Intel recently released its open-source NPU Acceleration Library, which enables small LLMs on Meteor Lake CPUs.
Intel’s NPU Acceleration Library goes open source — Meteor Lake CPUs can now run TinyLlama and other lightweight LLMs
Posted in computing