intel /ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

★ 8,841⑂ 1,433
PythonCreated 2016-08-29
8,841
stars
1,433
forks
–
watchers
–
prs
–
issues
–
releases
–
discussions

Snapshot: 2026-11-10T09:35:25Z · Data license Apache-2.0 · JSON