Movim • KTransformers Adds AVX2 MoE Support For Viable Performance On CPUs Without AMX/AVX-512

Ph chevron_right

KTransformers Adds AVX2 MoE Support For Viable Performance On CPUs Without AMX/AVX-512

news.movim.eu / Phoronix • 2 April 2026

KTransformers 0.5.3 released today for this framework for efficient inferencing and fine-tuning of large language models (LLMs) with a focus on CPU-GPU heterogeneous computing. With this release, KTransformers 0.5.3 is now more applicable for CPUs lacking Advanced Matrix Extensions (AMX) and AVX-512 in now providing some AVX2-only kernels too...