Framework
-
AI
Pruna AI open sources its AI model optimization framework
Pruna AIA European startup that has worked on compression -algorithms for AI models, makes its optimization framework Source On Thursday.…
Read More » -
AI
Microsoft’s Inference Framework Brings 1-Bit Large Language Models to Local Devices
On October 17, 2024, Microsoft has announced BitNet.cppan inference framework designed to output 1-bit quantized large language models (LLMs). BitNet.cpp…
Read More »