Pruna AI has released its AI model optimization framework as open-source on GitHub, aimed at reducing costs and increasing speed through model compression.
This move comes in response to the rising demand for efficient and affordable AI tools in the tech and crypto industries.
In December 2024, Hugging Face, a key player in AI model hosting, rolled out its optimization toolkit, “Optimum,” to shrink large language models.
The AI ecosystem is rapidly evolving with new specialized hardware and optimizations. Optimum allows developers to utilize these platforms efficiently, similar to Transformers. In October 2024, Meta AI released a distilled version of its Llama model, reducing resource needs by 30%. This decision received mixed reactions, with startups praising it and researchers criticizing the limited access to the model.
Pruna AI addresses critiques by going fully open-source, a move praised by Scenario CEO Emma Lawler as it benefits smaller firms. Their framework boasts significant efficiencies, claiming an eightfold reduction in the size of a Llama model, enhancing its competitiveness. Enterprise clients like PhotoRoom have already experienced benefits since mid-2024, with the CTO stating that Pruna’s technology has halved their server costs. The recent release now makes these advantages accessible to all.
Meanwhile, crypto insiders see parallels. Recently, Binance Labs tweeted about exploring AI to optimise blockchain analytics, hinting at a rising interest in leaner models.
On February 18, 2025, Musk and the xAI team introduced the Grok 3 model, claiming it excelled in various AI evaluation tests at the World Governments Summit in Dubai. Musk referred to Grok 3 as “scary smart” and stated it outperformed all existing models, achieving the highest ELO score on the LMSYS Chatbot Arena tests. The model also excelled in the American Invitational Mathematics Examination (AIME), Graduate-Level Google-Proof Q&A (GPQA), and LiveCodeBench, surpassing competitors like OpenAI’s GPT-40 and Google’s Gemini-2 Pro.
If you want to read more news articles like this, visit DeFi Planet and follow us on Twitter, LinkedIn, Facebook, Instagram, and CoinMarketCap Community.
“Take control of your crypto portfolio with MARKETS PRO, DeFi Planet’s suite of analytics tools.”
