Ziroh Labs, an artificial intelligence startup operating in India, collaborated with researchers at the country’s premier technology school to design an affordable system that it says can run large AI models without requiring advanced computing chips from the likes of Nvidia.
The company’s framework, called Kompact AI, was developed in partnership with the Indian Institute of Technology, Madras. Ziroh Labs said the platform enables AI to run on the central processing units (CPUs) found in everyday computing devices as opposed to the coveted, and costly, graphics processing units (GPUs) that have been the linchpin of the artificial intelligence boom.
A growing number of AI developers have touted efficiency gains that let them use fewer chips in the months following the viral success of China’s DeepSeek, which purportedly built a competitive AI model for a fraction of the cost of its US peers. Ziroh Labs’ approach primarily focuses on the process of inference, or operating AI systems after they’ve been trained.
Ziroh Labs said it can optimize leading AI models to run on personal computers. In a demonstration event this week, the team of researchers showed their product working on a laptop that uses a shelf-bought Intel Xeon processor and querying models such as Meta Platforms’ Llama 2 and Alibaba Group Holding’s Qwen2.5.
Other tech firms have also used CPUs to handle some inference workloads. Ziroh Labs said its approach leads to high-quality results. The startup said its technology has been tested by US chipmakers Intel and Advanced Micro Devices.
“It’s going to have a very profound market impact in the years ahead,” said William Raduchel, former chief strategy officer of Sun Microsystems and a tech adviser to the startup who spoke virtually at the event.
As in other countries, developers in India have struggled to afford, and get access to, top-of-the-line Nvidia chips to help build and support AI products. The shortage of GPUs risks hindering the speed and scale of local AI research and deployment.
“The AI divide is because only those with high-end expensive GPU-powered resources can access, develop and deploy powerful AI,” said V. Kamakoti, director at the Indian Institute of Technology, Madras. “We’re demonstrating that you don’t need a revolver to kill a mosquito.”
© 2025 Bloomberg LP
About The Author
