Smaller
Distillation Can Make AI Models Smaller and Cheaper
The original version of this story appeared in Quanta Magazine. The Chinese AI company DeepSeek released a chatbot earlier this year called R1, which drew a huge amount of attention. Most of it focused on the fact that a relatively small and unknown company said it had built a chatbot that rivaled the performance of…
“Rather Than Investing $10 Billion Into A Mega Fab In One City, We Could Build Smaller, Decentralised Fabs Across The Country” – Raja Manickam, iVP Semiconductor
– Advertisement – Amid a global reset in semiconductor strategy, India’s clean-slate advantage lies in frugal innovation, chiplet architecture, and agile microfabs. With no legacy constraints, we havethe freedom to shape the future rather than imitate the past. Raja Manickam, Founder and CEO iVP Semiconductor “There is an Indian in every chip,” I often say,…