AI Kosh: India’s AI Data Repository for Large Language Models (LLMs)

Why in news?

India unveiled its library of non-personal data sets, called AI Kosh, to help companies build large language models (LLMs), the latest step by the Centre to help scale up the growth of artificial intelligence (AI) in the country.

Introduction

• AI Kosh is India’s first large-scale non-personal data repository, launched to accelerate AI and Large Language Model (LLM) development.
• It is part of the IndiaAI Mission, supporting the country’s vision to scale AI innovation and reduce reliance on foreign AI models.

Key Features

• 316 datasets focused on Indian language translation models.
• Structured datasets from Census data, satellite imagery, meteorological data, and pollution data.
• Supports AI model training and validation through curated datasets.

IndiaAI Datasets Platform

• One of the seven pillars of the IndiaAI Mission.
• ₹10,370 crore investment to strengthen AI infrastructure and research.
• Helps Indian AI firms train models on datasets relevant to India.

Expansion & GPU Access

• 14,000 GPUs allocated for shared AI computing resources.
• 10,000 additional GPUs to be introduced in the next year.
• Quarterly updates to datasets and computing power for AI research scalability.

Government’s Vision

• Public dataset aggregation for AI research and model training.
• The Chief Data Officers’ Committee ensures data quality, security, and governance.
• Over 12,000 datasets available on data.gov.in, sourced from government agencies.

Building India’s Own AI Model

• Inspired by DeepSeek AI (China’s foundational AI model).
• Collaboration with Sankhya Labs, OpenAI India, Google India, and domestic AI startups.
• Goal: Develop India’s indigenous large-scale AI model for global competitiveness.

Industry Impact & Future Scope

• Empowers Indian AI startups and research institutions.
• Reduces dependency on foreign AI models and datasets.
• Strengthens India’s position as a global AI leader.

Conclusion

• AI Kosh is a transformational initiative for India’s AI-driven future.
• By providing structured datasets, computational resources, and government-backed AI initiatives, India is set to emerge as a global AI powerhouse.