Elon Musk called synthetic data the next stage in the development of AI
January 13, 2025
Elon Musk agreed with the statements of other experts regarding the fact that there is little real data left for training AI models.This is reported by TechCrunch.
"Now we have exhausted almost the entire body of human knowledge in the field of AI training. This happened last year," he said during a conversation with Stagwell Chairman of the Board of Directors Mark Penn.
In December, Ilya Sutskever, co-founder of OpenAI and founder of the AI startup Safe Superintelligence, said that the industry has reached a peak in data usage. In his opinion, AI agents, synthetic information and accelerated computing are the next stage in the evolution of artificial intelligence, which will lead to the emergence of superintelligence.
Musk sees synthetic data—information generated by artificial intelligence—as the way forward.
"The only way to complement [real—world information] is with synthetic data, when AI creates [training information]. With such materials, [AI] will sort of evaluate itself and go through this self—learning process," the entrepreneur added.
In 2024, the AI startup Anthropic used synthetic data to train one of its flagship Claude 3.5 Sonnet models. Meta has refined its Llama 3.1 neural networks with the help of AI-created materials. OpenAI also uses synthetic information to train o1— a "reasoning" artificial intelligence.
AI startups have started looking for new ways to scale due to the lack of high-quality data.
"Now we have exhausted almost the entire body of human knowledge in the field of AI training. This happened last year," he said during a conversation with Stagwell Chairman of the Board of Directors Mark Penn.
In December, Ilya Sutskever, co-founder of OpenAI and founder of the AI startup Safe Superintelligence, said that the industry has reached a peak in data usage. In his opinion, AI agents, synthetic information and accelerated computing are the next stage in the evolution of artificial intelligence, which will lead to the emergence of superintelligence.
Musk sees synthetic data—information generated by artificial intelligence—as the way forward.
"The only way to complement [real—world information] is with synthetic data, when AI creates [training information]. With such materials, [AI] will sort of evaluate itself and go through this self—learning process," the entrepreneur added.
In 2024, the AI startup Anthropic used synthetic data to train one of its flagship Claude 3.5 Sonnet models. Meta has refined its Llama 3.1 neural networks with the help of AI-created materials. OpenAI also uses synthetic information to train o1— a "reasoning" artificial intelligence.
AI startups have started looking for new ways to scale due to the lack of high-quality data.