Indeed, Musk suggested that synthetic data — data generated by AI models themselves — is the path forward. “The only way to supplement [real-world data] is with synthetic data, where the AI creates [training data],” he said. “With synthetic data … [AI] will sort of grade itself and go through this process of self-learning.”

Elon Musk says he's worried that "we’ve exhausted basically the cumulative sum of human knowledge" for training AIs. The solution: just have the AI make something up. The Latest Tech News, Delivered t

Elon Musk, owner of AI firm xAI, has agreed with other AI experts that the pool of real-world data to train AI models is almost empty. Speaking during a live-streamed discussion with Stagwell Chairman Mark Penn, Musk said, "We've now exhausted basically the cumulative sum of human knowledge... in AI training. That happened basically last year."

Elon Musk and other experts in the field of artificial intelligence believe that we have exhausted AI training data.

Musk shared some data on X that appears to bolster his case at first glance, but it actually shows the opposite.