OpenAI Co-Founder Predicts End Of AI Pre-Training Era At NeurIPS 2024

According to Odaily, OpenAI co-founder Ilya Sutskever recently delivered a speech at the NeurIPS 2024 conference in Vancouver, Canada, where he discussed the impending conclusion of the AI pre-training era and the anticipated rise of superintelligent AI. Sutskever highlighted that the pace of advancements in computing power, driven by improved hardware, software, and machine learning algorithms, has surpassed the availability of data for training AI models. He likened data to fossil fuels, suggesting that it will eventually be depleted. Sutskever explained, "Data is not growing because we only have one internet. You could even say data is the fossil fuel of AI. It was created in a certain way, and now we are using it. We have reached peak data, and there will be no more—we must work with what we have." He emphasized that the current data resources are finite, and the industry must adapt to this limitation. Looking ahead, Sutskever predicted that the future of AI development will focus on agent AI, synthetic data, and inference-time computation. These areas are expected to drive the next phase of AI evolution, ultimately leading to the emergence of superintelligent AI. His insights suggest a shift in the AI landscape, where innovation will be necessary to overcome the challenges posed by limited data resources.