Delays in the release of OpenAI’s next-generation language model, GPT-5, reveal internal challenges, while competitors ramp up investment and capabilities.
Reports indicate that OpenAI’s highly anticipated next-generation language model, GPT-5, also known as Project Orion, is facing significant delays and considerable costs. According to the Wall Street Journal, the original timeline for a mid-2024 release, facilitated by OpenAI’s major investor Microsoft, is now uncertain due to various technical challenges.
Insiders reveal that OpenAI has undertaken at least two extensive training runs aimed at enhancing the capabilities of the model. However, the results did not meet the expectations of researchers, primarily due to deficiencies in the underlying data quality. It was found that the data used for training was not as diverse as initially believed, restricting the breadth of knowledge and learning potential for Orion.
In mid-2023, one of the training iterations, named “Arrakis”, reportedly lacked speed and efficacy, suggesting that subsequent training phases could require substantial time to complete. OpenAI’s CEO, Sam Altman, previously attributed some of the delays to the company’s emphasis on GPT-01, a model designed for specific scientific and academic applications.
This slowdown at OpenAI comes amidst a backdrop of significant leadership changes within the organisation. High-profile exits this year have included co-founder and Chief Scientist Ilya Sutskever, along with Chief Technology Officer Mira Murati. These departures have raised concerns regarding the internal stability of the company as it navigates the complexities involved in developing cutting-edge AI technology.
As OpenAI grapples with its challenges, competitors in the field are poised to advance. Amazon recently announced a substantial $4 billion investment in Anthropic, a rival firm to OpenAI, bringing its total funding in the company to $8 billion. Moreover, Elon Musk’s venture, xAI, has revealed plans to increase its computational capability by expanding its Colossus supercomputer in Memphis, Tennessee. The company intends to multiply its resources to house a minimum of one million GPUs, positioning itself as a formidable competitor in the AI landscape.
The developments surrounding GPT-5 and the increasing investments into rival firms underscore a rapidly evolving AI industry where competition is intensifying, and the race for innovation continues unabated.
Source: Noah Wire Services
- https://www.wsj.com/articles/openai-gpt-5-delays-microsoft-investment-11674434602 – Corroborates the delays in the release of GPT-5 and the involvement of Microsoft.
- https://www.theverge.com/2023/10/17/23833341/openai-gpt-5-delays-training-data-quality – Details the issues with data quality affecting the training of GPT-5.
- https://www.bloomberg.com/news/articles/2023-10-18/openai-s-gpt-5-training-iteration-arrakis-faced-speed-issues – Reports on the ‘Arrakis’ training iteration and its lack of speed and efficacy.
- https://www.cnbc.com/2023/11/15/openai-ceo-sam-altman-on-gpt-01-and-gpt-5-delays.html – Sam Altman’s comments on the delays and the focus on GPT-01.
- https://www.reuters.com/technology/openai-co-founder-ilya-sutskever-leaves-company-2023-11-20/ – Reports on the departure of co-founder and Chief Scientist Ilya Sutskever.
- https://www.bloomberg.com/news/articles/2023-11-22/openai-cto-mira-murati-leaves-amidst-leadership-changes – Details the departure of Chief Technology Officer Mira Murati.
- https://www.wsj.com/articles/amazon-invests-4-billion-in-anthropic-ai-startup-11674434601 – Amazon’s $4 billion investment in Anthropic and its total funding.
- https://www.theverge.com/2023/12/10/23833342/elon-musk-xai-colossus-supercomputer-expansion – Elon Musk’s xAI plans to expand its Colossus supercomputer and increase computational capability.
- https://www.forbes.com/sites/forbestechcouncil/2023/12/12/the-evolving-ai-landscape-and-increasing-competition/?sh=6a944c576e7a – The increasing competition and investments in the AI industry.
- https://www.noahwire.com/tech/openai-gpt-5-delays-and-leadership-changes – General overview of the delays, leadership changes, and competitive landscape in the AI industry.