OpenAI CEO Sam Altman opens up ChatGPT as a new kind of app store

Key Concepts

• Gigawatt (GW): A unit of power equal to one billion watts, used to measure the capacity of power plants or the energy consumption of large systems like data centers.
• Compute: Refers to computational power or resources, essential for running AI models and applications.
• Semiconductor Maker: A company that designs and manufactures semiconductor devices, commonly known as chips, which are the fundamental components of electronic devices.
• Ecosystem: In this context, a network of interconnected applications, services, and developers built around a core platform like ChatGPT.
• Directory: An app store or marketplace within the ChatGPT ecosystem where developers can list their applications.
• Infrastructure: The underlying physical and organizational structures and facilities (e.g., data centers, power grids) required for the operation of a large-scale technological system.

---

OpenAI's Massive Infrastructure Expansion and Energy Demands

OpenAI, the parent company of ChatGPT, is undertaking an unprecedented infrastructure build-out, described as "one of the greatest tech build out stories in human history." This expansion is driven by the escalating demand for computational power ("compute") to support its AI models and a rapidly growing developer ecosystem.

Key Deals and Figures:

• AMD Partnership: OpenAI and its CEO, Sam Altman, are reportedly pursuing a potential 10% stake in semiconductor maker AMD. This deal also includes a commitment for up to six gigawatts (GW) of data center chip power from AMD. The first gigawatt, equivalent to the electricity consumption of approximately 750,000 homes, is expected to come online in the second half of next year.
• Cumulative Compute Commitments: This AMD deal is additive to previous mega-deals, bringing OpenAI's total announced compute power commitments to an astronomical level:
  • 10 GW build-out with Nvidia.
  • 7 GW build-out with Oracle and SoftBank.
  • Total: 23 GW across AMD, Nvidia, Oracle, and SoftBank.

Magnitude of Energy Requirement:

The combined 23 GW requirement is equivalent to the power output of 23 nuclear reactors. This figure highlights a significant challenge, especially given that currently, "zero new nuclear power plants" and "zero new natural gas plants" are under construction in the United States, raising questions about the source of this immense power.

The Compute Bottleneck and Developer Ecosystem

Despite the massive investments, OpenAI is currently facing a "compute" bottleneck, which is hindering its product development and launch schedule.

Impact of Insufficient Compute:

• OpenAI President Greg Brockman stated that "several updates to ChatGPT, and there are also new products in-house that they aren't launching because they don't have sufficient compute." This underscores the critical need for the ongoing infrastructure expansion.

Empowering the Developer Ecosystem:

A core focus of OpenAI's strategy is to empower its 4 million developers who are building on top of ChatGPT's architecture.

• Open ChatGPT for Developers: Sam Altman announced that OpenAI is opening up ChatGPT, allowing any developer to create applications inside the ChatGPT ecosystem.
• The "Directory" App Store: These developer-created applications can then apply to become part of a new app store, which OpenAI is calling "the directory." This initiative aims to foster innovation and expand the utility of ChatGPT through third-party integrations.

Addressing the Global Power Challenge

The unprecedented demand for electricity to power OpenAI's data centers is a major concern, prompting the company to explore diverse energy solutions.

Nuclear Power as a Partial Solution:

• OpenAI's head of infrastructure confirmed that "nuclear is a part of solving for the equation," acknowledging its potential. However, he also explicitly stated that it is "not enough" to meet the full demand.

Global Grid Engagement:

• To secure the necessary power, OpenAI is actively "talking to grids around the world," indicating a global strategy to source and manage its energy requirements. This highlights the global scale of the challenge and OpenAI's proactive approach to securing energy resources beyond traditional domestic options.

Conclusion

OpenAI is embarking on an "astronomical" infrastructure build-out, securing 23 GW of compute power through partnerships with AMD, Nvidia, Oracle, and SoftBank, equivalent to 23 nuclear reactors. This expansion is crucial to support its 4 million developers and the new "directory" app store, as current compute limitations are delaying new product launches. The immense energy demand poses a significant challenge, with OpenAI actively engaging with global power grids and considering nuclear energy, though acknowledging it's not a singular solution. This effort represents a pivotal moment in technological history, reshaping the landscape of AI and global energy consumption.