Inside America’s Race To Build The Next Generation Of AI Chips

By CNBC

Share:

Here's a comprehensive summary of the provided YouTube video transcript:

Key Concepts

  • Extreme Ultraviolet (EUV) Lithography: A critical semiconductor manufacturing technology using extremely short wavelength light (13.5 nm) to print nanoscopic patterns onto silicon wafers.
  • High Numerical Aperture (High NA) EUV: The next generation of EUV machines, featuring larger lenses that increase the aperture angle, allowing for higher resolution and printing smaller features in a single exposure step.
  • Deep Ultraviolet (DUV) Lithography: An older generation of lithography machines using longer wavelength light (193 nm), still widely used for less advanced chip layers.
  • Wafer: A thin, circular slice of silicon on which semiconductor chips are fabricated.
  • Transistors: The fundamental building blocks of microchips that control electrical signals.
  • Photoresist: Light-sensitive chemicals coated on wafers that change their properties when exposed to light, allowing patterns to be transferred.
  • Mask: A template containing the chip design, used in lithography to project patterns onto the wafer.
  • Numerical Aperture (NA): A measure of the light-gathering ability of an optical system, directly related to resolution. Higher NA means better resolution.
  • Node: Refers to the manufacturing process size (e.g., 7nm, 3nm), generally indicating the density and complexity of transistors.
  • Analog Chips: Process real-world signals like sound, light, and pressure.
  • Embedded Chips: Microcontrollers and signal processors that operate everyday devices.
  • Custom Silicon: Chips designed and optimized by a company for its specific products (e.g., Apple's A-series chips).
  • On-Device AI: Artificial intelligence processing that occurs directly on a device, prioritizing privacy and efficiency.
  • Tariffs: Taxes imposed on imported goods, a significant factor influencing the semiconductor industry and manufacturing location decisions.
  • CHIPS Act: U.S. legislation providing funding and incentives to boost domestic semiconductor manufacturing.

ASML and the Future of Chipmaking

The $400 Million High NA Machine

  • Description: Behind a highly secured door in an ASML cleanroom lies a colossal, $400 million machine, larger than a double-decker bus. It is described as the "most advanced machine tool in history."
  • Significance: This machine represents a "very risky investment" for ASML, as there was no initial guarantee of its technological success.
  • Exclusivity: ASML is the sole manufacturer of Extreme Ultraviolet (EUV) lithography machines globally, a market they "completely cornered."
  • High NA Technology: The new generation of machines is called High NA, standing for High Numerical Aperture. This technology is crucial for printing "nanoscopic blueprints onto the most advanced chips."
  • Market Dominance: Companies like Nvidia, Apple, TSMC, Samsung, and Intel rely on EUV for their advanced chips.
  • Deployment: The first High NA machine was installed at Intel's Oregon fab. Only five have been shipped globally, with Intel, TSMC, and Samsung being the primary recipients.
  • Production Capacity: ASML aims to ramp up production to millions of chips on the factory floors of these companies. Other advanced chipmakers like Micron, SK Hynix, and Rapidus are also expected to use EUV.
  • AI Enablement: "Without EUV, without very advanced logic manufacturing, most of the AI cannot happen."

ASML's Journey and EUV Technology

  • Origins: ASML originated as a subsidiary of Philips in 1984, conducting research in a "leaky shed." It became an independent company with an IPO in 1995.
  • EUV Development: ASML's foray into EUV began around 1997, with a significant commitment made "three or four years later" to focus entirely on EUV. This was a "very risky investment" that took "practically more than 20 years" to develop.
  • EUV Mechanism:
    • Chips are built in layers on silicon wafers, with billions of transistors determining functionality.
    • Lithography uses precise rays of light projected through a mask onto a wafer coated with photoresist.
    • ASML's older DUV machines use 193 nm wavelength light. Competitors like Nikon and Canon are still active in DUV.
    • ASML's breakthrough was using EUV light with a much shorter wavelength of 13.5 nm, "the width of just five DNA strands laid side by side."
    • Light Source: EUV light is generated by vaporizing molten tin droplets with a CO2 laser. Four lasers are used to vaporize tin droplets, creating a plasma "hotter than the sun," which emits EUV photons.
    • Vacuum Environment: The entire system operates in a vacuum because EUV light is absorbed by most materials.
    • Optics: Specialized mirrors from Carl Zeiss, described as the "flattest man-made surfaces in the world," are used to direct the EUV light.
    • Precision: The accuracy required is immense, likened to "shining a laser from the moon to hit a coin on the Earth."
  • Market Share and Revenue: In 2024, EUV machines represented less than 8% of ASML's total machine sales (44 EUV vs. 374 DUV), but accounted for 38% of system sales revenue due to their high price ($220 million for EUV).
  • Moore's Law: ASML is driven by Moore's Law, aiming to "continue to drive costs down" to enable advancements to the next chip nodes.

High NA vs. Lower NA EUV

  • Development Timeline: High NA machines began development around 2016.
  • Key Difference: The primary advancement in High NA is the "increase the aperture of the opening angle of the lens."
  • Resolution Improvement: A larger lens opening (higher NA) allows for capturing increasingly small designs on masks and projecting them in a single exposure step.
  • Efficiency: Lower NA machines require multiple exposures and masks for higher resolution, a complex process that reduces yield. High NA improves resolution and reduces mask count, saving time and money.
  • Cost and Size: Higher NA necessitates larger mirrors and thus larger, more expensive systems.
  • Power Consumption: These machines consume significant power, with concerns about AI training potentially consuming all worldwide energy by 2035 if efficiency isn't improved. ASML has reduced energy per wafer exposure by over 60% since 2018.
  • Throughput: ASML machines print about 200 wafers per hour, with a goal of several hundred per hour, enabling millions of wafers per year.
  • Intel's Experience: Intel reported using High NA for about 30,000 wafers, finding it "twice as reliable as previous models."
  • Samsung's Experience: Samsung stated High NA could reduce cycle time by 60%.
  • Benefits of High NA: Shrinks chip size (more devices per wafer) and increases speed and yield by avoiding multiple patterning.
  • Layered Manufacturing: Chips are made of around 100 layers, with most using DUV, while EUV is for the most advanced layers.
  • Legacy DUV: DUV machines sell for $5 million to $90 million and still constitute over half of ASML's sales, with high demand for chips not requiring EUV.

Geopolitical and Trade Dynamics

  • China Export Controls: U.S. export controls prevent ASML from selling EUV machines to China, a ban initiated under the first Trump administration.
  • China's Capabilities: While China cannot easily enter the EUV space, they are successfully scaling advanced nodes (like 7nm) without EUV for smartphones and personal devices.
  • Stockpiling: China has stockpiled ASML's less advanced machines. ASML's business in China decreased from a peak of 49% to 30% by the last quarter of 2024 due to order backlogs being fulfilled globally.
  • Generative AI Race: The demand for chips and manufacturing machines has soared due to the AI race.
  • Trump's Tariffs: New promises of 100% tariffs on chips from companies not manufacturing in the U.S. create uncertainty. ASML is unsure of the impact and expects to advocate for minimal tariffs on their machines.
  • Global Supply Chain: ASML's complex network of 800 global suppliers and the worldwide shipping of its machines (requiring seven Boeing 747s and 25-30 trucks for High NA) complicate tariff impacts.
  • U.S. Market Growth: Asia has historically been over 80% of ASML's business, but the U.S. share (around 17% in 2024) is growing, driven by Intel and TSMC's new fabs.
  • ASML Workforce: ASML's global workforce grew from 32,000 in 2022 to 44,000, with 8,500 in the U.S.
  • U.S. Facilities: ASML has 18 global offices in the U.S., including manufacturing and R&D sites.
  • Training Facilities: ASML is opening its first U.S. training facility in Arizona to train 1,200 people annually on EUV DPOF.
  • Next Generation: Hyper NA: ASML is developing Hyper NA machines, expected within ten years (2032-2035), with potentially higher costs.

Texas Instruments (TI) and Domestic Chip Manufacturing

TI's Ambitious Expansion in North Texas

  • Project Scope: Texas Instruments is undertaking a $60 billion, seven-plant project in North Texas, with the campus eventually being larger than 70 football fields.
  • Strategic Bet: TI is making a "big bet that companies will want to make a lot of chips on U.S. Soil."
  • Apple Partnership: Apple has committed to making critical foundational chips for iPhones and other devices at TI's new fabs, supporting tool installations.
  • Sherman Fab SM1: The first operational cleanroom in Sherman, Texas, is in qualification and expected to enter full production by year-end.
  • TI's Chip Focus: TI does not produce the world's most advanced chips (like 2-3nm nodes) but focuses on "analog and embedded chips" made on "cheaper legacy nodes: 45 to 130 nanometer." This is considered the "sweet spot" for performance and voltage requirements.
  • Analog Chips: Process real-world signals (sound, light, pressure).
  • Embedded Chips: Signal processors and microcontrollers for everyday devices (toasters, dishwashers, anti-lock brakes).
  • Customer Base: TI's primary customers are in the industrial and automotive sectors. They have over 100,000 customers and 80,000 products, with chips found in most devices with a plug, battery, or cord.
  • Tesla Model 3: TI has significant content in vehicles like the Tesla Model 3.

Historical Significance and Manufacturing Strategy

  • Founding: TI was founded in 1930 as Geophysical Service Incorporated, later reimagined as Texas Instruments in 1951.
  • Integrated Circuit: TI engineer Jack Kilby filed the first patent for an integrated circuit in 1958, revolutionizing miniaturization.
  • 300mm Fab for Analog: In 2009, TI opened the world's first 300mm fab for analog chips, repurposing a memory fab. This provided a significant "cost advantage" as a 300mm wafer yields about 2.3 times more chips than a 200mm wafer.
  • Scale and Efficiency: TI is one of the few companies that designs, develops, and manufactures semiconductors across the entire value chain at the scale of 300mm.
  • Fab Consolidation: TI is closing/selling 200mm fabs to transition to 300mm, with all seven new fabs planned for 300mm production.
  • Market Position: TI claims to be the country's biggest analog and embedded semiconductor manufacturer, selling tens of billions of chips annually at affordable prices (e.g., $0.40 compared to Nvidia's $35,000 GPU).
  • AI Support: TI's affordable chips play critical supporting roles in AI, including a partnership with Nvidia to improve efficiency in data centers.
  • Chip Shortage Impact (2020): The auto and industrial sectors were hit hard by the chip shortage, with TI unable to meet demand for its low-cost parts, leading to factory shutdowns for customers. This prompted TI's massive capacity expansion.

Tariffs, Global Footprint, and U.S. Incentives

  • Tariff Concerns: TI shares plunged in July due to concerns about tariffs impacting demand. Some see TI as a "tariff winner" because domestic manufacturing becomes more cost-competitive against foundries in Taiwan.
  • Global Operations: Despite significant U.S. investment (75% of capex), TI also manufactures chips at four fabs abroad (Germany, Japan, China) and has testing/assembly in Mexico, Taiwan, the Philippines, and Malaysia.
  • International Sales: About 60% of TI's revenue comes from outside the U.S., with China accounting for 20%, exposing them to geopolitical tensions and tariffs.
  • Resilience: TI's global footprint across 15 sites allows them to support customers in various political and economic environments.
  • Sherman Site Selection: Sherman, Texas, was chosen over Singapore for its independence, local sourcing capabilities, and existing infrastructure.
  • Local Support: Sherman provided incentives like tax offsets and water rate discounts to retain TI.
  • Federal and State Funding: TI received $1.6 billion in CHIPS Act funding and a 35% investment tax credit. Texas also passed the Texas CHIPS Act, offering incentives.
  • Resources in Sherman: Sherman offers crucial resources like water (from Lake Texoma, with water rights and treatment capabilities) and electricity, with the new 300mm manufacturing driving energy efficiency.
  • Water and Power: Chip manufacturing is water and power-intensive. TI aims for at least 50% water recycling, potentially up to 80%. The Sherman factory will use 100% renewable energy.
  • Grid Reliability: Texas's independent grid faced issues in 2021. TI built redundancy into its facilities with multiple transmission lines, diesel storage, and generators. Sherman also has a local power plant.
  • Talent Pipeline: The decline in U.S. semiconductor manufacturing share has made skilled engineers scarce. TI partners with universities and the military for workforce development.
  • Job Creation: TI projects creating 60,000 U.S. jobs with its $60 billion expansion.
  • Capacity vs. Demand: The massive increase in capital expenditure relies on TI regaining market share and demand "rocketing back."

Apple's Custom Silicon and AI Strategy

The A19 Pro Chip and On-Device AI

  • iPhone Air and 17 Pro: The new iPhone Air (5.6mm, thinnest ever) and iPhone 17 Pro feature Apple's most advanced chip yet, the A19 Pro.
  • A19 Pro Integration: The A19 Pro is located near the vapor chamber and includes "neural accelerators inside the six GPU cores" to power on-device AI.
  • Developer Tools: Apple provides software developers with tools to integrate AI "naturally into every application."
  • Performance: The integration of neural processing achieves "MacBook Pro class performance inside an iPhone."
  • Apple's Control: Apple is moving towards controlling the "full stack of silicon inside the phones," allowing for optimized solutions beyond merchant silicon parts.
  • Wall Street Concerns: Apple faces pressure regarding its AI strategy, with questions about its ability to compete with OpenAI and Google. Apple aims for the iPhone to be the "best place for developers to run their AI."
  • On-Device AI Importance: Prioritizes privacy, efficiency, and user control over the experience.
  • GPU Architecture: The A19 Pro integrates neural processing into GPU cores, allowing programmers to switch between 3D rendering and neural processing instructions seamlessly. This capability was previously lacking in GPUs but is now present, similar to Nvidia's approach.
  • Neural Engine: Apple's original AI hardware, the Neural Engine, was introduced in 2017. The A19 Pro enhances this by adding neural accelerators to GPU cores, akin to tensor cores for matrix math.
  • AI in Graphics: The GPU's AI capabilities can enhance imaging quality and rendering efficiency in graphics-intensive applications like gaming.
  • Investor Signal: The inclusion of neural accelerators across all chips, including entry-level models, signals Apple's architectural changes for AI, both on-device and potentially in hybrid-cloud solutions.
  • Private Cloud Compute: Apple is developing its private cloud compute capabilities.

New Modems and Wireless Chips

  • N1 Chip: Apple's first in-house wireless and Bluetooth chip, the N1, is in the iPhone Air and the entire 17 lineup.
  • C1X Modem: An updated Apple modem, the C1X, is in the iPhone Air. It's twice as fast and uses 30% less energy than the Qualcomm modem in the iPhone 16 Pro.
  • Supplier Shift: The N1 chip replaces Broadcom chips, and the C1X modem is an Apple-designed alternative to Qualcomm modems.
  • Full Silicon Stack Control: Apple now controls "all of the core chips in its own phone," a goal pursued since day one.
  • Co-design Capabilities: Apple can co-design its SoC (A19 Pro) with N1 for power management, allowing the application processor to remain mostly asleep while wireless functions operate efficiently.
  • Location Tracking: Co-designed interfaces in N1 enable low-energy processing for background tasks like high-accuracy location tracking, reducing reliance on power-intensive GPS.
  • Licensing Deals: Apple continues licensing deals with Broadcom for technology.
  • Future Rollout: Apple expects to see its cellular solutions (modems, wireless/Bluetooth chips) in more products, including Macs and iPads, within the next two years.
  • Modem Performance: While Apple's modems may not yet match Qualcomm's overall throughput and performance, they offer control and lower power consumption, leading to better battery life. This control is crucial for miniaturization in future form factors like smart glasses.
  • Qualcomm's Position: Qualcomm has long anticipated this shift and is not significantly impacted, as their Snapdragon line remains dominant in high-end Android smartphones.

Manufacturing and Supply Chain Considerations

  • A19 Pro Manufacturing: The A19 Pro is manufactured at TSMC's three-nanometer node.
  • TSMC Arizona Fab: TSMC is working towards three-nanometer production in its Arizona fab by 2028, but leading-edge production currently remains in Taiwan.
  • Geopolitical Risk: Reliance on Taiwan for manufacturing poses geopolitical risk for Apple.
  • U.S. Manufacturing Push: Apple is leading the creation of an end-to-end silicon supply chain in America, committing to manufacturing in the U.S. amidst tariff threats.
  • Intel as a Future Option: Apple will seriously consider Intel for future chip manufacturing if Intel's 14A process delivers on its promises.
  • TSMC's U.S. Expansion: Apple is excited about TSMC's push into U.S. manufacturing, which offers time zone advantages and supply chain diversity.
  • Investment in U.S. Silicon: There is a significant investment of $600 billion in the U.S. over the next four years, with hopes that a substantial portion will go towards custom silicon.
  • Thermal Management: The iPhone Air's design, including a raised plateau for the camera and a vapor chamber in Pro models, aids in thermal dissipation for the custom chips, addressing overheating concerns from the iPhone 15. The unibody aluminum design and laser-welded vapor chamber enhance heat dissipation.
  • External Dependencies: Apple still relies on other suppliers for components like memory (Samsung) and analog chips (Texas Instruments).

Chat with this Video

AI-Powered

Load the transcript when you're ready to chat so the initial page stays lighter.

Ready to summarize another video?

Summarize YouTube Video