How Samsung Missed the AI Moment

Key Concepts:

• Samsung Group: South Korean conglomerate with diverse businesses, including electronics, shipbuilding, and construction.
• DRAM (Dynamic Random Access Memory): Computer memory chips crucial for various devices.
• HBM (High-Bandwidth Memory): Advanced DRAM ideal for AI applications due to its high-speed data processing capabilities.
• SK Hynix: South Korean semiconductor company, a major competitor to Samsung, particularly in HBM.
• TSMC (Taiwan Semiconductor Manufacturing Company): Dominant player in the global foundry market, manufacturing chips for other companies.
• Nvidia: Leading designer of AI chips, a key customer for HBM manufacturers.
• Foundry Business: Manufacturing chips designed by other companies.
• AI (Artificial Intelligence): Driving demand for high-performance memory solutions like HBM.

Samsung's Crisis: An Overview

Samsung, a dominant force in South Korea's economy and a global leader in electronics, faces significant challenges. The company's reliance on its semiconductor business, particularly DRAM, has made it vulnerable to market shifts and competition. A key issue is Samsung's slow response to the growing demand for HBM, which has allowed SK Hynix to gain a competitive edge.

The Importance of Samsung to South Korea

• Economic Influence: Samsung accounts for approximately one-fifth of South Korea's exports, making it a critical component of the national economy.
• Ubiquitous Presence: Samsung's influence extends to various aspects of life in South Korea, from healthcare (Samsung Hospital) to education (Samsung schools) and housing (Samsung apartments).
• National Identity: The company is deeply intertwined with South Korea's national identity, and its success is seen as vital to the country's well-being. "It is probably the most influential company in Korea because of the importance to the economy."

The Semiconductor Business and the Rise of HBM

• DRAM Dominance: Samsung has historically dominated the DRAM market, with its semiconductor business contributing 50-70% of the company's profits.
• AI's Impact: The rise of AI and large language models has created a surge in demand for high-bandwidth memory (HBM), which is essential for AI accelerators.
• SK Hynix's Advantage: SK Hynix anticipated the demand for HBM and invested in its development, securing a crucial partnership with Nvidia.

SK Hynix's Success with Nvidia

• Nvidia Partnership: SK Hynix became a major supplier to Nvidia, providing approximately 20% of Nvidia's cost of goods sold.
• Record Profits: SK Hynix has experienced record quarterly profits driven by its dominance in the HBM market, leading to a surge in its stock value.
• Samsung's Lag: Samsung's HBM chips have not met Nvidia's requirements, resulting in a significantly smaller share of Nvidia's business (around 1%).

Samsung's Response and Challenges

• Market Share Loss: Samsung has lost its leading position in the DRAM market to SK Hynix, ending a three-decade dominance.
• Executive Apology: The Vice Chairman of Samsung's chips division issued a rare apology, acknowledging the company's shortcomings.
• HBM4 Push: Samsung is now focusing on developing next-generation HBM4 chips to close the gap with SK Hynix.
• Foundry Competition: Samsung's foundry business faces intense competition from TSMC, which controls about two-thirds of the global market. Samsung has about 8% market share.

Foundry Business and the Tesla Deal

• Tesla Pact: Samsung secured a $16.5 billion deal with Tesla to produce its next-but-one generation of AI semiconductors.
• Significance: While the annual impact may be limited, the deal is considered significant for Samsung's foundry business, which has been perceived as dormant.

The Broader Chip Market and Lessons Learned

• TSMC's Dominance: TSMC is increasingly dominating the logic chip market, posing a challenge to Samsung.
• Intel's Example: The decline of Intel, once the world's largest chip maker, serves as a cautionary tale for Samsung.
• Continuous Innovation: The chip industry requires constant innovation and investment to maintain competitiveness. "I think there is a bit of a lesson that we can learn from all these giants that you know you are successful today, doesn't mean that you are successful tomorrow."

Conclusion

Samsung faces a critical juncture as it navigates challenges in the semiconductor market. The company's slow response to the demand for HBM has allowed SK Hynix to gain a competitive advantage. Samsung is now making efforts to catch up, particularly with its HBM4 development and foundry partnerships. The company's success in these areas will be crucial to maintaining its position as a global technology leader and its importance to the South Korean economy.