Where Samsung stands in the AI race

Key Concepts

• Artificial Intelligence (AI) Boom: The recent surge in development and adoption of AI technologies across various sectors.
• High Bandwidth Memory (HBM): A type of DRAM memory chip that is vertically stacked to increase data processing speed, crucial for AI computing.
• Graphics Processing Unit (GPU): Specialized electronic circuits designed to rapidly manipulate and alter memory to accelerate the creation of images in a frame buffer intended for output to a display device. GPUs are key components in AI computing.
• Samsung Galaxy Smartphones: Samsung's line of smartphones that are integrating AI functions.
• Samsung Galaxy XR: Samsung's extended reality headset offering immersive experiences.
• SK Hynix: A South Korean semiconductor supplier and a leading competitor in the HBM market.
• Nvidia: A major technology company that designs GPUs and is a key customer for HBM.
• OpenAI: An artificial intelligence research laboratory that is also a significant player in the AI space and a potential customer for HBM.
• Stargate Project: OpenAI's initiative to build data centers in the US, requiring substantial HBM.

Samsung and the AI Boom: Navigating the Shifting Landscape

This episode of Tech Latest from Nikke Asia delves into Samsung's strategic positioning and challenges within the burgeoning artificial intelligence (AI) boom, with a particular focus on their advancements in AI memory chips. Host Katie Creel speaks with Nikkei Asia correspondent Kim Jay Wong, who is reporting from the Apex Summit in Chongju.

Samsung's Broader AI Integration Beyond Memory Chips

Even before the significant push into AI memory, Samsung has been actively investing in AI technologies across its diverse product portfolio. The company integrates AI capabilities into its smartphones and home appliances, often by collaborating with external AI tools.

• Smartphones: Samsung's Galaxy smartphones feature AI functions, such as real-time translation of foreign languages during phone calls. This allows users to communicate more seamlessly across language barriers.
• Home Appliances: Refrigerators are now equipped with AI displays that can provide weather updates and schedule briefings in the morning, moving beyond their traditional cooling function.

Extended Reality (XR) and Immersive Experiences

Samsung has also ventured into the extended reality (XR) market with its Galaxy XR headset.

• Galaxy XR Headset: This device offers immersive experiences, allowing users to virtually attend concerts or watch sports games as if they were physically present in the venue.
• AI-Powered Recommendations: The XR headset utilizes AI to recommend restaurants and book venues, enhancing user convenience.
• Market Challenges: Despite its innovative features, the high price point of the Galaxy XR headset is identified as a potential barrier to widespread adoption, a challenge shared by similar offerings from Meta and Apple.

AI in Smartphones: Boosting Sales and Gaining Market Share

Samsung's early integration of AI into its smartphones has proven to be a strategic advantage, particularly in attracting younger consumers.

• Targeting Young Consumers: While iPhones are traditionally popular among young Koreans for their design and operating system, Samsung's AI-powered Galaxy phones are gaining traction.
• Integrated AI Services: The seamless offering of AI services directly within the phone, without requiring users to access separate AI applications, is a key differentiator that appeals to this demographic and contributes to Samsung's smartphone sales. This contrasts with Apple's slower approach to AI integration in its iPhones, which has reportedly led to some user dissatisfaction.

The Crucial Role of High Bandwidth Memory (HBM) in AI

The conversation shifts to Samsung's significant investment in High Bandwidth Memory (HBM), a critical component for AI computing.

• What is HBM? HBM is a type of memory chip that stacks multiple DRAM chips vertically. This architecture significantly accelerates data processing, which is essential for the demanding computational needs of AI.
• HBM and GPUs: HBM is crucial for enabling Graphics Processing Units (GPUs) to process data at extremely high speeds. GPUs are fundamental to AI computing.
• Market Demand: The escalating demand for AI computing has led to a surge in demand for GPUs and, consequently, for HBM.
• Nvidia's Dominance: Nvidia, a leading GPU manufacturer, is a primary driver of HBM demand. The ability to supply HBM to Nvidia translates into substantial revenue opportunities, potentially billions of dollars annually.

Samsung's HBM Journey: From Lagging Behind to Catching Up

Historically, the memory chip market, including HBM, was considered a commodity segment. However, the AI boom has transformed HBM into a cutting-edge and highly competitive area.

• SK Hynix's Early Lead: SK Hynix has a significant head start in HBM technology, having developed it for over a decade. This early focus, even when the market was small and primarily served the video gaming industry, has given them a leadership position.
• Samsung's Initial Underestimation: Samsung initially underestimated the potential of the HBM market, viewing it as a niche segment with limited profitability. This led them to fall behind SK Hynix in technological development.
• The AI Boom's Impact: The explosive growth in AI demand has created a massive market for HBM, allowing SK Hynix to capitalize on its early investments.

South Korean Stock Market and HBM

The HBM boom has had a significant impact on the South Korean stock market, with both SK Hynix and Samsung experiencing substantial gains.

• SK Hynix's Sustained Growth: SK Hynix has benefited from its long-standing relationship with Nvidia.
• Samsung's Recent Breakthrough: Samsung has recently secured approval from Nvidia to supply its HBM chips, a development that has boosted its stock price.
• OpenAI Partnership: Samsung has also signed a tentative deal with OpenAI to supply chips for its "Stargate" project, which involves building extensive data centers in the US. This diversification of customers is seen as a positive development for Samsung.
• Stock Performance: Samsung's stock has nearly doubled in value this year, reflecting the positive market sentiment surrounding its AI chip endeavors.

Technological Gap and Future Outlook

Despite Samsung's recent progress, a technological gap persists between Samsung and SK Hynix in the HBM market.

• SK Hynix's Continued Leadership: SK Hynix is considered to still lead the race, actively developing next-generation HBM models for supply next year.
• Supply Chain Dependencies: The HBM manufacturing process relies on specialized equipment and local suppliers with key technologies. SK Hynix has established strong relationships with these suppliers, which can be a barrier for Samsung.
• Analyst Projections: Some analysts estimate that it may take Samsung one to two years to fully catch up with SK Hynix.
• Internal Pressure at Samsung: The shift in market position has reportedly caused disappointment and pressure among Samsung employees who were accustomed to the company's long-standing dominance in the semiconductor industry.

Conclusion

Samsung is actively navigating the AI boom, integrating AI into its consumer products and making significant strides in the critical HBM memory chip market. While the company has overcome initial challenges and secured key partnerships with Nvidia and OpenAI, it faces a competitive landscape where SK Hynix currently holds a technological lead. The coming years will be crucial in determining Samsung's ability to close this gap and solidify its position as a leader in the AI hardware ecosystem.

For further insights, readers are encouraged to visit asia.nikkei.com and subscribe to the weekly Tech Asia newsletter.