18-Year Obsession to Build Fully Self-Driving AIㅣHelm.ai, Vlad Voroninski

EOAbout 3 min readMar 20, 2025Watch original
THE SUMMARYAI-generated

Helm AI: Achieving Fully Autonomous Driving Through a Unified Approach

Key Concepts:

  • Autonomous Driving (L2+, L4)
  • Unsupervised Learning
  • Generative AI
  • AI-based Simulation
  • Deep Teaching
  • Foundation Models (Vid Gen 1, World Gen 1)
  • Partial Automation vs. Full Automation
  • Disengagement Rates
  • Corner Cases
  • Production Contracts

Company Overview and Goals

Helm AI, led by CEO Li Berninski, is an AI software company focused on a unified approach to autonomous driving, spanning from L2+ to fully autonomous L4. The company aims to enable automakers to compete with Tesla by providing cutting-edge autonomous driving systems. Helm AI has raised over $100 million. The company's core focus is on AI-based simulation, leveraging generative AI and unsupervised learning to unify partial and full automation.

Li Berninski's Background and Motivation

Li Berninski's interest in self-driving cars began during his undergraduate studies at UCLA's computer vision lab. He pursued mathematics in academia for about 10 years, viewing it as a crucial tool for solving AI challenges. He returned to the autonomous driving space around 2016, recognizing the potential of deep learning and identifying inefficiencies in existing approaches.

Early Challenges and Strategic Decisions

Starting Helm AI coincided with the COVID-19 pandemic, which initially caused delays in the automotive industry. The company's first 10 hires were researchers. In the early days, Helm AI focused on unsupervised learning, which was considered a "pipe dream" by many. The company dedicated two years to pure R&D with zero product development, a risky but ultimately successful strategy.

Foundation Models and Performance

Helm AI developed foundation models before the term was widely adopted. These models were used to build an autonomous driving system that outperformed existing market solutions. In tests on steep and curvy mountain roads, Helm AI's system achieved disengagement rates up to 200 times better than competitors. This performance attracted the attention of major automakers.

AI-Based Simulation and Generative AI

Helm AI innovates in generative AI, combining it with its in-house "deep teaching" technology to bridge the gap between AI-based simulation and reality. AI-based simulation allows for the generation of driving data and sensor data without real-world driving. This is particularly advantageous for addressing difficult "corner cases" in autonomous driving, as the cost of gathering real-world data for these cases increases exponentially as the system improves. Simulation provides a scalable platform, especially for automakers lacking large fleets like Tesla.

Vid Gen 1 and World Gen 1

Helm AI has developed two key foundation models for generative AI simulation:

  • Vid Gen 1: Creates highly realistic video data from arbitrary cameras and locations.
  • World Gen 1: Simulates the entire autonomous driving stack, predicting future events and suggesting vehicle paths. It can technically be used to drive a car in a simulator environment and potentially in the real world.

Customer Acquisition and Relationship Building

Convincing customers in the autonomous driving space requires:

  1. Demonstration: Showing the technology's robustness through real-world demonstrations in challenging, unforeseen situations.
  2. Execution: Delivering on production contracts and meeting deadlines, as these contracts are critical for automakers' production programs.
  3. Progress Tracking: Demonstrating continuous improvement and showing the rate of technological development over time.

Conviction and Grit

Developing autonomous driving technology requires significant conviction. As a startup founder, Li Berninski experienced the challenges of wearing multiple hats and navigating a landscape where most funding went to companies pursuing different approaches (pure play L4). Helm AI's focus on partial automation was initially met with skepticism. The company's success is attributed to its grit and the eventual alignment of the world's view with its strategic vision.

Conclusion

Helm AI is pursuing a unified approach to autonomous driving, leveraging AI-based simulation and generative AI to overcome the limitations of traditional methods. The company's early focus on research, combined with its strategic decisions and commitment to execution, has positioned it as a key player in the autonomous driving landscape.

AI summaries can miss context or contain errors. Check important details against the original video.

MAKE IT YOURS

Read. Remember. Reuse.

Free tools

Go a little deeper.

Have a question about this video? Load its transcript to open the video chat.