The State of Generative Media - Gorkem Yurtseven, FAL

Key Concepts

Generative Media Platform, Generative AI (video, audio, image), Marginal Cost of Creation, Hyperpersonalization, Interactive Ads, E-commerce Growth, Virtual Try-On, Video Model Dominance, Compute Intensity, Real-time Video Generation, Flux Context, GPT-4o, Enterprise Use Cases.

Generative Media Platform Definition and Market Overview

The speaker's company, file.ai, defines itself as a generative media platform, focusing on generative video, audio, and image models. The generative media market is described as very new, with the company partnering with both open and closed source model providers. The speaker aims to provide a historical perspective and future outlook on this rapidly evolving field.

Historical Context and the Evolution of Generative AI

• Early AI Waves: The speaker recalls the initial excitement around DALL-E 2 in 2022, highlighting Sam Altman's tweets showcasing the technology's capabilities. He contrasts this with earlier AI waves involving GANs, Deep Dream, and Prism (a viral selfie avatar app), noting that the current generative media landscape offers significantly greater capabilities and applications.
• Early Generative Art: Mentions Harold Cohen's early computer art projects, where massive computers were used to create art in a human-like style. This highlights the long history of attempting to generate visuals and art using computing technologies.
• Rapid Advancement: The speaker emphasizes how quickly the field evolved after DALL-E 2. Midjourney released its initial model as a Discord bot, followed by Stable Diffusion open-sourcing its model, enabling users to run similar technology on home GPUs. SDXL and other image models, including the more recent Flux, further accelerated progress.

The Marginal Cost of Creation Approaching Zero

The speaker argues that the marginal cost of creation (not creativity) is approaching zero due to these advancements. While storytelling and creativity remain crucial, the technical barrier to generating new content is significantly reduced. This has the potential to transform industries like social media, advertising, marketing, fashion, film, gaming, and e-commerce.

Impact on the Advertising Industry

• Software Eating Media: The speaker notes that software has been eating media, citing YouTube's ad revenue surpassing most media companies (except Disney).
• Ad Industry Growth: The speaker predicts that generative media will drive significant growth in the advertising industry, similar to how software-driven ads have fueled growth since 2000.
• Hyperpersonalization: AI-driven ads will be hyperpersonalized, with potentially thousands of versions generated for different demographics or even tailored to individual users based on their browsing history.
• Interactive Ads: Ads will become more interactive, with elements generated on the fly based on user input or context.
• Abundance of Content: The ad industry can thrive on a much larger volume of content compared to other media like movies, making it well-suited for generative media applications.
• A24 Civil War Movie Example: The speaker mentions a past interactive ad campaign for the A24 movie "Civil War," where users could upload a selfie and have it rendered as a toy soldier displayed in Times Square.

Impact on E-commerce

• E-commerce Growth: E-commerce is steadily growing as a percentage of the US retail industry, and generative media is expected to accelerate this trend.
• Visual Shopping Experience: Online shopping is inherently visual, making it a prime target for AI-driven enhancements.
• Virtual Try-On: Virtual try-on is identified as an early and clear product-market fit for generative media in e-commerce. Many retailers and startups are adopting this technology.

The Rise of Video Models

• Sora's Impact: The speaker draws a parallel between the initial reaction to DALL-E 2 and the more recent release of Sora. While Sora initially seemed far ahead, the speaker anticipates rapid progress in video generation from other players.
• Video Model Adoption: The speaker shares internal data showing a rapid increase in video model usage on their platform, growing from almost nothing in October to 18% in February and around 30% currently.
• Video Market Size Prediction: The speaker estimates that the generative video market will be 100x to 250x larger than the image generation market, based on factors like compute intensity (20x more), engagement (5x more), and broader industry applicability.
• Video Model Improvements: Video models are constantly improving, with new capabilities like consistency and sound being added. The speaker is particularly interested in seeing how Google's V3 model will be used and what new use cases it will unlock.

The Future of Video Generation

• Real-time Video Generation: The speaker envisions a future where video generation becomes real-time, enabling streaming of generated content to users.
• Interactive Experiences: Real-time video generation will blur the lines between games and movies, leading to more interactive and immersive experiences.
• Social and Live Event Impact: The speaker speculates on how this technology will impact social apps and live events, potentially making them more lifelike and accessible to a wider audience.

Image Models Are Not Done Yet

• Continued Improvements: Despite the focus on video, the speaker emphasizes that image models are still evolving, with recent advancements like Flux Context and GPT-4o introducing new editing capabilities and better text rendering.
• Enterprise Adoption: These improvements are expected to drive greater adoption of image models in enterprise use cases.

Conclusion

The generative media landscape is rapidly evolving, with significant advancements in both image and video generation. The marginal cost of creation is decreasing, leading to transformative applications across various industries, particularly advertising and e-commerce. While video models are poised for explosive growth, image models continue to improve and find new applications. The speaker's company, file.ai, is actively hiring to support this growth and encourages interested individuals to reach out.