Adobe CTO Explains How Generative AI Is Upending Creative Work

Key Concepts

• Adobe's AI strategy: Evolution from research to generative AI integration.
• Firefly: Adobe's family of AI models trained on licensed content.
• Commercial safety: Ensuring content is safe for commercial use, free of IP violations.
• Content licensing and moderation: Processes for acquiring and reviewing training data.
• Content enrichment/augmentation: Using AI to add information and segment content.
• AI-generated content in training data: Allowing AI-generated content with proper labeling.
• Third-party model integration: Opening Adobe tools to other generative AI models.
• Trust and transparency: Addressing concerns about AI replacing creatives and data usage.
• Production vs. creative work: Differentiating between AI-assisted production and human creativity.
• Value of human-created content: The potential for increased appreciation of human-driven storytelling.

Evolution of Adobe's AI Strategy

Adobe's AI investment began approximately 10 years ago, recognizing AI's growing importance in creative workflows. About three years ago, the emergence of generative AI and large-scale models capable of creating content in unprecedented ways prompted a significant shift. Adobe consolidated its computer vision, computer graphics, and AI research teams, investing in substantial GPU resources to explore how this technology could be integrated into creative tools for practical use, moving beyond simple text-to-image demos.

Firefly: Adobe's Approach to Generative AI

Adobe developed Firefly, a collection of AI models (image, video, design, vector), trained exclusively on licensed content. This approach contrasts with other companies that scrape data from the internet without permission.

Reasons for Choosing Licensed Content:

• Control: Existing models lacked the level of control needed by creative professionals.
• Legal Concerns: Customers expressed significant concerns about the legal implications of using models trained on unlicensed data, including potential lawsuits and IP violations.
• Ethical Considerations: Concerns about the impact on the future of creativity and the ability of creators to earn a living.

Licensing and Review Process:

1. Licensing: Content is either explicitly licensed from creators or published under a permissive license.
2. Human Review: Content undergoes human review to ensure proper licensing and to identify and remove any known owned IP (e.g., competitor brands) that could cause issues for commercial users.

This meticulous process is expensive but considered essential for ensuring commercial safety and ethical standards.

Addressing the "More Data is Better" Paradigm

Despite the conventional wisdom that more data equals better quality, Adobe's approach has proven successful. By operating under constraints, Adobe has become more creative in how it trains its models.

Strategies for Effective Training:

• Content Enrichment/Augmentation: Using AI models to add information and segment content based on type and quality.
• Efficient Use of Content: Focusing on using the right content in the right way, rather than simply maximizing volume.

AI-Generated Content in Training Data

Adobe allows AI-generated content into its training corpus, requiring contributors to declare whether content was generated with AI. This information is valuable for both end buyers and the training process. While AI-generated content is a small part of the overall training set, it still undergoes human moderation to ensure it meets ethical and content standards and does not violate IP rights.

Opening Up to Third-Party Models

Adobe is expanding its platform to include third-party generative AI models, recognizing that customers use a mix of models throughout their creative process.

Rationale:

• Customer Demand: Customers were using various models but found it cumbersome to juggle between different websites.
• Flexibility: Offering a range of models allows users to choose based on their specific needs, whether it's commercial safety or early-stage ideation.

Integrated Models:

• Google's Imagen and V2
• GPT image
• Black Forest Labs' Flux
• Ideogram
• Runway
• Pika

A new mobile app is also being released to facilitate on-the-go access to these models.

Building Trust and Addressing Concerns

Adobe faced backlash over perceived changes to its terms of use, with concerns that customer content would be used for training AI models. The company clarified that it does not train on customer content and that the changes were related to standard service provisions (e.g., analyzing content to remove backgrounds).

Key Takeaways:

• Transparency: The incident highlighted the need for clear and proactive communication with the creative community.
• Focus on Benefits: Adobe's focus is on integrating AI in a way that benefits creatives, accelerating workflows and removing tedious tasks.
• Community Engagement: Actively engaging the community to understand their needs and concerns is crucial.

The Future of AI and Creativity

While AI excels at production work, it lacks the true creativity and taste-making abilities of humans. The concern is that AI could disrupt the economic environment for creatives by automating production tasks and potentially drowning out human-created content.

Production vs. Creative Work:

• Production Work: The actual generating of images, which AI can increasingly handle.
• Creative Work: Understanding client needs, developing unique ideas, and iterating on content, which remains a human domain.

Optimistic Outlook:

The speaker believes that consumers will increasingly value content that tells a good story and comes from a human perspective. This could raise the bar for the industry and create continued demand for real artists. The analogy is drawn to the rise of digital photography, where the initial flood of pretty pictures led to a greater appreciation for storytelling photos.

Conclusion

Adobe's AI strategy is centered on responsible innovation, prioritizing commercial safety, ethical considerations, and the needs of creative professionals. By focusing on licensed content, transparent communication, and community engagement, Adobe aims to integrate AI in a way that empowers creatives and enhances the value of human-driven storytelling.