Vertical AI Innovations: Abacus LLM in Finance & Synthesia's Video Avatars | E2112

Key Concepts

• Vertical AI
• Generative AI (GenAI)
• Large Language Models (LLMs)
• On-premise solutions
• Response control
• Anti-hallucination
• Knowledge distillation
• AI-powered search
• AI Agents
• Chain of validation
• Triangulated retrieval
• Claim decomposition engine
• Fact backpacking
• AI video platform
• AI avatars
• AI digital twins
• Training data
• ARR (Annual Recurring Revenue)
• MRR (Monthly Recurring Revenue)
• ACV (Annual Contract Value)

Abacus: GenAI for Regulated Industries

Overview

Abacus, found at goabacus.co, is a company focused on bringing generative AI to regulated industries like banks, credit unions, and insurance companies. They aim to provide not just an LLM solution but also response control and anti-hallucination measures.

Key Points

• Problem: Financial institutions are behind in technology adoption but recognize the need for AI. They require data security, comprehensive data indexing, accurate answers, and response control.
• Solution: Abacus offers an on-premise solution that addresses these concerns.
• Moat: Navigating the strict regulations of the financial industry creates a significant barrier to entry.
• Abacus OS Private LLM: A 30 billion parameter model fine-tuned with client data (6 million queries/month).
• Parent and Sister Model: Abacus uses a large "parent" model to train a smaller, lightweight "sister" model for on-premise deployment via knowledge distillation. This reduces compute costs for clients.
• Enterprise Search & Abby Assist: Abacus offers an AI-powered search product and Abby Assist, an AI agent for call center environments.
• Decentralized Indexer: The indexer connects to data sources where they reside, avoiding the need to centralize data. It connects to complex core systems like Ferve and Scimitar.
• GPU Requirements: The system can run on a small allocation of H100 or A100 GPUs.
• Target Market: Mid-tier credit unions with $1-3 billion in total assets.
• Sales Strategy: Founder David Moscatelli opens accounts at target banks/credit unions and emails the CEO as a customer to get a response.
• 3-Month Money-Back Guarantee: Abacus offers a 3-month money-back guarantee to ensure customer satisfaction.
• Pricing: Monthly subscription ($10-15k) and a one-time installation fee ($250-350k), often amortized over a 3-year contract. The installation fee provides pricing flexibility.
• Low COGS: Due to the on-premise nature and in-house model, Abacus has low COGS and high gross margins.
• Hallucination Control: Abacus uses a "chain of validation" with three steps:
  • Triangulated Retrieval: Cross-references three different sources to validate information.
  • Claim Decomposition Engine: Decomposes the logical structure of a claim to ensure validity.
  • Fact Backpacking: Provides the document, location within the document, and citation for every answer.
• Accuracy Rate: The chain of validation results in a 98% accuracy rate.
• Growth: Abacus grew from $25k MRR to $125k MRR in one year.
• Fundraising: Abacus is raising capital to accelerate growth and capture market share.
• Hiring: Abacus is hiring sales professionals with experience in banking, insurance, or credit unions.

Notable Quotes

• David Moscatelli: "Abacus is where AI meets assurance."
• David Moscatelli: "The answer is never no, it's just not now."

Technical Terms

• LLM (Large Language Model): A type of AI model that uses deep learning algorithms and massive datasets to understand, summarize, generate, and predict new content.
• On-premise: Software that is installed and runs on a company's own servers and infrastructure, rather than in the cloud.
• Knowledge Distillation: A model compression technique where a smaller "student" model is trained to mimic the behavior of a larger, more complex "teacher" model.

Logical Connections

Abacus addresses the specific needs of regulated industries by providing a secure, accurate, and controllable AI solution. Their on-premise model and chain of validation system are designed to meet the stringent requirements of financial institutions.

Synthesis/Conclusion

Abacus is strategically positioned to capitalize on the growing demand for AI in regulated industries. Their focus on security, accuracy, and control, combined with their unique sales strategy and pricing model, gives them a competitive advantage in this niche market.

Synthesia: AI Video Platform for the Enterprise

Overview

Synthesia, found at www.synthesia.io, is an AI video platform for the enterprise that covers the entire video lifecycle, from creation to publishing and analytics.

Key Points

• Evolution: Started as an AI avatar company but has evolved into a comprehensive AI video platform.
• Platform Features: Includes AI models (avatars), a video editor, content management system, translation tools, a publishing platform, and an AI video player with analytics.
• Use Cases: Primarily focused on practical content for customer support, product marketing, and internal training. Over half (52%) of videos generated are external facing.
• AI Digital Twins: Users can create their own AI avatars using a webcam or studio recording.
• Language Support: Supports 140 different languages.
• Shutter Stock Partnership: Leverages Shutter Stock's visual information to train the Express 2 model.
• Express 2 Model: Aims to enable avatars to perform lines like real actors, conveying emotions and storytelling.
• Training Data: Uses both proprietary data (actors, studios, 3D data) and external data sources.
• ARR Milestone: Reached $100 million in annual recurring revenue.
• Fortune 100 Adoption: 70% of the Fortune 100 are now customers, up from 40% two years ago.
• Cost Management: Emphasizes building a great business with solid unit economics.
• Model Training Strategy: Focuses on humans talking to the camera, allowing for a more targeted and efficient training process.
• Enterprise Focus: Prioritizes features and trade-offs that benefit larger businesses.
• PLG Model: Offers a self-service product that allows anyone to try the platform.
• Future Vision: Envisions a future where interactive videos replace PowerPoint presentations.

Notable Quotes

• Victor Ripperelli: "Really what we are is an AI video platform for for the enterprise."
• Victor Ripperelli: "People today want to watch and listen to content, they don't want to read that much anymore."

Technical Terms

• AI Avatar: A digital representation of a person, created using artificial intelligence.
• AI Digital Twin: A virtual replica of a real-world entity, such as a person or object, created using AI.
• Training Data: The data used to train an AI model.

Logical Connections

Synthesia is transforming enterprise communication by enabling businesses to create engaging video content at scale. Their AI-powered platform and focus on practical use cases are driving adoption among the world's largest companies.

Synthesis/Conclusion

Synthesia is a leading player in the AI video platform market, with a strong focus on the enterprise. Their impressive growth, high customer retention, and commitment to innovation position them for continued success in the rapidly evolving world of AI-powered communication.