Kimi K2: RIP Sonnet & Opus! The BEST OPENSOURCE 1-TRILLION Parameter MODEL is HERE! (+Free APIs)

Key Concepts:

• Kimmy K2: A new open-source, one trillion parameter mixture of experts language model by Kimmy Aai (Moonshot AI).
• Open Weights: The model's weights are publicly available.
• Mixture of Experts (MoE): A neural network architecture with multiple sub-networks (experts), where only a subset is activated for each input.
• Kimmy K2 Base: Version for tinkering, fine-tuning, and building custom applications.
• Kimmy K2 Instruct: Version for general chat and agentic tasks, designed for speed.
• API Pricing: Cost per input/output tokens when using the model through an API.
• Ninja Tools: An AI platform that combines access to multiple AI models and tools under one subscription.
• Klein/Rue/Kilo: AI coding assistants that can be configured to use different language models.
• Tool Calling: The ability of a language model to use external tools or APIs to perform tasks.

1. Introduction of Kimmy K2

• Kimmy K2 is a one trillion parameter mixture of experts language model developed by the Chinese company Kimmy Aai (Moonshot AI).
• It is the largest open-source model to date.
• The model activates 32 billion parameters at any given time.
• It shares a similar structure with Deepseek V3 or R1.
• The model is available for free use and can be run on private servers.

2. Kimmy K2 Flavors and Capabilities

• Two versions: Kimmy K2 Base (for fine-tuning) and Kimmy K2 Instruct (for chat and agentic tasks).
• The Instruct version is designed for fast responses.
• The model is compared to Google's Opus, even surpassing it in some benchmarks.
• It outperforms DeepSeek, Quen, and Open AAI in SWE verified benchmarks.
• It performs well in Live Codebench, tool use benchmarks, and AM.
• The model beats Sonnet in several benchmarks.

3. Training and Availability

• Kimmy Aai has shared details about the model's training process.
• The model is available for free use on their chat platform.
• API access is available through their platform.

4. API Pricing and Free Tier

• API pricing is significantly cheaper than models like Sonnet or Gemini Pro.
• The cost is $0.15 or $0.60 per 1M input tokens (depending on cache hit/miss) and $0.25 or $0.50 per 1M output tokens.
• A free tier provides 32K tokens per minute, three requests per minute, and 1.5 million tokens per day.

5. Ninja Tools Platform

• Ninja Tools is an AI platform that combines multiple AI models and experiences.
• It offers access to models like Claude 3.5 Sonnet, GPT-4o, and Gemini under one subscription.
• Additional features include AI video generation, image generation, music generation, and document chats.
• The platform offers a playground for comparing AI responses.
• Pricing starts at $11 per month, with additional plans available.
• The coupon code "AI code king 20" provides an additional 20% discount.

6. Configuration with Klein/Rue/Kilo

• The video demonstrates how to configure Kimmy K2 with AI coding assistants like Klein, Rue, and Kilo.
• Users need to upgrade these tools to the latest version.
• Kilo provides $20 of free credits.
• Configuration involves creating a new profile in the settings, selecting the Kimmy K2 model (or using Open Router), and entering the API endpoint and API key.

7. Performance and Capabilities (Initial Testing)

• The model is described as "really good" and "insanely capable," especially in tool calling.
• Its functionality is similar to Sonnet.
• It is considered better than Grok 1.5 as a coder.
• The model's code-writing capabilities are "quite good."
• The speaker expresses excitement about the model being open weights.

8. Future Potential

• The current version is a "non-thinking variant," suggesting a future "thinking variant" could surpass models like Sonnet or Gemini.
• The speaker plans to switch to using Kimmy K2 due to its cost-effectiveness and capabilities.
• The only current limitation is the lack of vision capabilities.
• The speaker hopes for distilled versions of the model that can run on consumer-grade hardware.

9. Conclusion

• The speaker is impressed by Kimmy K2, calling it the "biggest open weights model" they have seen.
• The speaker no longer feels the need for the Llama behemoth.
• The speaker encourages viewers to share their thoughts and subscribe to the channel.