Google Home APIs, tools, and Gemini capabilities for your apps

I/O 2025: Gemini and the Future of the Smart Home

Key Concepts:

• Home APIs: Google's platform for developers to build smart home apps and experiences.
• Gemini: Google's AI model, being integrated into Google Home and the Home APIs.
• Device and Structure APIs: APIs for controlling and managing connected devices.
• Commissioning API: API for easier device setup and sharing using Matter.
• Automations API: API for accessing Google's intelligent automation engine.
• Intelligent Notifications: Camera notifications powered by AI, e.g., familiar face detection.
• Event Descriptions: AI-generated descriptions of events captured by cameras.
• Suggested Automations: AI-powered suggestions for useful automations based on a user's devices.
• "Help Me Create": Natural language interface for creating automations.
• Gemini Nano: On-device version of Gemini, used for the home status widget.
• Matter: Connectivity standard for smart home devices.

1. Overview of Home APIs and Their Adoption

• The Home APIs enable developers to build apps and experiences for the smart home ecosystem.
• Over 750 million devices are now accessible via the Home APIs.
• The APIs are cross-platform, supporting both Android and iOS.
• Partners like ADT, LG, and Eve have already built experiences using the Home APIs.

2. Gemini Integration with Google Home

• Gemini is playing a significant role in the future of Google Home.
• New Google Home app features powered by Gemini include:
  • Searching video history with event descriptions.
  • "Help me create" for building intelligent automations using natural language.
• Users can control smart home devices using natural language directly in the Gemini app.
• These Gemini-powered features are coming to the Home APIs later this year.

3. Partner Examples and Use Cases

• Cync: Uses Home APIs to ensure pet comfort by adjusting lighting and temperature based on the user's work schedule.
• iRobot: Integrates Matter-enabled vacuums with Google's intelligence to automatically start cleaning cycles when the user leaves for work, leveraging smart home away signals.
• Motorola: Explores using Moto Tag to trigger custom smart home routines (e.g., turning off the coffee machine, adjusting the thermostat).
• Tuya Smart: Makes Matter devices set up in their app automatically available in the Google Home app, and vice versa, streamlining device management for users.

4. Bringing Cameras to the Home APIs Powered by Gemini

• All Nest camera experiences are being brought to the Home APIs.
• This includes:
  • Livestream.
  • History.
  • Two-way talk.
  • Camera settings.
  • Gemini-powered intelligence features.
• Key Gemini-powered camera features:
  • Intelligent notifications (e.g., familiar face detection, package delivery).
  • Gemini-powered event descriptions and camera history search using natural language.

5. Gemini-Powered Features for Automations API

• New features to make automations easier and more natural:
  • Suggested Automations: Gemini suggests automations based on the user's devices.
  • "Help Me Create": Users can build automations using natural language.
  • New starters based on date and weather.
• These features aim to reduce development time and create more personalized experiences.

6. Gemini-Powered Experiences Across Google Surfaces

• Devices integrated with Google Home can participate in Gemini-powered experiences across Google's surfaces.
• Users can control and ask about devices directly from the Gemini app using natural language.
• Gemini is being previewed on home devices like smart speakers, smart displays, and Google TV, enabling more natural voice experiences.
• A home status widget, powered by Gemini Nano on Pixel devices, provides a personalized, real-time summary of the smart home on the home screen.

7. Access and Developer Opportunities

• The Gemini-powered Home APIs will be opened to a small group of early access partners later this year.
• Developers are encouraged to start building their Home APIs app today.
• A series of themed developer challenges are being launched, offering prizes for demos built with the Home APIs.
• Developers can sign up for the smart home developer newsletter for details and updates.

8. Conclusion

• The integration of Gemini with the Home APIs represents a significant step towards creating an effortless smart home that understands, adapts, and responds to users' needs.
• The Home APIs are the gateway to a future where AI-powered experiences are seamlessly integrated into the smart home.