Google has previously signaled its intention to bring its Gemini AI features to the Google Home app and its Nest smart home devices. Now we’re seeing what that looks like. Three key Gemini capabilities are available on Google Home now or arriving soon, and you can test out what the AI can do for you right now.
Here are the three big Gemini changes and how you can use them for home security and general smart home management. It’s one of the first examples we’ve seen of how these massive large language model AIs can affect everyday smart home use, and we can’t wait to take a closer look.
Note that these features are available only for English language users, primarily focused on Nest Aware Plus subscribers during the first rollout. They’re coming to many more users in time.
1. AI descriptions of what’s going on
You’ll need to apply to Google’s Public Preview feature to unlock these AI descriptions, so start here.
Tapping into the power of Gemini, Google Home will start providing detailed descriptions along with video clips when a Nest cam or doorbell is activated. That means you don’t have to view the video footage directly when you can read a quick description of what Gemini thinks is happening (a man is walking across the street and pauses, etc.).
This is an opt-in service for those who join Public Preview at this time, so don’t expect surprise text pop-ups. We’re curious to see how accurate these Gemini descriptions are, as Gemini hasn’t been the most reliable conversational AI to this point.
Read more: Best Home Security Cameras of 2024
2. Searching your camera history
Gemini can answer questions from your video history, too.
If you collect video clips in the Google Home app for an extended period (such as with cloud storage via a Nest Aware subscription), you can now opt into a search function. This isn’t any basic search, either. With Gemini, you can ask basic questions to get answers without shuffling through the videos yourself.
One of Google’s simple examples is, “Was the trash taken to the street yesterday?” You could also ask the search function about packages or mail deliveries it recently saw, if the dog was taken for a walk yet and any other timely questions.
This feature is currently rolling out to Nest Aware Plus users, and availability should continue expanding in the coming months.
3. ‘Help me create’ easy smart home routines
Google Home’s Automation options are extensive.
The “help me create” feature, coming soon to the Google Home app, is a more user-friendly option for creating home automations. I’m particularly interested in this feature because setting up home routines (and all the compatibility questions that come with it) is one of the most exhausting parts of managing a smart home.
This Gemini feature is designed to let you request, in natural language, exactly what you want to happen and then allow Gemini to set it up for you in the Google Home app. So you could say something like, “I want my door to lock when I leave in the morning,” or, “I want the lights to flash when someone rings the doorbell,” or possibly, “I want a routine that dims the lights and plays music from my romantic playlist,” and Gemini will work on putting it all together for you.
Now, to the testmobile! We’ll be taking these features for a spin in the coming weeks and let you know how they perform and how they’re best used. In the meantime, you can update your Google Home system and play around with the new features yourself to see which pass the vibe check.
This is also a great time to check out our list of the best indoor security cameras, Google Nest’s familiar face technology and the top facial recognition security cameras for your home.