Google has announced that it will start using Gemini models to enhance Nest cameras and Google Home experiences, as well as to improve the natural and conversational capabilities of Google Assistant on home devices such as speakers and displays. This initiative is part of Google’s ongoing efforts to improve smart home experiences for both users and developers.
The integration of Gemini models will enable Nest cameras to process video, images, and text more effectively. This means that Nest cameras will not only detect motion, people, and packages but will also provide more detailed and specific descriptions. For instance, a camera can identify that “the dog is digging in the garden” instead of merely detecting an animal. Users will also be able to search camera history in the Google Home app for specific events, such as whether the kids left their bikes in the driveway.
We were asked recently why Meta’s AI model being out of date and censoring stuff was considered “Smart Home News”, and new features like this being added to smart homes is why. An AI model being out of date and providing wrong information isn’t something limited to Meta and it’s content feeds. The same can happen with any AI model, anywhere. Even the AI models that are embedded in your next gen smart home.
Google is also enhancing the home automation capabilities within the Google Home app. The “Help me create” feature will use Gemini models to simplify the process of setting up automations. Users can describe what they want to automate in plain language, and the app will generate the necessary automation. For example, users can instruct the app to “lock the doors and turn off all the lights at bedtime,” and the automation will be set up accordingly.
Additionally, Google is working on improving Google Assistant for Nest speakers and displays. By applying large language models, Google aims to enhance media playback, setting timers, and other core experiences. New voices will be introduced later in the year to make interactions more conversational. The upgraded Google Assistant will also be capable of understanding more natural speech and follow-up questions, enhancing overall user experience.
These new features will initially be rolled out to a limited number of Nest Aware subscribers in Public Preview later this year, with plans for broader expansion over time.
For more information, check out Google’s announcement here.
