As part of its ongoing quest to continue upgrading its AI, Google is making some changes to Gemini — making a paid feature free to everyone and giving Gemini the ability to see the world around it.
Gemini gets a memory upgrade for all users
First up, the ability for Gemini to remember your preferences, interests, work, and more is coming to all users. This feature debuted last November as a Gemini Advanced exclusive (and, for comparison, has existed on ChatGPT for a while).
Also: Google’s Gemini AI might soon back up Siri on your iPhone – just like ChatGPT
Saved info lets you tell Gemini certain details about your life, like your name, your family’s name, or a specific project you’re using ChatGPT for. This means you won’t have to enter this information each time, and you’ll get more relevant answers.
Google offered a few more suggestions for the feature, including:
- Use simple language and avoid jargon
- I’m vegetarian, so don’t suggest recipes with meat
- After responding, include a Spanish translation
- When trip planning, include the cost per day
- I can only write code in JavaScript
- I prefer short, concise responses
You will need to add each piece of saved info manually. To do so, head to the settings menu and find “Saved info.” The feature does appear to be rolling out on the desktop version first, but it’s headed to both desktop and the mobile app.
Gemini Live gets eyes
In addition, at last week’s Mobile World Congress, Google announced that Gemini Live can now “see” — either from your screen or from a live video. This feature, which will be rolling out later this month, is only available to paid Gemini Advanced users for now.
With this feature, you’ll see a “Share screen with Live” button when you open Gemini. Tap it, and you’ll have the option to share your screen or start a video. You can ask the AI questions about your surroundings or about what’s on your phone screen.
Also: Gemini Live just got much easier to talk to – here’s how
In a demo video, a user asks for outfit ideas using a pair of pants shown on screen. Gemini recommends a top, and the user then asks for a jacket recommendation. In another showcasing live video, a user asks Gemini for help picking a glaze color for a vase they just created. Gemini ends up picking “the first one on the left in the second row” when shown a display of available options—fairly impressive context.