Gemini Live Gets Major Upgrade With On-Screen Visual Guidance and Smarter Google Photos Editing

Google is giving its Gemini Live assistant a major upgrade. The company announced new features that make it more visually aware, conversational, and better connected with Google apps. From on-screen visual guidance to natural photo editing and improved transparency in images, the update is designed to bring Gemini deeper into daily use.

On-Screen Visual Guidance

One of the most striking updates is real-time visual guidance. When you share your camera feed, Gemini can highlight objects right on the screen and offer suggestions.

Imagine comparing two pairs of sneakers while shopping—the assistant can give advice on which fits your outfit better. Or point the camera at a toolbox, and it’ll tell you which tool you need. It’s a more interactive way to make decisions in the moment.

Tighter Integration With Google Apps

Gemini Live is also getting closer ties with Google’s core apps. Right now, it works with Calendar, Tasks, and Keep to manage reminders, schedules, and lists.

But starting soon, it’ll connect with Messages, Phone, Clock, and Maps. That means you could plan a subway route in Maps and, without switching apps, ask Gemini to text someone that you’re running late. It’s all about keeping things seamless.

Speech That Feels More Human

Voice interactions are also getting an upgrade. Angela Sun, Director of Product Management for the Gemini app, explained that new model updates allow for more natural intonation, rhythm, and pitch.

You’ll be able to adjust how Gemini speaks—slower if you need clarity, faster if you’re in a rush. It can even change tone for stressful conversations or shift into character voices for storytelling, like narrating as Julius Caesar.

Conversational Photo Editing

Google Photos is getting a redesigned editor powered by Gemini. Instead of picking tools or sliders, you can just say what you want.

Want to remove cars from the background of a shot? Or restore an old photo? Maybe you’d rather get creative and add sunglasses or party hats. You can even start with a quick “make it better” and refine from there.

Selena Shang, Senior Product Manager at Google Photos, said the goal is to let users describe edits naturally, leaving Gemini to figure out the right tools behind the scenes.

More Transparency With Content Credentials

Google is also rolling out C2PA Content Credentials in the Pixel 10 camera app. These credentials apply to all images, whether they’re AI-edited or not, and will show details about how a photo was captured or modified inside Google Photos.

This builds on existing support for IPTC metadata and SynthID watermarks, giving users clearer insight into the origins of digital content.

Rollout and Availability

• Visual Guidance in Gemini Live: Launching August 28 on Pixel 10 devices, reaching other Android phones the same week, and iOS soon after.
• C2PA Content Credentials in Google Photos: Starting with Pixel 10 devices, rolling out later to Android and iOS.