Google will add visual cues and app integration to Gemini Live

Google has announced new features for Gemini Live, its real-time conversational voice assistant. The assistant will be able to highlight and point to objects on the screen while sharing a camera, for example by highlighting the tool you need.

The feature will first be available on Pixel 10 smartphones, which will be released on August 28, and will later be available on other Android devices and iOS. Gemini Live will also integrate with the Messages, Phone, and Clock apps, allowing users to ask the assistant to send a message or make a call without interrupting a conversation.

Google is also updating its Gemini Live audio model. The Assistant will better reproduce intonation, rhythm, and timbre of the voice, changing style depending on the topic of conversation. Users will be able to adjust the speed of speech and even choose the tone for narrations on behalf of characters.