Google announced that it will add Project Astra features to Gemini by the end of March. Thanks to this, the chatbot will be able to receive data from the user's screen and camera. Gemini will be able to answer questions about objects shown in photos or videos, as well as analyze content, for example, in YouTube videos.
Project Astra is a multimodal AI assistant that perceives the world in real time, recognizes objects, and remembers their location. The new capabilities will be available to Google One AI subscribers, but for now only on Android smartphones.
Google promises to reveal more about the new feature during MWC 2025 in Barcelona.