Microsoft is testing an updated Copilot Vision feature in Windows that can now see the user's entire screen, rather than just individual apps. The update is now available on Copilot+ PCs (with Snapdragon processors) to Windows Insiders.
Copilot Vision works on the principle of screen sharing: the user chooses what to show - the entire desktop, a specific application window or a browser. The function is activated via the glasses icon in the Copilot application.
The tool can:
- Analyze documents, presentations or websites;
- make recommendations regarding the design, content, or structure of materials;
- assist with editing resumes;
- provide advice while playing games or learning new software.
Copilot Vision doesn't run in the background—unlike the Recall feature, which saves screenshots automatically, Vision only sees what you consciously show it.
Microsoft previously tested Copilot Vision as a feature to analyze content in the Edge browser or images from a smartphone camera, but now it's becoming a full-fledged assistant for everything you see on your screen.
Recall that Microsoft is also testing the function of creating written descriptions of images using Copilit.