Microsoft has initiated testing of an updated version of its Copilot application for Windows, which will now allow users to share their screens or specific applications with the AI assistant. Initially confined to the Microsoft Edge browser, the Copilot Vision feature is expanding its capabilities to include any app installed on users’ PCs.
With Copilot Vision, users can receive guided assistance in utilizing tools within applications like Adobe Photoshop, or have the AI analyze their photos and web content. An early demonstration of Copilot Vision took place during Microsoft’s recent 50th anniversary celebration, where the AI assistant provided support while navigating a game of Minecraft and optimizing settings in Microsoft’s Clipchamp video editor.
Currently, comprehensive testing of Copilot Vision through the Insider beta program is limited to users in the United States. The application will eventually feature the ability to highlight sections of the screen to assist with app navigation, but this option has not been activated in the current beta build. Unlike Microsoft’s Recall feature, which captures snapshots, Copilot Vision is designed to function similarly to screen sharing during a Microsoft Teams call.
In addition to the Copilot Vision feature, Microsoft is also testing file search capabilities within Copilot on Windows. This functionality allows users to query the AI assistant about the contents of various file types on their PCs, including .docx, .xlsx, .pptx, .txt, .pdf, and .json formats, facilitating easier retrieval of recently worked-on documents.
Both new Copilot features require only the Copilot app on Windows, eliminating the need for a full Copilot Plus PC setup. Additionally, Copilot Vision will also be available on iOS and Android platforms. The rollout of these enhanced features is currently being tested with Windows Insiders, with a wider release anticipated for all Windows 11 users in the upcoming weeks or months.
