Microsoft is expanding its Copilot Vision feature, making it accessible on Windows and mobile platforms, thus extending its capabilities beyond the web interface. Initially introduced as part of a redesign last year, Copilot Vision has primarily functioned as a tool within the Microsoft Edge browser to assist users with web content.
The latest iteration of Copilot Vision can now analyze live video feeds from mobile devices. This advancement allows the AI to offer practical advice on tasks such as plant care and home decoration. The feature is being rolled out today within the Copilot app available on iOS and Android, with a similar rollout planned for Windows in the near future.
For Windows users, the Copilot app is receiving updates to incorporate Copilot Vision across the PC environment. This enhanced functionality will enable the AI assistant to provide guidance on using software applications like Adobe Photoshop, as well as to analyze images and webpages the user is currently viewing.
This new functionality differs from the Recall feature available on Copilot Plus PCs, which captures snapshots when activated. In contrast, Copilot Vision operates more like a screen-sharing tool, allowing users to share their app or desktop views during Microsoft Teams calls.
Windows Insiders will gain access to Copilot Vision next week. Microsoft plans to expand the rollout further following successful testing. In conjunction with this feature, a variety of updates to Copilot will also be introduced, enhancing its memory, personalization capabilities, web interactions, podcast creation abilities, deep research functionalities, and more. Detailed information about these new features can be found in the official announcement.
Related:
