Microsoft is set to introduce a range of AI capabilities for Windows 11, highlighted by the rollout of its Copilot Vision tool, which can analyze content displayed across user screens. These features are being gradually made available to users, with some specifically designed for Copilot Plus PCs.
Windows 11 users in the United States can now utilize Copilot Vision through the Copilot app. This innovative tool leverages artificial intelligence to provide insights on various content open on the screen. Users can verbally inquire about what they see across multiple applications and web pages and receive guidance on completing specific tasks, such as enhancing photo lighting. Microsoft had previously tested a limited version of this feature last year.
Moreover, owners of Snapdragon-powered Copilot Plus PCs can benefit from an AI-driven “agent” integrated within the Settings app. This feature enables users to search for particular settings using conversational language, such as, “I want to enable quiet hours” or “connect Bluetooth device.” Should the agent be able to fulfill the user’s request, it will offer to execute the task automatically.
Microsoft is also enhancing its “Click to Do” preview on Copilot Plus PCs. This feature, activated when users press the Windows key while left-clicking on apps or content, aids in swiftly completing various actions like summarizing text. The latest updates introduce new functionalities including practicing reading skills with the Reading Coach tool, drafting documents in Microsoft Word using Copilot, and scheduling meetings via Teams.
Exclusive to Copilot Plus PC users, additional features include an AI-based sticker generator in Paint and a tool for selecting specific objects within the app that allows editing of individual image components. Furthermore, a new AI lighting option is available in the Photos app for Snapdragon-equipped devices, alongside a “perfect screenshot” feature in the Snipping Tool designed to accurately capture on-screen content.
Across all Windows 11 PCs, Microsoft is also launching non-AI related enhancements, including an upgraded color picker within the Snipping Tool and a mechanism for automatic resolution of issues that lead to unexpected restarts.
Microsoft has announced that these new features will be rolled out over the next month. Some capabilities are already accessible through Windows’ newly introduced non-security preview update as well as updates available via the Microsoft Store.
