Microsoft Expands Copilot Vision AI to Scan Entire Desktop for Insiders

Microsoft is introducing a significant update to Copilot Vision for Windows Insiders, enhancing the AI tool's capabilities to see everything on your screen. Previously, Copilot Vision could analyze only two apps at a time, connecting the information between them. With this new feature, the AI can now view your entire desktop or any specific browser or app window, providing a more comprehensive and useful experience. Unlike Microsoft’s Recall, which automatically captures regular snapshots of your screen, Copilot Vision functions more like screen-sharing during a video call. To activate the feature, users simply click the glasses icon within the Copilot app and select the desktop area they want the AI to examine. According to Microsoft, Copilot Vision can assist in analyzing content, offering insights, and answering questions, guiding you through tasks verbally. This can range from providing tips to enhance a creative project, helping refine your resume, or even offering guidance while you navigate a new game. Initial testing of Copilot Vision began last year as a browser-focused feature in Microsoft Edge, designed to understand and interact with web content. Now, the tool’s functionality extends to a broader range of applications and can even respond to queries using your mobile phone’s camera. This update underscores Microsoft’s commitment to integrating advanced AI tools into everyday computing tasks, aiming to make technology more intuitive and helpful for users.