An AI companion on your desktop, ready to help you tackle projects, answer questions, and guide you through complex tasks may finally be here with the launch of Copilot Vision and its innovative Highlights feature on Windows. This update promises a more seamless and intelligent PC experience.
The Unique Advantages of Copilot Vision
Copilot Vision stands out by providing real-time, context-aware assistance. This AI assistant "sees" your screen, interprets your current activity, and offers immediate support, whether you’re browsing, working, or exploring new applications. It’s like having a knowledgeable partner who can offer answers, insights, and step-by-step walkthroughs right when you need them.
- Real-Time Visual Context: Copilot acts as your digital second set of eyes, capable of understanding what’s happening on your screen and offering relevant guidance.
- Multi-App Navigation: Users can share up to two apps at a time, enabling Copilot to follow your workflow and connect information across different tools.
- Hands-On Guidance with Highlights: The Highlights feature lets you request visual instructions for specific tasks, showing exactly where to click and what actions to take within an app.
- Personalized Support: Whether you’re gaming, editing photos, or organizing a trip, Copilot delivers tailored tips, like enhancing your images or ensuring your travel checklist is complete.
Easy Activation and User Control
Getting started with Copilot Vision is simple. Open the Copilot app, click the glasses icon in the composer, and select which app or browser window you want to share.
Just ask for help, and Copilot provides guidance in real time. You can stop sharing at any time by clicking ‘Stop’ or ‘X’ in the composer. Importantly, Copilot Vision is opt-in, putting you in full control over when and how it interacts with your desktop.
Who Can Use Copilot Vision?
Currently, Copilot Vision is available to users in the U.S. running Windows 10 or Windows 11. Microsoft plans to expand access to more countries outside of Europe soon. Since it’s part of Copilot Labs, the feature continues to evolve, with improvements driven by user feedback and changing needs.
More Powerful Tools in the Copilot App
Alongside Copilot Vision, the Copilot app now offers enhancements like Deep Research and robust file search. These capabilities further establish Copilot as a comprehensive digital companion, capable of understanding your goals and providing actionable advice across a range of activities.
Shaping the Future of PC Interaction
Copilot Vision aims to change how users engage with their computers by providing a responsive, context-aware assistant that adapts to your workflow. With regular updates and new features on the horizon, Copilot Vision is on track to become an essential tool for productivity and user support.
Competes with Gemini Live
CoPilot Vision is a step forward but it has tough competition. With Google integrating Gemini into Android and Chrome, access to Live screen sharing is only a click away in most apps.
Gemini Live provides very similar features to CoPilot pro and both are launching at the same time. As a power Windows user I look forward to testing out the CoPilot's Vision abilities however Google has been my go to model for months now, so displacing from my stack will be a challenge for Microsoft.
Final Thoughts
With Copilot Vision and Highlights, Windows users in the U.S. can now experience a smarter, more interactive desktop environment. If you’re eligible, it’s worth exploring how this AI-powered assistant can simplify tasks and enhance your daily computing while Microsoft continues to expand its reach and capabilities for the future.
Source: The Copilot Team, Microsoft Blog
Copilot Vision and Highlights Are Updating the Windows Experience