- Microsoft is expanding Copilot’s vision capabilities
- Soon, you can see and interact with Windows as a whole and applications
- You could even use it to learn a photoshop skill
It is a great day for Microsoft: it is the 50th anniversary of one of the most shocking companies in history, and it is the day the co -pilot takes to the next level. Microsoft’s assistant, Copilot, is becoming more personalized and has a lot of new features.
However, it is worth paying attention to the expansion of Copilot Vision, since it will provide one of the most significant intelligent increases for Windows. We have already seen that Copilot can navigate the web next to you, share what you are seeing with selected partners and take a hand.
Courtesy of the new Copilot For Windows application, you can let the AI see its screen when in the base operating system and in selected applications. As with the web, it combines multimodal with agent capabilities, and thanks to its ability to see and understand its screen, you can also interact with applications.
Help on the screen
This comes in the form of options to stand out on your screen, and even adding an additional cursor, but also guide it through the steps required through speech. It’s quite great.
In a shared demonstration, we saw that Copilot provides instructions for an edition within Photoshop, essentially guides it through how to use the tool. This could be a great change of play, since it is not just an AI for fast events; You can integrate co -pilot into your workflow and really use it as you seem best.
Of course, we will have to see exactly how well it works, but together with a more personalized co -pilot, the addition of the vision for Windows is a great step. It will be subscription in the launch, and Microsoft is adopting a slow and stable approach.
The vision within the Copilot For Windows application will begin to be implemented for Windows Insids next week, and Microsoft says it will be available “more widely later.” That is not super specific, so it could spend a while before you can really try it, if you are not an expert in Windows.
For Android and iOS too
Together with the ‘deep research’ capabilities and a new function of ‘purchases’ for Copilot, their vision capabilities are also expanding to their Android or iOS phone. Through the Copilot application, you can turn on your camera and essentially let the AI have that view for those devices. This means that I could point it out to a dog and ask for the race or even a store and ask for reviews. You can also load photos from the roll of your camera.
This improved vision capacity for Copilot in Mobile is also available at this time, just be sure to update the application.
This change in the mobile also takes the co -pilot to the same field of play as Google’s capabilities with Astra on Android. Windows changes represent a great leap in intelligence that could change the way it uses applications in the operating system.
I can’t wait to try vision with a complex task that I am trying to discover how to achieve in Photoshop or when I need to create a complex formula in Excel.
However, all these changes show Microsoft’s ambition with AI, specifically for more people to use Copilot. None of these are defined by categories or new per se, but they certainly make the co -pilot much more convincing together with Google Gemini or Chatgpt; After all, he has the brain, so why no more functions?
