- The new “computer use” function for Copilot Studio gives the agents of the most tools
- Agents can now interact directly with applications or websites
- This can help with data entry, analysis, research and much more
Microsoft is giving its Copilot Studio AI platform more autonomy to directly access websites and applications, without any human interaction.
The company has revealed a new “computer use” function for Copilot Studio, which will allow the platform to interact directly with desktop applications and websites equally, such as clicking buttons, selecting menus and even writing in fields on the screen.
This means that companies can build AI agents with a much greater understanding of such systems (essentially anything with a graphical user interface), treating them as if they were tools, which allowed a better functionality in all areas.
“Use of the computer”
“Copilot Studio is the end -to -end agents platform designed to help organizations achieve their AI and Operation objectives,” Charles Lamanna, corporate vice president of the Microsoft business and industry industry wrote, in a blog post that announces the news.
“We want to train it to rationalize processes, improve productivity and boost innovation.”
The use of the computer will allow agents to handle tasks even when there is no API available to connect directly to the system, and can automatically adapt to any change in the application or website.
Developers can use the tool to build agents in desktop and browser applications, with Edge, Chrome and Firefox, all included from the launch.
It works in real time, using incorporated reasoning tools to solve solutions to problems independently, so development can continue uninterrupted.
Lamanna presented several possible scenarios in which the use of the computer could be especially useful for developers, including the automation of the entry of large volumes of data from various sources in a centralized system, carrying out generalized market research from several online sources and processing much faster and more precise invoices than before.
As the tool is executed in infrastructure housed in Microsoft, users do not need to manage their own servers, and include existing security measures of Copilot Studio and the governance frames to help guarantee compliance with industry standards.
The launch, which will see more attention in Microsoft Build in May 2025, follows a similar announcement of “shares” in the commercial version of Copilot recently. This system allows you to complete the task fund such as making restaurant reservations, booking tickets for events and buying items in online stores.
