Microsoft wants you to talk to your computer as it reveals one of the most ambitious Windows 11 updates yet. Users will have access to a new “Agentic AI” named Copilot Actions, which enables hands-free, voice-controlled navigation of the operating system (OS).
Windows 11 has become “the computer you can talk to” as Microsoft infuses more AI throughout the OS. Copilot Actions will enable users to converse with their computers with natural language, including interactions with apps, files, and web services.
For example, Copilot Actions can autonomously compose and send a reply to an email or organize folders in the background when asked, while Windows users continue on other tasks. The agent will pop up progress updates in the Copilot app and prompt for intervention or confirmation when necessary.
According to Yusef Mehdi, Microsoft Consumer Chief Marketing Officer, "Simply describe the task you want to complete in your own words, and the agent will attempt to complete it by interacting with desktop and web applications. While this is happening, you can choose to focus on other tasks. At any time, you can take over the task or check in on the progress of the action, including reviewing what actions have been taken."
Users will need to manually enable Copilot Actions before it can integrate with the Copilot app.
Microsoft has also added a new “Hey Copilot” wake word, meaning users can skip a few clicks before interacting with the assistant at any time. The voice-enabled activation is powered by Copilot Vision, which provides contextual awareness of the screen's content. A new Taskbar will also combine Copilot chat and traditional Windows search.
Microsoft will release the new Copilot features to all Windows 11 computers, and not just to Copilot+ PCs. Some of the updates will be pushed to consumers in waves, starting today. However, other Copilot Actions will enter preview soon.