Microsoft Copilot Labs has opened beta trials of Copilot Vision to select Copilot Pro subscribers who are invited. The Vision AI sees everything that users are doing in the Microsoft Edge web browser to provide assistance, information, tips, and aid.
The Copilot AI is integrated into the latest versions of Microsoft Windows, Edge, and Office. This AI provides answers and assistance when prompted by text input. Copilot Vision adds the ability to see everything a user is doing within Microsoft Edge, eliminating the need to describe objects, maps, and other visual elements by text when prompting the AI.
Gamers will enjoy gaming more with the tips and information that Vision can provide in-game, although it does not yet have the ability to control games directly. The Vision AI can identify objects while web surfing to help users compare items when shopping for hotels, toys, or other products. The AI can also surface specific product information such as how to wash a piece of clothing. Users who don't know what to buy or what to do during the day can ask the AI for suggestions, allowing busy users to lead a more decision-free life.
Copilot Vision is currently limited for use to a select set of web sites during beta testing, and this set will expand over time. The visual data and user interactions Copilot Vision sees each session are deleted when the session is ended, but all answers generated by the AI are kept by Microsoft.
Reader stuck in endless meetings might want to simplify their lives by picking up a Plaud AI voice recorder to automatically transcribe and summarize (sold here on Amazon) what they didn't hear.
Are you a techie who knows how to write? Then join our Team! Wanted:
- News Writer (Romania based)
Details here