Microsoft's Voice and Vision Features Revolutionize Generative AI in Productivity Software
Microsoft's Generative AI Updates
On Tuesday, Microsoft announced several updates to its free Microsoft Copilot and paid-for Copilot Pro services aimed at making the personal AI assistant more powerful and easier to converse with.
New Features: Voice and Vision
Among the updates is Copilot Vision, built natively into Microsoft’s Edge browser. This feature allows Copilot to see what a user sees while surfing the web and respond to queries about the contents of a web page using natural language. For example, it can highlight reviews on Rotten Tomatoes to help users choose a film.
Yusuf Mehdi, Microsoft’s corporate vice president and consumer chief marketing officer, stated, “We believe Copilot can go beyond answering basic questions and generating content to offering more complete support for you and your tasks.”
Privacy and User Control
According to Mehdi, user privacy is respected with Copilot Vision, which is turned off by default. Users must actively enable the feature with clear notifications, ensuring that no conversations or content are stored beyond the active session, and none of the interactions will be used for training.
Experimental Features in Copilot Labs
- Think Deeper: This experimental feature allows Copilot to “reason” and provide detailed, step-by-step answers to complex questions.
- Available in select regions for Copilot Pro customers, it aims to assist with practical challenges such as significant decisions like moving or purchasing a vehicle.
Refreshing the Copilot Experience
Microsoft also unveiled a refreshed Copilot mobile app with an enhanced user interface described as “cleaner and warmer.” Conversations with Copilot will be more realistic thanks to the introduction of Copilot Voice, enabling faster responses and multiple voice options for user interaction.
Keith Wong's insights underline the trend of anthropomorphized generative AI becoming prevalent across consumer brands, predicting that by 2026, around 80% of top brands will leverage AI for consumer engagement.
This article was prepared using information from open sources in accordance with the principles of Ethical Policy. The editorial team is not responsible for absolute accuracy, as it relies on data from the sources referenced.