Microsoft's Voice and Vision Features Revolutionize Generative AI in Productivity Software

Tuesday, 1 October 2024, 11:34

Microsoft's updates to its generative AI capabilities revolutionize productivity software with exciting voice and vision features. By integrating these tools, Microsoft aims to enhance user interaction and streamline tasks, ensuring Copilot is a powerful personal AI assistant. Users can expect more natural conversations and visually-informative support as these features roll out in Copilot Pro.
Computerworld
Microsoft's Voice and Vision Features Revolutionize Generative AI in Productivity Software

Microsoft's Generative AI Updates

On Tuesday, Microsoft announced several updates to its free Microsoft Copilot and paid-for Copilot Pro services aimed at making the personal AI assistant more powerful and easier to converse with.

New Features: Voice and Vision

Among the updates is Copilot Vision, built natively into Microsoft’s Edge browser. This feature allows Copilot to see what a user sees while surfing the web and respond to queries about the contents of a web page using natural language. For example, it can highlight reviews on Rotten Tomatoes to help users choose a film.

Yusuf Mehdi, Microsoft’s corporate vice president and consumer chief marketing officer, stated, “We believe Copilot can go beyond answering basic questions and generating content to offering more complete support for you and your tasks.”

Privacy and User Control

According to Mehdi, user privacy is respected with Copilot Vision, which is turned off by default. Users must actively enable the feature with clear notifications, ensuring that no conversations or content are stored beyond the active session, and none of the interactions will be used for training.

Experimental Features in Copilot Labs

  • Think Deeper: This experimental feature allows Copilot to “reason” and provide detailed, step-by-step answers to complex questions.
  • Available in select regions for Copilot Pro customers, it aims to assist with practical challenges such as significant decisions like moving or purchasing a vehicle.

Refreshing the Copilot Experience

Microsoft also unveiled a refreshed Copilot mobile app with an enhanced user interface described as “cleaner and warmer.” Conversations with Copilot will be more realistic thanks to the introduction of Copilot Voice, enabling faster responses and multiple voice options for user interaction.

Keith Wong's insights underline the trend of anthropomorphized generative AI becoming prevalent across consumer brands, predicting that by 2026, around 80% of top brands will leverage AI for consumer engagement.


This article was prepared using information from open sources in accordance with the principles of Ethical Policy. The editorial team is not responsible for absolute accuracy, as it relies on data from the sources referenced.


Related posts


Newsletter

Subscribe to our newsletter for the most reliable and up-to-date tech news. Stay informed and elevate your tech expertise effortlessly.

Subscribe