Microsoft has unveiled a significant update to its artificial intelligence Copilot, enhancing it with voice interaction and image recognition capabilities.
The company is overhauling the Copilot design across all platforms — including mobile devices, the web version, and the Windows application. The new interface is based on cards and resembles the solution developed by Inflection AI for its personalized AI assistant Pi.
The redesigned Copilot now features a personalized Discover page that adapts to the user's interaction history. Over time, it will include useful search queries, tips, and relevant information.
One of the key innovations is the voice capabilities of Copilot. Users can now converse with the AI assistant, ask it questions, and interrupt it just like they would with a real person.
Another significant feature is Copilot Vision. This allows the AI assistant to "see" what the user is viewing on a web page. Copilot can answer questions about the text, images, and other content the user is looking at.
Microsoft also introduced Copilot Daily — an audio news and weather summary read aloud by a voice akin to that of a broadcaster. This feature uses content solely from authorized news and weather sources.
The company has enhanced Copilot's ability to respond to complex questions through new OpenAI models. The Think Deeper function allows the assistant to take more time to respond and provide a step-by-step explanation of intricate issues. This feature is particularly useful for comparing different options or analyzing complex situations. For instance, a user might ask: “Should I move to New York or San Francisco?” and Copilot will provide a detailed analysis of the pros and cons of each city.
Think Deeper is still in the early development stage and is available as part of the new Copilot Labs feature. This is an experimental platform where users can test new capabilities of the AI assistant and provide feedback to developers.
The updated Copilot is available in mobile applications for iOS and Android, on the website copilot.microsoft.com, and in the Windows app. Voice features are currently only functional in English and available in a limited number of countries — New Zealand, Canada, Australia, the UK, and the US.
Source: The Verge
Comments (0)
There are no comments for now