The Ask Photos feature in Google Photos will allow you to search for images using voice and text contextual queries

Google intends to integrate artificial intelligence deeper into the photo and video storage service Google Photos. As part of this integration, a new feature called Ask Photos will be introduced. It will allow users to search for the required images using complex voice or text queries.

The Ask Photos feature will help to browse through the entire Google Photos library with the ability to obtain unique identification aspects and use contextual queries to find the exact image needed. It could be a series of related photos showing progress for a specific event or person.

Ask Photos, a new feature coming to @GooglePhotos, makes it easier to search across your photos and videos with the help of Gemini models. It goes beyond simple search to understand context and answer more complex questions. #GoogleIOpic.twitter.com/OsYXZLo5S1

— Google (@Google) May 14, 2024

The new feature goes beyond simple image search as Gemini can detect the content of images. Google gave an example of searching for a car license plate with a query about the specific number on a particular car. The photos were then identified, providing the result with the specified number.

In another example, it was possible to accurately determine when a child learned to swim, based on images already in the user's Google Photos library. Alternatively, one could request a demonstration of a child's swimming accomplishments. Gemini will analyze the photo library, find relevant photos, recognize different contexts, such as swimming lessons in a pool, swimming at the ocean shore, swimming certificates and awards, and then group the found photos into a thematic summary.

The Ask Photos feature can also be used for videos, although Google did not show a live demonstration or example of this in action. It is also not mentioned whether this function will work locally on the device or require an internet connection.

Ask Photos will begin to roll out in the coming months. The "summer" timeframe is mentioned as the approximate release date.

Source: 9to5google