Google Explains How Its Gemini Integration in Photos App Lets Users Find Photos With Prompts

Nearly a yr after unveiling its Ask Photos characteristic on the I/O developer convention in May 2024, Google has lastly shed some gentle on how the characteristic will work. It was launched as an extension for Google Photos which permits the on-device Gemini synthetic intelligence (AI) assistant to entry a person’s photographs and reply queries about them. While the characteristic began transport out in early entry in September final yr, the corporate has now confirmed the small print about its availability and workings.

Gemini-Powered Ask Photos Feature: How Does It Work?

According to a brand new help doc published by Google, the characteristic is out there on each Android and iOS platforms. It requires customers to have Gemini and Google Photos apps put in, and have Gemini Apps Activity (previously Gemini Extensions) enabled. Further, the Gemini app ought to have the identical account logged in because the Photos app. Once finished, the characteristic is prepared for utilization.

The Mountain View-based tech big says customers can ask the Gemini app to discover a photograph within the Google Photos library. They can embody @Google Photos or my pictures of their immediate to make sure that Gemini makes use of the Google Photos app. It works with prompts reminiscent of:

1. Find my pictures of Alex
2. Show my pictures from final summer season
3. Show me latest selfies
4. Show my pictures from my most up-to-date journey
5. Find my pictures of landscapes

In essence, the Gemini integration within the Photos app lets customers ask conversational queries to filter out a particular picture saved on the person’s cloud storage. They can ask detailed queries spanning a number of sentences or pure language prompts with some fundamental details about the picture, enabling the AI to fetch the correct picture. They also can ask follow-up queries in case the AI shouldn’t be capable of finding the picture within the first try.

Users can ask questions primarily based on their face teams or relationships saved within the Photos app, the placement or date the photograph was taken, an outline of what is within the photograph, or their present dialog with the Gemini cellular app.