Google Patents Smart Glasses Assistant That Adapts Suggestions Based on User Gaze, Voice Input

Google has been granted a patent for an automatic assistant that can be utilized to ship recommendations to a consumer carrying good glasses and adapt them based mostly on what the consumer is , or their verbal directions. While Google was beforehand engaged on a pair of good glasses that relied on augmented actuality (AR) know-how, the corporate reportedly deserted its ‘Project Iris’ AR good glasses final 12 months, in favour of constructing related {hardware} for OEM companions. It is presently unclear whether or not the corporate will launch a pair of AR glasses based mostly on the know-how described in its newest patent.

Google’s Assistant for Smart Glasses Could Identify Environmental Features of User Interest

In a document (through 91Mobiles) revealed on the World Intellectual Property Organization (WIPO) web site titled “Adapting assistant recommendations rendered at computerized glasses in keeping with adjustments in consumer gaze and/or different consumer enter”, the corporate describes the usage of an “automated” assistant that may adapt to audio and video enter supplied by a pair of good glasses phrase by a consumer.

Google’s patent doc reveals the adaptive assistant in motion (faucet to broaden)
Photo Credit: WIPO/ Google

 

The firm says that the automated assistant would be capable of render recommendations on the show of the good glasses, and that customers will be capable of choose these choices with know-how that tracks a consumer’s “gaze”. This means that the gadget could be geared up with some type of eye monitoring that could possibly be utilized by the assistant.

When a consumer seems elsewhere, the assistant would be capable of use the digicam and microphone on the good glasses to “adapt” its recommendations dynamically, based mostly on the consumer’s viewpoint and their verbal directions, respectively.

Google offers an instance of the consumer carrying the glasses, whereas exploring a overseas metropolis. The gadget would supply recommendations for eating places based mostly on the path of their gaze (Fig. 2B). Users would be capable of invoke the assistant by tapping the glasses or utilizing a wake phrase.

According to the doc, the assistant would additionally restrict the variety of recommendations seen on the good glasses’ show, as too lots of the recommendations might impede the wearer’s view. These recommendations could be chosen based mostly on gestures, or utilizing a spoken command. The patent additionally means that the assistant might interface with different purposes on the gadget.

The firm additionally describes the power to “offload computational duties” to a server gadget that will allow the good glasses to “preserve computational assets” — successfully offering extra battery life. This signifies that the assistant could possibly be hosted on the server or the good glasses, whereas processes associated to the assistant’s operations might happen on both gadget.