Posted by Thomas Ezan – Sr Developer Relation Engineer (@lethargicpanda)
We’re excited to announce Gaze Hyperlink because the winner of the Finest Android App for our Gemini API Developer Competitors!
This modern app demonstrates the potential of the Gemini API in offering a communication system for people with Amyotrophic lateral sclerosis (ALS) who develop extreme motor and verbal disabilities, enabling them to kind sentences with solely their eyes.
About Gaze Hyperlink
Gaze Hyperlink makes use of Google’s Gemini 1.5 Flash mannequin to foretell the consumer’s meant sentence based mostly on just a few key phrases and the context of the dialog.
For instance if the context is “Is the room temperature okay?” and the consumer replies “scorching AC two” the app will leverage Gemini to generate the total sentence “I’m scorching, are you able to flip the AC down by two levels?”.
The Gaze Hyperlink group took benefit of Gemini 1.5 Flash multilingual capabilities to let the app generate sentences in English, Spanish and Chinese language, the three languages at the moment supported by the app.
We have been actually impressed by the Gaze Hyperlink app. The group used the Gemini API mixed with ML Equipment Face Detection to empower people with ALS offering them with a robust communication system that’s each accessible and reasonably priced.
With Gemini 1.5 Flash at the moment supporting 38 languages, it’s attainable for Gaze Hyperlink so as to add help for extra languages sooner or later. As well as, the mannequin’s multimodal skills may allow the group to boost the consumer expertise by integrating picture, audio and video to reinforce the context of the dialog.
Construct with the Gemini API
The results of the mixing of the Gemini API in Gaze Hyperlink is inspiring. If you’re engaged on an Android app as we speak, we encourage you to be taught in regards to the Gemini API capabilities to see how one can efficiently add generative AI to your app and delight your customers.
To get began, go to the Android AI documentation!
