Expressive Captions are a part of Reside Caption, in order that they’re constructed into the working system and out there throughout apps in your telephone. This implies you should use Expressive Captions with most stuff you watch, like livestreams on social platforms, recollections in your Google Pictures reel and video messages from family and friends. When enabled, captions will happen in actual time and on system, so you should use them even whilst you’re on airplane mode.

Bringing Expressive Captions to life

To construct Expressive Captions, our Android and Google DeepMind groups labored to grasp how we interact with content material on our units with out sound. Utilizing a number of AI fashions, Expressive Captions not solely captures spoken phrases but additionally interprets them into stylized captions, whereas offering labels for a good wider vary of background sounds. This makes captions simply as vibrant as listening to audio. It’s only one approach we’re constructing for the true lived experiences of individuals with disabilities and utilizing AI to construct for everybody.

Beginning at present, Expressive Captions can be out there within the U.S. in English on any Android system operating Android 14 and above that has Reside Caption. That is a part of our work to search out much more methods to carry emotional expression and context to captions.