Google Translate gets a Gemini upgrade: AI-powered live translation on headphones and more

Google has announced that it is adding a major update to its Translate app. The tech giant said it is integrating the new advanced capabilities from Gemini AI for greater accuracy and naturally delivered translations across the board. The update introduces the updated text translation quality in both the Translate app and Search, making translated text a lot more intelligent and more faithful to the original nuance.

Apart from this, Google also announced a new beta version of live translation that uses native speech-to-speech translation capabilities of Gemini to generate natural-sounding translations in real-time directly to headphones connected to Android devices. This update promises a more seamless and intuitive cross-cultural communication experience. This update also expands the number of languages that can be practiced within the Translate app.

Google Translate's Gemini upgrade: How it works

In a blog post, Google announced that Translate has already started utilising the advanced Gemini AI to offer better translations of the complex meaning carried out by phrases, idioms, local expressions, and slang. For instance, if there was an English idiom being translated that went as, "stealing my thunder," then the service now offers up a far more natural translation of that phrase than a literal word-for-word translation. The Gemini AI analyses the context so that this essential translation can communicate what is meant by an idiom.

The Gemini powered Google Translate has started to roll out to users in the US and India. The feature currently supports translations to and from English of nearly 20 languages. This includes Spanish, Hindi, Chinese, Japanese, and German. The AI-powered upgrade is coming to the Translate app for Android and iOS and to the web.

Real-time translation through headphones

Google is also launching a beta feature: real-time translations in-headphones. Powered by Gemini's new speech-to-speech translation technology, this experience retains the tone, emphasis, and rhythm of each speaker to make translations sound more natural for easier listening.

This feature can be used to have conversations in different languages, listen to speeches or lectures abroad, or to watch TV and films in other languages. By simply putting on headphones, opening the Translate app, and tapping "Live translate," users will hear the real-time translation in their preferred language.

Currently, the beta version of the feature is rolling out in the Google Translate app on Android in the US, Mexico and India. It works with any pair of headphones and supports more than 70 languages. Google is expected to bring the feature to iPhones and more countries in 2026.

Improved language learning tools

Apart from this, Google is also building on the Translate app's language-learning features, providing users with refined feedback that comes in handy with speaking practice. The app now includes a streak system showing the number of consecutive days of learning, enabling users to see how their consistency and progress are shaping up.

These capabilities are expanding to nearly 20 new countries including Germany, India, Sweden, and Taiwan. Supported language pairs include:

• English to German and Portuguese
• Bengali, Mandarin Chinese -Simplified, Dutch, German, Hindi, Italian, Romanian, & Swedish to English The company also notes that users like customised learning sets mirroring real-life situations, and Google intends to continue developing the feature with more functionality to help people reach their goals in language learning. With more advanced AI models in place, and the extension of more language learning capabilities, Google Translate now captures not just words, but the meaning behind them.