Google Translate adds new AI-powered experimental language learning feature that allows users to practice multiple languages, as well as communicate in real time and compete with multiple neighbors.
Google Translate is rolling out a new AI-powered experimental feature designed to help people practice and learn new languages. The feature is available for both beginners and advanced learners, creating customized listening and speaking practice sessions that adapt to the user's skill level and learning goals. Google Translate has also added a real-time communication capability that allows users to engage in two-way conversations with others through voice and on-screen translation. The introduction of these features marks Google's official challenge to language learning apps such as Multi-Neighbor.
Users can select the "Practice" option in the Google Translate app, set skill levels and goals, and then the app generates customized scenarios in which users can listen to a conversation and select the words they hear to improve comprehension or practice speaking. The feature currently supports English learners practicing Spanish and French, and Spanish, French and Portuguese learners practicing English.
In addition, Google Translate introduces real-time conversations, where users can tap the "Real-time translation" option, select the language they want to translate and speak, and the app will play the translation out loud and display a transcript of the bilingual conversation. This feature recognizes pauses, accents and intonation, and can be used even in noisy environments. The real-time translation feature is now live in the U.S., India, and Mexico, with support for more than 70 languages.
Google says the updates have been made possible by advances in AI and machine learning, with its Gemini model making huge strides in translation quality, multimodal translation and text-to-speech (TTS) capabilities. Google Translate helps users translate around 1 trillion words every day, and the new features will help break down language barriers.