Header Banner
Next Reality Logo
Next Reality
Mobile AR News
nextreality.mark.png
Apple Snap AR Business Google Instagram | Facebook NFT HoloLens Magic Leap Hands-On Smartphone AR The Future of AR Next Reality 30 AR Glossary ARKit Dev 101 What Is AR? Mixed Reality HoloLens Dev 101 Augmented Reality Hololens How-Tos HoloLens v. Magic Leap v. Meta 2 VR v. AR v. MR

Translate Foreign Text Live in Real Time Using Your Smartphone

Emergency exit sign being photographed with a smartphone.

Early last year, Google purchased Quest Visual, acquiring the immensely popular augmented reality translator app Word Lens in the process. While Google did put the feature on the Google Glass, they spoke more about implementing Word Lens into their Translate app sometime in the future.

Well, that time has now come.

Google Translate's latest update brings Word Lens' live translations to your Android and iOS device. Check out the guide below to learn how to use live translation, as well as take advantage of the highly improved conversation mode in Google Translate.

Live Translation

To start using live translation, all you need to do is tap on the camera icon and point your camera at what you want to be translated. Currently, live translation only works with English to Spanish, French, German, Italian, Portuguese, and Russian, and from those languages back to English.

Translate Foreign Text Live in Real Time Using Your Smartphone
Translate Foreign Text Live in Real Time Using Your Smartphone
Translate Foreign Text Live in Real Time Using Your Smartphone
Translate Foreign Text Live in Real Time Using Your Smartphone

Almost instantly, whatever text is aligned on the screen should translate. Below, you can see the real-time translation of a sign in Spanish (left) to English (right).

Warning sign indicating explosion risk with a prohibition on entry.
Warning sign indicating a risk of explosion with a "Not Among" graphic.
Warning sign indicating explosion risk with a prohibition on entry.
Warning sign indicating a risk of explosion with a "Not Among" graphic.

After using the the live translation feature on a few signs, I noticed that the translations weren't perfect. For the most part, it was able to to get the message across, but since it translates every word, it didn't always make sense since it can't translate context.

When it translates Spanish, it translates the prefixes, which mostly become incorporated with the word that follows it, so the structure becomes a little muddled at times. But you can get what it says.

Improve the translation by tapping on the "Scan" icon at the bottom-right, which then scans for text and uses the regular translation feature to provide a more accurate translation, which you can see below.

Warning signs related to explosion risk in Spanish and English.
Warning sign indicating danger of explosion, with text in Spanish and English.
Warning signs related to explosion risk in Spanish and English.
Warning sign indicating danger of explosion, with text in Spanish and English.

Conversation Mode

Conversation mode allows two users to take turns speaking in their language, translated instantly and spoken aloud for the other person to listen to, making conversation seamless. In the past, this feature has been painstakingly slow, but with this latest update, Conversation mode is greatly improved.

First select the two languages that will be spoken and hit the microphone icon. Google will then listen and figure out which language is being spoken first, then translate it to the other language and play it out loud.

Translate Foreign Text Live in Real Time Using Your Smartphone
Translate Foreign Text Live in Real Time Using Your Smartphone
Translate Foreign Text Live in Real Time Using Your Smartphone
Translate Foreign Text Live in Real Time Using Your Smartphone

You can then hand off the phone to the other person and they can speak in their language, which will be translated back to the other language. To make conversation even easier, you can flip your device to landscape mode and Translate will automatically begin listening for speech, making the whole process fairly seamless.

Voice recognition interface with "automatically start listening" prompt and microphone icon.

Using the feature was pretty awesome, as it translates very accurately and even recognizes colloquialisms.

Test out out the new and improved Google Translate for yourself, and let us know what you think! Leave us a comment below, or hit us up on Facebook, Google+, or Twitter.

Apple's iOS 26 and iPadOS 26 updates are packed with new features, and you can try them before almost everyone else. First, check Gadget Hacks' list of supported iPhone and iPad models, then follow the step-by-step guide to install the iOS/iPadOS 26 beta — no paid developer account required.

Related Articles

Comments

No Comments Exist

Be the first, drop a comment!