Google Translate on Android now lets you translate text without typing, using OCR technology. Just tap the camera button, point it at the text you want to translate (say, a menu, a road sign—you get the idea!), tap to freeze the picture and then brush your finger over the text to get a translation.
Currently, this is possible for Czech, Dutch, English, French, German, Italian, Polish, Portuguese, Russian, Spanish and Turkish—we’re working to expand to other languages, too. with With latest update to Google Translate app for Android, Google aims to get one step closer to the Babel fish.
By integrating Google Goggles’ optical character recognition (OCR) technology, the company made it possible for you to use the camera of your Android smart phone to input text without typing. This makes Google Translate for Android one of most intelligent and machine learning-intensive apps. Speech recognition, handwriting recognition, OCR, and machine translation all rely on powerful statistical models built on billions of samples of data.
Here’s how it comes together:
To use new camera feature, push the camera button, point at some text, tap to freeze the picture, brush the part you want with your finger, et voilà — enjoy your machine translation. As usual, you can click the text-to-speech icons to listen to the source text or the translated text.