How to Translate Non-Localized Games Right on Your Android Screen

Anyone who's tried playing Japanese visual novels or JRPGs without an official translation knows this pain. You're either stuck holding your phone up to the screen, pointing the camera at your monitor, or you dig into PC memory hooks, configure third-party OCR tools, and pray the text encoding doesn't break on the very first line.

On mobile devices and handheld consoles running Android, things have been even worse for a long time. There were practically no ready-made translation tools available. I recently discovered an interesting project called PlayTranslate that solves this problem in a rather elegant way.

PlayTranslate with Persona 3 Reload

What PlayTranslate Does

Essentially, it's an Android overlay that captures text from the screen in real time, recognizes it, and translates it into the selected language. The app supports 25 source languages from games and can output translations into 59 languages, including Russian.

The project targets two audiences: those who simply want to play through a story-driven game in a language they understand, and those learning a foreign language through games and visual novels. Because of this, the functionality runs considerably deeper than just "recognize the image and run it through a basic translator."

Key Features Under the Hood

It brings together many practical features that usually require cobbling together five different plugins:

1. Automatic translation and tap-to-translate. You can tap to translate the screen or enable auto mode, which monitors dialogue window changes and updates the translation automatically without extra steps.
2. Interactive dictionary and pop-up magnifier. Hovering a floating cursor over an unfamiliar word immediately displays a dictionary entry with context.
3. Furigana and pinyin over characters. For Japanese or Chinese learners, there's a mode that displays reading hints directly above symbols in real time.
4. Deep integration with AnkiDroid and Yomitan. You can save a sentence to an Anki card in one click, complete with screenshot, transcription, translation, text-to-speech, and even a recorded snippet of game audio. Yomitan dictionaries with pitch accent and frequency lists are supported.
5. Physical buttons and split-screen. On handheld consoles like Ayn Thor or phones with gamepads, you can assign translation display to a physical button held down. The app works with dual-screen devices and Android's Split Screen mode.

Technical Stack and Offline Operation

What makes the project architecture particularly compelling is its ability to function entirely offline. The developers built a robust local inference stack rather than just wrapping web APIs.

Here's how the internals work:

• Optical character recognition (OCR) uses a combination of PaddleOCR (PP-OCRv6 detectors), custom models like MangaOCR for vertical text, and the OpenCV library handling contour preprocessing and tracking.
• Morphological analysis and real-time text segmentation rely on specialized libraries: Sudachi for Japanese, HanLP for Chinese, KOMORAN for Korean, and PyThaiNLP for Thai.
• Local model inference runs through Alibaba's MNN engine. If desired, you can load compact LLMs into device memory for offline translation: TranslateGemma 4B, Qwen 2.5 1.5B Instruct, or Bergamot from the Mozilla Firefox team.

If you have network access and want maximum translation quality with context awareness, you can connect to virtually any external API in settings. Supported options include DeepL, OpenAI, Google Gemini, DeepSeek, Mistral, Groq, OpenRouter, or any compatible server with a custom base URL.

Installation and Getting Started

The app isn't available on Google Play due to its screen capture and overlay functionality, so you'll need to install it manually via APK from the repository's releases page.

After installation, you'll need to grant two permissions in Android settings: screen recording access for OCR functionality, and Accessibility permissions if you want to bind translation to gamepad buttons.

The project is open source under GPL 3.0, written in Kotlin, and under active development.

Who This Project Is For

If you're playing JRPG ports, PSP, PS2, or Switch emulators on Android and are tired of waiting for fan translations, PlayTranslate solves the problem immediately. For those using immersion learning to study Japanese or Chinese, the integration with AnkiDroid and Yomitan dictionaries saves significant time when analyzing game dialogue.