Run Gemma on a Phone with 1 GB RAM in 5 Minutes
Local AI without internet: install PocketPal AI and download a lightweight Gemma model
- 1.Install the PocketPal AI app from Google Play or the App Store. Open the app after installation.
The app is free and works offline. On iOS search for 'PocketPal AI' in the App Store, on Android - in Google Play.
PocketPal AI ↗ - 2.On first launch the app will ask for permissions - tap Allow. On the main screen open the Models tab (cube icon or tab at the bottom).
If the app offers to download a model on first launch - select 'Choose manually' to pick a lightweight version yourself.
PocketPal AI ↗ - 3.In the Models section find Gemma 2B or Gemma 2 2B Instruct in GGUF format with Q4_K_M or Q3_K_S quantization. Tap the model and tap Download.
For 1 GB RAM you need a model no larger than 1.5 - 1.8 GB. The Q4_K_M version is about 1.6 GB, Q3_K_S - about 1.3 GB. If the download is slow - connect to Wi-Fi.
Hugging Face (via PocketPal) ↗ - 4.After the download return to the main screen (Chat tab). At the top select the downloaded Gemma model from the dropdown list. Start a conversation - send your first prompt.
The first request may take 30 - 60 seconds: the model loads into memory. Subsequent responses will be faster.
PocketPal AI ↗PromptYou are a helpful assistant. Answer in Russian. Explain quantum computing in one simple sentence that a 10-year-old can understand.
What this prompt doesThis prompt sets the model's role and asks it to explain quantum computing in one simple sentence in Russian. Replace the topic 'quantum computing' with your own - for example 'photosynthesis' or 'how VPN works'. - 5.Make sure the internet is off (turn on airplane mode). Send another request - the model should respond without a network connection.
If the model does not respond or crashes - try Q3_K_S quantization or reduce the context in Settings -> Inference -> Context length to 1024.
PocketPal AI ↗PromptGive me 5 ideas for a weekend trip within 100 km of my city.
What this prompt doesAsks the model for 5 weekend trip ideas within 100 km of your city. The answer will be in English - add 'Answer in Russian' to the end of the prompt if you need Russian.
- freePocketPalThe app is completely free, with no subscriptions or ads; everything runs locally on your phone.
- freeHugging Face (model download)Downloading GGUF models via web and the app is free with no registration; the only cost is mobile data for a 600 - 800 MB file.
Why today
AI services change fast - interfaces and free limits may differ from what's described.