Gemma3
Gemma 3 is a lightweight family of models from Google built on Gemini technology. The Gemma 3 model comes in many different sizes with different amounts of parameters. Generally speaking, only the smallest of the models will have any chance of running on a Raspberry Pi. The 270m and 1b models are the smallest ones and they works nicely on the Raspberry Pi 4 and 5 with 8 GB of RAM.
ollama run gemma3:270m
or
ollama run gemma3:1b
The first time you run the model, it will download the model and its associated files. The Gemma3 270m model is about 300mb and the 1b model is about 820mb.
Once you see the "Send a message" prompt, the download is complete.
Type in whatever prompt you want to give to the model and see the output get generated.
$ ollama run --verbose gemma3:270m >>> please write a short poem about the Raspberry Pi. No more than one paragraph. A humble friend, a digital dream, The Raspberry Pi, a flowing stream. From circuits bright to a simple form, A guiding light, weathering the storm. It's a tool of learning, a constant friend, Unlocking knowledge, until the end. A humble story, a knowledge held, A beacon bright, forever told. total duration: 3.69364428s load duration: 191.825636ms prompt eval count: 25 token(s) prompt eval duration: 161.167543ms prompt eval rate: 155.12 tokens/s eval count: 76 token(s) eval duration: 3.33992834s eval rate: 22.75 tokens/s
$ ollama run --verbose gemma3:1b >>> please write a short poem about the Raspberry Pi. No more than one paragraph. A tiny chip, a clever start, A Raspberry Pi, a work of art. It learns and spins, a digital dream, For coding, gaming, a joyful stream. From simple tasks to projects grand, A versatile tool, close at hand. It’s tiny size, a powerful core, Opening doors we’ve longed before. A maker’s delight, a humble plea, The Raspberry Pi, for you and me! total duration: 11.090768898s load duration: 377.985336ms prompt eval count: 25 token(s) prompt eval duration: 903.544788ms prompt eval rate: 27.67 tokens/s eval count: 98 token(s) eval duration: 9.808476568s eval rate: 9.99 tokens/s
Page last edited September 18, 2025
Text editor powered by tinymce.
