Gemma 4: 96 Tokens/Second on Dual RTX Cards, Fixing My Kubernetes Bugs by Lunch
96 tokens per second. That's Gemma 4 chewing through Kubernetes bug reports on my dual RTX setup. Google's open model just turned 'wait and hope' into 'deploy and debug now.'
⚡ Key Takeaways
- Gemma 4 hits 96 tok/s on dual RTX consumer hardware, demolishing official benchmarks.
- From release to production inference: 2 hours, including custom llama.cpp build.
- Real-world bug fixes in Kubernetes code—production-ready Go and YAML in seconds.
Worth sharing?
Get the best Developer Tools stories of the week in your inbox — no noise, no spam.
Originally reported by dev.to