Latest writing
The Best gemma4 12B Quant for a 16GB Blackwell GPU
Benchmarking gemma4 12B quants on the cheapest 16GB Blackwell card. QAT beats Q4_K_M outright, and its FP4, FP8, and MTP speedups are all macOS-only on Ollama.
Read the postLatest writing
Benchmarking gemma4 12B quants on the cheapest 16GB Blackwell card. QAT beats Q4_K_M outright, and its FP4, FP8, and MTP speedups are all macOS-only on Ollama.
Read the post