Browser
Results as tablesRelease main-f03640150, as of 2026-11-13
A snapshot taken when this site was last built. The charts above read live data and may be newer. The same tables as markdown.
| Machine | Model | Setup | Engines (tok/s) |
|---|---|---|---|
| RTX 5090 Chrome 32 GB | Gemma-4-E2B | Single decode | Pie 84.8 · WebLLM 39 · llama.cpp WebGPU 21.5 |
| RTX 5090 Chrome 32 GB | Gemma-4-E2B | Single prefill | Pie 3,055 · WebLLM 495 · llama.cpp WebGPU 62.3 |
| RTX 5090 Chrome 32 GB | Gemma-4-E2B | Batched decode | Pie 486 · llama.cpp WebGPU 23.9 |
| RTX 5090 Chrome 32 GB | Gemma-4-E2B | Batched prefill | Pie 2,523 · llama.cpp WebGPU 62.4 |
| RTX 5090 Chrome 32 GB | Gemma-4-E4B | Single decode | Pie 67.9 · llama.cpp WebGPU 15.2 |
| RTX 5090 Chrome 32 GB | Gemma-4-E4B | Single prefill | Pie 2,098 · llama.cpp WebGPU 32.6 |
| RTX 5090 Chrome 32 GB | Gemma-4-E4B | Batched decode | Pie 351 · llama.cpp WebGPU 12.9 |
| RTX 5090 Chrome 32 GB | Gemma-4-E4B | Batched prefill | Pie 1,677 · llama.cpp WebGPU 32.5 |
| RTX 5090 Chrome 32 GB | Gemma-4-12B | Single decode | Pie 37.8 · llama.cpp WebGPU 33.8 |
| RTX 5090 Chrome 32 GB | Gemma-4-12B | Single prefill | Pie 1,107 · llama.cpp WebGPU 414 |
| RTX 5090 Chrome 32 GB | Gemma-4-12B | Batched decode | Pie 209 · llama.cpp WebGPU 74.7 |
| RTX 5090 Chrome 32 GB | Gemma-4-12B | Batched prefill | Pie 1,213 · llama.cpp WebGPU 445 |
| RTX 5090 Chrome 32 GB | Qwen3.5-4B | Single decode | Pie 97.3 · WebLLM 67 · llama.cpp WebGPU 42 |
| RTX 5090 Chrome 32 GB | Qwen3.5-4B | Single prefill | Pie 1,990 · WebLLM 1,314 · llama.cpp WebGPU 858 |
| RTX 5090 Chrome 32 GB | Qwen3.5-4B | Batched decode | Pie 409 · llama.cpp WebGPU 117 |
| RTX 5090 Chrome 32 GB | Qwen3.5-4B | Batched prefill | Pie 2,092 · llama.cpp WebGPU 1,098 |
| RTX 5090 Chrome 32 GB | Qwen3.5-9B | Single decode | Pie 87.6 · WebLLM 60.2 · llama.cpp WebGPU 40.3 |
| RTX 5090 Chrome 32 GB | Qwen3.5-9B | Single prefill | Pie 1,327 · WebLLM 863 · llama.cpp WebGPU 553 |
| RTX 5090 Chrome 32 GB | Qwen3.5-9B | Batched decode | Pie 292 · llama.cpp WebGPU 91.5 |
| RTX 5090 Chrome 32 GB | Qwen3.5-9B | Batched prefill | Pie 1,326 · llama.cpp WebGPU 662 |
| RTX 4090 Chrome 24 GB | Gemma-4-E2B | Single decode | Pie 92.8 · WebLLM 39 · llama.cpp WebGPU 25.4 |
| RTX 4090 Chrome 24 GB | Gemma-4-E2B | Single prefill | Pie 3,122 · WebLLM 455 · llama.cpp WebGPU 71.9 |
| RTX 4090 Chrome 24 GB | Gemma-4-E2B | Batched decode | Pie 459 · llama.cpp WebGPU 26.6 |
| RTX 4090 Chrome 24 GB | Gemma-4-E2B | Batched prefill | Pie 2,947 · llama.cpp WebGPU 70.3 |
| RTX 4090 Chrome 24 GB | Gemma-4-E4B | Single decode | Pie 72.4 · llama.cpp WebGPU 14.6 |
| RTX 4090 Chrome 24 GB | Gemma-4-E4B | Single prefill | Pie 1,938 · llama.cpp WebGPU 34.2 |
| RTX 4090 Chrome 24 GB | Gemma-4-E4B | Batched decode | Pie 319 · llama.cpp WebGPU 13.8 |
| RTX 4090 Chrome 24 GB | Gemma-4-E4B | Batched prefill | Pie 1,761 · llama.cpp WebGPU 35.6 |
| RTX 4090 Chrome 24 GB | Gemma-4-12B | Single decode | llama.cpp WebGPU 42.7 · Pie 33 |
| RTX 4090 Chrome 24 GB | Gemma-4-12B | Single prefill | Pie 874 · llama.cpp WebGPU 240 |
| RTX 4090 Chrome 24 GB | Gemma-4-12B | Batched decode | Pie 189 · llama.cpp WebGPU 56.4 |
| RTX 4090 Chrome 24 GB | Gemma-4-12B | Batched prefill | Pie 982 · llama.cpp WebGPU 253 |
| RTX 4090 Chrome 24 GB | Qwen3.5-4B | Single decode | Pie 107 · llama.cpp WebGPU 46.3 · WebLLM 33.3 |
| RTX 4090 Chrome 24 GB | Qwen3.5-4B | Single prefill | Pie 1,871 · WebLLM 915 · llama.cpp WebGPU 667 |
| RTX 4090 Chrome 24 GB | Qwen3.5-4B | Batched decode | Pie 331 · llama.cpp WebGPU 99.9 |
| RTX 4090 Chrome 24 GB | Qwen3.5-4B | Batched prefill | Pie 1,985 · llama.cpp WebGPU 683 |
| RTX 4090 Chrome 24 GB | Qwen3.5-9B | Single decode | Pie 84.9 · llama.cpp WebGPU 46 · WebLLM 35.1 |
| RTX 4090 Chrome 24 GB | Qwen3.5-9B | Single prefill | Pie 1,180 · WebLLM 658 · llama.cpp WebGPU 382 |
| RTX 4090 Chrome 24 GB | Qwen3.5-9B | Batched decode | Pie 251 · llama.cpp WebGPU 73 |
| RTX 4090 Chrome 24 GB | Qwen3.5-9B | Batched prefill | Pie 1,220 · llama.cpp WebGPU 391 |