Codestral 22B
mistralai/Codestral-22B-v0.1
Parameters
22B
Context
32K
Downloads
39.3K
Likes
1.3K
Architecture
transformer
GPU Requirements
VRAM / RAM / disk estimates by quantization and usage scenario
| Quantization | Minimum | Recommended | Production |
|---|---|---|---|
| FP1616bit | 56.8 GB RAM 85.2 · Disk 102.9 | 74.9 GB RAM 112.3 · Disk 128.9 | 174.2 GB RAM 261.2 · Disk 167.9 |
| FP88bit | 30.9 GB RAM 46.3 · Disk 71.0 | 47.8 GB RAM 71.7 · Disk 97.0 | 145.9 GB RAM 218.8 · Disk 136.0 |
| INT88bit | 30.9 GB RAM 46.3 · Disk 71.0 | 47.8 GB RAM 71.7 · Disk 97.0 | 145.9 GB RAM 218.8 · Disk 136.0 |
| AWQ4bit | 18.4 GB RAM 32.0 · Disk 55.6 | 34.8 GB RAM 52.1 · Disk 81.6 | 132.3 GB RAM 198.4 · Disk 120.6 |
| GPTQ4bit | 18.6 GB RAM 32.0 · Disk 55.8 | 34.9 GB RAM 52.4 · Disk 81.8 | 132.4 GB RAM 198.7 · Disk 120.8 |
| GGUF4bit | 18.9 GB RAM 32.0 · Disk 56.2 | 35.3 GB RAM 52.9 · Disk 82.2 | 132.8 GB RAM 199.2 · Disk 121.2 |
GPU Recommendations
1× H100 SXM
80 GB VRAM
≈ 315.1 tok/s
Effective production throughput ≈ 220.6 tok/s
score 0.6004
2× L4
48 GB VRAM
≈ 45.2 tok/s
Effective production throughput ≈ 31.6 tok/s
score 0.6407
8× H200 SXM
1128 GB VRAM
≈ 1445 tok/s
Effective production throughput ≈ 1011.5 tok/s
score 0.2197
1× RTX A6000
48 GB VRAM
≈ 72.2 tok/s
Effective production throughput ≈ 50.5 tok/s
score 0.6831
💬 Community — real deployment experience
0 Articles · 0 Benchmarks
GPUs that fit (single card)
RTX A6000
48 GB VRAM
$265
/mo · vast
L40S
48 GB VRAM
$341
/mo · vast
A100 SXM4
80 GB VRAM
$440
/mo · vast
RTX PRO 6000 Max-Q
48 GB VRAM
$531
/mo · vast
A100 PCIE
80 GB VRAM
$556
/mo · vast