AmciHub
Models
Cost Calculators
π₯οΈ GPU Rent
π¬ Video AI
ποΈ Audio
π¨ Image
GPUs
Community
EN
δΈζ
β Back to Community
π§ͺ Submit Benchmark
Benchmark Type
LLM
Image Generation
Video Generation
Audio / Voice
Embedding
Vision Multimodal
Other
GPU Count
GPU
Not found? Enter custom GPU name:
Model
Framework
Select framework
vLLM
SGLang
Transformers
llama.cpp
Ollama
TensorRT-LLM
Quantization
FP32
FP16
BF16
FP8
INT8
INT4
GPTQ
AWQ
GGUF
Other
Input tokens
Output tokens
Total tok/s
Prompt tok/s
Output tok/s
TTFT (ms)
Batch
Concurrency
Context
VRAM (GB)
GPU util %
Power (W)
β Environment (optional)
Framework version
OS
CUDA
Driver
PyTorch
Environment
Select
Local GPU
Cloud GPU
Colocation
Other
π Evidence (optional)
Notes
Submit Benchmark