🐎

Performance Benchmark

Public

Bump up version of all containers

#8880
/
KuntaiDu:kuntai-update-nightlybench/4f1a72a16(#7412)
Failed in 5h 10m
bootstrap
🚀 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 vllm step 10
A100 sglang benchmark
A100 lmdeploy benchmark
A100 trt llama-8B
A100 trt llama-70B
Collect the results
🚀 check the results!
Wait for container to be ready
A100
Kuntai Du
Kuntai Du
Created
Triggered from Webhook
A100
Waited 5m 44s
·
Ran in 8m 48s
Agent
Total Job Run Time: 4h 21m