🐎

Performance Benchmark

Public

bug fix: latency has been removed.

#8870
/
KuntaiDu:kuntai-update-nightlybench/e20d6b98e(#7412)
Canceled automatically after 4m 12s
bootstrap
🚀 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 vllm step 10
A100 sglang benchmark
A100 lmdeploy benchmark
A100 trt llama-8B
A100 trt llama-70B
Collect the results
🚀 check the results!
Wait for container to be ready
A100
Kuntai Du
Kuntai Du
Created
Triggered from Webhook
bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 40s
·
Ran in 12s
Agent
Kuntai Du unblocked 🚀 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 vllm step 10
Canceled
Waited 4m 0s
Queue
A100 sglang benchmark
Canceled
Waited 4m 0s
Queue
A100 lmdeploy benchmark
Canceled
Waited 4m 0s
Queue
A100 trt llama-8B
Canceled
Waited 4m 0s
Queue
A100 trt llama-70B
Canceled
Waited 11s
·
Ran in 3m 53s
Agent
Collect the results
Canceled
Queue
Wait for container to be ready
Canceled
Queue
A100
Canceled
Queue
Total Job Run Time: 4m 4s