馃悗

Performance Benchmark

Public

set sonnet output len to 400

#8541
/
KuntaiDu:kuntai-update-nightlybench/950219c9a(#7412)
Passed in 20m 36s and blocked
bootstrap
馃殌 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 vllm latest main
A100 sglang benchmark
A100 lmdeploy benchmark
A100 trt llama-8B
A100 trt llama-70B
Collect the results
馃殌 check the results!
Wait for container to be ready
A100
Kuntai Du
Kuntai Du
Created
Triggered from Webhook
bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 34s
路
Ran in 12s
Agent
Kuntai Du unblocked 馃殌 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 vllm latest main
Waited 3m 1s
路
Ran in 1m 31s
Agent
A100 sglang benchmark
Waited 10s
路
Ran in 6m 49s
Agent
A100 lmdeploy benchmark
Waited 7m 8s
路
Ran in 45s
Agent
A100 trt llama-8B
Waited 8m 2s
路
Ran in 3m 0s
Agent
A100 trt llama-70B
Waited 14m 58s
路
Ran in 20s
Agent
Collect the results
Waited 11s
路
Ran in 23s
Agent
Wait for container to be ready
A100
Total Job Run Time: 12m 59s