馃悗

Performance Benchmark

Public

Merge branch 'kuntai-update-nightlybench' of https://github.com/KuntaiDu/vllm into kuntai-update-nightlybench

#8873
/
KuntaiDu:kuntai-update-nightlybench/141ce129(#7412)
Passed in 3h 22m and blocked
bootstrap
馃殌 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 vllm step 10
A100 sglang benchmark
A100 lmdeploy benchmark
A100 trt llama-8B
A100 trt llama-70B
Collect the results
馃殌 check the results!
Wait for container to be ready
A100
Kuntai Du
Kuntai Du
Created
Triggered from Webhook
bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 36s
路
Ran in 10s
Agent
Kuntai Du unblocked 馃殌 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 vllm step 10
Waited 2m 6s
路
Ran in 44m 28s
Agent
A100 sglang benchmark
Waited 46m 44s
路
Ran in 48m 11s
Agent
A100 lmdeploy benchmark
Waited 1h 35m
路
Ran in 20m 23s
Agent
A100 trt llama-8B
Waited 1h 55m
路
Ran in 18m 48s
Agent
A100 trt llama-70B
Waited 2h 14m
路
Ran in 1h 0m
Agent
Collect the results
Waited 7m 13s
路
Ran in 20s
Agent
Wait for container to be ready
Queue
A100
Queue
Total Job Run Time: 3h 12m