馃悗

Performance Benchmark

Public

update dependency

#10108
/
jikunshang:add_genai_perf/5687ffdd6(#10704)
Passed in 10h 20m and blocked
bootstrap
馃殌 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 vllm step 10
A100 sglang benchmark
A100 lmdeploy benchmark
A100 trt llama-8B
A100 trt llama-70B
Collect the results
馃殌 check the results!
Wait for container to be ready
A100
H200
H100
Kunshang Ji
Kunshang Ji
Created
Triggered from Webhook
bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 12s
路
Ran in 12s
Agent
Kuntai Du unblocked 馃殌 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 vllm step 10
Waited 56m 43s
路
Ran in 43m 38s
Agent
A100 sglang benchmark
Waited 1h 54m
路
Ran in 43m 48s
Agent
A100 lmdeploy benchmark
Waited 1h 40m
路
Ran in 14m 1s
Agent
A100 trt llama-8B
Waited 3h 4m
路
Ran in 44m 49s
Agent
A100 trt llama-70B
Waited 2h 38m
路
Ran in 25m 7s
Agent
Collect the results
Waited 6h 31m
路
Ran in 20s
Agent
Wait for container to be ready
A100
H200
H100
Total Job Run Time: 2h 51m