馃悗

Performance Benchmark

Public

format

#10080
/
jikunshang:add_genai_perf/f89fcebf(#10704)
Passed in 9h 43m and blocked
bootstrap
馃殌 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 vllm step 10
A100 sglang benchmark
A100 lmdeploy benchmark
A100 trt llama-8B
A100 trt llama-70B
Collect the results
馃殌 check the results!
Wait for container to be ready
A100
H200
H100
Kunshang Ji
Kunshang Ji
Created
Triggered from Webhook
bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 42s
路
Ran in 16s
Agent
Kuntai Du unblocked 馃殌 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 vllm step 10
Waited 1h 43m
路
Ran in 43m 31s
Agent
A100 sglang benchmark
Waited 13m 55s
路
Ran in 44m 15s
Agent
A100 lmdeploy benchmark
Waited 2h 51m
路
Ran in 9m 53s
Agent
A100 trt llama-8B
Waited 58m 23s
路
Ran in 45m 20s
Agent
A100 trt llama-70B
Waited 2h 27m
路
Ran in 24m 10s
Agent
Collect the results
Waited 6h 41m
路
Ran in 21s
Agent
Wait for container to be ready
Queue
A100
Queue
H200
Queue
H100
Queue
Total Job Run Time: 2h 47m