馃悗

Performance Benchmark

Public

fix pipeline yaml

#4484
/
KuntaiDu:kuntai-benchmark-dev/37c4c118e(#5362)
Passed in 7h 27m
bootstrap
馃殌 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 trt benchmark
A100 lmdeploy benchmark
A100 vllm benchmark
A100 tgi benchmark
Plot
Wait for container to be ready
A100 Benchmark
Kuntai Du
Kuntai Du
Created
Triggered from Webhook

Cannot submit coverage without Codecov key.

bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 40s
路
Ran in 11s
Agent
Kuntai Du unblocked 馃殌 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 trt benchmark
Waited 33m 37s
路
Ran in 1h 15m
Agent
A100 lmdeploy benchmark
Waited 1h 59m
路
Ran in 29m 32s
Agent
A100 vllm benchmark
Waited 2h 30m
路
Ran in 25m 30s
Agent
A100 tgi benchmark
Waited 2h 56m
路
Ran in 17m 20s
Agent
Plot
Waited 3h 1m
路
Ran in 26s
Agent
Wait for container to be ready
Waited 3s
路
Ran in 4s
Agent
A100 Benchmark
Waited 39m 37s
路
Ran in 31m 8s
Agent
Total Job Run Time: 2h 59m