馃悗

Performance Benchmark

Public

reduce the # of prompts to reduce the runtime

#6372
/
KuntaiDu:kuntai-sglang/8d882e8b3(#6794)
Passed in 2h 7m
bootstrap
馃殌 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 sglang benchmark
A100 vllm benchmark
Plot
Kuntai Du
Kuntai Du
Created
Triggered from Webhook
bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 1m 6s
路
Ran in 8s
Agent
Kuntai Du unblocked 馃殌 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 sglang benchmark
Waited 9m 57s
路
Ran in 13m 45s
Agent
A100 vllm benchmark
Waited 1h 14m
路
Ran in 10m 5s
Agent
Plot
Waited 18m 15s
路
Ran in 25s
Agent
Total Job Run Time: 24m 23s