๐
Performance Benchmark
Publicadjust pipeline upload order
Passed in 8s and blocked
bootstrap
๐ Ready for comparing vllm against alternatives?
A100 trt benchmark
A100 lmdeploy benchmark
A100 vllm benchmark
A100 tgi benchmark
Plot
bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 51s
Ran in 8s
Total Job Run Time: 7s