๐
Performance Benchmark
Publicadjust pipeline.yaml
Passed in 9s and blocked
bootstrap
๐ Ready for comparing vllm against alternatives? This will take 4 hours.
A100 trt benchmark
A100 lmdeploy benchmark
A100 vllm benchmark
A100 tgi benchmark
Plot
Wait for container to be ready
A100 Benchmark
bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 44s
Ran in 9s
A100 trt benchmark
A100 lmdeploy benchmark
A100 vllm benchmark
A100 tgi benchmark
Plot
Wait for container to be ready
A100 Benchmark
Total Job Run Time: 8s