๐
Performance Benchmark
Publicadd ignore-eos flag
Passed in 17m 29s
bootstrap
๐ Ready for comparing vllm against alternatives? This will take 4 hours.
A100 vllm latest main
A100 sglang benchmark
A100 lmdeploy benchmark
A100 trt llama-8B
A100 trt llama-70B
Collect the results
๐ check the results!
Wait for container to be ready
A100
bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 33s
Ran in 11s

A100 sglang benchmark
A100 lmdeploy benchmark
A100 trt llama-8B
A100 trt llama-70B
Collect the results
Wait for container to be ready
A100
Total Job Run Time: 10m 22s