🐎

Performance Benchmark

Public

#4323

Canceled automatically after 5m 10s

🚀 Ready for comparing vllm against alternatives?

Kuntai Du

Created Tue 9th Jul 2024 at 11:56 PM

Triggered from Webhook

bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash

Ran in 11s

Kuntai Du unblocked 🚀 Ready for comparing vllm against alternatives?
Tue 9th Jul 2024 at 11:58 PM

A100 trt benchmark

A100 lmdeploy benchmark

A100 vllm benchmark

A100 tgi benchmark

Plot

Total Job Run Time: 10s