🐎

Performance Benchmark

Public

#4479

Canceled automatically after 5m 45s

🚀 Ready for comparing vllm against alternatives? This will take 4 hours.

Kuntai Du

Created Thu 11th Jul 2024 at 12:12 AM

Triggered from Webhook

bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash

Ran in 9s

Kuntai Du unblocked 🚀 Ready for comparing vllm against alternatives? This will take 4 hours.
Thu 11th Jul 2024 at 12:13 AM

A100 trt benchmark

A100 lmdeploy benchmark

A100 vllm benchmark

A100 tgi benchmark

Plot

Wait for container to be ready

A100 Benchmark

Total Job Run Time: 8s