🐎

Performance Benchmark

Public

enable torch compile for SGLang

#8739
/
KuntaiDu:kuntai-update-nightlybench/1b43f1c35(#7412)
Passed in 13s and blocked
bootstrap
🚀 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 vllm step 10
A100 sglang benchmark
A100 lmdeploy benchmark
A100 trt llama-8B
A100 trt llama-70B
Collect the results
🚀 check the results!
Wait for container to be ready
A100
Kuntai Du
Kuntai Du
Created
Triggered from Webhook
All tests were cache hits
:bazel: Test - e2e/rules_foo

2 tests (100.0%) were fully cached saving 187ms.
All tests were cache hits
:bazel: Test - e2e/repo_mapping

3 tests (100.0%) were fully cached saving 404ms.
All tests were cache hits
:bazel: Test - e2e/vendored_node

1 test (100.0%) was fully cached saving 99ms.
All tests were cache hits
:bazel: Test - e2e/runfiles

1 test (100.0%) was fully cached saving 173ms.
All tests were cache hits
:bazel: Test - e2e/pnpm_workspace_rerooted

12 tests (100.0%) were fully cached saving 2s.
All tests were cache hits
:bazel: Test - e2e/pnpm_workspace

10 tests (100.0%) were fully cached saving 2s.
All tests were cache hits
:bazel: Test - e2e/pnpm_lockfiles

42 tests (100.0%) were fully cached saving 3s.
All tests were cache hits
:bazel: Test - e2e/package_json_module

1 test (100.0%) was fully cached saving 253ms.
All tests were cache hits
:bazel: Test - e2e/npm_translate_yarn_lock

1 test (100.0%) was fully cached saving 31ms.
All tests were cache hits
:bazel: Test - e2e/npm_translate_package_lock

1 test (100.0%) was fully cached saving 31ms.
bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 34s
·
Ran in 13s
Agent
A100 vllm step 10
A100 sglang benchmark
A100 lmdeploy benchmark
A100 trt llama-8B
A100 trt llama-70B
Collect the results
Wait for container to be ready
A100
Total Job Run Time: 12s