🐎

Performance Benchmark

Public

format

#10079

jikunshang:add_genai_perf/ee2db6ad(#10704)

Passed in 13s and blocked

bootstrap

🚀 Ready for comparing vllm against alternatives? This will take 4 hours.

A100 vllm step 10

A100 sglang benchmark

A100 lmdeploy benchmark

A100 trt llama-8B

A100 trt llama-70B

Collect the results

🚀 check the results!

Wait for container to be ready

A100

H200

H100

Kunshang Ji

Created Tue 7th Jan at 11:39 PM

Triggered from Webhook

//js/private/test/image/non_ascii:bin2 failed during analysis

Test

errors encountered resolving select() keys for //js/private/test/image/non_ascii:bin2

Run the following command to try to reproduce locally:

bazel build --nobuild //js/private/test/image/non_ascii:bin2

All tests were cache hits

Test - e2e/js_image_oci

1 test (100.0%) was fully cached saving 2s.

All tests were cache hits

Test - e2e/pnpm_lockfiles

42 tests (100.0%) were fully cached saving 3s.

All tests were cache hits

Test - e2e/runfiles

1 test (100.0%) was fully cached saving 173ms.

All tests were cache hits

Test - e2e/rules_foo

2 tests (100.0%) were fully cached saving 187ms.

All tests were cache hits

Test - e2e/pnpm_workspace

10 tests (100.0%) were fully cached saving 2s.

All tests were cache hits

Test - e2e/vendored_node

1 test (100.0%) was fully cached saving 99ms.

All tests were cache hits

Test - e2e/package_json_module

1 test (100.0%) was fully cached saving 253ms.

All tests were cache hits

Test - e2e/repo_mapping

3 tests (100.0%) were fully cached saving 404ms.

All tests were cache hits

Test - e2e/pnpm_workspace_rerooted

12 tests (100.0%) were fully cached saving 2s.

bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash

Ran in 13s

A100 vllm step 10

A100 sglang benchmark

A100 lmdeploy benchmark

A100 trt llama-8B

A100 trt llama-70B

Collect the results

Wait for container to be ready

A100

H200

H100

Total Job Run Time: 13s