๐
Performance Benchmark
Publicupdate nightly benchmarks -- add ignore_eos
Passed in 11s and blocked
bootstrap
๐ Ready for comparing vllm against alternatives? This will take 4 hours.
A100 trt llama-8B
Collect the results
๐ check the results!
Wait for container to be ready
A100
bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 42s
Ran in 10s
A100 trt llama-8B
Collect the results
Wait for container to be ready
A100
Total Job Run Time: 10s