🐎

add standard deviation for each metric -- to plot confidence interval

Canceled automatically after 35m 0s
bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 43s
·
Ran in 8s
Annotate
Waited 6m 37s
·
Ran in 10s
A100 lmdeploy benchmark
Canceled
Waited 28m 7s
A100 trt benchmark
Canceled
Waited 28m 7s
A100 vllm benchmark
Canceled
Waited 28m 7s
A100 tgi benchmark
Canceled
Waited 28m 7s
Total Job Run Time: 17s