🐎

Performance Benchmark

Public

adjust figure -- add grid, bar plot, color, +throughput

#4057
/
KuntaiDu:kuntai-benchmark-dev/4def3026f(#5362)
Canceled automatically after 8m 14s
bootstrap
A100 trt benchmark llama8B
A100 trt benchmark mixtral8x7B
A100 trt benchmark llama70B
A100 lmdeploy benchmark
A100 vllm benchmark
A100 tgi benchmark
Plot
Kuntai Du
Kuntai Du
Created
Triggered from Webhook
bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 40s
·
Ran in 8s
Agent
A100 trt benchmark llama8B
Canceled
Waited 5m 0s
·
Ran in 3m 11s
Agent
A100 trt benchmark mixtral8x7B
Canceled
Waited 8m 7s
Queue
A100 trt benchmark llama70B
Canceled
Waited 8m 7s
Queue
A100 lmdeploy benchmark
Canceled
Waited 8m 7s
Queue
A100 vllm benchmark
Canceled
Waited 8m 7s
Queue
A100 tgi benchmark
Canceled
Waited 8m 7s
Queue
Plot
Canceled
Queue
Total Job Run Time: 3m 18s