馃悗

Performance Benchmark

Public

adjust plotting & provide more details in nightly description

#3948
/
KuntaiDu:kuntai-benchmark-dev/b012f719(#5362)
Kuntai Du canceled after 1d 0h
bootstrap
A100 trt benchmark llama8B
A100 trt benchmark mixtral8x7B
A100 trt benchmark llama70B
A100 lmdeploy benchmark
A100 vllm benchmark
A100 tgi benchmark
Plot
Kuntai Du
Kuntai Du
Created
Triggered from Webhook
bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 49s
路
Ran in 8s
Agent
A100 trt benchmark llama8B
Waited 8s
路
Ran in 6m 27s
Agent
A100 trt benchmark mixtral8x7B
Waited 14m 3s
路
Ran in 37m 27s
Agent
A100 trt benchmark llama70B
Waited 1h 17m
路
Ran in 1h 4m
Agent
A100 lmdeploy benchmark
Canceled
Waited 1d 0h
Queue
A100 vllm benchmark
Canceled
Waited 1d 0h
Queue
A100 tgi benchmark
Waited 2h 48m
路
Ran in 18m 25s
Agent
Plot
Canceled
Queue
Total Job Run Time: 2h 7m