🐎

Performance Benchmark

Public

allow running performance benchmark & nightly benchmark simultaneously

#4318
/
KuntaiDu:kuntai-benchmark-dev/13d8c047(#5362)
Canceled automatically after 1m 59s
bootstrap
A100 trt benchmark llama8B
A100 trt benchmark mixtral8x7B
A100 trt benchmark llama70B
A100 lmdeploy benchmark
A100 vllm benchmark
A100 tgi benchmark
Plot
Kuntai Du
Kuntai Du
Created
Triggered from Webhook
bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 42s
·
Ran in 8s
Agent
A100 trt benchmark llama8B
Canceled
Waited 1m 52s
Queue
A100 trt benchmark mixtral8x7B
Canceled
Waited 1m 52s
Queue
A100 trt benchmark llama70B
Canceled
Waited 1m 52s
Queue
A100 lmdeploy benchmark
Canceled
Waited 1m 52s
Queue
A100 vllm benchmark
Canceled
Waited 1m 52s
Queue
A100 tgi benchmark
Canceled
Waited 1m 52s
Queue
Plot
Canceled
Queue
Total Job Run Time: 8s