🐎

Performance Benchmark

Public

mute curl output --- it's getting toooo long

#4061
/
KuntaiDu:kuntai-benchmark-dev/2ee07df2f(#5362)
Canceled automatically after 12m 5s
bootstrap
A100 trt benchmark llama8B
A100 trt benchmark mixtral8x7B
A100 trt benchmark llama70B
A100 lmdeploy benchmark
A100 vllm benchmark
A100 tgi benchmark
Plot
Kuntai Du
Kuntai Du
Created
Triggered from Webhook
bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 47s
·
Ran in 9s
Agent
A100 trt benchmark llama8B
Canceled
Waited 11m 58s
Queue
A100 trt benchmark mixtral8x7B
Canceled
Waited 11m 58s
Queue
A100 trt benchmark llama70B
Canceled
Waited 11m 58s
Queue
A100 lmdeploy benchmark
Canceled
Waited 11m 58s
Queue
A100 vllm benchmark
Canceled
Waited 11m 58s
Queue
A100 tgi benchmark
Canceled
Waited 11m 58s
Queue
Plot
Canceled
Queue
Total Job Run Time: 8s