Jump to content
vLLM
Pipelines
Test Suites
Log In
Sign Up
Learn More...
Pipelines
Test Suites
🐎
Performance Benchmark
Public
GitHub Icon
adjust plotting & provide more details in nightly description
#3948
/
KuntaiDu:kuntai-benchmark-dev
/
b012f719f
(
#5362
)
Kuntai Du
canceled
after
1d 0h
Jobs
Canvas
Waterfall
bootstrap
A100 trt benchmark llama8B
A100 trt benchmark mixtral8x7B
A100 trt benchmark llama70B
A100 tgi benchmark
A100 lmdeploy benchmark
A100 vllm benchmark
Plot
56s
6m 35s
51m 30s
2h 22m 24s
3h 7m 5s
Kuntai Du canceled after 1d 0hKuntai Du canceled after 1d 0hKuntai Du canceled after 1d 0h