馃悗

Performance Benchmark

Public

make syntax checker happy

#8742
/
KuntaiDu:kuntai-update-nightlybench/7e12e84f6(#7412)
Failed in 5h 29m
bootstrap
馃殌 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 vllm step 10
A100 sglang benchmark
A100 lmdeploy benchmark
A100 trt llama-8B
A100 trt llama-70B
Collect the results
馃殌 check the results!
Wait for container to be ready
A100
Kuntai Du
Kuntai Du
Created
Triggered from Webhook
A100 lmdeploy benchmark
Waited 3h 13m
路
Ran in 37m 51s
Agent
A100 trt llama-8B
Waited 5h 4m
路
Ran in 11m 33s
Agent
A100 trt llama-70B
Waited 5h 27m
路
Ran in 2m 41s
Agent
Total Job Run Time: 3h 19m