馃悗

Performance Benchmark

Public

format

#10022
/
jikunshang:add_genai_perf/07666612f(#10704)
Failed in 5h 28m
bootstrap
馃殌 Ready for comparing vllm against alternatives? This will take 4 hours.
A100 vllm step 10
A100 sglang benchmark
A100 lmdeploy benchmark
A100 trt llama-8B
A100 trt llama-70B
Collect the results
馃殌 check the results!
Wait for container to be ready
A100
H200
H100
Kunshang Ji
Kunshang Ji
Created
Triggered from Webhook
A100 vllm step 10
Waited 2h 53m
路
Ran in 8m 30s
Agent
A100 sglang benchmark
Waited 20m 10s
路
Ran in 8m 51s
Agent
H100
Waited 8s
路
Ran in 5s
Agent
Total Job Run Time: 1h 36m