馃悗

bug fix: need to use llama checkpoint converter for mixtral model

Passed in 5h 44m
bootstrapcurl -sSL https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/kickoff-benchmark.sh | bash
Waited 44s
Ran in 8s
Annotate
Waited 3h 5m
Ran in 11s
A100 trt benchmark
Waited 1h 12m
Ran in 47m 39s
A100 lmdeploy benchmark
Waited 2h 24m
Ran in 13m 46s
Total Job Run Time: 1h 1m