Jump to content
vLLM
Pipelines
Test Suites
Log In
Sign Up
Learn More...
Pipelines
Test Suites
🐎
Performance Benchmark
Public
Builds
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
KuntaiDu:kuntai-update-nightlybench
All users
All states
All dates
update to include more benchmarking metrics
#8512
4h
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
501fea6d8
·
Created
Tue 3rd Sep 2024 at 7:07 AM
Loading steps…
make sure that vllm benchmark runs first
#8510
5h
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
4ffa6f9be
·
Created
Mon 2nd Sep 2024 at 10:26 PM
Loading steps…
adjust the test case: maximum length when generating output should not exceed 256 --- trt can generate 300 tokens maximum
#8509
1m
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
e2373e8b8
·
Created
Mon 2nd Sep 2024 at 10:19 PM
Loading steps…
use Alex's PR to rerun the benchmark
#8508
13m
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
fbd27dc06
·
Created
Mon 2nd Sep 2024 at 10:03 PM
Loading steps…
update test cases
#8507
11s
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
42650a1ce
·
Created
Mon 2nd Sep 2024 at 9:53 PM
Loading steps…
cut down the test scale so that it fits within 1:30 minutes
#8502
5h
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
e6c94e5ed
·
Created
Mon 2nd Sep 2024 at 4:50 AM
Loading steps…
adjust nightly test --- i guess the # of output tokens cannot be longer than the # of input tokens
#8493
6h
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
4276c99bc
·
Created
Sat 31st Aug 2024 at 1:53 AM
Loading steps…
also update the comparison script
#8486
5h
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
661633fa5
·
Created
Fri 30th Aug 2024 at 7:59 AM
Loading steps…
Add to separate one trt-llm runs to two steps, so that the 1:30hr longest CI run won't be a bottleneck. Also bump up sglang and lmdeploy version.
#8485
20m
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
575d89a9a
·
Created
Fri 30th Aug 2024 at 7:35 AM
Loading steps…
bring in the docker of all benchmarking engines
#8479
5h
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
93156a069
·
Created
Fri 30th Aug 2024 at 1:15 AM
Loading steps…
bring in the full test suite
#8478
17s
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
ec61fb6d3
·
Created
Fri 30th Aug 2024 at 1:13 AM
Loading steps…
switch to latest docker
#8476
42m
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
3970bfe16
·
Created
Fri 30th Aug 2024 at 12:28 AM
Loading steps…
comment out other engines
#8473
1h
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
57b4b7cdc
·
Created
Thu 29th Aug 2024 at 9:21 PM
Loading steps…
small-scale test on vllm
#8472
14m
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
811fdbfcf
·
Created
Thu 29th Aug 2024 at 9:04 PM
Loading steps…
avoid injecting scheduler steps via envvar
#8471
11s
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
b33055b81
·
Created
Thu 29th Aug 2024 at 9:02 PM
Loading steps…
update benchmark
#8468
34m
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
4a815f9cf
·
Created
Thu 29th Aug 2024 at 8:26 PM
Loading steps…
bugfix: should be instead of
#8466
9s
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
c0400608e
·
Created
Thu 29th Aug 2024 at 7:44 PM
Loading steps…
large-scale benchmark start
#8462
4h
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
bf613700d
·
Created
Thu 29th Aug 2024 at 8:16 AM
Loading steps…
comment out sglang and lmdeploy
#8461
2m
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
2f4a1cb69
·
Created
Thu 29th Aug 2024 at 8:03 AM
Loading steps…
remove max-model-len --- llama 3b is short context model
#8460
9s
Kuntai Du
·
KuntaiDu:kuntai-update-nightlybench
GitHub Icon
945a09bd1
·
Created
Thu 29th Aug 2024 at 8:01 AM
Loading steps…
‹ Prev
Next ›
