🧪

CI

Public

CI Testing of the vLLM Repo

Update Dockerfile.ppc64le

#17459
/
odh-on-pz:ppc64le-docker-dependencies/7172e726b7(#16048)
Passed in 49m 26s and blocked
bootstrap
:docker: build image
Build CUDA 12.1 image
:docker: build image CUDA 12.1
Build CUDA 11.8 image
:docker: build image CUDA 11.8
Documentation Build
Run Async Engine, Inputs, Utils, Worker Test
Async Engine, Inputs, Utils, Worker Test
Run Python-only Installation Test
Python-only Installation Test
Run Basic Correctness Test
Basic Correctness Test
Run Chunked Prefill Test
Chunked Prefill Test
Run Core Test
Core Test
Run Entrypoints Test
Entrypoints Test
Run Distributed Tests (4 GPUs)
Distributed Tests (4 GPUs)
Run Metrics, Tracing Test
Metrics, Tracing Test
Run Regression Test
Regression Test
Run Engine Test
Engine Test
Run V1 Test
V1 Test
Run Examples Test
Examples Test
Run Prefix Caching Test
Prefix Caching Test
Run Samplers Test
Samplers Test
Run LogitsProcessor Test
LogitsProcessor Test
Run Speculative decoding tests
Speculative decoding tests
Run LoRA Test %N
Run PyTorch Compilation Unit Tests
PyTorch Compilation Unit Tests
Run PyTorch Fullgraph Smoke Test
PyTorch Fullgraph Smoke Test
Run PyTorch Fullgraph Test
PyTorch Fullgraph Test
Run Kernels Test %N
Run Tensorizer Test
Tensorizer Test
Run Benchmarks
Benchmarks
Run Quantization Test
Quantization Test
Run LM Eval Small Models
LM Eval Small Models
Run OpenAI API correctness
OpenAI API correctness
Run Encoder Decoder tests
Encoder Decoder tests
Run OpenAI-Compatible Tool Use
OpenAI-Compatible Tool Use
Run Basic Models Test
Basic Models Test
Run Language Models Test (Standard)
Language Models Test (Standard)
Run Language Models Test (Extended)
Language Models Test (Extended)
Run Multi-Modal Models Test (Standard)
Multi-Modal Models Test (Standard)
Run Multi-Modal Models Test (Extended) 1
Multi-Modal Models Test (Extended) 1
Run Multi-Modal Models Test (Extended) 2
Multi-Modal Models Test (Extended) 2
Run Custom Models Test
Custom Models Test
Run Distributed Comm Ops Test
Distributed Comm Ops Test
Run 2 Node Tests (4 GPUs in total)
2 Node Tests (4 GPUs in total)
Run Distributed Tests (2 GPUs)
Distributed Tests (2 GPUs)
Run Plugin Tests (2 GPUs)
Plugin Tests (2 GPUs)
Run Multi-step Tests (4 GPUs)
Multi-step Tests (4 GPUs)
Run Pipeline Parallelism Test
Pipeline Parallelism Test
Run LoRA TP Test (Distributed)
LoRA TP Test (Distributed)
Run Weight Loading Multiple GPU Test
Weight Loading Multiple GPU Test
Run Weight Loading Multiple GPU Test - Large Models
Weight Loading Multiple GPU Test - Large Models
Run Distributed Tests (A100)
Distributed Tests (A100)
Run LM Eval Large Models
LM Eval Large Models
Neuron Test
Run Intel CPU test
Intel CPU Test
Intel HPU Test
Intel GPU Test
Run IBM Power(ppc64le) CPU Test
IBM Power(ppc64le) CPU Test
TPU V0 Test
TPU V1 Test
Md. Shafi Hussain
Md. Shafi Hussain
Created
Triggered from Webhook
bootstrapif [[ -n "" ]]; then VLLM_CI_BRANCH= curl -sSL "https://raw.githubusercontent.com/vllm-project/buildkite-ci//scripts/bootstrap.sh" | bash && exit 0; fi && curl -sSL "https://raw.githubusercontent.com/vllm-project/buildkite-ci/main/scripts/bootstrap.sh" | bash
Waited 39s
·
Ran in 19s
Agent
:docker: build imageaws ecr-public get-login-password --region us-east-1 | docker login --username AWS --password-stdin public.ecr.aws/q9t5s3a7 && #!/bin/bash && if [[ -z $(docker manifest inspect public.ecr.aws/q9t5s3a7/vllm-ci-test-repo:7172e726b7fccd763f7a157e95cbce13cecbc5bb) ]]; then && echo "Image not found, proceeding with build..." && else && echo "Image found" && exit 0 && fi && docker build --file docker/Dockerfile --build-arg max_jobs=16 --build-arg buildkite_commit=7172e726b7fccd763f7a157e95cbce13cecbc5bb --build-arg USE_SCCACHE=1 --tag public.ecr.aws/q9t5s3a7/vllm-ci-test-repo:7172e726b7fccd763f7a157e95cbce13cecbc5bb --target test --progress plain . && docker push public.ecr.aws/q9t5s3a7/vllm-ci-test-repo:7172e726b7fccd763f7a157e95cbce13cecbc5bb
Waited 39s
·
Ran in 34m 5s
Agent
:docker: build image CUDA 12.1aws ecr-public get-login-password --region us-east-1 | docker login --username AWS --password-stdin public.ecr.aws/q9t5s3a7 && #!/bin/bash && if [[ -z $(docker manifest inspect public.ecr.aws/q9t5s3a7/vllm-ci-test-repo:7172e726b7fccd763f7a157e95cbce13cecbc5bb-cu121) ]]; then && echo "Image not found, proceeding with build..." && else && echo "Image found" && exit 0 && fi && docker build --file docker/Dockerfile --build-arg max_jobs=16 --build-arg buildkite_commit=7172e726b7fccd763f7a157e95cbce13cecbc5bb --build-arg USE_SCCACHE=1 --build-arg CUDA_VERSION=12.1.0 --tag public.ecr.aws/q9t5s3a7/vllm-ci-test-repo:7172e726b7fccd763f7a157e95cbce13cecbc5bb-cu121 --target test --progress plain . && docker push public.ecr.aws/q9t5s3a7/vllm-ci-test-repo:7172e726b7fccd763f7a157e95cbce13cecbc5bb-cu121
:docker: build image CUDA 11.8aws ecr-public get-login-password --region us-east-1 | docker login --username AWS --password-stdin public.ecr.aws/q9t5s3a7 && #!/bin/bash && if [[ -z $(docker manifest inspect public.ecr.aws/q9t5s3a7/vllm-ci-test-repo:7172e726b7fccd763f7a157e95cbce13cecbc5bb-cu118) ]]; then && echo "Image not found, proceeding with build..." && else && echo "Image found" && exit 0 && fi && docker build --file docker/Dockerfile --build-arg max_jobs=16 --build-arg buildkite_commit=7172e726b7fccd763f7a157e95cbce13cecbc5bb --build-arg USE_SCCACHE=1 --build-arg CUDA_VERSION=11.8.0 --tag public.ecr.aws/q9t5s3a7/vllm-ci-test-repo:7172e726b7fccd763f7a157e95cbce13cecbc5bb-cu118 --target test --progress plain . && docker push public.ecr.aws/q9t5s3a7/vllm-ci-test-repo:7172e726b7fccd763f7a157e95cbce13cecbc5bb-cu118
Documentation Build
Waited 34s
·
Ran in 4m 37s
Agent
Async Engine, Inputs, Utils, Worker Test
Python-only Installation Test
Basic Correctness Test
Chunked Prefill Test
Core Test
Entrypoints Test
Distributed Tests (4 GPUs)
Metrics, Tracing Test
Regression Test
Engine Test
V1 Test
Examples Test
Prefix Caching Test
Samplers Test
LogitsProcessor Test
Speculative decoding tests
1/4
LoRA Test 1
2/4
LoRA Test 2
3/4
LoRA Test 3
4/4
LoRA Test 4
PyTorch Compilation Unit Tests
PyTorch Fullgraph Smoke Test
PyTorch Fullgraph Test
1/4
Kernels Test 1
2/4
Kernels Test 2
3/4
Kernels Test 3
4/4
Kernels Test 4
Tensorizer Test
Benchmarks
Quantization Test
LM Eval Small Models
OpenAI API correctness
Encoder Decoder tests
OpenAI-Compatible Tool Use
Basic Models Test
Language Models Test (Standard)
Language Models Test (Extended)
Multi-Modal Models Test (Standard)
Multi-Modal Models Test (Extended) 1
Multi-Modal Models Test (Extended) 2
Custom Models Test
Distributed Comm Ops Test
2 Node Tests (4 GPUs in total)./.buildkite/scripts/run-multi-node-test.sh /vllm-workspace/tests 2 2 public.ecr.aws/q9t5s3a7/vllm-ci-test-repo:7172e726b7fccd763f7a157e95cbce13cecbc5bb "VLLM_TEST_SAME_HOST=0 torchrun --nnodes 2 --nproc-per-node=2 --rdzv_backend=c10d --rdzv_endpoint=192.168.10.10 distributed/test_same_node.py | grep 'Same node test passed' && VLLM_MULTI_NODE=1 pytest -v -s distributed/test_multi_node_assignment.py && VLLM_MULTI_NODE=1 pytest -v -s distributed/test_pipeline_parallel.py" "VLLM_TEST_SAME_HOST=0 torchrun --nnodes 2 --nproc-per-node=2 --rdzv_backend=c10d --rdzv_endpoint=192.168.10.10 distributed/test_same_node.py | grep 'Same node test passed'"
Distributed Tests (2 GPUs)
Plugin Tests (2 GPUs)
Multi-step Tests (4 GPUs)
Pipeline Parallelism Test
LoRA TP Test (Distributed)
Weight Loading Multiple GPU Test
Weight Loading Multiple GPU Test - Large Models
Distributed Tests (A100)
LM Eval Large Models
AMD: :docker: build imagegrep -i 'from base as test' docker/Dockerfile.rocm && docker build --build-arg max_jobs=16 --tag rocm/vllm-ci:7172e726b7fccd763f7a157e95cbce13cecbc5bb -f docker/Dockerfile.rocm --target test --progress plain . || docker build --build-arg max_jobs=16 --tag rocm/vllm-ci:7172e726b7fccd763f7a157e95cbce13cecbc5bb -f docker/Dockerfile.rocm --progress plain . && docker push rocm/vllm-ci:7172e726b7fccd763f7a157e95cbce13cecbc5bb
Waited 7s
·
Ran in 21m 56s
Agent
AMD: Core Testbash .buildkite/scripts/hardware_ci/run-amd-test.sh "(command rocm-smi || true) && export VLLM_LOGGING_LEVEL=DEBUG && export VLLM_ALLOW_DEPRECATED_BEAM_SEARCH=1 && cd /vllm-workspace/tests ; pytest -v -s core"
Waited 6m 40s
·
Ran in 20m 29s
Agent
AMD: Metrics, Tracing Testbash .buildkite/scripts/hardware_ci/run-amd-test.sh "(command rocm-smi || true) && export VLLM_LOGGING_LEVEL=DEBUG && export VLLM_ALLOW_DEPRECATED_BEAM_SEARCH=1 && cd /vllm-workspace/tests ; pytest -v -s metrics && pytest -v -s tracing"
Waited 6m 35s
·
Ran in 20m 28s
Agent
AMD: Engine Testbash .buildkite/scripts/hardware_ci/run-amd-test.sh "(command rocm-smi || true) && export VLLM_LOGGING_LEVEL=DEBUG && export VLLM_ALLOW_DEPRECATED_BEAM_SEARCH=1 && cd /vllm-workspace/tests ; pytest -v -s engine test_sequence.py test_config.py test_logger.py && pytest -v -s tokenization"
Waited 1m 37s
·
Ran in 22m 42s
Agent
AMD: Prefix Caching Testbash .buildkite/scripts/hardware_ci/run-amd-test.sh "(command rocm-smi || true) && export VLLM_LOGGING_LEVEL=DEBUG && export VLLM_ALLOW_DEPRECATED_BEAM_SEARCH=1 && cd /vllm-workspace/tests ; pytest -v -s prefix_caching"
Waited 4m 45s
·
Ran in 16m 38s
Agent
AMD: LogitsProcessor Testbash .buildkite/scripts/hardware_ci/run-amd-test.sh "(command rocm-smi || true) && export VLLM_LOGGING_LEVEL=DEBUG && export VLLM_ALLOW_DEPRECATED_BEAM_SEARCH=1 && cd /vllm-workspace/tests ; pytest -v -s test_logits_processor.py && pytest -v -s model_executor/test_guided_processors.py"
Waited 9s
·
Ran in 10m 45s
Agent
AMD: Benchmarksbash .buildkite/scripts/hardware_ci/run-amd-test.sh "(command rocm-smi || true) && export VLLM_LOGGING_LEVEL=DEBUG && export VLLM_ALLOW_DEPRECATED_BEAM_SEARCH=1 && cd /vllm-workspace/.buildkite ; bash scripts/run-benchmarks.sh"
Waited 5m 5s
·
Ran in 9m 38s
Agent
AMD: Custom Models Testbash .buildkite/scripts/hardware_ci/run-amd-test.sh "(command rocm-smi || true) && export VLLM_LOGGING_LEVEL=DEBUG && export VLLM_ALLOW_DEPRECATED_BEAM_SEARCH=1 && cd /vllm-workspace/tests ; echo 'Testing custom models...'"
Waited 5m 44s
·
Ran in 7m 31s
Agent
AMD: Distributed Comm Ops Testbash .buildkite/scripts/hardware_ci/run-amd-test.sh "(command rocm-smi || true) && export VLLM_LOGGING_LEVEL=DEBUG && export VLLM_ALLOW_DEPRECATED_BEAM_SEARCH=1 && cd /vllm-workspace/tests ; pytest -v -s distributed/test_comm_ops.py && pytest -v -s distributed/test_shm_broadcast.py"
Waited 5m 58s
·
Ran in 4m 21s
Agent
Neuron Testbash .buildkite/scripts/hardware_ci/run-neuron-test.sh
Waited 1m 51s
·
Ran in 3m 57s
Agent
Intel CPU Testbash .buildkite/scripts/hardware_ci/run-cpu-test.sh
Intel HPU Testbash .buildkite/scripts/hardware_ci/run-hpu-test.sh
Waited 4s
·
Ran in 1m 20s
Agent
Intel GPU Testbash .buildkite/scripts/hardware_ci/run-xpu-test.sh
Waited 15s
·
Ran in 4m 1s
Agent
Harry Mellor unblocked Run IBM Power(ppc64le) CPU Test
IBM Power(ppc64le) CPU Testbash .buildkite/scripts/hardware_ci/run-cpu-test-ppc64le.sh
Waited 8s
·
Ran in 25m 16s
Agent
TPU V0 Testyes | docker system prune -a && if [[ -f ".buildkite/scripts/hardware_ci/run-tpu-test.sh" ]]; then bash .buildkite/scripts/hardware_ci/run-tpu-test.sh; fi
Waited 9s
·
Ran in 1s
Agent
TPU V1 Testif [[ -f ".buildkite/scripts/hardware_ci/run-tpu-v1-test.sh" ]]; then bash .buildkite/scripts/hardware_ci/run-tpu-v1-test.sh; fi && yes | docker system prune -a
Waited 12s
·
Ran in 35m 41s
Agent
Total Job Run Time: 4h 3m