julia-master

Public

https://github.com/JuliaCI/julia-buildkite & https://github.com/JuliaLang/julia

Address some reviewer comments

#45489
/
jakobnissen:iobuffer/478afb57aa7(#57570)
Canceled automatically after 2h 54m
Jakob Nybo Nissen
Jakob Nybo Nissen
Created
Triggered from Webhook
Unlock secrets, launch pipelinestrue
Waited 9s
·
Ran in 27s
Agent
Launch signed jobstrue
Waited 6s
·
Ran in 10s
Agent
Launch upload jobs# Explicitly pass along the cryptic token to child pipelines && export BUILDKITE_PLUGIN_CRYPTIC_BASE64_SIGNED_JOB_ID_SECRET && export ALLOW_FAIL="false" && ##### Launch `upload_*` jobs to store tarballs into S3 once tests are done && ### Linux: && # Regular Linux upload jobs: && GROUP="Upload" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/upload_linux.arches \ && .buildkite/pipelines/main/platforms/upload_linux.yml && # PowerPC Linux upload jobs, which we only run for Julia prior to 1.12: && GROUP="Upload" \ && julia .buildkite/pipelines/main/platforms/launch_powerpc.jl \ && .buildkite/pipelines/main/platforms/upload_linux.powerpc.arches \ && .buildkite/pipelines/main/platforms/upload_linux.yml && ### macOS: && GROUP="Upload" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/upload_macos.arches \ && .buildkite/pipelines/main/platforms/upload_macos.yml && ### FreeBSD: && GROUP="Upload" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/upload_freebsd.arches \ && .buildkite/pipelines/main/platforms/upload_freebsd.yml && ### Windows: && GROUP="Upload" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/upload_windows.arches \ && .buildkite/pipelines/main/platforms/upload_windows.yml && for OS in linux macos freebsd windows; do \ && GROUP="Upload" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/upload_${OS}.arches \ && .buildkite/pipelines/main/misc/upload_buildkite_results.yml && done && # Launch doctest deploy job && buildkite-agent pipeline upload .buildkite/pipelines/main/misc/deploy_docs.yml && # Don't share this with buildkite's env display && unset BUILDKITE_PLUGIN_CRYPTIC_BASE64_SIGNED_JOB_ID_SECRET
Waited 3s
·
Ran in 35s
Agent
upload test results i686-w64-mingw32buildkite-agent artifact download --step "test_i686-w64-mingw32" "results*.json" . || true
Canceled
Unclustered
upload test results x86_64-w64-mingw32buildkite-agent artifact download --step "test_x86_64-w64-mingw32" "results*.json" . || true
Canceled
Unclustered
upload test results x86_64-unknown-freebsdbuildkite-agent artifact download --step "test_x86_64-unknown-freebsd" "results*.json" . || true
Canceled
Unclustered
upload test results aarch64-apple-darwinbuildkite-agent artifact download --step "test_aarch64-apple-darwin" "results*.json" . || true
Waited 5s
·
Ran in 31s
Agent
upload test results x86_64-apple-darwinbuildkite-agent artifact download --step "test_x86_64-apple-darwin" "results*.json" . || true
Canceled
Unclustered
upload test results x86_64-linux-gnubuildkite-agent artifact download --step "test_x86_64-linux-gnu" "results*.json" . || true
Canceled
Unclustered
upload test results i686-linux-gnubuildkite-agent artifact download --step "test_i686-linux-gnu" "results*.json" . || true
Canceled
Unclustered
upload test results aarch64-linux-gnubuildkite-agent artifact download --step "test_aarch64-linux-gnu" "results*.json" . || true
Waited 10s
·
Ran in 16s
Agent
:windows: upload i686-w64-mingw32
Canceled
Unclustered
:windows: upload x86_64-w64-mingw32
Canceled
Unclustered
:freebsd: upload x86_64-unknown-freebsdbash .buildkite/utilities/upload_julia.sh
Canceled
Unclustered
:mac: upload aarch64-apple-darwinbash .buildkite/utilities/upload_julia.sh
Waited 10s
·
Ran in 44s
Agent
:mac: upload x86_64-apple-darwinbash .buildkite/utilities/upload_julia.sh
Canceled
Unclustered
:linux: upload x86_64-linux-gnubash .buildkite/utilities/upload_julia.sh
Canceled
Unclustered
:linux: upload i686-linux-gnubash .buildkite/utilities/upload_julia.sh
Canceled
Unclustered
:linux: upload aarch64-linux-gnubash .buildkite/utilities/upload_julia.sh
Waited 6s
·
Ran in 43s
Agent
Launch allowed-to-fail upload jobs# Explicitly pass along the cryptic token to child pipelines && export BUILDKITE_PLUGIN_CRYPTIC_BASE64_SIGNED_JOB_ID_SECRET && export ALLOW_FAIL="true" && # Launch Linux allowed-to-fail upload jobs && GROUP="Allow Fail (Upload)" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/upload_linux.soft_fail.arches \ && .buildkite/pipelines/main/platforms/upload_linux.yml && # Don't share this with buildkite's env display && unset BUILDKITE_PLUGIN_CRYPTIC_BASE64_SIGNED_JOB_ID_SECRET
Waited 8s
·
Ran in 9s
Agent
:linux: upload x86_64-linux-muslbash .buildkite/utilities/upload_julia.sh
Waited 5s
·
Ran in 22s
Agent
Launch build jobs### Launch Linux build jobs. && # Regular: && GROUP="Build" \ && ALLOW_FAIL="false" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/build_linux.arches \ && .buildkite/pipelines/main/platforms/build_linux.yml && # PowerPC (only for Julia prior to 1.12): && GROUP="Build" \ && ALLOW_FAIL="false" \ && julia .buildkite/pipelines/main/platforms/launch_powerpc.jl \ && .buildkite/pipelines/main/platforms/build_linux.powerpc.arches \ && .buildkite/pipelines/main/platforms/build_linux.yml && ### Launch macOS build jobs: && GROUP="Build" \ && ALLOW_FAIL="false" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/build_macos.arches \ && .buildkite/pipelines/main/platforms/build_macos.yml && ### Launch FreeBSD build jobs: && GROUP="Build" \ && ALLOW_FAIL="false" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/build_freebsd.arches \ && .buildkite/pipelines/main/platforms/build_freebsd.yml && ### Launch Windows build jobs: && GROUP="Build" \ && ALLOW_FAIL="false" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/build_windows.arches \ && .buildkite/pipelines/main/platforms/build_windows.yml
Waited 37m 18s
·
Ran in 34s
Agent
:windows: build i686-w64-mingw32
Canceled
Waited 2h 15m
·
Ran in 1m 17s
Agent
:windows: build x86_64-w64-mingw32
Canceled
Waited 2h 16m
Unclustered
:freebsd: build x86_64-unknown-freebsdbash .buildkite/utilities/build_julia.sh
Waited 1h 26m
·
Ran in 23m 10s
Agent
:mac: build aarch64-apple-darwinbash .buildkite/utilities/build_julia.sh
Waited 3s
·
Ran in 10m 33s
Agent
:mac: build x86_64-apple-darwinbash .buildkite/utilities/build_julia.sh
Waited 1h 15m
·
Ran in 31m 51s
Agent
:linux: build aarch64-linux-gnubash .buildkite/utilities/build_julia.sh
Waited 10s
·
Ran in 35m 12s
Agent
:linux: build x86_64-linux-gnuprofilingbash .buildkite/utilities/build_julia.sh
Waited 24s
·
Ran in 28m 40s
Agent
:linux: build x86_64-linux-gnuassertbash .buildkite/utilities/build_julia.sh
Waited 11s
·
Ran in 31m 43s
Agent
:linux: build x86_64-linux-gnubash .buildkite/utilities/build_julia.sh
Waited 1m 34s
·
Ran in 24m 40s
Agent
:linux: build i686-linux-gnubash .buildkite/utilities/build_julia.sh
Waited 3m 22s
·
Ran in 37m 45s
Agent
Launch check jobsbuildkite-agent pipeline upload .buildkite/pipelines/main/misc/analyzegc.yml && buildkite-agent pipeline upload .buildkite/pipelines/main/misc/doctest.yml && buildkite-agent pipeline upload .buildkite/pipelines/main/misc/pdf_docs/build_pdf_docs.yml && buildkite-agent pipeline upload .buildkite/pipelines/main/misc/embedding.yml && buildkite-agent pipeline upload .buildkite/pipelines/main/misc/trimming.yml && buildkite-agent pipeline upload .buildkite/pipelines/main/misc/llvmpasses.yml && # buildkite-agent pipeline upload .buildkite/pipelines/main/misc/whitespace.yml # Currently runs in GitHub Actions instead of Buildkite && buildkite-agent pipeline upload .buildkite/pipelines/main/misc/sanitizers/asan.yml && buildkite-agent pipeline upload .buildkite/pipelines/main/misc/sanitizers/tsan.yml
Waited 7s
·
Ran in 31s
Agent
tsanecho "--- Build julia-debug runtime with TSAN" && VERBOSE=1 contrib/tsan/build.sh ./tmp/test-tsan -j${JULIA_CPU_THREADS:?} julia-src-debug
Waited 42m 18s
·
Ran in 2m 49s
Agent
asanecho "--- Build julia with ASAN" && VERBOSE=1 contrib/asan/build.sh ./tmp/test-asan -j${JULIA_CPU_THREADS:?}
Waited 43m 25s
·
Ran in 1h 27m
Agent
llvmpassesecho "--- make release" && # Enable Julia assertions: FORCE_ASSERTIONS=1 && # Enable LLVM assertions: LLVM_ASSERTIONS=1 && export MAKE_ASSERT_FLAGS="FORCE_ASSERTIONS=1 LLVM_ASSERTIONS=1" && make --output-sync -j${JULIA_CPU_THREADS:?} release JULIA_PRECOMPILE=0 ${MAKE_ASSERT_FLAGS:?} && echo "--- make src/install-analysis-deps" && make --output-sync -j${JULIA_CPU_THREADS:?} -C src install-analysis-deps ${MAKE_ASSERT_FLAGS:?} && echo "+++ make test/llvmpasses" && make --output-sync -j${JULIA_CPU_THREADS:?} -C test/llvmpasses ${MAKE_ASSERT_FLAGS:?}
Waited 13s
·
Ran in 21m 43s
Agent
trimming# Download pre-built julia, extract into `usr/` && buildkite-agent artifact download --step "build_x86_64-linux-gnu" 'julia-*-linux-x86_64.tar.gz' . && mkdir -p usr && tar -C usr --strip-components=1 -zxf julia-*-linux-x86_64.tar.gz && rm -f julia-*-linux-x86_64.tar.gz && make --output-sync -j${JULIA_CPU_THREADS:?} -C test/trimming check JULIA="$(pwd)/usr/bin/julia" BIN="$(pwd)/usr/bin"
Waited 27s
·
Ran in 1m 7s
Agent
embedding# Download pre-built julia, extract into `usr/` && buildkite-agent artifact download --step "build_x86_64-linux-gnu" 'julia-*-linux-x86_64.tar.gz' . && mkdir -p usr && tar -C usr --strip-components=1 -zxf julia-*-linux-x86_64.tar.gz && rm -f julia-*-linux-x86_64.tar.gz && embedding_output="/tmp/embedding-test" && echo "+++ Run embedding tests, deploy to ${embedding_output:?}" && mkdir -p "${embedding_output:?}" && make --output-sync -j${JULIA_CPU_THREADS:?} -C test/embedding check JULIA="$(pwd)/usr/bin/julia" BIN="${embedding_output:?}"
Waited 1m 36s
·
Ran in 1m 57s
Agent
pdf_docs_buildecho "--- Download pre-built julia, extract into usr/" && buildkite-agent artifact download --step "build_x86_64-linux-gnu" 'julia-*-linux-x86_64.tar.gz' . && mkdir -p ./usr && tar -C ./usr --strip-components=1 -zxf julia-*-linux-x86_64.tar.gz && ln -s ./usr/bin/julia ./julia && echo "--- Print Julia version info" && export JULIA_NUM_THREADS=1 && ./julia -e 'using InteractiveUtils; InteractiveUtils.versioninfo()' && echo "--- Set some environment variables and create some directories" && export DOCUMENTER_LATEX_DEBUG="$(pwd)/latex-debug-logs" && mkdir -p ${DOCUMENTER_LATEX_DEBUG:?} && echo "DOCUMENTER_LATEX_DEBUG is ${DOCUMENTER_LATEX_DEBUG:?}" && echo "--- Build the PDF" && ./julia .buildkite/pipelines/main/misc/pdf_docs/make.jl && echo "--- Upload the PDF files as Buildkite artifacts" && find . -type f -name "*.pdf" && cd doc/_build/pdf/en && buildkite-agent artifact upload TheJuliaLanguage.pdf
Waited 3m 7s
·
Ran in 30m 2s
Agent
doctest# Download pre-built julia, extract into `usr/` && buildkite-agent artifact download --step "build_x86_64-linux-gnu" 'julia-*-linux-x86_64.tar.gz' . && mkdir -p ./usr && tar -C ./usr --strip-components=1 -zxf julia-*-linux-x86_64.tar.gz && ln -s ./usr/bin/julia ./julia && echo "--- Print Julia version info" && export JULIA_NUM_THREADS=1 && ./julia -e 'using InteractiveUtils; InteractiveUtils.versioninfo()' && TARBALL_NAME="$(echo julia-*-linux-x86_64.tar.gz)" && export DOCUMENTER_ARCHIVE="${TARBALL_NAME%-linux-x86_64.tar.gz}-htmldocs.tar.gz" && echo "--- Run Julia doctests/build HTML docs" && cd doc && make deploy doctest=true && echo "--- Compress and upload HTML docs" && buildkite-agent artifact upload "${DOCUMENTER_ARCHIVE}"
Waited 3m 46s
·
Ran in 8m 53s
Agent
analyzegcecho "--- Install in-tree LLVM dependencies" && make --output-sync -j${JULIA_CPU_THREADS:?} -C src install-analysis-deps && echo "+++ run clangsa/analyzegc" && make --output-sync -j${JULIA_CPU_THREADS:?} -C test/clangsa --keep-going && make --output-sync -j${JULIA_CPU_THREADS:?} -C src analyze --keep-going
Waited 45m 22s
·
Ran in 4m 41s
Agent
Launch test jobsexport ALLOW_FAIL="false" && buildkite-agent pipeline upload .buildkite/pipelines/main/misc/gcext.yml && buildkite-agent pipeline upload .buildkite/pipelines/main/misc/test_revise.yml && ### Launch Linux test jobs. && # Regular: && GROUP="Test" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/test_linux.arches \ && .buildkite/pipelines/main/platforms/test_linux.yml && # i686-linux-gnu: && GROUP="Test" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/test_linux.i686.arches \ && .buildkite/pipelines/main/platforms/test_linux.i686.yml && ### Launch macOS test jobs: && GROUP="Test" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/test_macos.arches \ && .buildkite/pipelines/main/platforms/test_macos.yml && ### Launch FreeBSD test jobs: && GROUP="Test" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/test_freebsd.arches \ && .buildkite/pipelines/main/platforms/test_freebsd.yml && ### Launch Windows test jobs: && GROUP="Test" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/test_windows.arches \ && .buildkite/pipelines/main/platforms/test_windows.yml
Waited 8s
·
Ran in 59s
Agent
:windows: test i686-w64-mingw32bash .buildkite/utilities/test_julia.sh
Canceled
Unclustered
:windows: test x86_64-w64-mingw32bash .buildkite/utilities/test_julia.sh
Canceled
Unclustered
:freebsd: test x86_64-unknown-freebsdbash .buildkite/utilities/test_julia.sh
Canceled
Waited 59s
·
Ran in 26m 38s
Agent
:mac: test aarch64-apple-darwinbash .buildkite/utilities/test_julia.sh
Waited 12s
·
Ran in 54m 21s
Agent
:mac: test x86_64-apple-darwinbash .buildkite/utilities/test_julia.sh
Canceled
Waited 4s
·
Ran in 29m 44s
Agent
:linux: test i686-linux-gnunetbash .buildkite/utilities/test_julia.sh
Waited 26m 21s
·
Ran in 3m 21s
Agent
:linux: test i686-linux-gnubash .buildkite/utilities/test_julia.sh
Canceled
Waited 26m 42s
·
Ran in 1h 9m
Agent
:linux: test x86_64-linux-gnuassertrr-netbash .buildkite/utilities/test_julia.sh
Waited 36m 5s
·
Ran in 5m 15s
Agent
:linux: test x86_64-linux-gnuassertrrbash .buildkite/utilities/test_julia.sh
Canceled
Waited 39m 6s
·
Ran in 1h 5m
Agent
:linux: test x86_64-linux-gnubash .buildkite/utilities/test_julia.sh
Canceled
Waited 47m 14s
·
Ran in 1h 3m
Agent
test revise# Download pre-built julia, extract into `usr/` && buildkite-agent artifact download --step "build_x86_64-linux-gnu" 'julia-*-linux-x86_64.tar.gz' . && mkdir -p ./usr && tar -C ./usr --strip-components=1 -zxf julia-*-linux-x86_64.tar.gz && ln -s ./usr/bin/julia ./julia && echo "--- Install and test Revise" && unset JULIA_DEPOT_PATH && JULIA_PKG_PRECOMPILE_AUTO=0 ./julia -e 'using Pkg; Pkg.add(name="Revise", rev="master"); ENV["JULIA_PKG_PRECOMPILE_AUTO"]=1; Pkg.test("Revise")'
Waited 4m 54s
·
Ran in 5m 56s
Agent
gcext# Download pre-built julia, extract into `usr/` && buildkite-agent artifact download --step "build_x86_64-linux-gnu" 'julia-*-linux-x86_64.tar.gz' . && mkdir -p usr && tar -C usr --strip-components=1 -zxf julia-*-linux-x86_64.tar.gz && rm -f julia-*-linux-x86_64.tar.gz && gcext_output="/tmp/gcext-test" && echo "+++ Run gcext tests, deploy to ${gcext_output:?}" && mkdir -p "${gcext_output:?}" && make --output-sync -j${JULIA_CPU_THREADS:?} -C test/gcext check JULIA="$(pwd)/usr/bin/julia" BIN="${gcext_output:?}"
Waited 5m 45s
·
Ran in 3m 4s
Agent
Launch allowed-to-fail build jobsexport ALLOW_FAIL="true" && # Launch Linux allowed-to-fail build jobs: && GROUP="Allow Fail" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/build_linux.soft_fail.arches \ && .buildkite/pipelines/main/platforms/build_linux.yml && # Launch macOS allowed-to-fail build jobs: && GROUP="Allow Fail" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/build_macos.soft_fail.arches \ && .buildkite/pipelines/main/platforms/build_macos.yml
Waited 2s
·
Ran in 44s
Agent
:linux: build x86_64-linux-gnummtkbash .buildkite/utilities/build_julia.sh
Waited 45m 13s
·
Ran in 2m 50s
Agent
:linux: build x86_64-linux-muslbash .buildkite/utilities/build_julia.sh
Waited 55m 12s
·
Ran in 41m 24s
Agent
Launch allowed-to-fail test jobsexport ALLOW_FAIL="true" && ### Launch Linux allowed-to-fail test jobs. && # Regular: && GROUP="Allow Fail" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/test_linux.soft_fail.arches \ && .buildkite/pipelines/main/platforms/test_linux.yml && # PowerPC (only for Julia prior to 1.12): && GROUP="Test" \ && julia .buildkite/pipelines/main/platforms/launch_powerpc.jl \ && .buildkite/pipelines/main/platforms/test_linux.powerpc.soft_fail.arches \ && .buildkite/pipelines/main/platforms/test_linux.yml && ### Launch macOS allowed-to-fail test jobs: && GROUP="Allow Fail" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/test_macos.soft_fail.arches \ && .buildkite/pipelines/main/platforms/test_macos.yml && ### Launch FreeBSD allowed-to-fail jobs: && GROUP="Allow Fail" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/test_freebsd.soft_fail.arches \ && .buildkite/pipelines/main/platforms/test_freebsd.yml && ### Launch Windows allowed-to-fail test jobs: && GROUP="Allow Fail" \ && bash .buildkite/utilities/arches_pipeline_upload.sh \ && .buildkite/pipelines/main/platforms/test_windows.soft_fail.arches \ && .buildkite/pipelines/main/platforms/test_windows.yml
Waited 55m 59s
·
Ran in 18s
Agent
:linux: test x86_64-linux-gnummtkbash .buildkite/utilities/test_julia.sh
Waited 1h 3m
·
Ran in 38s
Agent
:linux: test x86_64-linux-muslbash .buildkite/utilities/test_julia.sh
Waited 22m 55s
·
Ran in 35s
Agent
:linux: test aarch64-linux-gnubash .buildkite/utilities/test_julia.sh
Waited 10s
·
Ran in 1h 35m
Agent
Total Job Run Time: 14h 17m