Test

Public

Run fast unit and integration tests

Merge pull request #32097 from ggevay/transform-ore-dd

#101715
/
main/e95dfdaf25d0
Passed in 1h 5m
:pipeline:
mkpipeline
:rust: Cargo test
Restart test
Yugabyte CDC tests
Short Zippy
Feature benchmark (Kafka only)
Persistence tests
Cluster isolation test
chbench smoke test
Metabase smoke test
dbt-materialize tests
Storage Usage Table Test
Tracing Fast Path
Deploy website
Deploy
Gábor Gévay
Gábor Gévay
Created
Triggered from Webhook

Cluster tests 2 failed, main history: :bk-status-passed::bk-status-failed::bk-status-passed::bk-status-passed::bk-status-passed:

Docker compose failed: docker compose -f/dev/fd/4 --project-directory /var/lib/buildkite-agent/builds/hetzner-aarch64-8cpu-16gb-b37e003e/materialize/test/test/cluster up --detach --wait --quiet-pull materialized
Test details & reproducer Functional tests which require separate clusterd containers (instead of the usual clusterd included in the materialized container). 
BUILDKITE_PARALLEL_JOB=1 BUILDKITE_PARALLEL_JOB_COUNT=4 bin/mzcompose --find cluster run default

MySQL CDC resumption tests 1 failed, main history: :bk-status-passed::bk-status-passed::bk-status-passed::bk-status-passed::bk-status-passed:

Docker compose failed: docker compose -f/dev/fd/4 --project-directory /var/lib/buildkite-agent/builds/hetzner-aarch64-8cpu-16gb-1bc8ccb5/materialize/test/test/mysql-cdc-resumption run -eCLUSTER_REPLICA_SIZES testdrive --var=mysql-root-password=p@ssw0rd --var=mysql-host=mysql verify-data.td cleanup.td

^^^ +++
+++ !!! Error Report
1 errors were encountered during execution
files involved: verify-data.td
Test details & reproducer Functional test for the native (non-Debezium) MySQL sources, using Toxiproxy to simulate bad network as well as checking how Materialize handles binary log corruptions. 
BUILDKITE_PARALLEL_JOB=0 BUILDKITE_PARALLEL_JOB_COUNT=6 bin/mzcompose --find mysql-cdc-resumption run default

Pushed images with Docker tag v0.141.0-dev.0--pr.ge95dfdaf25d0f8d187c8de1dfdf897b360374478

aarch64 Docker tags produced in this build
  • materialize/ubuntu-base:mzbuild-MGCEUE5KYJCPZM5WSNHLJ7BPR55SKROF
  • materialize/prod-base:mzbuild-XSTYLCSKZRUYNVKDRZHKF6IKZFXOSHF2
  • materialize/balancerd:mzbuild-4KOYDMI4M7WBL7GN4EJE4QAWZCDFB2IU
  • materialize/bazel:mzbuild-GPYWYBGCHHBCMN7UEBT3PZGKINW55JTV
  • materialize/chbenchmark:mzbuild-FMVL5ENVNK4PRSX4H3SARY3ZBNQBIUQJ
  • materialize/ci-java-smoketest:mzbuild-V6ZYPN3CXH52RCVQFST2M42YUGUQD5TX
  • materialize/ci-metabase-smoketest:mzbuild-N3LWOQJ3HCWUOAPGCNPL44VUP6KISIDH
  • materialize/cli:mzbuild-2SZRAOXXX5ACNUKIHGH4ARY7SNMNK7R2
  • materialize/clusterd:mzbuild-CPEVNIDZ5OOXBMSQKSFV5BGH4X2WKY2T
  • materialize/dbt-materialize:mzbuild-A2O7IDKHNTSXOBLIYHQYQVNXMDEPLAQL
  • materialize/debezium:mzbuild-RMYH5YYIXAC4K3VHNK7GUKZQHCAW75CY
  • materialize/environmentd:mzbuild-WYGCY5G6PNNQQ45PIGAB7I2DMZPZQMJN
  • materialize/fivetran-destination:mzbuild-FSSJGNWO7WZMYN2VKDKSMA6CROT3IO5Y
  • materialize/fivetran-destination-tester:mzbuild-HW7CRZ4B65JKS4GKFEMLYMJDREKBLVCU
  • materialize/frontegg-mock:mzbuild-NEOUERHQAGYQULIP75PO4ZY4LW5GOOW5
  • materialize/jobs:mzbuild-ZVRDC3M6AWMNDMGEH7E4FFJ4YUJAZCLW
  • materialize/kgen:mzbuild-E36YAAD2RUT2EGINFAHXW6VTOC6ROVM4
  • materialize/maelstrom-persist-base:mzbuild-AIDNKP5YQGJTORKPEPAUUAESL3YRPSQL
  • materialize/maelstrom-persist:mzbuild-V22ZV5QDSUGGEI4QMZHHHQLQGITHAW3M
  • materialize/materialized-base:mzbuild-W56MVNSG6EIN4VEUEYVUUICCVRQWMOVO
  • materialize/materialized:mzbuild-2ZG57U5FGTZ3BRAFXZUJH4VNUKQFATZ3
  • materialize/test-certs:mzbuild-75GIVGZBOAYS54JCYUUD6R2FEE5VDR3W
  • materialize/mysql:mzbuild-NZUI4244CPCPQPG7GOVYGXWWQLYPP6EP
  • materialize/mysql-client:mzbuild-LUEEEMGAFUDNFYJEZCDRPN556DNYPINZ
  • materialize/mz:mzbuild-T3VVZSMFPUPDI2GYAZNAGJ6YI2XYUJU7
  • materialize/orchestratord:mzbuild-5I4WCOGVPGMH2UBOBSLBHJOTT23ZKOC3
  • materialize/postgres:mzbuild-EZI4RN5GRRAFRIFYK4TGYCNFJ3TMX2FB
  • materialize/psql:mzbuild-LMZWHKC4CZRBG7IA77FKMHQ4XECNCE73
  • materialize/sqlancer:mzbuild-5L7ZLJRGN7ZQXBAAJ7X2BVQRFMQQAOXP
  • materialize/sqllogictest:mzbuild-GQ3G5WYZGPHSRQCZAZGETHPQFMZDYKNW
  • materialize/sqlsmith:mzbuild-XHNLYM577YYRKWN6A5PTJZPWRE324PXR
  • materialize/testdrive-base:mzbuild-Q3PAFJZHO5BPZRA7WYXVIY5Y3MN3WHHN
  • materialize/testdrive:mzbuild-KSAPYWAC3VTYX2NH5VUUSS5AHSTYDTBR
x86_64 Docker tags produced in this build
  • materialize/ubuntu-base:mzbuild-5NAFJNH2KMVHELOHVJME6SGR3PLLJN2A
  • materialize/prod-base:mzbuild-AZBXOQ7O2TLCAAFRQ54TTXOKACLIEPY2
  • materialize/balancerd:mzbuild-2UDEMMUNZHGZ5GPZK43YRYRMADDVMVOX
  • materialize/bazel:mzbuild-DV73MZQVHFIBFUMXOQQQN52SZHYU7ZLF
  • materialize/chbenchmark:mzbuild-DHPJOEKOE44YO5SXPKDCNWLUPU2ZZ6W5
  • materialize/ci-java-smoketest:mzbuild-IYGR7Z4VXJLZI2TNYZ2NDBRCMHDXTU2Q
  • materialize/ci-metabase-smoketest:mzbuild-P4L526ANT3U7RNDIU7YSXTTN4VZFVDXS
  • materialize/cli:mzbuild-FPVFNAOUVKYUZ63YBKUEDED63TS5XKGA
  • materialize/clusterd:mzbuild-C5DYYRSJ2Z3O2NY6Q6F5D5XGTVG2EMOB
  • materialize/dbt-materialize:mzbuild-IOQDDMAIOIAVKZWEYDSO54AROAFFN4I7
  • materialize/debezium:mzbuild-DH3UATRUW63NX4NC45OHBETXJZNLKBQ5
  • materialize/environmentd:mzbuild-SY73B3OX54MM5M5GFKCDNZLLY2ZJQDZ3
  • materialize/fivetran-destination:mzbuild-OTATOQ6ROPOZ52RMI75N3PAIPAJJCCAR
  • materialize/fivetran-destination-tester:mzbuild-QGENPO4MHMNGHRK5VPEWPKRELQKQWZX3
  • materialize/frontegg-mock:mzbuild-6QTQGJ6S7SYVIPJODYTWBCKD747KKZHG
  • materialize/jobs:mzbuild-RKDTJB36RLR4IV6ALZ7DX4GLTNQDGGJH
  • materialize/kgen:mzbuild-GKPNRV2XR5AYZWGVW5P7S6QYNWL3QV3W
  • materialize/maelstrom-persist-base:mzbuild-LVSGCWMZXLE3QRYIDIHBGIRYVSRWZ6CI
  • materialize/maelstrom-persist:mzbuild-644G7EL56ZS3LA6JJKG47OBY4EN76S2D
  • materialize/materialized-base:mzbuild-IFNDR2I54636APTP5UNGQAPCH2F57MTX
  • materialize/materialized:mzbuild-F3CX6OE3LFKM57JFNBDYUOSVKHCDEEAE
  • materialize/test-certs:mzbuild-Z2YUNQRKOEMYYW4OPM4E4BWDSPQKJ57U
  • materialize/mysql:mzbuild-HFTGC5USPVHB6VFLU2SVX7AJMASQK5EQ
  • materialize/mysql-client:mzbuild-ML4Y767WRJNDQLCBWU7KSTV24XPE6PUQ
  • materialize/mz:mzbuild-QL2NQWL62BSUYKBQQJ2EIFR5F4KIRDGK
  • materialize/orchestratord:mzbuild-R3MVN3QTAC3XLWDI3V3YKPFI5ZR2E7LY
  • materialize/postgres:mzbuild-FWSB6QZSR6SCG54RFVC6ZXQJQSELIJ63
  • materialize/psql:mzbuild-GNHCHJUW4XE6RCEY4GDDEQBVTYB6AXOR
  • materialize/sqlancer:mzbuild-NDOUBNF5POAW5MKNPYGCCEK6ITH5OPEH
  • materialize/sqllogictest:mzbuild-W2MNYLGN4HZNCHSCA5OWQDIIJ4QTUHDA
  • materialize/sqlsmith:mzbuild-W4PBNCEJXKXRGUUNJ72IWGGODU5RKT3C
  • materialize/testdrive-base:mzbuild-M5WTIILEKDNJCN6KUE2JGQLFWSASA6FM
  • materialize/testdrive:mzbuild-B4SMZ5XBMVWXIKABAEQZMUQEMNKCXPR5
:pipeline:ci/test/mkpipeline.sh
Waited 7s
·
Ran in 20s
Agent
mkpipelinebin/ci-builder run min bin/pyactivate -m ci.mkpipeline test
Waited 10s
·
Ran in 2m 25s
Agent
:bazel: Build x86_64bin/ci-builder run min bin/pyactivate -m ci.test.build
Waited 52s
·
Ran in 14m 38s
Agent
:bazel: Build aarch64bin/ci-builder run min bin/pyactivate -m ci.test.build
Waited 53s
·
Ran in 18m 52s
Agent
Build WASMbin/ci-builder run stable bin/pyactivate -m ci.deploy.npm --no-release
Waited 44s
·
Ran in 4m 13s
Agent
Tag development docker imagesbin/ci-builder run min bin/pyactivate -m ci.test.dev_tag
Waited 37s
·
Ran in 1m 25s
Agent
Lint and rustfmtbin/ci-builder run stable ci/test/lint-fast.sh
Waited 2s
·
Ran in 4m 35s
Agent
Clippy and doctestsbin/ci-builder run stable ci/test/lint-slow.sh
Waited 1m 29s
·
Ran in 21m 56s
Agent
:rust: macOS Clippycargo clippy --all-targets -- -D warnings
Waited 7s
·
Ran in 3m 51s
Agent
Lint dependenciesbin/ci-builder run stable ci/test/lint-deps.sh
Waited 15s
·
Ran in 5m 31s
Agent
Lint docsbin/ci-builder run stable ci/test/lint-docs.sh
Waited 2m 30s
·
Ran in 10m 18s
Agent
Preview docsbin/ci-builder run stable ci/test/preview-docs.sh
Waited 45s
·
Ran in 3m 24s
Agent
Run Docs JS Widgets Testsbin/ci-builder run stable ci/test/docs-widgets/docs-widgets.sh
Waited 21s
·
Ran in 4m 48s
Agent
:rust: Cargo test
Waited 1m 33s
·
Ran in 24m 41s
Agent
1/8
Testdrive 1
Waited 10s
·
Ran in 10m 18s
Agent
2/8
Testdrive 2
Waited 7s
·
Ran in 9m 36s
Agent
3/8
Testdrive 3
Waited 2s
·
Ran in 8m 1s
Agent
4/8
Testdrive 4
Waited 3s
·
Ran in 7m 30s
Agent
5/8
Testdrive 5
Waited 10s
·
Ran in 10m 1s
Agent
6/8
Testdrive 6
Waited 8s
·
Ran in 8m 37s
Agent
7/8
Testdrive 7
Waited 7s
·
Ran in 8m 28s
Agent
8/8
Testdrive 8
Waited 6s
·
Ran in 11m 30s
Agent
1/4
Cluster tests 1
Waited 10s
·
Ran in 15m 7s
Agent
2/4
Cluster tests 2
Waited 10s
·
Ran in 23m 21s
Agent
2/4
Cluster tests 2
Waited 1m 53s
·
Ran in 17m 38s
Agent
3/4
Cluster tests 3
Waited 4s
·
Ran in 14m 32s
Agent
4/4
Cluster tests 4
Waited 10s
·
Ran in 16m 23s
Agent
1/6
Fast SQL logic tests 1
Waited 3s
·
Ran in 12m 34s
Agent
2/6
Fast SQL logic tests 2
Waited 11s
·
Ran in 13m 13s
Agent
3/6
Fast SQL logic tests 3
Waited 2m 3s
·
Ran in 13m 39s
Agent
4/6
Fast SQL logic tests 4
Waited 2m 4s
·
Ran in 15m 13s
Agent
5/6
Fast SQL logic tests 5
Waited 2m 5s
·
Ran in 15m 27s
Agent
6/6
Fast SQL logic tests 6
Waited 2m 7s
·
Ran in 16m 35s
Agent
Restart test
Waited 18s
·
Ran in 8m 45s
Agent
1/2
Legacy upgrade tests (last version from docs, ignore missing) 1
Waited 3s
·
Ran in 8m 28s
Agent
2/2
Legacy upgrade tests (last version from docs, ignore missing) 2
Waited 10s
·
Ran in 12m 57s
Agent
Debezium Postgres tests
Waited 1m 8s
·
Ran in 6m 29s
Agent
Debezium SQL Server tests
Waited 7s
·
Ran in 8m 33s
Agent
Debezium MySQL tests
Waited 3s
·
Ran in 3m 25s
Agent
1/2
MySQL CDC tests 1
Waited 11s
·
Ran in 11m 50s
Agent
2/2
MySQL CDC tests 2
Waited 1s
·
Ran in 13m 40s
Agent
1/6
MySQL CDC resumption tests 1
Waited 2m 11s
·
Ran in 15m 42s
Agent
1/6
MySQL CDC resumption tests 1
Waited 1m 50s
·
Ran in 9m 15s
Agent
2/6
MySQL CDC resumption tests 2
Waited 2m 11s
·
Ran in 11m 50s
Agent
3/6
MySQL CDC resumption tests 3
Waited 2m 12s
·
Ran in 9m 36s
Agent
4/6
MySQL CDC resumption tests 4
Waited 2m 15s
·
Ran in 20m 13s
Agent
5/6
MySQL CDC resumption tests 5
Waited 2m 17s
·
Ran in 17m 23s
Agent
6/6
MySQL CDC resumption tests 6
Waited 2m 28s
·
Ran in 11m 59s
Agent
MySQL RTR tests
Waited 7s
·
Ran in 2m 51s
Agent
1/2
Postgres CDC tests 1
Waited 1m 47s
·
Ran in 13m 34s
Agent
2/2
Postgres CDC tests 2
Waited 2m 13s
·
Ran in 15m 5s
Agent
1/5
Postgres CDC resumption tests 1
Waited 2m 7s
·
Ran in 8m 43s
Agent
2/5
Postgres CDC resumption tests 2
Waited 2m 7s
·
Ran in 13m 19s
Agent
3/5
Postgres CDC resumption tests 3
Waited 2m 7s
·
Ran in 11m 0s
Agent
4/5
Postgres CDC resumption tests 4
Waited 2m 8s
·
Ran in 12m 10s
Agent
5/5
Postgres CDC resumption tests 5
Waited 2m 8s
·
Ran in 14m 37s
Agent
Postgres RTR tests
Waited 2m 17s
·
Ran in 7m 11s
Agent
Yugabyte CDC tests
Waited 2m 28s
·
Ran in 8m 57s
Agent
1/2
SQL Server CDC tests 1
Waited 2m 28s
·
Ran in 6m 37s
Agent
2/2
SQL Server CDC tests 2
Waited 2m 19s
·
Ran in 6m 32s
Agent
SSH connection tests
Waited 2m 30s
·
Ran in 16m 5s
Agent
Fivetran Destination tests
Waited 2m 19s
·
Ran in 10m 14s
Agent
Copy to S3
Waited 2m 30s
·
Ran in 7m 24s
Agent
Kafka resumption tests
Waited 2m 27s
·
Ran in 17m 30s
Agent
Kafka auth test
Waited 2m 30s
·
Ran in 15m 18s
Agent
Kafka exactly-once tests
Waited 2m 31s
·
Ran in 7m 56s
Agent
1/2
Kafka RTR tests 1
Waited 2m 29s
·
Ran in 9m 10s
Agent
2/2
Kafka RTR tests 2
Waited 2m 42s
·
Ran in 14m 29s
Agent
Short Zippy
Waited 2m 30s
·
Ran in 12m 28s
Agent
1/6
Checks + restart of environmentd & storage clusterd 1
Waited 2m 9s
·
Ran in 13m 57s
Agent
2/6
Checks + restart of environmentd & storage clusterd 2
Waited 2m 9s
·
Ran in 15m 25s
Agent
3/6
Checks + restart of environmentd & storage clusterd 3
Waited 2m 13s
·
Ran in 13m 38s
Agent
4/6
Checks + restart of environmentd & storage clusterd 4
Waited 2m 14s
·
Ran in 13m 44s
Agent
5/6
Checks + restart of environmentd & storage clusterd 5
Waited 2m 16s
·
Ran in 14m 51s
Agent
6/6
Checks + restart of environmentd & storage clusterd 6
Waited 2m 59s
·
Ran in 13m 9s
Agent
1/6
Checks without restart or upgrade 1
Waited 3m 1s
·
Ran in 12m 45s
Agent
2/6
Checks without restart or upgrade 2
Waited 3m 2s
·
Ran in 14m 10s
Agent
3/6
Checks without restart or upgrade 3
Waited 3m 3s
·
Ran in 12m 8s
Agent
4/6
Checks without restart or upgrade 4
Waited 3m 4s
·
Ran in 11m 55s
Agent
5/6
Checks without restart or upgrade 5
Waited 3m 7s
·
Ran in 13m 52s
Agent
6/6
Checks without restart or upgrade 6
Waited 3m 19s
·
Ran in 6m 57s
Agent
1/2
Source/Sink Error Reporting 1
Waited 2m 30s
·
Ran in 13m 22s
Agent
2/2
Source/Sink Error Reporting 2
Waited 2m 24s
·
Ran in 10m 4s
Agent
Feature benchmark (Kafka only)
Waited 1m 47s
·
Ran in 20m 36s
Agent
Persistence tests
Waited 2m 33s
·
Ran in 12m 16s
Agent
Cluster isolation test
Waited 2m 33s
·
Ran in 11m 36s
Agent
chbench smoke test
Waited 2m 34s
·
Ran in 9m 2s
Agent
Metabase smoke test
Waited 7s
·
Ran in 5m 16s
Agent
dbt-materialize tests
Waited 2m 34s
·
Ran in 12m 47s
Agent
Storage Usage Table Test
Waited 2m 26s
·
Ran in 8m 35s
Agent
Tracing Fast Path
Waited 1m 1s
·
Ran in 5m 0s
Agent
Deploy websiteTriggered build of main / e95dfdaf25 on Deploy website
Build #9086 (asynchronous)
Build will continue even if previous stage fails
Build will continue even if previous stage fails
DeployTriggered build of main / e95dfdaf25 on Deploy
Build #18229 (asynchronous)
Total Job Run Time: 17h 14m