Nightly

Public

Tests that are too slow or non-deterministic for the regular Test pipeline

Scheduled build

#10889

main/8388630649

Passed in 5h 21m

Miri test (full)

Extended SSH connection tests

CRDB rolling restarts

PubSub disruption

Tests for balancerd

Legacy upgrade tests (last version from git)

CRDB / Persist backup and restore

Postgres / Persist backup and restore

Replica isolation

Zero downtime

Materialize Emulator

Created Fri 17th Jan at 12:32 AM

Triggered from Pipeline Schedule

bin/ci-builder run stable bin/pyactivate -m ci.mkpipeline nightly "$@"

Ran in 1m 50s

Detect references to already closed issuesbin/ci-builder run stable bin/ci-closed-issues-detect

Ran in 1m 4s

Unused dependenciesbin/ci-builder run nightly bin/unused-deps

Ran in 17m 50s

Miri test (full)

Ran in 2h 52m

1/8

Feature benchmark against merge base or 'latest' 1

Ran in 2h 22m

2/8

Feature benchmark against merge base or 'latest' 2

Ran in 4h 46m

3/8

Feature benchmark against merge base or 'latest' 3

Ran in 4h 32m

4/8

Feature benchmark against merge base or 'latest' 4

Ran in 3h 21m

5/8

Feature benchmark against merge base or 'latest' 5

Ran in 2h 32m

6/8

Feature benchmark against merge base or 'latest' 6

Ran in 2h 18m

7/8

Feature benchmark against merge base or 'latest' 7

Ran in 2h 38m

8/8

Feature benchmark against merge base or 'latest' 8

Ran in 4h 27m

Scalability benchmark (read & write) against merge base or 'latest'

Ran in 1h 30m

Scalability benchmark (DDL) against merge base or 'latest'

Ran in 1h 18m

Scalability benchmark (connection) against merge base or 'latest'

Ran in 26m 3s

Parallel Benchmark

Ran in 1h 25m

1/2

Kafka smoke test against previous Kafka versions 1

Ran in 40m 20s

2/2

Kafka smoke test against previous Kafka versions 2

Ran in 12m 54s

Kafka multi-broker test

Ran in 4m 58s

🐼 resumption tests

Ran in 10m 26s

🐼 🏎️ testdrive

Ran in 56m 31s

🏎️ testdrive with old Upsert

Ran in 53m 41s

🏎️ testdrive with --kafka-default-partitions 5

Ran in 55m 31s

🏎️ testdrive 4 replicas

Ran in 1h 19m

🏎️ testdrive with SIZE 1

Ran in 1h 3m

🏎️ testdrive with SIZE 8

Ran in 55m 15s

🏎️ testdrive with Structured Persist (Only Structured)

Ran in 51m 15s

1/2

Full Testdrive in Cloudtest (K8s) 1

Ran in 1h 8m

2/2

Full Testdrive in Cloudtest (K8s) 2

Ran in 1h 7m

1/2

Product limits 1

Ran in 1h 16m

2/2

Product limits 2

Ran in 36m 0s

Instance size limits

Ran in 6m 32s

1/2

Bounded Memory 1

Ran in 28m 31s

2/2

Bounded Memory 2

Ran in 14m 35s

Upsert (compaction enabled)

Ran in 14m 32s

Upsert (compaction disabled)

Ran in 18m 34s

Extended SSH connection tests

Ran in 18m 3s

Zippy Kafka Sources

Ran in 33m 59s

Zippy Kafka Sources with old Upsert

Ran in 34m 28s

Zippy Kafka Parallel Insert

Ran in 33m 56s

Zippy User Tables

Ran in 34m 41s

Zippy Postgres CDC

Ran in 33m 11s

Zippy MySQL CDC

Ran in 34m 38s

Zippy Debezium Postgres

Ran in 34m 40s

Zippy Cluster Replicas

Ran in 36m 4s

Zippy w/ latest CRDB

Ran in 34m 8s

Zippy w/ alter connection

Ran in 39m 38s

MySQL CDC tests (before source versioning)

Ran in 16m 58s

MySQL CDC resumption tests (before source versioning)

Ran in 41m 38s

MySQL RTR tests (before source versioning)

Ran in 2m 51s

Postgres CDC tests (before source versioning)

Ran in 16m 23s

Postgres CDC resumption tests (before source versioning)

Ran in 27m 20s

Postgres RTR tests (before source versioning)

Ran in 2m 52s

Testdrive (before Kafka source versioning)

Ran in 31m 0s

AWS (Real)

Ran in 5m 19s

AWS (Localstack)

Ran in 3m 35s

Secrets Local File

Ran in 1m 25s

1/2

Checks + restart of the entire Mz 1

Ran in 25m 12s

2/2

Checks + restart of the entire Mz 2

Ran in 19m 31s

1/2

Checks + restart of the entire Mz with old Upsert 1

Ran in 22m 17s

2/2

Checks + restart of the entire Mz with old Upsert 2

Ran in 20m 28s

1/2

Checks + backup + rollback to previous 1

Ran in 19m 3s

2/2

Checks + backup + rollback to previous 2

Ran in 17m 3s

1/2

Checks parallel + DROP/CREATE replica 1

Ran in 12m 50s

2/2

Checks parallel + DROP/CREATE replica 2

Ran in 13m 11s

1/2

Checks parallel + restart compute clusterd 1

Ran in 15m 18s

2/2

Checks parallel + restart compute clusterd 2

Ran in 13m 0s

1/2

Checks parallel + restart of the entire Mz 1

Ran in 13m 40s

2/2

Checks parallel + restart of the entire Mz 2

Ran in 13m 46s

1/2

Checks parallel + restart of environmentd & storage clusterd 1

Ran in 13m 47s

2/2

Checks parallel + restart of environmentd & storage clusterd 2

Ran in 17m 31s

1/2

Checks parallel + kill storage clusterd 1

Ran in 15m 9s

2/2

Checks parallel + kill storage clusterd 2

Ran in 12m 56s

1/2

Checks upgrade, whole-Mz restart 1

Ran in 22m 3s

2/2

Checks upgrade, whole-Mz restart 2

Ran in 22m 32s

1/2

Checks preflight-check and roll back upgrade 1

Ran in 22m 49s

2/2

Checks preflight-check and roll back upgrade 2

Ran in 28m 53s

1/2

Checks upgrade across two versions 1

Ran in 24m 11s

2/2

Checks upgrade across two versions 2

Ran in 21m 56s

1/2

Checks upgrade across four versions 1

Ran in 32m 3s

2/2

Checks upgrade across four versions 2

Ran in 23m 34s

1/2

Checks 0dt restart of the entire Mz with forced migrations 1

Ran in 24m 21s

2/2

Checks 0dt restart of the entire Mz with forced migrations 2

Ran in 27m 46s

1/2

Checks 0dt upgrade, whole-Mz restart 1

Ran in 23m 28s

2/2

Checks 0dt upgrade, whole-Mz restart 2

Ran in 36m 2s

1/2

Checks 0dt upgrade across two versions 1

Ran in 29m 44s

2/2

Checks 0dt upgrade across two versions 2

Ran in 1h 3m

2/2

Checks 0dt upgrade across two versions 2

Ran in 21m 32s

1/2

Checks 0dt upgrade across four versions 1

Ran in 36m 6s

2/2

Checks 0dt upgrade across four versions 2

Ran in 34m 53s

Checks 0dt upgrade to a bumped version

Ran in 1h 0m

K8s recovery: storage on failing node

Ran in 22m 6s

K8s recovery: compute on failing node

Ran in 21m 47s

K8s recovery: replicated compute on failing node

Ran in 21m 9s

K8s recovery: envd on failing node

Ran in 26m 17s

Maelstrom coverage of persist

Ran in 2m 32s

Long single-node Maelstrom coverage of persist

Ran in 11m 51s

Long multi-node Maelstrom coverage of persist with postgres consensus

Ran in 7m 5s

Maelstrom coverage of txn-wal

Ran in 7m 2s

SQL-level feature flags

Ran in 1m 56s

LaunchDarkly

Ran in 5m 52s

Canary Deploy in Staging Cloud

Ran in 1h 41m

Mz E2E Test

Ran in 14m 25s

Terraform + Helm Chart E2E on AWS

Ran in 36m 15s

SQLsmith

Ran in 27m 4s

SQLsmith explain

Ran in 27m 16s

SQLancer PQS

Ran in 27m 8s

SQLancer NoREC

Ran in 27m 1s

SQLancer QueryPartitioning

Ran in 27m 1s

SQLancer Having

Ran in 27m 19s

RQG dbt3-joins workload

Ran in 39m 11s

RQG subqueries workload

Ran in 33m 18s

RQG banking workload

Ran in 33m 32s

RQG left join stacks workload

Ran in 6m 6s

CRDB rolling restarts

Ran in 9m 59s

PubSub disruption

Ran in 16m 27s

1/2

Data Ingest 1

Ran in 43m 45s

2/2

Data Ingest 2

Ran in 23m 22s

Parallel Workload (DML)

Ran in 35m 34s

Parallel Workload (DDL)

Ran in 35m 59s

Parallel Workload (DDL Only)

Ran in 37m 4s

Parallel Workload (rename + naughty identifiers)

Ran in 29m 10s

Parallel Workload (rename)

Ran in 37m 46s

Parallel Workload (kill)

Ran in 39m 50s

Parallel Workload (0dt deploy)

Ran in 36m 9s

Tests for balancerd

Ran in 10m 44s

Legacy upgrade tests (last version from git)

Ran in 15m 14s

Cloudtest

Ran in 31m 30s

Slow Cloudtest

Ran in 24m 44s

1/2

Txn-wal fencing 1

Ran in 10m 25s

2/2

Txn-wal fencing 2

Ran in 15m 42s

Copy To S3 (1 replica)

Ran in 23m 35s

Copy To S3 (2 replicas)

Ran in 19m 53s

CRDB / Persist backup and restore

Ran in 18m 16s

Postgres / Persist backup and restore

Ran in 20m 12s

Replica isolation

Ran in 13m 57s

Zero downtime

Ran in 1h 36m

Materialize Emulator

Ran in 1m 41s

1/10

💡 SQL logic tests 1

Ran in 1h 24m

2/10

💡 SQL logic tests 2

Ran in 1h 22m

3/10

💡 SQL logic tests 3

Ran in 1h 46m

4/10

💡 SQL logic tests 4

Ran in 1h 37m

5/10

💡 SQL logic tests 5

Ran in 1h 25m

6/10

💡 SQL logic tests 6

Ran in 2h 38m

7/10

💡 SQL logic tests 7

Ran in 1h 30m

8/10

💡 SQL logic tests 8

Ran in 1h 45m

9/10

💡 SQL logic tests 9

Ran in 1h 20m

10/10

💡 SQL logic tests 10

Ran in 1h 39m

tests

Ran in 3m 4s

tests

Ran in 2m 32s

tests

Ran in 2m 5s

tests

Ran in 1m 54s

tests

Ran in 1m 50s

Total Job Run Time: 4d 11h