Nightly

Public

Tests that are too slow or non-deterministic for the regular Test pipeline

Scheduled build

#10914

main/04fb1108fc

Passed in 9h 43m

Miri test (full)

Extended SSH connection tests

CRDB rolling restarts

PubSub disruption

Tests for balancerd

CRDB / Persist backup and restore

Postgres / Persist backup and restore

Created Sun 19th Jan at 12:32 AM

Triggered from Pipeline Schedule

bin/ci-builder run stable bin/pyactivate -m ci.mkpipeline nightly "$@"

Ran in 1m 49s

Detect references to already closed issuesbin/ci-builder run stable bin/ci-closed-issues-detect

Ran in 1m 3s

Unused dependenciesbin/ci-builder run nightly bin/unused-deps

Ran in 18m 34s

Miri test (full)

Ran in 2h 54m

1/8

Feature benchmark against merge base or 'latest' 1

Ran in 2h 32m

2/8

Feature benchmark against merge base or 'latest' 2

Ran in 4h 41m

3/8

Feature benchmark against merge base or 'latest' 3

Ran in 4h 21m

4/8

Feature benchmark against merge base or 'latest' 4

Ran in 2h 47m

5/8

Feature benchmark against merge base or 'latest' 5

Ran in 2h 30m

6/8

Feature benchmark against merge base or 'latest' 6

Ran in 2h 14m

7/8

Feature benchmark against merge base or 'latest' 7

Ran in 2h 41m

8/8

Feature benchmark against merge base or 'latest' 8

Ran in 4h 1m

8/8

Feature benchmark against merge base or 'latest' 8

Ran in 4h 4m

Scalability benchmark (read & write) against merge base or 'latest'

Ran in 1h 27m

Scalability benchmark (DDL) against merge base or 'latest'

Ran in 1h 33m

Scalability benchmark (connection) against merge base or 'latest'

Ran in 26m 31s

Parallel Benchmark

Ran in 1h 22m

1/2

Kafka smoke test against previous Kafka versions 1

Ran in 38m 57s

2/2

Kafka smoke test against previous Kafka versions 2

Ran in 12m 34s

Kafka multi-broker test

Ran in 2m 59s

🐼 resumption tests

Ran in 9m 47s

🐼 🏎️ testdrive

Ran in 1h 0m

🏎️ testdrive with old Upsert

Ran in 52m 52s

🏎️ testdrive with --kafka-default-partitions 5

Ran in 53m 25s

🏎️ testdrive 4 replicas

Ran in 1h 1m

🏎️ testdrive with SIZE 1

Ran in 56m 30s

🏎️ testdrive with SIZE 8

Ran in 58m 11s

🏎️ testdrive with Structured Persist (Only Structured)

Ran in 54m 51s

testdrive with

blob store

Ran in 1h 13m

🏎️ testdrive 4 replicas with

blob store

Ran in 1h 40m

🏎️ testdrive with SIZE 8 and

blob store

Ran in 1h 9m

1/2

Full Testdrive in Cloudtest (K8s) 1

Ran in 1h 7m

2/2

Full Testdrive in Cloudtest (K8s) 2

Ran in 1h 7m

1/2

Product limits 1

Ran in 1h 17m

2/2

Product limits 2

Ran in 38m 9s

Instance size limits

Ran in 9m 4s

1/2

Bounded Memory 1

Ran in 28m 35s

2/2

Bounded Memory 2

Ran in 11m 40s

Upsert (compaction enabled)

Ran in 13m 50s

Upsert (compaction disabled)

Ran in 12m 39s

Extended SSH connection tests

Ran in 18m 0s

Zippy Kafka Sources

Ran in 34m 54s

Zippy Kafka Sources with

blob store

Ran in 34m 47s

Zippy Kafka Sources with old Upsert

Ran in 34m 51s

Zippy Kafka Sources with old Upsert and

blob store

Ran in 35m 19s

Zippy Kafka Parallel Insert

Ran in 34m 6s

Zippy Kafka Parallel Insert with :azurite: blob store

Ran in 39m 21s

Zippy User Tables

Ran in 40m 23s

Zippy Postgres CDC

Ran in 38m 51s

Zippy MySQL CDC

Ran in 38m 56s

Zippy Debezium Postgres

Ran in 39m 21s

Zippy Cluster Replicas

Ran in 42m 37s

Zippy w/ latest CRDB

Ran in 40m 47s

Zippy w/ alter connection

Ran in 40m 7s

MySQL CDC tests (before source versioning)

Ran in 17m 3s

MySQL CDC resumption tests (before source versioning)

Ran in 42m 8s

MySQL RTR tests (before source versioning)

Ran in 2m 22s

Postgres CDC tests (before source versioning)

Ran in 17m 4s

Postgres CDC resumption tests (before source versioning)

Ran in 23m 17s

Postgres RTR tests (before source versioning)

Ran in 2m 14s

Testdrive (before Kafka source versioning)

Ran in 42m 53s

AWS (Real)

Ran in 5m 16s

AWS (Localstack)

Ran in 3m 32s

Secrets Local File

Ran in 2m 1s

1/2

Checks without restart or upgrade with

blob store 1

Ran in 19m 42s

2/2

Checks without restart or upgrade with

blob store 2

Ran in 22m 28s

1/2

Checks + restart of the entire Mz 1

Ran in 21m 48s

2/2

Checks + restart of the entire Mz 2

Ran in 22m 10s

1/2

Checks + restart of environmentd & storage clusterd with

blob store 1

Ran in 23m 19s

2/2

Checks + restart of environmentd & storage clusterd with

blob store 2

Ran in 29m 29s

1/2

Checks + restart of the entire Mz with old Upsert 1

Ran in 20m 19s

2/2

Checks + restart of the entire Mz with old Upsert 2

Ran in 23m 9s

1/2

Checks + backup + rollback to previous 1

Ran in 19m 35s

2/2

Checks + backup + rollback to previous 2

Ran in 15m 58s

1/2

Checks parallel + DROP/CREATE replica 1

Ran in 14m 39s

2/2

Checks parallel + DROP/CREATE replica 2

Ran in 14m 21s

1/2

Checks parallel + restart compute clusterd 1

Ran in 14m 20s

2/2

Checks parallel + restart compute clusterd 2

Ran in 14m 48s

1/2

Checks parallel + restart of the entire Mz 1

Ran in 13m 45s

2/2

Checks parallel + restart of the entire Mz 2

Ran in 15m 10s

1/2

Checks parallel + restart of the entire Mz with

blob store 1

Ran in 14m 8s

2/2

Checks parallel + restart of the entire Mz with

blob store 2

Ran in 15m 32s

1/2

Checks parallel + restart of environmentd & storage clusterd 1

Ran in 13m 38s

2/2

Checks parallel + restart of environmentd & storage clusterd 2

Ran in 15m 9s

1/2

Checks parallel + kill storage clusterd 1

Ran in 12m 37s

2/2

Checks parallel + kill storage clusterd 2

Ran in 13m 55s

1/2

Checks upgrade, whole-Mz restart 1

Ran in 26m 3s

2/2

Checks upgrade, whole-Mz restart 2

Ran in 22m 1s

1/2

Checks preflight-check and roll back upgrade 1

Ran in 21m 54s

2/2

Checks preflight-check and roll back upgrade 2

Ran in 22m 51s

1/2

Checks upgrade across two versions 1

Ran in 25m 54s

2/2

Checks upgrade across two versions 2

Ran in 23m 24s

1/2

Checks upgrade across four versions 1

Ran in 24m 1s

2/2

Checks upgrade across four versions 2

Ran in 28m 2s

1/2

Checks 0dt restart of the entire Mz with forced migrations with

blob store 1

Ran in 24m 54s

2/2

Checks 0dt restart of the entire Mz with forced migrations with

blob store 2

Ran in 31m 17s

1/2

Checks 0dt upgrade, whole-Mz restart 1

Ran in 22m 56s

2/2

Checks 0dt upgrade, whole-Mz restart 2

Ran in 23m 2s

1/2

Checks 0dt upgrade across two versions 1

Ran in 24m 38s

2/2

Checks 0dt upgrade across two versions 2

Ran in 24m 24s

1/2

Checks 0dt upgrade across four versions 1

Ran in 26m 2s

2/2

Checks 0dt upgrade across four versions 2

Ran in 28m 5s

Checks 0dt upgrade to a bumped version

Ran in 55m 16s

K8s recovery: storage on failing node

Ran in 21m 46s

K8s recovery: compute on failing node

Ran in 21m 34s

K8s recovery: replicated compute on failing node

Ran in 20m 6s

K8s recovery: envd on failing node

Ran in 25m 30s

Maelstrom coverage of persist

Ran in 2m 28s

Long single-node Maelstrom coverage of persist

Ran in 11m 38s

Long multi-node Maelstrom coverage of persist with postgres consensus

Ran in 6m 53s

Maelstrom coverage of txn-wal

Ran in 6m 46s

SQL-level feature flags

Ran in 6m 37s

LaunchDarkly

Ran in 5m 55s

Canary Deploy in Staging Cloud

Ran in 1h 45m

Mz E2E Test

Ran in 17m 34s

Terraform + Helm Chart E2E on AWS

Ran in 35m 57s

SQLsmith

Ran in 26m 48s

SQLsmith explain

Ran in 31m 8s

SQLancer PQS

Ran in 31m 8s

SQLancer NoREC

Ran in 31m 1s

SQLancer QueryPartitioning

Ran in 31m 16s

SQLancer Having

Ran in 26m 39s

RQG dbt3-joins workload

Ran in 38m 48s

RQG subqueries workload

Ran in 36m 48s

RQG banking workload

Ran in 38m 7s

RQG left join stacks workload

Ran in 11m 1s

CRDB rolling restarts

Ran in 10m 32s

PubSub disruption

Ran in 16m 25s

1/2

Data Ingest 1

Ran in 24m 26s

1/2

Data Ingest 1

Ran in 49m 31s

2/2

Data Ingest 2

Ran in 23m 10s

Parallel Workload (DML)

Ran in 34m 8s

Parallel Workload (DDL) with

blob store

Ran in 34m 2s

Parallel Workload (DDL Only)

Ran in 33m 4s

Parallel Workload (rename + naughty identifiers)

Ran in 33m 41s

Parallel Workload (rename) with

blob store

Ran in 34m 5s

Parallel Workload (kill)

Ran in 34m 17s

Parallel Workload (0dt deploy)

Ran in 40m 16s

Tests for balancerd

Ran in 6m 39s

Legacy upgrade tests (last version from git)

Ran in 22m 27s

1/2

Legacy upgrade tests (last version from docs) 1

Ran in 14m 15s

2/2

Legacy upgrade tests (last version from docs) 2

Ran in 13m 7s

Cloudtest

Ran in 33m 42s

Slow Cloudtest

Ran in 24m 49s

1/2

Txn-wal fencing 1

Ran in 10m 43s

2/2

Txn-wal fencing 2

Ran in 16m 35s

Copy To S3 (1 replica)

Ran in 23m 42s

Copy To S3 (2 replicas)

Ran in 25m 19s

CRDB / Persist backup and restore

Ran in 16m 53s

Postgres / Persist backup and restore

Ran in 17m 18s

Replica isolation

Ran in 12m 44s

Zero downtime

Ran in 1h 34m

Materialize Emulator

Ran in 1m 19s

1/10

💡 SQL logic tests 1

Ran in 1h 56m

2/10

💡 SQL logic tests 2

Ran in 1h 44m

3/10

💡 SQL logic tests 3

Ran in 1h 52m

4/10

💡 SQL logic tests 4

Ran in 1h 44m

5/10

💡 SQL logic tests 5

Ran in 1h 56m

6/10

💡 SQL logic tests 6

Ran in 1h 58m

7/10

💡 SQL logic tests 7

Ran in 1h 30m

8/10

💡 SQL logic tests 8

Ran in 1h 35m

9/10

💡 SQL logic tests 9

Ran in 1h 52m

10/10

💡 SQL logic tests 10

Ran in 1h 34m

Cluster tests with

blob store

Ran in 47m 10s

tests

Ran in 7m 21s

tests

Ran in 6m 50s

tests

Ran in 6m 19s

tests

Ran in 2m 36s

tests

Ran in 6m 8s

Total Job Run Time: 5d 1h