Nightly

Public

Tests that are too slow or non-deterministic for the regular Test pipeline

Scheduled build

#10918

main/699f35e59d

Passed in 13h 4m

Miri test (full)

Extended SSH connection tests

CRDB rolling restarts

PubSub disruption

Tests for balancerd

CRDB / Persist backup and restore

Postgres / Persist backup and restore

Created Mon 20th Jan at 12:32 AM

Triggered from Pipeline Schedule

bin/ci-builder run stable bin/pyactivate -m ci.mkpipeline nightly "$@"

Ran in 1m 52s

Detect references to already closed issuesbin/ci-builder run stable bin/ci-closed-issues-detect

Ran in 1m 5s

Unused dependenciesbin/ci-builder run nightly bin/unused-deps

Ran in 23m 51s

Miri test (full)

Ran in 2h 37m

1/8

Feature benchmark against merge base or 'latest' 1

Ran in 2h 22m

2/8

Feature benchmark against merge base or 'latest' 2

Ran in 4h 32m

3/8

Feature benchmark against merge base or 'latest' 3

Ran in 4h 2m

4/8

Feature benchmark against merge base or 'latest' 4

Ran in 3h 1m

5/8

Feature benchmark against merge base or 'latest' 5

Ran in 2h 22m

6/8

Feature benchmark against merge base or 'latest' 6

Ran in 2h 18m

7/8

Feature benchmark against merge base or 'latest' 7

Ran in 2h 25m

8/8

Feature benchmark against merge base or 'latest' 8

Ran in 4h 38m

8/8

Feature benchmark against merge base or 'latest' 8

Ran in 4h 28m

8/8

Feature benchmark against merge base or 'latest' 8

Ran in 3h 50m

Scalability benchmark (read & write) against merge base or 'latest'

Ran in 1h 27m

Scalability benchmark (DDL) against merge base or 'latest'

Ran in 1h 32m

Scalability benchmark (connection) against merge base or 'latest'

Ran in 27m 24s

Parallel Benchmark

Ran in 1h 23m

1/2

Kafka smoke test against previous Kafka versions 1

Ran in 39m 23s

2/2

Kafka smoke test against previous Kafka versions 2

Ran in 13m 17s

Kafka multi-broker test

Ran in 3m 31s

🐼 resumption tests

Ran in 10m 8s

🐼 🏎️ testdrive

Ran in 56m 16s

🏎️ testdrive with old Upsert

Ran in 1h 0m

🏎️ testdrive with --kafka-default-partitions 5

Ran in 1h 3m

🏎️ testdrive 4 replicas

Ran in 1h 11m

🏎️ testdrive with SIZE 1

Ran in 56m 4s

🏎️ testdrive with SIZE 8

Ran in 59m 26s

🏎️ testdrive with Structured Persist (Only Structured)

Ran in 54m 15s

testdrive with

blob store

Ran in 1h 8m

🏎️ testdrive 4 replicas with

blob store

Ran in 1h 25m

🏎️ testdrive with SIZE 8 and

blob store

Ran in 1h 11m

1/2

Full Testdrive in Cloudtest (K8s) 1

Ran in 1h 9m

2/2

Full Testdrive in Cloudtest (K8s) 2

Ran in 1h 7m

1/2

Product limits 1

Ran in 1h 7m

2/2

Product limits 2

Ran in 38m 41s

Instance size limits

Ran in 8m 45s

1/2

Bounded Memory 1

Ran in 32m 11s

2/2

Bounded Memory 2

Ran in 12m 56s

Upsert (compaction enabled)

Ran in 17m 41s

Upsert (compaction disabled)

Ran in 17m 39s

Extended SSH connection tests

Ran in 18m 15s

Zippy Kafka Sources

Ran in 35m 15s

Zippy Kafka Sources with

blob store

Ran in 42m 31s

Zippy Kafka Sources with old Upsert

Ran in 41m 40s

Zippy Kafka Sources with old Upsert and

blob store

Ran in 42m 7s

Zippy Kafka Parallel Insert

Ran in 39m 58s

Zippy Kafka Parallel Insert with :azurite: blob store

Ran in 41m 43s

Zippy User Tables

Ran in 41m 55s

Zippy Postgres CDC

Ran in 42m 53s

Zippy MySQL CDC

Ran in 33m 49s

Zippy Debezium Postgres

Ran in 33m 10s

Zippy Cluster Replicas

Ran in 35m 5s

Zippy w/ latest CRDB

Ran in 34m 40s

Zippy w/ alter connection

Ran in 39m 17s

MySQL CDC tests (before source versioning)

Ran in 21m 27s

MySQL CDC resumption tests (before source versioning)

Ran in 46m 17s

MySQL RTR tests (before source versioning)

Ran in 6m 56s

Postgres CDC tests (before source versioning)

Ran in 19m 43s

Postgres CDC resumption tests (before source versioning)

Ran in 27m 42s

Postgres RTR tests (before source versioning)

Ran in 7m 27s

Testdrive (before Kafka source versioning)

Ran in 38m 17s

AWS (Real)

Ran in 5m 16s

AWS (Localstack)

Ran in 7m 54s

Secrets Local File

Ran in 6m 4s

1/2

Checks without restart or upgrade with

blob store 1

Ran in 21m 3s

2/2

Checks without restart or upgrade with

blob store 2

Ran in 24m 13s

1/2

Checks + restart of the entire Mz 1

Ran in 23m 55s

2/2

Checks + restart of the entire Mz 2

Ran in 22m 0s

1/2

Checks + restart of environmentd & storage clusterd with

blob store 1

Ran in 23m 48s

2/2

Checks + restart of environmentd & storage clusterd with

blob store 2

Ran in 30m 6s

1/2

Checks + restart of the entire Mz with old Upsert 1

Ran in 22m 18s

2/2

Checks + restart of the entire Mz with old Upsert 2

Ran in 19m 36s

1/2

Checks + backup + rollback to previous 1

Ran in 20m 53s

2/2

Checks + backup + rollback to previous 2

Ran in 16m 27s

1/2

Checks parallel + DROP/CREATE replica 1

Ran in 13m 16s

2/2

Checks parallel + DROP/CREATE replica 2

Ran in 12m 54s

1/2

Checks parallel + restart compute clusterd 1

Ran in 14m 17s

2/2

Checks parallel + restart compute clusterd 2

Ran in 12m 47s

1/2

Checks parallel + restart of the entire Mz 1

Ran in 14m 2s

2/2

Checks parallel + restart of the entire Mz 2

Ran in 14m 2s

1/2

Checks parallel + restart of the entire Mz with

blob store 1

Ran in 15m 10s

2/2

Checks parallel + restart of the entire Mz with

blob store 2

Ran in 15m 29s

1/2

Checks parallel + restart of environmentd & storage clusterd 1

Ran in 13m 45s

2/2

Checks parallel + restart of environmentd & storage clusterd 2

Ran in 15m 15s

1/2

Checks parallel + kill storage clusterd 1

Ran in 12m 57s

2/2

Checks parallel + kill storage clusterd 2

Ran in 13m 13s

1/2

Checks upgrade, whole-Mz restart 1

Ran in 22m 56s

2/2

Checks upgrade, whole-Mz restart 2

Ran in 23m 1s

1/2

Checks preflight-check and roll back upgrade 1

Ran in 22m 23s

2/2

Checks preflight-check and roll back upgrade 2

Ran in 24m 52s

1/2

Checks upgrade across two versions 1

Ran in 23m 43s

2/2

Checks upgrade across two versions 2

Ran in 23m 9s

1/2

Checks upgrade across four versions 1

Ran in 24m 21s

2/2

Checks upgrade across four versions 2

Ran in 24m 53s

1/2

Checks 0dt restart of the entire Mz with forced migrations with

blob store 1

Ran in 27m 23s

2/2

Checks 0dt restart of the entire Mz with forced migrations with

blob store 2

Ran in 31m 0s

1/2

Checks 0dt upgrade, whole-Mz restart 1

Ran in 23m 19s

2/2

Checks 0dt upgrade, whole-Mz restart 2

Ran in 24m 22s

1/2

Checks 0dt upgrade across two versions 1

Ran in 23m 44s

2/2

Checks 0dt upgrade across two versions 2

Ran in 26m 19s

1/2

Checks 0dt upgrade across four versions 1

Ran in 30m 36s

2/2

Checks 0dt upgrade across four versions 2

Ran in 29m 55s

Checks 0dt upgrade to a bumped version

Ran in 55m 28s

K8s recovery: storage on failing node

Ran in 22m 35s

K8s recovery: compute on failing node

Ran in 22m 3s

K8s recovery: replicated compute on failing node

Ran in 20m 30s

K8s recovery: envd on failing node

Ran in 26m 31s

Maelstrom coverage of persist

Ran in 6m 46s

Long single-node Maelstrom coverage of persist

Ran in 15m 48s

Long multi-node Maelstrom coverage of persist with postgres consensus

Ran in 11m 1s

Maelstrom coverage of txn-wal

Ran in 11m 8s

SQL-level feature flags

Ran in 6m 9s

LaunchDarkly

Ran in 5m 52s

Canary Deploy in Staging Cloud

Ran in 1h 45m

Mz E2E Test

Ran in 17m 27s

Terraform + Helm Chart E2E on AWS

Ran in 36m 47s

SQLsmith

Ran in 31m 48s

SQLsmith explain

Ran in 31m 0s

SQLancer PQS

Ran in 31m 5s

SQLancer NoREC

Ran in 31m 11s

SQLancer QueryPartitioning

Ran in 30m 57s

SQLancer Having

Ran in 31m 26s

RQG dbt3-joins workload

Ran in 36m 54s

RQG subqueries workload

Ran in 36m 49s

RQG banking workload

Ran in 37m 14s

RQG left join stacks workload

Ran in 10m 31s

CRDB rolling restarts

Ran in 10m 30s

PubSub disruption

Ran in 18m 13s

1/2

Data Ingest 1

Ran in 48m 31s

1/2

Data Ingest 1

Ran in 30m 23s

1/2

Data Ingest 1

Ran in 47m 35s

2/2

Data Ingest 2

Ran in 23m 12s

Parallel Workload (DML)

Ran in 33m 45s

Parallel Workload (DDL) with

blob store

Ran in 33m 33s

Parallel Workload (DDL Only)

Ran in 33m 8s

Parallel Workload (rename + naughty identifiers)

Ran in 33m 21s

Parallel Workload (rename) with

blob store

Ran in 33m 33s

Parallel Workload (kill)

Ran in 35m 11s

Parallel Workload (0dt deploy)

Ran in 34m 50s

Tests for balancerd

Ran in 6m 38s

Legacy upgrade tests (last version from git)

Ran in 21m 16s

1/2

Legacy upgrade tests (last version from docs) 1

Ran in 13m 25s

2/2

Legacy upgrade tests (last version from docs) 2

Ran in 13m 28s

Cloudtest

Ran in 36m 6s

Slow Cloudtest

Ran in 25m 52s

1/2

Txn-wal fencing 1

Ran in 11m 6s

2/2

Txn-wal fencing 2

Ran in 19m 41s

Copy To S3 (1 replica)

Ran in 25m 56s

Copy To S3 (2 replicas)

Ran in 23m 55s

CRDB / Persist backup and restore

Ran in 17m 58s

Postgres / Persist backup and restore

Ran in 17m 35s

Replica isolation

Ran in 12m 23s

Zero downtime

Ran in 1h 47m

Materialize Emulator

Ran in 1m 31s

1/10

💡 SQL logic tests 1

Ran in 1h 34m

2/10

💡 SQL logic tests 2

Ran in 1h 35m

3/10

💡 SQL logic tests 3

Ran in 1h 51m

4/10

💡 SQL logic tests 4

Ran in 1h 51m

5/10

💡 SQL logic tests 5

Ran in 1h 36m

6/10

💡 SQL logic tests 6

Ran in 1h 57m

7/10

💡 SQL logic tests 7

Ran in 1h 35m

8/10

💡 SQL logic tests 8

Ran in 1h 32m

9/10

💡 SQL logic tests 9

Ran in 2h 0m

10/10

💡 SQL logic tests 10

Ran in 2h 20m

Cluster tests with

blob store

Ran in 53m 9s

tests

Ran in 7m 46s

tests

Ran in 6m 43s

tests

Ran in 6m 31s

tests

Ran in 6m 21s

tests

Ran in 6m 28s

Total Job Run Time: 5d 7h