Nightly

Public

Tests that are too slow or non-deterministic for the regular Test pipeline

persist/storage: communicate projection pushdown via shard_source

#10654

ParkMyCar:persist/projection-pushdown/a883b7dabf(#30764)

Parker Timmerman canceled after 17m 51s

Miri test (full)

Extended SSH connection tests

CRDB rolling restarts

PubSub disruption

Tests for balancerd

Legacy upgrade tests (last version from git)

CRDB / Persist backup and restore

Postgres / Persist backup and restore

Replica isolation

Zero downtime

Parker Timmerman

Created Mon 9th Dec 2024 at 9:15 PM

Triggered from Web

bin/ci-builder run stable bin/pyactivate -m ci.mkpipeline nightly "$@"

Ran in 35s

Build x86_64bin/ci-builder run stable bin/pyactivate -m ci.test.build

Ran in 23s

Build aarch64bin/ci-builder run stable bin/pyactivate -m ci.test.build

Ran in 20s

Unused dependenciesbin/ci-builder run nightly bin/unused-deps

Ran in 2m 45s

Miri test (full)

Ran in 10m 20s

1/8

Feature benchmark against merge base or 'latest' 1

2/8

Feature benchmark against merge base or 'latest' 2

3/8

Feature benchmark against merge base or 'latest' 3

4/8

Feature benchmark against merge base or 'latest' 4

5/8

Feature benchmark against merge base or 'latest' 5

6/8

Feature benchmark against merge base or 'latest' 6

7/8

Feature benchmark against merge base or 'latest' 7

8/8

Feature benchmark against merge base or 'latest' 8

Scalability benchmark (read & write) against merge base or 'latest'

Scalability benchmark (DDL) against merge base or 'latest'

Scalability benchmark (connection) against merge base or 'latest'

Parallel Benchmark

1/2

Kafka smoke test against previous Kafka versions 1

2/2

Kafka smoke test against previous Kafka versions 2

Kafka multi-broker test

🐼 resumption tests

🐼 🏎️ testdrive

🏎️ testdrive with old Upsert

🏎️ testdrive with --kafka-default-partitions 5

🏎️ testdrive 4 replicas

🏎️ testdrive with SIZE 1

🏎️ testdrive with SIZE 8

🏎️ testdrive with Structured Persist (Only Structured)

1/2

Full Testdrive in Cloudtest (K8s) 1

2/2

Full Testdrive in Cloudtest (K8s) 2

1/2

Product limits 1

2/2

Product limits 2

Instance size limits

1/2

Bounded Memory 1

2/2

Bounded Memory 2

Upsert (compaction enabled)

Upsert (compaction disabled)

Extended SSH connection tests

Zippy Kafka Sources

Zippy Kafka Sources with old Upsert

Zippy Kafka Parallel Insert

Zippy User Tables

Zippy Postgres CDC

Zippy MySQL CDC

Zippy Debezium Postgres

Zippy Cluster Replicas

Zippy w/ latest CRDB

Zippy w/ alter connection

MySQL CDC tests (before source versioning)

MySQL CDC resumption tests (before source versioning)

MySQL RTR tests (before source versioning)

Postgres CDC tests (before source versioning)

Postgres CDC resumption tests (before source versioning)

Postgres RTR tests (before source versioning)

Testdrive %N (before Kafka source versioning)

AWS (Real)

AWS (Localstack)

Secrets Local File

1/2

Checks + restart of the entire Mz 1

2/2

Checks + restart of the entire Mz 2

1/2

Checks + restart of the entire Mz with old Upsert 1

2/2

Checks + restart of the entire Mz with old Upsert 2

1/2

Checks + backup + rollback to previous 1

2/2

Checks + backup + rollback to previous 2

1/2

Checks parallel + DROP/CREATE replica 1

2/2

Checks parallel + DROP/CREATE replica 2

1/2

Checks parallel + restart compute clusterd 1

2/2

Checks parallel + restart compute clusterd 2

1/2

Checks parallel + restart of the entire Mz 1

2/2

Checks parallel + restart of the entire Mz 2

1/2

Checks parallel + restart of environmentd & storage clusterd 1

2/2

Checks parallel + restart of environmentd & storage clusterd 2

1/2

Checks parallel + kill storage clusterd 1

2/2

Checks parallel + kill storage clusterd 2

1/2

Checks upgrade, whole-Mz restart 1

2/2

Checks upgrade, whole-Mz restart 2

1/2

Checks preflight-check and roll back upgrade 1

2/2

Checks preflight-check and roll back upgrade 2

1/2

Checks upgrade across two versions 1

2/2

Checks upgrade across two versions 2

1/2

Checks upgrade across four versions 1

2/2

Checks upgrade across four versions 2

1/2

Checks 0dt restart of the entire Mz with forced migrations 1

2/2

Checks 0dt restart of the entire Mz with forced migrations 2

1/2

Checks 0dt upgrade, whole-Mz restart 1

2/2

Checks 0dt upgrade, whole-Mz restart 2

1/2

Checks 0dt upgrade across two versions 1

2/2

Checks 0dt upgrade across two versions 2

1/2

Checks 0dt upgrade across four versions 1

2/2

Checks 0dt upgrade across four versions 2

Checks 0dt upgrade to a bumped version

K8s recovery: storage on failing node

K8s recovery: compute on failing node

K8s recovery: replicated compute on failing node

K8s recovery: envd on failing node

Maelstrom coverage of persist

Long single-node Maelstrom coverage of persist

Long multi-node Maelstrom coverage of persist with postgres consensus

Maelstrom coverage of txn-wal

SQL-level feature flags

LaunchDarkly

Mz E2E Test

Output consistency (internal)

Output consistency (Postgres)

Output consistency (version for DFR)

Output consistency (version for CTF)

Output consistency (feature-flags for DFR)

SQLsmith

SQLsmith explain

SQLancer PQS

SQLancer NoREC

SQLancer QueryPartitioning

SQLancer Having

RQG dbt3-joins workload

RQG subqueries workload

RQG banking workload

RQG left join stacks workload

CRDB rolling restarts

PubSub disruption

1/2

Data Ingest 1

2/2

Data Ingest 2

Parallel Workload (DML)

Parallel Workload (DDL)

Parallel Workload (DDL Only)

Parallel Workload (rename + naughty identifiers)

Parallel Workload (rename)

Parallel Workload (kill)

Parallel Workload (0dt deploy)

Tests for balancerd

Legacy upgrade tests (last version from git)

Cloudtest

Slow Cloudtest

1/2

Txn-wal fencing 1

2/2

Txn-wal fencing 2

Copy To S3 (1 replica)

Copy To S3 (2 replicas)

CRDB / Persist backup and restore

Postgres / Persist backup and restore

Replica isolation

Zero downtime

1/10

💡 SQL logic tests 1

2/10

💡 SQL logic tests 2

3/10

💡 SQL logic tests 3

4/10

💡 SQL logic tests 4

5/10

💡 SQL logic tests 5

6/10

💡 SQL logic tests 6

7/10

💡 SQL logic tests 7

8/10

💡 SQL logic tests 8

9/10

💡 SQL logic tests 9

10/10

💡 SQL logic tests 10

tests

Total Job Run Time: 14m 23s