Nightly

Public

Tests that are too slow or non-deterministic for the regular Test pipeline

persist, projection pushdown

#10703

ParkMyCar:persist/projection-pushdown/163d2ac5d4(#30764)

Canceled automatically after 48m 43s

Miri test (full)

Extended SSH connection tests

CRDB rolling restarts

PubSub disruption

Tests for balancerd

Legacy upgrade tests (last version from git)

CRDB / Persist backup and restore

Postgres / Persist backup and restore

Replica isolation

Zero downtime

Parker Timmerman

Created Wed 18th Dec 2024 at 4:03 PM

Triggered from Web

bin/ci-builder run stable bin/pyactivate -m ci.mkpipeline nightly "$@"

Ran in 34s

Build x86_64bin/ci-builder run stable bin/pyactivate -m ci.test.build

Ran in 17m 24s

Build aarch64bin/ci-builder run stable bin/pyactivate -m ci.test.build

Ran in 22m 43s

Unused dependenciesbin/ci-builder run nightly bin/unused-deps

Ran in 19m 47s

Miri test (full)

Ran in 49m 5s

1/8

Feature benchmark against merge base or 'latest' 1

Ran in 29m 27s

2/8

Feature benchmark against merge base or 'latest' 2

Ran in 29m 32s

3/8

Feature benchmark against merge base or 'latest' 3

Ran in 29m 38s

4/8

Feature benchmark against merge base or 'latest' 4

Ran in 29m 18s

5/8

Feature benchmark against merge base or 'latest' 5

Ran in 29m 22s

6/8

Feature benchmark against merge base or 'latest' 6

Ran in 29m 14s

7/8

Feature benchmark against merge base or 'latest' 7

Ran in 29m 26s

8/8

Feature benchmark against merge base or 'latest' 8

Ran in 29m 27s

Scalability benchmark (read & write) against merge base or 'latest'

Ran in 29m 11s

Scalability benchmark (DDL) against merge base or 'latest'

Ran in 29m 24s

Scalability benchmark (connection) against merge base or 'latest'

Ran in 25m 29s

Parallel Benchmark

Ran in 29m 19s

1/2

Kafka smoke test against previous Kafka versions 1

Ran in 23m 57s

2/2

Kafka smoke test against previous Kafka versions 2

Ran in 18m 32s

Kafka multi-broker test

Ran in 7m 26s

🐼 resumption tests

Ran in 11m 0s

🐼 🏎️ testdrive

Ran in 24m 12s

🏎️ testdrive with old Upsert

Ran in 24m 12s

🏎️ testdrive with --kafka-default-partitions 5

Ran in 23m 58s

🏎️ testdrive 4 replicas

Ran in 25m 10s

🏎️ testdrive with SIZE 1

Ran in 23m 55s

🏎️ testdrive with SIZE 8

Ran in 24m 24s

🏎️ testdrive with Structured Persist (Only Structured)

Ran in 24m 23s

1/2

Full Testdrive in Cloudtest (K8s) 1

Ran in 25m 47s

2/2

Full Testdrive in Cloudtest (K8s) 2

Ran in 25m 47s

1/2

Product limits 1

Ran in 24m 16s

2/2

Product limits 2

Ran in 23m 59s

Instance size limits

Ran in 8m 9s

1/2

Bounded Memory 1

Ran in 23m 57s

2/2

Bounded Memory 2

Ran in 14m 54s

Upsert (compaction enabled)

Ran in 17m 30s

Upsert (compaction disabled)

Ran in 18m 3s

Extended SSH connection tests

Ran in 23m 54s

Zippy Kafka Sources

Ran in 24m 19s

Zippy Kafka Sources with old Upsert

Ran in 24m 21s

Zippy Kafka Parallel Insert

Ran in 24m 20s

Zippy User Tables

Ran in 24m 22s

Zippy Postgres CDC

Ran in 24m 16s

Zippy MySQL CDC

Ran in 24m 9s

Zippy Debezium Postgres

Ran in 24m 14s

Zippy Cluster Replicas

Ran in 24m 5s

Zippy w/ latest CRDB

Ran in 24m 9s

Zippy w/ alter connection

Ran in 24m 13s

MySQL CDC tests (before source versioning)

Ran in 20m 39s

MySQL CDC resumption tests (before source versioning)

Ran in 23m 33s

MySQL RTR tests (before source versioning)

Ran in 6m 13s

Postgres CDC tests (before source versioning)

Ran in 18m 19s

Postgres CDC resumption tests (before source versioning)

Ran in 23m 45s

Postgres RTR tests (before source versioning)

Ran in 6m 14s

Testdrive %N (before Kafka source versioning)

Ran in 23m 58s

AWS (Real)

Ran in 4m 55s

AWS (Localstack)

Ran in 7m 25s

Secrets Local File

Ran in 5m 21s

1/2

Checks + restart of the entire Mz 1

Ran in 20m 19s

2/2

Checks + restart of the entire Mz 2

Ran in 18m 21s

1/2

Checks + restart of the entire Mz with old Upsert 1

Ran in 21m 1s

2/2

Checks + restart of the entire Mz with old Upsert 2

Ran in 18m 45s

1/2

Checks + backup + rollback to previous 1

Ran in 17m 33s

2/2

Checks + backup + rollback to previous 2

Ran in 15m 59s

1/2

Checks parallel + DROP/CREATE replica 1

Ran in 12m 16s

2/2

Checks parallel + DROP/CREATE replica 2

Ran in 13m 9s

1/2

Checks parallel + restart compute clusterd 1

Ran in 13m 28s

2/2

Checks parallel + restart compute clusterd 2

Ran in 13m 52s

1/2

Checks parallel + restart of the entire Mz 1

Ran in 12m 44s

2/2

Checks parallel + restart of the entire Mz 2

Ran in 12m 43s

1/2

Checks parallel + restart of environmentd & storage clusterd 1

Ran in 14m 4s

2/2

Checks parallel + restart of environmentd & storage clusterd 2

Ran in 15m 2s

1/2

Checks parallel + kill storage clusterd 1

Ran in 12m 13s

2/2

Checks parallel + kill storage clusterd 2

Ran in 12m 34s

1/2

Checks upgrade, whole-Mz restart 1

Ran in 24m 5s

2/2

Checks upgrade, whole-Mz restart 2

Ran in 22m 29s

1/2

Checks preflight-check and roll back upgrade 1

Ran in 23m 10s

2/2

Checks preflight-check and roll back upgrade 2

Ran in 24m 32s

1/2

Checks upgrade across two versions 1

Ran in 24m 12s

2/2

Checks upgrade across two versions 2

Ran in 24m 19s

1/2

Checks upgrade across four versions 1

Ran in 24m 23s

2/2

Checks upgrade across four versions 2

Ran in 24m 18s

1/2

Checks 0dt restart of the entire Mz with forced migrations 1

Ran in 24m 40s

2/2

Checks 0dt restart of the entire Mz with forced migrations 2

Ran in 24m 29s

1/2

Checks 0dt upgrade, whole-Mz restart 1

Ran in 24m 22s

2/2

Checks 0dt upgrade, whole-Mz restart 2

Ran in 24m 24s

1/2

Checks 0dt upgrade across two versions 1

Ran in 24m 28s

2/2

Checks 0dt upgrade across two versions 2

Ran in 23m 55s

1/2

Checks 0dt upgrade across four versions 1

Ran in 21m 5s

2/2

Checks 0dt upgrade across four versions 2

Ran in 21m 14s

Checks 0dt upgrade to a bumped version

Ran in 30m 12s

K8s recovery: storage on failing node

Ran in 21m 40s

K8s recovery: compute on failing node

Ran in 21m 33s

K8s recovery: replicated compute on failing node

Ran in 20m 18s

K8s recovery: envd on failing node

Ran in 25m 13s

Maelstrom coverage of persist

Ran in 5m 48s

Long single-node Maelstrom coverage of persist

Ran in 15m 4s

Long multi-node Maelstrom coverage of persist with postgres consensus

Ran in 12m 21s

Maelstrom coverage of txn-wal

Ran in 15m 8s

SQL-level feature flags

Ran in 1m 46s

LaunchDarkly

Ran in 5m 23s

Mz E2E Test

Ran in 5m 15s

Output consistency (internal)

Ran in 17m 27s

Output consistency (Postgres)

Ran in 16m 3s

Output consistency (version for DFR)

Ran in 16m 55s

Output consistency (version for CTF)

Ran in 16m 15s

Output consistency (feature-flags for DFR)

Ran in 16m 54s

SQLsmith

Ran in 16m 36s

SQLsmith explain

Ran in 16m 56s

SQLancer PQS

Ran in 16m 17s

SQLancer NoREC

Ran in 15m 56s

SQLancer QueryPartitioning

Ran in 15m 46s

SQLancer Having

Ran in 15m 43s

RQG dbt3-joins workload

Ran in 20m 4s

RQG subqueries workload

Ran in 16m 19s

RQG banking workload

Ran in 15m 49s

RQG left join stacks workload

Ran in 6m 27s

CRDB rolling restarts

Ran in 10m 37s

PubSub disruption

Ran in 20m 28s

1/2

Data Ingest 1

Ran in 24m 7s

2/2

Data Ingest 2

Ran in 24m 11s

Parallel Workload (DML)

Ran in 19m 15s

Parallel Workload (DDL)

Ran in 17m 19s

Parallel Workload (DDL Only)

Ran in 16m 9s

Parallel Workload (rename + naughty identifiers)

Ran in 15m 53s

Parallel Workload (rename)

Ran in 14m 29s

Parallel Workload (kill)

Ran in 13m 13s

Parallel Workload (0dt deploy)

Ran in 29m 38s

Tests for balancerd

Ran in 7m 24s

Legacy upgrade tests (last version from git)

Ran in 15m 6s

Cloudtest

Ran in 25m 43s

Slow Cloudtest

Ran in 25m 37s

1/2

Txn-wal fencing 1

Ran in 14m 22s

2/2

Txn-wal fencing 2

Ran in 20m 35s

Copy To S3 (1 replica)

Ran in 12m 57s

Copy To S3 (2 replicas)

Ran in 12m 52s

CRDB / Persist backup and restore

Ran in 14m 34s

Postgres / Persist backup and restore

Ran in 14m 12s

Replica isolation

Ran in 14m 30s

Zero downtime

Ran in 24m 5s

1/10

💡 SQL logic tests 1

Ran in 23m 44s

2/10

💡 SQL logic tests 2

Ran in 23m 32s

3/10

💡 SQL logic tests 3

Ran in 23m 30s

4/10

💡 SQL logic tests 4

Ran in 23m 45s

5/10

💡 SQL logic tests 5

Ran in 23m 43s

6/10

💡 SQL logic tests 6

Ran in 23m 47s

7/10

💡 SQL logic tests 7

Ran in 23m 30s

8/10

💡 SQL logic tests 8

Ran in 23m 37s

9/10

💡 SQL logic tests 9

Ran in 23m 24s

10/10

💡 SQL logic tests 10

Ran in 23m 24s

tests

Ran in 3m 25s

tests

Ran in 2m 9s

tests

Ran in 2m 10s

tests

Ran in 2m 11s

tests

Ran in 2m 12s

Total Job Run Time: 2d 1h