Nightly

Public

Tests that are too slow or non-deterministic for the regular Test pipeline

mz secret positional bool changed to flag

#10765
/
alex-hunt-materialize:bump_clap_v4/f95dd0d16b(#30919)
Passed in 4h 48m
:pipeline:
:rust: Miri test (full)
Extended SSH connection tests
CRDB rolling restarts
PubSub disruption
Tests for balancerd
Legacy upgrade tests (last version from git)
CRDB / Persist backup and restore
Postgres / Persist backup and restore
Replica isolation
Zero downtime
Alex Hunt
Alex Hunt
Created
Triggered from Web
:pipeline:bin/ci-builder run stable bin/pyactivate -m ci.mkpipeline nightly "$@"
Waited 9s
·
Ran in 1m 48s
Agent
Unused dependenciesbin/ci-builder run nightly bin/unused-deps
Waited 11s
·
Ran in 21m 17s
Agent
:rust: Miri test (full)
Waited 2m 42s
·
Ran in 2h 11m
Agent
1/8
Feature benchmark against merge base or 'latest' 1
Waited 1m 44s
·
Ran in 2h 32m
Agent
2/8
Feature benchmark against merge base or 'latest' 2
Waited 1m 51s
·
Ran in 4h 44m
Agent
3/8
Feature benchmark against merge base or 'latest' 3
Waited 1m 56s
·
Ran in 4h 10m
Agent
4/8
Feature benchmark against merge base or 'latest' 4
Waited 1m 56s
·
Ran in 3h 1m
Agent
5/8
Feature benchmark against merge base or 'latest' 5
Waited 1m 57s
·
Ran in 2h 40m
Agent
6/8
Feature benchmark against merge base or 'latest' 6
Waited 1m 57s
·
Ran in 2h 17m
Agent
7/8
Feature benchmark against merge base or 'latest' 7
Waited 1m 57s
·
Ran in 2h 26m
Agent
8/8
Feature benchmark against merge base or 'latest' 8
Waited 1m 57s
·
Ran in 3h 40m
Agent
Scalability benchmark (read & write) against merge base or 'latest'
Waited 1m 58s
·
Ran in 1h 41m
Agent
Scalability benchmark (DDL) against merge base or 'latest'
Waited 1m 42s
·
Ran in 1h 32m
Agent
Scalability benchmark (connection) against merge base or 'latest'
Waited 1m 54s
·
Ran in 25m 59s
Agent
Parallel Benchmark
Waited 1m 55s
·
Ran in 1h 22m
Agent
1/2
Kafka smoke test against previous Kafka versions 1
Waited 5s
·
Ran in 45m 39s
Agent
2/2
Kafka smoke test against previous Kafka versions 2
Waited 2s
·
Ran in 13m 32s
Agent
Kafka multi-broker test
Waited 9s
·
Ran in 3m 6s
Agent
🐼 resumption tests
Waited 4s
·
Ran in 9m 35s
Agent
🐼 🏎️ testdrive
Waited 5s
·
Ran in 54m 53s
Agent
🏎️ testdrive with old Upsert
Waited 10s
·
Ran in 56m 14s
Agent
🏎️ testdrive with --kafka-default-partitions 5
Waited 2s
·
Ran in 1h 5m
Agent
🏎️ testdrive 4 replicas
Waited 2m 47s
·
Ran in 1h 17m
Agent
🏎️ testdrive with SIZE 1
Waited 2m 39s
·
Ran in 57m 54s
Agent
🏎️ testdrive with SIZE 8
Waited 2m 47s
·
Ran in 1h 4m
Agent
🏎️ testdrive with Structured Persist (Only Structured)
Waited 2m 51s
·
Ran in 1h 1m
Agent
1/2
Full Testdrive in Cloudtest (K8s) 1
Waited 56s
·
Ran in 1h 9m
Agent
2/2
Full Testdrive in Cloudtest (K8s) 2
Waited 1m 0s
·
Ran in 1h 5m
Agent
1/2
Product limits 1
Waited 9m 35s
·
Ran in 58m 17s
Agent
2/2
Product limits 2
Waited 10m 36s
·
Ran in 36m 24s
Agent
Instance size limits
Waited 11m 41s
·
Ran in 6m 44s
Agent
1/2
Bounded Memory 1
Waited 21s
·
Ran in 27m 30s
Agent
2/2
Bounded Memory 2
Waited 42s
·
Ran in 10m 12s
Agent
Upsert (compaction enabled)
Waited 2m 40s
·
Ran in 17m 10s
Agent
Upsert (compaction disabled)
Waited 2m 40s
·
Ran in 17m 8s
Agent
Extended SSH connection tests
Waited 4s
·
Ran in 19m 40s
Agent
Zippy Kafka Sources
Waited 2m 50s
·
Ran in 39m 57s
Agent
Zippy Kafka Sources with old Upsert
Waited 2m 51s
·
Ran in 39m 54s
Agent
Zippy Kafka Parallel Insert
Waited 2m 51s
·
Ran in 39m 51s
Agent
Zippy User Tables
Waited 2m 54s
·
Ran in 41m 8s
Agent
Zippy Postgres CDC
Waited 2m 54s
·
Ran in 39m 57s
Agent
Zippy MySQL CDC
Waited 2m 55s
·
Ran in 40m 11s
Agent
Zippy Debezium Postgres
Waited 3m 3s
·
Ran in 37m 48s
Agent
Zippy Cluster Replicas
Waited 3m 9s
·
Ran in 41m 6s
Agent
Zippy w/ latest CRDB
Waited 3m 14s
·
Ran in 38m 44s
Agent
Zippy w/ alter connection
Waited 12m 0s
·
Ran in 37m 42s
Agent
MySQL CDC tests (before source versioning)
Waited 2m 41s
·
Ran in 20m 59s
Agent
MySQL CDC resumption tests (before source versioning)
Waited 2m 41s
·
Ran in 46m 10s
Agent
MySQL RTR tests (before source versioning)
Waited 2m 42s
·
Ran in 6m 18s
Agent
Postgres CDC tests (before source versioning)
Waited 2m 45s
·
Ran in 18m 29s
Agent
Postgres CDC resumption tests (before source versioning)
Waited 2m 45s
·
Ran in 28m 48s
Agent
Postgres RTR tests (before source versioning)
Waited 2m 49s
·
Ran in 7m 11s
Agent
Testdrive %N (before Kafka source versioning)
Waited 3m 15s
·
Ran in 36m 28s
Agent
AWS (Real)
Waited 50s
·
Ran in 4m 43s
Agent
AWS (Localstack)
Waited 2m 50s
·
Ran in 8m 37s
Agent
Secrets Local File
Waited 3m 0s
·
Ran in 6m 46s
Agent
1/2
Checks + restart of the entire Mz 1
Waited 12m 12s
·
Ran in 18m 14s
Agent
2/2
Checks + restart of the entire Mz 2
Waited 12m 59s
·
Ran in 16m 55s
Agent
1/2
Checks + restart of the entire Mz with old Upsert 1
Waited 13m 1s
·
Ran in 17m 15s
Agent
2/2
Checks + restart of the entire Mz with old Upsert 2
Waited 13m 14s
·
Ran in 16m 31s
Agent
1/2
Checks + backup + rollback to previous 1
Waited 13m 48s
·
Ran in 14m 31s
Agent
2/2
Checks + backup + rollback to previous 2
Waited 14m 9s
·
Ran in 12m 2s
Agent
1/2
Checks parallel + DROP/CREATE replica 1
Waited 14m 18s
·
Ran in 10m 29s
Agent
2/2
Checks parallel + DROP/CREATE replica 2
Waited 14m 9s
·
Ran in 9m 56s
Agent
1/2
Checks parallel + restart compute clusterd 1
Waited 14m 11s
·
Ran in 11m 51s
Agent
2/2
Checks parallel + restart compute clusterd 2
Waited 14m 29s
·
Ran in 9m 59s
Agent
1/2
Checks parallel + restart of the entire Mz 1
Waited 14m 34s
·
Ran in 10m 42s
Agent
2/2
Checks parallel + restart of the entire Mz 2
Waited 14m 37s
·
Ran in 11m 11s
Agent
1/2
Checks parallel + restart of environmentd & storage clusterd 1
Waited 14m 46s
·
Ran in 10m 59s
Agent
2/2
Checks parallel + restart of environmentd & storage clusterd 2
Waited 14m 57s
·
Ran in 12m 58s
Agent
1/2
Checks parallel + kill storage clusterd 1
Waited 15m 10s
·
Ran in 9m 11s
Agent
2/2
Checks parallel + kill storage clusterd 2
Waited 15m 6s
·
Ran in 11m 7s
Agent
1/2
Checks upgrade, whole-Mz restart 1
Waited 15m 16s
·
Ran in 19m 3s
Agent
2/2
Checks upgrade, whole-Mz restart 2
Waited 15m 7s
·
Ran in 19m 47s
Agent
1/2
Checks preflight-check and roll back upgrade 1
Waited 15m 23s
·
Ran in 20m 7s
Agent
2/2
Checks preflight-check and roll back upgrade 2
Waited 15m 24s
·
Ran in 21m 14s
Agent
1/2
Checks upgrade across two versions 1
Waited 15m 22s
·
Ran in 24m 28s
Agent
2/2
Checks upgrade across two versions 2
Waited 15m 38s
·
Ran in 27m 0s
Agent
1/2
Checks upgrade across four versions 1
Waited 15m 30s
·
Ran in 20m 18s
Agent
2/2
Checks upgrade across four versions 2
Waited 15m 54s
·
Ran in 29m 54s
Agent
1/2
Checks 0dt restart of the entire Mz with forced migrations 1
Waited 16m 7s
·
Ran in 21m 28s
Agent
2/2
Checks 0dt restart of the entire Mz with forced migrations 2
Waited 16m 2s
·
Ran in 26m 3s
Agent
1/2
Checks 0dt upgrade, whole-Mz restart 1
Waited 16m 21s
·
Ran in 19m 49s
Agent
2/2
Checks 0dt upgrade, whole-Mz restart 2
Waited 16m 35s
·
Ran in 21m 18s
Agent
1/2
Checks 0dt upgrade across two versions 1
Waited 16m 30s
·
Ran in 20m 41s
Agent
2/2
Checks 0dt upgrade across two versions 2
Waited 17m 12s
·
Ran in 26m 35s
Agent
1/2
Checks 0dt upgrade across four versions 1
Waited 17m 12s
·
Ran in 25m 1s
Agent
2/2
Checks 0dt upgrade across four versions 2
Waited 17m 49s
·
Ran in 26m 52s
Agent
Checks 0dt upgrade to a bumped version
Waited 1m 48s
·
Ran in 56m 29s
Agent
K8s recovery: storage on failing node
Waited 46s
·
Ran in 21m 13s
Agent
K8s recovery: compute on failing node
Waited 47s
·
Ran in 21m 6s
Agent
K8s recovery: replicated compute on failing node
Waited 48s
·
Ran in 19m 59s
Agent
K8s recovery: envd on failing node
Waited 49s
·
Ran in 27m 9s
Agent
Maelstrom coverage of persist
Waited 3m 2s
·
Ran in 7m 14s
Agent
Long single-node Maelstrom coverage of persist
Waited 3m 16s
·
Ran in 11m 38s
Agent
Long multi-node Maelstrom coverage of persist with postgres consensus
Waited 3m 18s
·
Ran in 9m 54s
Agent
Maelstrom coverage of txn-wal
Waited 3m 19s
·
Ran in 10m 12s
Agent
SQL-level feature flags
Waited 3m 20s
·
Ran in 5m 34s
Agent
LaunchDarkly
Waited 1m 34s
·
Ran in 5m 27s
Agent
Mz E2E Test
Waited 1m 25s
·
Ran in 16m 59s
Agent
Output consistency (internal)
Waited 3m 21s
·
Ran in 24m 48s
Agent
Output consistency (Postgres)
Waited 3m 21s
·
Ran in 18m 52s
Agent
Output consistency (version for DFR)
Waited 3m 22s
·
Ran in 25m 34s
Agent
Output consistency (version for CTF)
Waited 3m 22s
·
Ran in 18m 13s
Agent
Output consistency (feature-flags for DFR)
Waited 3m 22s
·
Ran in 27m 5s
Agent
SQLsmith
Waited 3m 22s
·
Ran in 30m 22s
Agent
SQLsmith explain
Waited 3m 22s
·
Ran in 30m 46s
Agent
SQLancer PQS
Waited 3m 33s
·
Ran in 30m 5s
Agent
SQLancer NoREC
Waited 3m 33s
·
Ran in 30m 2s
Agent
SQLancer QueryPartitioning
Waited 3m 24s
·
Ran in 30m 21s
Agent
SQLancer Having
Waited 3m 24s
·
Ran in 30m 12s
Agent
RQG dbt3-joins workload
Waited 18m 11s
·
Ran in 34m 58s
Agent
RQG subqueries workload
Waited 3m 26s
·
Ran in 36m 1s
Agent
RQG banking workload
Waited 3m 26s
·
Ran in 36m 23s
Agent
RQG left join stacks workload
Waited 3m 28s
·
Ran in 9m 46s
Agent
CRDB rolling restarts
Waited 5s
·
Ran in 10m 30s
Agent
PubSub disruption
Waited 1s
·
Ran in 16m 54s
Agent
1/2
Data Ingest 1
Waited 7s
·
Ran in 43m 37s
Agent
2/2
Data Ingest 2
Waited 6s
·
Ran in 22m 42s
Agent
Parallel Workload (DML)
Waited 18m 21s
·
Ran in 31m 29s
Agent
Parallel Workload (DDL)
Waited 18m 26s
·
Ran in 28m 32s
Agent
Parallel Workload (DDL Only)
Waited 18m 26s
·
Ran in 30m 40s
Agent
Parallel Workload (rename + naughty identifiers)
Waited 20m 5s
·
Ran in 31m 46s
Agent
Parallel Workload (rename)
Waited 20m 29s
·
Ran in 31m 19s
Agent
Parallel Workload (kill)
Waited 21m 8s
·
Ran in 31m 46s
Agent
Parallel Workload (0dt deploy)
Waited 1m 56s
·
Ran in 38m 39s
Agent
Tests for balancerd
Waited 4s
·
Ran in 6m 41s
Agent
Legacy upgrade tests (last version from git)
Waited 5s
·
Ran in 15m 6s
Agent
Cloudtest
Waited 1m 5s
·
Ran in 32m 28s
Agent
Slow Cloudtest
Waited 1m 3s
·
Ran in 25m 22s
Agent
1/2
Txn-wal fencing 1
Waited 11s
·
Ran in 11m 26s
Agent
2/2
Txn-wal fencing 2
Waited 5s
·
Ran in 17m 15s
Agent
Copy To S3 (1 replica)
Waited 21m 13s
·
Ran in 21m 31s
Agent
Copy To S3 (2 replicas)
Waited 24m 6s
·
Ran in 18m 11s
Agent
CRDB / Persist backup and restore
Waited 4s
·
Ran in 18m 0s
Agent
Postgres / Persist backup and restore
Waited 1s
·
Ran in 17m 43s
Agent
Replica isolation
Waited 10s
·
Ran in 12m 30s
Agent
Zero downtime
Waited 4s
·
Ran in 1h 33m
Agent
1/10
💡 SQL logic tests 1
Waited 1s
·
Ran in 1h 34m
Agent
2/10
💡 SQL logic tests 2
Waited 7s
·
Ran in 1h 34m
Agent
3/10
💡 SQL logic tests 3
Waited 5s
·
Ran in 2h 0m
Agent
4/10
💡 SQL logic tests 4
Waited 9s
·
Ran in 1h 53m
Agent
5/10
💡 SQL logic tests 5
Waited 7s
·
Ran in 1h 49m
Agent
6/10
💡 SQL logic tests 6
Waited 8s
·
Ran in 1h 44m
Agent
7/10
💡 SQL logic tests 7
Waited 8s
·
Ran in 1h 27m
Agent
8/10
💡 SQL logic tests 8
Waited 6s
·
Ran in 1h 33m
Agent
9/10
💡 SQL logic tests 9
Waited 9s
·
Ran in 1h 23m
Agent
10/10
💡 SQL logic tests 10
Waited 7s
·
Ran in 1h 40m
Agent
:csharp: tests
Waited 3m 28s
·
Ran in 6m 32s
Agent
:javascript: tests
Waited 3m 28s
·
Ran in 5m 33s
Agent
:java: tests
Waited 3m 28s
·
Ran in 5m 23s
Agent
:python: tests
Waited 3m 28s
·
Ran in 6m 11s
Agent
:ruby: tests
Waited 3m 29s
·
Ran in 5m 19s
Agent
Total Job Run Time: 4d 8h