Nightly
PublicTests that are too slow or non-deterministic for the regular Test pipeline
Canceled automatically after 2h 15m


Linters
Unused dependencies
Builds


Benchmarks
Scalability benchmark (read & write) against merge base or 'latest'
Scalability benchmark (DDL) against merge base or 'latest'
Scalability benchmark (connection) against merge base or 'latest'
Parallel Benchmark
Feature benchmark against merge base or 'latest'
1/8Feature benchmark against merge base or 'latest' 1
2/8Feature benchmark against merge base or 'latest' 2
3/8Feature benchmark against merge base or 'latest' 3
4/8Feature benchmark against merge base or 'latest' 4
5/8Feature benchmark against merge base or 'latest' 5
6/8Feature benchmark against merge base or 'latest' 6
7/8Feature benchmark against merge base or 'latest' 7
8/8Feature benchmark against merge base or 'latest' 8
Platform checks
Checks 0dt upgrade to a bumped version
Checks + restart of the entire Mz
1/2Checks + restart of the entire Mz 1
2/2Checks + restart of the entire Mz 2
Checks + restart of the entire Mz with old Upsert
1/2Checks + restart of the entire Mz with old Upsert 1
2/2Checks + restart of the entire Mz with old Upsert 2
Checks + backup + rollback to previous
1/2Checks + backup + rollback to previous 1
2/2Checks + backup + rollback to previous 2
Checks parallel + DROP/CREATE replica
1/2Checks parallel + DROP/CREATE replica 1
2/2Checks parallel + DROP/CREATE replica 2
Checks parallel + restart compute clusterd
1/2Checks parallel + restart compute clusterd 1
2/2Checks parallel + restart compute clusterd 2
Checks parallel + restart of the entire Mz
1/2Checks parallel + restart of the entire Mz 1
2/2Checks parallel + restart of the entire Mz 2
Checks parallel + restart of environmentd & storage clusterd
1/2Checks parallel + restart of environmentd & storage clusterd 1
2/2Checks parallel + restart of environmentd & storage clusterd 2
Checks parallel + kill storage clusterd
1/2Checks parallel + kill storage clusterd 1
2/2Checks parallel + kill storage clusterd 2
Checks upgrade, whole-Mz restart
1/2Checks upgrade, whole-Mz restart 1
2/2Checks upgrade, whole-Mz restart 2
Checks preflight-check and roll back upgrade
1/2Checks preflight-check and roll back upgrade 1
2/2Checks preflight-check and roll back upgrade 2
Checks upgrade across two versions
1/2Checks upgrade across two versions 1
2/2Checks upgrade across two versions 2
Checks upgrade across four versions
1/2Checks upgrade across four versions 1
2/2Checks upgrade across four versions 2
Checks 0dt restart of the entire Mz with forced migrations
1/2Checks 0dt restart of the entire Mz with forced migrations 1
2/2Checks 0dt restart of the entire Mz with forced migrations 2
Checks 0dt upgrade, whole-Mz restart
1/2Checks 0dt upgrade, whole-Mz restart 1
2/2Checks 0dt upgrade, whole-Mz restart 2
Checks 0dt upgrade across two versions
1/2Checks 0dt upgrade across two versions 1
2/2Checks 0dt upgrade across two versions 2
Checks 0dt upgrade across four versions
1/2Checks 0dt upgrade across four versions 1
2/2Checks 0dt upgrade across four versions 2
Platform checks upgrade in Cloudtest/K8s
Parallel Workload
Parallel Workload (0dt deploy)
Parallel Workload (DML)
Parallel Workload (DDL)
Parallel Workload (DDL Only)
Parallel Workload (rename + naughty identifiers)
Parallel Workload (rename)
Parallel Workload (kill)
Kafka
Kafka smoke test against previous Kafka versions
1/2Kafka smoke test against previous Kafka versions 1
2/2Kafka smoke test against previous Kafka versions 2
Kafka multi-broker test
🐼 resumption tests
Testdrive
🐼 🏎️ testdrive
🏎️ testdrive with old Upsert
🏎️ testdrive with --kafka-default-partitions 5
🏎️ testdrive 4 replicas
🏎️ testdrive with SIZE 1
🏎️ testdrive with SIZE 8
🏎️ testdrive with Structured Persist (Only Structured)
Full Testdrive in Cloudtest (K8s)
1/2Full Testdrive in Cloudtest (K8s) 1
2/2Full Testdrive in Cloudtest (K8s) 2
Limits
Product limits
1/2Product limits 1
2/2Product limits 2
Instance size limits
Bounded Memory
1/2Bounded Memory 1
2/2Bounded Memory 2
Extended SSH connection tests
Zippy
Zippy Kafka Sources
Zippy Kafka Sources with old Upsert
Zippy Kafka Parallel Insert
Zippy User Tables
Zippy Postgres CDC
Zippy MySQL CDC
Zippy Debezium Postgres
Zippy Cluster Replicas
Zippy w/ latest CRDB
Zippy w/ alter connection
CDC with old source syntax
MySQL CDC tests (before source versioning)
MySQL CDC resumption tests (before source versioning)
MySQL RTR tests (before source versioning)
Postgres CDC tests (before source versioning)
Postgres CDC resumption tests (before source versioning)
Postgres RTR tests (before source versioning)
Testdrive (before Kafka source versioning)
K8s node recovery cloudtest
K8s recovery: storage on failing node
K8s recovery: replicated compute on failing node
K8s recovery: envd on failing node
K8s recovery: compute on failing node
Persist
Maelstrom coverage of persist
Long single-node Maelstrom coverage of persist
Long multi-node Maelstrom coverage of persist with postgres consensus
Maelstrom coverage of txn-wal
Output consistency
Output consistency (internal)
Output consistency (Postgres)
Output consistency (version for DFR)
Output consistency (version for CTF)
Output consistency (feature-flags for DFR)
SQLsmith
SQLsmith
SQLsmith explain
CRDB rolling restarts
PubSub disruption
Data Ingest
1/2Data Ingest 1
2/2Data Ingest 2
Tests for balancerd
Legacy upgrade tests (last version from git)
Cloud tests
Cloudtest
Slow Cloudtest
Txn-wal fencing
1/2Txn-wal fencing 1
2/2Txn-wal fencing 2
CRDB / Persist backup and restore
Postgres / Persist backup and restore
Replica isolation
Zero downtime
E2E
Mz E2E Test
21m
25m 47s
1h 32m
1h 3m 19s
25m 15s
26m 58s
30m 3s
21m 12s
20m 34s
21m 10s
23m 52s
22m 26s
31m 20s
38m 33s
35m 54s
37m 20s
36m 5s
43m 11s
40m 56s
43m 26s
56m 55s
40m 5s
40m 5s
1h 20m 36s
1h 20m 36s
1h 4m 37s
1h 4m 37s
37m 31s
18m 19s
51m 14s
46m 13s
7m 36s
29m 28s
15m 8s
5m 46s
26m 14s
33m 31s
40m 4s
54m 31s
57m 22s
39m 8s
28m 58s
39m 9s
17m 19s
4m 57s