Nightly

Public

Tests that are too slow or non-deterministic for the regular Test pipeline

Create a special optimizer pipeline for constant INSERTs

Canceled automatically after 2h 15m
:pipeline:
:rust: Miri test (full)
Extended SSH connection tests
CRDB rolling restarts
PubSub disruption
Tests for balancerd
Legacy upgrade tests (last version from git)
CRDB / Persist backup and restore
Postgres / Persist backup and restore
Replica isolation
Zero downtime
:pipeline:bin/ci-builder run stable bin/pyactivate -m ci.mkpipeline nightly "$@"
Waited 4s
·
Ran in 3m 13s
:bazel: Build x86_64bin/ci-builder run stable bin/pyactivate -m ci.test.build
Waited 24s
·
Ran in 20m 26s
:bazel: Build aarch64bin/ci-builder run stable bin/pyactivate -m ci.test.build
Waited 56s
·
Ran in 24m 52s
Unused dependenciesbin/ci-builder run nightly bin/unused-deps
Waited 5s
·
Ran in 20m 55s
:rust: Miri test (full)
Waited 11s
·
Ran in 2h 11m
1/8
Feature benchmark against merge base or 'latest' 1
Canceled
Waited 18s
·
Ran in 1h 52m
2/8
Feature benchmark against merge base or 'latest' 2
Canceled
Waited 20s
·
Ran in 1h 52m
3/8
Feature benchmark against merge base or 'latest' 3
Canceled
Waited 20s
·
Ran in 1h 52m
4/8
Feature benchmark against merge base or 'latest' 4
Canceled
Waited 20s
·
Ran in 1h 52m
5/8
Feature benchmark against merge base or 'latest' 5
Canceled
Waited 20s
·
Ran in 1h 52m
6/8
Feature benchmark against merge base or 'latest' 6
Canceled
Waited 22s
·
Ran in 1h 52m
7/8
Feature benchmark against merge base or 'latest' 7
Canceled
Waited 22s
·
Ran in 1h 52m
8/8
Feature benchmark against merge base or 'latest' 8
Canceled
Waited 22s
·
Ran in 1h 52m
Scalability benchmark (read & write) against merge base or 'latest'
Waited 33s
·
Ran in 1h 31m
Scalability benchmark (DDL) against merge base or 'latest'
Waited 13s
·
Ran in 1h 8m
Scalability benchmark (connection) against merge base or 'latest'
Waited 26s
·
Ran in 24m 48s
Parallel Benchmark
Waited 18s
·
Ran in 1h 23m
1/2
Kafka smoke test against previous Kafka versions 1
Waited 7s
·
Ran in 39m 59s
2/2
Kafka smoke test against previous Kafka versions 2
Waited 11s
·
Ran in 16m 23s
Kafka multi-broker test
Waited 9s
·
Ran in 7m 30s
🐼 resumption tests
Waited 3s
·
Ran in 12m 56s
🐼 🏎️ testdrive
Waited 11s
·
Ran in 58m 46s
🏎️ testdrive with old Upsert
Waited 9m 2s
·
Ran in 58m 40s
🏎️ testdrive with --kafka-default-partitions 5
Waited 9m 49s
·
Ran in 56m 12s
🏎️ testdrive 4 replicas
Waited 8m 39s
·
Ran in 1h 1m
🏎️ testdrive with SIZE 1
Waited 2s
·
Ran in 59m 18s
🏎️ testdrive with SIZE 8
Waited 8m 52s
·
Ran in 59m 37s
🏎️ testdrive with Structured Persist (Only Structured)
Waited 9m 10s
·
Ran in 55m 58s
1/2
Full Testdrive in Cloudtest (K8s) 1
Waited 51s
·
Ran in 1h 19m
2/2
Full Testdrive in Cloudtest (K8s) 2
Waited 53s
·
Ran in 1h 11m
1/2
Product limits 1
Waited 9m 0s
·
Ran in 55m 37s
2/2
Product limits 2
Waited 9m 24s
·
Ran in 31m 50s
Instance size limits
Waited 9m 28s
·
Ran in 6m 22s
1/2
Bounded Memory 1
Waited 9m 53s
·
Ran in 27m 38s
2/2
Bounded Memory 2
Waited 9m 57s
·
Ran in 10m 53s
Upsert (compaction enabled)
Waited 11s
·
Ran in 17m 30s
Upsert (compaction disabled)
Waited 5s
·
Ran in 18m 14s
Extended SSH connection tests
Waited 9s
·
Ran in 22m 45s
Zippy Kafka Sources
Waited 10m 23s
·
Ran in 34m 32s
Zippy Kafka Sources with old Upsert
Waited 10m 35s
·
Ran in 37m 52s
Zippy Kafka Parallel Insert
Waited 10m 57s
·
Ran in 34m 42s
Zippy User Tables
Waited 11m 25s
·
Ran in 37m 51s
Zippy Postgres CDC
Waited 11m 53s
·
Ran in 33m 58s
Zippy MySQL CDC
Waited 11m 58s
·
Ran in 34m 13s
Zippy Debezium Postgres
Waited 11m 59s
·
Ran in 34m 35s
Zippy Cluster Replicas
Waited 12m 1s
·
Ran in 35m 57s
Zippy w/ latest CRDB
Waited 12m 32s
·
Ran in 38m 43s
Zippy w/ alter connection
Waited 9m 33s
·
Ran in 34m 54s
MySQL CDC tests (before source versioning)
Waited 6s
·
Ran in 21m 8s
MySQL CDC resumption tests (before source versioning)
Waited 6s
·
Ran in 45m 50s
MySQL RTR tests (before source versioning)
Waited 6s
·
Ran in 6m 34s
Postgres CDC tests (before source versioning)
Waited 6s
·
Ran in 18m 20s
Postgres CDC resumption tests (before source versioning)
Waited 1s
·
Ran in 28m 11s
Postgres RTR tests (before source versioning)
Waited 11s
·
Ran in 6m 50s
Testdrive %N (before Kafka source versioning)
Waited 12m 55s
·
Ran in 33m 18s
AWS (Real)
Waited 6s
·
Ran in 4m 19s
AWS (Localstack)
Waited 10s
·
Ran in 7m 27s
Secrets Local File
Waited 7s
·
Ran in 5m 40s
1/2
Checks + restart of the entire Mz 1
Waited 9m 38s
·
Ran in 15m 37s
2/2
Checks + restart of the entire Mz 2
Waited 9m 41s
·
Ran in 14m 43s
1/2
Checks + restart of the entire Mz with old Upsert 1
Waited 9m 43s
·
Ran in 14m 46s
2/2
Checks + restart of the entire Mz with old Upsert 2
Waited 10m 7s
·
Ran in 16m 52s
1/2
Checks + backup + rollback to previous 1
Waited 10m 46s
·
Ran in 19m 18s
2/2
Checks + backup + rollback to previous 2
Waited 10m 55s
·
Ran in 13m 51s
1/2
Checks parallel + DROP/CREATE replica 1
Waited 11m 17s
·
Ran in 7m 23s
2/2
Checks parallel + DROP/CREATE replica 2
Waited 11m 35s
·
Ran in 9m 38s
1/2
Checks parallel + restart compute clusterd 1
Waited 11m 25s
·
Ran in 8m 21s
2/2
Checks parallel + restart compute clusterd 2
Waited 11m 47s
·
Ran in 8m 47s
1/2
Checks parallel + restart of the entire Mz 1
Waited 12m 4s
·
Ran in 8m 14s
2/2
Checks parallel + restart of the entire Mz 2
Waited 12m 28s
·
Ran in 8m 43s
1/2
Checks parallel + restart of environmentd & storage clusterd 1
Waited 12m 29s
·
Ran in 9m 12s
2/2
Checks parallel + restart of environmentd & storage clusterd 2
Waited 12m 43s
·
Ran in 11m 9s
1/2
Checks parallel + kill storage clusterd 1
Waited 12m 52s
·
Ran in 9m 35s
2/2
Checks parallel + kill storage clusterd 2
Waited 12m 54s
·
Ran in 7m 48s
1/2
Checks upgrade, whole-Mz restart 1
Waited 12m 56s
·
Ran in 18m 24s
2/2
Checks upgrade, whole-Mz restart 2
Waited 13m 34s
·
Ran in 16m 57s
1/2
Checks preflight-check and roll back upgrade 1
Waited 14m 14s
·
Ran in 24m 19s
2/2
Checks preflight-check and roll back upgrade 2
Waited 14m 41s
·
Ran in 18m 56s
1/2
Checks upgrade across two versions 1
Waited 15m 50s
·
Ran in 20m 4s
2/2
Checks upgrade across two versions 2
Waited 16m 14s
·
Ran in 17m 26s
1/2
Checks upgrade across four versions 1
Waited 16m 22s
·
Ran in 20m 13s
2/2
Checks upgrade across four versions 2
Waited 16m 28s
·
Ran in 20m 53s
1/2
Checks 0dt restart of the entire Mz with forced migrations 1
Waited 16m 59s
·
Ran in 17m 38s
2/2
Checks 0dt restart of the entire Mz with forced migrations 2
Waited 17m 11s
·
Ran in 18m 55s
1/2
Checks 0dt upgrade, whole-Mz restart 1
Waited 17m 14s
·
Ran in 19m 58s
2/2
Checks 0dt upgrade, whole-Mz restart 2
Waited 17m 28s
·
Ran in 25m 44s
1/2
Checks 0dt upgrade across two versions 1
Waited 17m 58s
·
Ran in 22m 27s
2/2
Checks 0dt upgrade across two versions 2
Waited 18m 38s
·
Ran in 22m 19s
1/2
Checks 0dt upgrade across four versions 1
Waited 18m 40s
·
Ran in 24m 47s
2/2
Checks 0dt upgrade across four versions 2
Waited 18m 42s
·
Ran in 24m 4s
Checks 0dt upgrade to a bumped version
Waited 19s
·
Ran in 59m 0s
Platform checks upgrade in Cloudtest/K8s
Waited 55s
·
Ran in 57m 27s
K8s recovery: storage on failing node
Waited 53s
·
Ran in 24m 52s
K8s recovery: compute on failing node
Timed Out
Waited 44s
·
Ran in 1h 2m
K8s recovery: replicated compute on failing node
Waited 55s
·
Ran in 22m 45s
K8s recovery: envd on failing node
Waited 56s
·
Ran in 28m 32s
Maelstrom coverage of persist
Waited 3s
·
Ran in 5m 49s
Long single-node Maelstrom coverage of persist
Waited 6s
·
Ran in 15m 3s
Long multi-node Maelstrom coverage of persist with postgres consensus
Waited 2s
·
Ran in 10m 15s
Maelstrom coverage of txn-wal
Waited 9s
·
Ran in 10m 10s
SQL-level feature flags
Waited 2s
·
Ran in 5m 45s
LaunchDarkly
Waited 11s
·
Ran in 3m 33s
Mz E2E Test
Waited 8s
·
Ran in 4m 50s
Output consistency (internal)
Waited 7s
·
Ran in 20m 59s
Output consistency (Postgres)
Waited 11s
·
Ran in 19m 35s
Output consistency (version for DFR)
Waited 3s
·
Ran in 26m 11s
Output consistency (version for CTF)
Waited 6s
·
Ran in 16m 34s
Output consistency (feature-flags for DFR)
Waited 8s
·
Ran in 13m 49s
SQLsmith
Waited 10s
·
Ran in 33m 21s
SQLsmith explain
Waited 5s
·
Ran in 32m 25s
SQLancer PQS
Waited 2s
·
Ran in 30m 25s
SQLancer NoREC
Waited 4s
·
Ran in 30m 34s
SQLancer QueryPartitioning
Waited 2s
·
Ran in 30m 25s
SQLancer Having
Waited 9m 33s
·
Ran in 30m 31s
RQG dbt3-joins workload
Waited 18m 50s
·
Ran in 35m 42s
RQG subqueries workload
Waited 9m 32s
·
Ran in 36m 22s
RQG banking workload
Waited 9m 24s
·
Ran in 36m 41s
RQG left join stacks workload
Waited 9m 35s
·
Ran in 5m 40s
CRDB rolling restarts
Waited 10m 5s
·
Ran in 13m 55s
PubSub disruption
Waited 12m 55s
·
Ran in 17m 8s
1/2
Data Ingest 1
Waited 13m 10s
·
Ran in 44m 13s
2/2
Data Ingest 2
Waited 13m 9s
·
Ran in 22m 37s
Parallel Workload (DML)
Waited 18m 51s
·
Ran in 28m 32s
Parallel Workload (DDL)
Waited 19m 41s
·
Ran in 32m 0s
Parallel Workload (DDL Only)
Waited 19m 47s
·
Ran in 27m 52s
Parallel Workload (rename + naughty identifiers)
Waited 19m 51s
·
Ran in 32m 7s
Parallel Workload (rename)
Waited 20m 2s
·
Ran in 28m 38s
Parallel Workload (kill)
Waited 20m 29s
·
Ran in 28m 40s
Parallel Workload (0dt deploy)
Waited 23s
·
Ran in 38m 31s
Tests for balancerd
Waited 10m 10s
·
Ran in 10m 13s
Legacy upgrade tests (last version from git)
Waited 10m 16s
·
Ran in 17m 23s
Cloudtest
Waited 59s
·
Ran in 38m 9s
Slow Cloudtest
Waited 57s
·
Ran in 27m 3s
1/2
Txn-wal fencing 1
Waited 13m 33s
·
Ran in 13m 34s
2/2
Txn-wal fencing 2
Waited 13m 35s
·
Ran in 15m 23s
Copy To S3 (1 replica)
Waited 20m 45s
·
Ran in 17m 47s
Copy To S3 (2 replicas)
Waited 20m 52s
·
Ran in 18m 17s
CRDB / Persist backup and restore
Waited 10m 27s
·
Ran in 19m 35s
Postgres / Persist backup and restore
Waited 10m 29s
·
Ran in 19m 16s
Replica isolation
Waited 10m 33s
·
Ran in 16m 2s
Zero downtime
Waited 13m 31s
·
Ran in 1h 23m
:csharp: tests
Timed Out
Waited 10m 32s
·
Ran in 20m 12s
:javascript: tests
Waited 10m 44s
·
Ran in 5m 14s
:java: tests
Waited 11m 3s
·
Ran in 1m 32s
:python: tests
Waited 11m 20s
·
Ran in 5m 34s
:ruby: tests
Waited 12m 3s
·
Ran in 5m 17s
Total Job Run Time: 3d 4h