Nightly

Public

Tests that are too slow or non-deterministic for the regular Test pipeline

Create a special optimizer pipeline for constant INSERTs

Canceled automatically after 1h 53m
:pipeline:
:rust: Miri test (full)
Extended SSH connection tests
CRDB rolling restarts
PubSub disruption
Tests for balancerd
Legacy upgrade tests (last version from git)
CRDB / Persist backup and restore
Postgres / Persist backup and restore
Replica isolation
Zero downtime
:pipeline:bin/ci-builder run stable bin/pyactivate -m ci.mkpipeline nightly "$@"
Waited 52s
·
Ran in 3m 59s
:bazel: Build x86_64bin/ci-builder run stable bin/pyactivate -m ci.test.build
Waited 10s
·
Ran in 45s
:bazel: Build aarch64bin/ci-builder run stable bin/pyactivate -m ci.test.build
Waited 10s
·
Ran in 44s
Unused dependenciesbin/ci-builder run nightly bin/unused-deps
Waited 27s
·
Ran in 20m 21s
:rust: Miri test (full)
Canceled
Waited 1m 58s
·
Ran in 1h 48m
1/8
Feature benchmark against merge base or 'latest' 1
Canceled
Waited 2m 8s
·
Ran in 1h 32m
2/8
Feature benchmark against merge base or 'latest' 2
Canceled
Waited 2m 10s
·
Ran in 1h 33m
3/8
Feature benchmark against merge base or 'latest' 3
Canceled
Waited 2m 10s
·
Ran in 1h 33m
4/8
Feature benchmark against merge base or 'latest' 4
Canceled
Waited 2m 10s
·
Ran in 1h 32m
5/8
Feature benchmark against merge base or 'latest' 5
Canceled
Waited 2m 13s
·
Ran in 1h 32m
6/8
Feature benchmark against merge base or 'latest' 6
Canceled
Waited 2m 13s
·
Ran in 1h 32m
7/8
Feature benchmark against merge base or 'latest' 7
Canceled
Waited 2m 13s
·
Ran in 1h 32m
8/8
Feature benchmark against merge base or 'latest' 8
Canceled
Waited 2m 14s
·
Ran in 1h 33m
Scalability benchmark (read & write) against merge base or 'latest'
Canceled
Waited 35m 12s
·
Ran in 59m 48s
Scalability benchmark (DDL) against merge base or 'latest'
Waited 2m 8s
·
Ran in 1h 15m
Scalability benchmark (connection) against merge base or 'latest'
Waited 2m 10s
·
Ran in 25m 3s
Parallel Benchmark
Waited 2m 13s
·
Ran in 1h 22m
1/2
Kafka smoke test against previous Kafka versions 1
Waited 7s
·
Ran in 37m 35s
2/2
Kafka smoke test against previous Kafka versions 2
Waited 16s
·
Ran in 15m 2s
Kafka multi-broker test
Waited 25s
·
Ran in 5m 54s
🐼 resumption tests
Waited 1m 4s
·
Ran in 14m 31s
🐼 🏎️ testdrive
Waited 1m 22s
·
Ran in 59m 10s
🏎️ testdrive with old Upsert
Waited 1m 14s
·
Ran in 1h 6m
🏎️ testdrive with --kafka-default-partitions 5
Waited 1m 18s
·
Ran in 1h 7m
🏎️ testdrive 4 replicas
Waited 1m 50s
·
Ran in 1h 20m
🏎️ testdrive with SIZE 1
Waited 18s
·
Ran in 1h 2m
🏎️ testdrive with SIZE 8
Waited 2m 0s
·
Ran in 1h 1m
🏎️ testdrive with Structured Persist (Only Structured)
Waited 2m 1s
·
Ran in 57m 23s
1/2
Full Testdrive in Cloudtest (K8s) 1
Waited 52s
·
Ran in 1h 16m
2/2
Full Testdrive in Cloudtest (K8s) 2
Waited 43s
·
Ran in 1h 10m
1/2
Product limits 1
Waited 2m 4s
·
Ran in 1h 2m
2/2
Product limits 2
Waited 2m 7s
·
Ran in 37m 13s
Instance size limits
Waited 2m 7s
·
Ran in 8m 27s
1/2
Bounded Memory 1
Waited 1m 31s
·
Ran in 30m 44s
2/2
Bounded Memory 2
Waited 1m 58s
·
Ran in 14m 13s
Upsert (compaction enabled)
Waited 1m 3s
·
Ran in 15m 22s
Upsert (compaction disabled)
Waited 1m 18s
·
Ran in 16m 16s
Extended SSH connection tests
Waited 1m 21s
·
Ran in 22m 26s
Zippy Kafka Sources
Waited 2m 6s
·
Ran in 39m 35s
Zippy Kafka Sources with old Upsert
Waited 2m 12s
·
Ran in 34m 16s
Zippy Kafka Parallel Insert
Waited 2m 17s
·
Ran in 39m 6s
Zippy User Tables
Waited 2m 20s
·
Ran in 39m 30s
Zippy Postgres CDC
Waited 2m 21s
·
Ran in 38m 42s
Zippy MySQL CDC
Waited 2m 21s
·
Ran in 39m 11s
Zippy Debezium Postgres
Waited 2m 22s
·
Ran in 38m 43s
Zippy Cluster Replicas
Waited 2m 23s
·
Ran in 40m 24s
Zippy w/ latest CRDB
Waited 2m 23s
·
Ran in 39m 8s
Zippy w/ alter connection
Waited 2m 7s
·
Ran in 39m 6s
MySQL CDC tests (before source versioning)
Waited 1m 36s
·
Ran in 20m 19s
MySQL CDC resumption tests (before source versioning)
Waited 2m 22s
·
Ran in 44m 38s
MySQL RTR tests (before source versioning)
Waited 2m 19s
·
Ran in 5m 13s
Postgres CDC tests (before source versioning)
Waited 2m 45s
·
Ran in 16m 39s
Postgres CDC resumption tests (before source versioning)
Waited 2m 47s
·
Ran in 27m 21s
Postgres RTR tests (before source versioning)
Waited 3m 7s
·
Ran in 5m 2s
Testdrive %N (before Kafka source versioning)
Waited 2m 25s
·
Ran in 38m 34s
AWS (Real)
Waited 43s
·
Ran in 4m 53s
AWS (Localstack)
Waited 3m 8s
·
Ran in 6m 9s
Secrets Local File
Waited 2m 59s
·
Ran in 4m 16s
1/2
Checks + restart of the entire Mz 1
Waited 2m 8s
·
Ran in 20m 38s
2/2
Checks + restart of the entire Mz 2
Waited 2m 8s
·
Ran in 19m 57s
1/2
Checks + restart of the entire Mz with old Upsert 1
Waited 2m 8s
·
Ran in 21m 32s
2/2
Checks + restart of the entire Mz with old Upsert 2
Waited 2m 8s
·
Ran in 21m 2s
1/2
Checks + backup + rollback to previous 1
Waited 2m 8s
·
Ran in 19m 6s
2/2
Checks + backup + rollback to previous 2
Waited 2m 9s
·
Ran in 16m 19s
1/2
Checks parallel + DROP/CREATE replica 1
Waited 2m 20s
·
Ran in 12m 22s
2/2
Checks parallel + DROP/CREATE replica 2
Waited 2m 20s
·
Ran in 12m 51s
1/2
Checks parallel + restart compute clusterd 1
Waited 2m 10s
·
Ran in 13m 49s
2/2
Checks parallel + restart compute clusterd 2
Waited 2m 20s
·
Ran in 13m 2s
1/2
Checks parallel + restart of the entire Mz 1
Waited 2m 20s
·
Ran in 13m 12s
2/2
Checks parallel + restart of the entire Mz 2
Waited 2m 11s
·
Ran in 13m 18s
1/2
Checks parallel + restart of environmentd & storage clusterd 1
Waited 2m 11s
·
Ran in 13m 17s
2/2
Checks parallel + restart of environmentd & storage clusterd 2
Waited 2m 11s
·
Ran in 15m 56s
1/2
Checks parallel + kill storage clusterd 1
Waited 2m 12s
·
Ran in 12m 48s
2/2
Checks parallel + kill storage clusterd 2
Waited 2m 12s
·
Ran in 13m 29s
1/2
Checks upgrade, whole-Mz restart 1
Waited 2m 13s
·
Ran in 22m 51s
2/2
Checks upgrade, whole-Mz restart 2
Waited 2m 13s
·
Ran in 22m 59s
1/2
Checks preflight-check and roll back upgrade 1
Waited 2m 13s
·
Ran in 21m 38s
2/2
Checks preflight-check and roll back upgrade 2
Waited 2m 13s
·
Ran in 24m 48s
1/2
Checks upgrade across two versions 1
Waited 2m 14s
·
Ran in 23m 4s
2/2
Checks upgrade across two versions 2
Waited 2m 15s
·
Ran in 23m 17s
1/2
Checks upgrade across four versions 1
Waited 2m 15s
·
Ran in 25m 45s
2/2
Checks upgrade across four versions 2
Waited 2m 15s
·
Ran in 24m 33s
1/2
Checks 0dt restart of the entire Mz with forced migrations 1
Waited 2m 15s
·
Ran in 23m 19s
2/2
Checks 0dt restart of the entire Mz with forced migrations 2
Waited 2m 16s
·
Ran in 29m 43s
1/2
Checks 0dt upgrade, whole-Mz restart 1
Waited 2m 16s
·
Ran in 22m 59s
2/2
Checks 0dt upgrade, whole-Mz restart 2
Waited 2m 16s
·
Ran in 24m 1s
1/2
Checks 0dt upgrade across two versions 1
Waited 2m 17s
·
Ran in 25m 6s
2/2
Checks 0dt upgrade across two versions 2
Waited 2m 18s
·
Ran in 26m 5s
1/2
Checks 0dt upgrade across four versions 1
Waited 2m 19s
·
Ran in 28m 22s
2/2
Checks 0dt upgrade across four versions 2
Waited 2m 19s
·
Ran in 29m 37s
Checks 0dt upgrade to a bumped version
Waited 2m 15s
·
Ran in 59m 5s
Platform checks upgrade in Cloudtest/K8s
Waited 53s
·
Ran in 58m 49s
K8s recovery: storage on failing node
Waited 46s
·
Ran in 24m 51s
K8s recovery: compute on failing node
Waited 46s
·
Ran in 29m 23s
K8s recovery: replicated compute on failing node
Waited 47s
·
Ran in 23m 21s
K8s recovery: envd on failing node
Waited 50s
·
Ran in 28m 33s
Maelstrom coverage of persist
Waited 3m 41s
·
Ran in 5m 11s
Long single-node Maelstrom coverage of persist
Waited 3m 42s
·
Ran in 14m 44s
Long multi-node Maelstrom coverage of persist with postgres consensus
Waited 3m 46s
·
Ran in 11m 25s
Maelstrom coverage of txn-wal
Waited 3m 59s
·
Ran in 9m 46s
SQL-level feature flags
Waited 4m 1s
·
Ran in 5m 31s
LaunchDarkly
Waited 53s
·
Ran in 5m 35s
Mz E2E Test
Waited 55s
·
Ran in 5m 1s
Output consistency (internal)
Timed Out
Waited 3m 53s
·
Ran in 30m 54s
Output consistency (Postgres)
Waited 4m 29s
·
Ran in 18m 23s
Output consistency (version for DFR)
Waited 4m 26s
·
Ran in 25m 45s
Output consistency (version for CTF)
Waited 4m 27s
·
Ran in 15m 11s
Output consistency (feature-flags for DFR)
Waited 4m 33s
·
Ran in 13m 27s
SQLsmith
Waited 4m 39s
·
Ran in 29m 34s
SQLsmith explain
Waited 4m 40s
·
Ran in 32m 8s
SQLancer PQS
Waited 4m 46s
·
Ran in 30m 18s
SQLancer NoREC
Waited 5m 7s
·
Ran in 26m 47s
SQLancer QueryPartitioning
Waited 5m 7s
·
Ran in 30m 15s
SQLancer Having
Waited 5m 18s
·
Ran in 30m 6s
RQG dbt3-joins workload
Waited 2m 20s
·
Ran in 37m 16s
RQG subqueries workload
Waited 5m 19s
·
Ran in 36m 5s
RQG banking workload
Waited 5m 20s
·
Ran in 35m 43s
RQG left join stacks workload
Waited 5m 39s
·
Ran in 8m 28s
CRDB rolling restarts
Waited 5m 39s
·
Ran in 9m 58s
PubSub disruption
Waited 2m 25s
·
Ran in 20m 48s
1/2
Data Ingest 1
Waited 2m 28s
·
Ran in 48m 22s
2/2
Data Ingest 2
Waited 2m 29s
·
Ran in 25m 53s
Parallel Workload (DML)
Waited 2m 20s
·
Ran in 33m 54s
Parallel Workload (DDL)
Waited 2m 21s
·
Ran in 34m 24s
Parallel Workload (DDL Only)
Waited 2m 22s
·
Ran in 33m 46s
Parallel Workload (rename + naughty identifiers)
Waited 2m 24s
·
Ran in 33m 27s
Parallel Workload (rename)
Waited 2m 26s
·
Ran in 34m 10s
Parallel Workload (kill)
Waited 2m 27s
·
Ran in 33m 49s
Parallel Workload (0dt deploy)
Waited 2m 24s
·
Ran in 38m 12s
Tests for balancerd
Waited 5m 48s
·
Ran in 6m 26s
Legacy upgrade tests (last version from git)
Waited 6m 0s
·
Ran in 20m 29s
Cloudtest
Waited 1m 47s
·
Ran in 38m 3s
Slow Cloudtest
Waited 1m 1s
·
Ran in 26m 53s
1/2
Txn-wal fencing 1
Waited 2m 29s
·
Ran in 15m 37s
2/2
Txn-wal fencing 2
Waited 2m 31s
·
Ran in 19m 10s
Copy To S3 (1 replica)
Waited 2m 30s
·
Ran in 23m 19s
Copy To S3 (2 replicas)
Waited 2m 31s
·
Ran in 23m 37s
CRDB / Persist backup and restore
Waited 6m 5s
·
Ran in 20m 19s
Postgres / Persist backup and restore
Waited 6m 20s
·
Ran in 21m 8s
Replica isolation
Waited 6m 29s
·
Ran in 16m 17s
Zero downtime
Waited 2m 42s
·
Ran in 1h 24m
:csharp: tests
Waited 6m 19s
·
Ran in 6m 16s
:javascript: tests
Waited 6m 42s
·
Ran in 6m 44s
:java: tests
Waited 6m 45s
·
Ran in 4m 29s
:python: tests
Waited 6m 51s
·
Ran in 4m 43s
:ruby: tests
Waited 6m 42s
·
Ran in 2m 8s
Total Job Run Time: 3d 4h