Detox

Public

Gray box end-to-end testing and automation framework for mobile apps

🏎️ testdrive 4 replicas failed, main history: :bk-status-failed::bk-status-failed::bk-status-passed::bk-status-passed::bk-status-passed:

error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
copy-from-s3-minio.td:41:1: preparing query failed: connection closed
     |
  15 | $ postgres-execute c ... [rest of line truncated for security]
  24 | $ s3-set-presigned-u ... [rest of line truncated for security]
  26 | > COPY INTO t1 FROM  ... [rest of line truncated for security]
  37 | $ s3-set-presigned-u ... [rest of line truncated for security]
  39 | > COPY INTO t1 FROM  ... [rest of line truncated for security]
  40 | 
  41 | > SELECT * FROM t1;
     | ^

error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
error connecting to server: failed to lookup address information: Name or service not known: failed to lookup address information: Name or service not known
testdrive-materialized-1     | 2025-03-20T01:33:08.253863Z  thread 'coordinator' panicked at src/storage-controller/src/lib.rs:2380:33: no sender for 06aa6783-fb9e-469c-aff6-a34f3599306c!
Test details & reproducer Testdrive is the basic framework and language for defining product tests under the expected-result/actual-result (aka golden testing) paradigm. A query is retried until it produces the desired result.
bin/mzcompose --find testdrive run default --replicas=4 
Checks 0dt upgrade across four versions 1 succeeded with known error logs, main history: :bk-status-passed::bk-status-passed::bk-status-passed::bk-status-passed::bk-status-passed:
platform-checks-mz_4-1              | 2025-03-20T01:02:58.308948Z  thread 'coordinator' panicked at src/storage-controller/src/lib.rs:850:17: dependency since has advanced past dependent (u479) upper 
Test details & reproducer Write a single set of .td fragments for a particular feature or functionality and then have Zippy execute them in upgrade, 0dt-upgrade, restart, recovery and failure contexts.
BUILDKITE_PARALLEL_JOB=0 BUILDKITE_PARALLEL_JOB_COUNT=2 bin/mzcompose --find platform-checks run default --scenario=ZeroDowntimeUpgradeEntireMzFourVersions --seed=0195b0bf-0a29-4551-b85c-cfae936dff4e 
Checks 0dt upgrade across two versions 2 succeeded with known error logs, main history: :bk-status-passed::bk-status-passed::bk-status-passed::bk-status-passed::bk-status-passed:
platform-checks-mz_4-1              | 2025-03-20T00:58:21.983498Z  thread 'coordinator' panicked at src/storage-controller/src/lib.rs:976:17: dependency since has advanced past dependent (u416) upper 
Test details & reproducer Write a single set of .td fragments for a particular feature or functionality and then have Zippy execute them in upgrade, 0dt-upgrade, restart, recovery and failure contexts.
BUILDKITE_PARALLEL_JOB=1 BUILDKITE_PARALLEL_JOB_COUNT=2 bin/mzcompose --find platform-checks run default --scenario=ZeroDowntimeUpgradeEntireMzTwoVersions --seed=0195b0bf-0a29-4551-b85c-cfae936dff4e 
Parallel Workload (0dt deploy) succeeded with known error logs, main history: :bk-status-passed::bk-status-passed::bk-status-passed::bk-status-passed::bk-status-passed:
parallel-workload-materialized2-1    | 2025-03-20T00:03:21.123689Z  thread 'coordinator' panicked at src/storage-controller/src/lib.rs:976:17: dependency since has advanced past dependent (u345) upper 
Test details & reproducer Runs a randomized parallel workload stressing all parts of Materialize, can mostly find panics and unexpected errors. See zippy for a sequential randomized tests which can verify correctness.
bin/mzcompose --find parallel-workload run default --runtime=1500 --scenario=0dt-deploy --threads=16 

Terraform + Helm Chart E2E on Azure failed, main history: :bk-status-failed::bk-status-failed::bk-status-failed::bk-status-failed::bk-status-failed:

[31mERROR[0m [2mmz_self_managed_debug[0m[2m:[0m self-managed-debug: fatal: failed to read kubeconfig from '"/kube/config"': No such file or directory (os error 2): No such file or directory (os error 2)
subprocess.CalledProcessError: Command '['terraform', 'apply', '-auto-approve']' returned non-zero exit status 1.
Test details & reproducer Tests the mz command line tool against a real Cloud instance
bin/mzcompose --find terraform run azure-temporary 
:pipeline:.buildkite/pipeline.sh start | buildkite-agent pipeline upload
Waited 2s
·
Ran in 1m 36s
:ios::detox: RN .76 + iOS: Tests appnvm install && ./scripts/ci.ios.sh
Canceled
Waited 2s
·
Ran in 1h 9m
:ios::detox: (Old Arch) RN .76 + iOS: Tests appnvm install && ./scripts/ci.ios.sh
Waited 3s
·
Ran in 26m 4s
:ios::detox: (Old Arch) RN .73 + iOS: Tests appnvm install && ./scripts/ci.ios.sh
Waited 1s
·
Ran in 27m 48s
:ios::react: RN .76 + iOS: Demo appnvm install && ./scripts/demo-projects.ios.sh
Waited 2s
·
Ran in 14m 3s
:android::detox: RN .76 + Android: Tests appnvm install && ./scripts/ci.android.sh
Waited 3s
·
Ran in 19m 0s
:android::detox: (Old Arch) RN .76 + Android: Tests appnvm install && ./scripts/ci.android.sh
Waited 2s
·
Ran in 20m 17s
:android::detox: (Old Arch) RN .73 + Android: Tests appnvm install && ./scripts/ci.android.sh
Waited 6s
·
Ran in 22m 13s
:android::react: RN .76 + Android: Demo appnvm install && ./scripts/demo-projects.android.sh
Waited 3s
·
Ran in 6m 6s
Build will continue even if previous stage fails
Post-processing: Test coveragenvm install && mkdir -p aggregated-coverage && buildkite-agent artifact download '**/*.lcov' aggregated-coverage && bash scripts/aggregate_coverage.sh
Canceled
Total Job Run Time: 3h 27m