Deploy

Public

Deploy Docker images and other packages

Deploy

#18336

main/62a440f496

Passed in 37m 30s

bin/ci-builder run nightly ci/deploy/devsite.sh

bin/ci-builder run stable bin/pyactivate -m ci....

Parker Timmerman

Created Mon 14th Apr at 8:07 PM

Triggered from Pipeline

Test - Build #102239 / Deploy

Parallel Workload (0dt deploy) (#2) failed, main history:

Unknown error in services.log:

parallel-workload-materialized2-1    | thread 'tokio:work-24' panicked at src/ore/src/collections.rs:145:17: duplicate cache entry (key: CacheKey { deploy_generation: 11, id: System(682), expr_type: Local }, old value: LocalVal { encoded_key: [11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 170, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], decoded_val: [2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 153, 2, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 50, 1, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 204, 1, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 205, 1, 0, 0, 0, 0, 0, 0, 15, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 198, 1, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 205, 1, 0, 0, 0, 0, 0, 0, 15, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 20, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 21, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 22, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 2, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 5, 0, 0, 0, 13, 0, 0, 0, 4, 0, 0, 0, 11, 0, 0, 0, 8, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 37, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 37, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 21, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 2, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 5, 0, 0, 0, 13, 0, 0, 0, 4, 0, 0, 0, 11, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 16, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 6, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 16, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1,

Unknown error in services.log:

parallel-workload-materialized2-1    | thread 'main' panicked at src/ore/src/collections.rs:145:17: duplicate cache entry (key: CacheKey { deploy_generation: 11, id: System(682), expr_type: Local }, old value: LocalVal { encoded_key: [11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 170, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], decoded_val: [2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 153, 2, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 50, 1, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 204, 1, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 205, 1, 0, 0, 0, 0, 0, 0, 15, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 198, 1, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 205, 1, 0, 0, 0, 0, 0, 0, 15, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 20, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 21, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 22, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 2, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 5, 0, 0, 0, 13, 0, 0, 0, 4, 0, 0, 0, 11, 0, 0, 0, 8, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 37, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 37, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 21, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 2, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 5, 0, 0, 0, 13, 0, 0, 0, 4, 0, 0, 0, 11, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 16, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 6, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 16, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1,

(45 occurrences)

Test details & reproducer

Runs a randomized parallel workload stressing all parts of Materialize, can mostly find panics and unexpected errors. See zippy for a sequential randomized tests which can verify correctness.

bin/mzcompose --find parallel-workload run default --runtime=1500 --scenario=0dt-deploy --threads=16

Feature benchmark against merge base or 'latest' 2 failed, main history:

Unknown error in Scenario 'OptbenchTPCHQ17':

New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723

NAME                                | TYPE            |      THIS       |      OTHER      |  UNIT  | THRESHOLD  |  Regression?  | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ17                     | wallclock       |    21987071.000 |    17712433.000 |   ns   |    20%     |    !!YES!!    | worse:  24.1% slower
OptbenchTPCHQ17                     | memory_mz       |         517.654 |         510.883 |   MB   |    20%     |      no       | worse:   1.3% more
OptbenchTPCHQ17                     | memory_clusterd |          40.674 |          41.246 |   MB   |    50%     |      no       | better:  1.4% less

Unknown error in Scenario 'InsertMultiRow':

New regression against v0.125.3

NAME                                | TYPE            |      THIS       |      OTHER      |  UNIT  | THRESHOLD  |  Regression?  | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
InsertMultiRow                      | wallclock       |           0.115 |           0.097 |   s    |    10%     |    !!YES!!    | worse:  18.1% slower
InsertMultiRow                      | memory_mz       |         551.319 |         523.186 |   MB   |    20%     |      no       | worse:   5.4% more
InsertMultiRow                      | memory_clusterd |          27.771 |          27.952 |   MB   |    50%     |      no       | better:  0.6% less

Unknown error in Scenario 'CrossJoin':

New regression against v0.125.3

NAME                                | TYPE            |      THIS       |      OTHER      |  UNIT  | THRESHOLD  |  Regression?  | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
CrossJoin                           | wallclock       |          31.926 |          25.803 |   s    |    10%     |    !!YES!!    | worse:  23.7% slower
CrossJoin                           | memory_mz       |         521.564 |         502.300 |   MB   |    20%     |      no       | worse:   3.8% more
CrossJoin                           | memory_clusterd |         120.640 |          77.724 |   MB   |    50%     |    !!YES!!    | worse:  55.2% more

Test details & reproducer

Simple benchmark of mostly individual queries using testdrive. Can find wallclock/memorys regressions in single-connection query executions, not suitable for concurrency.

BUILDKITE_PARALLEL_JOB=1 BUILDKITE_PARALLEL_JOB_COUNT=8 bin/mzcompose --find feature-benchmark run default --other-tag common-ancestor

Feature benchmark against merge base or 'latest' 1 failed, main history:

Unknown error in Scenario 'OptbenchTPCHQ19':

New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723

NAME                                | TYPE            |      THIS       |      OTHER      |  UNIT  | THRESHOLD  |  Regression?  | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ19                     | wallclock       |    24423753.000 |    18007343.000 |   ns   |    20%     |    !!YES!!    | worse:  35.6% slower
OptbenchTPCHQ19                     | memory_mz       |         510.693 |         517.654 |   MB   |    20%     |      no       | better:  1.3% less
OptbenchTPCHQ19                     | memory_clusterd |          39.616 |          40.073 |   MB   |    50%     |      no       | better:  1.1% less

Unknown error in Scenario 'OptbenchTPCHQ01':

New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723

NAME                                | TYPE            |      THIS       |      OTHER      |  UNIT  | THRESHOLD  |  Regression?  | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ01                     | wallclock       |     3625147.000 |     2797461.000 |   ns   |    20%     |    !!YES!!    | worse:  29.6% slower
OptbenchTPCHQ01                     | memory_mz       |         518.322 |         514.126 |   MB   |    20%     |      no       | worse:   0.8% more
OptbenchTPCHQ01                     | memory_clusterd |          45.614 |          39.864 |   MB   |    50%     |      no       | worse:  14.4% more

Unknown error in Scenario 'OptbenchTPCHQ16':

New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723

NAME                                | TYPE            |      THIS       |      OTHER      |  UNIT  | THRESHOLD  |  Regression?  | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ16                     | wallclock       |    17537408.000 |    13544566.000 |   ns   |    20%     |    !!YES!!    | worse:  29.5% slower
OptbenchTPCHQ16                     | memory_mz       |         521.469 |         517.082 |   MB   |    20%     |      no       | worse:   0.8% more
OptbenchTPCHQ16                     | memory_clusterd |          40.016 |          40.359 |   MB   |    50%     |      no       | better:  0.9% less

Test details & reproducer

Simple benchmark of mostly individual queries using testdrive. Can find wallclock/memorys regressions in single-connection query executions, not suitable for concurrency.

BUILDKITE_PARALLEL_JOB=0 BUILDKITE_PARALLEL_JOB_COUNT=8 bin/mzcompose --find feature-benchmark run default --other-tag common-ancestor

Feature benchmark against merge base or 'latest' 8 failed, main history:

Unknown error in Scenario 'OptbenchTPCHQ03':

New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723

NAME                                | TYPE            |      THIS       |      OTHER      |  UNIT  | THRESHOLD  |  Regression?  | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ03                     | wallclock       |     7472032.000 |     6053262.000 |   ns   |    20%     |    !!YES!!    | worse:  23.4% slower
OptbenchTPCHQ03                     | memory_mz       |         515.747 |         510.311 |   MB   |    20%     |      no       | worse:   1.1% more
OptbenchTPCHQ03                     | memory_clusterd |          39.988 |          40.312 |   MB   |    50%     |      no       | better:  0.8% less

Test details & reproducer

Simple benchmark of mostly individual queries using testdrive. Can find wallclock/memorys regressions in single-connection query executions, not suitable for concurrency.

BUILDKITE_PARALLEL_JOB=7 BUILDKITE_PARALLEL_JOB_COUNT=8 bin/mzcompose --find feature-benchmark run default --other-tag common-ancestor

Feature benchmark against merge base or 'latest' 3 failed, main history:

Unknown error in Scenario 'OptbenchTPCHQ22':

New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723

NAME                                | TYPE            |      THIS       |      OTHER      |  UNIT  | THRESHOLD  |  Regression?  | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ22                     | wallclock       |    31592094.000 |    23309540.000 |   ns   |    20%     |    !!YES!!    | worse:  35.5% slower
OptbenchTPCHQ22                     | memory_mz       |         521.851 |         519.180 |   MB   |    20%     |      no       | worse:   0.5% more
OptbenchTPCHQ22                     | memory_clusterd |          40.426 |          39.711 |   MB   |    50%     |      no       | worse:   1.8% more

Unknown error in Scenario 'OptbenchTPCHQ18':

New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723

NAME                                | TYPE            |      THIS       |      OTHER      |  UNIT  | THRESHOLD  |  Regression?  | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ18                     | wallclock       |    17668062.000 |    13936993.000 |   ns   |    20%     |    !!YES!!    | worse:  26.8% slower
OptbenchTPCHQ18                     | memory_mz       |         518.227 |         510.025 |   MB   |    20%     |      no       | worse:   1.6% more
OptbenchTPCHQ18                     | memory_clusterd |          40.188 |          40.035 |   MB   |    50%     |      no       | worse:   0.4% more

Test details & reproducer

Simple benchmark of mostly individual queries using testdrive. Can find wallclock/memorys regressions in single-connection query executions, not suitable for concurrency.

BUILDKITE_PARALLEL_JOB=2 BUILDKITE_PARALLEL_JOB_COUNT=8 bin/mzcompose --find feature-benchmark run default --other-tag common-ancestor

Feature benchmark against merge base or 'latest' 6 failed, main history:

Unknown error in Scenario 'OptbenchTPCHQ21':

New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723

NAME                                | TYPE            |      THIS       |      OTHER      |  UNIT  | THRESHOLD  |  Regression?  | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ21                     | wallclock       |    36719613.000 |    29338652.000 |   ns   |    20%     |    !!YES!!    | worse:  25.2% slower
OptbenchTPCHQ21                     | memory_mz       |         522.232 |         515.175 |   MB   |    20%     |      no       | worse:   1.4% more
OptbenchTPCHQ21                     | memory_clusterd |          39.902 |          41.122 |   MB   |    50%     |      no       | better:  3.0% less

Unknown error in Scenario 'OptbenchTPCHQ12':

New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723

NAME                                | TYPE            |      THIS       |      OTHER      |  UNIT  | THRESHOLD  |  Regression?  | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ12                     | wallclock       |     6363261.000 |     4931313.000 |   ns   |    20%     |    !!YES!!    | worse:  29.0% slower
OptbenchTPCHQ12                     | memory_mz       |         520.420 |         518.036 |   MB   |    20%     |      no       | worse:   0.5% more
OptbenchTPCHQ12                     | memory_clusterd |          40.092 |          40.560 |   MB   |    50%     |      no       | better:  1.2% less

Test details & reproducer

Simple benchmark of mostly individual queries using testdrive. Can find wallclock/memorys regressions in single-connection query executions, not suitable for concurrency.

BUILDKITE_PARALLEL_JOB=5 BUILDKITE_PARALLEL_JOB_COUNT=8 bin/mzcompose --find feature-benchmark run default --other-tag common-ancestor

Feature benchmark against merge base or 'latest' 7 failed, main history:

Unknown error in Scenario 'OptbenchTPCHQ04':

New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723

NAME                                | TYPE            |      THIS       |      OTHER      |  UNIT  | THRESHOLD  |  Regression?  | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ04                     | wallclock       |     8977025.000 |     7086429.000 |   ns   |    20%     |    !!YES!!    | worse:  26.7% slower
OptbenchTPCHQ04                     | memory_mz       |         517.178 |         511.837 |   MB   |    20%     |      no       | worse:   1.0% more
OptbenchTPCHQ04                     | memory_clusterd |          40.894 |          40.331 |   MB   |    50%     |      no       | worse:   1.4% more

Unknown error in Scenario 'OptbenchTPCHQ14':

New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723

NAME                                | TYPE            |      THIS       |      OTHER      |  UNIT  | THRESHOLD  |  Regression?  | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ14                     | wallclock       |     7515716.000 |     6029370.000 |   ns   |    20%     |    !!YES!!    | worse:  24.7% slower
OptbenchTPCHQ14                     | memory_mz       |         518.322 |         512.123 |   MB   |    20%     |      no       | worse:   1.2% more
OptbenchTPCHQ14                     | memory_clusterd |          40.083 |          39.921 |   MB   |    50%     |      no       | worse:   0.4% more

Test details & reproducer

Simple benchmark of mostly individual queries using testdrive. Can find wallclock/memorys regressions in single-connection query executions, not suitable for concurrency.

BUILDKITE_PARALLEL_JOB=6 BUILDKITE_PARALLEL_JOB_COUNT=8 bin/mzcompose --find feature-benchmark run default --other-tag common-ancestor

Feature benchmark against merge base or 'latest' 5 failed, main history:

Unknown error in Scenario 'OptbenchTPCHQ20':

New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723

NAME                                | TYPE            |      THIS       |      OTHER      |  UNIT  | THRESHOLD  |  Regression?  | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ20                     | wallclock       |    27193533.000 |    21062541.000 |   ns   |    20%     |    !!YES!!    | worse:  29.1% slower
OptbenchTPCHQ20                     | memory_mz       |         518.417 |         515.175 |   MB   |    20%     |      no       | worse:   0.6% more
OptbenchTPCHQ20                     | memory_clusterd |          39.444 |          40.760 |   MB   |    50%     |      no       | better:  3.2% less

Unknown error in Scenario 'OptbenchTPCHQ13':

New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723

NAME                                | TYPE            |      THIS       |      OTHER      |  UNIT  | THRESHOLD  |  Regression?  | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ13                     | wallclock       |     9373563.000 |     6931694.000 |   ns   |    20%     |    !!YES!!    | worse:  35.2% slower
OptbenchTPCHQ13                     | memory_mz       |         516.224 |         504.494 |   MB   |    20%     |      no       | worse:   2.3% more
OptbenchTPCHQ13                     | memory_clusterd |          40.369 |          40.073 |   MB   |    50%     |      no       | worse:   0.7% more

Unknown error in Scenario 'OptbenchTPCHQ06':

New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723

NAME                                | TYPE            |      THIS       |      OTHER      |  UNIT  | THRESHOLD  |  Regression?  | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ06                     | wallclock       |     4002865.000 |     3287437.000 |   ns   |    20%     |    !!YES!!    | worse:  21.8% slower
OptbenchTPCHQ06                     | memory_mz       |         500.965 |         513.649 |   MB   |    20%     |      no       | better:  2.5% less
OptbenchTPCHQ06                     | memory_clusterd |          40.016 |          40.035 |   MB   |    50%     |      no       | better:  0.0% less

Test details & reproducer

Simple benchmark of mostly individual queries using testdrive. Can find wallclock/memorys regressions in single-connection query executions, not suitable for concurrency.

BUILDKITE_PARALLEL_JOB=4 BUILDKITE_PARALLEL_JOB_COUNT=8 bin/mzcompose --find feature-benchmark run default --other-tag common-ancestor

RQG dbt3-joins workload failed, main history:

Unknown error in workflow-default:

Docker compose failed: docker compose -f/dev/fd/3 --project-directory /var/lib/buildkite-agent/builds/hetzner-aarch64-16cpu-32gb-96681929/materialize/nightly/test/rqg exec -T rqg perl gentest.pl --seed=0193702d-2f3f-48f9-9853-8dad091013e5 --dsn1=dbi:Pg:dbname=materialize;host=mz_this;user=materialize;port=6875 --dsn2=dbi:Pg:dbname=postgres;host=postgres;user=postgres;password=postgres --grammar=conf/mz/dbt3-joins.yy --queries=100000000 --threads=4 --duration=1800 --validator=ResultsetComparatorSimplify

Test details & reproducer

Test Materialize with the Random Query Generator (grammar-based): https://github.com/MaterializeInc/RQG/ Can find query errors and panics, but not correctness.

bin/mzcompose --find rqg run default dbt3-joins --seed=0193702d-2f3f-48f9-9853-8dad091013e5

Parallel Workload (0dt deploy) failed, main history:

Potential regression panic: assertion failed: (left == right): invalid upsert state (#6489, closed) in services.log:

parallel-workload-materialized2-1    | thread 'timely:work-0' panicked at src/storage/src/upsert/types.rs:751:30: invalid upsert state: non 0/1 diff_sum: 2, state: Consolidating { len_sum: 22, checksum_sum: -5696480674036577238, diff_sum: -5696480674036577238, .. }

Unknown error in services.log:

parallel-workload-materialized2-1    | thread 'coordinator' panicked at src/adapter/src/coord.rs:3999:22: failed to initialize storage_controller: Durable(Fence(DeployGeneration { current_generation: 9, fence_generation: 10 }))

Unknown error in workflow-default:

psycopg.OperationalError: connection failed: connection to server at "127.0.0.1", port 7075 failed: server closed the connection unexpectedly  This probably means the server terminated abnormally  before or while processing the request.

Test details & reproducer

Runs a randomized parallel workload stressing all parts of Materialize, can mostly find panics and unexpected errors. See zippy for a sequential randomized tests which can verify correctness.

bin/mzcompose --find parallel-workload run default --runtime=1500 --scenario=0dt-deploy --threads=16

bin/ci-builder run min bin/pyactivate -m ci.mkpipeline deploy "$@"

Ran in 1m 11s

bin/ci-builder run nightly ci/deploy/devsite.shbin/ci-builder run nightly ci/deploy/devsite.sh

Ran in 14m 27s

bin/ci-builder run stable bin/pyactivate -m ci....bin/ci-builder run stable bin/pyactivate -m ci.deploy.docker

Ran in 56s

bin/ci-builder run stable bin/pyactivate -m ci....bin/ci-builder run stable bin/pyactivate -m ci.deploy.pypi

Ran in 2s

bin/ci-builder run stable bin/pyactivate -m ci....bin/ci-builder run stable bin/pyactivate -m ci.deploy.npm

Ran in 4m 0s

Total Job Run Time: 20m 36s