Nightly
PublicTests that are too slow or non-deterministic for the regular Test pipeline
Scheduled build
Failed in 7h 31m
Miri test (full)Parallel Workload (0dt deploy) (#2) failed, main history: 
parallel-workload-materialized2-1 | thread 'tokio:work-24' panicked at src/ore/src/collections.rs:145:17: duplicate cache entry (key: CacheKey { deploy_generation: 11, id: System(682), expr_type: Local }, old value: LocalVal { encoded_key: [11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 170, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], decoded_val: [2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 153, 2, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 50, 1, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 204, 1, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 205, 1, 0, 0, 0, 0, 0, 0, 15, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 198, 1, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 205, 1, 0, 0, 0, 0, 0, 0, 15, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 20, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 21, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 22, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 2, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 5, 0, 0, 0, 13, 0, 0, 0, 4, 0, 0, 0, 11, 0, 0, 0, 8, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 37, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 37, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 21, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 2, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 5, 0, 0, 0, 13, 0, 0, 0, 4, 0, 0, 0, 11, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 16, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 6, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 16, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1,
parallel-workload-materialized2-1 | thread 'main' panicked at src/ore/src/collections.rs:145:17: duplicate cache entry (key: CacheKey { deploy_generation: 11, id: System(682), expr_type: Local }, old value: LocalVal { encoded_key: [11, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 170, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], decoded_val: [2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 153, 2, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 50, 1, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 204, 1, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 205, 1, 0, 0, 0, 0, 0, 0, 15, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 198, 1, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 205, 1, 0, 0, 0, 0, 0, 0, 15, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 20, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 21, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 22, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 2, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 5, 0, 0, 0, 13, 0, 0, 0, 4, 0, 0, 0, 11, 0, 0, 0, 8, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 37, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 37, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 21, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 9, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 2, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 5, 0, 0, 0, 13, 0, 0, 0, 4, 0, 0, 0, 11, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 16, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 0, 0, 0, 6, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 7, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 16, 0, 0, 0, 0, 0, 0, 0, 13, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 1, 21, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 26, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 18, 0, 0, 0, 0, 23, 0, 0, 0, 34, 0, 0, 0, 0, 18, 0, 0, 0, 1, 18, 0, 0, 0, 1, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1,
(45 occurrences)
Test details & reproducer
Runs a randomized parallel workload stressing all parts of Materialize, can mostly find panics and unexpected errors. See zippy for a sequential randomized tests which can verify correctness.bin/mzcompose --find parallel-workload run default --runtime=1500 --scenario=0dt-deploy --threads=16
Feature benchmark against merge base or 'latest' 2 failed, main history:
- Unknown error in Scenario 'OptbenchTPCHQ17':
New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723
NAME | TYPE | THIS | OTHER | UNIT | THRESHOLD | Regression? | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ17 | wallclock | 21987071.000 | 17712433.000 | ns | 20% | !!YES!! | worse: 24.1% slower
OptbenchTPCHQ17 | memory_mz | 517.654 | 510.883 | MB | 20% | no | worse: 1.3% more
OptbenchTPCHQ17 | memory_clusterd | 40.674 | 41.246 | MB | 50% | no | better: 1.4% less
- Unknown error in Scenario 'InsertMultiRow':
New regression against v0.125.3
NAME | TYPE | THIS | OTHER | UNIT | THRESHOLD | Regression? | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
InsertMultiRow | wallclock | 0.115 | 0.097 | s | 10% | !!YES!! | worse: 18.1% slower
InsertMultiRow | memory_mz | 551.319 | 523.186 | MB | 20% | no | worse: 5.4% more
InsertMultiRow | memory_clusterd | 27.771 | 27.952 | MB | 50% | no | better: 0.6% less
- Unknown error in Scenario 'CrossJoin':
New regression against v0.125.3
NAME | TYPE | THIS | OTHER | UNIT | THRESHOLD | Regression? | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
CrossJoin | wallclock | 31.926 | 25.803 | s | 10% | !!YES!! | worse: 23.7% slower
CrossJoin | memory_mz | 521.564 | 502.300 | MB | 20% | no | worse: 3.8% more
CrossJoin | memory_clusterd | 120.640 | 77.724 | MB | 50% | !!YES!! | worse: 55.2% more
Test details & reproducer
Simple benchmark of mostly individual queries using testdrive. Can find wallclock/memorys regressions in single-connection query executions, not suitable for concurrency.BUILDKITE_PARALLEL_JOB=1 BUILDKITE_PARALLEL_JOB_COUNT=8 bin/mzcompose --find feature-benchmark run default --other-tag common-ancestor
Feature benchmark against merge base or 'latest' 1 failed, main history:
- Unknown error in Scenario 'OptbenchTPCHQ19':
New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723
NAME | TYPE | THIS | OTHER | UNIT | THRESHOLD | Regression? | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ19 | wallclock | 24423753.000 | 18007343.000 | ns | 20% | !!YES!! | worse: 35.6% slower
OptbenchTPCHQ19 | memory_mz | 510.693 | 517.654 | MB | 20% | no | better: 1.3% less
OptbenchTPCHQ19 | memory_clusterd | 39.616 | 40.073 | MB | 50% | no | better: 1.1% less
- Unknown error in Scenario 'OptbenchTPCHQ01':
New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723
NAME | TYPE | THIS | OTHER | UNIT | THRESHOLD | Regression? | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ01 | wallclock | 3625147.000 | 2797461.000 | ns | 20% | !!YES!! | worse: 29.6% slower
OptbenchTPCHQ01 | memory_mz | 518.322 | 514.126 | MB | 20% | no | worse: 0.8% more
OptbenchTPCHQ01 | memory_clusterd | 45.614 | 39.864 | MB | 50% | no | worse: 14.4% more
- Unknown error in Scenario 'OptbenchTPCHQ16':
New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723
NAME | TYPE | THIS | OTHER | UNIT | THRESHOLD | Regression? | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ16 | wallclock | 17537408.000 | 13544566.000 | ns | 20% | !!YES!! | worse: 29.5% slower
OptbenchTPCHQ16 | memory_mz | 521.469 | 517.082 | MB | 20% | no | worse: 0.8% more
OptbenchTPCHQ16 | memory_clusterd | 40.016 | 40.359 | MB | 50% | no | better: 0.9% less
Test details & reproducer
Simple benchmark of mostly individual queries using testdrive. Can find wallclock/memorys regressions in single-connection query executions, not suitable for concurrency.BUILDKITE_PARALLEL_JOB=0 BUILDKITE_PARALLEL_JOB_COUNT=8 bin/mzcompose --find feature-benchmark run default --other-tag common-ancestor
Feature benchmark against merge base or 'latest' 8 failed, main history:
- Unknown error in Scenario 'OptbenchTPCHQ03':
New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723
NAME | TYPE | THIS | OTHER | UNIT | THRESHOLD | Regression? | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ03 | wallclock | 7472032.000 | 6053262.000 | ns | 20% | !!YES!! | worse: 23.4% slower
OptbenchTPCHQ03 | memory_mz | 515.747 | 510.311 | MB | 20% | no | worse: 1.1% more
OptbenchTPCHQ03 | memory_clusterd | 39.988 | 40.312 | MB | 50% | no | better: 0.8% less
Test details & reproducer
Simple benchmark of mostly individual queries using testdrive. Can find wallclock/memorys regressions in single-connection query executions, not suitable for concurrency.BUILDKITE_PARALLEL_JOB=7 BUILDKITE_PARALLEL_JOB_COUNT=8 bin/mzcompose --find feature-benchmark run default --other-tag common-ancestor
Feature benchmark against merge base or 'latest' 3 failed, main history:
- Unknown error in Scenario 'OptbenchTPCHQ22':
New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723
NAME | TYPE | THIS | OTHER | UNIT | THRESHOLD | Regression? | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ22 | wallclock | 31592094.000 | 23309540.000 | ns | 20% | !!YES!! | worse: 35.5% slower
OptbenchTPCHQ22 | memory_mz | 521.851 | 519.180 | MB | 20% | no | worse: 0.5% more
OptbenchTPCHQ22 | memory_clusterd | 40.426 | 39.711 | MB | 50% | no | worse: 1.8% more
- Unknown error in Scenario 'OptbenchTPCHQ18':
New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723
NAME | TYPE | THIS | OTHER | UNIT | THRESHOLD | Regression? | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ18 | wallclock | 17668062.000 | 13936993.000 | ns | 20% | !!YES!! | worse: 26.8% slower
OptbenchTPCHQ18 | memory_mz | 518.227 | 510.025 | MB | 20% | no | worse: 1.6% more
OptbenchTPCHQ18 | memory_clusterd | 40.188 | 40.035 | MB | 50% | no | worse: 0.4% more
Test details & reproducer
Simple benchmark of mostly individual queries using testdrive. Can find wallclock/memorys regressions in single-connection query executions, not suitable for concurrency.BUILDKITE_PARALLEL_JOB=2 BUILDKITE_PARALLEL_JOB_COUNT=8 bin/mzcompose --find feature-benchmark run default --other-tag common-ancestor
Feature benchmark against merge base or 'latest' 6 failed, main history:
- Unknown error in Scenario 'OptbenchTPCHQ21':
New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723
NAME | TYPE | THIS | OTHER | UNIT | THRESHOLD | Regression? | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ21 | wallclock | 36719613.000 | 29338652.000 | ns | 20% | !!YES!! | worse: 25.2% slower
OptbenchTPCHQ21 | memory_mz | 522.232 | 515.175 | MB | 20% | no | worse: 1.4% more
OptbenchTPCHQ21 | memory_clusterd | 39.902 | 41.122 | MB | 50% | no | better: 3.0% less
- Unknown error in Scenario 'OptbenchTPCHQ12':
New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723
NAME | TYPE | THIS | OTHER | UNIT | THRESHOLD | Regression? | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ12 | wallclock | 6363261.000 | 4931313.000 | ns | 20% | !!YES!! | worse: 29.0% slower
OptbenchTPCHQ12 | memory_mz | 520.420 | 518.036 | MB | 20% | no | worse: 0.5% more
OptbenchTPCHQ12 | memory_clusterd | 40.092 | 40.560 | MB | 50% | no | better: 1.2% less
Test details & reproducer
Simple benchmark of mostly individual queries using testdrive. Can find wallclock/memorys regressions in single-connection query executions, not suitable for concurrency.BUILDKITE_PARALLEL_JOB=5 BUILDKITE_PARALLEL_JOB_COUNT=8 bin/mzcompose --find feature-benchmark run default --other-tag common-ancestor
Feature benchmark against merge base or 'latest' 7 failed, main history:
- Unknown error in Scenario 'OptbenchTPCHQ04':
New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723
NAME | TYPE | THIS | OTHER | UNIT | THRESHOLD | Regression? | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ04 | wallclock | 8977025.000 | 7086429.000 | ns | 20% | !!YES!! | worse: 26.7% slower
OptbenchTPCHQ04 | memory_mz | 517.178 | 511.837 | MB | 20% | no | worse: 1.0% more
OptbenchTPCHQ04 | memory_clusterd | 40.894 | 40.331 | MB | 50% | no | worse: 1.4% more
- Unknown error in Scenario 'OptbenchTPCHQ14':
New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723
NAME | TYPE | THIS | OTHER | UNIT | THRESHOLD | Regression? | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ14 | wallclock | 7515716.000 | 6029370.000 | ns | 20% | !!YES!! | worse: 24.7% slower
OptbenchTPCHQ14 | memory_mz | 518.322 | 512.123 | MB | 20% | no | worse: 1.2% more
OptbenchTPCHQ14 | memory_clusterd | 40.083 | 39.921 | MB | 50% | no | worse: 0.4% more
Test details & reproducer
Simple benchmark of mostly individual queries using testdrive. Can find wallclock/memorys regressions in single-connection query executions, not suitable for concurrency.BUILDKITE_PARALLEL_JOB=6 BUILDKITE_PARALLEL_JOB_COUNT=8 bin/mzcompose --find feature-benchmark run default --other-tag common-ancestor
Feature benchmark against merge base or 'latest' 5 failed, main history:
- Unknown error in Scenario 'OptbenchTPCHQ20':
New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723
NAME | TYPE | THIS | OTHER | UNIT | THRESHOLD | Regression? | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ20 | wallclock | 27193533.000 | 21062541.000 | ns | 20% | !!YES!! | worse: 29.1% slower
OptbenchTPCHQ20 | memory_mz | 518.417 | 515.175 | MB | 20% | no | worse: 0.6% more
OptbenchTPCHQ20 | memory_clusterd | 39.444 | 40.760 | MB | 50% | no | better: 3.2% less
- Unknown error in Scenario 'OptbenchTPCHQ13':
New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723
NAME | TYPE | THIS | OTHER | UNIT | THRESHOLD | Regression? | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ13 | wallclock | 9373563.000 | 6931694.000 | ns | 20% | !!YES!! | worse: 35.2% slower
OptbenchTPCHQ13 | memory_mz | 516.224 | 504.494 | MB | 20% | no | worse: 2.3% more
OptbenchTPCHQ13 | memory_clusterd | 40.369 | 40.073 | MB | 50% | no | worse: 0.7% more
- Unknown error in Scenario 'OptbenchTPCHQ06':
New regression against v0.126.0-dev.0--main.g6981cb35f6a64748293867beb67e74b804f9e723
NAME | TYPE | THIS | OTHER | UNIT | THRESHOLD | Regression? | 'THIS' is
--------------------------------------------------------------------------------------------------------------------------------------------------------
OptbenchTPCHQ06 | wallclock | 4002865.000 | 3287437.000 | ns | 20% | !!YES!! | worse: 21.8% slower
OptbenchTPCHQ06 | memory_mz | 500.965 | 513.649 | MB | 20% | no | better: 2.5% less
OptbenchTPCHQ06 | memory_clusterd | 40.016 | 40.035 | MB | 50% | no | better: 0.0% less
Test details & reproducer
Simple benchmark of mostly individual queries using testdrive. Can find wallclock/memorys regressions in single-connection query executions, not suitable for concurrency.BUILDKITE_PARALLEL_JOB=4 BUILDKITE_PARALLEL_JOB_COUNT=8 bin/mzcompose --find feature-benchmark run default --other-tag common-ancestor
RQG dbt3-joins workload failed, main history:
- Unknown error in workflow-default:
Docker compose failed: docker compose -f/dev/fd/3 --project-directory /var/lib/buildkite-agent/builds/hetzner-aarch64-16cpu-32gb-96681929/materialize/nightly/test/rqg exec -T rqg perl gentest.pl --seed=0193702d-2f3f-48f9-9853-8dad091013e5 --dsn1=dbi:Pg:dbname=materialize;host=mz_this;user=materialize;port=6875 --dsn2=dbi:Pg:dbname=postgres;host=postgres;user=postgres;password=postgres --grammar=conf/mz/dbt3-joins.yy --queries=100000000 --threads=4 --duration=1800 --validator=ResultsetComparatorSimplify
Test details & reproducer
Test Materialize with the Random Query Generator (grammar-based): https://github.com/MaterializeInc/RQG/ Can find query errors and panics, but not correctness.bin/mzcompose --find rqg run default dbt3-joins --seed=0193702d-2f3f-48f9-9853-8dad091013e5
Parallel Workload (0dt deploy) failed, main history:
- Potential regression panic: assertion failed: (left == right): invalid upsert state (#6489, closed) in services.log:
parallel-workload-materialized2-1 | thread 'timely:work-0' panicked at src/storage/src/upsert/types.rs:751:30: invalid upsert state: non 0/1 diff_sum: 2, state: Consolidating { len_sum: 22, checksum_sum: -5696480674036577238, diff_sum: -5696480674036577238, .. }
parallel-workload-materialized2-1 | thread 'coordinator' panicked at src/adapter/src/coord.rs:3999:22: failed to initialize storage_controller: Durable(Fence(DeployGeneration { current_generation: 9, fence_generation: 10 }))
- Unknown error in workflow-default:
psycopg.OperationalError: connection failed: connection to server at "127.0.0.1", port 7075 failed: server closed the connection unexpectedly This probably means the server terminated abnormally before or while processing the request.
Test details & reproducer
Runs a randomized parallel workload stressing all parts of Materialize, can mostly find panics and unexpected errors. See zippy for a sequential randomized tests which can verify correctness.bin/mzcompose --find parallel-workload run default --runtime=1500 --scenario=0dt-deploy --threads=16
Detect references to already closed issuesbin/ci-builder run stable bin/ci-closed-issues-detect
Waited 10s
Ran in 1m 6s
Total Job Run Time: 3d 23h