[2026-11-03 02:02:04] === Setup env script [Stateless tests (amd_asan_ubsan, distributed plan, parallel, selected tests)], workflow [PR] === [2026-11-03 02:02:04] Run command: [. ./ci/tmp/praktika_setup_env.sh] [2026-11-03 02:02:04] Read GH Environment from workflow data [2026-11-03 02:02:04] _Environment(WORKFLOW_NAME='PR', JOB_NAME='Stateless tests (amd_asan_ubsan, distributed plan, parallel, selected tests)', REPOSITORY='Altinity/ClickHouse', BRANCH='backports/antalya-26.8/115817', SHA='93a0eb76cad0173884e89826c27200879de038ec', PR_NUMBER=2758, EVENT_TYPE='pull_request', EVENT_TIME='2026-11-03T00:56:47Z', JOB_OUTPUT_STREAM='/home/ubuntu/_work/_temp/_runner_file_commands/set_output_ed526a3f-00af-4176-97c4-d62a5d9e0bfe', EVENT_FILE_PATH='/home/ubuntu/_work/_temp/_github_workflow/event.json', CHANGE_URL='https://github.com/Altinity/ClickHouse/pull/2758', COMMIT_URL='https://github.com/Altinity/ClickHouse/pull/2758/commits/93a0eb76cad0173884e89826c27200879de038ec', BASE_BRANCH='antalya-26.8', RUN_ID='41556417822', RUN_URL='https://github.com/Altinity/ClickHouse/actions/runs/41556417822', INSTANCE_TYPE='altinity-self-hosted', INSTANCE_ID='altinity-self-hosted', INSTANCE_LIFE_CYCLE='altinity-self-hosted', PR_BODY='### Changelog category (leave one):\r\n- New Feature\r\n- Experimental Feature\r\n- Improvement\r\n- Performance Improvement\r\n- Backward Incompatible Change\r\n- Build/Testing/Packaging Improvement\r\n- Documentation (changelog entry is not required)\r\n- Critical Bug Fix (crash, data loss, RBAC)\r\n- Bug Fix (user-visible misbehavior in an official stable release)\r\n- CI Fix or Improvement (changelog entry is not required)\r\n- Not for changelog (changelog entry is not required)\r\n\r\n\r\n### Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):\r\n...\r\n\r\n### Documentation entry for user-facing changes\r\n...\r\n\r\n### CI/CD Options\r\n#### Exclude tests:\r\n- [ ] Fast test\r\n- [ ] Integration Tests\r\n- [ ] Stateless tests\r\n- [ ] Stateful tests\r\n- [ ] Unit tests\r\n- [ ] Performance tests\r\n- [x] Aarch64 tests\r\n- [ ] All with ASAN\r\n- [x] All with TSAN\r\n- [x] All with MSAN\r\n- [ ] All with UBSAN\r\n- [x] All with Coverage\r\n- [ ] All Regression\r\n- [ ] Disable CI Cache\r\n\r\n#### Regression jobs to run:\r\n- [x] Fast suites (mostly <1h)\r\n- [x] Aggregate Functions (2h)\r\n- [x] Alter (1.5h)\r\n- [x] Benchmark (30m)\r\n- [x] CAS (content-addressed storage; Antalya only)\r\n- [x] ClickHouse Keeper (1h)\r\n- [x] Iceberg (2h)\r\n- [x] LDAP (1h)\r\n- [x] OAuth (5m)\r\n- [x] Parquet (1.5h)\r\n- [x] RBAC (1.5h)\r\n- [x] SSL Server (1h)\r\n- [x] S3 (2h)\r\n- [x] S3 Export (2h)\r\n- [x] Swarms (30m)\r\n- [x] Tiered Storage (2h)\r\n', PR_TITLE='Parallelize iceberg data manifest decoding', USER_LOGIN='subkanthi', FORK_NAME='Altinity/ClickHouse', COMMIT_MESSAGE='', EVENT_ACTION='synchronize', LINKED_PR_NUMBER=0, LOCAL_RUN=False, PR_LABELS=[], REPORT_MESSAGES=[], JOB_CONFIG=Stateless tests (amd_asan_ubsan, distributed plan, parallel, selected tests), TRACEBACKS=[], WORKFLOW_JOB_DATA={'check_run_id': 125679160668, 'workflow_ref': 'Altinity/ClickHouse/.github/workflows/pull_request.yml@refs/pull/2758/merge', 'workflow_sha': '1fbcb015cfa4aa38542b3791d48db19e069bac58', 'workflow_repository': 'Altinity/ClickHouse', 'workflow_file_path': '.github/workflows/pull_request.yml', 'status': 'success'}, JOB_KV_DATA={'commit_authors': [], 'parent_pr_number': 0, 'changed_files': ['src/Common/ProfileEvents.cpp', 'src/Core/Settings.cpp', 'src/Core/SettingsChangesHistory.cpp', 'src/Storages/ObjectStorage/DataLakes/Iceberg/Constant.h', 'src/Storages/ObjectStorage/DataLakes/Iceberg/IcebergIterator.cpp', 'src/Storages/ObjectStorage/DataLakes/Iceberg/IcebergIterator.h', 'src/Storages/ObjectStorage/DataLakes/Iceberg/IcebergMetadata.cpp', 'src/Storages/ObjectStorage/DataLakes/Iceberg/IcebergMetadata.h', 'src/Storages/ObjectStorage/DataLakes/Iceberg/IcebergMetadataFilesCache.h', 'src/Storages/ObjectStorage/DataLakes/Iceberg/ManifestFile.h', 'src/Storages/ObjectStorage/DataLakes/Iceberg/ManifestFileIterator.cpp', 'src/Storages/ObjectStorage/DataLakes/Iceberg/ManifestFileIterator.h', 'src/Storages/ObjectStorage/DataLakes/Iceberg/ManifestFilesPruning.cpp', 'src/Storages/ObjectStorage/DataLakes/Iceberg/ManifestFilesPruning.h', 'src/Storages/ObjectStorage/DataLakes/Iceberg/ManifestListPruning.cpp', 'src/Storages/ObjectStorage/DataLakes/Iceberg/ManifestListPruning.h', 'src/Storages/ObjectStorage/DataLakes/Iceberg/Snapshot.h', 'src/Storages/ObjectStorage/DataLakes/Iceberg/StatelessMetadataFileGetter.cpp', 'tests/integration/test_storage_iceberg_with_spark/test_manifest_list_partition_pruning.py', 'tests/queries/0_stateless/05045_iceberg_manifest_partition_arity.reference', 'tests/queries/0_stateless/05045_iceberg_manifest_partition_arity.sh'], 'settings_history_changed_settings': [{'namespace': 'Session', 'name': 'use_iceberg_manifest_list_partition_pruning'}], 'build_digest': 'c17995ced07709c4923a', 'master_commits': ['{"message":"Not Found","documentation_url":"https://docs.github.com/rest/commits/commits#list-commits","status":"404"}'], 'merge_base_commit_sha': '0c206c66f06f5cebffd8f908ab00767ef6055958', 'master_track_commits_sha': ['a7561812f25ef22d59a6b3b411d7b636674979f1', 'fc6d4404b640140fe27cb3f19f4f9e39b9184d77', 'd6fa825257838da9902bdfdf641585930699ee0a', 'de6cbffee20f7c2aa3e11ca2eddc321435b410dc', '2c11597354e74df6358c31dedba82faeb946793a', '36a658f6388a9f8f5e50d36ffdb573876dd27cb5', 'd8d64d936e2a08807abaaebf3ac9619e1e74390c', '003a998407bbcafb25e67a277dd746bf43bc3569', '0d44895dcc58a3f2e4986da837a70b02f2b65961', 'f56ba9281706b16554b7c123e8248b55cf3db0e9', '08370bad95c267fd2d9da3f0f1cdbfbd861a843f', 'f978f73a607650018e42c4fffb6cc3822a1ebb87', 'fe37002a614379da6965d153158b16f00911956b', 'a2f1c1a598af08cd0f93299b55ef17a22828bfc7', 'ff996441057bd00dc246463c73f9599ef184b6c0', '57cf1603f6fdcf0a2370cdfd750ccd631bbe3bd8', 'e7a185431bc585d843575402c69d58c9eee66afc', '248a853455d3a5135a9d16099e3699da2798a613', 'f34df5245bd984421ff80f2afa5951b49cad5cbe', '5a049599fd5e6c13de0a7786fd36895f9c9a877d', '05fd3f6734ad790c937df3aed3bbf35135fe634b', 'ca0bd2cbbf7d40808286e1bd9188df72e9625616', '4cc5558ff27d4fac88ba470525e9081106e712cd', '18d0a55f378f28ad3a7fe96e15df022f7d969b31', '58e3edd4f58c39b5edfbd53b9377cf340ad23f7c', '2f37e86c9745c69f64aaabd915143d3c506f6665', 'ec70972c20f0bd8dfecac1a162fb7fff4fef3d27', '6d31165544be9abd7ac4bcf00904ce45d2f412d9', '17bdc1bbd3f9518c918e2520975d21d576a56bab', 'ab9c4003d72ad373f88f9695b4ceb7845a919b7a', '16bf984e9a9b6a3ac799172400c720be59a5bbc0', '3b0a212f4cb9c7c8b92f3b5209fa7c74b0a441fd', 'bd4ee4cf779401e88888148385dba10a24b48779', '3e48d94dab4c3bfe0b9b3f63e99755d2edb3520e', '5474a436940c70552afd5ad6477666387ae9e64b', '25d9892715f2834d6fa9d7d559d0558149891739', 'de189940e116130a7f73fdee1441fd0ca8d5226e', '72139e4da5ca19aa51f47c1cb9b2e6e0a0c85dcc', '3427e153184002ab45f348ca4e2ae02dd27621f1', 'b14787807c360971359e7642fb3b25c316c37164', 'a53a151c91938362c8c97c0a301d0ee9ab0fdcde', 'd75a682e8b6286b8dd8b336d8e9659dfd00c71eb', 'd1da97eda5e04888052a21603618a00bf2414e6c', '36512e6c443396870ea70431d6f20808d51f02b4', '4fe8ba025148db2a9f3b7a05f46db5dd54489eb1', 'bd4bd7ba31be06e98d3f20f57a7613b9b941f5c3', '8e5015a6c0c442ca442bfebe6dfa12b6676de5e8', '7fe386015231d65fccd7532287fab490108465da', '50ea4fb90b3f9e2ff2c96767eea33cfbd3152853', '7ddb48212c02d9ffbe6cb3b93d85b2eb0cb75ff9', '901451383125f81225997ae3334b88980b248080', 'a2c1121252123e7f52776d42215e382de0fba8c7', 'cc10dd14733ff21cf7f0561da0129cecefd9bc49', '0d8f0107562c92ba4c7bea99cac799a4e4349e7e', 'b0a8a7e8b9e41d7df4901d8dede84ed72e7ace10', 'a52c43f2529ab5cf1807da3aac77f6af5b40459d', 'a6b6f62c46acf76dba669df6f38e8aaeb6f565aa', 'c62f82fa29e19a46a82c46d7dfd8d5d8c65cb3ec', 'aaf0e48b7afb613cb526175fc0d2f338bea8d0ff', '56bd97b41296987abc383768a1493eafa39fb756', '559232083fbd97440f4c468dfd3b50a9de3895bf', 'fbe84302a881fcc6b1fd90cbf446592c71f2c1db', '640494377eb4c37b0087071d1f4995dd2144be8c', '1650756894db8086e311a8bf32e8f6d226a42402', 'a87b65bce227dbb352cf08efe0ed840d7a122beb', '9c76d30c08e80c024d2c8385d86e214dea008a96', '27c83a6a658a1c915c3adf8c5e7a2e86bf4139b1', '017662d2a51eaa32f1e31c44570b6ef0711cae83', '481bb381f738a8c94310c751a5f4d8f46ea832bf', '2e1280e226756f9d6f3525249d8680c44ad56409', '40e33702cf4a6fecc36fac4411982bf0291c7775', '297e46fde25f2be0d2be3b804e55f4a1db202eba', '7dfbc9c0d958dce0e8ff6f18ec15ab7af8a58b18', '24db9b37ea4f0f2f1d3fe02302423fafb3379ad0', '5907813a4c9e6e7890d23bdde26f20912ac60279', '707433e1ab77998be27c2869a423f60fe2d5167a', 'c885c2abe37eb1021df72eecbee8d7d7bd1da8ab', 'fe381e497cab04383b036556fb5459c37a21d424', '87ca1d9c258be3405a2e49e81460e79fdd91a7ff', '41b2d79ce1e473e9ffea49065cfd5635d6aece88', 'a3686d4096fa57090ca05cb547bb6ba0af0315fc', '42f8498ba500f800d0f18ac91e85ebc0b0b5eafa', 'f2281827814c964760f61b815aeb7f4f08a0a2a1', 'cbab891976c0632739cc2b53afa1c1db295811eb', '0da855d004bb08fcc40650d4000a46f69b4e908a', '8294a5e1e75c4a9b641c5790b843653e95b9b1d1', '94d0739ba8bfea1dd24beb487a7ef1a0caa2438d', '8f006ddfae418aa29d23a42a7d0a42c03076d10b', 'cf9ae7d4a517b8be1b64beb1bb3e8f7da76525c3', '55545034e172b518eca756c5e8d0da8c0dd6310d', '51cd4dbd72a95d9f38211c013520a9e4cc942730', '9c10097729ac4934fcbd056504ccc3eb6e097b1c', '98cd6827bd3a7d1b014f4384ca910e0ba095713e', '90df6d04781d06175aaefbef2f584c21c9b00dbe', 'ba0c2712649fec6d56fb537cece4fb7efa96c8b6', 'd0be80819a94ab0d447d5c8a49374950fa60ba83', 'c74cf78e4b081f6c696933974545e5041382bb48', '365221e0465eafa71666bedc371e29e84bc7d515', '919e9a82a92de6b465229f9242a5d987b4c6c9da', '8ce806adefa022f0b3c9f2aeb4e2e3c349f39c1f'], 'changed_integration_tests': ['tests/integration/test_storage_iceberg_with_spark/test_manifest_list_partition_pruning.py'], 'version': {'revision': 54546, 'major': 26, 'minor': 8, 'patch': 34, 'tweak': 20001, 'githash': '4ca42662d1a0175631b2f340620d5a50dd049999', 'describe': 'v26.8.34.20001.altinityantalya', 'string': '26.8.34.20001.altinityantalya', 'flavour': 'altinityantalya'}}, JOB_KV_DATA_BASE_KEYS=['commit_authors', 'parent_pr_number', 'changed_files', 'settings_history_changed_settings', 'build_digest', 'master_commits', 'merge_base_commit_sha', 'master_track_commits_sha', 'changed_integration_tests', 'version'], COMMIT_AUTHORS=[], WORKFLOW_CONFIG={'name': 'PR', 'digest_jobs': {'Config Workflow': 'ffffffffffffffffffff', 'Dockers Build (amd)': 'dbdb16b5d79e3185c288-a0e0', 'Dockers Build (arm)': 'dbdb16b5d79e3185c288-4ac6', 'Dockers Build (multiplatform manifest)': 'dbdb16b5d79e3185c288-a0e0-4ac6-d019', 'Fast test': '87d2af27608d22b3ef6b-95a4', 'CI Tests': '09e997436f0ce7d6680b-3251', 'Build (amd_debug)': 'c17995ced07709c4923a-e6eb', 'Build (amd_asan_ubsan)': 'c17995ced07709c4923a-3af3', 'Build (amd_binary)': 'c17995ced07709c4923a-670a', 'Build (arm_debug)': 'c17995ced07709c4923a-9820', 'Build (arm_asan_ubsan)': 'c17995ced07709c4923a-8ecd', 'Build (arm_binary)': 'c17995ced07709c4923a-6087', 'Build (amd_tsan)': 'c17995ced07709c4923a-3a69', 'Build (amd_msan)': 'c17995ced07709c4923a-5ad3', 'Build (arm_tsan)': 'c17995ced07709c4923a-e02c', 'Build (arm_msan)': 'c17995ced07709c4923a-8fe5', 'Build (amd_release)': 'c17995ced07709c4923a-e778', 'Build (arm_release)': 'c17995ced07709c4923a-1f13', 'Build (wasm_parser)': '1ad6fbbda50d2743efe1-139843296a0d9dbf7b01-a7ea', 'Quick functional tests': 'c17995ced07709c4923a-e6eb-ada0c23201050b2bed50-6470', 'Stateless tests (arm_asan_ubsan, targeted)': 'c17995ced07709c4923a-8ecd-ac688a2ce4d074367b70-bfa7', 'Integration tests (amd_asan_ubsan, targeted)': 'c17995ced07709c4923a-3af3-67bd895e82a61386699f-16d3', 'AST fuzzer (amd_debug, targeted)': 'c17995ced07709c4923a-e6eb-609b14b4cebd23434103-481a', 'AST fuzzer (amd_debug, targeted, old_compatibility)': 'c17995ced07709c4923a-e6eb-609b14b4cebd23434103-cfbf', 'Bugfix validation (unit tests)': '24165e6c0dd5a67a5e8a-d2db', 'Stateless tests (amd_debug, parallel)': 'c17995ced07709c4923a-e6eb-ac688a2ce4d074367b70-f291', 'Stateless tests (amd_debug, sequential)': 'c17995ced07709c4923a-e6eb-ac688a2ce4d074367b70-fa6a', 'Stateless tests (amd_msan, WasmEdge, parallel, 1/6)': 'c17995ced07709c4923a-5ad3-ac688a2ce4d074367b70-305b', 'Stateless tests (amd_msan, WasmEdge, parallel, 2/6)': 'c17995ced07709c4923a-5ad3-ac688a2ce4d074367b70-1c21', 'Stateless tests (amd_msan, WasmEdge, parallel, 3/6)': 'c17995ced07709c4923a-5ad3-ac688a2ce4d074367b70-b1ff', 'Stateless tests (amd_msan, WasmEdge, parallel, 4/6)': 'c17995ced07709c4923a-5ad3-ac688a2ce4d074367b70-ddf8', 'Stateless tests (amd_msan, WasmEdge, parallel, 5/6)': 'c17995ced07709c4923a-5ad3-ac688a2ce4d074367b70-ae12', 'Stateless tests (amd_msan, WasmEdge, parallel, 6/6)': 'c17995ced07709c4923a-5ad3-ac688a2ce4d074367b70-814e', 'Stateless tests (amd_msan, WasmEdge, sequential, 1/4)': 'c17995ced07709c4923a-5ad3-ac688a2ce4d074367b70-5a6f', 'Stateless tests (amd_msan, WasmEdge, sequential, 2/4)': 'c17995ced07709c4923a-5ad3-ac688a2ce4d074367b70-ee7e', 'Stateless tests (amd_msan, WasmEdge, sequential, 3/4)': 'c17995ced07709c4923a-5ad3-ac688a2ce4d074367b70-cf64', 'Stateless tests (amd_msan, WasmEdge, sequential, 4/4)': 'c17995ced07709c4923a-5ad3-ac688a2ce4d074367b70-c8f0', 'Stateless tests (amd_debug, distributed plan, s3 storage, parallel)': 'c17995ced07709c4923a-e6eb-ac688a2ce4d074367b70-b8f1', 'Stateless tests (amd_debug, distributed plan, s3 storage, sequential)': 'c17995ced07709c4923a-e6eb-ac688a2ce4d074367b70-6ca4', 'Stateless tests (arm_binary, parallel)': 'c17995ced07709c4923a-6087-ac688a2ce4d074367b70-76e6', 'Stateless tests (arm_binary, sequential)': 'c17995ced07709c4923a-6087-ac688a2ce4d074367b70-6ad9', 'Stateless tests (amd_asan_ubsan, distributed plan, parallel, selected tests)': 'ffffffffffffffffffff', 'Stateless tests (amd_asan_ubsan, db disk, distributed plan, sequential, selected tests)': 'ffffffffffffffffffff', 'Stateless tests (amd_tsan, parallel, selected tests)': 'ffffffffffffffffffff', 'Stateless tests (amd_tsan, sequential, selected tests)': 'ffffffffffffffffffff', 'Stateless tests (amd_tsan, s3 storage, parallel, selected tests)': 'ffffffffffffffffffff', 'Stateless tests (amd_tsan, s3 storage, sequential, selected tests)': 'ffffffffffffffffffff', 'Stateless tests (amd_binary, cas s3 storage, parallel)': 'c17995ced07709c4923a-670a-ac688a2ce4d074367b70-6318', 'Stateless tests (amd_asan_ubsan, cas s3 storage, parallel, 1/2)': 'c17995ced07709c4923a-3af3-ac688a2ce4d074367b70-b848', 'Stateless tests (amd_asan_ubsan, cas s3 storage, parallel, 2/2)': 'c17995ced07709c4923a-3af3-ac688a2ce4d074367b70-d3a6', 'Stateless tests (amd_tsan, cas s3 storage, parallel, 1/2)': 'c17995ced07709c4923a-3a69-ac688a2ce4d074367b70-b332', 'Stateless tests (amd_tsan, cas s3 storage, parallel, 2/2)': 'c17995ced07709c4923a-3a69-ac688a2ce4d074367b70-d7de', 'Stateless tests (amd_msan, cas s3 storage, parallel, 1/3)': 'c17995ced07709c4923a-5ad3-ac688a2ce4d074367b70-9917', 'Stateless tests (amd_msan, cas s3 storage, parallel, 2/3)': 'c17995ced07709c4923a-5ad3-ac688a2ce4d074367b70-97bf', 'Stateless tests (amd_msan, cas s3 storage, parallel, 3/3)': 'c17995ced07709c4923a-5ad3-ac688a2ce4d074367b70-fffc', 'Stateless tests (arm_binary, cas s3 storage, parallel)': 'c17995ced07709c4923a-6087-ac688a2ce4d074367b70-1558', 'Stateless tests (amd_binary, cas storage, parallel)': 'c17995ced07709c4923a-670a-ac688a2ce4d074367b70-06d0', 'Stateless tests (arm_asan_ubsan, azure, parallel, 1/8)': 'c17995ced07709c4923a-8ecd-ac688a2ce4d074367b70-3518', 'Stateless tests (arm_asan_ubsan, azure, parallel, 2/8)': 'c17995ced07709c4923a-8ecd-ac688a2ce4d074367b70-3e94', 'Stateless tests (arm_asan_ubsan, azure, parallel, 3/8)': 'c17995ced07709c4923a-8ecd-ac688a2ce4d074367b70-7ac7', 'Stateless tests (arm_asan_ubsan, azure, parallel, 4/8)': 'c17995ced07709c4923a-8ecd-ac688a2ce4d074367b70-01cc', 'Stateless tests (arm_asan_ubsan, azure, parallel, 5/8)': 'c17995ced07709c4923a-8ecd-ac688a2ce4d074367b70-96b4', 'Stateless tests (arm_asan_ubsan, azure, parallel, 6/8)': 'c17995ced07709c4923a-8ecd-ac688a2ce4d074367b70-1a8a', 'Stateless tests (arm_asan_ubsan, azure, parallel, 7/8)': 'c17995ced07709c4923a-8ecd-ac688a2ce4d074367b70-7a12', 'Stateless tests (arm_asan_ubsan, azure, parallel, 8/8)': 'c17995ced07709c4923a-8ecd-ac688a2ce4d074367b70-5816', 'Stateless tests (arm_asan_ubsan, azure, sequential, 1/2)': 'c17995ced07709c4923a-8ecd-ac688a2ce4d074367b70-02a5', 'Stateless tests (arm_asan_ubsan, azure, sequential, 2/2)': 'c17995ced07709c4923a-8ecd-ac688a2ce4d074367b70-9c51', 'Integration tests (amd_asan_ubsan, db disk, old analyzer, 1/8)': 'c17995ced07709c4923a-3af3-67bd895e82a61386699f-8541', 'Integration tests (amd_asan_ubsan, db disk, old analyzer, 2/8)': 'c17995ced07709c4923a-3af3-67bd895e82a61386699f-7e4f', 'Integration tests (amd_asan_ubsan, db disk, old analyzer, 3/8)': 'c17995ced07709c4923a-3af3-67bd895e82a61386699f-dd5b', 'Integration tests (amd_asan_ubsan, db disk, old analyzer, 4/8)': 'c17995ced07709c4923a-3af3-67bd895e82a61386699f-19d8', 'Integration tests (amd_asan_ubsan, db disk, old analyzer, 5/8)': 'c17995ced07709c4923a-3af3-67bd895e82a61386699f-62f1', 'Integration tests (amd_asan_ubsan, db disk, old analyzer, 6/8)': 'c17995ced07709c4923a-3af3-67bd895e82a61386699f-e5f9', 'Integration tests (amd_asan_ubsan, db disk, old analyzer, 7/8)': 'c17995ced07709c4923a-3af3-67bd895e82a61386699f-7088', 'Integration tests (amd_asan_ubsan, db disk, old analyzer, 8/8)': 'c17995ced07709c4923a-3af3-67bd895e82a61386699f-cf19', 'Integration tests (arm_binary, distributed plan, 1/4)': 'c17995ced07709c4923a-6087-67bd895e82a61386699f-df50', 'Integration tests (arm_binary, distributed plan, 2/4)': 'c17995ced07709c4923a-6087-67bd895e82a61386699f-8fae', 'Integration tests (arm_binary, distributed plan, 3/4)': 'c17995ced07709c4923a-6087-67bd895e82a61386699f-ea56', 'Integration tests (arm_binary, distributed plan, 4/4)': 'c17995ced07709c4923a-6087-67bd895e82a61386699f-2f21', 'Integration tests (amd_tsan, 1/8)': 'c17995ced07709c4923a-3a69-67bd895e82a61386699f-cd96', 'Integration tests (amd_tsan, 2/8)': 'c17995ced07709c4923a-3a69-67bd895e82a61386699f-100b', 'Integration tests (amd_tsan, 3/8)': 'c17995ced07709c4923a-3a69-67bd895e82a61386699f-5bac', 'Integration tests (amd_tsan, 4/8)': 'c17995ced07709c4923a-3a69-67bd895e82a61386699f-64d5', 'Integration tests (amd_tsan, 5/8)': 'c17995ced07709c4923a-3a69-67bd895e82a61386699f-2345', 'Integration tests (amd_tsan, 6/8)': 'c17995ced07709c4923a-3a69-67bd895e82a61386699f-5f78', 'Integration tests (amd_tsan, 7/8)': 'c17995ced07709c4923a-3a69-67bd895e82a61386699f-3cf8', 'Integration tests (amd_tsan, 8/8)': 'c17995ced07709c4923a-3a69-67bd895e82a61386699f-7b02', 'Integration tests (amd_msan, 1/10)': 'c17995ced07709c4923a-5ad3-67bd895e82a61386699f-0d8f', 'Integration tests (amd_msan, 2/10)': 'c17995ced07709c4923a-5ad3-67bd895e82a61386699f-abe8', 'Integration tests (amd_msan, 3/10)': 'c17995ced07709c4923a-5ad3-67bd895e82a61386699f-bde4', 'Integration tests (amd_msan, 4/10)': 'c17995ced07709c4923a-5ad3-67bd895e82a61386699f-04e5', 'Integration tests (amd_msan, 5/10)': 'c17995ced07709c4923a-5ad3-67bd895e82a61386699f-27ab', 'Integration tests (amd_msan, 6/10)': 'c17995ced07709c4923a-5ad3-67bd895e82a61386699f-893c', 'Integration tests (amd_msan, 7/10)': 'c17995ced07709c4923a-5ad3-67bd895e82a61386699f-52f2', 'Integration tests (amd_msan, 8/10)': 'c17995ced07709c4923a-5ad3-67bd895e82a61386699f-df64', 'Integration tests (amd_msan, 9/10)': 'c17995ced07709c4923a-5ad3-67bd895e82a61386699f-c073', 'Integration tests (amd_msan, 10/10)': 'c17995ced07709c4923a-5ad3-67bd895e82a61386699f-8693', 'Unit tests (asan_ubsan)': 'c17995ced07709c4923a-3af3-f831876c9cd6de9754f5-4e459d2acca4e85b35f8-84f3', 'Unit tests (tsan)': 'c17995ced07709c4923a-3a69-f831876c9cd6de9754f5-4e459d2acca4e85b35f8-9fe2', 'Unit tests (msan)': 'c17995ced07709c4923a-5ad3-f831876c9cd6de9754f5-4e459d2acca4e85b35f8-b999', 'Unit tests (asan_ubsan, function_prop_fuzzer)': 'c17995ced07709c4923a-3af3-f831876c9cd6de9754f5-4e459d2acca4e85b35f8-cfb8', 'Unit tests (tsan, function_prop_fuzzer)': 'c17995ced07709c4923a-3a69-f831876c9cd6de9754f5-4e459d2acca4e85b35f8-0f4c', 'Unit tests (msan, function_prop_fuzzer)': 'c17995ced07709c4923a-5ad3-f831876c9cd6de9754f5-4e459d2acca4e85b35f8-028d', 'Docker server image': 'c17995ced07709c4923a-e778-1f13-707e62cb5f36aad1cc7b-b880', 'Docker keeper image': 'c17995ced07709c4923a-e778-1f13-707e62cb5f36aad1cc7b-b2ca', 'Install packages (amd_release)': 'c17995ced07709c4923a-e778-7fb94f08ccb3e714e894-44d5', 'Install packages (arm_release)': 'c17995ced07709c4923a-1f13-7fb94f08ccb3e714e894-3e39', 'Compatibility check (amd_release)': 'c17995ced07709c4923a-e778-d7eab69ed31c18f94d8d-cdf8', 'Compatibility check (arm_release)': 'c17995ced07709c4923a-1f13-d7eab69ed31c18f94d8d-6b97', 'Stress test (amd_debug)': 'c17995ced07709c4923a-e6eb-29c7de9244eca92ddcfc-97bc', 'Stress test (amd_asan_ubsan)': 'c17995ced07709c4923a-3af3-29c7de9244eca92ddcfc-0273', 'Stress test (amd_tsan)': 'c17995ced07709c4923a-3a69-29c7de9244eca92ddcfc-98bd', 'Stress test (amd_msan)': 'c17995ced07709c4923a-5ad3-29c7de9244eca92ddcfc-5bdc', 'Stress test (arm_release)': 'c17995ced07709c4923a-1f13-29c7de9244eca92ddcfc-28b3', 'Stress test (arm_debug)': 'c17995ced07709c4923a-9820-29c7de9244eca92ddcfc-48aa', 'Stress test (arm_asan_ubsan)': 'c17995ced07709c4923a-8ecd-29c7de9244eca92ddcfc-77c4', 'Stress test (arm_asan_ubsan, s3)': 'c17995ced07709c4923a-8ecd-29c7de9244eca92ddcfc-359a', 'Stress test (arm_tsan)': 'c17995ced07709c4923a-e02c-29c7de9244eca92ddcfc-f72d', 'Stress test (arm_msan)': 'c17995ced07709c4923a-8fe5-29c7de9244eca92ddcfc-57d4', 'AST fuzzer (amd_debug)': 'c17995ced07709c4923a-e6eb-a3de5be3c11a9e4e769b-d62c', 'AST fuzzer (arm_asan_ubsan)': 'c17995ced07709c4923a-8ecd-a3de5be3c11a9e4e769b-922e', 'AST fuzzer (amd_tsan)': 'c17995ced07709c4923a-3a69-a3de5be3c11a9e4e769b-b0f1', 'AST fuzzer (amd_msan)': 'c17995ced07709c4923a-5ad3-a3de5be3c11a9e4e769b-f0ce', 'BuzzHouse (amd_debug)': 'c17995ced07709c4923a-e6eb-fb2cbd85003e22e7a458-da00', 'BuzzHouse (arm_asan_ubsan)': 'c17995ced07709c4923a-8ecd-fb2cbd85003e22e7a458-452b', 'BuzzHouse (amd_tsan)': 'c17995ced07709c4923a-3a69-fb2cbd85003e22e7a458-fe2d', 'BuzzHouse (amd_msan)': 'c17995ced07709c4923a-5ad3-fb2cbd85003e22e7a458-2793', 'PromQL Compliance': 'ffffffffffffffffffff', 'SQLLogic test': 'c17995ced07709c4923a-1f13-0dc483b9acdcd894e95f-9f018150d6c698d5ac10-c139', 'SQLStorm test': 'c17995ced07709c4923a-1f13-0dc483b9acdcd894e95f-ea08be8e1e3ce6734350-7062', 'Keeper Stress Tests (PR)': 'c17995ced07709c4923a-6087-f7f922410456c18fcde0-fa23', 'Build Toolchain (PGO, BOLT) (amd64)': '3fdd4cbfdf7d613e0bbb-7e82', 'Build Toolchain (PGO, BOLT) (aarch64)': '3fdd4cbfdf7d613e0bbb-032b', 'Source upload': 'ffffffffffffffffffff', 'Finish Workflow': 'ffffffffffffffffffff'}, 'digest_dockers': {'altinityinfra/style-test': 'e14c3a1b6e1ba0d98798', 'altinityinfra/fasttest': '52c29eac6eac1227a38c', 'altinityinfra/binary-builder': '68f93d303574d5c8fd0e', 'altinityinfra/wasm-builder': '1ad6fbbda50d2743efe1', 'altinityinfra/cctools': 'a80028310da3ac5e396d', 'altinityinfra/utils': '72129641dcff8ea318bd', 'altinityinfra/test-base': 'f831876c9cd6de9754f5', 'altinityinfra/fuzzer': '39e3ed127a5eb70b5603', 'altinityinfra/performance-comparison': '2649953e6cf0821a12d4', 'altinityinfra/keeper-jepsen-test': '9bd0ef733562cde1d3d3', 'altinityinfra/server-jepsen-test': 'f3d47cd8f2e193d6287e', 'altinityinfra/integration-test': '8772ca868782bfb96640', 'altinityinfra/integration-tests-runner': 'fe5a666779f60a3db169', 'altinityinfra/integration-test-with-unity-catalog': 'eea17ddacf7bd60a6ce2', 'altinityinfra/integration-test-with-hms': 'da265a74f6cbad9c4d7d', 'altinityinfra/integration-helper': '5dc43a6382f0055b4d8e', 'altinityinfra/kerberos-kdc': '9391ecdee8d716376396', 'altinityinfra/test-mysql80': 'b4952fdc56ce2efe639c', 'altinityinfra/test-mysql57': '4d3b6a2e9f51ec2644be', 'altinityinfra/mysql-golang-client': '4e2f6aa1571ffde03183', 'altinityinfra/mysql-java-client': 'd02850b5045db9c22d37', 'altinityinfra/mysql-js-client': '77a3fdb2d4bc2e3d94e6', 'altinityinfra/arrowflight-server-test': 'f7ca5d17ed977c92b143', 'altinityinfra/dotnet-client': '50da1ccb94f49087d3f0', 'altinityinfra/mysql-php-client': '199f1620a1e4cd493f05', 'altinityinfra/nginx-dav': 'aa33b6ad5665b723c6e4', 'altinityinfra/postgresql-java-client': 'b9d0b4c6ffe6d83fe389', 'altinityinfra/python-bottle': '99a04d92eceed16e2bfc', 'altinityinfra/s3-proxy': '57c3f2d0385fc09b9f6c', 'altinityinfra/docs-builder': '41cd74b1c3043c629c84', 'altinityinfra/install-deb-test': 'ec2879744cacbe7f4957', 'altinityinfra/install-rpm-test': '6f408fc7fa9d466a1090', 'altinityinfra/sqlancer-test': '9d36e8e405eadf53aa2b', 'altinityinfra/mysql_dotnet_client': 'bd062438ccde46deabe5', 'altinityinfra/stateless-test': '0dc483b9acdcd894e95f', 'altinityinfra/stress-test': 'b1a4453306c8f088b059'}, 'cache_success': ['Build (arm_debug)', 'Build (arm_asan_ubsan)', 'Build (arm_binary)', 'Build (amd_tsan)', 'Build (amd_msan)', 'Build (arm_tsan)', 'Build (arm_msan)', 'Stateless tests (arm_asan_ubsan, targeted)', 'Bugfix validation (unit tests)', 'Stateless tests (amd_msan, WasmEdge, parallel, 1/6)', 'Stateless tests (amd_msan, WasmEdge, parallel, 2/6)', 'Stateless tests (amd_msan, WasmEdge, parallel, 3/6)', 'Stateless tests (amd_msan, WasmEdge, parallel, 4/6)', 'Stateless tests (amd_msan, WasmEdge, parallel, 5/6)', 'Stateless tests (amd_msan, WasmEdge, parallel, 6/6)', 'Stateless tests (amd_msan, WasmEdge, sequential, 1/4)', 'Stateless tests (amd_msan, WasmEdge, sequential, 2/4)', 'Stateless tests (amd_msan, WasmEdge, sequential, 3/4)', 'Stateless tests (amd_msan, WasmEdge, sequential, 4/4)', 'Stateless tests (arm_binary, parallel)', 'Stateless tests (arm_binary, sequential)', 'Stateless tests (amd_tsan, parallel, selected tests)', 'Stateless tests (amd_tsan, sequential, selected tests)', 'Stateless tests (amd_tsan, s3 storage, parallel, selected tests)', 'Stateless tests (amd_tsan, s3 storage, sequential, selected tests)', 'Stateless tests (amd_tsan, cas s3 storage, parallel, 1/2)', 'Stateless tests (amd_tsan, cas s3 storage, parallel, 2/2)', 'Stateless tests (amd_msan, cas s3 storage, parallel, 1/3)', 'Stateless tests (amd_msan, cas s3 storage, parallel, 2/3)', 'Stateless tests (amd_msan, cas s3 storage, parallel, 3/3)', 'Stateless tests (arm_binary, cas s3 storage, parallel)', 'Stateless tests (arm_asan_ubsan, azure, parallel, 1/8)', 'Stateless tests (arm_asan_ubsan, azure, parallel, 2/8)', 'Stateless tests (arm_asan_ubsan, azure, parallel, 3/8)', 'Stateless tests (arm_asan_ubsan, azure, parallel, 4/8)', 'Stateless tests (arm_asan_ubsan, azure, parallel, 5/8)', 'Stateless tests (arm_asan_ubsan, azure, parallel, 6/8)', 'Stateless tests (arm_asan_ubsan, azure, parallel, 7/8)', 'Stateless tests (arm_asan_ubsan, azure, parallel, 8/8)', 'Stateless tests (arm_asan_ubsan, azure, sequential, 1/2)', 'Stateless tests (arm_asan_ubsan, azure, sequential, 2/2)', 'Integration tests (arm_binary, distributed plan, 1/4)', 'Integration tests (arm_binary, distributed plan, 2/4)', 'Integration tests (arm_binary, distributed plan, 3/4)', 'Integration tests (arm_binary, distributed plan, 4/4)', 'Integration tests (amd_tsan, 1/8)', 'Integration tests (amd_tsan, 2/8)', 'Integration tests (amd_tsan, 3/8)', 'Integration tests (amd_tsan, 4/8)', 'Integration tests (amd_tsan, 5/8)', 'Integration tests (amd_tsan, 6/8)', 'Integration tests (amd_tsan, 7/8)', 'Integration tests (amd_tsan, 8/8)', 'Integration tests (amd_msan, 1/10)', 'Integration tests (amd_msan, 2/10)', 'Integration tests (amd_msan, 3/10)', 'Integration tests (amd_msan, 4/10)', 'Integration tests (amd_msan, 5/10)', 'Integration tests (amd_msan, 6/10)', 'Integration tests (amd_msan, 7/10)', 'Integration tests (amd_msan, 8/10)', 'Integration tests (amd_msan, 9/10)', 'Integration tests (amd_msan, 10/10)', 'Unit tests (tsan)', 'Unit tests (msan)', 'Unit tests (tsan, function_prop_fuzzer)', 'Unit tests (msan, function_prop_fuzzer)', 'Install packages (arm_release)', 'Compatibility check (arm_release)', 'Stress test (amd_tsan)', 'Stress test (amd_msan)', 'Stress test (arm_release)', 'Stress test (arm_debug)', 'Stress test (arm_asan_ubsan)', 'Stress test (arm_asan_ubsan, s3)', 'Stress test (arm_tsan)', 'Stress test (arm_msan)', 'AST fuzzer (arm_asan_ubsan)', 'AST fuzzer (amd_tsan)', 'AST fuzzer (amd_msan)', 'BuzzHouse (arm_asan_ubsan)', 'BuzzHouse (amd_tsan)', 'BuzzHouse (amd_msan)', 'PromQL Compliance', 'Keeper Stress Tests (PR)', 'Build Toolchain (PGO, BOLT) (amd64)', 'Build Toolchain (PGO, BOLT) (aarch64)', 'CI Tests', 'Dockers Build (amd)', 'Dockers Build (arm)', 'Dockers Build (multiplatform manifest)'], 'cache_success_base64': ['QnVpbGQgKGFybV9kZWJ1Zyk=', 'QnVpbGQgKGFybV9hc2FuX3Vic2FuKQ==', 'QnVpbGQgKGFybV9iaW5hcnkp', 'QnVpbGQgKGFtZF90c2FuKQ==', 'QnVpbGQgKGFtZF9tc2FuKQ==', 'QnVpbGQgKGFybV90c2FuKQ==', 'QnVpbGQgKGFybV9tc2FuKQ==', 'U3RhdGVsZXNzIHRlc3RzIChhcm1fYXNhbl91YnNhbiwgdGFyZ2V0ZWQp', 'QnVnZml4IHZhbGlkYXRpb24gKHVuaXQgdGVzdHMp', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfbXNhbiwgV2FzbUVkZ2UsIHBhcmFsbGVsLCAxLzYp', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfbXNhbiwgV2FzbUVkZ2UsIHBhcmFsbGVsLCAyLzYp', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfbXNhbiwgV2FzbUVkZ2UsIHBhcmFsbGVsLCAzLzYp', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfbXNhbiwgV2FzbUVkZ2UsIHBhcmFsbGVsLCA0LzYp', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfbXNhbiwgV2FzbUVkZ2UsIHBhcmFsbGVsLCA1LzYp', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfbXNhbiwgV2FzbUVkZ2UsIHBhcmFsbGVsLCA2LzYp', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfbXNhbiwgV2FzbUVkZ2UsIHNlcXVlbnRpYWwsIDEvNCk=', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfbXNhbiwgV2FzbUVkZ2UsIHNlcXVlbnRpYWwsIDIvNCk=', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfbXNhbiwgV2FzbUVkZ2UsIHNlcXVlbnRpYWwsIDMvNCk=', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfbXNhbiwgV2FzbUVkZ2UsIHNlcXVlbnRpYWwsIDQvNCk=', 'U3RhdGVsZXNzIHRlc3RzIChhcm1fYmluYXJ5LCBwYXJhbGxlbCk=', 'U3RhdGVsZXNzIHRlc3RzIChhcm1fYmluYXJ5LCBzZXF1ZW50aWFsKQ==', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfdHNhbiwgcGFyYWxsZWwsIHNlbGVjdGVkIHRlc3RzKQ==', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfdHNhbiwgc2VxdWVudGlhbCwgc2VsZWN0ZWQgdGVzdHMp', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfdHNhbiwgczMgc3RvcmFnZSwgcGFyYWxsZWwsIHNlbGVjdGVkIHRlc3RzKQ==', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfdHNhbiwgczMgc3RvcmFnZSwgc2VxdWVudGlhbCwgc2VsZWN0ZWQgdGVzdHMp', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfdHNhbiwgY2FzIHMzIHN0b3JhZ2UsIHBhcmFsbGVsLCAxLzIp', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfdHNhbiwgY2FzIHMzIHN0b3JhZ2UsIHBhcmFsbGVsLCAyLzIp', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfbXNhbiwgY2FzIHMzIHN0b3JhZ2UsIHBhcmFsbGVsLCAxLzMp', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfbXNhbiwgY2FzIHMzIHN0b3JhZ2UsIHBhcmFsbGVsLCAyLzMp', 'U3RhdGVsZXNzIHRlc3RzIChhbWRfbXNhbiwgY2FzIHMzIHN0b3JhZ2UsIHBhcmFsbGVsLCAzLzMp', 'U3RhdGVsZXNzIHRlc3RzIChhcm1fYmluYXJ5LCBjYXMgczMgc3RvcmFnZSwgcGFyYWxsZWwp', 'U3RhdGVsZXNzIHRlc3RzIChhcm1fYXNhbl91YnNhbiwgYXp1cmUsIHBhcmFsbGVsLCAxLzgp', 'U3RhdGVsZXNzIHRlc3RzIChhcm1fYXNhbl91YnNhbiwgYXp1cmUsIHBhcmFsbGVsLCAyLzgp', 'U3RhdGVsZXNzIHRlc3RzIChhcm1fYXNhbl91YnNhbiwgYXp1cmUsIHBhcmFsbGVsLCAzLzgp', 'U3RhdGVsZXNzIHRlc3RzIChhcm1fYXNhbl91YnNhbiwgYXp1cmUsIHBhcmFsbGVsLCA0Lzgp', 'U3RhdGVsZXNzIHRlc3RzIChhcm1fYXNhbl91YnNhbiwgYXp1cmUsIHBhcmFsbGVsLCA1Lzgp', 'U3RhdGVsZXNzIHRlc3RzIChhcm1fYXNhbl91YnNhbiwgYXp1cmUsIHBhcmFsbGVsLCA2Lzgp', 'U3RhdGVsZXNzIHRlc3RzIChhcm1fYXNhbl91YnNhbiwgYXp1cmUsIHBhcmFsbGVsLCA3Lzgp', 'U3RhdGVsZXNzIHRlc3RzIChhcm1fYXNhbl91YnNhbiwgYXp1cmUsIHBhcmFsbGVsLCA4Lzgp', 'U3RhdGVsZXNzIHRlc3RzIChhcm1fYXNhbl91YnNhbiwgYXp1cmUsIHNlcXVlbnRpYWwsIDEvMik=', 'U3RhdGVsZXNzIHRlc3RzIChhcm1fYXNhbl91YnNhbiwgYXp1cmUsIHNlcXVlbnRpYWwsIDIvMik=', 'SW50ZWdyYXRpb24gdGVzdHMgKGFybV9iaW5hcnksIGRpc3RyaWJ1dGVkIHBsYW4sIDEvNCk=', 'SW50ZWdyYXRpb24gdGVzdHMgKGFybV9iaW5hcnksIGRpc3RyaWJ1dGVkIHBsYW4sIDIvNCk=', 'SW50ZWdyYXRpb24gdGVzdHMgKGFybV9iaW5hcnksIGRpc3RyaWJ1dGVkIHBsYW4sIDMvNCk=', 'SW50ZWdyYXRpb24gdGVzdHMgKGFybV9iaW5hcnksIGRpc3RyaWJ1dGVkIHBsYW4sIDQvNCk=', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF90c2FuLCAxLzgp', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF90c2FuLCAyLzgp', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF90c2FuLCAzLzgp', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF90c2FuLCA0Lzgp', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF90c2FuLCA1Lzgp', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF90c2FuLCA2Lzgp', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF90c2FuLCA3Lzgp', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF90c2FuLCA4Lzgp', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF9tc2FuLCAxLzEwKQ==', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF9tc2FuLCAyLzEwKQ==', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF9tc2FuLCAzLzEwKQ==', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF9tc2FuLCA0LzEwKQ==', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF9tc2FuLCA1LzEwKQ==', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF9tc2FuLCA2LzEwKQ==', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF9tc2FuLCA3LzEwKQ==', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF9tc2FuLCA4LzEwKQ==', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF9tc2FuLCA5LzEwKQ==', 'SW50ZWdyYXRpb24gdGVzdHMgKGFtZF9tc2FuLCAxMC8xMCk=', 'VW5pdCB0ZXN0cyAodHNhbik=', 'VW5pdCB0ZXN0cyAobXNhbik=', 'VW5pdCB0ZXN0cyAodHNhbiwgZnVuY3Rpb25fcHJvcF9mdXp6ZXIp', 'VW5pdCB0ZXN0cyAobXNhbiwgZnVuY3Rpb25fcHJvcF9mdXp6ZXIp', 'SW5zdGFsbCBwYWNrYWdlcyAoYXJtX3JlbGVhc2Up', 'Q29tcGF0aWJpbGl0eSBjaGVjayAoYXJtX3JlbGVhc2Up', 'U3RyZXNzIHRlc3QgKGFtZF90c2FuKQ==', 'U3RyZXNzIHRlc3QgKGFtZF9tc2FuKQ==', 'U3RyZXNzIHRlc3QgKGFybV9yZWxlYXNlKQ==', 'U3RyZXNzIHRlc3QgKGFybV9kZWJ1Zyk=', 'U3RyZXNzIHRlc3QgKGFybV9hc2FuX3Vic2FuKQ==', 'U3RyZXNzIHRlc3QgKGFybV9hc2FuX3Vic2FuLCBzMyk=', 'U3RyZXNzIHRlc3QgKGFybV90c2FuKQ==', 'U3RyZXNzIHRlc3QgKGFybV9tc2FuKQ==', 'QVNUIGZ1enplciAoYXJtX2FzYW5fdWJzYW4p', 'QVNUIGZ1enplciAoYW1kX3RzYW4p', 'QVNUIGZ1enplciAoYW1kX21zYW4p', 'QnV6ekhvdXNlIChhcm1fYXNhbl91YnNhbik=', 'QnV6ekhvdXNlIChhbWRfdHNhbik=', 'QnV6ekhvdXNlIChhbWRfbXNhbik=', 'UHJvbVFMIENvbXBsaWFuY2U=', 'S2VlcGVyIFN0cmVzcyBUZXN0cyAoUFIp', 'QnVpbGQgVG9vbGNoYWluIChQR08sIEJPTFQpIChhbWQ2NCk=', 'QnVpbGQgVG9vbGNoYWluIChQR08sIEJPTFQpIChhYXJjaDY0KQ==', 'Q0kgVGVzdHM=', 'RG9ja2VycyBCdWlsZCAoYW1kKQ==', 'RG9ja2VycyBCdWlsZCAoYXJtKQ==', 'RG9ja2VycyBCdWlsZCAobXVsdGlwbGF0Zm9ybSBtYW5pZmVzdCk='], 'cache_artifacts': {'Dockers Build (amd)': {'type': 'success', 'sha': '33604e3d7ced035f3facbdcf8b107adbcb989dcd', 'pr_number': 2677, 'branch': 'backports/antalya-26.8/117198', 'workflow': 'PR', 'event': 'pull_request'}, 'Dockers Build (arm)': {'type': 'success', 'sha': '33604e3d7ced035f3facbdcf8b107adbcb989dcd', 'pr_number': 2677, 'branch': 'backports/antalya-26.8/117198', 'workflow': 'PR', 'event': 'pull_request'}, 'Dockers Build (multiplatform manifest)': {'type': 'success', 'sha': '33604e3d7ced035f3facbdcf8b107adbcb989dcd', 'pr_number': 2677, 'branch': 'backports/antalya-26.8/117198', 'workflow': 'PR', 'event': 'pull_request'}}, 'cache_jobs': {'Dockers Build (amd)': {'type': 'success', 'sha': '33604e3d7ced035f3facbdcf8b107adbcb989dcd', 'pr_number': 2677, 'branch': 'backports/antalya-26.8/117198', 'workflow': 'PR', 'event': 'pull_request'}, 'Dockers Build (arm)': {'type': 'success', 'sha': '33604e3d7ced035f3facbdcf8b107adbcb989dcd', 'pr_number': 2677, 'branch': 'backports/antalya-26.8/117198', 'workflow': 'PR', 'event': 'pull_request'}, 'Dockers Build (multiplatform manifest)': {'type': 'success', 'sha': '33604e3d7ced035f3facbdcf8b107adbcb989dcd', 'pr_number': 2677, 'branch': 'backports/antalya-26.8/117198', 'workflow': 'PR', 'event': 'pull_request'}}, 'filtered_jobs': {'Build (arm_debug)': "Skipped, job name includes excluded tag 'arm'", 'Build (arm_asan_ubsan)': "Skipped, job name includes excluded tag 'arm'", 'Build (arm_binary)': "Skipped, job name includes excluded tag 'arm'", 'Build (amd_tsan)': "Skipped, job name includes excluded tag 'tsan'", 'Build (amd_msan)': "Skipped, job name includes excluded tag 'msan'", 'Build (arm_tsan)': "Skipped, job name includes excluded tag 'arm'", 'Build (arm_msan)': "Skipped, job name includes excluded tag 'arm'", 'Stateless tests (arm_asan_ubsan, targeted)': "Skipped, job name includes excluded tag 'arm'", 'Bugfix validation (unit tests)': 'Skipped, not a bug-fix PR', 'Stateless tests (amd_msan, WasmEdge, parallel, 1/6)': "Skipped, job name includes excluded tag 'msan'", 'Stateless tests (amd_msan, WasmEdge, parallel, 2/6)': "Skipped, job name includes excluded tag 'msan'", 'Stateless tests (amd_msan, WasmEdge, parallel, 3/6)': "Skipped, job name includes excluded tag 'msan'", 'Stateless tests (amd_msan, WasmEdge, parallel, 4/6)': "Skipped, job name includes excluded tag 'msan'", 'Stateless tests (amd_msan, WasmEdge, parallel, 5/6)': "Skipped, job name includes excluded tag 'msan'", 'Stateless tests (amd_msan, WasmEdge, parallel, 6/6)': "Skipped, job name includes excluded tag 'msan'", 'Stateless tests (amd_msan, WasmEdge, sequential, 1/4)': "Skipped, job name includes excluded tag 'msan'", 'Stateless tests (amd_msan, WasmEdge, sequential, 2/4)': "Skipped, job name includes excluded tag 'msan'", 'Stateless tests (amd_msan, WasmEdge, sequential, 3/4)': "Skipped, job name includes excluded tag 'msan'", 'Stateless tests (amd_msan, WasmEdge, sequential, 4/4)': "Skipped, job name includes excluded tag 'msan'", 'Stateless tests (arm_binary, parallel)': "Skipped, job name includes excluded tag 'arm'", 'Stateless tests (arm_binary, sequential)': "Skipped, job name includes excluded tag 'arm'", 'Stateless tests (amd_tsan, parallel, selected tests)': "Skipped, job name includes excluded tag 'tsan'", 'Stateless tests (amd_tsan, sequential, selected tests)': "Skipped, job name includes excluded tag 'tsan'", 'Stateless tests (amd_tsan, s3 storage, parallel, selected tests)': "Skipped, job name includes excluded tag 'tsan'", 'Stateless tests (amd_tsan, s3 storage, sequential, selected tests)': "Skipped, job name includes excluded tag 'tsan'", 'Stateless tests (amd_tsan, cas s3 storage, parallel, 1/2)': "Skipped, job name includes excluded tag 'tsan'", 'Stateless tests (amd_tsan, cas s3 storage, parallel, 2/2)': "Skipped, job name includes excluded tag 'tsan'", 'Stateless tests (amd_msan, cas s3 storage, parallel, 1/3)': "Skipped, job name includes excluded tag 'msan'", 'Stateless tests (amd_msan, cas s3 storage, parallel, 2/3)': "Skipped, job name includes excluded tag 'msan'", 'Stateless tests (amd_msan, cas s3 storage, parallel, 3/3)': "Skipped, job name includes excluded tag 'msan'", 'Stateless tests (arm_binary, cas s3 storage, parallel)': "Skipped, job name includes excluded tag 'arm'", 'Stateless tests (arm_asan_ubsan, azure, parallel, 1/8)': "Skipped, job name includes excluded tag 'arm'", 'Stateless tests (arm_asan_ubsan, azure, parallel, 2/8)': "Skipped, job name includes excluded tag 'arm'", 'Stateless tests (arm_asan_ubsan, azure, parallel, 3/8)': "Skipped, job name includes excluded tag 'arm'", 'Stateless tests (arm_asan_ubsan, azure, parallel, 4/8)': "Skipped, job name includes excluded tag 'arm'", 'Stateless tests (arm_asan_ubsan, azure, parallel, 5/8)': "Skipped, job name includes excluded tag 'arm'", 'Stateless tests (arm_asan_ubsan, azure, parallel, 6/8)': "Skipped, job name includes excluded tag 'arm'", 'Stateless tests (arm_asan_ubsan, azure, parallel, 7/8)': "Skipped, job name includes excluded tag 'arm'", 'Stateless tests (arm_asan_ubsan, azure, parallel, 8/8)': "Skipped, job name includes excluded tag 'arm'", 'Stateless tests (arm_asan_ubsan, azure, sequential, 1/2)': "Skipped, job name includes excluded tag 'arm'", 'Stateless tests (arm_asan_ubsan, azure, sequential, 2/2)': "Skipped, job name includes excluded tag 'arm'", 'Integration tests (arm_binary, distributed plan, 1/4)': "Skipped, job name includes excluded tag 'arm'", 'Integration tests (arm_binary, distributed plan, 2/4)': "Skipped, job name includes excluded tag 'arm'", 'Integration tests (arm_binary, distributed plan, 3/4)': "Skipped, job name includes excluded tag 'arm'", 'Integration tests (arm_binary, distributed plan, 4/4)': "Skipped, job name includes excluded tag 'arm'", 'Integration tests (amd_tsan, 1/8)': "Skipped, job name includes excluded tag 'tsan'", 'Integration tests (amd_tsan, 2/8)': "Skipped, job name includes excluded tag 'tsan'", 'Integration tests (amd_tsan, 3/8)': "Skipped, job name includes excluded tag 'tsan'", 'Integration tests (amd_tsan, 4/8)': "Skipped, job name includes excluded tag 'tsan'", 'Integration tests (amd_tsan, 5/8)': "Skipped, job name includes excluded tag 'tsan'", 'Integration tests (amd_tsan, 6/8)': "Skipped, job name includes excluded tag 'tsan'", 'Integration tests (amd_tsan, 7/8)': "Skipped, job name includes excluded tag 'tsan'", 'Integration tests (amd_tsan, 8/8)': "Skipped, job name includes excluded tag 'tsan'", 'Integration tests (amd_msan, 1/10)': "Skipped, job name includes excluded tag 'msan'", 'Integration tests (amd_msan, 2/10)': "Skipped, job name includes excluded tag 'msan'", 'Integration tests (amd_msan, 3/10)': "Skipped, job name includes excluded tag 'msan'", 'Integration tests (amd_msan, 4/10)': "Skipped, job name includes excluded tag 'msan'", 'Integration tests (amd_msan, 5/10)': "Skipped, job name includes excluded tag 'msan'", 'Integration tests (amd_msan, 6/10)': "Skipped, job name includes excluded tag 'msan'", 'Integration tests (amd_msan, 7/10)': "Skipped, job name includes excluded tag 'msan'", 'Integration tests (amd_msan, 8/10)': "Skipped, job name includes excluded tag 'msan'", 'Integration tests (amd_msan, 9/10)': "Skipped, job name includes excluded tag 'msan'", 'Integration tests (amd_msan, 10/10)': "Skipped, job name includes excluded tag 'msan'", 'Unit tests (tsan)': "Skipped, job name includes excluded tag 'tsan'", 'Unit tests (msan)': "Skipped, job name includes excluded tag 'msan'", 'Unit tests (tsan, function_prop_fuzzer)': "Skipped, job name includes excluded tag 'tsan'", 'Unit tests (msan, function_prop_fuzzer)': "Skipped, job name includes excluded tag 'msan'", 'Install packages (arm_release)': "Skipped, job name includes excluded tag 'arm'", 'Compatibility check (arm_release)': "Skipped, job name includes excluded tag 'arm'", 'Stress test (amd_tsan)': "Skipped, job name includes excluded tag 'tsan'", 'Stress test (amd_msan)': "Skipped, job name includes excluded tag 'msan'", 'Stress test (arm_release)': "Skipped, job name includes excluded tag 'arm'", 'Stress test (arm_debug)': "Skipped, job name includes excluded tag 'arm'", 'Stress test (arm_asan_ubsan)': "Skipped, job name includes excluded tag 'arm'", 'Stress test (arm_asan_ubsan, s3)': "Skipped, job name includes excluded tag 'arm'", 'Stress test (arm_tsan)': "Skipped, job name includes excluded tag 'arm'", 'Stress test (arm_msan)': "Skipped, job name includes excluded tag 'arm'", 'AST fuzzer (arm_asan_ubsan)': "Skipped, job name includes excluded tag 'arm'", 'AST fuzzer (amd_tsan)': "Skipped, job name includes excluded tag 'tsan'", 'AST fuzzer (amd_msan)': "Skipped, job name includes excluded tag 'msan'", 'BuzzHouse (arm_asan_ubsan)': "Skipped, job name includes excluded tag 'arm'", 'BuzzHouse (amd_tsan)': "Skipped, job name includes excluded tag 'tsan'", 'BuzzHouse (amd_msan)': "Skipped, job name includes excluded tag 'msan'", 'PromQL Compliance': "Skipped, PR not labeled 'comp-promql' — PromQL compliance comment job only", 'Keeper Stress Tests (PR)': 'Skipped, no changes in src/Coordination, tests/stress/keeper, or keeper_stress_job.py', 'Build Toolchain (PGO, BOLT) (amd64)': "Skipped, not labeled with 'ci-toolchain'", 'Build Toolchain (PGO, BOLT) (aarch64)': "Skipped, not labeled with 'ci-toolchain'", 'CI Tests': 'Not affected by the changed files and not required'}, 'sha': '93a0eb76cad0173884e89826c27200879de038ec', 'submodule_cache_hash': '09c946e3f45904e3', 'custom_data': {'version': {'revision': 54546, 'major': 26, 'minor': 8, 'patch': 34, 'tweak': 20001, 'githash': '4ca42662d1a0175631b2f340620d5a50dd049999', 'describe': 'v26.8.34.20001.altinityantalya', 'string': '26.8.34.20001.altinityantalya', 'flavour': 'altinityantalya'}, 'ci_exclude_tags': ['aarch64', 'arm', 'tsan', 'msan', 'coverage'], 'ci_regression_jobs': ['common', 'aggregate_functions', 'alter', 'benchmark', 'cas', 'clickhouse_keeper', 'iceberg', 'ldap', 'oauth', 'parquet', 'rbac', 'ssl_server', 's3', 's3_export', 'swarms', 'tiered_storage']}}) [2026-11-03 02:02:04] === Setup env finished === [2026-11-03 02:02:04] === Pre run script [Stateless tests (amd_asan_ubsan, distributed plan, parallel, selected tests)], workflow [PR] === [2026-11-03 02:02:04] NOTE: Repo state is clean before job start [2026-11-03 02:02:04] Update Job and Workflow Report [2026-11-03 02:02:05] NOTE: UsageStorage data will be initialized [2026-11-03 02:02:05] Downloaded file from S3 with version 22 using boto3 [2026-11-03 02:02:05] Uploaded file with version 23 using boto3 [2026-11-03 02:02:05] Workflow status changed: [RUNNING] -> [RUNNING] [2026-11-03 02:02:05] Download required artifacts [2026-11-03 02:02:05] --- Job requires s3 artifacts [[Artifact.Config(name='CH_AMD_ASAN_UBSAN', type='s3', path='/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/build/programs/self-extracting/clickhouse', compress_zst=False, optional=False, _provided_by='Build (amd_asan_ubsan)', ext={})]] [2026-11-03 02:02:29] === Pre run finished === [2026-11-03 02:02:29] === Run script [Stateless tests (amd_asan_ubsan, distributed plan, parallel, selected tests)], workflow [PR] === [2026-11-03 02:02:29] INFO: disk status before running a job: [2026-11-03 02:02:29] Run command: [df -h] [2026-11-03 02:02:29] Filesystem Size Used Avail Use% Mounted on [2026-11-03 02:02:29] tmpfs 6.2G 960K 6.2G 1% /run [2026-11-03 02:02:29] /dev/sda1 338G 9.5G 315G 3% / [2026-11-03 02:02:29] tmpfs 31G 0 31G 0% /dev/shm [2026-11-03 02:02:29] tmpfs 5.0M 0 5.0M 0% /run/lock [2026-11-03 02:02:29] /dev/sda15 253M 142K 252M 1% /boot/efi [2026-11-03 02:02:29] tmpfs 6.2G 4.0K 6.2G 1% /run/user/0 [2026-11-03 02:02:29] Run command: [docker system df] [2026-11-03 02:02:29] TYPE TOTAL ACTIVE SIZE RECLAIMABLE [2026-11-03 02:02:29] Images 0 0 0B 0B [2026-11-03 02:02:29] Containers 0 0 0B 0B [2026-11-03 02:02:29] Local Volumes 0 0 0B 0B [2026-11-03 02:02:29] Build Cache 0 0 0B 0B [2026-11-03 02:02:29] WARNING: Create mount dir point in advance to have the same owner [2026-11-03 02:02:29] Run command: [mkdir -p ./ci/tmp/var/lib/clickhouse] [2026-11-03 02:02:29] WARNING: Create mount dir point in advance to have the same owner [2026-11-03 02:02:29] Run command: [mkdir -p ./ci/tmp/etc/clickhouse-client] [2026-11-03 02:02:29] WARNING: Create mount dir point in advance to have the same owner [2026-11-03 02:02:29] Run command: [mkdir -p ./ci/tmp/etc/clickhouse-server] [2026-11-03 02:02:29] WARNING: Create mount dir point in advance to have the same owner [2026-11-03 02:02:29] Run command: [mkdir -p ./ci/tmp/etc/clickhouse-server1] [2026-11-03 02:02:29] WARNING: Create mount dir point in advance to have the same owner [2026-11-03 02:02:29] Run command: [mkdir -p ./ci/tmp/etc/clickhouse-server2] [2026-11-03 02:02:29] WARNING: Create mount dir point in advance to have the same owner [2026-11-03 02:02:29] Run command: [mkdir -p ./ci/tmp/var/log] [2026-11-03 02:02:29] --- Run command [docker run --init --oom-score-adj=1000 --rm --name praktika_e4c0463a3b47 -e PYTHONUNBUFFERED=1 -e PYTHONPATH='.:./ci' --volume ./:/home/ubuntu/_work/ClickHouse/ClickHouse --workdir=/home/ubuntu/_work/ClickHouse/ClickHouse --memory=127368159232 --cgroupns=host --cap-add=SYS_PTRACE --privileged --dns-search='.' --security-opt seccomp=unconfined --ulimit nofile=1048576:1048576 --tmpfs /tmp/clickhouse:mode=1777 --volume=./ci/tmp/var/lib/clickhouse:/var/lib/clickhouse --volume=./ci/tmp/etc/clickhouse-client:/etc/clickhouse-client --volume=./ci/tmp/etc/clickhouse-server:/etc/clickhouse-server --volume=./ci/tmp/etc/clickhouse-server1:/etc/clickhouse-server1 --volume=./ci/tmp/etc/clickhouse-server2:/etc/clickhouse-server2 --volume=./ci/tmp/var/log:/var/log --env=AZURE_STORAGE_KEY=$AZURE_STORAGE_KEY --env=AZURE_ACCOUNT_NAME=$AZURE_ACCOUNT_NAME --env=AZURE_CONTAINER_NAME=$AZURE_CONTAINER_NAME --env=AZURE_STORAGE_ACCOUNT_URL=$AZURE_STORAGE_ACCOUNT_URL --env=CLICKHOUSE_TEST_STAT_URL=$CLICKHOUSE_TEST_STAT_URL --env=CLICKHOUSE_TEST_STAT_LOGIN=$CLICKHOUSE_TEST_STAT_LOGIN --env=CLICKHOUSE_TEST_STAT_PASSWORD=$CLICKHOUSE_TEST_STAT_PASSWORD --add-host=dockerhub-proxy.dockerhub-proxy-zone:65.108.242.32 altinityinfra/stateless-test:0dc483b9acdcd894e95f_amd python3 ./ci/jobs/functional_tests.py --options "amd_asan_ubsan, distributed plan, parallel, selected tests"] [2026-11-03 02:02:29] Run command: [timeout --verbose 300 docker pull altinityinfra/stateless-test:0dc483b9acdcd894e95f_amd] [2026-11-03 02:02:30] 0dc483b9acdcd894e95f_amd: Pulling from altinityinfra/stateless-test [2026-11-03 02:02:30] 1cac3721050a: Pulling fs layer [2026-11-03 02:02:30] 19d820a2c1e5: Pulling fs layer [2026-11-03 02:02:30] 444dc467b90d: Pulling fs layer [2026-11-03 02:02:30] 2c5c2ec67eb1: Pulling fs layer [2026-11-03 02:02:30] 2c1ce468d9f3: Pulling fs layer [2026-11-03 02:02:30] 44069b3884d1: Pulling fs layer [2026-11-03 02:02:30] d08f49adb969: Pulling fs layer [2026-11-03 02:02:30] c82e00478455: Pulling fs layer [2026-11-03 02:02:30] 13ccea9f55bc: Pulling fs layer [2026-11-03 02:02:30] c3ba06c384b7: Pulling fs layer [2026-11-03 02:02:30] 022bfa77d190: Pulling fs layer [2026-11-03 02:02:30] 91eeebc24234: Pulling fs layer [2026-11-03 02:02:30] 7f5b143774f5: Pulling fs layer [2026-11-03 02:02:30] 249d403e0ebb: Pulling fs layer [2026-11-03 02:02:30] 5484abf12191: Pulling fs layer [2026-11-03 02:02:30] 8136910c94a7: Pulling fs layer [2026-11-03 02:02:30] 1040ca0380d2: Pulling fs layer [2026-11-03 02:02:30] 2b6df0120196: Pulling fs layer [2026-11-03 02:02:30] 2c5c2ec67eb1: Waiting [2026-11-03 02:02:30] c9a5d08720ee: Pulling fs layer [2026-11-03 02:02:30] d2eb60b2b0c7: Pulling fs layer [2026-11-03 02:02:30] d08f49adb969: Waiting [2026-11-03 02:02:30] 44069b3884d1: Waiting [2026-11-03 02:02:30] c82e00478455: Waiting [2026-11-03 02:02:30] c3ba06c384b7: Waiting [2026-11-03 02:02:30] 2c1ce468d9f3: Waiting [2026-11-03 02:02:30] 13ccea9f55bc: Waiting [2026-11-03 02:02:30] 022bfa77d190: Waiting [2026-11-03 02:02:30] 172f8faf4548: Pulling fs layer [2026-11-03 02:02:30] 7f5b143774f5: Waiting [2026-11-03 02:02:30] 44676fdcf3dd: Pulling fs layer [2026-11-03 02:02:30] 679a977edd32: Pulling fs layer [2026-11-03 02:02:30] 8136910c94a7: Waiting [2026-11-03 02:02:30] 009206d3e518: Pulling fs layer [2026-11-03 02:02:30] 5484abf12191: Waiting [2026-11-03 02:02:30] 249d403e0ebb: Waiting [2026-11-03 02:02:30] 91eeebc24234: Waiting [2026-11-03 02:02:30] 1040ca0380d2: Waiting [2026-11-03 02:02:30] 942a0000a039: Pulling fs layer [2026-11-03 02:02:30] 9609905d11ac: Pulling fs layer [2026-11-03 02:02:30] 768c1160d30c: Pulling fs layer [2026-11-03 02:02:30] 009206d3e518: Waiting [2026-11-03 02:02:30] 44676fdcf3dd: Waiting [2026-11-03 02:02:30] 2e201d90f06c: Pulling fs layer [2026-11-03 02:02:30] 942a0000a039: Waiting [2026-11-03 02:02:30] 1bbc51953627: Pulling fs layer [2026-11-03 02:02:30] c78c4b2fea53: Pulling fs layer [2026-11-03 02:02:30] b7d8fcb065c6: Pulling fs layer [2026-11-03 02:02:30] 768c1160d30c: Waiting [2026-11-03 02:02:30] 2e201d90f06c: Waiting [2026-11-03 02:02:30] 8a6745b8ded9: Pulling fs layer [2026-11-03 02:02:30] c78c4b2fea53: Waiting [2026-11-03 02:02:30] 1bbc51953627: Waiting [2026-11-03 02:02:30] 36e14dabf8fc: Pulling fs layer [2026-11-03 02:02:30] 8a6745b8ded9: Waiting [2026-11-03 02:02:30] 643c83af8dd1: Pulling fs layer [2026-11-03 02:02:30] c3c4774351a0: Pulling fs layer [2026-11-03 02:02:30] b7925141880f: Pulling fs layer [2026-11-03 02:02:30] b7d8fcb065c6: Waiting [2026-11-03 02:02:30] 679a977edd32: Waiting [2026-11-03 02:02:30] 6421eed88363: Pulling fs layer [2026-11-03 02:02:30] b7925141880f: Waiting [2026-11-03 02:02:30] 36e14dabf8fc: Waiting [2026-11-03 02:02:30] 643c83af8dd1: Waiting [2026-11-03 02:02:30] c3c4774351a0: Waiting [2026-11-03 02:02:30] 6421eed88363: Waiting [2026-11-03 02:02:30] 172f8faf4548: Waiting [2026-11-03 02:02:30] 2b6df0120196: Waiting [2026-11-03 02:02:30] d2eb60b2b0c7: Waiting [2026-11-03 02:02:30] c9a5d08720ee: Waiting [2026-11-03 02:02:31] 19d820a2c1e5: Verifying Checksum [2026-11-03 02:02:31] 19d820a2c1e5: Download complete [2026-11-03 02:02:31] 1cac3721050a: Verifying Checksum [2026-11-03 02:02:31] 1cac3721050a: Download complete [2026-11-03 02:02:31] 444dc467b90d: Verifying Checksum [2026-11-03 02:02:31] 444dc467b90d: Download complete [2026-11-03 02:02:31] 2c1ce468d9f3: Verifying Checksum [2026-11-03 02:02:31] 2c1ce468d9f3: Download complete [2026-11-03 02:02:32] 44069b3884d1: Verifying Checksum [2026-11-03 02:02:32] 44069b3884d1: Download complete [2026-11-03 02:02:32] 1cac3721050a: Pull complete [2026-11-03 02:02:32] 19d820a2c1e5: Pull complete [2026-11-03 02:02:32] c82e00478455: Verifying Checksum [2026-11-03 02:02:32] c82e00478455: Download complete [2026-11-03 02:02:32] d08f49adb969: Verifying Checksum [2026-11-03 02:02:32] d08f49adb969: Download complete [2026-11-03 02:02:32] 2c5c2ec67eb1: Verifying Checksum [2026-11-03 02:02:32] 2c5c2ec67eb1: Download complete [2026-11-03 02:02:32] 13ccea9f55bc: Verifying Checksum [2026-11-03 02:02:32] 13ccea9f55bc: Download complete [2026-11-03 02:02:32] 444dc467b90d: Pull complete [2026-11-03 02:02:33] 91eeebc24234: Verifying Checksum [2026-11-03 02:02:33] 91eeebc24234: Download complete [2026-11-03 02:02:33] 7f5b143774f5: Verifying Checksum [2026-11-03 02:02:33] 7f5b143774f5: Download complete [2026-11-03 02:02:33] 022bfa77d190: Verifying Checksum [2026-11-03 02:02:33] 022bfa77d190: Download complete [2026-11-03 02:02:33] c3ba06c384b7: Verifying Checksum [2026-11-03 02:02:33] c3ba06c384b7: Download complete [2026-11-03 02:02:34] 5484abf12191: Download complete [2026-11-03 02:02:34] 8136910c94a7: Verifying Checksum [2026-11-03 02:02:34] 8136910c94a7: Download complete [2026-11-03 02:02:34] 1040ca0380d2: Download complete [2026-11-03 02:02:34] 2b6df0120196: Verifying Checksum [2026-11-03 02:02:34] 2b6df0120196: Download complete [2026-11-03 02:02:34] d2eb60b2b0c7: Verifying Checksum [2026-11-03 02:02:34] d2eb60b2b0c7: Download complete [2026-11-03 02:02:35] c9a5d08720ee: Verifying Checksum [2026-11-03 02:02:35] c9a5d08720ee: Download complete [2026-11-03 02:02:35] 172f8faf4548: Verifying Checksum [2026-11-03 02:02:35] 172f8faf4548: Download complete [2026-11-03 02:02:35] 2c5c2ec67eb1: Pull complete [2026-11-03 02:02:35] 2c1ce468d9f3: Pull complete [2026-11-03 02:02:35] 44069b3884d1: Pull complete [2026-11-03 02:02:35] 009206d3e518: Download complete [2026-11-03 02:02:36] 942a0000a039: Verifying Checksum [2026-11-03 02:02:36] 942a0000a039: Download complete [2026-11-03 02:02:37] d08f49adb969: Pull complete [2026-11-03 02:02:37] c82e00478455: Pull complete [2026-11-03 02:02:37] 13ccea9f55bc: Pull complete [2026-11-03 02:02:37] 768c1160d30c: Verifying Checksum [2026-11-03 02:02:37] 768c1160d30c: Download complete [2026-11-03 02:02:37] 2e201d90f06c: Verifying Checksum [2026-11-03 02:02:37] 2e201d90f06c: Download complete [2026-11-03 02:02:38] 1bbc51953627: Verifying Checksum [2026-11-03 02:02:38] 1bbc51953627: Download complete [2026-11-03 02:02:39] c78c4b2fea53: Verifying Checksum [2026-11-03 02:02:39] c78c4b2fea53: Download complete [2026-11-03 02:02:40] c3ba06c384b7: Pull complete [2026-11-03 02:02:40] b7d8fcb065c6: Verifying Checksum [2026-11-03 02:02:40] b7d8fcb065c6: Download complete [2026-11-03 02:02:40] 9609905d11ac: Verifying Checksum [2026-11-03 02:02:40] 9609905d11ac: Download complete [2026-11-03 02:02:41] 8a6745b8ded9: Verifying Checksum [2026-11-03 02:02:41] 8a6745b8ded9: Download complete [2026-11-03 02:02:41] 022bfa77d190: Pull complete [2026-11-03 02:02:41] 91eeebc24234: Pull complete [2026-11-03 02:02:41] 7f5b143774f5: Pull complete [2026-11-03 02:02:41] 643c83af8dd1: Verifying Checksum [2026-11-03 02:02:41] 643c83af8dd1: Download complete [2026-11-03 02:02:41] 249d403e0ebb: Verifying Checksum [2026-11-03 02:02:41] 249d403e0ebb: Download complete [2026-11-03 02:02:41] c3c4774351a0: Verifying Checksum [2026-11-03 02:02:41] c3c4774351a0: Download complete [2026-11-03 02:02:42] 6421eed88363: Download complete [2026-11-03 02:02:42] 36e14dabf8fc: Verifying Checksum [2026-11-03 02:02:42] 36e14dabf8fc: Download complete [2026-11-03 02:02:42] b7925141880f: Verifying Checksum [2026-11-03 02:02:42] b7925141880f: Download complete [2026-11-03 02:02:53] 249d403e0ebb: Pull complete [2026-11-03 02:02:53] 5484abf12191: Pull complete [2026-11-03 02:02:53] 8136910c94a7: Pull complete [2026-11-03 02:02:53] 1040ca0380d2: Pull complete [2026-11-03 02:02:53] 2b6df0120196: Pull complete [2026-11-03 02:02:54] c9a5d08720ee: Pull complete [2026-11-03 02:02:54] d2eb60b2b0c7: Pull complete [2026-11-03 02:02:54] 172f8faf4548: Pull complete [2026-11-03 02:02:54] 44676fdcf3dd: Pull complete [2026-11-03 02:02:54] 679a977edd32: Pull complete [2026-11-03 02:02:54] 009206d3e518: Pull complete [2026-11-03 02:02:54] 942a0000a039: Pull complete [2026-11-03 02:03:11] 9609905d11ac: Pull complete [2026-11-03 02:03:20] 768c1160d30c: Pull complete [2026-11-03 02:03:20] 2e201d90f06c: Pull complete [2026-11-03 02:03:20] 1bbc51953627: Pull complete [2026-11-03 02:03:26] c78c4b2fea53: Pull complete [2026-11-03 02:03:27] b7d8fcb065c6: Pull complete [2026-11-03 02:03:28] 8a6745b8ded9: Pull complete [2026-11-03 02:03:30] 36e14dabf8fc: Pull complete [2026-11-03 02:03:30] 643c83af8dd1: Pull complete [2026-11-03 02:03:30] c3c4774351a0: Pull complete [2026-11-03 02:03:33] b7925141880f: Pull complete [2026-11-03 02:03:33] 6421eed88363: Pull complete [2026-11-03 02:03:33] Digest: sha256:2d420088b7975de30f7bddab8b3c24798f2e05e34627d2a1d29f041ad9e8bbd1 [2026-11-03 02:03:33] Status: Downloaded newer image for altinityinfra/stateless-test:0dc483b9acdcd894e95f_amd [2026-11-03 02:03:33] docker.io/altinityinfra/stateless-test:0dc483b9acdcd894e95f_amd [2026-11-03 02:03:33] NOTE: Host metrics collection started (fine 1.0s, window 5.0s, disk on, psi on, file [./ci/tmp/host_metrics.jsonl]) [2026-11-03 02:03:34] Subprocess started, pid [4628] [2026-11-03 02:03:35] NOTE: Enabled config option [--distributed-plan] [2026-11-03 02:03:35] NOTE: Enabled test runner option [--no-sequential] [2026-11-03 02:03:35] Workers count set to optimal value: 8 [2026-11-03 02:03:35] Detected changed test: '05045_iceberg_manifest_partition_arity' (from 'tests/queries/0_stateless/05045_iceberg_manifest_partition_arity.reference') [2026-11-03 02:03:35] Detected changed test: '05045_iceberg_manifest_partition_arity' (from 'tests/queries/0_stateless/05045_iceberg_manifest_partition_arity.sh') [2026-11-03 02:03:35] NOTE: Workflow [VectorSearchStress.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [create_release.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [sync_silk.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [nightly_cloud_api_docs.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [nightly_upload.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [nightly_fuzzers.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [hourly.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [nightly_keeper_faults.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [weekly_cfi.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [optimize_clickhouse.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] Read workflow [PR] config from [pull_request.py] [2026-11-03 02:03:35] NOTE: Workflow [optimize_toolchain.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [nightly_jepsen.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [release_branches.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [auto_releases.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [nightly_statistics.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [nightly_sqlancer.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [pr_version_info.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [merge_queue.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [nightly_changelog.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [nightly_docs_autogen.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [backport_branches.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [nightly_keeper.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [custom_build_praktika.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] NOTE: Workflow [nightly_coverage.py] is disabled via Settings.DISABLED_WORKFLOWS - skip [2026-11-03 02:03:35] Enable praktika job [Dockers Build (amd)] for [PR] [2026-11-03 02:03:35] Add automatic digest config for [Dockers Build (amd)] job [2026-11-03 02:03:35] Enable praktika job [Dockers Build (arm)] for [PR] [2026-11-03 02:03:35] Add automatic digest config for [Dockers Build (arm)] job [2026-11-03 02:03:35] Enable praktika job [Dockers Build (multiplatform manifest)] for [PR] [2026-11-03 02:03:35] Add automatic digest config for [Dockers Build (multiplatform manifest)] job [2026-11-03 02:03:35] Enable native job [Config Workflow] for [PR] [2026-11-03 02:03:35] Enable native job [Finish Workflow] for [PR] [2026-11-03 02:03:35] Parsed 0 test names: [] [2026-11-03 02:03:36] [find_tests] skipping 6 lines in non-tracked or shared-registry files (test scripts, docs, CI, contrib, ProfileEvents/Settings registries) [2026-11-03 02:03:36] [find_tests] skipping 3 shared-registry file(s): ['src/Common/ProfileEvents.cpp', 'src/Core/Settings.cpp', 'src/Core/SettingsChangesHistory.cpp'] [2026-11-03 02:03:36] [find_tests] querying coverage for 174 changed lines across 15 files [2026-11-03 02:03:39] [find_tests] CIDB query: 0.56s, response=0 bytes [2026-11-03 02:03:39] [find_tests] broad-tier2 query: 0.49s, response=0 bytes [2026-11-03 02:03:40] [find_tests] ultra-broad query: 0.47s, response=0 bytes [2026-11-03 02:03:40] [find_tests] done in 3.84s: 0/174 lines matched, 0 unique tests selected [2026-11-03 02:03:40] [find_tests] keyword-fallback: 50 tests matching keywords ['Iterator', 'Object'] (from 50 candidates) [2026-11-03 02:03:40] [find_tests] keyword-fallback: 50 tests matching keywords ['Metadata', 'Object'] (from 113 candidates) [2026-11-03 02:03:40] [find_tests] keyword-fallback: 50 tests matching keywords ['Iterator', 'Object'] (from 50 candidates) [2026-11-03 02:03:40] [find_tests] keyword-fallback: 50 tests matching keywords ['Manifest', 'Object'] (from 57 candidates) [2026-11-03 02:03:40] [find_tests] keyword-fallback: 50 tests matching keywords ['Metadata', 'Object'] (from 113 candidates) [2026-11-03 02:03:40] [find_tests] keyword-fallback: 50 tests matching keywords ['Manifest', 'Object'] (from 57 candidates) [2026-11-03 02:03:40] [find_tests] keyword-fallback: 50 tests matching keywords ['Metadata', 'Object'] (from 113 candidates) [2026-11-03 02:03:41] [find_tests] keyword-fallback: 50 tests matching keywords ['Object', 'Snapshot'] (from 61 candidates) [2026-11-03 02:03:41] [find_tests] keyword-fallback: 50 tests matching keywords ['Iterator', 'Object'] (from 50 candidates) [2026-11-03 02:03:41] [find_tests] keyword-fallback: 50 tests matching keywords ['Iterator', 'Object'] (from 50 candidates) [2026-11-03 02:03:41] [find_tests] keyword-fallback: 50 tests matching keywords ['Manifest', 'Object'] (from 57 candidates) [2026-11-03 02:03:41] [find_tests] keyword-fallback: 50 tests matching keywords ['Manifest', 'Object'] (from 57 candidates) [2026-11-03 02:03:41] [find_tests] keyword-fallback: 47 tests matching keywords ['Object', 'Stateless'] (from 47 candidates) [2026-11-03 02:03:41] [find_tests] keyword-fallback: 46 tests matching keywords ['Object'] (from 46 candidates) [2026-11-03 02:03:41] [find_tests] keyword-fallback: 50 tests matching keywords ['Manifest', 'Object'] (from 57 candidates) [2026-11-03 02:03:41] [selected tests] 70 tests to run: ['05045_iceberg_manifest_partition_arity.', '03999_stateless_settings_history.', '03850_nested_cluster_table_function_task_iterator.', '03784_msan_token_iterator.', '03611_verify_exception_in_iceberg_iterator.', '05323_iceberg_tolerate_conflicting_manifest_schemas_compatibility.', '05301_paimon_manifest_path_traversal.', '05292_iceberg_malformed_manifest_list_writer.', '05026_cas_manifest_path_newline.', '04615_ast_json_optimize_manifest_show_like_where.', '04614_iceberg_count_malformed_manifest_row_counts.', '04613_iceberg_drop_partition_whole_manifest.', '04201_iceberg_manifest_per_file_stats.', '05008_cas_gc_snapshot_prune.', '04726_streaming_queries_commit_order_snapshot_plan.', '04619_streaming_queries_shared_snapshot_strip_race.', '04611_iceberg_count_ignores_corrupted_snapshot_summary.', '04119_parser_snapshot_query_ast_format.', '04092_format_unlock_snapshot.', '04075_delta_lake_snapshot_version_without_kernel.', '04073_backup_from_snapshot_ast_format.', '04060_transaction_snapshot_visibility.', '04039_merge_tree_snapshot_teardown_race.', '03978_alter_table_execute_expire_snapshots_parse.', '03775_paimon_target_snapshot.', '03546_merge_tree_projection_shared_snapshot.', '05384_object_storage_reader_exception_buffer_lifetime.', '05296_parquet_variant_json_objects.', '05211_local_object_storage_path_embedded_nul.', '05021_json_max_dynamic_subcolumns_in_parsing_nested_objects.', '04893_object_storage_optimize_not_supported.', '04839_parquet_lazy_materialization_object_storage_json_subcolumn.', '04836_handler_temporary_object_safe_methods.', '04775_backup_disk_source_grants_object_storage.', '04660_lazy_materialization_object_storage_filter_only_default.', '04650_lazy_materialization_object_storage_column_defaults.', '04627_object_storage_lazy_hive_partitioning.', '04625_lazy_materialization_object_storage_unpinned.', '04615_substreams_prefix_cache_map_shared_data_subobject.', '04612_parquet_lazy_materialization_object_storage.', '04611_show_create_hint_object_level_grant.', '04341_packed_skip_indices_drop_size_object_storage.', '04331_type_json_allow_duplicated_key_with_literal_and_nested_object_typed_paths.', '04303_object_storage_prewhere_isnotnull_subcolumn.', '04303_object_storage_cluster_fallback_to_local_if_empty.', '04260_one_format_s3_no_object_reads.', '04119_object_storage_bad_arg_count_no_logical_error.', '04093_json_enum_null_whole_object.', '04053_row_policy_object_storage.', '04042_object_storage_listing_profile_events.', '04040_object_storage_parallelize_output.', '03924_duplicated_key_with_literal_and_nested_object_in_typed_paths_in_json.', '03914_json_functions_with_object_type.', '03903_alter_update_object_storage_crash.', '03779_json_allow_duplicated_path_with_nested_object_and_literal.', '03776_local_object_storage_blob_storage_log.', '03644_object_storage_correlated_subqueries.', '03578_copy_file_in_object_storage.', '03284_json_object_as_tuple_duplicate_keys.', '03250_json_group_by_sub_object_subcolumn.', '03247_object_column_copy.', '02874_infer_objects_as_named_tuples.', '02731_zero_objects_in_metadata.', '02714_local_object_storage.', '02500_bson_read_object_id.', '02499_read_json_objects_as_strings.', '05306_iceberg_table_function_metadata_staleness_no_list.', '05294_metadata_only_alter_guard_alias_dependency.', '05218_trivial_count_sparsity_filter_after_metadata_only_alter.', '05214_iceberg_drop_partition_explicit_metadata.'] [2026-11-03 02:03:41] Job will start from stage [install] [2026-11-03 02:03:41] > Start execution for [Install ClickHouse] [2026-11-03 02:03:41] Run command: [rm -rf /etc/clickhouse-client/* /etc/clickhouse-server/* /etc/clickhouse-server1/* /etc/clickhouse-server2/*] [2026-11-03 02:03:41] Run command: [mkdir -p /usr/share/clickhouse/ && ln -sf /usr/local/include /usr/share/clickhouse/protos] [2026-11-03 02:03:41] Run command: [ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-server] [2026-11-03 02:03:41] Run command: [ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client] [2026-11-03 02:03:41] Run command: [ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-compressor] [2026-11-03 02:03:41] Run command: [ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-local] [2026-11-03 02:03:41] Run command: [ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-disks] [2026-11-03 02:03:41] Run command: [ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-obfuscator] [2026-11-03 02:03:41] Run command: [ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-format] [2026-11-03 02:03:41] Run command: [ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/ch] [2026-11-03 02:03:41] Run command: [ln -sf /usr/bin/clickhouse-odbc-bridge /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-odbc-bridge] [2026-11-03 02:03:41] Run command: [cp programs/server/config.xml programs/server/users.xml /etc/clickhouse-server/] [2026-11-03 02:03:41] Run command: [./tests/config/install.sh /etc/clickhouse-server /etc/clickhouse-client --distributed-plan] [2026-11-03 02:03:41] + DEST_SERVER_PATH=/etc/clickhouse-server [2026-11-03 02:03:41] + DEST_CLIENT_PATH=/etc/clickhouse-client [2026-11-03 02:03:41] +++ dirname ./tests/config/install.sh [2026-11-03 02:03:41] ++ cd ./tests/config [2026-11-03 02:03:41] ++ pwd -P [2026-11-03 02:03:41] + SRC_PATH=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/config [2026-11-03 02:03:41] + '[' 3 -ge 2 ']' [2026-11-03 02:03:41] + shift 2 [2026-11-03 02:03:41] + FAST_TEST=0 [2026-11-03 02:03:41] + EXPORT_S3_STORAGE_POLICIES=1 [2026-11-03 02:03:41] + USE_AZURE_STORAGE_FOR_MERGE_TREE= [2026-11-03 02:03:41] + USE_ASYNC_INSERT= [2026-11-03 02:03:41] + BUGFIX_VALIDATE_CHECK=0 [2026-11-03 02:03:41] + PREVIOUS_RELEASE_CONFIG=0 [2026-11-03 02:03:41] + NO_AZURE=0 [2026-11-03 02:03:41] + KEEPER_INJECT_AUTH=1 [2026-11-03 02:03:41] + WASM_ENGINE= [2026-11-03 02:03:41] + REMOTE_DATABASE_DISK=0 [2026-11-03 02:03:41] + LLVM_COVERAGE=0 [2026-11-03 02:03:41] + [[ 1 -gt 0 ]] [2026-11-03 02:03:41] + case $1 in [2026-11-03 02:03:41] + USE_DISTRIBUTED_PLAN=1 [2026-11-03 02:03:41] + shift [2026-11-03 02:03:41] + [[ 0 -gt 0 ]] [2026-11-03 02:03:41] + echo 'Going to install test configs from /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config into /etc/clickhouse-server' [2026-11-03 02:03:41] Going to install test configs from /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config into /etc/clickhouse-server [2026-11-03 02:03:41] + mkdir -p /etc/clickhouse-server/users.d/ [2026-11-03 02:03:41] + mkdir -p /etc/clickhouse-client [2026-11-03 02:03:41] + rm -rf /etc/clickhouse-server/config.d [2026-11-03 02:03:41] + mkdir -p /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/tmp.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/core_dump.yaml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/zookeeper_write.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/max_num_to_warn.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/listen.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/text_log.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/blob_storage_log.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/predicate_statistics_log.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/custom_settings_prefixes.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/database_catalog_drop_table_concurrency.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/enable_access_control_improvements.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/allow_experimental_export_merge_tree_partition.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/macros.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/secure_ports.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/clusters.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/graphite.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/graphite_alternative.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/grpc_protocol.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/database_atomic.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/max_concurrent_queries.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/merge_tree_settings.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/backoff_policy.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:41] + check_clickhouse_version 25.4 [2026-11-03 02:03:41] + local required_version=25.4 [2026-11-03 02:03:41] + shift [2026-11-03 02:03:41] ++ clickhouse --version [2026-11-03 02:03:41] ++ awk '{print $4}' [2026-11-03 02:03:47] Decompressing the binary............................................................ [2026-11-03 02:03:48] + current_version=26.8.34.20001.altinityantalya. [2026-11-03 02:03:48] ++ printf '%s\n' 25.4 26.8.34.20001.altinityantalya. [2026-11-03 02:03:48] ++ sort -V [2026-11-03 02:03:48] ++ head -n1 [2026-11-03 02:03:48] + '[' 25.4 = 25.4 ']' [2026-11-03 02:03:48] + echo 'ClickHouse version 26.8.34.20001.altinityantalya. is OK (>= 25.4)' [2026-11-03 02:03:48] ClickHouse version 26.8.34.20001.altinityantalya. is OK (>= 25.4) [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/backoff_policy_25_4.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/merge_tree_old_dirs_cleanup.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/test_cluster_with_incorrect_pw.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + check_clickhouse_version 25.10 [2026-11-03 02:03:48] + local required_version=25.10 [2026-11-03 02:03:48] + shift [2026-11-03 02:03:48] ++ clickhouse --version [2026-11-03 02:03:48] ++ awk '{print $4}' [2026-11-03 02:03:48] + current_version=26.8.34.20001.altinityantalya. [2026-11-03 02:03:48] ++ printf '%s\n' 25.10 26.8.34.20001.altinityantalya. [2026-11-03 02:03:48] ++ sort -V [2026-11-03 02:03:48] ++ head -n1 [2026-11-03 02:03:48] + '[' 25.10 = 25.10 ']' [2026-11-03 02:03:48] ClickHouse version 26.8.34.20001.altinityantalya. is OK (>= 25.10) [2026-11-03 02:03:48] + echo 'ClickHouse version 26.8.34.20001.altinityantalya. is OK (>= 25.10)' [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/keeper_max_request_size.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/logging_no_rotate.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/merge_tree.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/lost_forever_check.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/tcp_with_proxy.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/prometheus.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/top_level_domains_lists.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/top_level_domains_path.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/transactions_info_log.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/transactions.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/encryption.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/zookeeper_log.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/small_caches.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + value=0 [2026-11-03 02:03:48] + echo 'Async logging: 0' [2026-11-03 02:03:48] Async logging: 0 [2026-11-03 02:03:48] + sed 's|[01]|0|' /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/logger_trace.xml [2026-11-03 02:03:48] + default_compression_codec_options=("LZ4" "ZSTD(1)" "ZSTD(3)") [2026-11-03 02:03:48] + default_compression_codec=LZ4 [2026-11-03 02:03:48] + echo 'Default compression codec: LZ4' [2026-11-03 02:03:48] Default compression codec: LZ4 [2026-11-03 02:03:48] + echo '' [2026-11-03 02:03:48] + echo ' ' [2026-11-03 02:03:48] + echo ' LZ4' [2026-11-03 02:03:48] + echo ' ' [2026-11-03 02:03:48] + echo '' [2026-11-03 02:03:48] + overcommit_evict_step_values=(8192 65536 1048576 10485760) [2026-11-03 02:03:48] + OVERCOMMIT_EVICT_STEP=65536 [2026-11-03 02:03:48] + echo 'Overcommit eviction evict step: 65536' [2026-11-03 02:03:48] Overcommit eviction evict step: 65536 [2026-11-03 02:03:48] + export OVERCOMMIT_EVICT_STEP [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/named_collection.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + cp /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/ssl_certs.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/filesystem_cache_log.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/filesystem_read_prefetches_log.yaml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/session_log.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/background_schedule_pool_log.yaml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/system_unfreeze.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/nlp.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/forbidden_headers.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/enable_keeper_map.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/custom_disks_base_path.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/display_name.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/compressed_marks_and_index.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/disable_s3_env_credentials.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/enable_wait_for_shutdown_replicated_tables.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + cp /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/storage_conf_backups.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + cp /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/backups.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + cp /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/filesystem_caches_path.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/validate_tcp_client_information.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + case "$(uname -s)" in [2026-11-03 02:03:48] ++ uname -s [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/distributed_query.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/zero_copy_destructive_operations.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/handlers.yaml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/threadpool_writer_pool_size.yaml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/serverwide_trace_collector.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:48] + is_sanitizer_build [2026-11-03 02:03:48] ++ clickhouse local --query 'SELECT value LIKE '\''%-DSANITIZER%'\'' FROM system.build_options WHERE name = '\''CXX_FLAGS'\''' [2026-11-03 02:03:49] + '[' 1 = 1 ']' [2026-11-03 02:03:49] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/trace_log_no_symbolize.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:49] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/memory_profiler.yaml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:49] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/rocksdb.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:49] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/process_query_plan_packet.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:49] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/storage_conf_03008.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:49] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/memory_access.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:49] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/jemalloc_enable_global_profiler.yaml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:49] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/jemalloc_flush_profile.yaml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:49] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/wait_remaining_connections.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:49] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/kafka.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:49] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/keeper_multiread_batch_size.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:49] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/zookeeper_enforce_component_name.yaml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:49] + '[' 0 '!=' 1 ']' [2026-11-03 02:03:49] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/abort_on_logical_error.yaml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:49] + [[ -n '' ]] [2026-11-03 02:03:49] + '[' 0 '!=' 1 ']' [2026-11-03 02:03:49] + is_openssl_fips_build [2026-11-03 02:03:49] ++ clickhouse local --query 'SELECT value FROM system.build_options where name = '\''USE_OPENSSL_FIPS'\'' LIMIT 1' [2026-11-03 02:03:50] + '[' '' -eq 1 ']' [2026-11-03 02:03:50] ./tests/config/install.sh: line 261: [: : integer expression expected [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/ssh.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/ssh_host_rsa_key /etc/clickhouse-server/config.d/ [2026-11-03 02:03:50] + '[' 0 '!=' 1 ']' [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/legacy_geobase.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/log_queries.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/readonly.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/ci_logs_sender.yaml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/access_management.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/database_atomic_drop_detach_sync.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/opentelemetry.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/remote_queries.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/session_log_test.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/memory_profiler.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/no_fsync_metadata.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/filelog.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/enable_blobs_check.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/marks.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/insert_keeper_retries.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/prefetch_settings.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/nonconst_timezone.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/allow_introspection_functions.yaml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/replicated_ddl_entry.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/limits.yaml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + check_clickhouse_version 26.8 [2026-11-03 02:03:50] + local required_version=26.8 [2026-11-03 02:03:50] + shift [2026-11-03 02:03:50] ++ clickhouse --version [2026-11-03 02:03:50] ++ awk '{print $4}' [2026-11-03 02:03:50] + current_version=26.8.34.20001.altinityantalya. [2026-11-03 02:03:50] ++ sort -V [2026-11-03 02:03:50] ++ printf '%s\n' 26.8 26.8.34.20001.altinityantalya. [2026-11-03 02:03:50] ++ head -n1 [2026-11-03 02:03:50] + '[' 26.8 = 26.8 ']' [2026-11-03 02:03:50] ClickHouse version 26.8.34.20001.altinityantalya. is OK (>= 26.8) [2026-11-03 02:03:50] + echo 'ClickHouse version 26.8.34.20001.altinityantalya. is OK (>= 26.8)' [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/http_paths.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/http_url_prefix.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:50] + check_clickhouse_version 26.1 [2026-11-03 02:03:50] + local required_version=26.1 [2026-11-03 02:03:50] + shift [2026-11-03 02:03:50] ++ clickhouse --version [2026-11-03 02:03:50] ++ awk '{print $4}' [2026-11-03 02:03:50] + current_version=26.8.34.20001.altinityantalya. [2026-11-03 02:03:50] ++ printf '%s\n' 26.1 26.8.34.20001.altinityantalya. [2026-11-03 02:03:50] ++ sort -V [2026-11-03 02:03:50] ++ head -n1 [2026-11-03 02:03:50] + '[' 26.1 = 26.1 ']' [2026-11-03 02:03:50] + echo 'ClickHouse version 26.8.34.20001.altinityantalya. is OK (>= 26.1)' [2026-11-03 02:03:50] ClickHouse version 26.8.34.20001.altinityantalya. is OK (>= 26.1) [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/distributed_index_analysis.yaml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + '[' 0 == 1 ']' [2026-11-03 02:03:50] + [[ -n '' ]] [2026-11-03 02:03:50] + [[ -n 1 ]] [2026-11-03 02:03:50] + [[ 1 -eq 1 ]] [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/distributed_plan.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + echo [2026-11-03 02:03:50] + [[ -n '' ]] [2026-11-03 02:03:50] + [[ -n 0 ]] [2026-11-03 02:03:50] + [[ 0 -eq 1 ]] [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/timeouts.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/ints_dictionary.xml /etc/clickhouse-server/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/strings_dictionary.xml /etc/clickhouse-server/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/decimals_dictionary.xml /etc/clickhouse-server/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/executable_dictionary.xml /etc/clickhouse-server/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/executable_pool_dictionary.xml /etc/clickhouse-server/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/test_function.xml /etc/clickhouse-server/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/top_level_domains /etc/clickhouse-server/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/regions_hierarchy.txt /etc/clickhouse-server/config.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/regions_names_en.txt /etc/clickhouse-server/config.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/regions_names_es.txt /etc/clickhouse-server/config.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/ext-en.txt /etc/clickhouse-server/config.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/ext-ru.txt /etc/clickhouse-server/config.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/lem-en.bin /etc/clickhouse-server/config.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/server.key /etc/clickhouse-server/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/server.crt /etc/clickhouse-server/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/dhparam.pem /etc/clickhouse-server/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/query_masking_rules.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:50] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/zookeeper.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:50] + [[ -n '' ]] [2026-11-03 02:03:51] + rm -f /etc/clickhouse-server/config.d/zookeeper_fault_injection.xml [2026-11-03 02:03:51] + [[ -n '' ]] [2026-11-03 02:03:51] + rm -f /etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml [2026-11-03 02:03:51] + [[ -n '' ]] [2026-11-03 02:03:51] + rm -f /etc/clickhouse-server/config.d/fail_points_active.xml [2026-11-03 02:03:51] + value_create_snapshot_on_exit=1 [2026-11-03 02:03:51] + echo 'Replacing create_snapshot_on_exit with 1' [2026-11-03 02:03:51] Replacing create_snapshot_on_exit with 1 [2026-11-03 02:03:51] + value_latest_logs_cache_size_threshold=11829248 [2026-11-03 02:03:51] + echo 'Replacing latest_logs_cache_size_threshold with 11829248' [2026-11-03 02:03:51] Replacing latest_logs_cache_size_threshold with 11829248 [2026-11-03 02:03:51] Replacing log_readahead_commit_window_bytes with 24989696 [2026-11-03 02:03:51] Replacing digest_enabled_on_commit with 0 [2026-11-03 02:03:51] Replacing nuraft_use_bg_thread_for_snapshot_io with 1 [2026-11-03 02:03:51] + value_log_readahead_commit_window_bytes=24989696 [2026-11-03 02:03:51] + echo 'Replacing log_readahead_commit_window_bytes with 24989696' [2026-11-03 02:03:51] + value=0 [2026-11-03 02:03:51] + echo 'Replacing digest_enabled_on_commit with 0' [2026-11-03 02:03:51] + value_nuraft_use_bg_thread_for_snapshot_io=1 [2026-11-03 02:03:51] + echo 'Replacing nuraft_use_bg_thread_for_snapshot_io with 1' [2026-11-03 02:03:51] + sed -E 's|[01]|1|; s|[[:digit:]]+|11829248|; s|[[:digit:]]+|24989696|; s|[01]|0|; s|[01]|1|' /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/keeper_port.xml [2026-11-03 02:03:51] + inject_auth=1 [2026-11-03 02:03:51] + [[ 1 -eq 0 ]] [2026-11-03 02:03:51] + [[ 1 -eq 1 ]] [2026-11-03 02:03:51] + echo 'Keeper connection will use auth' [2026-11-03 02:03:51] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/zookeeper_auth.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:51] Keeper connection will use auth [2026-11-03 02:03:51] + [[ -n '' ]] [2026-11-03 02:03:51] + [[ -n '' ]] [2026-11-03 02:03:51] + object_key_types_options=("generate-full-key" "generate-template-key") [2026-11-03 02:03:51] + object_key_type=generate-full-key [2026-11-03 02:03:51] + [[ -n '' ]] [2026-11-03 02:03:51] + [[ '' == \1 ]] [2026-11-03 02:03:51] + [[ '' == \1 ]] [2026-11-03 02:03:51] + [[ '' == \1 ]] [2026-11-03 02:03:51] + [[ '' == \1 ]] [2026-11-03 02:03:51] + [[ 1 == \1 ]] [2026-11-03 02:03:51] + [[ 0 != \1 ]] [2026-11-03 02:03:51] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/azure_storage_conf.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:51] + reserve_granularity_options=("1Mi" "4Mi" "8Mi") [2026-11-03 02:03:51] + reserve_granularity=4Mi [2026-11-03 02:03:51] + echo 'Replacing s3_cache reserve_granularity with 4Mi' [2026-11-03 02:03:51] Replacing s3_cache reserve_granularity with 4Mi [2026-11-03 02:03:51] + reserve_granularity_sed='//,/<\/s3_cache>/s|[^<]*|4Mi|' [2026-11-03 02:03:51] + check_clickhouse_version 25.5 [2026-11-03 02:03:51] + local required_version=25.5 [2026-11-03 02:03:51] + shift [2026-11-03 02:03:51] ++ clickhouse --version [2026-11-03 02:03:51] ++ awk '{print $4}' [2026-11-03 02:03:51] + current_version=26.8.34.20001.altinityantalya. [2026-11-03 02:03:51] ++ printf '%s\n' 25.5 26.8.34.20001.altinityantalya. [2026-11-03 02:03:51] ++ sort -V [2026-11-03 02:03:51] ++ head -n1 [2026-11-03 02:03:51] + '[' 25.5 = 25.5 ']' [2026-11-03 02:03:51] + echo 'ClickHouse version 26.8.34.20001.altinityantalya. is OK (>= 25.5)' [2026-11-03 02:03:51] ClickHouse version 26.8.34.20001.altinityantalya. is OK (>= 25.5) [2026-11-03 02:03:51] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/storage_conf_02944.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:51] + cp --remove-destination /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/storage_conf.xml /etc/clickhouse-server/config.d/storage_conf.xml [2026-11-03 02:03:51] + check_clickhouse_version 25.5 [2026-11-03 02:03:51] + local required_version=25.5 [2026-11-03 02:03:51] + shift [2026-11-03 02:03:51] ++ clickhouse --version [2026-11-03 02:03:51] ++ awk '{print $4}' [2026-11-03 02:03:51] + current_version=26.8.34.20001.altinityantalya. [2026-11-03 02:03:51] ++ printf '%s\n' 25.5 26.8.34.20001.altinityantalya. [2026-11-03 02:03:51] ++ sort -V [2026-11-03 02:03:51] ++ head -n1 [2026-11-03 02:03:51] + '[' 25.5 = 25.5 ']' [2026-11-03 02:03:51] + echo 'ClickHouse version 26.8.34.20001.altinityantalya. is OK (>= 25.5)' [2026-11-03 02:03:51] ClickHouse version 26.8.34.20001.altinityantalya. is OK (>= 25.5) [2026-11-03 02:03:51] + check_clickhouse_version 26.7 [2026-11-03 02:03:51] + local required_version=26.7 [2026-11-03 02:03:51] + shift [2026-11-03 02:03:51] ++ clickhouse --version [2026-11-03 02:03:51] ++ awk '{print $4}' [2026-11-03 02:03:52] + current_version=26.8.34.20001.altinityantalya. [2026-11-03 02:03:52] ++ printf '%s\n' 26.7 26.8.34.20001.altinityantalya. [2026-11-03 02:03:52] ++ sort -V [2026-11-03 02:03:52] ++ head -n1 [2026-11-03 02:03:52] + '[' 26.7 = 26.7 ']' [2026-11-03 02:03:52] + echo 'ClickHouse version 26.8.34.20001.altinityantalya. is OK (>= 26.7)' [2026-11-03 02:03:52] + check_clickhouse_version 26.7 [2026-11-03 02:03:52] ClickHouse version 26.8.34.20001.altinityantalya. is OK (>= 26.7) [2026-11-03 02:03:52] + local required_version=26.7 [2026-11-03 02:03:52] + shift [2026-11-03 02:03:52] ++ clickhouse --version [2026-11-03 02:03:52] ++ awk '{print $4}' [2026-11-03 02:03:52] + current_version=26.8.34.20001.altinityantalya. [2026-11-03 02:03:52] ++ printf '%s\n' 26.7 26.8.34.20001.altinityantalya. [2026-11-03 02:03:52] ++ sort -V [2026-11-03 02:03:52] ++ head -n1 [2026-11-03 02:03:52] + '[' 26.7 = 26.7 ']' [2026-11-03 02:03:52] + echo 'ClickHouse version 26.8.34.20001.altinityantalya. is OK (>= 26.7)' [2026-11-03 02:03:52] ClickHouse version 26.8.34.20001.altinityantalya. is OK (>= 26.7) [2026-11-03 02:03:52] + sed -i '//,/<\/s3_cache>/s|[^<]*|4Mi|' /etc/clickhouse-server/config.d/storage_conf.xml [2026-11-03 02:03:52] + [[ -n '' ]] [2026-11-03 02:03:52] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/storage_conf_02963.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:52] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/storage_conf_02961.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:52] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/storage_conf_03517.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:52] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/storage_conf_03755.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:52] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/storage_conf_04070.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:52] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/s3_settings_override.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:52] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/s3_cache.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:52] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/s3_cache_new.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:52] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/storage_conf_local.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:52] + [[ '' == \1 ]] [2026-11-03 02:03:52] + [[ '' == \1 ]] [2026-11-03 02:03:52] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/users.d/disable_async_inserts.xml /etc/clickhouse-server/users.d/ [2026-11-03 02:03:52] + [[ '' == \1 ]] [2026-11-03 02:03:52] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/config.d/wasm_udf.xml /etc/clickhouse-server/config.d/ [2026-11-03 02:03:52] + '[' '!' -z '' ']' [2026-11-03 02:03:52] + [[ 0 -eq 1 ]] [2026-11-03 02:03:52] + [[ 0 -eq 1 ]] [2026-11-03 02:03:52] + [[ 0 -eq 1 ]] [2026-11-03 02:03:52] + ln -sf /home/ubuntu/_work/ClickHouse/ClickHouse/tests/config/client_config.xml /etc/clickhouse-client/config.xml [2026-11-03 02:03:52] Run command: [clickhouse-server --version] [2026-11-03 02:03:52] ClickHouse server version 26.8.34.20001.altinityantalya. [2026-11-03 02:03:53] Run command: [sed -i 's|>/test/chroot|>/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/chroot|' /etc/clickhouse-server**/config.d/*.xml] [2026-11-03 02:03:53] Chosen random timezone: Atlantic/Bermuda [2026-11-03 02:03:53] Run command: [cat /usr/share/zoneinfo/Atlantic/Bermuda > /etc/localtime && echo 'Atlantic/Bermuda' > /etc/timezone] [2026-11-03 02:03:53] Start ClickHouse Server [2026-11-03 02:03:53] > Start execution for [Start ClickHouse Server] [2026-11-03 02:03:53] Started setup_seaweedfs.sh asynchronously with PID 405 [2026-11-03 02:04:05] Started azurite-rs asynchronously with PID 550 [2026-11-03 02:04:05] Run command: [dmesg --clear] [2026-11-03 02:04:05] Starting ClickHouse server replica 0, command: clickhouse-server --config-file /etc/clickhouse-server/config.xml --pid-file /etc/clickhouse-server/clickhouse-server.pid -- --path /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 --user_files_path /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0/user_files --top_level_domains_path /etc/clickhouse-server/top_level_domains --logger.stderr /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/var/log/clickhouse-server/stderr.log [2026-11-03 02:04:05] TSAN_OPTIONS = memory_limit_mb=40808 [2026-11-03 02:04:05] WARNING: stderr: cat: /etc/clickhouse-server/clickhouse-server.pid: No such file or directory [2026-11-03 02:04:05] Processing configuration file '/etc/clickhouse-server/config.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/abort_on_logical_error.yaml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/allow_experimental_export_merge_tree_partition.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/background_schedule_pool_log.yaml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/backoff_policy.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/backoff_policy_25_4.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/core_dump.yaml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/default_compression_codec.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/distributed_query.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/filesystem_read_prefetches_log.yaml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/http_url_prefix.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/jemalloc_enable_global_profiler.yaml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/jemalloc_flush_profile.yaml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/kafka.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/keeper_max_request_size.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/keeper_multiread_batch_size.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/memory_access.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/memory_profiler.yaml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/predicate_statistics_log.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/process_query_plan_packet.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/s3_settings_override.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/small_caches.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/ssh.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_03008.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_03517.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_03755.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_04070.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_backups.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_local.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/trace_log_no_symbolize.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/transactions_info_log.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/wait_remaining_connections.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/wasm_udf.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/zookeeper.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_auth.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_enforce_component_name.yaml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. [2026-11-03 02:04:05] Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. [2026-11-03 02:04:06] Got pid from fs [581] [2026-11-03 02:04:06] ClickHouse server replica 0 started successfully, pid [581] [2026-11-03 02:04:06] Run command [clickhouse-client --port 9000 --receive_timeout=5 --query "select 1"] [2026-11-03 02:04:06] Server replica 0 not ready, err: Code: 210. DB::NetException: Connection refused (localhost:9000). (NETWORK_ERROR), wait [2026-11-03 02:04:08] Run command [clickhouse-client --port 9000 --receive_timeout=5 --query "select 1"] [2026-11-03 02:04:09] Server replica 0 ready [2026-11-03 02:04:09] Run command: [clickhouse-client --port 9000 --query "system flush logs"] [2026-11-03 02:04:13] Run command: [clickhouse-client --port 9000 --query "SYSTEM FLUSH ASYNC INSERT QUEUE"] [2026-11-03 02:04:13] Started setup_kafka.sh asynchronously with PID 988 [2026-11-03 02:04:15] Run command: [MAX_INSERT_THREADS_BOOTSTRAP=4 [2026-11-03 02:04:15] MAX_INSERT_THREADS_BOOTSTRAP_S3=4 [2026-11-03 02:04:15] MAX_MEMORY_USAGE_BOOTSTRAP=25G [2026-11-03 02:04:15] MAX_MEMORY_USAGE_BOOTSTRAP_S3=30G [2026-11-03 02:04:15] STOP_MERGES_FOR_BOOTSTRAP=0 [2026-11-03 02:04:15] set -e [2026-11-03 02:04:15] set -o pipefail [2026-11-03 02:04:15] # Record which sub-command failed (set -e then exits). $BASH_COMMAND is the [2026-11-03 02:04:15] # failing command itself, so the captured reason names the exact query instead [2026-11-03 02:04:15] # of just a line number; combined with the ClickHouse client error already on [2026-11-03 02:04:15] # stderr this is captured below so the bugfix-validation re-prepare path can [2026-11-03 02:04:15] # report the real reason. [2026-11-03 02:04:15] trap 'rc=$?; echo "prepare_stateful_data: command [$BASH_COMMAND] at line $LINENO failed with exit $rc" >&2' ERR [2026-11-03 02:04:15] MAX_EXECUTION_TIME=1800 [2026-11-03 02:04:15] if [[ "${STOP_MERGES_FOR_BOOTSTRAP:-0}" -eq 1 ]]; then [2026-11-03 02:04:15] echo "Stopping merges for msan stateful preload" [2026-11-03 02:04:15] clickhouse-client --query "SYSTEM STOP MERGES" [2026-11-03 02:04:15] trap 'clickhouse-client --query "SYSTEM START MERGES" || true' EXIT [2026-11-03 02:04:15] fi [2026-11-03 02:04:15] clickhouse-client --query "SHOW DATABASES" [2026-11-03 02:04:15] clickhouse-client --query "CREATE DATABASE datasets" [2026-11-03 02:04:15] python3 ./ci/jobs/scripts/pick_endpoint.py create-sql ./tests/docker_scripts/create.sql | clickhouse-client [2026-11-03 02:04:15] S3_BASE=$(python3 ./ci/jobs/scripts/pick_endpoint.py tpcds) [2026-11-03 02:04:15] export S3_BASE [2026-11-03 02:04:15] bash ./tests/docker_scripts/create_tpcds.sh [2026-11-03 02:04:15] bash ./tests/docker_scripts/create_tpch.sh [2026-11-03 02:04:15] clickhouse-client --query "SHOW TABLES FROM datasets" [2026-11-03 02:04:15] clickhouse-client --query "SHOW TABLES FROM tpcds" [2026-11-03 02:04:15] clickhouse-client --query "SHOW TABLES FROM tpch" [2026-11-03 02:04:15] clickhouse-client --query "CREATE DATABASE test" [2026-11-03 02:04:15] clickhouse-client --query "SHOW TABLES FROM test" [2026-11-03 02:04:15] if [[ -n "$USE_S3_STORAGE_FOR_MERGE_TREE" ]] && [[ "$USE_S3_STORAGE_FOR_MERGE_TREE" -eq 1 ]]; then [2026-11-03 02:04:15] clickhouse-client --query "CREATE TABLE test.hits (WatchID UInt64, JavaEnable UInt8, Title String, GoodEvent Int16, EventTime DateTime, EventDate Date, CounterID UInt32, ClientIP UInt32, ClientIP6 FixedString(16), RegionID UInt32, UserID UInt64, CounterClass Int8, OS UInt8, UserAgent UInt8, URL String, Referer String, URLDomain String, RefererDomain String, Refresh UInt8, IsRobot UInt8, RefererCategories Array(UInt16), URLCategories Array(UInt16), URLRegions Array(UInt32), RefererRegions Array(UInt32), ResolutionWidth UInt16, ResolutionHeight UInt16, ResolutionDepth UInt8, FlashMajor UInt8, FlashMinor UInt8, FlashMinor2 String, NetMajor UInt8, NetMinor UInt8, UserAgentMajor UInt16, UserAgentMinor FixedString(2), CookieEnable UInt8, JavascriptEnable UInt8, IsMobile UInt8, MobilePhone UInt8, MobilePhoneModel String, Params String, IPNetworkID UInt32, TraficSourceID Int8, SearchEngineID UInt16, SearchPhrase String, AdvEngineID UInt8, IsArtifical UInt8, WindowClientWidth UInt16, WindowClientHeight UInt16, ClientTimeZone Int16, ClientEventTime DateTime, SilverlightVersion1 UInt8, SilverlightVersion2 UInt8, SilverlightVersion3 UInt32, SilverlightVersion4 UInt16, PageCharset String, CodeVersion UInt32, IsLink UInt8, IsDownload UInt8, IsNotBounce UInt8, FUniqID UInt64, HID UInt32, IsOldCounter UInt8, IsEvent UInt8, IsParameter UInt8, DontCountHits UInt8, WithHash UInt8, HitColor FixedString(1), UTCEventTime DateTime, Age UInt8, Sex UInt8, Income UInt8, Interests UInt16, Robotness UInt8, GeneralInterests Array(UInt16), RemoteIP UInt32, RemoteIP6 FixedString(16), WindowName Int32, OpenerName Int32, HistoryLength Int16, BrowserLanguage FixedString(2), BrowserCountry FixedString(2), SocialNetwork String, SocialAction String, HTTPError UInt16, SendTiming Int32, DNSTiming Int32, ConnectTiming Int32, ResponseStartTiming Int32, ResponseEndTiming Int32, FetchTiming Int32, RedirectTiming Int32, DOMInteractiveTiming Int32, DOMContentLoadedTiming Int32, DOMCompleteTiming Int32, LoadEventStartTiming Int32, LoadEventEndTiming Int32, NSToDOMContentLoadedTiming Int32, FirstPaintTiming Int32, RedirectCount Int8, SocialSourceNetworkID UInt8, SocialSourcePage String, ParamPrice Int64, ParamOrderID String, ParamCurrency FixedString(3), ParamCurrencyID UInt16, GoalsReached Array(UInt32), OpenstatServiceName String, OpenstatCampaignID String, OpenstatAdID String, OpenstatSourceID String, UTMSource String, UTMMedium String, UTMCampaign String, UTMContent String, UTMTerm String, FromTag String, HasGCLID UInt8, RefererHash UInt64, URLHash UInt64, CLID UInt32, YCLID UInt64, ShareService String, ShareURL String, ShareTitle String, ParsedParams Nested(Key1 String, Key2 String, Key3 String, Key4 String, Key5 String, ValueDouble Float64), IslandID FixedString(16), RequestNum UInt32, RequestTry UInt8) [2026-11-03 02:04:15] ENGINE = MergeTree() PARTITION BY toYYYYMM(EventDate) [2026-11-03 02:04:15] ORDER BY (CounterID, EventDate, intHash32(UserID)) SAMPLE BY intHash32(UserID) SETTINGS index_granularity = 8192, storage_policy='s3_cache'" [2026-11-03 02:04:15] clickhouse-client --query "CREATE TABLE test.visits (CounterID UInt32, StartDate Date, Sign Int8, IsNew UInt8, VisitID UInt64, UserID UInt64, StartTime DateTime, Duration UInt32, UTCStartTime DateTime, PageViews Int32, Hits Int32, IsBounce UInt8, Referer String, StartURL String, RefererDomain String, StartURLDomain String, EndURL String, LinkURL String, IsDownload UInt8, TraficSourceID Int8, SearchEngineID UInt16, SearchPhrase String, AdvEngineID UInt8, PlaceID Int32, RefererCategories Array(UInt16), URLCategories Array(UInt16), URLRegions Array(UInt32), RefererRegions Array(UInt32), IsYandex UInt8, GoalReachesDepth Int32, GoalReachesURL Int32, GoalReachesAny Int32, SocialSourceNetworkID UInt8, SocialSourcePage String, MobilePhoneModel String, ClientEventTime DateTime, RegionID UInt32, ClientIP UInt32, ClientIP6 FixedString(16), RemoteIP UInt32, RemoteIP6 FixedString(16), IPNetworkID UInt32, SilverlightVersion3 UInt32, CodeVersion UInt32, ResolutionWidth UInt16, ResolutionHeight UInt16, UserAgentMajor UInt16, UserAgentMinor UInt16, WindowClientWidth UInt16, WindowClientHeight UInt16, SilverlightVersion2 UInt8, SilverlightVersion4 UInt16, FlashVersion3 UInt16, FlashVersion4 UInt16, ClientTimeZone Int16, OS UInt8, UserAgent UInt8, ResolutionDepth UInt8, FlashMajor UInt8, FlashMinor UInt8, NetMajor UInt8, NetMinor UInt8, MobilePhone UInt8, SilverlightVersion1 UInt8, Age UInt8, Sex UInt8, Income UInt8, JavaEnable UInt8, CookieEnable UInt8, JavascriptEnable UInt8, IsMobile UInt8, BrowserLanguage UInt16, BrowserCountry UInt16, Interests UInt16, Robotness UInt8, GeneralInterests Array(UInt16), Params Array(String), Goals Nested(ID UInt32, Serial UInt32, EventTime DateTime, Price Int64, OrderID String, CurrencyID UInt32), WatchIDs Array(UInt64), ParamSumPrice Int64, ParamCurrency FixedString(3), ParamCurrencyID UInt16, ClickLogID UInt64, ClickEventID Int32, ClickGoodEvent Int32, ClickEventTime DateTime, ClickPriorityID Int32, ClickPhraseID Int32, ClickPageID Int32, ClickPlaceID Int32, ClickTypeID Int32, ClickResourceID Int32, ClickCost UInt32, ClickClientIP UInt32, ClickDomainID UInt32, ClickURL String, ClickAttempt UInt8, ClickOrderID UInt32, ClickBannerID UInt32, ClickMarketCategoryID UInt32, ClickMarketPP UInt32, ClickMarketCategoryName String, ClickMarketPPName String, ClickAWAPSCampaignName String, ClickPageName String, ClickTargetType UInt16, ClickTargetPhraseID UInt64, ClickContextType UInt8, ClickSelectType Int8, ClickOptions String, ClickGroupBannerID Int32, OpenstatServiceName String, OpenstatCampaignID String, OpenstatAdID String, OpenstatSourceID String, UTMSource String, UTMMedium String, UTMCampaign String, UTMContent String, UTMTerm String, FromTag String, HasGCLID UInt8, FirstVisit DateTime, PredLastVisit Date, LastVisit Date, TotalVisits UInt32, TraficSource Nested(ID Int8, SearchEngineID UInt16, AdvEngineID UInt8, PlaceID UInt16, SocialSourceNetworkID UInt8, Domain String, SearchPhrase String, SocialSourcePage String), Attendance FixedString(16), CLID UInt32, YCLID UInt64, NormalizedRefererHash UInt64, SearchPhraseHash UInt64, RefererDomainHash UInt64, NormalizedStartURLHash UInt64, StartURLDomainHash UInt64, NormalizedEndURLHash UInt64, TopLevelDomain UInt64, URLScheme UInt64, OpenstatServiceNameHash UInt64, OpenstatCampaignIDHash UInt64, OpenstatAdIDHash UInt64, OpenstatSourceIDHash UInt64, UTMSourceHash UInt64, UTMMediumHash UInt64, UTMCampaignHash UInt64, UTMContentHash UInt64, UTMTermHash UInt64, FromHash UInt64, WebVisorEnabled UInt8, WebVisorActivity UInt32, ParsedParams Nested(Key1 String, Key2 String, Key3 String, Key4 String, Key5 String, ValueDouble Float64), Market Nested(Type UInt8, GoalID UInt32, OrderID String, OrderPrice Int64, PP UInt32, DirectPlaceID UInt32, DirectOrderID UInt32, DirectBannerID UInt32, GoodID String, GoodName String, GoodQuantity Int32, GoodPrice Int64), IslandID FixedString(16)) [2026-11-03 02:04:15] ENGINE = CollapsingMergeTree(Sign) PARTITION BY toYYYYMM(StartDate) ORDER BY (CounterID, StartDate, intHash32(UserID), VisitID) [2026-11-03 02:04:15] SAMPLE BY intHash32(UserID) SETTINGS index_granularity = 8192, storage_policy='s3_cache'" [2026-11-03 02:04:15] clickhouse-client --max_estimated_execution_time 0 --max_execution_time "$MAX_EXECUTION_TIME" --max_memory_usage "$MAX_MEMORY_USAGE_BOOTSTRAP" --query "INSERT INTO test.hits SELECT * FROM datasets.hits_v1 SETTINGS enable_filesystem_cache_on_write_operations=0, max_insert_threads=$MAX_INSERT_THREADS_BOOTSTRAP" [2026-11-03 02:04:15] clickhouse-client --max_estimated_execution_time 0 --max_execution_time "$MAX_EXECUTION_TIME" --max_memory_usage "$MAX_MEMORY_USAGE_BOOTSTRAP" --query "INSERT INTO test.visits SELECT * FROM datasets.visits_v1 SETTINGS enable_filesystem_cache_on_write_operations=0, max_insert_threads=$MAX_INSERT_THREADS_BOOTSTRAP" [2026-11-03 02:04:15] clickhouse-client --query "DROP TABLE datasets.visits_v1 SYNC" [2026-11-03 02:04:15] clickhouse-client --query "DROP TABLE datasets.hits_v1 SYNC" [2026-11-03 02:04:15] # Note: `tpcds` and `tpch` databases are NOT dropped here as they are used by stateful tests. [2026-11-03 02:04:15] else [2026-11-03 02:04:15] clickhouse-client --query "RENAME TABLE datasets.hits_v1 TO test.hits" [2026-11-03 02:04:15] clickhouse-client --query "RENAME TABLE datasets.visits_v1 TO test.visits" [2026-11-03 02:04:15] fi [2026-11-03 02:04:15] clickhouse-client --query "CREATE TABLE test.hits_s3 (WatchID UInt64, JavaEnable UInt8, Title String, GoodEvent Int16, EventTime DateTime, EventDate Date, CounterID UInt32, ClientIP UInt32, ClientIP6 FixedString(16), RegionID UInt32, UserID UInt64, CounterClass Int8, OS UInt8, UserAgent UInt8, URL String, Referer String, URLDomain String, RefererDomain String, Refresh UInt8, IsRobot UInt8, RefererCategories Array(UInt16), URLCategories Array(UInt16), URLRegions Array(UInt32), RefererRegions Array(UInt32), ResolutionWidth UInt16, ResolutionHeight UInt16, ResolutionDepth UInt8, FlashMajor UInt8, FlashMinor UInt8, FlashMinor2 String, NetMajor UInt8, NetMinor UInt8, UserAgentMajor UInt16, UserAgentMinor FixedString(2), CookieEnable UInt8, JavascriptEnable UInt8, IsMobile UInt8, MobilePhone UInt8, MobilePhoneModel String, Params String, IPNetworkID UInt32, TraficSourceID Int8, SearchEngineID UInt16, SearchPhrase String, AdvEngineID UInt8, IsArtifical UInt8, WindowClientWidth UInt16, WindowClientHeight UInt16, ClientTimeZone Int16, ClientEventTime DateTime, SilverlightVersion1 UInt8, SilverlightVersion2 UInt8, SilverlightVersion3 UInt32, SilverlightVersion4 UInt16, PageCharset String, CodeVersion UInt32, IsLink UInt8, IsDownload UInt8, IsNotBounce UInt8, FUniqID UInt64, HID UInt32, IsOldCounter UInt8, IsEvent UInt8, IsParameter UInt8, DontCountHits UInt8, WithHash UInt8, HitColor FixedString(1), UTCEventTime DateTime, Age UInt8, Sex UInt8, Income UInt8, Interests UInt16, Robotness UInt8, GeneralInterests Array(UInt16), RemoteIP UInt32, RemoteIP6 FixedString(16), WindowName Int32, OpenerName Int32, HistoryLength Int16, BrowserLanguage FixedString(2), BrowserCountry FixedString(2), SocialNetwork String, SocialAction String, HTTPError UInt16, SendTiming Int32, DNSTiming Int32, ConnectTiming Int32, ResponseStartTiming Int32, ResponseEndTiming Int32, FetchTiming Int32, RedirectTiming Int32, DOMInteractiveTiming Int32, DOMContentLoadedTiming Int32, DOMCompleteTiming Int32, LoadEventStartTiming Int32, LoadEventEndTiming Int32, NSToDOMContentLoadedTiming Int32, FirstPaintTiming Int32, RedirectCount Int8, SocialSourceNetworkID UInt8, SocialSourcePage String, ParamPrice Int64, ParamOrderID String, ParamCurrency FixedString(3), ParamCurrencyID UInt16, GoalsReached Array(UInt32), OpenstatServiceName String, OpenstatCampaignID String, OpenstatAdID String, OpenstatSourceID String, UTMSource String, UTMMedium String, UTMCampaign String, UTMContent String, UTMTerm String, FromTag String, HasGCLID UInt8, RefererHash UInt64, URLHash UInt64, CLID UInt32, YCLID UInt64, ShareService String, ShareURL String, ShareTitle String, ParsedParams Nested(Key1 String, Key2 String, Key3 String, Key4 String, Key5 String, ValueDouble Float64), IslandID FixedString(16), RequestNum UInt32, RequestTry UInt8) ENGINE = MergeTree() PARTITION BY toYYYYMM(EventDate) ORDER BY (CounterID, EventDate, intHash32(UserID)) SAMPLE BY intHash32(UserID) SETTINGS index_granularity = 8192, storage_policy='s3_cache'" [2026-11-03 02:04:15] # AWS S3 is very inefficient, so increase memory even further: [2026-11-03 02:04:15] clickhouse-client --max_estimated_execution_time 0 --max_execution_time "$MAX_EXECUTION_TIME" --max_memory_usage "$MAX_MEMORY_USAGE_BOOTSTRAP_S3" --max_memory_usage_for_user "$MAX_MEMORY_USAGE_BOOTSTRAP_S3" --query "INSERT INTO test.hits_s3 SELECT * FROM test.hits SETTINGS enable_filesystem_cache_on_write_operations=0, write_through_distributed_cache=0, max_insert_threads=$MAX_INSERT_THREADS_BOOTSTRAP_S3" [2026-11-03 02:04:15] clickhouse-client --query "CREATE TABLE test.hits_parquet (Title String, URL String, Referer String, SearchPhrase String, WatchID UInt64, UserID UInt64, CounterID UInt32, EventTime DateTime, EventDate Date, RegionID UInt32, ClientIP UInt32) ENGINE = S3('https://clickhouse-public-datasets.s3.eu-central-1.amazonaws.com/hits_compatible/hits.parquet', NOSIGN)" [2026-11-03 02:04:15] clickhouse-client --query "SHOW TABLES FROM test" [2026-11-03 02:04:15] clickhouse-client --query "SELECT count() FROM test.hits" [2026-11-03 02:04:15] clickhouse-client --query "SELECT count() FROM test.visits" [2026-11-03 02:04:15] if [[ "${STOP_MERGES_FOR_BOOTSTRAP:-0}" -eq 1 ]]; then [2026-11-03 02:04:15] echo "Re-enabling merges after msan stateful preload" [2026-11-03 02:04:15] clickhouse-client --query "SYSTEM START MERGES" [2026-11-03 02:04:15] trap - EXIT [2026-11-03 02:04:15] fi [2026-11-03 02:04:15] ] [2026-11-03 02:04:15] INFORMATION_SCHEMA [2026-11-03 02:04:15] default [2026-11-03 02:04:15] information_schema [2026-11-03 02:04:15] system [2026-11-03 02:04:17] pick_endpoint [datasets-web]: http://dockerhub-proxy.dockerhub-proxy-zone:6000/datasets-web (0.020s) [2026-11-03 02:04:18] pick_endpoint [tpcds]: http://dockerhub-proxy.dockerhub-proxy-zone:6000/tpc-ds-sf1 (0.014s) [2026-11-03 02:05:00] hits_v1 [2026-11-03 02:05:00] visits_v1 [2026-11-03 02:05:00] call_center [2026-11-03 02:05:00] catalog_page [2026-11-03 02:05:00] catalog_returns [2026-11-03 02:05:00] catalog_sales [2026-11-03 02:05:00] customer [2026-11-03 02:05:00] customer_address [2026-11-03 02:05:00] customer_demographics [2026-11-03 02:05:00] date_dim [2026-11-03 02:05:00] household_demographics [2026-11-03 02:05:00] income_band [2026-11-03 02:05:00] inventory [2026-11-03 02:05:00] item [2026-11-03 02:05:00] promotion [2026-11-03 02:05:00] reason [2026-11-03 02:05:00] ship_mode [2026-11-03 02:05:00] store [2026-11-03 02:05:00] store_returns [2026-11-03 02:05:00] store_sales [2026-11-03 02:05:00] time_dim [2026-11-03 02:05:00] warehouse [2026-11-03 02:05:00] web_page [2026-11-03 02:05:00] web_returns [2026-11-03 02:05:00] web_sales [2026-11-03 02:05:00] web_site [2026-11-03 02:05:01] customer [2026-11-03 02:05:01] lineitem [2026-11-03 02:05:01] nation [2026-11-03 02:05:01] orders [2026-11-03 02:05:01] part [2026-11-03 02:05:01] partsupp [2026-11-03 02:05:01] region [2026-11-03 02:05:01] supplier [2026-11-03 02:07:21] hits [2026-11-03 02:07:21] hits_parquet [2026-11-03 02:07:21] hits_s3 [2026-11-03 02:07:21] visits [2026-11-03 02:07:21] 8873898 [2026-11-03 02:07:22] 1676861 [2026-11-03 02:07:22] Run command: [clickhouse-client --query "insert into system.zookeeper (name, path, value) values ('auxiliary_zookeeper2', '/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/chroot/', '')"] [2026-11-03 02:07:24] stateful data prepared [2026-11-03 02:07:24] Tests [2026-11-03 02:07:24] Run command: [set -o pipefail; clickhouse-test --testname --check-zookeeper-session --hung-check --memory-limit 10737418240 --trace --capture-client-stacktrace --queries ./tests/queries --test-runs 1 --no-sequential --jobs 8 --random-settings-diagnostics-dir /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/random-settings-diagnostics --known-fails-file-path tests/broken_tests.yaml --shard --zookeeper --queries ./tests/queries -- 05045_iceberg_manifest_partition_arity. 03999_stateless_settings_history. 03850_nested_cluster_table_function_task_iterator. 03784_msan_token_iterator. 03611_verify_exception_in_iceberg_iterator. 05323_iceberg_tolerate_conflicting_manifest_schemas_compatibility. 05301_paimon_manifest_path_traversal. 05292_iceberg_malformed_manifest_list_writer. 05026_cas_manifest_path_newline. 04615_ast_json_optimize_manifest_show_like_where. 04614_iceberg_count_malformed_manifest_row_counts. 04613_iceberg_drop_partition_whole_manifest. 04201_iceberg_manifest_per_file_stats. 05008_cas_gc_snapshot_prune. 04726_streaming_queries_commit_order_snapshot_plan. 04619_streaming_queries_shared_snapshot_strip_race. 04611_iceberg_count_ignores_corrupted_snapshot_summary. 04119_parser_snapshot_query_ast_format. 04092_format_unlock_snapshot. 04075_delta_lake_snapshot_version_without_kernel. 04073_backup_from_snapshot_ast_format. 04060_transaction_snapshot_visibility. 04039_merge_tree_snapshot_teardown_race. 03978_alter_table_execute_expire_snapshots_parse. 03775_paimon_target_snapshot. 03546_merge_tree_projection_shared_snapshot. 05384_object_storage_reader_exception_buffer_lifetime. 05296_parquet_variant_json_objects. 05211_local_object_storage_path_embedded_nul. 05021_json_max_dynamic_subcolumns_in_parsing_nested_objects. 04893_object_storage_optimize_not_supported. 04839_parquet_lazy_materialization_object_storage_json_subcolumn. 04836_handler_temporary_object_safe_methods. 04775_backup_disk_source_grants_object_storage. 04660_lazy_materialization_object_storage_filter_only_default. 04650_lazy_materialization_object_storage_column_defaults. 04627_object_storage_lazy_hive_partitioning. 04625_lazy_materialization_object_storage_unpinned. 04615_substreams_prefix_cache_map_shared_data_subobject. 04612_parquet_lazy_materialization_object_storage. 04611_show_create_hint_object_level_grant. 04341_packed_skip_indices_drop_size_object_storage. 04331_type_json_allow_duplicated_key_with_literal_and_nested_object_typed_paths. 04303_object_storage_prewhere_isnotnull_subcolumn. 04303_object_storage_cluster_fallback_to_local_if_empty. 04260_one_format_s3_no_object_reads. 04119_object_storage_bad_arg_count_no_logical_error. 04093_json_enum_null_whole_object. 04053_row_policy_object_storage. 04042_object_storage_listing_profile_events. 04040_object_storage_parallelize_output. 03924_duplicated_key_with_literal_and_nested_object_in_typed_paths_in_json. 03914_json_functions_with_object_type. 03903_alter_update_object_storage_crash. 03779_json_allow_duplicated_path_with_nested_object_and_literal. 03776_local_object_storage_blob_storage_log. 03644_object_storage_correlated_subqueries. 03578_copy_file_in_object_storage. 03284_json_object_as_tuple_duplicate_keys. 03250_json_group_by_sub_object_subcolumn. 03247_object_column_copy. 02874_infer_objects_as_named_tuples. 02731_zero_objects_in_metadata. 02714_local_object_storage. 02500_bson_read_object_id. 02499_read_json_objects_as_strings. 05306_iceberg_table_function_metadata_staleness_no_list. 05294_metadata_only_alter_guard_alias_dependency. 05218_trivial_count_sparsity_filter_after_metadata_only_alter. 05214_iceberg_drop_partition_explicit_metadata. | ts '%Y-%m-%d %H:%M:%S' | tee -a "/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/test_result.txt"] [2026-11-03 02:07:24] 2026-11-02 22:07:24 Using queries from './tests/queries' directory [2026-11-03 02:07:24] 2026-11-02 22:07:24 Connecting to ClickHouse server... OK [2026-11-03 02:07:24] 2026-11-02 22:07:24 Connected to server 26.8.34.20001.altinityantalya @ 1fbcb015cfa4aa38542b3791d48db19e069bac58 HEAD [2026-11-03 02:07:24] 2026-11-02 22:07:24 build_flags=['asan', 'ubsan', 'release', 'use_embedded_compiler', 'use_glibc_compatibility', 'use_icu', 'use_h3', 'use_mysql', 'use_rdkafka', 'use_capnp', 'use_simdutf', 'use_hdfs', 'use_snappy', 'use_parquet', 'use_protobuf', 'use_brotli', 'use_libdeflate', 'use_ssl', 'use_vectorscan', 'use_simdjson', 'use_grpc', 'use_ldap', 'use_krb5', 'use_filelog', 'use_bzip2', 'use_amqpcpp', 'use_rocksdb', 'use_nuraft', 'use_nlp', 'use_libstemmer', 'use_liburing', 'use_sqlite', 'use_libpqxx', 'use_azure_blob_storage', 'use_aws_s3', 'use_cassandra', 'use_yaml_cpp', 'use_datasketches', 'use_avro', 'use_arrow', 'use_orc', 'use_msgpack', 'use_delta_kernel_rs', 'use_wasmedge', 'use_wasmtime', 'use_jwt_cpp', 'cpu-x86_64'] collect_per_test_coverage=False coverage_active=False [2026-11-03 02:07:25] 2026-11-02 22:07:25 Found 70 parallel tests and 0 sequential tests [2026-11-03 02:07:25] 2026-11-02 22:07:25 Running about 8 stateless tests (Process-4). [2026-11-03 02:07:25] 2026-11-02 22:07:25 Running about 8 stateless tests (Process-5). [2026-11-03 02:07:25] 2026-11-02 22:07:25 Running about 8 stateless tests (Process-3). [2026-11-03 02:07:25] 2026-11-02 22:07:25 Running about 8 stateless tests (Process-7). [2026-11-03 02:07:25] 2026-11-02 22:07:25 Running about 8 stateless tests (Process-6). [2026-11-03 02:07:25] 2026-11-02 22:07:25 Running about 8 stateless tests (Process-9). [2026-11-03 02:07:25] 2026-11-02 22:07:25 Running about 8 stateless tests (Process-8). [2026-11-03 02:07:25] 2026-11-02 22:07:25 Running about 8 stateless tests (Process-10). [2026-11-03 02:07:27] 2026-11-02 22:07:27 [ 1 / 70] 04726_streaming_queries_commit_order_snapshot_plan: [ OK ] 1.82 sec. [2026-11-03 02:07:27] 2026-11-02 22:07:27 [ 2 / 70] 03250_json_group_by_sub_object_subcolumn: [ OK ] 2.15 sec. [2026-11-03 02:07:27] 2026-11-02 22:07:27 [ 3 / 70] 03775_paimon_target_snapshot: [ OK ] 2.49 sec. [2026-11-03 02:07:27] 2026-11-02 22:07:27 [ 4 / 70] 04119_parser_snapshot_query_ast_format: [ OK ] 2.56 sec. [2026-11-03 02:07:29] 2026-11-02 22:07:29 [ 5 / 70] 05021_json_max_dynamic_subcolumns_in_parsing_nested_objects: [ OK ] 2.03 sec. [2026-11-03 02:07:29] 2026-11-02 22:07:29 [ 6 / 70] 05294_metadata_only_alter_guard_alias_dependency: [ OK ] 2.01 sec. [2026-11-03 02:07:32] 2026-11-02 22:07:31 [ 7 / 70] 04615_ast_json_optimize_manifest_show_like_where: [ OK ] 2.42 sec. [2026-11-03 02:07:32] 2026-11-02 22:07:32 [ 8 / 70] 04619_streaming_queries_shared_snapshot_strip_race: [ OK ] 4.11 sec. [2026-11-03 02:07:32] 2026-11-02 22:07:32 [ 9 / 70] 04627_object_storage_lazy_hive_partitioning: [ OK ] 2.26 sec. [2026-11-03 02:07:34] 2026-11-02 22:07:34 [10 / 70] 02499_read_json_objects_as_strings: [ OK ] 1.87 sec. [2026-11-03 02:07:39] 2026-11-02 22:07:39 [11 / 70] 04625_lazy_materialization_object_storage_unpinned: [ OK ] 14.44 sec. [2026-11-03 02:07:42] 2026-11-02 22:07:42 [12 / 70] 04650_lazy_materialization_object_storage_column_defaults: [ OK ] 15.72 sec. [2026-11-03 02:07:45] 2026-11-02 22:07:45 [13 / 70] 03914_json_functions_with_object_type: [ OK ] 2.46 sec. [2026-11-03 02:07:47] 2026-11-02 22:07:47 [14 / 70] 04341_packed_skip_indices_drop_size_object_storage: [ OK ] 2.22 sec. [2026-11-03 02:07:49] 2026-11-02 22:07:49 [15 / 70] 02731_zero_objects_in_metadata: [ OK ] 9.64 sec. [2026-11-03 02:07:52] 2026-11-02 22:07:52 [16 / 70] 05026_cas_manifest_path_newline: [ OK ] 20.01 sec. [2026-11-03 02:07:53] 2026-11-02 22:07:53 [17 / 70] 05306_iceberg_table_function_metadata_staleness_no_list: [ OK ] 18.87 sec. [2026-11-03 02:07:54] 2026-11-02 22:07:54 [18 / 70] 05218_trivial_count_sparsity_filter_after_metadata_only_alter: [ OK ] 2.16 sec. [2026-11-03 02:07:54] 2026-11-02 22:07:54 [19 / 70] 03999_stateless_settings_history: [ OK ] 7.13 sec. [2026-11-03 02:07:55] 2026-11-02 22:07:55 [20 / 70] 03284_json_object_as_tuple_duplicate_keys: [ OK ] 1.86 sec. [2026-11-03 02:07:56] 2026-11-02 22:07:56 [21 / 70] 04075_delta_lake_snapshot_version_without_kernel: [ OK ] 2.12 sec. [2026-11-03 02:07:56] 2026-11-02 22:07:56 [22 / 70] 03784_msan_token_iterator: [ OK ] 1.61 sec. [2026-11-03 02:07:57] 2026-11-02 22:07:57 [23 / 70] 04613_iceberg_drop_partition_whole_manifest: [ OK ] 31.90 sec. [2026-11-03 02:07:58] 2026-11-02 22:07:58 [24 / 70] 04073_backup_from_snapshot_ast_format: [ OK ] 1.66 sec. [2026-11-03 02:07:58] 2026-11-02 22:07:58 [25 / 70] 03546_merge_tree_projection_shared_snapshot: [ OK ] 1.71 sec. [2026-11-03 02:07:59] 2026-11-02 22:07:59 [26 / 70] 04836_handler_temporary_object_safe_methods: [ OK ] 27.12 sec. [2026-11-03 02:08:00] 2026-11-02 22:08:00 [27 / 70] 05323_iceberg_tolerate_conflicting_manifest_schemas_compatibility: [ OK ] 1.61 sec. [2026-11-03 02:08:01] 2026-11-02 22:08:01 [28 / 70] 03978_alter_table_execute_expire_snapshots_parse: [ OK ] 2.10 sec. [2026-11-03 02:08:01] 2026-11-02 22:08:01 [29 / 70] 04612_parquet_lazy_materialization_object_storage: [ OK ] 12.04 sec. [2026-11-03 02:08:02] 2026-11-02 22:08:02 [30 / 70] 04615_substreams_prefix_cache_map_shared_data_subobject: [ OK ] 3.81 sec. [2026-11-03 02:08:09] 2026-11-02 22:08:09 [31 / 70] 02500_bson_read_object_id: [ OK ] 6.82 sec. [2026-11-03 02:08:12] 2026-11-02 22:08:12 [32 / 70] 04201_iceberg_manifest_per_file_stats: [ OK ] 12.73 sec. [2026-11-03 02:08:14] 2026-11-02 22:08:14 [33 / 70] 03644_object_storage_correlated_subqueries: [ OK ] 1.91 sec. [2026-11-03 02:08:16] 2026-11-02 22:08:16 [34 / 70] 04303_object_storage_prewhere_isnotnull_subcolumn: [ OK ] 1.82 sec. [2026-11-03 02:08:18] 2026-11-02 22:08:18 [35 / 70] 04092_format_unlock_snapshot: [ OK ] 1.86 sec. [2026-11-03 02:08:20] 2026-11-02 22:08:20 [36 / 70] 03924_duplicated_key_with_literal_and_nested_object_in_typed_paths_in_json: [ OK ] 1.71 sec. [2026-11-03 02:08:24] 2026-11-02 22:08:24 [37 / 70] 04042_object_storage_listing_profile_events: [ OK ] 22.80 sec. [2026-11-03 02:08:26] 2026-11-02 22:08:26 [38 / 70] 03779_json_allow_duplicated_path_with_nested_object_and_literal: [ OK ] 2.01 sec. [2026-11-03 02:08:26] 2026-11-02 22:08:26 [39 / 70] 03578_copy_file_in_object_storage: [ OK ] 31.58 sec. [2026-11-03 02:08:28] 2026-11-02 22:08:28 [40 / 70] 02874_infer_objects_as_named_tuples: [ OK ] 1.86 sec. [2026-11-03 02:08:30] 2026-11-02 22:08:30 [41 / 70] 04611_iceberg_count_ignores_corrupted_snapshot_summary: [ OK ] 1.96 sec. [2026-11-03 02:08:32] 2026-11-02 22:08:32 [42 / 70] 04331_type_json_allow_duplicated_key_with_literal_and_nested_object_typed_paths: [ OK ] 1.77 sec. [2026-11-03 02:08:34] 2026-11-02 22:08:34 [43 / 70] 04053_row_policy_object_storage: [ OK ] 13.53 sec. [2026-11-03 02:08:34] 2026-11-02 22:08:34 [44 / 70] 04611_show_create_hint_object_level_grant: [ OK ] 37.90 sec. [2026-11-03 02:08:36] 2026-11-02 22:08:36 [45 / 70] 05384_object_storage_reader_exception_buffer_lifetime: [ OK ] 70.99 sec. [2026-11-03 02:08:36] 2026-11-02 22:08:36 [46 / 70] 04614_iceberg_count_malformed_manifest_row_counts: [ OK ] 1.81 sec. [2026-11-03 02:08:38] 2026-11-02 22:08:38 [47 / 70] 03611_verify_exception_in_iceberg_iterator: [ OK ] 1.80 sec. [2026-11-03 02:08:38] 2026-11-02 22:08:38 [48 / 70] 04060_transaction_snapshot_visibility: [ OK ] 2.26 sec. [2026-11-03 02:08:40] 2026-11-02 22:08:40 [49 / 70] 05214_iceberg_drop_partition_explicit_metadata: [ OK ] 39.35 sec. [2026-11-03 02:08:42] 2026-11-02 22:08:42 [50 / 70] 03776_local_object_storage_blob_storage_log: [ OK ] 10.19 sec. [2026-11-03 02:08:43] 2026-11-02 22:08:43 [51 / 70] 04775_backup_disk_source_grants_object_storage: [ OK ] 33.49 sec. [2026-11-03 02:08:44] 2026-11-02 22:08:44 [52 / 70] 04119_object_storage_bad_arg_count_no_logical_error: [ OK ] 3.06 sec. [2026-11-03 02:08:44] 2026-11-02 22:08:44 [53 / 70] 03903_alter_update_object_storage_crash: [ OK ] 1.76 sec. [2026-11-03 02:08:44] 2026-11-02 22:08:44 [54 / 70] 05211_local_object_storage_path_embedded_nul: [ OK ] 10.62 sec. [2026-11-03 02:08:45] 2026-11-02 22:08:45 [55 / 70] 03247_object_column_copy: [ OK ] 1.71 sec. [2026-11-03 02:08:47] 2026-11-02 22:08:47 [56 / 70] 02714_local_object_storage: [ OK ] 8.57 sec. [2026-11-03 02:08:47] 2026-11-02 22:08:47 [57 / 70] 04303_object_storage_cluster_fallback_to_local_if_empty: [ OK ] 3.17 sec. [2026-11-03 02:08:54] 2026-11-02 22:08:54 [58 / 70] 05296_parquet_variant_json_objects: [ OK ] 7.27 sec. [2026-11-03 02:08:54] 2026-11-02 22:08:54 [59 / 70] 04839_parquet_lazy_materialization_object_storage_json_subcolumn: [ OK ] 10.73 sec. [2026-11-03 02:08:55] 2026-11-02 22:08:55 [60 / 70] 04260_one_format_s3_no_object_reads: [ OK ] 10.38 sec. [2026-11-03 02:08:57] 2026-11-02 22:08:57 [61 / 70] 04093_json_enum_null_whole_object: [ OK ] 2.01 sec. [2026-11-03 02:09:01] 2026-11-02 22:09:01 [62 / 70] 04660_lazy_materialization_object_storage_filter_only_default: [ OK ] 13.39 sec. [2026-11-03 02:09:01] 2026-11-02 22:09:01 [63 / 70] 05008_cas_gc_snapshot_prune: [ OK ] 23.11 sec. [2026-11-03 02:09:01] 2026-11-02 22:09:01 [2026-11-03 02:09:01] 2026-11-02 22:09:01 9 tests passed. 0 tests skipped. 96.36 s elapsed (Process-6). [2026-11-03 02:09:01] 2026-11-02 22:09:01 [64 / 70] 03850_nested_cluster_table_function_task_iterator: [ OK ] 34.99 sec. [2026-11-03 02:09:01] 2026-11-02 22:09:01 [2026-11-03 02:09:01] 2026-11-02 22:09:01 8 tests passed. 0 tests skipped. 96.69 s elapsed (Process-10). [2026-11-03 02:09:04] 2026-11-02 22:09:04 [65 / 70] 05292_iceberg_malformed_manifest_list_writer: [ OK ] 9.94 sec. [2026-11-03 02:09:04] 2026-11-02 22:09:04 [2026-11-03 02:09:04] 2026-11-02 22:09:04 5 tests passed. 0 tests skipped. 99.45 s elapsed (Process-8). [2026-11-03 02:09:10] 2026-11-02 22:09:10 [66 / 70] 04040_object_storage_parallelize_output: [ OK ] 9.68 sec. [2026-11-03 02:09:10] 2026-11-02 22:09:10 [2026-11-03 02:09:10] 2026-11-02 22:09:10 15 tests passed. 0 tests skipped. 105.63 s elapsed (Process-9). [2026-11-03 02:09:12] 2026-11-02 22:09:12 [67 / 70] 05301_paimon_manifest_path_traversal: [ OK ] 28.02 sec. [2026-11-03 02:09:12] 2026-11-02 22:09:12 [2026-11-03 02:09:12] 2026-11-02 22:09:12 16 tests passed. 0 tests skipped. 107.84 s elapsed (Process-4). [2026-11-03 02:09:13] 2026-11-02 22:09:13 [68 / 70] 04893_object_storage_optimize_not_supported: [ OK ] 15.90 sec. [2026-11-03 02:09:13] 2026-11-02 22:09:13 [2026-11-03 02:09:13] 2026-11-02 22:09:13 8 tests passed. 0 tests skipped. 107.91 s elapsed (Process-3). [2026-11-03 02:09:31] 2026-11-02 22:09:31 [69 / 70] 05045_iceberg_manifest_partition_arity: [ FAIL ] 36.16 sec. [2026-11-03 02:09:31] 2026-11-02 22:09:31 Reason: result differs with reference: [2026-11-03 02:09:31] 2026-11-02 22:09:31 --- /home/ubuntu/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/05045_iceberg_manifest_partition_arity.reference 2026-11-02 22:01:36.796517006 -0400 [2026-11-03 02:09:31] 2026-11-02 22:09:31 +++ /home/ubuntu/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/05045_iceberg_manifest_partition_arity.1641.stdout 2026-11-02 22:09:31.697812985 -0400 [2026-11-03 02:09:31] 2026-11-02 22:09:31 @@ -13,19 +13,19 @@ [2026-11-03 02:09:31] 2026-11-02 22:09:31 --- A4 the server is still alive --- [2026-11-03 02:09:31] 2026-11-02 22:09:31 1 [2026-11-03 02:09:31] 2026-11-02 22:09:31 --- A5 min/max pruning still applies when the partition key is narrower --- [2026-11-03 02:09:31] 2026-11-02 22:09:31 1 [2026-11-03 02:09:31] 2026-11-02 22:09:31 1 [2026-11-03 02:09:31] 2026-11-02 22:09:31 --- A6 the tuple arity is validated even when no partition key is modelled --- [2026-11-03 02:09:31] 2026-11-02 22:09:31 ICEBERG_SPECIFICATION_VIOLATION [2026-11-03 02:09:31] 2026-11-02 22:09:31 201 [2026-11-03 02:09:31] 2026-11-02 22:09:31 --- A7 partition pruning happens, and stops when the key is narrower --- [2026-11-03 02:09:31] 2026-11-02 22:09:31 1 [2026-11-03 02:09:31] 2026-11-02 22:09:31 -0 [2026-11-03 02:09:31] 2026-11-02 22:09:31 +1 [2026-11-03 02:09:31] 2026-11-02 22:09:31 --- A8 a leading unmodellable field is not realigned onto the wrong value --- [2026-11-03 02:09:31] 2026-11-02 22:09:31 201 [2026-11-03 02:09:31] 2026-11-02 22:09:31 -0 [2026-11-03 02:09:31] 2026-11-02 22:09:31 +1 [2026-11-03 02:09:31] 2026-11-02 22:09:31 --- A9 the manifest list prunes both tables before their patched manifests are read --- [2026-11-03 02:09:31] 2026-11-02 22:09:31 201 [2026-11-03 02:09:31] 2026-11-02 22:09:31 201 [2026-11-03 02:09:31] 2026-11-02 22:09:31 1 [2026-11-03 02:09:31] 2026-11-02 22:09:31 1 [2026-11-03 02:09:31] 2026-11-02 22:09:31 [2026-11-03 02:09:31] 2026-11-02 22:09:31 [2026-11-03 02:09:31] 2026-11-02 22:09:31 /home/ubuntu/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/test_h5f2j5z7g0g9/05045_iceberg_manifest_partition_arity.sh.bashlog: [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:9] ROOT=/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0/user_files/test_h5f2j5z7g0g9_ibp [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:10] rm -rf /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0/user_files/test_h5f2j5z7g0g9_ibp [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:11] trap 'rm -rf "${ROOT}"' EXIT [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:13] HELPER=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/test_h5f2j5z7g0g9/test_h5f2j5z7g0g9_avro_header.py [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:14] cat [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:74] SPEC_PQ='[{"field-id":1001,"name":"p","source-id":1,"transform":"identity"},{"field-id":1002,"name":"q","source-id":2,"transform":"identity"}]' [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:75] SPEC_P='[{"field-id":1001,"name":"p","source-id":1,"transform":"identity"}]' [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:79] SPEC_UNMODELLED='[{"field-id":1001,"name":"p","source-id":1,"transform":"identity"},{"field-id":1002,"name":"q","source-id":9999,"transform":"void"}]' [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:83] SPEC_UNMODELLED_LEAD='[{"field-id":1001,"name":"q","source-id":9999,"transform":"void"},{"field-id":1002,"name":"p","source-id":1,"transform":"identity"}]' [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:87] SPEC_NOKEY='[{"field-id":1001,"name":"p","source-id":9999,"transform":"void"}]' [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:88] SPEC_NOKEY_OK='[{"field-id":1001,"name":"p","source-id":9999,"transform":"void"},{"field-id":1002,"name":"q","source-id":9998,"transform":"void"}]' [2026-11-03 02:09:31] 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:146] mk t_ok 'p, q' [2026-11-03 02:09:31] 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:94] cat [2026-11-03 02:09:31] 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:146] mk t_long 'p, q' [2026-11-03 02:09:31] 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:94] cat [2026-11-03 02:09:31] 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:146] mk t_short p [2026-11-03 02:09:31] 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:94] cat [2026-11-03 02:09:31] 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:146] mk t_narrow 'p, q' [2026-11-03 02:09:31] 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:94] cat [2026-11-03 02:09:31] 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:146] mk t_nokey 'p, q' [2026-11-03 02:09:31] 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:94] cat [2026-11-03 02:09:31] 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:146] mk t_nokey_ok 'p, q' [2026-11-03 02:09:31] 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:94] cat [2026-11-03 02:09:31] 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:146] mk t_narrow_lead 'q, p' [2026-11-03 02:09:31] 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:94] cat [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:146] /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=warning --database=test_h5f2j5z7g0g9 --log_comment 05045_iceberg_manifest_partition_arity.sh-test_h5f2j5z7g0g9 --no-secure --max_insert_threads 2 --send_table_structure_on_insert_with_inline_data 0 --group_by_two_level_threshold 328610 --group_by_two_level_threshold_bytes 39531143 --distributed_aggregation_memory_efficient 1 --fsync_metadata 1 --output_format_parallel_formatting 1 --input_format_parallel_parsing 0 --input_format_parquet_dictionary_filter_push_down 0 --min_chunk_bytes_for_parallel_parsing 19338484 --max_read_buffer_size 706369 --prefer_localhost_replica 0 --max_block_size 66350 --max_joined_block_size_rows 88997 --joined_block_split_single_row 0 --join_output_by_rowlist_perkey_rows_threshold 765 --max_threads 1 --optimize_append_index 1 --use_hedged_requests 1 --optimize_if_chain_to_multiif 1 --optimize_if_transform_strings_to_enum 0 --optimize_read_in_order 1 --optimize_or_like_chain 1 --optimize_substitute_columns 1 --enable_multiple_prewhere_read_steps 1 --use_lightweight_primary_key_index_analysis True --read_in_order_two_level_merge_threshold 77 --optimize_aggregation_in_order 1 --aggregation_in_order_max_block_bytes 7967692 --use_uncompressed_cache 1 --min_bytes_to_use_direct_io 10737418240 --min_bytes_to_use_mmap_io 10737418240 --local_filesystem_read_method pread_threadpool --remote_filesystem_read_method read --local_filesystem_read_prefetch 0 --filesystem_cache_segments_batch_size 5 --read_from_filesystem_cache_if_exists_otherwise_bypass_cache 1 --throw_on_error_from_cache_on_write_operations 0 --remote_filesystem_read_prefetch 1 --distributed_cache_discard_connection_if_unread_data 0 --distributed_cache_use_clients_cache_for_read 0 --allow_prefetched_read_pool_for_remote_filesystem 0 --filesystem_prefetch_max_memory_usage 32Mi --filesystem_prefetches_limit 0 --filesystem_prefetch_min_bytes_for_single_read_task 8Mi --filesystem_prefetch_step_marks 50 --filesystem_prefetch_step_bytes 100Mi --enable_filesystem_cache 0 --enable_filesystem_cache_on_write_operations 0 --compile_expressions 1 --compile_aggregate_expressions 0 --compile_sort_description 0 --merge_tree_coarse_index_granularity 18 --optimize_distinct_in_order 1 --max_bytes_before_remerge_sort 293903977 --min_compress_block_size 362920 --max_compress_block_size 309553 --merge_tree_compact_parts_min_granules_to_multibuffer_read 5 --optimize_sorting_by_input_stream_properties 1 --http_response_buffer_size 4220635 --http_wait_end_of_query True --enable_memory_bound_merging_of_aggregation_results 0 --min_count_to_compile_expression 0 --min_count_to_compile_aggregate_expression 0 --min_count_to_compile_sort_description 3 --session_timezone Mexico/BajaSur --use_page_cache_for_disks_without_file_cache True --use_page_cache_for_local_disks False --use_page_cache_for_object_storage True --page_cache_inject_eviction False --merge_tree_read_split_ranges_into_intersecting_and_non_intersecting_injection_probability 0.91 --prefer_external_sort_block_bytes 1 --cross_join_min_rows_to_compress 0 --cross_join_min_bytes_to_compress 1 --min_external_table_block_size_bytes 0 --max_parsing_threads 10 --optimize_functions_to_subcolumns 1 --parallel_replicas_local_plan 1 --query_plan_join_swap_table false --enable_vertical_final 0 --optimize_extract_common_expressions 0 --optimize_rewrite_array_exists_to_has False --optimize_skip_unused_shards True --optimize_trivial_approximate_count_query False --optimize_trivial_insert_select False --optimize_using_constraints False --optimize_syntax_fuse_functions True --optimize_aggregators_of_group_by_keys True --optimize_and_compare_chain True --optimize_arithmetic_operations_in_aggregate_functions True --optimize_count_from_files True --optimize_distributed_group_by_sharding_key True --optimize_empty_string_comparisons True --optimize_group_by_constant_keys True --optimize_group_by_function_keys True --optimize_injective_functions_in_group_by True --optimize_injective_functions_inside_uniq True --optimize_inverse_dictionary_lookup True --optimize_move_to_prewhere True --optimize_multiif_to_if True --optimize_normalize_count_variants True --optimize_on_insert True --optimize_redundant_functions_in_order_by True --optimize_respect_aliases True --optimize_rewrite_aggregate_function_with_if True --optimize_rewrite_regexp_functions True --optimize_rewrite_sum_if_to_count_if True --optimize_skip_unused_shards_rewrite_in True --optimize_time_filter_with_preimage False --optimize_trivial_count_query True --optimize_uniq_to_count True --optimize_use_projections True --optimize_use_implicit_projections True --optimize_use_projection_filtering True --query_plan_optimize_lazy_materialization True --query_plan_optimize_prewhere True --use_async_executor_for_materialized_views 1 --use_query_condition_cache 0 --secondary_indices_enable_bulk_filtering 0 --use_skip_indexes_if_final 0 --use_skip_indexes_on_data_read 0 --use_indexes_refiner_in_read_pools 1 --enable_join_runtime_filters_index_analysis 1 --optimize_trivial_count_with_sparsity_filter 1 --optimize_rewrite_like_perfect_affix 0 --enable_lazy_columns_replication 0 --allow_special_serialization_kinds_in_output_formats 1 --use_skip_indexes_for_top_k 0 --use_top_k_dynamic_filtering False --query_plan_max_limit_for_top_k_optimization 0 --query_plan_read_in_order_through_join 1 --read_in_order_use_virtual_row 1 --short_circuit_function_evaluation_for_nulls_threshold 0.31205786687110154 --automatic_parallel_replicas_mode 0 --temporary_files_buffer_size 1217814 --query_plan_optimize_join_order_algorithm dpsize,greedy --max_bytes_before_external_join 1000000000 --grace_hash_join_initial_buckets 1 --query_plan_optimize_join_order_randomize 970989 --use_top_k_dynamic_filtering_for_variable_length_types False --page_cache_max_coalesced_bytes 67108864 --optimize_dictget_tuple_element True --execute_exists_as_scalar_subquery True --normalize_function_names True --enable_join_runtime_filters True --join_runtime_filter_min_probe_rows 0 --enable_parallel_blocks_marshalling True --query_plan_reuse_storage_ordering_for_window_functions False --query_plan_join_shard_by_pk_ranges False --count_distinct_optimization True --enable_add_distinct_to_in_subqueries True --use_statistics True --use_statistics_cache True --enable_optimize_predicate_expression True --enable_optimize_predicate_expression_to_final_subquery True --enable_software_prefetch_in_aggregation True --allow_reorder_prewhere_conditions True --materialize_statistics_on_insert True --query_plan_merge_filters True --query_plan_remove_unused_columns True --query_plan_convert_outer_join_to_inner_join True --query_plan_convert_any_join_to_semi_or_anti_join True --query_plan_merge_filter_into_join_condition True --query_plan_enable_multithreading_after_window_functions True --query_plan_max_limit_for_lazy_materialization 10 --query_plan_optimize_join_order_limit 64 --query_plan_direct_read_from_text_index True --query_plan_text_index_add_hint True --optimize_truncate_order_by_after_group_by_keys True --enable_automatic_decision_for_merging_across_partitions_for_final True --parallel_non_joined_rows_processing True --use_skip_indexes_for_disjunctions True --use_hash_table_stats_for_join_reordering True --allow_calculating_subcolumns_sizes_for_merge_tree_reading True --use_join_disjunctions_push_down True --enable_join_transitive_predicates False --use_streaming_marks_compression 1 --text_index_posting_list_apply_mode lazy --text_index_lazy_intersection_density_threshold 0.1480129187056557 --max_bytes_before_external_sort 8460572261 --max_bytes_before_external_group_by 1062196081 --max_bytes_ratio_before_external_sort 0 --max_bytes_ratio_before_external_group_by 0 --use_skip_indexes_if_final_exact_mode 0 --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --compute_exact_num_defaults_for_sparse_columns 0 --prefer_fetch_merged_part_size_threshold 1 --vertical_merge_algorithm_min_rows_to_activate 862234 --vertical_merge_algorithm_min_columns_to_activate 1 --allow_vertical_merges_from_compact_to_wide_parts 0 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 6883788 --merge_max_block_size 20655 --merge_use_batch_sorting_queue 1 --index_granularity 35324 --min_bytes_for_wide_part 0 --marks_compress_block_size 20568 --primary_key_compress_block_size 82905 --replace_long_file_name_to_hash 0 --max_file_name_length 0 --min_bytes_for_full_part_storage 536870912 --compact_parts_max_bytes_to_buffer 280841282 --compact_parts_max_granules_to_buffer 138 --compact_parts_merge_max_bytes_to_prefetch_part 20647545 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 37 --old_parts_lifetime 243 --prewarm_mark_cache 1 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 0 --enable_block_number_column 0 --enable_block_offset_column 1 --patch_parts_version v1 --use_primary_key_cache 1 --prewarm_primary_key_cache 0 --object_serialization_version v3 --object_shared_data_serialization_version advanced --object_shared_data_serialization_version_for_zero_level_parts map_with_buckets --object_shared_data_buckets_for_compact_part 6 --object_shared_data_buckets_for_wide_part 32 --dynamic_serialization_version v3 --serialization_info_version basic --string_serialization_version single_stream --nullable_serialization_version allow_sparse --enable_shared_storage_snapshot_in_query 0 --min_columns_to_activate_adaptive_write_buffer 763 --reduce_blocking_parts_sleep_ms 1104 --shared_merge_tree_outdated_parts_group_size 2 --shared_merge_tree_max_outdated_parts_to_process_at_once 7 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas 0 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas_on_startup 0 --text_index_dictionary_block_size 128 --text_index_dictionary_block_frontcoding_compression 0 --text_index_posting_list_block_size 64 --text_index_posting_list_codec bitpacking --map_serialization_version basic --map_serialization_version_for_zero_level_parts basic --max_buckets_in_map 76 --map_buckets_strategy sqrt --map_buckets_min_avg_size 614 --map_buckets_coefficient 1.43 --propagate_types_serialization_versions_to_nested_types 0 --compress_per_column_in_compact_parts 1 --packed_skip_index_max_bytes 1048576 --allow_repeated_settings --allow_repeated_settings --client_logs_file=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/05045_iceberg_manifest_partition_arity.1641.stderr-fatal --allow_insert_into_iceberg=1 --use_iceberg_metadata_files_cache=0 --query ' [2026-11-03 02:09:31] 2026-11-02 22:09:31 CREATE TABLE t_ok (p Int32, q Int32, v Int32) [2026-11-03 02:09:31] 2026-11-02 22:09:31 ENGINE = IcebergLocal('\''/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0/user_files/test_h5f2j5z7g0g9_ibp/t_ok/'\'', '\''Parquet'\'') PARTITION BY (p, q) [2026-11-03 02:09:31] 2026-11-02 22:09:31 SETTINGS allow_experimental_iceberg_compaction = 0; [2026-11-03 02:09:31] 2026-11-02 22:09:31 INSERT INTO t_ok VALUES (1,10,100),(1,10,101),(2,20,200),(2,20,201),(3,30,300); [2026-11-03 02:09:31] 2026-11-02 22:09:31 CREATE TABLE t_long (p Int32, q Int32, v Int32) [2026-11-03 02:09:31] 2026-11-02 22:09:31 ENGINE = IcebergLocal('\''/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0/user_files/test_h5f2j5z7g0g9_ibp/t_long/'\'', '\''Parquet'\'') PARTITION BY (p, q) [2026-11-03 02:09:31] 2026-11-02 22:09:31 SETTINGS allow_experimental_iceberg_compaction = 0; [2026-11-03 02:09:31] 2026-11-02 22:09:31 INSERT INTO t_long VALUES (1,10,100),(1,10,101),(2,20,200),(2,20,201),(3,30,300); [2026-11-03 02:09:31] 2026-11-02 22:09:31 CREATE TABLE t_short (p Int32, q Int32, v Int32) [2026-11-03 02:09:31] 2026-11-02 22:09:31 ENGINE = IcebergLocal('\''/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0/user_files/test_h5f2j5z7g0g9_ibp/t_short/'\'', '\''Parquet'\'') PARTITION BY (p) [2026-11-03 02:09:31] 2026-11-02 22:09:31 SETTINGS allow_experimental_iceberg_compaction = 0; [2026-11-03 02:09:31] 2026-11-02 22:09:31 INSERT INTO t_short VALUES (1,10,100),(1,10,101),(2,20,200),(2,20,201),(3,30,300); [2026-11-03 02:09:31] 2026-11-02 22:09:31 CREATE TABLE t_narrow (p Int32, q Int32, v Int32) [2026-11-03 02:09:31] 2026-11-02 22:09:31 ENGINE = IcebergLocal('\''/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0/user_files/test_h5f2j5z7g0g9_ibp/t_narrow/'\'', '\''Parquet'\'') PARTITION BY (p, q) [2026-11-03 02:09:31] 2026-11-02 22:09:31 SETTINGS allow_experimental_iceberg_compaction = 0; [2026-11-03 02:09:31] 2026-11-02 22:09:31 INSERT INTO t_narrow VALUES (1,10,100),(1,10,101),(2,20,200),(2,20,201),(3,30,300); [2026-11-03 02:09:31] 2026-11-02 22:09:31 CREATE TABLE t_nokey (p Int32, q Int32, v Int32) [2026-11-03 02:09:31] 2026-11-02 22:09:31 ENGINE = IcebergLocal('\''/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0/user_files/test_h5f2j5z7g0g9_ibp/t_nokey/'\'', '\''Parquet'\'') PARTITION BY (p, q) [2026-11-03 02:09:31] 2026-11-02 22:09:31 SETTINGS allow_experimental_iceberg_compaction = 0; [2026-11-03 02:09:31] 2026-11-02 22:09:31 INSERT INTO t_nokey VALUES (1,10,100),(1,10,101),(2,20,200),(2,20,201),(3,30,300); [2026-11-03 02:09:31] 2026-11-02 22:09:31 CREATE TABLE t_nokey_ok (p Int32, q Int32, v Int32) [2026-11-03 02:09:31] 2026-11-02 22:09:31 ENGINE = IcebergLocal('\''/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0/user_files/test_h5f2j5z7g0g9_ibp/t_nokey_ok/'\'', '\''Parquet'\'') PARTITION BY (p, q) [2026-11-03 02:09:31] 2026-11-02 22:09:31 SETTINGS allow_experimental_iceberg_compaction = 0; [2026-11-03 02:09:31] 2026-11-02 22:09:31 ----------------------------------------234 lines are hidden---------------------------------------- [2026-11-03 02:09:31] 2026-11-02 22:09:31 FROM system.query_log [2026-11-03 02:09:31] 2026-11-02 22:09:31 WHERE current_database = currentDatabase() AND type = '\''QueryFinish'\'' AND log_comment IN ('\''test_h5f2j5z7g0g9_partition_control'\'', '\''test_h5f2j5z7g0g9_partition_narrow'\'') [2026-11-03 02:09:31] 2026-11-02 22:09:31 GROUP BY log_comment [2026-11-03 02:09:31] 2026-11-02 22:09:31 ORDER BY indexOf(['\''test_h5f2j5z7g0g9_partition_control'\'', '\''test_h5f2j5z7g0g9_partition_narrow'\''], log_comment) [2026-11-03 02:09:31] 2026-11-02 22:09:31 SETTINGS enable_parallel_replicas = 0' [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:23] [:208] echo '--- A8 a leading unmodellable field is not realigned onto the wrong value ---' [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:23] [:211] /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=warning --database=test_h5f2j5z7g0g9 --log_comment 05045_iceberg_manifest_partition_arity.sh-test_h5f2j5z7g0g9 --no-secure --max_insert_threads 2 --send_table_structure_on_insert_with_inline_data 0 --group_by_two_level_threshold 328610 --group_by_two_level_threshold_bytes 39531143 --distributed_aggregation_memory_efficient 1 --fsync_metadata 1 --output_format_parallel_formatting 1 --input_format_parallel_parsing 0 --input_format_parquet_dictionary_filter_push_down 0 --min_chunk_bytes_for_parallel_parsing 19338484 --max_read_buffer_size 706369 --prefer_localhost_replica 0 --max_block_size 66350 --max_joined_block_size_rows 88997 --joined_block_split_single_row 0 --join_output_by_rowlist_perkey_rows_threshold 765 --max_threads 1 --optimize_append_index 1 --use_hedged_requests 1 --optimize_if_chain_to_multiif 1 --optimize_if_transform_strings_to_enum 0 --optimize_read_in_order 1 --optimize_or_like_chain 1 --optimize_substitute_columns 1 --enable_multiple_prewhere_read_steps 1 --use_lightweight_primary_key_index_analysis True --read_in_order_two_level_merge_threshold 77 --optimize_aggregation_in_order 1 --aggregation_in_order_max_block_bytes 7967692 --use_uncompressed_cache 1 --min_bytes_to_use_direct_io 10737418240 --min_bytes_to_use_mmap_io 10737418240 --local_filesystem_read_method pread_threadpool --remote_filesystem_read_method read --local_filesystem_read_prefetch 0 --filesystem_cache_segments_batch_size 5 --read_from_filesystem_cache_if_exists_otherwise_bypass_cache 1 --throw_on_error_from_cache_on_write_operations 0 --remote_filesystem_read_prefetch 1 --distributed_cache_discard_connection_if_unread_data 0 --distributed_cache_use_clients_cache_for_read 0 --allow_prefetched_read_pool_for_remote_filesystem 0 --filesystem_prefetch_max_memory_usage 32Mi --filesystem_prefetches_limit 0 --filesystem_prefetch_min_bytes_for_single_read_task 8Mi --filesystem_prefetch_step_marks 50 --filesystem_prefetch_step_bytes 100Mi --enable_filesystem_cache 0 --enable_filesystem_cache_on_write_operations 0 --compile_expressions 1 --compile_aggregate_expressions 0 --compile_sort_description 0 --merge_tree_coarse_index_granularity 18 --optimize_distinct_in_order 1 --max_bytes_before_remerge_sort 293903977 --min_compress_block_size 362920 --max_compress_block_size 309553 --merge_tree_compact_parts_min_granules_to_multibuffer_read 5 --optimize_sorting_by_input_stream_properties 1 --http_response_buffer_size 4220635 --http_wait_end_of_query True --enable_memory_bound_merging_of_aggregation_results 0 --min_count_to_compile_expression 0 --min_count_to_compile_aggregate_expression 0 --min_count_to_compile_sort_description 3 --session_timezone Mexico/BajaSur --use_page_cache_for_disks_without_file_cache True --use_page_cache_for_local_disks False --use_page_cache_for_object_storage True --page_cache_inject_eviction False --merge_tree_read_split_ranges_into_intersecting_and_non_intersecting_injection_probability 0.91 --prefer_external_sort_block_bytes 1 --cross_join_min_rows_to_compress 0 --cross_join_min_bytes_to_compress 1 --min_external_table_block_size_bytes 0 --max_parsing_threads 10 --optimize_functions_to_subcolumns 1 --parallel_replicas_local_plan 1 --query_plan_join_swap_table false --enable_vertical_final 0 --optimize_extract_common_expressions 0 --optimize_rewrite_array_exists_to_has False --optimize_skip_unused_shards True --optimize_trivial_approximate_count_query False --optimize_trivial_insert_select False --optimize_using_constraints False --optimize_syntax_fuse_functions True --optimize_aggregators_of_group_by_keys True --optimize_and_compare_chain True --optimize_arithmetic_operations_in_aggregate_functions True --optimize_count_from_files True --optimize_distributed_group_by_sharding_key True --optimize_empty_string_comparisons True --optimize_group_by_constant_keys True --optimize_group_by_function_keys True --optimize_injective_functions_in_group_by True --optimize_injective_functions_inside_uniq True --optimize_inverse_dictionary_lookup True --optimize_move_to_prewhere True --optimize_multiif_to_if True --optimize_normalize_count_variants True --optimize_on_insert True --optimize_redundant_functions_in_order_by True --optimize_respect_aliases True --optimize_rewrite_aggregate_function_with_if True --optimize_rewrite_regexp_functions True --optimize_rewrite_sum_if_to_count_if True --optimize_skip_unused_shards_rewrite_in True --optimize_time_filter_with_preimage False --optimize_trivial_count_query True --optimize_uniq_to_count True --optimize_use_projections True --optimize_use_implicit_projections True --optimize_use_projection_filtering True --query_plan_optimize_lazy_materialization True --query_plan_optimize_prewhere True --use_async_executor_for_materialized_views 1 --use_query_condition_cache 0 --secondary_indices_enable_bulk_filtering 0 --use_skip_indexes_if_final 0 --use_skip_indexes_on_data_read 0 --use_indexes_refiner_in_read_pools 1 --enable_join_runtime_filters_index_analysis 1 --optimize_trivial_count_with_sparsity_filter 1 --optimize_rewrite_like_perfect_affix 0 --enable_lazy_columns_replication 0 --allow_special_serialization_kinds_in_output_formats 1 --use_skip_indexes_for_top_k 0 --use_top_k_dynamic_filtering False --query_plan_max_limit_for_top_k_optimization 0 --query_plan_read_in_order_through_join 1 --read_in_order_use_virtual_row 1 --short_circuit_function_evaluation_for_nulls_threshold 0.31205786687110154 --automatic_parallel_replicas_mode 0 --temporary_files_buffer_size 1217814 --query_plan_optimize_join_order_algorithm dpsize,greedy --max_bytes_before_external_join 1000000000 --grace_hash_join_initial_buckets 1 --query_plan_optimize_join_order_randomize 970989 --use_top_k_dynamic_filtering_for_variable_length_types False --page_cache_max_coalesced_bytes 67108864 --optimize_dictget_tuple_element True --execute_exists_as_scalar_subquery True --normalize_function_names True --enable_join_runtime_filters True --join_runtime_filter_min_probe_rows 0 --enable_parallel_blocks_marshalling True --query_plan_reuse_storage_ordering_for_window_functions False --query_plan_join_shard_by_pk_ranges False --count_distinct_optimization True --enable_add_distinct_to_in_subqueries True --use_statistics True --use_statistics_cache True --enable_optimize_predicate_expression True --enable_optimize_predicate_expression_to_final_subquery True --enable_software_prefetch_in_aggregation True --allow_reorder_prewhere_conditions True --materialize_statistics_on_insert True --query_plan_merge_filters True --query_plan_remove_unused_columns True --query_plan_convert_outer_join_to_inner_join True --query_plan_convert_any_join_to_semi_or_anti_join True --query_plan_merge_filter_into_join_condition True --query_plan_enable_multithreading_after_window_functions True --query_plan_max_limit_for_lazy_materialization 10 --query_plan_optimize_join_order_limit 64 --query_plan_direct_read_from_text_index True --query_plan_text_index_add_hint True --optimize_truncate_order_by_after_group_by_keys True --enable_automatic_decision_for_merging_across_partitions_for_final True --parallel_non_joined_rows_processing True --use_skip_indexes_for_disjunctions True --use_hash_table_stats_for_join_reordering True --allow_calculating_subcolumns_sizes_for_merge_tree_reading True --use_join_disjunctions_push_down True --enable_join_transitive_predicates False --use_streaming_marks_compression 1 --text_index_posting_list_apply_mode lazy --text_index_lazy_intersection_density_threshold 0.1480129187056557 --max_bytes_before_external_sort 8460572261 --max_bytes_before_external_group_by 1062196081 --max_bytes_ratio_before_external_sort 0 --max_bytes_ratio_before_external_group_by 0 --use_skip_indexes_if_final_exact_mode 0 --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --compute_exact_num_defaults_for_sparse_columns 0 --prefer_fetch_merged_part_size_threshold 1 --vertical_merge_algorithm_min_rows_to_activate 862234 --vertical_merge_algorithm_min_columns_to_activate 1 --allow_vertical_merges_from_compact_to_wide_parts 0 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 6883788 --merge_max_block_size 20655 --merge_use_batch_sorting_queue 1 --index_granularity 35324 --min_bytes_for_wide_part 0 --marks_compress_block_size 20568 --primary_key_compress_block_size 82905 --replace_long_file_name_to_hash 0 --max_file_name_length 0 --min_bytes_for_full_part_storage 536870912 --compact_parts_max_bytes_to_buffer 280841282 --compact_parts_max_granules_to_buffer 138 --compact_parts_merge_max_bytes_to_prefetch_part 20647545 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 37 --old_parts_lifetime 243 --prewarm_mark_cache 1 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 0 --enable_block_number_column 0 --enable_block_offset_column 1 --patch_parts_version v1 --use_primary_key_cache 1 --prewarm_primary_key_cache 0 --object_serialization_version v3 --object_shared_data_serialization_version advanced --object_shared_data_serialization_version_for_zero_level_parts map_with_buckets --object_shared_data_buckets_for_compact_part 6 --object_shared_data_buckets_for_wide_part 32 --dynamic_serialization_version v3 --serialization_info_version basic --string_serialization_version single_stream --nullable_serialization_version allow_sparse --enable_shared_storage_snapshot_in_query 0 --min_columns_to_activate_adaptive_write_buffer 763 --reduce_blocking_parts_sleep_ms 1104 --shared_merge_tree_outdated_parts_group_size 2 --shared_merge_tree_max_outdated_parts_to_process_at_once 7 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas 0 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas_on_startup 0 --text_index_dictionary_block_size 128 --text_index_dictionary_block_frontcoding_compression 0 --text_index_posting_list_block_size 64 --text_index_posting_list_codec bitpacking --map_serialization_version basic --map_serialization_version_for_zero_level_parts basic --max_buckets_in_map 76 --map_buckets_strategy sqrt --map_buckets_min_avg_size 614 --map_buckets_coefficient 1.43 --propagate_types_serialization_versions_to_nested_types 0 --compress_per_column_in_compact_parts 1 --packed_skip_index_max_bytes 1048576 --allow_repeated_settings --allow_repeated_settings --client_logs_file=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/05045_iceberg_manifest_partition_arity.1641.stderr-fatal --use_iceberg_metadata_files_cache=0 --use_iceberg_manifest_list_partition_pruning=0 --query ' [2026-11-03 02:09:31] 2026-11-02 22:09:31 SELECT sum(v) FROM t_narrow_lead WHERE p = 1 SETTINGS log_comment = '\''test_h5f2j5z7g0g9_partition_narrow_lead'\''; [2026-11-03 02:09:31] 2026-11-02 22:09:31 SYSTEM FLUSH LOGS query_log;' [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:25] [:214] report IcebergPartitionPrunedFiles partition_narrow_lead [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:25] [:131] local counter=IcebergPartitionPrunedFiles tags= t [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:25] [:132] shift [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:25] [:133] for t in "$@" [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:25] [:133] tags=''\''test_h5f2j5z7g0g9_partition_narrow_lead'\''' [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:25] [:134] /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=warning --database=test_h5f2j5z7g0g9 --log_comment 05045_iceberg_manifest_partition_arity.sh-test_h5f2j5z7g0g9 --no-secure --max_insert_threads 2 --send_table_structure_on_insert_with_inline_data 0 --group_by_two_level_threshold 328610 --group_by_two_level_threshold_bytes 39531143 --distributed_aggregation_memory_efficient 1 --fsync_metadata 1 --output_format_parallel_formatting 1 --input_format_parallel_parsing 0 --input_format_parquet_dictionary_filter_push_down 0 --min_chunk_bytes_for_parallel_parsing 19338484 --max_read_buffer_size 706369 --prefer_localhost_replica 0 --max_block_size 66350 --max_joined_block_size_rows 88997 --joined_block_split_single_row 0 --join_output_by_rowlist_perkey_rows_threshold 765 --max_threads 1 --optimize_append_index 1 --use_hedged_requests 1 --optimize_if_chain_to_multiif 1 --optimize_if_transform_strings_to_enum 0 --optimize_read_in_order 1 --optimize_or_like_chain 1 --optimize_substitute_columns 1 --enable_multiple_prewhere_read_steps 1 --use_lightweight_primary_key_index_analysis True --read_in_order_two_level_merge_threshold 77 --optimize_aggregation_in_order 1 --aggregation_in_order_max_block_bytes 7967692 --use_uncompressed_cache 1 --min_bytes_to_use_direct_io 10737418240 --min_bytes_to_use_mmap_io 10737418240 --local_filesystem_read_method pread_threadpool --remote_filesystem_read_method read --local_filesystem_read_prefetch 0 --filesystem_cache_segments_batch_size 5 --read_from_filesystem_cache_if_exists_otherwise_bypass_cache 1 --throw_on_error_from_cache_on_write_operations 0 --remote_filesystem_read_prefetch 1 --distributed_cache_discard_connection_if_unread_data 0 --distributed_cache_use_clients_cache_for_read 0 --allow_prefetched_read_pool_for_remote_filesystem 0 --filesystem_prefetch_max_memory_usage 32Mi --filesystem_prefetches_limit 0 --filesystem_prefetch_min_bytes_for_single_read_task 8Mi --filesystem_prefetch_step_marks 50 --filesystem_prefetch_step_bytes 100Mi --enable_filesystem_cache 0 --enable_filesystem_cache_on_write_operations 0 --compile_expressions 1 --compile_aggregate_expressions 0 --compile_sort_description 0 --merge_tree_coarse_index_granularity 18 --optimize_distinct_in_order 1 --max_bytes_before_remerge_sort 293903977 --min_compress_block_size 362920 --max_compress_block_size 309553 --merge_tree_compact_parts_min_granules_to_multibuffer_read 5 --optimize_sorting_by_input_stream_properties 1 --http_response_buffer_size 4220635 --http_wait_end_of_query True --enable_memory_bound_merging_of_aggregation_results 0 --min_count_to_compile_expression 0 --min_count_to_compile_aggregate_expression 0 --min_count_to_compile_sort_description 3 --session_timezone Mexico/BajaSur --use_page_cache_for_disks_without_file_cache True --use_page_cache_for_local_disks False --use_page_cache_for_object_storage True --page_cache_inject_eviction False --merge_tree_read_split_ranges_into_intersecting_and_non_intersecting_injection_probability 0.91 --prefer_external_sort_block_bytes 1 --cross_join_min_rows_to_compress 0 --cross_join_min_bytes_to_compress 1 --min_external_table_block_size_bytes 0 --max_parsing_threads 10 --optimize_functions_to_subcolumns 1 --parallel_replicas_local_plan 1 --query_plan_join_swap_table false --enable_vertical_final 0 --optimize_extract_common_expressions 0 --optimize_rewrite_array_exists_to_has False --optimize_skip_unused_shards True --optimize_trivial_approximate_count_query False --optimize_trivial_insert_select False --optimize_using_constraints False --optimize_syntax_fuse_functions True --optimize_aggregators_of_group_by_keys True --optimize_and_compare_chain True --optimize_arithmetic_operations_in_aggregate_functions True --optimize_count_from_files True --optimize_distributed_group_by_sharding_key True --optimize_empty_string_comparisons True --optimize_group_by_constant_keys True --optimize_group_by_function_keys True --optimize_injective_functions_in_group_by True --optimize_injective_functions_inside_uniq True --optimize_inverse_dictionary_lookup True --optimize_move_to_prewhere True --optimize_multiif_to_if True --optimize_normalize_count_variants True --optimize_on_insert True --optimize_redundant_functions_in_order_by True --optimize_respect_aliases True --optimize_rewrite_aggregate_function_with_if True --optimize_rewrite_regexp_functions True --optimize_rewrite_sum_if_to_count_if True --optimize_skip_unused_shards_rewrite_in True --optimize_time_filter_with_preimage False --optimize_trivial_count_query True --optimize_uniq_to_count True --optimize_use_projections True --optimize_use_implicit_projections True --optimize_use_projection_filtering True --query_plan_optimize_lazy_materialization True --query_plan_optimize_prewhere True --use_async_executor_for_materialized_views 1 --use_query_condition_cache 0 --secondary_indices_enable_bulk_filtering 0 --use_skip_indexes_if_final 0 --use_skip_indexes_on_data_read 0 --use_indexes_refiner_in_read_pools 1 --enable_join_runtime_filters_index_analysis 1 --optimize_trivial_count_with_sparsity_filter 1 --optimize_rewrite_like_perfect_affix 0 --enable_lazy_columns_replication 0 --allow_special_serialization_kinds_in_output_formats 1 --use_skip_indexes_for_top_k 0 --use_top_k_dynamic_filtering False --query_plan_max_limit_for_top_k_optimization 0 --query_plan_read_in_order_through_join 1 --read_in_order_use_virtual_row 1 --short_circuit_function_evaluation_for_nulls_threshold 0.31205786687110154 --automatic_parallel_replicas_mode 0 --temporary_files_buffer_size 1217814 --query_plan_optimize_join_order_algorithm dpsize,greedy --max_bytes_before_external_join 1000000000 --grace_hash_join_initial_buckets 1 --query_plan_optimize_join_order_randomize 970989 --use_top_k_dynamic_filtering_for_variable_length_types False --page_cache_max_coalesced_bytes 67108864 --optimize_dictget_tuple_element True --execute_exists_as_scalar_subquery True --normalize_function_names True --enable_join_runtime_filters True --join_runtime_filter_min_probe_rows 0 --enable_parallel_blocks_marshalling True --query_plan_reuse_storage_ordering_for_window_functions False --query_plan_join_shard_by_pk_ranges False --count_distinct_optimization True --enable_add_distinct_to_in_subqueries True --use_statistics True --use_statistics_cache True --enable_optimize_predicate_expression True --enable_optimize_predicate_expression_to_final_subquery True --enable_software_prefetch_in_aggregation True --allow_reorder_prewhere_conditions True --materialize_statistics_on_insert True --query_plan_merge_filters True --query_plan_remove_unused_columns True --query_plan_convert_outer_join_to_inner_join True --query_plan_convert_any_join_to_semi_or_anti_join True --query_plan_merge_filter_into_join_condition True --query_plan_enable_multithreading_after_window_functions True --query_plan_max_limit_for_lazy_materialization 10 --query_plan_optimize_join_order_limit 64 --query_plan_direct_read_from_text_index True --query_plan_text_index_add_hint True --optimize_truncate_order_by_after_group_by_keys True --enable_automatic_decision_for_merging_across_partitions_for_final True --parallel_non_joined_rows_processing True --use_skip_indexes_for_disjunctions True --use_hash_table_stats_for_join_reordering True --allow_calculating_subcolumns_sizes_for_merge_tree_reading True --use_join_disjunctions_push_down True --enable_join_transitive_predicates False --use_streaming_marks_compression 1 --text_index_posting_list_apply_mode lazy --text_index_lazy_intersection_density_threshold 0.1480129187056557 --max_bytes_before_external_sort 8460572261 --max_bytes_before_external_group_by 1062196081 --max_bytes_ratio_before_external_sort 0 --max_bytes_ratio_before_external_group_by 0 --use_skip_indexes_if_final_exact_mode 0 --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --compute_exact_num_defaults_for_sparse_columns 0 --prefer_fetch_merged_part_size_threshold 1 --vertical_merge_algorithm_min_rows_to_activate 862234 --vertical_merge_algorithm_min_columns_to_activate 1 --allow_vertical_merges_from_compact_to_wide_parts 0 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 6883788 --merge_max_block_size 20655 --merge_use_batch_sorting_queue 1 --index_granularity 35324 --min_bytes_for_wide_part 0 --marks_compress_block_size 20568 --primary_key_compress_block_size 82905 --replace_long_file_name_to_hash 0 --max_file_name_length 0 --min_bytes_for_full_part_storage 536870912 --compact_parts_max_bytes_to_buffer 280841282 --compact_parts_max_granules_to_buffer 138 --compact_parts_merge_max_bytes_to_prefetch_part 20647545 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 37 --old_parts_lifetime 243 --prewarm_mark_cache 1 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 0 --enable_block_number_column 0 --enable_block_offset_column 1 --patch_parts_version v1 --use_primary_key_cache 1 --prewarm_primary_key_cache 0 --object_serialization_version v3 --object_shared_data_serialization_version advanced --object_shared_data_serialization_version_for_zero_level_parts map_with_buckets --object_shared_data_buckets_for_compact_part 6 --object_shared_data_buckets_for_wide_part 32 --dynamic_serialization_version v3 --serialization_info_version basic --string_serialization_version single_stream --nullable_serialization_version allow_sparse --enable_shared_storage_snapshot_in_query 0 --min_columns_to_activate_adaptive_write_buffer 763 --reduce_blocking_parts_sleep_ms 1104 --shared_merge_tree_outdated_parts_group_size 2 --shared_merge_tree_max_outdated_parts_to_process_at_once 7 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas 0 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas_on_startup 0 --text_index_dictionary_block_size 128 --text_index_dictionary_block_frontcoding_compression 0 --text_index_posting_list_block_size 64 --text_index_posting_list_codec bitpacking --map_serialization_version basic --map_serialization_version_for_zero_level_parts basic --max_buckets_in_map 76 --map_buckets_strategy sqrt --map_buckets_min_avg_size 614 --map_buckets_coefficient 1.43 --propagate_types_serialization_versions_to_nested_types 0 --compress_per_column_in_compact_parts 1 --packed_skip_index_max_bytes 1048576 --allow_repeated_settings --allow_repeated_settings --client_logs_file=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/05045_iceberg_manifest_partition_arity.1641.stderr-fatal --query ' [2026-11-03 02:09:31] 2026-11-02 22:09:31 SELECT max(ProfileEvents['\''IcebergPartitionPrunedFiles'\'']) > 0 [2026-11-03 02:09:31] 2026-11-02 22:09:31 FROM system.query_log [2026-11-03 02:09:31] 2026-11-02 22:09:31 WHERE current_database = currentDatabase() AND type = '\''QueryFinish'\'' AND log_comment IN ('\''test_h5f2j5z7g0g9_partition_narrow_lead'\'') [2026-11-03 02:09:31] 2026-11-02 22:09:31 GROUP BY log_comment [2026-11-03 02:09:31] 2026-11-02 22:09:31 ORDER BY indexOf(['\''test_h5f2j5z7g0g9_partition_narrow_lead'\''], log_comment) [2026-11-03 02:09:31] 2026-11-02 22:09:31 SETTINGS enable_parallel_replicas = 0' [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:26] [:216] echo '--- A9 the manifest list prunes both tables before their patched manifests are read ---' [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:26] [:220] /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=warning --database=test_h5f2j5z7g0g9 --log_comment 05045_iceberg_manifest_partition_arity.sh-test_h5f2j5z7g0g9 --no-secure --max_insert_threads 2 --send_table_structure_on_insert_with_inline_data 0 --group_by_two_level_threshold 328610 --group_by_two_level_threshold_bytes 39531143 --distributed_aggregation_memory_efficient 1 --fsync_metadata 1 --output_format_parallel_formatting 1 --input_format_parallel_parsing 0 --input_format_parquet_dictionary_filter_push_down 0 --min_chunk_bytes_for_parallel_parsing 19338484 --max_read_buffer_size 706369 --prefer_localhost_replica 0 --max_block_size 66350 --max_joined_block_size_rows 88997 --joined_block_split_single_row 0 --join_output_by_rowlist_perkey_rows_threshold 765 --max_threads 1 --optimize_append_index 1 --use_hedged_requests 1 --optimize_if_chain_to_multiif 1 --optimize_if_transform_strings_to_enum 0 --optimize_read_in_order 1 --optimize_or_like_chain 1 --optimize_substitute_columns 1 --enable_multiple_prewhere_read_steps 1 --use_lightweight_primary_key_index_analysis True --read_in_order_two_level_merge_threshold 77 --optimize_aggregation_in_order 1 --aggregation_in_order_max_block_bytes 7967692 --use_uncompressed_cache 1 --min_bytes_to_use_direct_io 10737418240 --min_bytes_to_use_mmap_io 10737418240 --local_filesystem_read_method pread_threadpool --remote_filesystem_read_method read --local_filesystem_read_prefetch 0 --filesystem_cache_segments_batch_size 5 --read_from_filesystem_cache_if_exists_otherwise_bypass_cache 1 --throw_on_error_from_cache_on_write_operations 0 --remote_filesystem_read_prefetch 1 --distributed_cache_discard_connection_if_unread_data 0 --distributed_cache_use_clients_cache_for_read 0 --allow_prefetched_read_pool_for_remote_filesystem 0 --filesystem_prefetch_max_memory_usage 32Mi --filesystem_prefetches_limit 0 --filesystem_prefetch_min_bytes_for_single_read_task 8Mi --filesystem_prefetch_step_marks 50 --filesystem_prefetch_step_bytes 100Mi --enable_filesystem_cache 0 --enable_filesystem_cache_on_write_operations 0 --compile_expressions 1 --compile_aggregate_expressions 0 --compile_sort_description 0 --merge_tree_coarse_index_granularity 18 --optimize_distinct_in_order 1 --max_bytes_before_remerge_sort 293903977 --min_compress_block_size 362920 --max_compress_block_size 309553 --merge_tree_compact_parts_min_granules_to_multibuffer_read 5 --optimize_sorting_by_input_stream_properties 1 --http_response_buffer_size 4220635 --http_wait_end_of_query True --enable_memory_bound_merging_of_aggregation_results 0 --min_count_to_compile_expression 0 --min_count_to_compile_aggregate_expression 0 --min_count_to_compile_sort_description 3 --session_timezone Mexico/BajaSur --use_page_cache_for_disks_without_file_cache True --use_page_cache_for_local_disks False --use_page_cache_for_object_storage True --page_cache_inject_eviction False --merge_tree_read_split_ranges_into_intersecting_and_non_intersecting_injection_probability 0.91 --prefer_external_sort_block_bytes 1 --cross_join_min_rows_to_compress 0 --cross_join_min_bytes_to_compress 1 --min_external_table_block_size_bytes 0 --max_parsing_threads 10 --optimize_functions_to_subcolumns 1 --parallel_replicas_local_plan 1 --query_plan_join_swap_table false --enable_vertical_final 0 --optimize_extract_common_expressions 0 --optimize_rewrite_array_exists_to_has False --optimize_skip_unused_shards True --optimize_trivial_approximate_count_query False --optimize_trivial_insert_select False --optimize_using_constraints False --optimize_syntax_fuse_functions True --optimize_aggregators_of_group_by_keys True --optimize_and_compare_chain True --optimize_arithmetic_operations_in_aggregate_functions True --optimize_count_from_files True --optimize_distributed_group_by_sharding_key True --optimize_empty_string_comparisons True --optimize_group_by_constant_keys True --optimize_group_by_function_keys True --optimize_injective_functions_in_group_by True --optimize_injective_functions_inside_uniq True --optimize_inverse_dictionary_lookup True --optimize_move_to_prewhere True --optimize_multiif_to_if True --optimize_normalize_count_variants True --optimize_on_insert True --optimize_redundant_functions_in_order_by True --optimize_respect_aliases True --optimize_rewrite_aggregate_function_with_if True --optimize_rewrite_regexp_functions True --optimize_rewrite_sum_if_to_count_if True --optimize_skip_unused_shards_rewrite_in True --optimize_time_filter_with_preimage False --optimize_trivial_count_query True --optimize_uniq_to_count True --optimize_use_projections True --optimize_use_implicit_projections True --optimize_use_projection_filtering True --query_plan_optimize_lazy_materialization True --query_plan_optimize_prewhere True --use_async_executor_for_materialized_views 1 --use_query_condition_cache 0 --secondary_indices_enable_bulk_filtering 0 --use_skip_indexes_if_final 0 --use_skip_indexes_on_data_read 0 --use_indexes_refiner_in_read_pools 1 --enable_join_runtime_filters_index_analysis 1 --optimize_trivial_count_with_sparsity_filter 1 --optimize_rewrite_like_perfect_affix 0 --enable_lazy_columns_replication 0 --allow_special_serialization_kinds_in_output_formats 1 --use_skip_indexes_for_top_k 0 --use_top_k_dynamic_filtering False --query_plan_max_limit_for_top_k_optimization 0 --query_plan_read_in_order_through_join 1 --read_in_order_use_virtual_row 1 --short_circuit_function_evaluation_for_nulls_threshold 0.31205786687110154 --automatic_parallel_replicas_mode 0 --temporary_files_buffer_size 1217814 --query_plan_optimize_join_order_algorithm dpsize,greedy --max_bytes_before_external_join 1000000000 --grace_hash_join_initial_buckets 1 --query_plan_optimize_join_order_randomize 970989 --use_top_k_dynamic_filtering_for_variable_length_types False --page_cache_max_coalesced_bytes 67108864 --optimize_dictget_tuple_element True --execute_exists_as_scalar_subquery True --normalize_function_names True --enable_join_runtime_filters True --join_runtime_filter_min_probe_rows 0 --enable_parallel_blocks_marshalling True --query_plan_reuse_storage_ordering_for_window_functions False --query_plan_join_shard_by_pk_ranges False --count_distinct_optimization True --enable_add_distinct_to_in_subqueries True --use_statistics True --use_statistics_cache True --enable_optimize_predicate_expression True --enable_optimize_predicate_expression_to_final_subquery True --enable_software_prefetch_in_aggregation True --allow_reorder_prewhere_conditions True --materialize_statistics_on_insert True --query_plan_merge_filters True --query_plan_remove_unused_columns True --query_plan_convert_outer_join_to_inner_join True --query_plan_convert_any_join_to_semi_or_anti_join True --query_plan_merge_filter_into_join_condition True --query_plan_enable_multithreading_after_window_functions True --query_plan_max_limit_for_lazy_materialization 10 --query_plan_optimize_join_order_limit 64 --query_plan_direct_read_from_text_index True --query_plan_text_index_add_hint True --optimize_truncate_order_by_after_group_by_keys True --enable_automatic_decision_for_merging_across_partitions_for_final True --parallel_non_joined_rows_processing True --use_skip_indexes_for_disjunctions True --use_hash_table_stats_for_join_reordering True --allow_calculating_subcolumns_sizes_for_merge_tree_reading True --use_join_disjunctions_push_down True --enable_join_transitive_predicates False --use_streaming_marks_compression 1 --text_index_posting_list_apply_mode lazy --text_index_lazy_intersection_density_threshold 0.1480129187056557 --max_bytes_before_external_sort 8460572261 --max_bytes_before_external_group_by 1062196081 --max_bytes_ratio_before_external_sort 0 --max_bytes_ratio_before_external_group_by 0 --use_skip_indexes_if_final_exact_mode 0 --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --compute_exact_num_defaults_for_sparse_columns 0 --prefer_fetch_merged_part_size_threshold 1 --vertical_merge_algorithm_min_rows_to_activate 862234 --vertical_merge_algorithm_min_columns_to_activate 1 --allow_vertical_merges_from_compact_to_wide_parts 0 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 6883788 --merge_max_block_size 20655 --merge_use_batch_sorting_queue 1 --index_granularity 35324 --min_bytes_for_wide_part 0 --marks_compress_block_size 20568 --primary_key_compress_block_size 82905 --replace_long_file_name_to_hash 0 --max_file_name_length 0 --min_bytes_for_full_part_storage 536870912 --compact_parts_max_bytes_to_buffer 280841282 --compact_parts_max_granules_to_buffer 138 --compact_parts_merge_max_bytes_to_prefetch_part 20647545 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 37 --old_parts_lifetime 243 --prewarm_mark_cache 1 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 0 --enable_block_number_column 0 --enable_block_offset_column 1 --patch_parts_version v1 --use_primary_key_cache 1 --prewarm_primary_key_cache 0 --object_serialization_version v3 --object_shared_data_serialization_version advanced --object_shared_data_serialization_version_for_zero_level_parts map_with_buckets --object_shared_data_buckets_for_compact_part 6 --object_shared_data_buckets_for_wide_part 32 --dynamic_serialization_version v3 --serialization_info_version basic --string_serialization_version single_stream --nullable_serialization_version allow_sparse --enable_shared_storage_snapshot_in_query 0 --min_columns_to_activate_adaptive_write_buffer 763 --reduce_blocking_parts_sleep_ms 1104 --shared_merge_tree_outdated_parts_group_size 2 --shared_merge_tree_max_outdated_parts_to_process_at_once 7 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas 0 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas_on_startup 0 --text_index_dictionary_block_size 128 --text_index_dictionary_block_frontcoding_compression 0 --text_index_posting_list_block_size 64 --text_index_posting_list_codec bitpacking --map_serialization_version basic --map_serialization_version_for_zero_level_parts basic --max_buckets_in_map 76 --map_buckets_strategy sqrt --map_buckets_min_avg_size 614 --map_buckets_coefficient 1.43 --propagate_types_serialization_versions_to_nested_types 0 --compress_per_column_in_compact_parts 1 --packed_skip_index_max_bytes 1048576 --allow_repeated_settings --allow_repeated_settings --client_logs_file=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/05045_iceberg_manifest_partition_arity.1641.stderr-fatal --use_iceberg_metadata_files_cache=0 --query ' [2026-11-03 02:09:31] 2026-11-02 22:09:31 SELECT sum(v) FROM t_narrow WHERE p = 1 SETTINGS log_comment = '\''test_h5f2j5z7g0g9_list_narrow'\''; [2026-11-03 02:09:31] 2026-11-02 22:09:31 SELECT sum(v) FROM t_narrow_lead WHERE p = 1 SETTINGS log_comment = '\''test_h5f2j5z7g0g9_list_narrow_lead'\''; [2026-11-03 02:09:31] 2026-11-02 22:09:31 SYSTEM FLUSH LOGS query_log;' [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:28] [:224] report IcebergPartitionPrunedFiles list_narrow list_narrow_lead [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:28] [:131] local counter=IcebergPartitionPrunedFiles tags= t [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:28] [:132] shift [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:28] [:133] for t in "$@" [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:28] [:133] tags=''\''test_h5f2j5z7g0g9_list_narrow'\''' [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:28] [:133] for t in "$@" [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:28] [:133] tags=''\''test_h5f2j5z7g0g9_list_narrow'\'', '\''test_h5f2j5z7g0g9_list_narrow_lead'\''' [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:28] [:134] /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=warning --database=test_h5f2j5z7g0g9 --log_comment 05045_iceberg_manifest_partition_arity.sh-test_h5f2j5z7g0g9 --no-secure --max_insert_threads 2 --send_table_structure_on_insert_with_inline_data 0 --group_by_two_level_threshold 328610 --group_by_two_level_threshold_bytes 39531143 --distributed_aggregation_memory_efficient 1 --fsync_metadata 1 --output_format_parallel_formatting 1 --input_format_parallel_parsing 0 --input_format_parquet_dictionary_filter_push_down 0 --min_chunk_bytes_for_parallel_parsing 19338484 --max_read_buffer_size 706369 --prefer_localhost_replica 0 --max_block_size 66350 --max_joined_block_size_rows 88997 --joined_block_split_single_row 0 --join_output_by_rowlist_perkey_rows_threshold 765 --max_threads 1 --optimize_append_index 1 --use_hedged_requests 1 --optimize_if_chain_to_multiif 1 --optimize_if_transform_strings_to_enum 0 --optimize_read_in_order 1 --optimize_or_like_chain 1 --optimize_substitute_columns 1 --enable_multiple_prewhere_read_steps 1 --use_lightweight_primary_key_index_analysis True --read_in_order_two_level_merge_threshold 77 --optimize_aggregation_in_order 1 --aggregation_in_order_max_block_bytes 7967692 --use_uncompressed_cache 1 --min_bytes_to_use_direct_io 10737418240 --min_bytes_to_use_mmap_io 10737418240 --local_filesystem_read_method pread_threadpool --remote_filesystem_read_method read --local_filesystem_read_prefetch 0 --filesystem_cache_segments_batch_size 5 --read_from_filesystem_cache_if_exists_otherwise_bypass_cache 1 --throw_on_error_from_cache_on_write_operations 0 --remote_filesystem_read_prefetch 1 --distributed_cache_discard_connection_if_unread_data 0 --distributed_cache_use_clients_cache_for_read 0 --allow_prefetched_read_pool_for_remote_filesystem 0 --filesystem_prefetch_max_memory_usage 32Mi --filesystem_prefetches_limit 0 --filesystem_prefetch_min_bytes_for_single_read_task 8Mi --filesystem_prefetch_step_marks 50 --filesystem_prefetch_step_bytes 100Mi --enable_filesystem_cache 0 --enable_filesystem_cache_on_write_operations 0 --compile_expressions 1 --compile_aggregate_expressions 0 --compile_sort_description 0 --merge_tree_coarse_index_granularity 18 --optimize_distinct_in_order 1 --max_bytes_before_remerge_sort 293903977 --min_compress_block_size 362920 --max_compress_block_size 309553 --merge_tree_compact_parts_min_granules_to_multibuffer_read 5 --optimize_sorting_by_input_stream_properties 1 --http_response_buffer_size 4220635 --http_wait_end_of_query True --enable_memory_bound_merging_of_aggregation_results 0 --min_count_to_compile_expression 0 --min_count_to_compile_aggregate_expression 0 --min_count_to_compile_sort_description 3 --session_timezone Mexico/BajaSur --use_page_cache_for_disks_without_file_cache True --use_page_cache_for_local_disks False --use_page_cache_for_object_storage True --page_cache_inject_eviction False --merge_tree_read_split_ranges_into_intersecting_and_non_intersecting_injection_probability 0.91 --prefer_external_sort_block_bytes 1 --cross_join_min_rows_to_compress 0 --cross_join_min_bytes_to_compress 1 --min_external_table_block_size_bytes 0 --max_parsing_threads 10 --optimize_functions_to_subcolumns 1 --parallel_replicas_local_plan 1 --query_plan_join_swap_table false --enable_vertical_final 0 --optimize_extract_common_expressions 0 --optimize_rewrite_array_exists_to_has False --optimize_skip_unused_shards True --optimize_trivial_approximate_count_query False --optimize_trivial_insert_select False --optimize_using_constraints False --optimize_syntax_fuse_functions True --optimize_aggregators_of_group_by_keys True --optimize_and_compare_chain True --optimize_arithmetic_operations_in_aggregate_functions True --optimize_count_from_files True --optimize_distributed_group_by_sharding_key True --optimize_empty_string_comparisons True --optimize_group_by_constant_keys True --optimize_group_by_function_keys True --optimize_injective_functions_in_group_by True --optimize_injective_functions_inside_uniq True --optimize_inverse_dictionary_lookup True --optimize_move_to_prewhere True --optimize_multiif_to_if True --optimize_normalize_count_variants True --optimize_on_insert True --optimize_redundant_functions_in_order_by True --optimize_respect_aliases True --optimize_rewrite_aggregate_function_with_if True --optimize_rewrite_regexp_functions True --optimize_rewrite_sum_if_to_count_if True --optimize_skip_unused_shards_rewrite_in True --optimize_time_filter_with_preimage False --optimize_trivial_count_query True --optimize_uniq_to_count True --optimize_use_projections True --optimize_use_implicit_projections True --optimize_use_projection_filtering True --query_plan_optimize_lazy_materialization True --query_plan_optimize_prewhere True --use_async_executor_for_materialized_views 1 --use_query_condition_cache 0 --secondary_indices_enable_bulk_filtering 0 --use_skip_indexes_if_final 0 --use_skip_indexes_on_data_read 0 --use_indexes_refiner_in_read_pools 1 --enable_join_runtime_filters_index_analysis 1 --optimize_trivial_count_with_sparsity_filter 1 --optimize_rewrite_like_perfect_affix 0 --enable_lazy_columns_replication 0 --allow_special_serialization_kinds_in_output_formats 1 --use_skip_indexes_for_top_k 0 --use_top_k_dynamic_filtering False --query_plan_max_limit_for_top_k_optimization 0 --query_plan_read_in_order_through_join 1 --read_in_order_use_virtual_row 1 --short_circuit_function_evaluation_for_nulls_threshold 0.31205786687110154 --automatic_parallel_replicas_mode 0 --temporary_files_buffer_size 1217814 --query_plan_optimize_join_order_algorithm dpsize,greedy --max_bytes_before_external_join 1000000000 --grace_hash_join_initial_buckets 1 --query_plan_optimize_join_order_randomize 970989 --use_top_k_dynamic_filtering_for_variable_length_types False --page_cache_max_coalesced_bytes 67108864 --optimize_dictget_tuple_element True --execute_exists_as_scalar_subquery True --normalize_function_names True --enable_join_runtime_filters True --join_runtime_filter_min_probe_rows 0 --enable_parallel_blocks_marshalling True --query_plan_reuse_storage_ordering_for_window_functions False --query_plan_join_shard_by_pk_ranges False --count_distinct_optimization True --enable_add_distinct_to_in_subqueries True --use_statistics True --use_statistics_cache True --enable_optimize_predicate_expression True --enable_optimize_predicate_expression_to_final_subquery True --enable_software_prefetch_in_aggregation True --allow_reorder_prewhere_conditions True --materialize_statistics_on_insert True --query_plan_merge_filters True --query_plan_remove_unused_columns True --query_plan_convert_outer_join_to_inner_join True --query_plan_convert_any_join_to_semi_or_anti_join True --query_plan_merge_filter_into_join_condition True --query_plan_enable_multithreading_after_window_functions True --query_plan_max_limit_for_lazy_materialization 10 --query_plan_optimize_join_order_limit 64 --query_plan_direct_read_from_text_index True --query_plan_text_index_add_hint True --optimize_truncate_order_by_after_group_by_keys True --enable_automatic_decision_for_merging_across_partitions_for_final True --parallel_non_joined_rows_processing True --use_skip_indexes_for_disjunctions True --use_hash_table_stats_for_join_reordering True --allow_calculating_subcolumns_sizes_for_merge_tree_reading True --use_join_disjunctions_push_down True --enable_join_transitive_predicates False --use_streaming_marks_compression 1 --text_index_posting_list_apply_mode lazy --text_index_lazy_intersection_density_threshold 0.1480129187056557 --max_bytes_before_external_sort 8460572261 --max_bytes_before_external_group_by 1062196081 --max_bytes_ratio_before_external_sort 0 --max_bytes_ratio_before_external_group_by 0 --use_skip_indexes_if_final_exact_mode 0 --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --compute_exact_num_defaults_for_sparse_columns 0 --prefer_fetch_merged_part_size_threshold 1 --vertical_merge_algorithm_min_rows_to_activate 862234 --vertical_merge_algorithm_min_columns_to_activate 1 --allow_vertical_merges_from_compact_to_wide_parts 0 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 6883788 --merge_max_block_size 20655 --merge_use_batch_sorting_queue 1 --index_granularity 35324 --min_bytes_for_wide_part 0 --marks_compress_block_size 20568 --primary_key_compress_block_size 82905 --replace_long_file_name_to_hash 0 --max_file_name_length 0 --min_bytes_for_full_part_storage 536870912 --compact_parts_max_bytes_to_buffer 280841282 --compact_parts_max_granules_to_buffer 138 --compact_parts_merge_max_bytes_to_prefetch_part 20647545 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 37 --old_parts_lifetime 243 --prewarm_mark_cache 1 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 0 --enable_block_number_column 0 --enable_block_offset_column 1 --patch_parts_version v1 --use_primary_key_cache 1 --prewarm_primary_key_cache 0 --object_serialization_version v3 --object_shared_data_serialization_version advanced --object_shared_data_serialization_version_for_zero_level_parts map_with_buckets --object_shared_data_buckets_for_compact_part 6 --object_shared_data_buckets_for_wide_part 32 --dynamic_serialization_version v3 --serialization_info_version basic --string_serialization_version single_stream --nullable_serialization_version allow_sparse --enable_shared_storage_snapshot_in_query 0 --min_columns_to_activate_adaptive_write_buffer 763 --reduce_blocking_parts_sleep_ms 1104 --shared_merge_tree_outdated_parts_group_size 2 --shared_merge_tree_max_outdated_parts_to_process_at_once 7 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas 0 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas_on_startup 0 --text_index_dictionary_block_size 128 --text_index_dictionary_block_frontcoding_compression 0 --text_index_posting_list_block_size 64 --text_index_posting_list_codec bitpacking --map_serialization_version basic --map_serialization_version_for_zero_level_parts basic --max_buckets_in_map 76 --map_buckets_strategy sqrt --map_buckets_min_avg_size 614 --map_buckets_coefficient 1.43 --propagate_types_serialization_versions_to_nested_types 0 --compress_per_column_in_compact_parts 1 --packed_skip_index_max_bytes 1048576 --allow_repeated_settings --allow_repeated_settings --client_logs_file=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/05045_iceberg_manifest_partition_arity.1641.stderr-fatal --query ' [2026-11-03 02:09:31] 2026-11-02 22:09:31 SELECT max(ProfileEvents['\''IcebergPartitionPrunedFiles'\'']) > 0 [2026-11-03 02:09:31] 2026-11-02 22:09:31 FROM system.query_log [2026-11-03 02:09:31] 2026-11-02 22:09:31 WHERE current_database = currentDatabase() AND type = '\''QueryFinish'\'' AND log_comment IN ('\''test_h5f2j5z7g0g9_list_narrow'\'', '\''test_h5f2j5z7g0g9_list_narrow_lead'\'') [2026-11-03 02:09:31] 2026-11-02 22:09:31 GROUP BY log_comment [2026-11-03 02:09:31] 2026-11-02 22:09:31 ORDER BY indexOf(['\''test_h5f2j5z7g0g9_list_narrow'\'', '\''test_h5f2j5z7g0g9_list_narrow_lead'\''], log_comment) [2026-11-03 02:09:31] 2026-11-02 22:09:31 SETTINGS enable_parallel_replicas = 0' [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:30] [:226] /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=warning --database=test_h5f2j5z7g0g9 --log_comment 05045_iceberg_manifest_partition_arity.sh-test_h5f2j5z7g0g9 --no-secure --max_insert_threads 2 --send_table_structure_on_insert_with_inline_data 0 --group_by_two_level_threshold 328610 --group_by_two_level_threshold_bytes 39531143 --distributed_aggregation_memory_efficient 1 --fsync_metadata 1 --output_format_parallel_formatting 1 --input_format_parallel_parsing 0 --input_format_parquet_dictionary_filter_push_down 0 --min_chunk_bytes_for_parallel_parsing 19338484 --max_read_buffer_size 706369 --prefer_localhost_replica 0 --max_block_size 66350 --max_joined_block_size_rows 88997 --joined_block_split_single_row 0 --join_output_by_rowlist_perkey_rows_threshold 765 --max_threads 1 --optimize_append_index 1 --use_hedged_requests 1 --optimize_if_chain_to_multiif 1 --optimize_if_transform_strings_to_enum 0 --optimize_read_in_order 1 --optimize_or_like_chain 1 --optimize_substitute_columns 1 --enable_multiple_prewhere_read_steps 1 --use_lightweight_primary_key_index_analysis True --read_in_order_two_level_merge_threshold 77 --optimize_aggregation_in_order 1 --aggregation_in_order_max_block_bytes 7967692 --use_uncompressed_cache 1 --min_bytes_to_use_direct_io 10737418240 --min_bytes_to_use_mmap_io 10737418240 --local_filesystem_read_method pread_threadpool --remote_filesystem_read_method read --local_filesystem_read_prefetch 0 --filesystem_cache_segments_batch_size 5 --read_from_filesystem_cache_if_exists_otherwise_bypass_cache 1 --throw_on_error_from_cache_on_write_operations 0 --remote_filesystem_read_prefetch 1 --distributed_cache_discard_connection_if_unread_data 0 --distributed_cache_use_clients_cache_for_read 0 --allow_prefetched_read_pool_for_remote_filesystem 0 --filesystem_prefetch_max_memory_usage 32Mi --filesystem_prefetches_limit 0 --filesystem_prefetch_min_bytes_for_single_read_task 8Mi --filesystem_prefetch_step_marks 50 --filesystem_prefetch_step_bytes 100Mi --enable_filesystem_cache 0 --enable_filesystem_cache_on_write_operations 0 --compile_expressions 1 --compile_aggregate_expressions 0 --compile_sort_description 0 --merge_tree_coarse_index_granularity 18 --optimize_distinct_in_order 1 --max_bytes_before_remerge_sort 293903977 --min_compress_block_size 362920 --max_compress_block_size 309553 --merge_tree_compact_parts_min_granules_to_multibuffer_read 5 --optimize_sorting_by_input_stream_properties 1 --http_response_buffer_size 4220635 --http_wait_end_of_query True --enable_memory_bound_merging_of_aggregation_results 0 --min_count_to_compile_expression 0 --min_count_to_compile_aggregate_expression 0 --min_count_to_compile_sort_description 3 --session_timezone Mexico/BajaSur --use_page_cache_for_disks_without_file_cache True --use_page_cache_for_local_disks False --use_page_cache_for_object_storage True --page_cache_inject_eviction False --merge_tree_read_split_ranges_into_intersecting_and_non_intersecting_injection_probability 0.91 --prefer_external_sort_block_bytes 1 --cross_join_min_rows_to_compress 0 --cross_join_min_bytes_to_compress 1 --min_external_table_block_size_bytes 0 --max_parsing_threads 10 --optimize_functions_to_subcolumns 1 --parallel_replicas_local_plan 1 --query_plan_join_swap_table false --enable_vertical_final 0 --optimize_extract_common_expressions 0 --optimize_rewrite_array_exists_to_has False --optimize_skip_unused_shards True --optimize_trivial_approximate_count_query False --optimize_trivial_insert_select False --optimize_using_constraints False --optimize_syntax_fuse_functions True --optimize_aggregators_of_group_by_keys True --optimize_and_compare_chain True --optimize_arithmetic_operations_in_aggregate_functions True --optimize_count_from_files True --optimize_distributed_group_by_sharding_key True --optimize_empty_string_comparisons True --optimize_group_by_constant_keys True --optimize_group_by_function_keys True --optimize_injective_functions_in_group_by True --optimize_injective_functions_inside_uniq True --optimize_inverse_dictionary_lookup True --optimize_move_to_prewhere True --optimize_multiif_to_if True --optimize_normalize_count_variants True --optimize_on_insert True --optimize_redundant_functions_in_order_by True --optimize_respect_aliases True --optimize_rewrite_aggregate_function_with_if True --optimize_rewrite_regexp_functions True --optimize_rewrite_sum_if_to_count_if True --optimize_skip_unused_shards_rewrite_in True --optimize_time_filter_with_preimage False --optimize_trivial_count_query True --optimize_uniq_to_count True --optimize_use_projections True --optimize_use_implicit_projections True --optimize_use_projection_filtering True --query_plan_optimize_lazy_materialization True --query_plan_optimize_prewhere True --use_async_executor_for_materialized_views 1 --use_query_condition_cache 0 --secondary_indices_enable_bulk_filtering 0 --use_skip_indexes_if_final 0 --use_skip_indexes_on_data_read 0 --use_indexes_refiner_in_read_pools 1 --enable_join_runtime_filters_index_analysis 1 --optimize_trivial_count_with_sparsity_filter 1 --optimize_rewrite_like_perfect_affix 0 --enable_lazy_columns_replication 0 --allow_special_serialization_kinds_in_output_formats 1 --use_skip_indexes_for_top_k 0 --use_top_k_dynamic_filtering False --query_plan_max_limit_for_top_k_optimization 0 --query_plan_read_in_order_through_join 1 --read_in_order_use_virtual_row 1 --short_circuit_function_evaluation_for_nulls_threshold 0.31205786687110154 --automatic_parallel_replicas_mode 0 --temporary_files_buffer_size 1217814 --query_plan_optimize_join_order_algorithm dpsize,greedy --max_bytes_before_external_join 1000000000 --grace_hash_join_initial_buckets 1 --query_plan_optimize_join_order_randomize 970989 --use_top_k_dynamic_filtering_for_variable_length_types False --page_cache_max_coalesced_bytes 67108864 --optimize_dictget_tuple_element True --execute_exists_as_scalar_subquery True --normalize_function_names True --enable_join_runtime_filters True --join_runtime_filter_min_probe_rows 0 --enable_parallel_blocks_marshalling True --query_plan_reuse_storage_ordering_for_window_functions False --query_plan_join_shard_by_pk_ranges False --count_distinct_optimization True --enable_add_distinct_to_in_subqueries True --use_statistics True --use_statistics_cache True --enable_optimize_predicate_expression True --enable_optimize_predicate_expression_to_final_subquery True --enable_software_prefetch_in_aggregation True --allow_reorder_prewhere_conditions True --materialize_statistics_on_insert True --query_plan_merge_filters True --query_plan_remove_unused_columns True --query_plan_convert_outer_join_to_inner_join True --query_plan_convert_any_join_to_semi_or_anti_join True --query_plan_merge_filter_into_join_condition True --query_plan_enable_multithreading_after_window_functions True --query_plan_max_limit_for_lazy_materialization 10 --query_plan_optimize_join_order_limit 64 --query_plan_direct_read_from_text_index True --query_plan_text_index_add_hint True --optimize_truncate_order_by_after_group_by_keys True --enable_automatic_decision_for_merging_across_partitions_for_final True --parallel_non_joined_rows_processing True --use_skip_indexes_for_disjunctions True --use_hash_table_stats_for_join_reordering True --allow_calculating_subcolumns_sizes_for_merge_tree_reading True --use_join_disjunctions_push_down True --enable_join_transitive_predicates False --use_streaming_marks_compression 1 --text_index_posting_list_apply_mode lazy --text_index_lazy_intersection_density_threshold 0.1480129187056557 --max_bytes_before_external_sort 8460572261 --max_bytes_before_external_group_by 1062196081 --max_bytes_ratio_before_external_sort 0 --max_bytes_ratio_before_external_group_by 0 --use_skip_indexes_if_final_exact_mode 0 --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --compute_exact_num_defaults_for_sparse_columns 0 --prefer_fetch_merged_part_size_threshold 1 --vertical_merge_algorithm_min_rows_to_activate 862234 --vertical_merge_algorithm_min_columns_to_activate 1 --allow_vertical_merges_from_compact_to_wide_parts 0 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 6883788 --merge_max_block_size 20655 --merge_use_batch_sorting_queue 1 --index_granularity 35324 --min_bytes_for_wide_part 0 --marks_compress_block_size 20568 --primary_key_compress_block_size 82905 --replace_long_file_name_to_hash 0 --max_file_name_length 0 --min_bytes_for_full_part_storage 536870912 --compact_parts_max_bytes_to_buffer 280841282 --compact_parts_max_granules_to_buffer 138 --compact_parts_merge_max_bytes_to_prefetch_part 20647545 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 37 --old_parts_lifetime 243 --prewarm_mark_cache 1 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 0 --enable_block_number_column 0 --enable_block_offset_column 1 --patch_parts_version v1 --use_primary_key_cache 1 --prewarm_primary_key_cache 0 --object_serialization_version v3 --object_shared_data_serialization_version advanced --object_shared_data_serialization_version_for_zero_level_parts map_with_buckets --object_shared_data_buckets_for_compact_part 6 --object_shared_data_buckets_for_wide_part 32 --dynamic_serialization_version v3 --serialization_info_version basic --string_serialization_version single_stream --nullable_serialization_version allow_sparse --enable_shared_storage_snapshot_in_query 0 --min_columns_to_activate_adaptive_write_buffer 763 --reduce_blocking_parts_sleep_ms 1104 --shared_merge_tree_outdated_parts_group_size 2 --shared_merge_tree_max_outdated_parts_to_process_at_once 7 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas 0 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas_on_startup 0 --text_index_dictionary_block_size 128 --text_index_dictionary_block_frontcoding_compression 0 --text_index_posting_list_block_size 64 --text_index_posting_list_codec bitpacking --map_serialization_version basic --map_serialization_version_for_zero_level_parts basic --max_buckets_in_map 76 --map_buckets_strategy sqrt --map_buckets_min_avg_size 614 --map_buckets_coefficient 1.43 --propagate_types_serialization_versions_to_nested_types 0 --compress_per_column_in_compact_parts 1 --packed_skip_index_max_bytes 1048576 --allow_repeated_settings --allow_repeated_settings --client_logs_file=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/05045_iceberg_manifest_partition_arity.1641.stderr-fatal --query ' [2026-11-03 02:09:31] 2026-11-02 22:09:31 DROP TABLE IF EXISTS t_ok SYNC; [2026-11-03 02:09:31] 2026-11-02 22:09:31 DROP TABLE IF EXISTS t_long SYNC; [2026-11-03 02:09:31] 2026-11-02 22:09:31 DROP TABLE IF EXISTS t_short SYNC; [2026-11-03 02:09:31] 2026-11-02 22:09:31 DROP TABLE IF EXISTS t_narrow SYNC; [2026-11-03 02:09:31] 2026-11-02 22:09:31 DROP TABLE IF EXISTS t_nokey SYNC; [2026-11-03 02:09:31] 2026-11-02 22:09:31 DROP TABLE IF EXISTS t_nokey_ok SYNC; [2026-11-03 02:09:31] 2026-11-02 22:09:31 DROP TABLE IF EXISTS t_narrow_lead SYNC;' [2026-11-03 02:09:31] 2026-11-02 22:09:31 + [2026-11-02 22:09:31] [:1] rm -rf /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0/user_files/test_h5f2j5z7g0g9_ibp [2026-11-03 02:09:31] 2026-11-02 22:09:31 [2026-11-03 02:09:31] 2026-11-02 22:09:31 [2026-11-03 02:09:31] 2026-11-02 22:09:31 Settings used in the test: --max_insert_threads 2 --send_table_structure_on_insert_with_inline_data 0 --group_by_two_level_threshold 328610 --group_by_two_level_threshold_bytes 39531143 --distributed_aggregation_memory_efficient 1 --fsync_metadata 1 --output_format_parallel_formatting 1 --input_format_parallel_parsing 0 --input_format_parquet_dictionary_filter_push_down 0 --min_chunk_bytes_for_parallel_parsing 19338484 --max_read_buffer_size 706369 --prefer_localhost_replica 0 --max_block_size 66350 --max_joined_block_size_rows 88997 --joined_block_split_single_row 0 --join_output_by_rowlist_perkey_rows_threshold 765 --max_threads 1 --optimize_append_index 1 --use_hedged_requests 1 --optimize_if_chain_to_multiif 1 --optimize_if_transform_strings_to_enum 0 --optimize_read_in_order 1 --optimize_or_like_chain 1 --optimize_substitute_columns 1 --enable_multiple_prewhere_read_steps 1 --use_lightweight_primary_key_index_analysis True --read_in_order_two_level_merge_threshold 77 --optimize_aggregation_in_order 1 --aggregation_in_order_max_block_bytes 7967692 --use_uncompressed_cache 1 --min_bytes_to_use_direct_io 10737418240 --min_bytes_to_use_mmap_io 10737418240 --local_filesystem_read_method pread_threadpool --remote_filesystem_read_method read --local_filesystem_read_prefetch 0 --filesystem_cache_segments_batch_size 5 --read_from_filesystem_cache_if_exists_otherwise_bypass_cache 1 --throw_on_error_from_cache_on_write_operations 0 --remote_filesystem_read_prefetch 1 --distributed_cache_discard_connection_if_unread_data 0 --distributed_cache_use_clients_cache_for_read 0 --allow_prefetched_read_pool_for_remote_filesystem 0 --filesystem_prefetch_max_memory_usage 32Mi --filesystem_prefetches_limit 0 --filesystem_prefetch_min_bytes_for_single_read_task 8Mi --filesystem_prefetch_step_marks 50 --filesystem_prefetch_step_bytes 100Mi --enable_filesystem_cache 0 --enable_filesystem_cache_on_write_operations 0 --compile_expressions 1 --compile_aggregate_expressions 0 --compile_sort_description 0 --merge_tree_coarse_index_granularity 18 --optimize_distinct_in_order 1 --max_bytes_before_remerge_sort 293903977 --min_compress_block_size 362920 --max_compress_block_size 309553 --merge_tree_compact_parts_min_granules_to_multibuffer_read 5 --optimize_sorting_by_input_stream_properties 1 --http_response_buffer_size 4220635 --http_wait_end_of_query True --enable_memory_bound_merging_of_aggregation_results 0 --min_count_to_compile_expression 0 --min_count_to_compile_aggregate_expression 0 --min_count_to_compile_sort_description 3 --session_timezone Mexico/BajaSur --use_page_cache_for_disks_without_file_cache True --use_page_cache_for_local_disks False --use_page_cache_for_object_storage True --page_cache_inject_eviction False --merge_tree_read_split_ranges_into_intersecting_and_non_intersecting_injection_probability 0.91 --prefer_external_sort_block_bytes 1 --cross_join_min_rows_to_compress 0 --cross_join_min_bytes_to_compress 1 --min_external_table_block_size_bytes 0 --max_parsing_threads 10 --optimize_functions_to_subcolumns 1 --parallel_replicas_local_plan 1 --query_plan_join_swap_table false --enable_vertical_final 0 --optimize_extract_common_expressions 0 --optimize_rewrite_array_exists_to_has False --optimize_skip_unused_shards True --optimize_trivial_approximate_count_query False --optimize_trivial_insert_select False --optimize_using_constraints False --optimize_syntax_fuse_functions True --optimize_aggregators_of_group_by_keys True --optimize_and_compare_chain True --optimize_arithmetic_operations_in_aggregate_functions True --optimize_count_from_files True --optimize_distributed_group_by_sharding_key True --optimize_empty_string_comparisons True --optimize_group_by_constant_keys True --optimize_group_by_function_keys True --optimize_injective_functions_in_group_by True --optimize_injective_functions_inside_uniq True --optimize_inverse_dictionary_lookup True --optimize_move_to_prewhere True --optimize_multiif_to_if True --optimize_normalize_count_variants True --optimize_on_insert True --optimize_redundant_functions_in_order_by True --optimize_respect_aliases True --optimize_rewrite_aggregate_function_with_if True --optimize_rewrite_regexp_functions True --optimize_rewrite_sum_if_to_count_if True --optimize_skip_unused_shards_rewrite_in True --optimize_time_filter_with_preimage False --optimize_trivial_count_query True --optimize_uniq_to_count True --optimize_use_projections True --optimize_use_implicit_projections True --optimize_use_projection_filtering True --query_plan_optimize_lazy_materialization True --query_plan_optimize_prewhere True --use_async_executor_for_materialized_views 1 --use_query_condition_cache 0 --secondary_indices_enable_bulk_filtering 0 --use_skip_indexes_if_final 0 --use_skip_indexes_on_data_read 0 --use_indexes_refiner_in_read_pools 1 --enable_join_runtime_filters_index_analysis 1 --optimize_trivial_count_with_sparsity_filter 1 --optimize_rewrite_like_perfect_affix 0 --enable_lazy_columns_replication 0 --allow_special_serialization_kinds_in_output_formats 1 --use_skip_indexes_for_top_k 0 --use_top_k_dynamic_filtering False --query_plan_max_limit_for_top_k_optimization 0 --query_plan_read_in_order_through_join 1 --read_in_order_use_virtual_row 1 --short_circuit_function_evaluation_for_nulls_threshold 0.31205786687110154 --automatic_parallel_replicas_mode 0 --temporary_files_buffer_size 1217814 --query_plan_optimize_join_order_algorithm dpsize,greedy --max_bytes_before_external_join 1000000000 --grace_hash_join_initial_buckets 1 --query_plan_optimize_join_order_randomize 970989 --use_top_k_dynamic_filtering_for_variable_length_types False --page_cache_max_coalesced_bytes 67108864 --optimize_dictget_tuple_element True --execute_exists_as_scalar_subquery True --normalize_function_names True --enable_join_runtime_filters True --join_runtime_filter_min_probe_rows 0 --enable_parallel_blocks_marshalling True --query_plan_reuse_storage_ordering_for_window_functions False --query_plan_join_shard_by_pk_ranges False --count_distinct_optimization True --enable_add_distinct_to_in_subqueries True --use_statistics True --use_statistics_cache True --enable_optimize_predicate_expression True --enable_optimize_predicate_expression_to_final_subquery True --enable_software_prefetch_in_aggregation True --allow_reorder_prewhere_conditions True --materialize_statistics_on_insert True --query_plan_merge_filters True --query_plan_remove_unused_columns True --query_plan_convert_outer_join_to_inner_join True --query_plan_convert_any_join_to_semi_or_anti_join True --query_plan_merge_filter_into_join_condition True --query_plan_enable_multithreading_after_window_functions True --query_plan_max_limit_for_lazy_materialization 10 --query_plan_optimize_join_order_limit 64 --query_plan_direct_read_from_text_index True --query_plan_text_index_add_hint True --optimize_truncate_order_by_after_group_by_keys True --enable_automatic_decision_for_merging_across_partitions_for_final True --parallel_non_joined_rows_processing True --use_skip_indexes_for_disjunctions True --use_hash_table_stats_for_join_reordering True --allow_calculating_subcolumns_sizes_for_merge_tree_reading True --use_join_disjunctions_push_down True --enable_join_transitive_predicates False --use_streaming_marks_compression 1 --text_index_posting_list_apply_mode lazy --text_index_lazy_intersection_density_threshold 0.1480129187056557 --max_bytes_before_external_sort 8460572261 --max_bytes_before_external_group_by 1062196081 --max_bytes_ratio_before_external_sort 0 --max_bytes_ratio_before_external_group_by 0 --use_skip_indexes_if_final_exact_mode 0 [2026-11-03 02:09:31] 2026-11-02 22:09:31 [2026-11-03 02:09:31] 2026-11-02 22:09:31 MergeTree settings used in test: --ratio_of_defaults_for_sparse_serialization 1.0 --compute_exact_num_defaults_for_sparse_columns 0 --prefer_fetch_merged_part_size_threshold 1 --vertical_merge_algorithm_min_rows_to_activate 862234 --vertical_merge_algorithm_min_columns_to_activate 1 --allow_vertical_merges_from_compact_to_wide_parts 0 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 6883788 --merge_max_block_size 20655 --merge_use_batch_sorting_queue 1 --index_granularity 35324 --min_bytes_for_wide_part 0 --marks_compress_block_size 20568 --primary_key_compress_block_size 82905 --replace_long_file_name_to_hash 0 --max_file_name_length 0 --min_bytes_for_full_part_storage 536870912 --compact_parts_max_bytes_to_buffer 280841282 --compact_parts_max_granules_to_buffer 138 --compact_parts_merge_max_bytes_to_prefetch_part 20647545 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 37 --old_parts_lifetime 243 --prewarm_mark_cache 1 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 0 --enable_block_number_column 0 --enable_block_offset_column 1 --patch_parts_version v1 --use_primary_key_cache 1 --prewarm_primary_key_cache 0 --object_serialization_version v3 --object_shared_data_serialization_version advanced --object_shared_data_serialization_version_for_zero_level_parts map_with_buckets --object_shared_data_buckets_for_compact_part 6 --object_shared_data_buckets_for_wide_part 32 --dynamic_serialization_version v3 --serialization_info_version basic --string_serialization_version single_stream --nullable_serialization_version allow_sparse --enable_shared_storage_snapshot_in_query 0 --min_columns_to_activate_adaptive_write_buffer 763 --reduce_blocking_parts_sleep_ms 1104 --shared_merge_tree_outdated_parts_group_size 2 --shared_merge_tree_max_outdated_parts_to_process_at_once 7 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas 0 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas_on_startup 0 --text_index_dictionary_block_size 128 --text_index_dictionary_block_frontcoding_compression 0 --text_index_posting_list_block_size 64 --text_index_posting_list_codec bitpacking --map_serialization_version basic --map_serialization_version_for_zero_level_parts basic --max_buckets_in_map 76 --map_buckets_strategy sqrt --map_buckets_min_avg_size 614 --map_buckets_coefficient 1.43 --propagate_types_serialization_versions_to_nested_types 0 --compress_per_column_in_compact_parts 1 --packed_skip_index_max_bytes 1048576 [2026-11-03 02:09:31] 2026-11-02 22:09:31 [2026-11-03 02:09:31] 2026-11-02 22:09:31 Database: test_h5f2j5z7g0g9 [2026-11-03 02:09:31] 2026-11-02 22:09:31 [2026-11-03 02:09:31] 2026-11-02 22:09:31 Having 1 errors! 7 tests passed. 0 tests skipped. 0 broken tests. 126.64 s elapsed (Process-7). [2026-11-03 02:10:27] 2026-11-02 22:10:27 [70 / 70] 04039_merge_tree_snapshot_teardown_race: [ OK ] 182.52 sec. [2026-11-03 02:10:27] 2026-11-02 22:10:27 [2026-11-03 02:10:27] 2026-11-02 22:10:27 1 tests passed. 0 tests skipped. 182.63 s elapsed (Process-5). [2026-11-03 02:10:27] 2026-11-02 22:10:27 Checking the hung queries: done [2026-11-03 02:10:27] 2026-11-02 22:10:27 [2026-11-03 02:10:27] 2026-11-02 22:10:27 No queries hung. [2026-11-03 02:10:27] 2026-11-02 22:10:27 All tests have finished. [2026-11-03 02:10:28] ERROR: command failed after 1/1 attempt(s), exit code: 1 [2026-11-03 02:10:28] WARNING: Failed to get start time for [Tests] - start time and duration won't be set [2026-11-03 02:10:28] Run command: [clickhouse-client --query "SYSTEM FLUSH LOGS"] [2026-11-03 02:10:32] Run command: [./ci/jobs/scripts/functional_tests/setup_log_cluster.sh --stop-log-replication] [2026-11-03 02:10:32] ./ci/jobs/scripts/functional_tests/setup_log_cluster.sh: line 18: EXTRA_COLUMNS_EXPRESSION: parameter null or not set [2026-11-03 02:10:32] ERROR: command failed after 1/1 attempt(s), exit code: 1 [2026-11-03 02:10:32] Running diagnostics for 1 test(s)... [2026-11-03 02:10:32] Run command: [clickhouse-test --testname --check-zookeeper-session --hung-check --memory-limit 10737418240 --trace --capture-client-stacktrace --queries ./tests/queries --shard --zookeeper --diagnose-random-settings --random-settings-diagnostics-dir /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/random-settings-diagnostics --no-random-settings --no-random-merge-tree-settings -- 05045_iceberg_manifest_partition_arity] [2026-11-03 02:10:32] Using queries from './tests/queries' directory [2026-11-03 02:10:32] Connecting to ClickHouse server... OK [2026-11-03 02:10:32] Connected to server 26.8.34.20001.altinityantalya @ 1fbcb015cfa4aa38542b3791d48db19e069bac58 HEAD [2026-11-03 02:10:32] build_flags=['asan', 'ubsan', 'release', 'use_embedded_compiler', 'use_glibc_compatibility', 'use_icu', 'use_h3', 'use_mysql', 'use_rdkafka', 'use_capnp', 'use_simdutf', 'use_hdfs', 'use_snappy', 'use_parquet', 'use_protobuf', 'use_brotli', 'use_libdeflate', 'use_ssl', 'use_vectorscan', 'use_simdjson', 'use_grpc', 'use_ldap', 'use_krb5', 'use_filelog', 'use_bzip2', 'use_amqpcpp', 'use_rocksdb', 'use_nuraft', 'use_nlp', 'use_libstemmer', 'use_liburing', 'use_sqlite', 'use_libpqxx', 'use_azure_blob_storage', 'use_aws_s3', 'use_cassandra', 'use_yaml_cpp', 'use_datasketches', 'use_avro', 'use_arrow', 'use_orc', 'use_msgpack', 'use_delta_kernel_rs', 'use_wasmedge', 'use_wasmtime', 'use_jwt_cpp', 'cpu-x86_64'] collect_per_test_coverage=False coverage_active=False [2026-11-03 02:10:32] Found 1 test(s) to diagnose. [2026-11-03 02:10:32] ====================================================================== [2026-11-03 02:10:32] Diagnosing: 05045_iceberg_manifest_partition_arity [2026-11-03 02:10:32] Settings: --max_insert_threads 2 --send_table_structure_on_insert_with_inline_data 0 --group_by_two_level_threshold 328610 --group_by_two_level_threshold_bytes 39531143 --distributed_aggregation_memory_efficient 1 --fsync_metadata 1 --output_format_parallel_formatting 1 --input_format_parallel_parsing 0 --input_format_parquet_dictionary_filter_push_down 0 --min_chunk_bytes_for_parallel_parsing 19338484 --max_read_buffer_size 706369 --prefer_localhost_replica 0 --max_block_size 66350 --max_joined_block_size_rows 88997 --joined_block_split_single_row 0 --join_output_by_rowlist_perkey_rows_threshold 765 --max_threads 1 --optimize_append_index 1 --use_hedged_requests 1 --optimize_if_chain_to_multiif 1 --optimize_if_transform_strings_to_enum 0 --optimize_read_in_order 1 --optimize_or_like_chain 1 --optimize_substitute_columns 1 --enable_multiple_prewhere_read_steps 1 --use_lightweight_primary_key_index_analysis True --read_in_order_two_level_merge_threshold 77 --optimize_aggregation_in_order 1 --aggregation_in_order_max_block_bytes 7967692 --use_uncompressed_cache 1 --min_bytes_to_use_direct_io 10737418240 --min_bytes_to_use_mmap_io 10737418240 --local_filesystem_read_method pread_threadpool --remote_filesystem_read_method read --local_filesystem_read_prefetch 0 --filesystem_cache_segments_batch_size 5 --read_from_filesystem_cache_if_exists_otherwise_bypass_cache 1 --throw_on_error_from_cache_on_write_operations 0 --remote_filesystem_read_prefetch 1 --distributed_cache_discard_connection_if_unread_data 0 --distributed_cache_use_clients_cache_for_read 0 --allow_prefetched_read_pool_for_remote_filesystem 0 --filesystem_prefetch_max_memory_usage 32Mi --filesystem_prefetches_limit 0 --filesystem_prefetch_min_bytes_for_single_read_task 8Mi --filesystem_prefetch_step_marks 50 --filesystem_prefetch_step_bytes 100Mi --enable_filesystem_cache 0 --enable_filesystem_cache_on_write_operations 0 --compile_expressions 1 --compile_aggregate_expressions 0 --compile_sort_description 0 --merge_tree_coarse_index_granularity 18 --optimize_distinct_in_order 1 --max_bytes_before_remerge_sort 293903977 --min_compress_block_size 362920 --max_compress_block_size 309553 --merge_tree_compact_parts_min_granules_to_multibuffer_read 5 --optimize_sorting_by_input_stream_properties 1 --http_response_buffer_size 4220635 --http_wait_end_of_query True --enable_memory_bound_merging_of_aggregation_results 0 --min_count_to_compile_expression 0 --min_count_to_compile_aggregate_expression 0 --min_count_to_compile_sort_description 3 --session_timezone Mexico/BajaSur --use_page_cache_for_disks_without_file_cache True --use_page_cache_for_local_disks False --use_page_cache_for_object_storage True --page_cache_inject_eviction False --merge_tree_read_split_ranges_into_intersecting_and_non_intersecting_injection_probability 0.91 --prefer_external_sort_block_bytes 1 --cross_join_min_rows_to_compress 0 --cross_join_min_bytes_to_compress 1 --min_external_table_block_size_bytes 0 --max_parsing_threads 10 --optimize_functions_to_subcolumns 1 --parallel_replicas_local_plan 1 --query_plan_join_swap_table false --enable_vertical_final 0 --optimize_extract_common_expressions 0 --optimize_rewrite_array_exists_to_has False --optimize_skip_unused_shards True --optimize_trivial_approximate_count_query False --optimize_trivial_insert_select False --optimize_using_constraints False --optimize_syntax_fuse_functions True --optimize_aggregators_of_group_by_keys True --optimize_and_compare_chain True --optimize_arithmetic_operations_in_aggregate_functions True --optimize_count_from_files True --optimize_distributed_group_by_sharding_key True --optimize_empty_string_comparisons True --optimize_group_by_constant_keys True --optimize_group_by_function_keys True --optimize_injective_functions_in_group_by True --optimize_injective_functions_inside_uniq True --optimize_inverse_dictionary_lookup True --optimize_move_to_prewhere True --optimize_multiif_to_if True --optimize_normalize_count_variants True --optimize_on_insert True --optimize_redundant_functions_in_order_by True --optimize_respect_aliases True --optimize_rewrite_aggregate_function_with_if True --optimize_rewrite_regexp_functions True --optimize_rewrite_sum_if_to_count_if True --optimize_skip_unused_shards_rewrite_in True --optimize_time_filter_with_preimage False --optimize_trivial_count_query True --optimize_uniq_to_count True --optimize_use_projections True --optimize_use_implicit_projections True --optimize_use_projection_filtering True --query_plan_optimize_lazy_materialization True --query_plan_optimize_prewhere True --use_async_executor_for_materialized_views 1 --use_query_condition_cache 0 --secondary_indices_enable_bulk_filtering 0 --use_skip_indexes_if_final 0 --use_skip_indexes_on_data_read 0 --use_indexes_refiner_in_read_pools 1 --enable_join_runtime_filters_index_analysis 1 --optimize_trivial_count_with_sparsity_filter 1 --optimize_rewrite_like_perfect_affix 0 --enable_lazy_columns_replication 0 --allow_special_serialization_kinds_in_output_formats 1 --use_skip_indexes_for_top_k 0 --use_top_k_dynamic_filtering False --query_plan_max_limit_for_top_k_optimization 0 --query_plan_read_in_order_through_join 1 --read_in_order_use_virtual_row 1 --short_circuit_function_evaluation_for_nulls_threshold 0.31205786687110154 --automatic_parallel_replicas_mode 0 --temporary_files_buffer_size 1217814 --query_plan_optimize_join_order_algorithm dpsize,greedy --max_bytes_before_external_join 1000000000 --grace_hash_join_initial_buckets 1 --query_plan_optimize_join_order_randomize 970989 --use_top_k_dynamic_filtering_for_variable_length_types False --page_cache_max_coalesced_bytes 67108864 --optimize_dictget_tuple_element True --execute_exists_as_scalar_subquery True --normalize_function_names True --enable_join_runtime_filters True --join_runtime_filter_min_probe_rows 0 --enable_parallel_blocks_marshalling True --query_plan_reuse_storage_ordering_for_window_functions False --query_plan_join_shard_by_pk_ranges False --count_distinct_optimization True --enable_add_distinct_to_in_subqueries True --use_statistics True --use_statistics_cache True --enable_optimize_predicate_expression True --enable_optimize_predicate_expression_to_final_subquery True --enable_software_prefetch_in_aggregation True --allow_reorder_prewhere_conditions True --materialize_statistics_on_insert True --query_plan_merge_filters True --query_plan_remove_unused_columns True --query_plan_convert_outer_join_to_inner_join True --query_plan_convert_any_join_to_semi_or_anti_join True --query_plan_merge_filter_into_join_condition True --query_plan_enable_multithreading_after_window_functions True --query_plan_max_limit_for_lazy_materialization 10 --query_plan_optimize_join_order_limit 64 --query_plan_direct_read_from_text_index True --query_plan_text_index_add_hint True --optimize_truncate_order_by_after_group_by_keys True --enable_automatic_decision_for_merging_across_partitions_for_final True --parallel_non_joined_rows_processing True --use_skip_indexes_for_disjunctions True --use_hash_table_stats_for_join_reordering True --allow_calculating_subcolumns_sizes_for_merge_tree_reading True --use_join_disjunctions_push_down True --enable_join_transitive_predicates False --use_streaming_marks_compression 1 --text_index_posting_list_apply_mode lazy --text_index_lazy_intersection_density_threshold 0.1480129187056557 --max_bytes_before_external_sort 8460572261 --max_bytes_before_external_group_by 1062196081 --max_bytes_ratio_before_external_sort 0 --max_bytes_ratio_before_external_group_by 0 --use_skip_indexes_if_final_exact_mode 0 [2026-11-03 02:10:32] MergeTree settings: --ratio_of_defaults_for_sparse_serialization 1.0 --compute_exact_num_defaults_for_sparse_columns 0 --prefer_fetch_merged_part_size_threshold 1 --vertical_merge_algorithm_min_rows_to_activate 862234 --vertical_merge_algorithm_min_columns_to_activate 1 --allow_vertical_merges_from_compact_to_wide_parts 0 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 6883788 --merge_max_block_size 20655 --merge_use_batch_sorting_queue 1 --index_granularity 35324 --min_bytes_for_wide_part 0 --marks_compress_block_size 20568 --primary_key_compress_block_size 82905 --replace_long_file_name_to_hash 0 --max_file_name_length 0 --min_bytes_for_full_part_storage 536870912 --compact_parts_max_bytes_to_buffer 280841282 --compact_parts_max_granules_to_buffer 138 --compact_parts_merge_max_bytes_to_prefetch_part 20647545 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 37 --old_parts_lifetime 243 --prewarm_mark_cache 1 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 0 --enable_block_number_column 0 --enable_block_offset_column 1 --patch_parts_version v1 --use_primary_key_cache 1 --prewarm_primary_key_cache 0 --object_serialization_version v3 --object_shared_data_serialization_version advanced --object_shared_data_serialization_version_for_zero_level_parts map_with_buckets --object_shared_data_buckets_for_compact_part 6 --object_shared_data_buckets_for_wide_part 32 --dynamic_serialization_version v3 --serialization_info_version basic --string_serialization_version single_stream --nullable_serialization_version allow_sparse --enable_shared_storage_snapshot_in_query 0 --min_columns_to_activate_adaptive_write_buffer 763 --reduce_blocking_parts_sleep_ms 1104 --shared_merge_tree_outdated_parts_group_size 2 --shared_merge_tree_max_outdated_parts_to_process_at_once 7 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas 0 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas_on_startup 0 --text_index_dictionary_block_size 128 --text_index_dictionary_block_frontcoding_compression 0 --text_index_posting_list_block_size 64 --text_index_posting_list_codec bitpacking --map_serialization_version basic --map_serialization_version_for_zero_level_parts basic --max_buckets_in_map 76 --map_buckets_strategy sqrt --map_buckets_min_avg_size 614 --map_buckets_coefficient 1.43 --propagate_types_serialization_versions_to_nested_types 0 --compress_per_column_in_compact_parts 1 --packed_skip_index_max_bytes 1048576 [2026-11-03 02:10:32] ====================================================================== [2026-11-03 02:13:02] --- Randomized settings diagnosis --- [2026-11-03 02:13:02] Step 1: Re-running with the same randomized settings (budget: 60s)... [2026-11-03 02:13:02] Runs: 2, Failed: 2, Passed: 0, Other: 0 [2026-11-03 02:13:02] Result: Failure is reproducible. [2026-11-03 02:13:02] Step 2: Re-running without randomized settings (budget: 60s)... [2026-11-03 02:13:02] Runs: 4, Failed: 4, Passed: 0, Other: 0 [2026-11-03 02:13:02] Result: Test also fails without randomized settings (not a randomization issue). [2026-11-03 02:13:02] Stopping Redpanda broker [2026-11-03 02:13:02] Run command: [pkill -f redpanda] [2026-11-03 02:13:02] Run command: [clickhouse-client --port 9000 --query "system flush logs"] [2026-11-03 02:13:07] Run command: [clickhouse-client --port 9000 --query "SYSTEM FLUSH ASYNC INSERT QUEUE"] [2026-11-03 02:13:07] Stop ClickHouse processes [2026-11-03 02:13:07] Run command: [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && clickhouse stop --pid-path /etc/clickhouse-server --max-tries 300 --do-not-kill >/dev/null] [2026-11-03 02:13:27] Check fatal errors [2026-11-03 02:13:27] > Start execution for [Exception in test runner] [2026-11-03 02:13:27] Run command: [! awk 'found && /^[^[:space:]]/ { print; exit } /^Traceback \(most recent call last\):/ { found=1 } found { print }' /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/job.log | head -n 100 | tee /dev/stderr | grep -q .] [2026-11-03 02:13:27] > Start execution for [Lost s3 keys] [2026-11-03 02:13:27] Run command: [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/var/log/clickhouse-server && ! grep -a 'Code: 499.*The specified key does not exist' clickhouse-server*.log | grep -v -e 'a.myext' -e 'ReadBuffer is canceled by the exception' -e 'DistributedCacheTCPHandler' -e 'ReadBufferFromDistributedCache' -e 'ReadBufferFromS3' -e 'ReadBufferFromAzureBlobStorage' -e 'AsynchronousBoundedReadBuffer' -e 'Error during background download' -e 'caller id: None:DistribCache' | head -n100 | tee /dev/stderr | grep -q .] [2026-11-03 02:13:27] > Start execution for [Lost forever for SharedMergeTree] [2026-11-03 02:13:27] Run command: [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/var/log/clickhouse-server && ! grep -a 'it is lost forever' clickhouse-server*.log | head -n100 | tee /dev/stderr | grep -q .] [2026-11-03 02:13:27] > Start execution for [S3_ERROR No such key thrown (in clickhouse-server.log or clickhouse-server.err.log)] [2026-11-03 02:13:27] Run command: [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/var/log/clickhouse-server && ! grep -a 'Code: 499.*The specified key does not exist' clickhouse-server*.log | grep -v -e 'a.myext' -e 'ReadBuffer is canceled by the exception' -e 'DistributedCacheTCPHandler' -e 'ReadBufferFromDistributedCache' -e 'ReadBufferFromS3' -e 'ReadBufferFromAzureBlobStorage' -e 'AsynchronousBoundedReadBuffer' -e 'Error during background download' -e 'caller id: None:DistribCache' | head -n100 | tee /dev/stderr | grep -q .] [2026-11-03 02:13:27] > Start execution for [OOM in dmesg] [2026-11-03 02:13:27] Run command: [! cat /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/dmesg.log | grep -a -e 'Out of memory: Killed process' -e 'oom_reaper: reaped process' -e 'oom-kill:constraint=CONSTRAINT_NONE' | tee /dev/stderr | grep -q .] [2026-11-03 02:13:27] Collect logs [2026-11-03 02:13:27] > Start execution for [Collect logs] [2026-11-03 02:13:27] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && timeout --verbose --signal=TERM --kill-after=60 600 clickhouse local --max_memory_usage 10G --max_threads 1 --max_rows_to_read=0 --max_result_rows 0 --max_result_bytes 0 --max_bytes_to_read 0 --max_execution_time 0 --max_execution_time_leaf 0 --max_estimated_execution_time 0 --only-system-tables --stacktrace --config-file=/etc/clickhouse-server/config.xml --path /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 --query "select * from system.query_log into outfile '/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/query_log.tsv' format TSVWithNamesAndTypes" -- --zookeeper.implementation=testkeeper] [2026-11-03 02:13:34] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && wc -l < /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/query_log.tsv] [2026-11-03 02:13:34] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && timeout --verbose --signal=TERM --kill-after=60 600 clickhouse local --max_memory_usage 10G --max_threads 1 --max_rows_to_read=0 --max_result_rows 0 --max_result_bytes 0 --max_bytes_to_read 0 --max_execution_time 0 --max_execution_time_leaf 0 --max_estimated_execution_time 0 --only-system-tables --stacktrace --config-file=/etc/clickhouse-server/config.xml --path /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 --query "select * from system.zookeeper_log into outfile '/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/zookeeper_log.tsv' format TSVWithNamesAndTypes" -- --zookeeper.implementation=testkeeper] [2026-11-03 02:13:40] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && wc -l < /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/zookeeper_log.tsv] [2026-11-03 02:13:40] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && timeout --verbose --signal=TERM --kill-after=60 600 clickhouse local --max_memory_usage 10G --max_threads 1 --max_rows_to_read=0 --max_result_rows 0 --max_result_bytes 0 --max_bytes_to_read 0 --max_execution_time 0 --max_execution_time_leaf 0 --max_estimated_execution_time 0 --only-system-tables --stacktrace --config-file=/etc/clickhouse-server/config.xml --path /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 --query "select * from system.aggregated_zookeeper_log into outfile '/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/aggregated_zookeeper_log.tsv' format TSVWithNamesAndTypes" -- --zookeeper.implementation=testkeeper] [2026-11-03 02:13:46] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && wc -l < /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/aggregated_zookeeper_log.tsv] [2026-11-03 02:13:46] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && timeout --verbose --signal=TERM --kill-after=60 600 clickhouse local --max_memory_usage 10G --max_threads 1 --max_rows_to_read=0 --max_result_rows 0 --max_result_bytes 0 --max_bytes_to_read 0 --max_execution_time 0 --max_execution_time_leaf 0 --max_estimated_execution_time 0 --only-system-tables --stacktrace --config-file=/etc/clickhouse-server/config.xml --path /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 --query "select * from system.trace_log into outfile '/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/trace_log.tsv' format TSVWithNamesAndTypes" -- --zookeeper.implementation=testkeeper] [2026-11-03 02:13:54] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && wc -l < /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/trace_log.tsv] [2026-11-03 02:13:54] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && timeout --verbose --signal=TERM --kill-after=60 600 clickhouse local --max_memory_usage 10G --max_threads 1 --max_rows_to_read=0 --max_result_rows 0 --max_result_bytes 0 --max_bytes_to_read 0 --max_execution_time 0 --max_execution_time_leaf 0 --max_estimated_execution_time 0 --only-system-tables --stacktrace --config-file=/etc/clickhouse-server/config.xml --path /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 --query "select * from system.transactions_info_log into outfile '/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/transactions_info_log.tsv' format TSVWithNamesAndTypes" -- --zookeeper.implementation=testkeeper] [2026-11-03 02:14:00] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && wc -l < /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/transactions_info_log.tsv] [2026-11-03 02:14:00] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && timeout --verbose --signal=TERM --kill-after=60 600 clickhouse local --max_memory_usage 10G --max_threads 1 --max_rows_to_read=0 --max_result_rows 0 --max_result_bytes 0 --max_bytes_to_read 0 --max_execution_time 0 --max_execution_time_leaf 0 --max_estimated_execution_time 0 --only-system-tables --stacktrace --config-file=/etc/clickhouse-server/config.xml --path /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 --query "select * from system.metric_log into outfile '/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/metric_log.tsv' format TSVWithNamesAndTypes" -- --zookeeper.implementation=testkeeper] [2026-11-03 02:14:08] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && wc -l < /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/metric_log.tsv] [2026-11-03 02:14:08] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && timeout --verbose --signal=TERM --kill-after=60 600 clickhouse local --max_memory_usage 10G --max_threads 1 --max_rows_to_read=0 --max_result_rows 0 --max_result_bytes 0 --max_bytes_to_read 0 --max_execution_time 0 --max_execution_time_leaf 0 --max_estimated_execution_time 0 --only-system-tables --stacktrace --config-file=/etc/clickhouse-server/config.xml --path /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 --query "select * from system.error_log into outfile '/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/error_log.tsv' format TSVWithNamesAndTypes" -- --zookeeper.implementation=testkeeper] [2026-11-03 02:14:14] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && wc -l < /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/error_log.tsv] [2026-11-03 02:14:14] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && timeout --verbose --signal=TERM --kill-after=60 600 clickhouse local --max_memory_usage 10G --max_threads 1 --max_rows_to_read=0 --max_result_rows 0 --max_result_bytes 0 --max_bytes_to_read 0 --max_execution_time 0 --max_execution_time_leaf 0 --max_estimated_execution_time 0 --only-system-tables --stacktrace --config-file=/etc/clickhouse-server/config.xml --path /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 --query "select * from system.query_metric_log into outfile '/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/query_metric_log.tsv' format TSVWithNamesAndTypes" -- --zookeeper.implementation=testkeeper] [2026-11-03 02:14:21] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && wc -l < /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/query_metric_log.tsv] [2026-11-03 02:14:21] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && timeout --verbose --signal=TERM --kill-after=60 600 clickhouse local --max_memory_usage 10G --max_threads 1 --max_rows_to_read=0 --max_result_rows 0 --max_result_bytes 0 --max_bytes_to_read 0 --max_execution_time 0 --max_execution_time_leaf 0 --max_estimated_execution_time 0 --only-system-tables --stacktrace --config-file=/etc/clickhouse-server/config.xml --path /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 --query "select * from system.part_log into outfile '/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/part_log.tsv' format TSVWithNamesAndTypes" -- --zookeeper.implementation=testkeeper] [2026-11-03 02:14:28] Run command [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0 && wc -l < /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/part_log.tsv] [2026-11-03 02:14:28] Run command: [cd /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp && tar -czf coordination.tar.gz --files-from <(find . -type d -name coordination)] [2026-11-03 02:14:28] NOTE: Failed 1 tests - do not block pipeline, exit with 0 [2026-11-03 02:14:28] ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ [2026-11-03 02:14:28] Fail [Stateless tests (amd_asan_ubsan, distributed plan, parallel, selected tests)] [2026-11-03 02:14:28] | Failed: 1, Passed: 69, Skipped: 0, Broken: 0 [2026-11-03 02:14:28] Fail [Tests] [2026-11-03 02:14:28] Fail [05045_iceberg_manifest_partition_arity] [2026-11-03 02:14:28] | --- Randomized settings diagnosis --- [2026-11-03 02:14:28] | Step 1: Re-running with the same randomized settings (budget: 60s)... [2026-11-03 02:14:28] | Runs: 2, Failed: 2, Passed: 0, Other: 0 [2026-11-03 02:14:28] | Result: Failure is reproducible. [2026-11-03 02:14:28] | Step 2: Re-running without randomized settings (budget: 60s)... [2026-11-03 02:14:28] | Runs: 4, Failed: 4, Passed: 0, Other: 0 [2026-11-03 02:14:28] | Result: Test also fails without randomized settings (not a randomization issue). [2026-11-03 02:14:28] | [2026-11-03 02:14:28] | 2026-11-02 22:09:31 Reason: result differs with reference: [2026-11-03 02:14:28] | 2026-11-02 22:09:31 --- /home/ubuntu/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/05045_iceberg_manifest_partition_arity.reference 2026-11-02 22:01:36.796517006 -0400 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 +++ /home/ubuntu/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/05045_iceberg_manifest_partition_arity.1641.stdout 2026-11-02 22:09:31.697812985 -0400 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 @@ -13,19 +13,19 @@ [2026-11-03 02:14:28] | 2026-11-02 22:09:31 --- A4 the server is still alive --- [2026-11-03 02:14:28] | 2026-11-02 22:09:31 1 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 --- A5 min/max pruning still applies when the partition key is narrower --- [2026-11-03 02:14:28] | 2026-11-02 22:09:31 1 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 1 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 --- A6 the tuple arity is validated even when no partition key is modelled --- [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ICEBERG_SPECIFICATION_VIOLATION [2026-11-03 02:14:28] | 2026-11-02 22:09:31 201 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 --- A7 partition pruning happens, and stops when the key is narrower --- [2026-11-03 02:14:28] | 2026-11-02 22:09:31 1 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 -0 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 +1 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 --- A8 a leading unmodellable field is not realigned onto the wrong value --- [2026-11-03 02:14:28] | 2026-11-02 22:09:31 201 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 -0 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 +1 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 --- A9 the manifest list prunes both tables before their patched manifests are read --- [2026-11-03 02:14:28] | 2026-11-02 22:09:31 201 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 201 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 1 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 1 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 [2026-11-03 02:14:28] | 2026-11-02 22:09:31 /home/ubuntu/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/test_h5f2j5z7g0g9/05045_iceberg_manifest_partition_arity.sh.bashlog: [2026-11-03 02:14:28] | 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:9] ROOT=/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0/user_files/test_h5f2j5z7g0g9_ibp [2026-11-03 02:14:28] | 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:10] rm -rf /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0/user_files/test_h5f2j5z7g0g9_ibp [2026-11-03 02:14:28] | 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:11] trap 'rm -rf "${ROOT}"' EXIT [2026-11-03 02:14:28] | 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:13] HELPER=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/test_h5f2j5z7g0g9/test_h5f2j5z7g0g9_avro_header.py [2026-11-03 02:14:28] | 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:14] cat [2026-11-03 02:14:28] | 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:74] SPEC_PQ='[{"field-id":1001,"name":"p","source-id":1,"transform":"identity"},{"field-id":1002,"name":"q","source-id":2,"transform":"identity"}]' [2026-11-03 02:14:28] | 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:75] SPEC_P='[{"field-id":1001,"name":"p","source-id":1,"transform":"identity"}]' [2026-11-03 02:14:28] | 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:79] SPEC_UNMODELLED='[{"field-id":1001,"name":"p","source-id":1,"transform":"identity"},{"field-id":1002,"name":"q","source-id":9999,"transform":"void"}]' [2026-11-03 02:14:28] | 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:83] SPEC_UNMODELLED_LEAD='[{"field-id":1001,"name":"q","source-id":9999,"transform":"void"},{"field-id":1002,"name":"p","source-id":1,"transform":"identity"}]' [2026-11-03 02:14:28] | 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:87] SPEC_NOKEY='[{"field-id":1001,"name":"p","source-id":9999,"transform":"void"}]' [2026-11-03 02:14:28] | 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:88] SPEC_NOKEY_OK='[{"field-id":1001,"name":"p","source-id":9999,"transform":"void"},{"field-id":1002,"name":"q","source-id":9998,"transform":"void"}]' [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:146] mk t_ok 'p, q' [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:94] cat [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:146] mk t_long 'p, q' [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:94] cat [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:146] mk t_short p [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:94] cat [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:146] mk t_narrow 'p, q' [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:94] cat [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:146] mk t_nokey 'p, q' [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:94] cat [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:146] mk t_nokey_ok 'p, q' [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:94] cat [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:146] mk t_narrow_lead 'q, p' [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ++ [2026-11-02 22:09:00] [:94] cat [2026-11-03 02:14:28] | 2026-11-02 22:09:31 + [2026-11-02 22:09:00] [:146] /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-client --send_logs_level=warning --database=test_h5f2j5z7g0g9 --log_comment 05045_iceberg_manifest_partition_arity.sh-test_h5f2j5z7g0g9 --no-secure --max_insert_threads 2 --send_table_structure_on_insert_with_inline_data 0 --group_by_two_level_threshold 328610 --group_by_two_level_threshold_bytes 39531143 --distributed_aggregation_memory_efficient 1 --fsync_metadata 1 --output_format_parallel_formatting 1 --input_format_parallel_parsing 0 --input_format_parquet_dictionary_filter_push_down 0 --min_chunk_bytes_for_parallel_parsing 19338484 --max_read_buffer_size 706369 --prefer_localhost_replica 0 --max_block_size 66350 --max_joined_block_size_rows 88997 --joined_block_split_single_row 0 --join_output_by_rowlist_perkey_rows_threshold 765 --max_threads 1 --optimize_append_index 1 --use_hedged_requests 1 --optimize_if_chain_to_multiif 1 --optimize_if_transform_strings_to_enum 0 --optimize_read_in_order 1 --optimize_or_like_chain 1 --optimize_substitute_columns 1 --enable_multiple_prewhere_read_steps 1 --use_lightweight_primary_key_index_analysis True --read_in_order_two_level_merge_threshold 77 --optimize_aggregation_in_order 1 --aggregation_in_order_max_block_bytes 7967692 --use_uncompressed_cache 1 --min_bytes_to_use_direct_io 10737418240 --min_bytes_to_use_mmap_io 10737418240 --local_filesystem_read_method pread_threadpool --remote_filesystem_read_method read --local_filesystem_read_prefetch 0 --filesystem_cache_segments_batch_size 5 --read_from_filesystem_cache_if_exists_otherwise_bypass_cache 1 --throw_on_error_from_cache_on_write_operations 0 --remote_filesystem_read_prefetch 1 --distributed_cache_discard_connection_if_unread_data 0 --distributed_cache_use_clients_cache_for_read 0 --allow_prefetched_read_pool_for_remote_filesystem 0 --filesystem_prefetch_max_memory_usage 32Mi --filesystem_prefetches_limit 0 --filesystem_prefetch_min_bytes_for_single_read_task 8Mi --filesystem_prefetch_step_marks 50 --filesystem_prefetch_step_bytes 100Mi --enable_filesystem_cache 0 --enable_filesystem_cache_on_write_operations 0 --compile_expressions 1 --compile_aggregate_expressions 0 --compile_sort_description 0 --merge_tree_coarse_index_granularity 18 --optimize_distinct_in_order 1 --max_bytes_before_remerge_sort 293903977 --min_compress_block_size 362920 --max_compress_block_size 309553 --merge_tree_compact_parts_min_granules_to_multibuffer_read 5 --optimize_sorting_by_input_stream_properties 1 --http_response_buffer_size 4220635 --http_wait_end_of_query True --enable_memory_bound_merging_of_aggregation_results 0 --min_count_to_compile_expression 0 --min_count_to_compile_aggregate_expression 0 --min_count_to_compile_sort_description 3 --session_timezone Mexico/BajaSur --use_page_cache_for_disks_without_file_cache True --use_page_cache_for_local_disks False --use_page_cache_for_object_storage True --page_cache_inject_eviction False --merge_tree_read_split_ranges_into_intersecting_and_non_intersecting_injection_probability 0.91 --prefer_external_sort_block_bytes 1 --cross_join_min_rows_to_compress 0 --cross_join_min_bytes_to_compress 1 --min_external_table_block_size_bytes 0 --max_parsing_threads 10 --optimize_functions_to_subcolumns 1 --parallel_replicas_local_plan 1 --query_plan_join_swap_table false --enable_vertical_final 0 --optimize_extract_common_expressions 0 --optimize_rewrite_array_exists_to_has False --optimize_skip_unused_shards True --optimize_trivial_approximate_count_query False --optimize_trivial_insert_select False --optimize_using_constraints False --optimize_syntax_fuse_functions True --optimize_aggregators_of_group_by_keys True --optimize_and_compare_chain True --optimize_arithmetic_operations_in_aggregate_functions True --optimize_count_from_files True --optimize_distributed_group_by_sharding_key True --optimize_empty_string_comparisons True --optimize_group_by_constant_keys True --optimize_group_by_function_keys True --optimize_injective_functions_in_group_by True --optimize_injective_functions_inside_uniq True --optimize_inverse_dictionary_lookup True --optimize_move_to_prewhere True --optimize_multiif_to_if True --optimize_normalize_count_variants True --optimize_on_insert True --optimize_redundant_functions_in_order_by True --optimize_respect_aliases True --optimize_rewrite_aggregate_function_with_if True --optimize_rewrite_regexp_functions True --optimize_rewrite_sum_if_to_count_if True --optimize_skip_unused_shards_rewrite_in True --optimize_time_filter_with_preimage False --optimize_trivial_count_query True --optimize_uniq_to_count True --optimize_use_projections True --optimize_use_implicit_projections True --optimize_use_projection_filtering True --query_plan_optimize_lazy_materialization True --query_plan_optimize_prewhere True --use_async_executor_for_materialized_views 1 --use_query_condition_cache 0 --secondary_indices_enable_bulk_filtering 0 --use_skip_indexes_if_final 0 --use_skip_indexes_on_data_read 0 --use_indexes_refiner_in_read_pools 1 --enable_join_runtime_filters_index_analysis 1 --optimize_trivial_count_with_sparsity_filter 1 --optimize_rewrite_like_perfect_affix 0 --enable_lazy_columns_replication 0 --allow_special_serialization_kinds_in_output_formats 1 --use_skip_indexes_for_top_k 0 --use_top_k_dynamic_filtering False --query_plan_max_limit_for_top_k_optimization 0 --query_plan_read_in_order_through_join 1 --read_in_order_use_virtual_row 1 --short_circuit_function_evaluation_for_nulls_threshold 0.31205786687110154 --automatic_parallel_replicas_mode 0 --temporary_files_buffer_size 1217814 --query_plan_optimize_join_order_algorithm dpsize,greedy --max_bytes_before_external_join 1000000000 --grace_hash_join_initial_buckets 1 --query_plan_optimize_join_order_randomize 970989 --use_top_k_dynamic_filtering_for_variable_length_types False --page_cache_max_coalesced_bytes 67108864 --optimize_dictget_tuple_element True --execute_exists_as_scalar_subquery True --normalize_function_names True --enable_join_runtime_filters True --join_runtime_filter_min_probe_rows 0 --enable_parallel_blocks_marshalling True --query_plan_reuse_storage_ordering_for_window_functions False --query_plan_join_shard_by_pk_ranges False --count_distinct_optimization True --enable_add_distinct_to_in_subqueries True --use_statistics True --use_statistics_cache True --enable_optimize_predicate_expression True --enable_optimize_predicate_expression_to_final_subquery True --enable_software_prefetch_in_aggregation True --allow_reorder_prewhere_conditions True --materialize_statistics_on_insert True --query_plan_merge_filters True --query_plan_remove_unused_columns True --query_plan_convert_outer_join_to_inner_join True --query_plan_convert_any_join_to_semi_or_anti_join True --query_plan_merge_filter_into_join_condition True --query_plan_enable_multithreading_after_window_functions True --query_plan_max_limit_for_lazy_materialization 10 --query_plan_optimize_join_order_limit 64 --query_plan_direct_read_from_text_index True --query_plan_text_index_add_hint True --optimize_truncate_order_by_after_group_by_keys True --enable_automatic_decision_for_merging_across_partitions_for_final True --parallel_non_joined_rows_processing True --use_skip_indexes_for_disjunctions True --use_hash_table_stats_for_join_reordering True --allow_calculating_subcolumns_sizes_for_merge_tree_reading True --use_join_disjunctions_push_down True --enable_join_transitive_predicates False --use_streaming_marks_compression 1 --text_index_posting_list_apply_mode lazy --text_index_lazy_intersection_density_threshold 0.1480129187056557 --max_bytes_before_external_sort 8460572261 --max_bytes_before_external_group_by 1062196081 --max_bytes_ratio_before_external_sort 0 --max_bytes_ratio_before_external_group_by 0 --use_skip_indexes_if_final_exact_mode 0 --allow_merge_tree_settings --ratio_of_defaults_for_sparse_serialization 1.0 --compute_exact_num_defaults_for_sparse_columns 0 --prefer_fetch_merged_part_size_threshold 1 --vertical_merge_algorithm_min_rows_to_activate 862234 --vertical_merge_algorithm_min_columns_to_activate 1 --allow_vertical_merges_from_compact_to_wide_parts 0 --min_merge_bytes_to_use_direct_io 1 --index_granularity_bytes 6883788 --merge_max_block_size 20655 --merge_use_batch_sorting_queue 1 --index_granularity 35324 --min_bytes_for_wide_part 0 --marks_compress_block_size 20568 --primary_key_compress_block_size 82905 --replace_long_file_name_to_hash 0 --max_file_name_length 0 --min_bytes_for_full_part_storage 536870912 --compact_parts_max_bytes_to_buffer 280841282 --compact_parts_max_granules_to_buffer 138 --compact_parts_merge_max_bytes_to_prefetch_part 20647545 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 37 --old_parts_lifetime 243 --prewarm_mark_cache 1 --use_const_adaptive_granularity 1 --enable_index_granularity_compression 0 --enable_block_number_column 0 --enable_block_offset_column 1 --patch_parts_version v1 --use_primary_key_cache 1 --prewarm_primary_key_cache 0 --object_serialization_version v3 --object_shared_data_serialization_version advanced --object_shared_data_serialization_version_for_zero_level_parts map_with_buckets --object_shared_data_buckets_for_compact_part 6 --object_shared_data_buckets_for_wide_part 32 --dynamic_serialization_version v3 --serialization_info_version basic --string_serialization_version single_stream --nullable_serialization_version allow_sparse --enable_shared_storage_snapshot_in_query 0 --min_columns_to_activate_adaptive_write_buffer 763 --reduce_blocking_parts_sleep_ms 1104 --shared_merge_tree_outdated_parts_group_size 2 --shared_merge_tree_max_outdated_parts_to_process_at_once 7 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas 0 --shared_merge_tree_try_fetch_part_in_memory_data_from_replicas_on_startup 0 --text_index_dictionary_block_size 128 --text_index_dictionary_block_frontcoding_compression 0 --text_index_posting_list_block_size 64 --text_index_posting_list_codec bitpacking --map_serialization_version basic --map_serialization_version_for_zero_level_parts basic --max_buckets_in_map 76 --map_buckets_strategy sqrt --map_buckets_min_avg_size 614 --map_buckets_coefficient 1.43 --propagate_types_serialization_versions_to_nested_types 0 --compress_per_column_in_compact_parts 1 --packed_skip_index_max_bytes 1048576 --allow_repeated_settings --allow_repeated_settings --client_logs_file=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/queries/0_stateless/05045_iceberg_manifest_partition_arity.1641.stderr-fatal --allow_insert_into_iceberg=1 --use_iceberg_metadata_files_cache=0 --query ' [2026-11-03 02:14:28] | 2026-11-02 22:09:31 CREATE TABLE t_ok (p Int32, q Int32, v Int32) [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ENGINE = IcebergLocal('\''/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0/user_files/test_h5f2j5z7g0g9_ibp/t_ok/'\'', '\''Parquet'\'') PARTITION BY (p, q) [2026-11-03 02:14:28] | 2026-11-02 22:09:31 SETTINGS allow_experimental_iceberg_compaction = 0; [2026-11-03 02:14:28] | 2026-11-02 22:09:31 INSERT INTO t_ok VALUES (1,10,100),(1,10,101),(2,20,200),(2,20,201),(3,30,300); [2026-11-03 02:14:28] | 2026-11-02 22:09:31 CREATE TABLE t_long (p Int32, q Int32, v Int32) [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ENGINE = IcebergLocal('\''/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0/user_files/test_h5f2j5z7g0g9_ibp/t_long/'\'', '\''Parquet'\'') PARTITION BY (p, q) [2026-11-03 02:14:28] | 2026-11-02 22:09:31 SETTINGS allow_experimental_iceberg_compaction = 0; [2026-11-03 02:14:28] | 2026-11-02 22:09:31 INSERT INTO t_long VALUES (1,10,100),(1,10,101),(2,20,200),(2,20,201),(3,30,300); [2026-11-03 02:14:28] | 2026-11-02 22:09:31 CREATE TABLE t_short (p Int32, q Int32, v Int32) [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ENGINE = IcebergLocal('\''/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0/user_files/test_h5f2j5z7g0g9_ibp/t_short/'\'', '\''Parquet'\'') PARTITION BY (p) [2026-11-03 02:14:28] | 2026-11-02 22:09:31 SETTINGS allow_experimental_iceberg_compaction = 0; [2026-11-03 02:14:28] | 2026-11-02 22:09:31 INSERT INTO t_short VALUES (1,10,100),(1,10,101),(2,20,200),(2,20,201),(3,30,300); [2026-11-03 02:14:28] | 2026-11-02 22:09:31 CREATE TABLE t_narrow (p Int32, q Int32, v Int32) [2026-11-03 02:14:28] | 2026-11-02 22:09:31 ENGINE = IcebergLocal('\''/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/run_r0/user_files/test_h5f2j5z7g0g9_ibp/t_narrow/'\'', '\''Parquet'\'') PARTITION BY (p, q) [2026-11-03 02:14:28] | 2026-11-02 22:09:31 SETTINGS allow_experimental_iceberg_compaction = 0; [2026-11-03 02:14:28] | 2026-11-02 22:09:31 INSER [2026-11-03 02:14:28] ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ [2026-11-03 02:14:28] --- Fixing file ownership after running docker as root [2026-11-03 02:14:28] Run command: [docker run --rm --user root --volume ./:/home/ubuntu/_work/ClickHouse/ClickHouse --workdir=/home/ubuntu/_work/ClickHouse/ClickHouse altinityinfra/stateless-test:0dc483b9acdcd894e95f_amd chown -R 1000:1000 ./ci/tmp] [2026-11-03 02:14:29] ERROR: Run failed with exit code [1] [2026-11-03 02:14:29] === Run script finished === [2026-11-03 02:14:29] === Post run script [Stateless tests (amd_asan_ubsan, distributed plan, parallel, selected tests)], workflow [PR] === [2026-11-03 02:14:29] Job's output: [[]] [2026-11-03 02:14:29] Insert results to CIDB [2026-11-03 02:14:30] INFO: 76 rows inserted into CIDB [2026-11-03 02:14:30] Run CI cache hook [2026-11-03 02:14:31] Run html report hook [2026-11-03 02:14:31] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/aggregated_zookeeper_log.tsv] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:32] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/azurite.log] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:32] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/broken_tests_handler.log] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:32] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/var/log/clickhouse-server/clickhouse-disks.log] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:33] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-local.err.log] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:33] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/clickhouse-local.log] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:34] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/var/log/clickhouse-server/clickhouse-server.err.log] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:34] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/var/log/clickhouse-server/clickhouse-server.log] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:37] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/dmesg.log] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:37] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/error_log.tsv] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:37] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/kafka.log] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:37] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/metric_log.tsv] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:38] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/part_log.tsv] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:38] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/query_log.tsv] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:38] NOTE: File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/query_log.tsv] exceeds threshold [Settings.COMPRESS_THRESHOLD_MB:32] - compress [2026-11-03 02:14:38] Run command: [rm -f /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/query_log.tsv.zst && zstd -c /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/query_log.tsv > /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/query_log.tsv.zst] [2026-11-03 02:14:38] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/query_metric_log.tsv] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:39] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/seaweedfs.log] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:39] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/var/log/clickhouse-server/stderr.log] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:39] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/trace_log.tsv] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:39] NOTE: File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/trace_log.tsv] exceeds threshold [Settings.COMPRESS_THRESHOLD_MB:32] - compress [2026-11-03 02:14:39] Run command: [rm -f /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/trace_log.tsv.zst && zstd -c /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/trace_log.tsv > /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/trace_log.tsv.zst] [2026-11-03 02:14:40] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/transactions_info_log.tsv] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:40] File [/home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/zookeeper_log.tsv] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object [2026-11-03 02:14:40] WARNING: Failed to scan file /home/ubuntu/_work/ClickHouse/ClickHouse/ci/tmp/system_tables/zookeeper_log.tsv, unknown encoding [2026-11-03 02:14:40] File [./ci/tmp/job.log] matches Settings.TEXT_CONTENT_EXTENSIONS [['.txt', '.log', '.err', '.out', '.tsv', '.csv', '.json']] - add text attribute for s3 object