Copyright 2025, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

S3 Test Run Report

DateJun 18, 2025 0:33
Duration2h 51m
Framework TestFlows 2.0.250110.1002922

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#865/c8f5926c0c4b2ce5a36d97092b0953ea02b76234/regression/aarch64/with_analyzer/zookeeper/without_thread_fuzzer/s3/azure/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/PRs/865/c8f5926c0c4b2ce5a36d97092b0953ea02b76234/package_aarch64/clickhouse-common-static_24.8.14.10063.altinitytest_arm64.deb
version24.8.14.10063.altinitytest
user.namearthurpassos
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashe3c00be97a045aa04e9d1a6ec50cc64f4c387b70
job.nameS3
job.retry1
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/15719763915
archaarch64
localTrue
clickhouse_versionNone
clickhouse_pathhttps://s3.amazonaws.com/altinity-build-artifacts/PRs/865/c8f5926c0c4b2ce5a36d97092b0953ea02b76234/package_aarch64/clickhouse-common-static_24.8.14.10063.altinitytest_arm64.deb
as_binaryFalse
base_osNone
keeper_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerTrue
reuse_envFalse
storages['azure']
minio_uriSecret(name='minio_uri')
minio_root_userSecret(name='minio_root_user')
minio_root_passwordSecret(name='minio_root_password')
aws_s3_bucketSecret(name='aws_s3_bucket')
aws_s3_regionSecret(name='aws_s3_region')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_access_keySecret(name='aws_s3_access_key')
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')
azure_account_nameSecret(name='azure_account_name')
azure_storage_keySecret(name='azure_storage_key')
azure_containerSecret(name='azure_container')

Summary

84.1%OK
11.3%Known

Statistics

Units Skip OK Fail Error XFail Retried
Modules
1
1
Features
12
1
11
Scenarios
185
15
131
39
Checks
54
54
Examples
39
39
Steps
21706
63
21531
10
6
96

Known Fails

Test NameResultMessage
/s3/azure/part 1/disk/cacheXFail 4ms
Under development for 22.8 and newer.
None
/s3/azure/part 1/disk/cache defaultXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/part 1/disk/cache pathXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/part 1/disk/low cardinality offsetXFail 1m 6s
https://github.com/ClickHouse/ClickHouse/pull/44875
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 805, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 786, in regression
    Feature(test=azure_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 643, in azure_regression
    Feature(test=load("s3.tests.disk", "azure"))()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2568, in azure
    disk_tests(uri=None, bucket_prefix=None)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2538, in disk_tests
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2500, in low_cardinality_offset
    assert output == "23999\n", error()
           ^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert output == "23999\n", error()

Assertion values
  assert output == "23999\n", error()
         ^ is '23999'
  assert output == "23999\n", error()
                ^ is = False

  assert output == "23999\n", error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py', line 2500 in 'low_cardinality_offset'

2492\|                      "1",
2493\|                  ),
2494\|                  (
2495\|                      "merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem",
2496\|                      "1",
2497\|                  ),
2498\|              ],
2499\|          ).output
2500\|>         assert output == "23999\n", error()
2501\|  
2502\|  
2503\|  @TestFeature
/s3/azure/part 1/disk/no restartXFail 6ms
https://github.com/ClickHouse/ClickHouse/issues/58924
None
/s3/azure/part 1/invalid disk/access failed skip checkXFail 1ms
Not working, needs investigation
None
/s3/azure/part 1/invalid disk/cache path conflictXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/part 2/zero copy replication/ttl deleteXFail 2m 29s
https://github.com/ClickHouse/ClickHouse/issues/22679
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 805, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 786, in regression
    Feature(test=azure_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 647, in azure_regression
    Feature(test=load("s3.tests.zero_copy_replication", "azure"))()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1734, in azure
    outline(uri=None, bucket_prefix=None)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1706, in outline
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1040, in ttl_delete
    check_query_node(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py", line 719, in check_query_node
    assert r == expected, error()
           ^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == expected, error()

Assertion values
  assert r == expected, error()
         ^ is '1441794'
  assert r == expected, error()
              ^ is '1310721'
  assert r == expected, error()
           ^ is = False
    @@ -1 +1 @@
    -1441794
    +1310721
  assert r == expected, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py', line 719 in 'check_query_node'

711\|  
712\|  @TestStep(Then)
713\|  def check_query_node(self, node, num, query, expected):
714\|      node = current().context.node
715\|  
716\|      with By(f"executing query {num}", description=query):
717\|          r = node.query(query).output.strip()
718\|          with Then(f"result should match the expected", description=expected):
719\|>             assert r == expected, error()
720\|  
721\|  
722\|  def get_s3_file_content(cluster, bucket, filename, decode=True):

Results

Test Name Result Duration
/s3 OK 2h 51m
/s3/azure OK 2h 51m
/s3/azure/part 1 OK 1h 30m
/s3/azure/part 1/sanity OK 1m 35s
/s3/azure/part 1/sanity/sanity OK 36s 785ms
/s3/azure/part 1/alter OK 29m 52s
/s3/azure/part 1/alter/normal OK 9m 12s
/s3/azure/part 1/alter/normal/attach from OK 29s 188ms
/s3/azure/part 1/alter/normal/columns OK 29s 845ms
/s3/azure/part 1/alter/normal/detach OK 1m 4s
/s3/azure/part 1/alter/normal/drop OK 2m 4s
/s3/azure/part 1/alter/normal/fetch OK 1m 5s
/s3/azure/part 1/alter/normal/freeze OK 48s 199ms
/s3/azure/part 1/alter/normal/index OK 20s 215ms
/s3/azure/part 1/alter/normal/move to table OK 48s 405ms
/s3/azure/part 1/alter/normal/order by OK 10s 917ms
/s3/azure/part 1/alter/normal/projection OK 23s 386ms
/s3/azure/part 1/alter/normal/replace OK 46s 242ms
/s3/azure/part 1/alter/normal/sample by OK 10s 937ms
/s3/azure/part 1/alter/normal/update delete OK 31s 5ms
/s3/azure/part 1/alter/encrypted OK 9m 42s
/s3/azure/part 1/alter/encrypted/attach from OK 26s 374ms
/s3/azure/part 1/alter/encrypted/columns OK 36s 71ms
/s3/azure/part 1/alter/encrypted/detach OK 1m 8s
/s3/azure/part 1/alter/encrypted/drop OK 2m 10s
/s3/azure/part 1/alter/encrypted/fetch OK 1m 2s
/s3/azure/part 1/alter/encrypted/freeze OK 48s 327ms
/s3/azure/part 1/alter/encrypted/index OK 24s 25ms
/s3/azure/part 1/alter/encrypted/move to table OK 54s 69ms
/s3/azure/part 1/alter/encrypted/order by OK 15s 987ms
/s3/azure/part 1/alter/encrypted/projection OK 26s 458ms
/s3/azure/part 1/alter/encrypted/replace OK 42s 499ms
/s3/azure/part 1/alter/encrypted/sample by OK 10s 884ms
/s3/azure/part 1/alter/encrypted/update delete OK 35s 683ms
/s3/azure/part 1/alter/zero copy OK 4m 13s
/s3/azure/part 1/alter/zero copy/attach from OK 28s 804ms
/s3/azure/part 1/alter/zero copy/columns OK 30s 530ms
/s3/azure/part 1/alter/zero copy/detach Skip 1ms
/s3/azure/part 1/alter/zero copy/drop Skip 2ms
/s3/azure/part 1/alter/zero copy/fetch Skip 1ms
/s3/azure/part 1/alter/zero copy/freeze Skip 2ms
/s3/azure/part 1/alter/zero copy/index OK 22s 818ms
/s3/azure/part 1/alter/zero copy/move to table OK 49s 487ms
/s3/azure/part 1/alter/zero copy/order by OK 11s 39ms
/s3/azure/part 1/alter/zero copy/projection OK 23s 527ms
/s3/azure/part 1/alter/zero copy/replace OK 46s 397ms
/s3/azure/part 1/alter/zero copy/sample by OK 10s 935ms
/s3/azure/part 1/alter/zero copy/update delete OK 30s 312ms
/s3/azure/part 1/alter/zero copy encrypted OK 4m 40s
/s3/azure/part 1/alter/zero copy encrypted/attach from OK 27s 705ms
/s3/azure/part 1/alter/zero copy encrypted/columns OK 34s 708ms
/s3/azure/part 1/alter/zero copy encrypted/detach Skip 1ms
/s3/azure/part 1/alter/zero copy encrypted/drop Skip 1ms
/s3/azure/part 1/alter/zero copy encrypted/fetch Skip 3ms
/s3/azure/part 1/alter/zero copy encrypted/freeze Skip 2ms
/s3/azure/part 1/alter/zero copy encrypted/index OK 28s 854ms
/s3/azure/part 1/alter/zero copy encrypted/move to table OK 53s 616ms
/s3/azure/part 1/alter/zero copy encrypted/order by OK 15s 765ms
/s3/azure/part 1/alter/zero copy encrypted/projection OK 26s 148ms
/s3/azure/part 1/alter/zero copy encrypted/replace OK 43s 423ms
/s3/azure/part 1/alter/zero copy encrypted/sample by OK 15s 801ms
/s3/azure/part 1/alter/zero copy encrypted/update delete OK 34s 639ms
/s3/azure/part 1/disk OK 57m 41s
/s3/azure/part 1/disk/access OK 1m 4s
/s3/azure/part 1/disk/access skip check OK 1m 3s
/s3/azure/part 1/disk/add storage OK 2m 18s
/s3/azure/part 1/disk/alter move OK 1m 20s
/s3/azure/part 1/disk/alter on cluster modify ttl OK 2m 28s
/s3/azure/part 1/disk/cache XFail 4ms
/s3/azure/part 1/disk/cache default XFail 1ms
/s3/azure/part 1/disk/cache path XFail 1ms
/s3/azure/part 1/disk/compact parts OK 1m 1s
/s3/azure/part 1/disk/config over restart OK 1m 50s
/s3/azure/part 1/disk/default move factor OK 1m 55s
/s3/azure/part 1/disk/delete OK 8m 44s
/s3/azure/part 1/disk/download appropriate disk OK 1m 52s
/s3/azure/part 1/disk/drop sync OK 1m 27s
/s3/azure/part 1/disk/environment credentials Skip 1ms
/s3/azure/part 1/disk/exports Skip 1ms
/s3/azure/part 1/disk/generic url Skip 903us
/s3/azure/part 1/disk/imports Skip 1ms
/s3/azure/part 1/disk/log OK 4m 14s
/s3/azure/part 1/disk/low cardinality offset XFail 1m 6s
/s3/azure/part 1/disk/max single part upload size syntax OK 1m 4s
/s3/azure/part 1/disk/mergetree OK 6m 28s
/s3/azure/part 1/disk/mergetree collapsing OK 1m 30s
/s3/azure/part 1/disk/mergetree versionedcollapsing OK 1m 30s
/s3/azure/part 1/disk/metadata OK 1m 24s
/s3/azure/part 1/disk/min bytes for seek syntax OK 1m 5s
/s3/azure/part 1/disk/multiple storage OK 1m 40s
/s3/azure/part 1/disk/multiple storage query OK 1m 41s
/s3/azure/part 1/disk/no restart XFail 6ms
/s3/azure/part 1/disk/perform ttl move on insert OK 2m 12s
/s3/azure/part 1/disk/perform ttl move on insert default OK 1m 33s
/s3/azure/part 1/disk/performance ttl move OK 2m 2s
/s3/azure/part 1/disk/remote host filter OK 2m 22s
/s3/azure/part 1/disk/specific url Skip 1ms
/s3/azure/part 1/disk/syntax OK 1m 32s
/s3/azure/part 1/disk/wide parts OK 1m 4s
/s3/azure/part 1/invalid disk OK 1m 21s
/s3/azure/part 1/invalid disk/access default OK 11s 267ms
/s3/azure/part 1/invalid disk/access failed OK 10s 0ms
/s3/azure/part 1/invalid disk/access failed skip check XFail 1ms
/s3/azure/part 1/invalid disk/cache path conflict XFail 1ms
/s3/azure/part 1/invalid disk/empty endpoint OK 10s 252ms
/s3/azure/part 1/invalid disk/invalid endpoint OK 29s 271ms
/s3/azure/part 1/invalid disk/invalid type OK 20s 328ms
/s3/azure/part 1/combinatoric table Skip 1ms
/s3/azure/part 2 OK 1h 17m
/s3/azure/part 2/zero copy replication OK 25m 48s
/s3/azure/part 2/zero copy replication/add remove one replica OK 29s 423ms
/s3/azure/part 2/zero copy replication/add remove replica parallel OK 52s 985ms
/s3/azure/part 2/zero copy replication/add replica global setting OK 1m 47s
/s3/azure/part 2/zero copy replication/add replica local setting OK 33s 439ms
/s3/azure/part 2/zero copy replication/alter Skip 2ms
/s3/azure/part 2/zero copy replication/bad detached part OK 1m 30s
/s3/azure/part 2/zero copy replication/check refcount after mutation OK 24s 629ms
/s3/azure/part 2/zero copy replication/consistency during conflicting mutation OK 26s 427ms
/s3/azure/part 2/zero copy replication/consistency during double mutation OK 27s 118ms
/s3/azure/part 2/zero copy replication/default value OK 19s 95ms
/s3/azure/part 2/zero copy replication/delete OK 22s 432ms
/s3/azure/part 2/zero copy replication/delete all OK 25s 279ms
/s3/azure/part 2/zero copy replication/drop replica OK 51s 993ms
/s3/azure/part 2/zero copy replication/global setting OK 1m 42s
/s3/azure/part 2/zero copy replication/insert multiple replicas OK 29s 729ms
/s3/azure/part 2/zero copy replication/metadata Skip 2ms
/s3/azure/part 2/zero copy replication/migration OK 35s 623ms
/s3/azure/part 2/zero copy replication/offline alter replica OK 48s 690ms
/s3/azure/part 2/zero copy replication/performance alter OK 1m 43s
/s3/azure/part 2/zero copy replication/performance insert OK 1m 53s
/s3/azure/part 2/zero copy replication/performance select OK 2m 5s
/s3/azure/part 2/zero copy replication/stale alter replica OK 1m 52s
/s3/azure/part 2/zero copy replication/ttl delete XFail 2m 29s
/s3/azure/part 2/zero copy replication/ttl move OK 2m 30s
/s3/azure/part 2/reconnect OK 4m 9s
/s3/azure/part 2/reconnect/local and s3 disk OK 1m 26s
/s3/azure/part 2/reconnect/local and s3 volumes OK 1m 10s
/s3/azure/part 2/reconnect/s3 disk OK 1m 32s
/s3/azure/part 2/backup OK 4m 41s
/s3/azure/part 2/backup/local and s3 disk OK 1m 28s
/s3/azure/part 2/backup/local and s3 volumes OK 1m 21s
/s3/azure/part 2/backup/s3 disk OK 1m 52s
/s3/azure/part 2/settings OK 43m 14s
/s3/azure/part 2/settings/setting combinations OK 42m 10s

Generated by TestFlows Open-Source Test Framework v2.0.250110.1002922