Copyright 2025, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

S3 Test Run Report

DateJul 10, 2025 23:59
Duration2h 27m
Framework TestFlows 2.0.250110.1002922

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/1abef611c9a40dce30ed011ede491e532b2a3e72/regression/aarch64/with_analyzer/zookeeper/without_thread_fuzzer/s3/azure/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/25.3/1abef611c9a40dce30ed011ede491e532b2a3e72/package_aarch64/clickhouse-common-static_25.3.3.20183.altinityantalya_arm64.deb
version25.3.3.20183.altinityantalya
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash88c93f843cd48cd9defc6cec6b98d6b98f94adde
job.nameS3 (azure)
job.retry1
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/16207084940
archaarch64
localTrue
clickhouse_versionNone
clickhouse_pathhttps://s3.amazonaws.com/altinity-build-artifacts/25.3/1abef611c9a40dce30ed011ede491e532b2a3e72/package_aarch64/clickhouse-common-static_25.3.3.20183.altinityantalya_arm64.deb
as_binaryFalse
base_osNone
keeper_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerTrue
reuse_envFalse
storages['azure']
minio_uriSecret(name='minio_uri')
minio_root_userSecret(name='minio_root_user')
minio_root_passwordSecret(name='minio_root_password')
aws_s3_bucketSecret(name='aws_s3_bucket')
aws_s3_regionSecret(name='aws_s3_region')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_access_keySecret(name='aws_s3_access_key')
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')
azure_account_nameSecret(name='azure_account_name')
azure_storage_keySecret(name='azure_storage_key')
azure_containerSecret(name='azure_container')

Summary

84.9%OK
11.1%Known

Statistics

Units Skip OK Fail Error XFail Retried
Modules
1
1
Features
12
1
11
Scenarios
185
13
133
39
Checks
54
54
Examples
43
43
Steps
21920
63
21781
10
6
60

Known Fails

Test NameResultMessage
/s3/azure/part 1/disk/cacheXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/part 1/disk/cache defaultXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/part 1/disk/cache pathXFail 875us
Under development for 22.8 and newer.
None
/s3/azure/part 1/disk/low cardinality offsetXFail 56s 617ms
https://github.com/ClickHouse/ClickHouse/pull/44875
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 799, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 780, in regression
    Feature(test=azure_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 639, in azure_regression
    Feature(test=load("s3.tests.disk", "azure"))()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2568, in azure
    disk_tests(uri=None, bucket_prefix=None)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2538, in disk_tests
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2500, in low_cardinality_offset
    assert output == "23999\n", error()
           ^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert output == "23999\n", error()

Assertion values
  assert output == "23999\n", error()
         ^ is '23999'
  assert output == "23999\n", error()
                ^ is = False

  assert output == "23999\n", error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py', line 2500 in 'low_cardinality_offset'

2492\|                      "1",
2493\|                  ),
2494\|                  (
2495\|                      "merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem",
2496\|                      "1",
2497\|                  ),
2498\|              ],
2499\|          ).output
2500\|>         assert output == "23999\n", error()
2501\|  
2502\|  
2503\|  @TestFeature
/s3/azure/part 1/disk/no restartXFail 2ms
https://github.com/ClickHouse/ClickHouse/issues/58924
None
/s3/azure/part 1/invalid disk/access failed skip checkXFail 2ms
Not working, needs investigation
None
/s3/azure/part 1/invalid disk/cache path conflictXFail 2ms
Under development for 22.8 and newer.
None
/s3/azure/part 2/zero copy replication/ttl deleteXFail 2m 11s
https://github.com/ClickHouse/ClickHouse/issues/22679
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 799, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 780, in regression
    Feature(test=azure_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 643, in azure_regression
    Feature(test=load("s3.tests.zero_copy_replication", "azure"))()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1734, in azure
    outline(uri=None, bucket_prefix=None)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1706, in outline
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1040, in ttl_delete
    check_query_node(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py", line 719, in check_query_node
    assert r == expected, error()
           ^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == expected, error()

Assertion values
  assert r == expected, error()
         ^ is '1441794'
  assert r == expected, error()
              ^ is '1310721'
  assert r == expected, error()
           ^ is = False
    @@ -1 +1 @@
    -1441794
    +1310721
  assert r == expected, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py', line 719 in 'check_query_node'

711\|  
712\|  @TestStep(Then)
713\|  def check_query_node(self, node, num, query, expected):
714\|      node = current().context.node
715\|  
716\|      with By(f"executing query {num}", description=query):
717\|          r = node.query(query).output.strip()
718\|          with Then(f"result should match the expected", description=expected):
719\|>             assert r == expected, error()
720\|  
721\|  
722\|  def get_s3_file_content(cluster, bucket, filename, decode=True):

Results

Test Name Result Duration
/s3 OK 2h 27m
/s3/azure OK 2h 27m
/s3/azure/part 1 OK 1h 22m
/s3/azure/part 1/sanity OK 1m 20s
/s3/azure/part 1/sanity/sanity OK 30s 366ms
/s3/azure/part 1/alter OK 30m 48s
/s3/azure/part 1/alter/normal OK 9m 0s
/s3/azure/part 1/alter/normal/attach from OK 28s 26ms
/s3/azure/part 1/alter/normal/columns OK 29s 875ms
/s3/azure/part 1/alter/normal/detach OK 1m 1s
/s3/azure/part 1/alter/normal/drop OK 1m 57s
/s3/azure/part 1/alter/normal/fetch OK 1m 3s
/s3/azure/part 1/alter/normal/freeze OK 56s 753ms
/s3/azure/part 1/alter/normal/index OK 19s 885ms
/s3/azure/part 1/alter/normal/move to table OK 47s 699ms
/s3/azure/part 1/alter/normal/order by OK 10s 274ms
/s3/azure/part 1/alter/normal/projection OK 22s 134ms
/s3/azure/part 1/alter/normal/replace OK 43s 425ms
/s3/azure/part 1/alter/normal/sample by OK 10s 309ms
/s3/azure/part 1/alter/normal/update delete OK 29s 796ms
/s3/azure/part 1/alter/encrypted OK 9m 44s
/s3/azure/part 1/alter/encrypted/attach from OK 26s 104ms
/s3/azure/part 1/alter/encrypted/columns OK 37s 688ms
/s3/azure/part 1/alter/encrypted/detach OK 1m 15s
/s3/azure/part 1/alter/encrypted/drop OK 2m 8s
/s3/azure/part 1/alter/encrypted/fetch OK 1m 0s
/s3/azure/part 1/alter/encrypted/freeze OK 56s 640ms
/s3/azure/part 1/alter/encrypted/index OK 24s 932ms
/s3/azure/part 1/alter/encrypted/move to table OK 51s 579ms
/s3/azure/part 1/alter/encrypted/order by OK 15s 379ms
/s3/azure/part 1/alter/encrypted/projection OK 23s 908ms
/s3/azure/part 1/alter/encrypted/replace OK 44s 515ms
/s3/azure/part 1/alter/encrypted/sample by OK 10s 154ms
/s3/azure/part 1/alter/encrypted/update delete OK 29s 141ms
/s3/azure/part 1/alter/zero copy OK 5m 0s
/s3/azure/part 1/alter/zero copy/attach from OK 27s 119ms
/s3/azure/part 1/alter/zero copy/columns OK 29s 532ms
/s3/azure/part 1/alter/zero copy/detach Skip 4ms
/s3/azure/part 1/alter/zero copy/drop Skip 962us
/s3/azure/part 1/alter/zero copy/fetch Skip 1ms
/s3/azure/part 1/alter/zero copy/freeze OK 56s 483ms
/s3/azure/part 1/alter/zero copy/index OK 19s 864ms
/s3/azure/part 1/alter/zero copy/move to table OK 47s 338ms
/s3/azure/part 1/alter/zero copy/order by OK 15s 294ms
/s3/azure/part 1/alter/zero copy/projection OK 22s 746ms
/s3/azure/part 1/alter/zero copy/replace OK 43s 670ms
/s3/azure/part 1/alter/zero copy/sample by OK 10s 167ms
/s3/azure/part 1/alter/zero copy/update delete OK 28s 734ms
/s3/azure/part 1/alter/zero copy encrypted OK 5m 22s
/s3/azure/part 1/alter/zero copy encrypted/attach from OK 26s 638ms
/s3/azure/part 1/alter/zero copy encrypted/columns OK 37s 887ms
/s3/azure/part 1/alter/zero copy encrypted/detach Skip 1ms
/s3/azure/part 1/alter/zero copy encrypted/drop Skip 1ms
/s3/azure/part 1/alter/zero copy encrypted/fetch Skip 942us
/s3/azure/part 1/alter/zero copy encrypted/freeze OK 51s 898ms
/s3/azure/part 1/alter/zero copy encrypted/index OK 31s 613ms
/s3/azure/part 1/alter/zero copy encrypted/move to table OK 52s 238ms
/s3/azure/part 1/alter/zero copy encrypted/order by OK 15s 586ms
/s3/azure/part 1/alter/zero copy encrypted/projection OK 23s 744ms
/s3/azure/part 1/alter/zero copy encrypted/replace OK 42s 989ms
/s3/azure/part 1/alter/zero copy encrypted/sample by OK 10s 152ms
/s3/azure/part 1/alter/zero copy encrypted/update delete OK 29s 419ms
/s3/azure/part 1/disk OK 48m 53s
/s3/azure/part 1/disk/access OK 54s 669ms
/s3/azure/part 1/disk/access skip check OK 56s 758ms
/s3/azure/part 1/disk/add storage OK 2m 1s
/s3/azure/part 1/disk/alter move OK 1m 7s
/s3/azure/part 1/disk/alter on cluster modify ttl OK 2m 5s
/s3/azure/part 1/disk/cache XFail 1ms
/s3/azure/part 1/disk/cache default XFail 1ms
/s3/azure/part 1/disk/cache path XFail 875us
/s3/azure/part 1/disk/compact parts OK 55s 417ms
/s3/azure/part 1/disk/config over restart OK 1m 34s
/s3/azure/part 1/disk/default move factor OK 1m 34s
/s3/azure/part 1/disk/delete OK 8m 4s
/s3/azure/part 1/disk/download appropriate disk OK 1m 43s
/s3/azure/part 1/disk/drop sync OK 1m 9s
/s3/azure/part 1/disk/environment credentials Skip 1ms
/s3/azure/part 1/disk/exports Skip 827us
/s3/azure/part 1/disk/generic url Skip 721us
/s3/azure/part 1/disk/imports Skip 944us
/s3/azure/part 1/disk/log OK 3m 33s
/s3/azure/part 1/disk/low cardinality offset XFail 56s 617ms
/s3/azure/part 1/disk/max single part upload size syntax OK 54s 869ms
/s3/azure/part 1/disk/mergetree OK 5m 4s
/s3/azure/part 1/disk/mergetree collapsing OK 1m 17s
/s3/azure/part 1/disk/mergetree versionedcollapsing OK 1m 21s
/s3/azure/part 1/disk/metadata OK 1m 10s
/s3/azure/part 1/disk/min bytes for seek syntax OK 55s 39ms
/s3/azure/part 1/disk/multiple storage OK 1m 25s
/s3/azure/part 1/disk/multiple storage query OK 1m 29s
/s3/azure/part 1/disk/no restart XFail 2ms
/s3/azure/part 1/disk/perform ttl move on insert OK 1m 43s
/s3/azure/part 1/disk/perform ttl move on insert default OK 1m 15s
/s3/azure/part 1/disk/performance ttl move OK 1m 39s
/s3/azure/part 1/disk/remote host filter OK 1m 46s
/s3/azure/part 1/disk/specific url Skip 1ms
/s3/azure/part 1/disk/syntax OK 1m 17s
/s3/azure/part 1/disk/wide parts OK 55s 11ms
/s3/azure/part 1/invalid disk OK 1m 10s
/s3/azure/part 1/invalid disk/access default OK 10s 740ms
/s3/azure/part 1/invalid disk/access failed OK 10s 760ms
/s3/azure/part 1/invalid disk/access failed skip check XFail 2ms
/s3/azure/part 1/invalid disk/cache path conflict XFail 2ms
/s3/azure/part 1/invalid disk/empty endpoint OK 10s 741ms
/s3/azure/part 1/invalid disk/invalid endpoint OK 16s 784ms
/s3/azure/part 1/invalid disk/invalid type OK 21s 501ms
/s3/azure/part 1/combinatoric table Skip 1ms
/s3/azure/part 2 OK 1h 2m
/s3/azure/part 2/zero copy replication OK 22m 25s
/s3/azure/part 2/zero copy replication/add remove one replica OK 26s 971ms
/s3/azure/part 2/zero copy replication/add remove replica parallel OK 41s 691ms
/s3/azure/part 2/zero copy replication/add replica global setting OK 1m 38s
/s3/azure/part 2/zero copy replication/add replica local setting OK 24s 845ms
/s3/azure/part 2/zero copy replication/alter Skip 1ms
/s3/azure/part 2/zero copy replication/bad detached part OK 1m 19s
/s3/azure/part 2/zero copy replication/check refcount after mutation OK 22s 353ms
/s3/azure/part 2/zero copy replication/consistency during conflicting mutation OK 24s 406ms
/s3/azure/part 2/zero copy replication/consistency during double mutation OK 24s 347ms
/s3/azure/part 2/zero copy replication/default value OK 17s 333ms
/s3/azure/part 2/zero copy replication/delete OK 18s 199ms
/s3/azure/part 2/zero copy replication/delete all OK 21s 359ms
/s3/azure/part 2/zero copy replication/drop replica OK 43s 29ms
/s3/azure/part 2/zero copy replication/global setting OK 1m 32s
/s3/azure/part 2/zero copy replication/insert multiple replicas OK 23s 714ms
/s3/azure/part 2/zero copy replication/metadata Skip 1ms
/s3/azure/part 2/zero copy replication/migration OK 29s 283ms
/s3/azure/part 2/zero copy replication/offline alter replica OK 41s 287ms
/s3/azure/part 2/zero copy replication/performance alter OK 1m 22s
/s3/azure/part 2/zero copy replication/performance insert OK 1m 40s
/s3/azure/part 2/zero copy replication/performance select OK 1m 52s
/s3/azure/part 2/zero copy replication/stale alter replica OK 1m 34s
/s3/azure/part 2/zero copy replication/ttl delete XFail 2m 11s
/s3/azure/part 2/zero copy replication/ttl move OK 2m 13s
/s3/azure/part 2/reconnect OK 3m 20s
/s3/azure/part 2/reconnect/local and s3 disk OK 1m 5s
/s3/azure/part 2/reconnect/local and s3 volumes OK 57s 907ms
/s3/azure/part 2/reconnect/s3 disk OK 1m 16s
/s3/azure/part 2/backup OK 3m 54s
/s3/azure/part 2/backup/local and s3 disk OK 1m 14s
/s3/azure/part 2/backup/local and s3 volumes OK 1m 6s
/s3/azure/part 2/backup/s3 disk OK 1m 33s
/s3/azure/part 2/settings OK 32m 37s
/s3/azure/part 2/settings/setting combinations OK 31m 45s

Generated by TestFlows Open-Source Test Framework v2.0.250110.1002922