Copyright 2025, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

S3 Test Run Report

DateAug 27, 2025 18:33
Duration2h 35m
Framework TestFlows 2.0.250110.1002922

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#964/0f5e65cdfc919521519c358feef8180ae3e0d313/regression/aarch64/with_analyzer/zookeeper/without_thread_fuzzer/s3/azure/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/PRs/964/0f5e65cdfc919521519c358feef8180ae3e0d313/package_aarch64/clickhouse-common-static_24.8.14.10504.altinitytest_arm64.deb
version24.8.14.10504.altinitytest
user.nameMyroTk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashe3c00be97a045aa04e9d1a6ec50cc64f4c387b70
job.nameS3
job.retry2
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/17268187938
archaarch64
localTrue
clickhouse_versionNone
clickhouse_pathhttps://s3.amazonaws.com/altinity-build-artifacts/PRs/964/0f5e65cdfc919521519c358feef8180ae3e0d313/package_aarch64/clickhouse-common-static_24.8.14.10504.altinitytest_arm64.deb
as_binaryFalse
base_osNone
keeper_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerTrue
reuse_envFalse
storages['azure']
minio_uriSecret(name='minio_uri')
minio_root_userSecret(name='minio_root_user')
minio_root_passwordSecret(name='minio_root_password')
aws_s3_bucketSecret(name='aws_s3_bucket')
aws_s3_regionSecret(name='aws_s3_region')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_access_keySecret(name='aws_s3_access_key')
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')
azure_account_nameSecret(name='azure_account_name')
azure_storage_keySecret(name='azure_storage_key')
azure_containerSecret(name='azure_container')

Summary

84.1%OK
11.3%Known

Statistics

Units Skip OK Fail Error XFail Retried
Modules
1
1
Features
12
1
11
Scenarios
185
15
131
39
Checks
54
54
Examples
39
39
Steps
21770
63
21619
10
6
72

Known Fails

Test NameResultMessage
/s3/azure/part 1/disk/cacheXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/part 1/disk/cache defaultXFail 933us
Under development for 22.8 and newer.
None
/s3/azure/part 1/disk/cache pathXFail 925us
Under development for 22.8 and newer.
None
/s3/azure/part 1/disk/low cardinality offsetXFail 55s 834ms
https://github.com/ClickHouse/ClickHouse/pull/44875
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 805, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 786, in regression
    Feature(test=azure_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 643, in azure_regression
    Feature(test=load("s3.tests.disk", "azure"))()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2568, in azure
    disk_tests(uri=None, bucket_prefix=None)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2538, in disk_tests
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2500, in low_cardinality_offset
    assert output == "23999\n", error()
           ^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert output == "23999\n", error()

Assertion values
  assert output == "23999\n", error()
         ^ is '23999'
  assert output == "23999\n", error()
                ^ is = False

  assert output == "23999\n", error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py', line 2500 in 'low_cardinality_offset'

2492\|                      "1",
2493\|                  ),
2494\|                  (
2495\|                      "merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem",
2496\|                      "1",
2497\|                  ),
2498\|              ],
2499\|          ).output
2500\|>         assert output == "23999\n", error()
2501\|  
2502\|  
2503\|  @TestFeature
/s3/azure/part 1/disk/no restartXFail 1ms
https://github.com/ClickHouse/ClickHouse/issues/58924
None
/s3/azure/part 1/invalid disk/access failed skip checkXFail 1ms
Not working, needs investigation
None
/s3/azure/part 1/invalid disk/cache path conflictXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/part 2/zero copy replication/ttl deleteXFail 2m 13s
https://github.com/ClickHouse/ClickHouse/issues/22679
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 805, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 786, in regression
    Feature(test=azure_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 647, in azure_regression
    Feature(test=load("s3.tests.zero_copy_replication", "azure"))()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1734, in azure
    outline(uri=None, bucket_prefix=None)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1706, in outline
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1040, in ttl_delete
    check_query_node(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py", line 719, in check_query_node
    assert r == expected, error()
           ^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == expected, error()

Assertion values
  assert r == expected, error()
         ^ is '1441794'
  assert r == expected, error()
              ^ is '1310721'
  assert r == expected, error()
           ^ is = False
    @@ -1 +1 @@
    -1441794
    +1310721
  assert r == expected, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py', line 719 in 'check_query_node'

711\|  
712\|  @TestStep(Then)
713\|  def check_query_node(self, node, num, query, expected):
714\|      node = current().context.node
715\|  
716\|      with By(f"executing query {num}", description=query):
717\|          r = node.query(query).output.strip()
718\|          with Then(f"result should match the expected", description=expected):
719\|>             assert r == expected, error()
720\|  
721\|  
722\|  def get_s3_file_content(cluster, bucket, filename, decode=True):

Results

Test Name Result Duration
/s3 OK 2h 35m
/s3/azure OK 2h 35m
/s3/azure/part 1 OK 1h 21m
/s3/azure/part 1/sanity OK 1m 21s
/s3/azure/part 1/sanity/sanity OK 31s 814ms
/s3/azure/part 1/alter OK 29m 6s
/s3/azure/part 1/alter/normal OK 9m 12s
/s3/azure/part 1/alter/normal/attach from OK 27s 867ms
/s3/azure/part 1/alter/normal/columns OK 28s 867ms
/s3/azure/part 1/alter/normal/detach OK 1m 5s
/s3/azure/part 1/alter/normal/drop OK 2m 6s
/s3/azure/part 1/alter/normal/fetch OK 1m 2s
/s3/azure/part 1/alter/normal/freeze OK 56s 442ms
/s3/azure/part 1/alter/normal/index OK 19s 489ms
/s3/azure/part 1/alter/normal/move to table OK 47s 537ms
/s3/azure/part 1/alter/normal/order by OK 10s 174ms
/s3/azure/part 1/alter/normal/projection OK 22s 416ms
/s3/azure/part 1/alter/normal/replace OK 44s 640ms
/s3/azure/part 1/alter/normal/sample by OK 10s 114ms
/s3/azure/part 1/alter/normal/update delete OK 30s 379ms
/s3/azure/part 1/alter/encrypted OK 9m 40s
/s3/azure/part 1/alter/encrypted/attach from OK 25s 967ms
/s3/azure/part 1/alter/encrypted/columns OK 35s 26ms
/s3/azure/part 1/alter/encrypted/detach OK 1m 6s
/s3/azure/part 1/alter/encrypted/drop OK 2m 13s
/s3/azure/part 1/alter/encrypted/fetch OK 1m 0s
/s3/azure/part 1/alter/encrypted/freeze OK 57s 50ms
/s3/azure/part 1/alter/encrypted/index OK 22s 949ms
/s3/azure/part 1/alter/encrypted/move to table OK 52s 34ms
/s3/azure/part 1/alter/encrypted/order by OK 15s 234ms
/s3/azure/part 1/alter/encrypted/projection OK 25s 615ms
/s3/azure/part 1/alter/encrypted/replace OK 40s 994ms
/s3/azure/part 1/alter/encrypted/sample by OK 10s 76ms
/s3/azure/part 1/alter/encrypted/update delete OK 34s 682ms
/s3/azure/part 1/alter/zero copy OK 4m 1s
/s3/azure/part 1/alter/zero copy/attach from OK 27s 424ms
/s3/azure/part 1/alter/zero copy/columns OK 29s 510ms
/s3/azure/part 1/alter/zero copy/detach Skip 1ms
/s3/azure/part 1/alter/zero copy/drop Skip 952us
/s3/azure/part 1/alter/zero copy/fetch Skip 897us
/s3/azure/part 1/alter/zero copy/freeze Skip 1ms
/s3/azure/part 1/alter/zero copy/index OK 19s 55ms
/s3/azure/part 1/alter/zero copy/move to table OK 48s 249ms
/s3/azure/part 1/alter/zero copy/order by OK 10s 167ms
/s3/azure/part 1/alter/zero copy/projection OK 22s 67ms
/s3/azure/part 1/alter/zero copy/replace OK 44s 659ms
/s3/azure/part 1/alter/zero copy/sample by OK 10s 93ms
/s3/azure/part 1/alter/zero copy/update delete OK 29s 766ms
/s3/azure/part 1/alter/zero copy encrypted OK 4m 32s
/s3/azure/part 1/alter/zero copy encrypted/attach from OK 26s 255ms
/s3/azure/part 1/alter/zero copy encrypted/columns OK 34s 533ms
/s3/azure/part 1/alter/zero copy encrypted/detach Skip 1ms
/s3/azure/part 1/alter/zero copy encrypted/drop Skip 1ms
/s3/azure/part 1/alter/zero copy encrypted/fetch Skip 926us
/s3/azure/part 1/alter/zero copy encrypted/freeze Skip 878us
/s3/azure/part 1/alter/zero copy encrypted/index OK 28s 713ms
/s3/azure/part 1/alter/zero copy encrypted/move to table OK 51s 965ms
/s3/azure/part 1/alter/zero copy encrypted/order by OK 15s 243ms
/s3/azure/part 1/alter/zero copy encrypted/projection OK 25s 878ms
/s3/azure/part 1/alter/zero copy encrypted/replace OK 40s 820ms
/s3/azure/part 1/alter/zero copy encrypted/sample by OK 14s 528ms
/s3/azure/part 1/alter/zero copy encrypted/update delete OK 34s 705ms
/s3/azure/part 1/disk OK 49m 16s
/s3/azure/part 1/disk/access OK 53s 498ms
/s3/azure/part 1/disk/access skip check OK 52s 260ms
/s3/azure/part 1/disk/add storage OK 1m 57s
/s3/azure/part 1/disk/alter move OK 1m 5s
/s3/azure/part 1/disk/alter on cluster modify ttl OK 2m 5s
/s3/azure/part 1/disk/cache XFail 1ms
/s3/azure/part 1/disk/cache default XFail 933us
/s3/azure/part 1/disk/cache path XFail 925us
/s3/azure/part 1/disk/compact parts OK 53s 4ms
/s3/azure/part 1/disk/config over restart OK 1m 35s
/s3/azure/part 1/disk/default move factor OK 1m 28s
/s3/azure/part 1/disk/delete OK 8m 17s
/s3/azure/part 1/disk/download appropriate disk OK 1m 39s
/s3/azure/part 1/disk/drop sync OK 1m 8s
/s3/azure/part 1/disk/environment credentials Skip 1ms
/s3/azure/part 1/disk/exports Skip 871us
/s3/azure/part 1/disk/generic url Skip 787us
/s3/azure/part 1/disk/imports Skip 1ms
/s3/azure/part 1/disk/log OK 3m 32s
/s3/azure/part 1/disk/low cardinality offset XFail 55s 834ms
/s3/azure/part 1/disk/max single part upload size syntax OK 55s 595ms
/s3/azure/part 1/disk/mergetree OK 5m 10s
/s3/azure/part 1/disk/mergetree collapsing OK 1m 17s
/s3/azure/part 1/disk/mergetree versionedcollapsing OK 1m 19s
/s3/azure/part 1/disk/metadata OK 1m 13s
/s3/azure/part 1/disk/min bytes for seek syntax OK 55s 627ms
/s3/azure/part 1/disk/multiple storage OK 1m 25s
/s3/azure/part 1/disk/multiple storage query OK 1m 30s
/s3/azure/part 1/disk/no restart XFail 1ms
/s3/azure/part 1/disk/perform ttl move on insert OK 1m 53s
/s3/azure/part 1/disk/perform ttl move on insert default OK 1m 14s
/s3/azure/part 1/disk/performance ttl move OK 1m 45s
/s3/azure/part 1/disk/remote host filter OK 1m 53s
/s3/azure/part 1/disk/specific url Skip 1ms
/s3/azure/part 1/disk/syntax OK 1m 21s
/s3/azure/part 1/disk/wide parts OK 55s 589ms
/s3/azure/part 1/invalid disk OK 1m 21s
/s3/azure/part 1/invalid disk/access default OK 9s 680ms
/s3/azure/part 1/invalid disk/access failed OK 10s 699ms
/s3/azure/part 1/invalid disk/access failed skip check XFail 1ms
/s3/azure/part 1/invalid disk/cache path conflict XFail 1ms
/s3/azure/part 1/invalid disk/empty endpoint OK 10s 664ms
/s3/azure/part 1/invalid disk/invalid endpoint OK 28s 814ms
/s3/azure/part 1/invalid disk/invalid type OK 21s 373ms
/s3/azure/part 1/combinatoric table Skip 1ms
/s3/azure/part 2 OK 1h 3m
/s3/azure/part 2/zero copy replication OK 22m 56s
/s3/azure/part 2/zero copy replication/add remove one replica OK 26s 957ms
/s3/azure/part 2/zero copy replication/add remove replica parallel OK 37s 141ms
/s3/azure/part 2/zero copy replication/add replica global setting OK 1m 37s
/s3/azure/part 2/zero copy replication/add replica local setting OK 24s 617ms
/s3/azure/part 2/zero copy replication/alter Skip 1ms
/s3/azure/part 2/zero copy replication/bad detached part OK 1m 18s
/s3/azure/part 2/zero copy replication/check refcount after mutation OK 22s 699ms
/s3/azure/part 2/zero copy replication/consistency during conflicting mutation OK 24s 674ms
/s3/azure/part 2/zero copy replication/consistency during double mutation OK 24s 150ms
/s3/azure/part 2/zero copy replication/default value OK 17s 207ms
/s3/azure/part 2/zero copy replication/delete OK 16s 990ms
/s3/azure/part 2/zero copy replication/delete all OK 21s 233ms
/s3/azure/part 2/zero copy replication/drop replica OK 45s 294ms
/s3/azure/part 2/zero copy replication/global setting OK 1m 33s
/s3/azure/part 2/zero copy replication/insert multiple replicas OK 23s 890ms
/s3/azure/part 2/zero copy replication/metadata Skip 1ms
/s3/azure/part 2/zero copy replication/migration OK 28s 604ms
/s3/azure/part 2/zero copy replication/offline alter replica OK 44s 439ms
/s3/azure/part 2/zero copy replication/performance alter OK 1m 28s
/s3/azure/part 2/zero copy replication/performance insert OK 1m 47s
/s3/azure/part 2/zero copy replication/performance select OK 1m 53s
/s3/azure/part 2/zero copy replication/stale alter replica OK 1m 53s
/s3/azure/part 2/zero copy replication/ttl delete XFail 2m 13s
/s3/azure/part 2/zero copy replication/ttl move OK 2m 12s
/s3/azure/part 2/reconnect OK 3m 30s
/s3/azure/part 2/reconnect/local and s3 disk OK 1m 9s
/s3/azure/part 2/reconnect/local and s3 volumes OK 1m 1s
/s3/azure/part 2/reconnect/s3 disk OK 1m 19s
/s3/azure/part 2/backup OK 4m 2s
/s3/azure/part 2/backup/local and s3 disk OK 1m 15s
/s3/azure/part 2/backup/local and s3 volumes OK 1m 7s
/s3/azure/part 2/backup/s3 disk OK 1m 39s
/s3/azure/part 2/settings OK 33m 21s
/s3/azure/part 2/settings/setting combinations OK 32m 30s

Generated by TestFlows Open-Source Test Framework v2.0.250110.1002922