Copyright 2025, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

S3 Test Run Report

DateJun 27, 2025 15:04
Duration2h 16m
Framework TestFlows 2.0.250110.1002922

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/d1f73c287081665b9e9ca2767a633a3cc8a41f08/regression/aarch64/with_analyzer/zookeeper/without_thread_fuzzer/s3/azure/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.8/d1f73c287081665b9e9ca2767a633a3cc8a41f08/package_aarch64/clickhouse-common-static_24.8.14.10501.altinitytest_arm64.deb
version24.8.14.10501.altinitytest
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashe3c00be97a045aa04e9d1a6ec50cc64f4c387b70
job.nameS3
job.retry1
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/15925737638
archaarch64
localTrue
clickhouse_versionNone
clickhouse_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.8/d1f73c287081665b9e9ca2767a633a3cc8a41f08/package_aarch64/clickhouse-common-static_24.8.14.10501.altinitytest_arm64.deb
as_binaryFalse
base_osNone
keeper_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerTrue
reuse_envFalse
storages['azure']
minio_uriSecret(name='minio_uri')
minio_root_userSecret(name='minio_root_user')
minio_root_passwordSecret(name='minio_root_password')
aws_s3_bucketSecret(name='aws_s3_bucket')
aws_s3_regionSecret(name='aws_s3_region')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_access_keySecret(name='aws_s3_access_key')
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')
azure_account_nameSecret(name='azure_account_name')
azure_storage_keySecret(name='azure_storage_key')
azure_containerSecret(name='azure_container')

Summary

84.1%OK
11.3%Known

Statistics

Units Skip OK Fail Error XFail Retried
Modules
1
1
Features
12
1
11
Scenarios
185
15
131
39
Checks
54
54
Examples
39
39
Steps
21718
63
21615
9
6
25

Known Fails

Test NameResultMessage
/s3/azure/part 1/disk/cacheXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/part 1/disk/cache defaultXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/part 1/disk/cache pathXFail 874us
Under development for 22.8 and newer.
None
/s3/azure/part 1/disk/low cardinality offsetXFail 53s 248ms
https://github.com/ClickHouse/ClickHouse/pull/44875
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 805, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 786, in regression
    Feature(test=azure_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 643, in azure_regression
    Feature(test=load("s3.tests.disk", "azure"))()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2568, in azure
    disk_tests(uri=None, bucket_prefix=None)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2538, in disk_tests
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2500, in low_cardinality_offset
    assert output == "23999\n", error()
           ^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert output == "23999\n", error()

Assertion values
  assert output == "23999\n", error()
         ^ is '23999'
  assert output == "23999\n", error()
                ^ is = False

  assert output == "23999\n", error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py', line 2500 in 'low_cardinality_offset'

2492\|                      "1",
2493\|                  ),
2494\|                  (
2495\|                      "merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem",
2496\|                      "1",
2497\|                  ),
2498\|              ],
2499\|          ).output
2500\|>         assert output == "23999\n", error()
2501\|  
2502\|  
2503\|  @TestFeature
/s3/azure/part 1/disk/no restartXFail 3ms
https://github.com/ClickHouse/ClickHouse/issues/58924
None
/s3/azure/part 1/invalid disk/access failed skip checkXFail 1ms
Not working, needs investigation
None
/s3/azure/part 1/invalid disk/cache path conflictXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/part 2/zero copy replication/ttl deleteXFail 1m 43s
https://github.com/ClickHouse/ClickHouse/issues/22679
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 805, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 786, in regression
    Feature(test=azure_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 647, in azure_regression
    Feature(test=load("s3.tests.zero_copy_replication", "azure"))()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1734, in azure
    outline(uri=None, bucket_prefix=None)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1706, in outline
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1040, in ttl_delete
    check_query_node(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py", line 719, in check_query_node
    assert r == expected, error()
           ^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == expected, error()

Assertion values
  assert r == expected, error()
         ^ is '1441794'
  assert r == expected, error()
              ^ is '1310721'
  assert r == expected, error()
           ^ is = False
    @@ -1 +1 @@
    -1441794
    +1310721
  assert r == expected, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py', line 719 in 'check_query_node'

711\|  
712\|  @TestStep(Then)
713\|  def check_query_node(self, node, num, query, expected):
714\|      node = current().context.node
715\|  
716\|      with By(f"executing query {num}", description=query):
717\|          r = node.query(query).output.strip()
718\|          with Then(f"result should match the expected", description=expected):
719\|>             assert r == expected, error()
720\|  
721\|  
722\|  def get_s3_file_content(cluster, bucket, filename, decode=True):

Results

Test Name Result Duration
/s3 OK 2h 16m
/s3/azure OK 2h 16m
/s3/azure/part 1 OK 1h 15m
/s3/azure/part 1/sanity OK 1m 20s
/s3/azure/part 1/sanity/sanity OK 28s 590ms
/s3/azure/part 1/alter OK 25m 23s
/s3/azure/part 1/alter/normal OK 7m 38s
/s3/azure/part 1/alter/normal/attach from OK 24s 317ms
/s3/azure/part 1/alter/normal/columns OK 25s 604ms
/s3/azure/part 1/alter/normal/detach OK 54s 111ms
/s3/azure/part 1/alter/normal/drop OK 1m 39s
/s3/azure/part 1/alter/normal/fetch OK 53s 343ms
/s3/azure/part 1/alter/normal/freeze OK 40s 417ms
/s3/azure/part 1/alter/normal/index OK 17s 574ms
/s3/azure/part 1/alter/normal/move to table OK 41s 658ms
/s3/azure/part 1/alter/normal/order by OK 9s 590ms
/s3/azure/part 1/alter/normal/projection OK 20s 605ms
/s3/azure/part 1/alter/normal/replace OK 37s 976ms
/s3/azure/part 1/alter/normal/sample by OK 9s 349ms
/s3/azure/part 1/alter/normal/update delete OK 24s 37ms
/s3/azure/part 1/alter/encrypted OK 8m 5s
/s3/azure/part 1/alter/encrypted/attach from OK 24s 248ms
/s3/azure/part 1/alter/encrypted/columns OK 28s 482ms
/s3/azure/part 1/alter/encrypted/detach OK 1m 1s
/s3/azure/part 1/alter/encrypted/drop OK 1m 48s
/s3/azure/part 1/alter/encrypted/fetch OK 51s 540ms
/s3/azure/part 1/alter/encrypted/freeze OK 40s 532ms
/s3/azure/part 1/alter/encrypted/index OK 19s 419ms
/s3/azure/part 1/alter/encrypted/move to table OK 45s 318ms
/s3/azure/part 1/alter/encrypted/order by OK 9s 358ms
/s3/azure/part 1/alter/encrypted/projection OK 24s 5ms
/s3/azure/part 1/alter/encrypted/replace OK 35s 755ms
/s3/azure/part 1/alter/encrypted/sample by OK 9s 495ms
/s3/azure/part 1/alter/encrypted/update delete OK 27s 468ms
/s3/azure/part 1/alter/zero copy OK 3m 29s
/s3/azure/part 1/alter/zero copy/attach from OK 22s 996ms
/s3/azure/part 1/alter/zero copy/columns OK 24s 25ms
/s3/azure/part 1/alter/zero copy/detach Skip 1ms
/s3/azure/part 1/alter/zero copy/drop Skip 1ms
/s3/azure/part 1/alter/zero copy/fetch Skip 1ms
/s3/azure/part 1/alter/zero copy/freeze Skip 936us
/s3/azure/part 1/alter/zero copy/index OK 19s 840ms
/s3/azure/part 1/alter/zero copy/move to table OK 40s 945ms
/s3/azure/part 1/alter/zero copy/order by OK 9s 554ms
/s3/azure/part 1/alter/zero copy/projection OK 20s 161ms
/s3/azure/part 1/alter/zero copy/replace OK 38s 813ms
/s3/azure/part 1/alter/zero copy/sample by OK 9s 438ms
/s3/azure/part 1/alter/zero copy/update delete OK 23s 432ms
/s3/azure/part 1/alter/zero copy encrypted OK 4m 26s
/s3/azure/part 1/alter/zero copy encrypted/attach from OK 21s 480ms
/s3/azure/part 1/alter/zero copy encrypted/columns OK 28s 737ms
/s3/azure/part 1/alter/zero copy encrypted/detach Skip 1ms
/s3/azure/part 1/alter/zero copy encrypted/drop Skip 1ms
/s3/azure/part 1/alter/zero copy encrypted/fetch Skip 1ms
/s3/azure/part 1/alter/zero copy encrypted/freeze Skip 1ms
/s3/azure/part 1/alter/zero copy encrypted/index OK 19s 475ms
/s3/azure/part 1/alter/zero copy encrypted/move to table OK 43s 186ms
/s3/azure/part 1/alter/zero copy encrypted/order by OK 9s 409ms
/s3/azure/part 1/alter/zero copy encrypted/projection OK 22s 310ms
/s3/azure/part 1/alter/zero copy encrypted/replace OK 1m 24s
/s3/azure/part 1/alter/zero copy encrypted/sample by OK 9s 532ms
/s3/azure/part 1/alter/zero copy encrypted/update delete OK 27s 821ms
/s3/azure/part 1/disk OK 47m 10s
/s3/azure/part 1/disk/access OK 55s 33ms
/s3/azure/part 1/disk/access skip check OK 55s 98ms
/s3/azure/part 1/disk/add storage OK 1m 51s
/s3/azure/part 1/disk/alter move OK 1m 5s
/s3/azure/part 1/disk/alter on cluster modify ttl OK 2m 4s
/s3/azure/part 1/disk/cache XFail 1ms
/s3/azure/part 1/disk/cache default XFail 1ms
/s3/azure/part 1/disk/cache path XFail 874us
/s3/azure/part 1/disk/compact parts OK 55s 895ms
/s3/azure/part 1/disk/config over restart OK 1m 36s
/s3/azure/part 1/disk/default move factor OK 1m 35s
/s3/azure/part 1/disk/delete OK 7m 30s
/s3/azure/part 1/disk/download appropriate disk OK 1m 38s
/s3/azure/part 1/disk/drop sync OK 1m 6s
/s3/azure/part 1/disk/environment credentials Skip 1ms
/s3/azure/part 1/disk/exports Skip 1ms
/s3/azure/part 1/disk/generic url Skip 798us
/s3/azure/part 1/disk/imports Skip 896us
/s3/azure/part 1/disk/log OK 3m 26s
/s3/azure/part 1/disk/low cardinality offset XFail 53s 248ms
/s3/azure/part 1/disk/max single part upload size syntax OK 52s 973ms
/s3/azure/part 1/disk/mergetree OK 4m 52s
/s3/azure/part 1/disk/mergetree collapsing OK 1m 13s
/s3/azure/part 1/disk/mergetree versionedcollapsing OK 1m 15s
/s3/azure/part 1/disk/metadata OK 1m 8s
/s3/azure/part 1/disk/min bytes for seek syntax OK 55s 163ms
/s3/azure/part 1/disk/multiple storage OK 1m 11s
/s3/azure/part 1/disk/multiple storage query OK 1m 20s
/s3/azure/part 1/disk/no restart XFail 3ms
/s3/azure/part 1/disk/perform ttl move on insert OK 1m 51s
/s3/azure/part 1/disk/perform ttl move on insert default OK 1m 15s
/s3/azure/part 1/disk/performance ttl move OK 1m 41s
/s3/azure/part 1/disk/remote host filter OK 1m 50s
/s3/azure/part 1/disk/specific url Skip 2ms
/s3/azure/part 1/disk/syntax OK 1m 12s
/s3/azure/part 1/disk/wide parts OK 54s 630ms
/s3/azure/part 1/invalid disk OK 1m 21s
/s3/azure/part 1/invalid disk/access default OK 9s 720ms
/s3/azure/part 1/invalid disk/access failed OK 10s 749ms
/s3/azure/part 1/invalid disk/access failed skip check XFail 1ms
/s3/azure/part 1/invalid disk/cache path conflict XFail 1ms
/s3/azure/part 1/invalid disk/empty endpoint OK 10s 732ms
/s3/azure/part 1/invalid disk/invalid endpoint OK 28s 813ms
/s3/azure/part 1/invalid disk/invalid type OK 21s 386ms
/s3/azure/part 1/combinatoric table Skip 1ms
/s3/azure/part 2 OK 58m 52s
/s3/azure/part 2/zero copy replication OK 19m 39s
/s3/azure/part 2/zero copy replication/add remove one replica OK 25s 791ms
/s3/azure/part 2/zero copy replication/add remove replica parallel OK 34s 843ms
/s3/azure/part 2/zero copy replication/add replica global setting OK 1m 13s
/s3/azure/part 2/zero copy replication/add replica local setting OK 21s 950ms
/s3/azure/part 2/zero copy replication/alter Skip 1ms
/s3/azure/part 2/zero copy replication/bad detached part OK 57s 587ms
/s3/azure/part 2/zero copy replication/check refcount after mutation OK 18s 424ms
/s3/azure/part 2/zero copy replication/consistency during conflicting mutation OK 20s 434ms
/s3/azure/part 2/zero copy replication/consistency during double mutation OK 20s 104ms
/s3/azure/part 2/zero copy replication/default value OK 17s 365ms
/s3/azure/part 2/zero copy replication/delete OK 16s 756ms
/s3/azure/part 2/zero copy replication/delete all OK 20s 46ms
/s3/azure/part 2/zero copy replication/drop replica OK 40s 666ms
/s3/azure/part 2/zero copy replication/global setting OK 1m 29s
/s3/azure/part 2/zero copy replication/insert multiple replicas OK 21s 698ms
/s3/azure/part 2/zero copy replication/metadata Skip 1ms
/s3/azure/part 2/zero copy replication/migration OK 27s 807ms
/s3/azure/part 2/zero copy replication/offline alter replica OK 38s 725ms
/s3/azure/part 2/zero copy replication/performance alter OK 1m 17s
/s3/azure/part 2/zero copy replication/performance insert OK 1m 37s
/s3/azure/part 2/zero copy replication/performance select OK 1m 45s
/s3/azure/part 2/zero copy replication/stale alter replica OK 1m 34s
/s3/azure/part 2/zero copy replication/ttl delete XFail 1m 43s
/s3/azure/part 2/zero copy replication/ttl move OK 1m 44s
/s3/azure/part 2/reconnect OK 3m 22s
/s3/azure/part 2/reconnect/local and s3 disk OK 1m 5s
/s3/azure/part 2/reconnect/local and s3 volumes OK 1m 2s
/s3/azure/part 2/reconnect/s3 disk OK 1m 14s
/s3/azure/part 2/backup OK 3m 51s
/s3/azure/part 2/backup/local and s3 disk OK 1m 15s
/s3/azure/part 2/backup/local and s3 volumes OK 1m 7s
/s3/azure/part 2/backup/s3 disk OK 1m 29s
/s3/azure/part 2/settings OK 31m 58s
/s3/azure/part 2/settings/setting combinations OK 31m 6s

Generated by TestFlows Open-Source Test Framework v2.0.250110.1002922