Copyright 2025, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

S3 Test Run Report

DateJun 05, 2025 17:15
Duration2h 31m
Framework TestFlows 2.0.250110.1002922

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#843/7a49bd3cfa10011d0430e1f9de4ce6ea37d19571/regression/aarch64/with_analyzer/zookeeper/without_thread_fuzzer/s3/azure/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/PRs/843/7a49bd3cfa10011d0430e1f9de4ce6ea37d19571/package_aarch64/clickhouse-common-static_24.8.14.10034.altinitytest_arm64.deb
version24.8.14.10034.altinitytest
user.nameilejn
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashf9e29772f4d261b82c23189d89038eb7ba027865
job.nameS3
job.retry1
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/15471286628
archaarch64
localTrue
clickhouse_versionNone
clickhouse_pathhttps://s3.amazonaws.com/altinity-build-artifacts/PRs/843/7a49bd3cfa10011d0430e1f9de4ce6ea37d19571/package_aarch64/clickhouse-common-static_24.8.14.10034.altinitytest_arm64.deb
as_binaryFalse
base_osNone
keeper_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerTrue
reuse_envFalse
storages['azure']
minio_uriSecret(name='minio_uri')
minio_root_userSecret(name='minio_root_user')
minio_root_passwordSecret(name='minio_root_password')
aws_s3_bucketSecret(name='aws_s3_bucket')
aws_s3_regionSecret(name='aws_s3_region')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_access_keySecret(name='aws_s3_access_key')
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')
azure_account_nameSecret(name='azure_account_name')
azure_storage_keySecret(name='azure_storage_key')
azure_containerSecret(name='azure_container')

Summary

84.1%OK
11.3%Known

Statistics

Units Skip OK Fail Error XFail Retried
Modules
1
1
Features
12
1
11
Scenarios
185
15
131
39
Checks
54
54
Examples
39
39
Steps
21813
63
21660
10
6
74

Known Fails

Test NameResultMessage
/s3/azure/part 1/disk/cacheXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/part 1/disk/cache defaultXFail 4ms
Under development for 22.8 and newer.
None
/s3/azure/part 1/disk/cache pathXFail 894us
Under development for 22.8 and newer.
None
/s3/azure/part 1/disk/low cardinality offsetXFail 57s 159ms
https://github.com/ClickHouse/ClickHouse/pull/44875
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 803, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 784, in regression
    Feature(test=azure_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 643, in azure_regression
    Feature(test=load("s3.tests.disk", "azure"))()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2568, in azure
    disk_tests(uri=None, bucket_prefix=None)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2538, in disk_tests
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2500, in low_cardinality_offset
    assert output == "23999\n", error()
           ^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert output == "23999\n", error()

Assertion values
  assert output == "23999\n", error()
         ^ is '23999'
  assert output == "23999\n", error()
                ^ is = False

  assert output == "23999\n", error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py', line 2500 in 'low_cardinality_offset'

2492\|                      "1",
2493\|                  ),
2494\|                  (
2495\|                      "merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem",
2496\|                      "1",
2497\|                  ),
2498\|              ],
2499\|          ).output
2500\|>         assert output == "23999\n", error()
2501\|  
2502\|  
2503\|  @TestFeature
/s3/azure/part 1/disk/no restartXFail 2ms
https://github.com/ClickHouse/ClickHouse/issues/58924
None
/s3/azure/part 1/invalid disk/access failed skip checkXFail 1ms
Not working, needs investigation
None
/s3/azure/part 1/invalid disk/cache path conflictXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/part 2/zero copy replication/ttl deleteXFail 2m 15s
https://github.com/ClickHouse/ClickHouse/issues/22679
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 803, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 784, in regression
    Feature(test=azure_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 647, in azure_regression
    Feature(test=load("s3.tests.zero_copy_replication", "azure"))()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1734, in azure
    outline(uri=None, bucket_prefix=None)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1706, in outline
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1040, in ttl_delete
    check_query_node(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py", line 719, in check_query_node
    assert r == expected, error()
           ^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == expected, error()

Assertion values
  assert r == expected, error()
         ^ is '1441794'
  assert r == expected, error()
              ^ is '1310721'
  assert r == expected, error()
           ^ is = False
    @@ -1 +1 @@
    -1441794
    +1310721
  assert r == expected, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py', line 719 in 'check_query_node'

711\|  
712\|  @TestStep(Then)
713\|  def check_query_node(self, node, num, query, expected):
714\|      node = current().context.node
715\|  
716\|      with By(f"executing query {num}", description=query):
717\|          r = node.query(query).output.strip()
718\|          with Then(f"result should match the expected", description=expected):
719\|>             assert r == expected, error()
720\|  
721\|  
722\|  def get_s3_file_content(cluster, bucket, filename, decode=True):

Results

Test Name Result Duration
/s3 OK 2h 31m
/s3/azure OK 2h 31m
/s3/azure/part 1 OK 1h 22m
/s3/azure/part 1/sanity OK 1m 23s
/s3/azure/part 1/sanity/sanity OK 31s 640ms
/s3/azure/part 1/alter OK 29m 26s
/s3/azure/part 1/alter/normal OK 9m 4s
/s3/azure/part 1/alter/normal/attach from OK 28s 86ms
/s3/azure/part 1/alter/normal/columns OK 29s 41ms
/s3/azure/part 1/alter/normal/detach OK 1m 2s
/s3/azure/part 1/alter/normal/drop OK 2m 0s
/s3/azure/part 1/alter/normal/fetch OK 1m 3s
/s3/azure/part 1/alter/normal/freeze OK 56s 797ms
/s3/azure/part 1/alter/normal/index OK 20s 372ms
/s3/azure/part 1/alter/normal/move to table OK 47s 31ms
/s3/azure/part 1/alter/normal/order by OK 10s 430ms
/s3/azure/part 1/alter/normal/projection OK 22s 412ms
/s3/azure/part 1/alter/normal/replace OK 44s 807ms
/s3/azure/part 1/alter/normal/sample by OK 10s 259ms
/s3/azure/part 1/alter/normal/update delete OK 29s 149ms
/s3/azure/part 1/alter/encrypted OK 9m 48s
/s3/azure/part 1/alter/encrypted/attach from OK 26s 567ms
/s3/azure/part 1/alter/encrypted/columns OK 34s 319ms
/s3/azure/part 1/alter/encrypted/detach OK 1m 11s
/s3/azure/part 1/alter/encrypted/drop OK 2m 14s
/s3/azure/part 1/alter/encrypted/fetch OK 1m 1s
/s3/azure/part 1/alter/encrypted/freeze OK 57s 293ms
/s3/azure/part 1/alter/encrypted/index OK 22s 355ms
/s3/azure/part 1/alter/encrypted/move to table OK 51s 866ms
/s3/azure/part 1/alter/encrypted/order by OK 11s 286ms
/s3/azure/part 1/alter/encrypted/projection OK 26s 289ms
/s3/azure/part 1/alter/encrypted/replace OK 44s 961ms
/s3/azure/part 1/alter/encrypted/sample by OK 10s 245ms
/s3/azure/part 1/alter/encrypted/update delete OK 35s 696ms
/s3/azure/part 1/alter/zero copy OK 4m 9s
/s3/azure/part 1/alter/zero copy/attach from OK 32s 268ms
/s3/azure/part 1/alter/zero copy/columns OK 29s 175ms
/s3/azure/part 1/alter/zero copy/detach Skip 1ms
/s3/azure/part 1/alter/zero copy/drop Skip 1ms
/s3/azure/part 1/alter/zero copy/fetch Skip 819us
/s3/azure/part 1/alter/zero copy/freeze Skip 3ms
/s3/azure/part 1/alter/zero copy/index OK 21s 739ms
/s3/azure/part 1/alter/zero copy/move to table OK 49s 79ms
/s3/azure/part 1/alter/zero copy/order by OK 10s 280ms
/s3/azure/part 1/alter/zero copy/projection OK 22s 738ms
/s3/azure/part 1/alter/zero copy/replace OK 45s 146ms
/s3/azure/part 1/alter/zero copy/sample by OK 10s 274ms
/s3/azure/part 1/alter/zero copy/update delete OK 29s 128ms
/s3/azure/part 1/alter/zero copy encrypted OK 4m 41s
/s3/azure/part 1/alter/zero copy encrypted/attach from OK 31s 717ms
/s3/azure/part 1/alter/zero copy encrypted/columns OK 34s 515ms
/s3/azure/part 1/alter/zero copy encrypted/detach Skip 1ms
/s3/azure/part 1/alter/zero copy encrypted/drop Skip 1ms
/s3/azure/part 1/alter/zero copy encrypted/fetch Skip 1ms
/s3/azure/part 1/alter/zero copy encrypted/freeze Skip 1ms
/s3/azure/part 1/alter/zero copy encrypted/index OK 28s 479ms
/s3/azure/part 1/alter/zero copy encrypted/move to table OK 53s 514ms
/s3/azure/part 1/alter/zero copy encrypted/order by OK 15s 751ms
/s3/azure/part 1/alter/zero copy encrypted/projection OK 25s 862ms
/s3/azure/part 1/alter/zero copy encrypted/replace OK 45s 265ms
/s3/azure/part 1/alter/zero copy encrypted/sample by OK 10s 588ms
/s3/azure/part 1/alter/zero copy encrypted/update delete OK 35s 792ms
/s3/azure/part 1/disk OK 50m 24s
/s3/azure/part 1/disk/access OK 54s 810ms
/s3/azure/part 1/disk/access skip check OK 54s 752ms
/s3/azure/part 1/disk/add storage OK 2m 1s
/s3/azure/part 1/disk/alter move OK 1m 7s
/s3/azure/part 1/disk/alter on cluster modify ttl OK 2m 7s
/s3/azure/part 1/disk/cache XFail 1ms
/s3/azure/part 1/disk/cache default XFail 4ms
/s3/azure/part 1/disk/cache path XFail 894us
/s3/azure/part 1/disk/compact parts OK 55s 95ms
/s3/azure/part 1/disk/config over restart OK 1m 39s
/s3/azure/part 1/disk/default move factor OK 1m 35s
/s3/azure/part 1/disk/delete OK 8m 25s
/s3/azure/part 1/disk/download appropriate disk OK 1m 43s
/s3/azure/part 1/disk/drop sync OK 1m 13s
/s3/azure/part 1/disk/environment credentials Skip 2ms
/s3/azure/part 1/disk/exports Skip 1ms
/s3/azure/part 1/disk/generic url Skip 1ms
/s3/azure/part 1/disk/imports Skip 866us
/s3/azure/part 1/disk/log OK 3m 43s
/s3/azure/part 1/disk/low cardinality offset XFail 57s 159ms
/s3/azure/part 1/disk/max single part upload size syntax OK 57s 199ms
/s3/azure/part 1/disk/mergetree OK 5m 17s
/s3/azure/part 1/disk/mergetree collapsing OK 1m 19s
/s3/azure/part 1/disk/mergetree versionedcollapsing OK 1m 19s
/s3/azure/part 1/disk/metadata OK 1m 13s
/s3/azure/part 1/disk/min bytes for seek syntax OK 55s 451ms
/s3/azure/part 1/disk/multiple storage OK 1m 28s
/s3/azure/part 1/disk/multiple storage query OK 1m 32s
/s3/azure/part 1/disk/no restart XFail 2ms
/s3/azure/part 1/disk/perform ttl move on insert OK 1m 47s
/s3/azure/part 1/disk/perform ttl move on insert default OK 1m 18s
/s3/azure/part 1/disk/performance ttl move OK 1m 49s
/s3/azure/part 1/disk/remote host filter OK 1m 55s
/s3/azure/part 1/disk/specific url Skip 1ms
/s3/azure/part 1/disk/syntax OK 1m 17s
/s3/azure/part 1/disk/wide parts OK 55s 146ms
/s3/azure/part 1/invalid disk OK 1m 25s
/s3/azure/part 1/invalid disk/access default OK 9s 836ms
/s3/azure/part 1/invalid disk/access failed OK 10s 929ms
/s3/azure/part 1/invalid disk/access failed skip check XFail 1ms
/s3/azure/part 1/invalid disk/cache path conflict XFail 1ms
/s3/azure/part 1/invalid disk/empty endpoint OK 10s 889ms
/s3/azure/part 1/invalid disk/invalid endpoint OK 31s 963ms
/s3/azure/part 1/invalid disk/invalid type OK 21s 622ms
/s3/azure/part 1/combinatoric table Skip 1ms
/s3/azure/part 2 OK 1h 6m
/s3/azure/part 2/zero copy replication OK 23m 20s
/s3/azure/part 2/zero copy replication/add remove one replica OK 27s 583ms
/s3/azure/part 2/zero copy replication/add remove replica parallel OK 39s 994ms
/s3/azure/part 2/zero copy replication/add replica global setting OK 1m 38s
/s3/azure/part 2/zero copy replication/add replica local setting OK 25s 865ms
/s3/azure/part 2/zero copy replication/alter Skip 1ms
/s3/azure/part 2/zero copy replication/bad detached part OK 1m 20s
/s3/azure/part 2/zero copy replication/check refcount after mutation OK 23s 461ms
/s3/azure/part 2/zero copy replication/consistency during conflicting mutation OK 26s 33ms
/s3/azure/part 2/zero copy replication/consistency during double mutation OK 24s 819ms
/s3/azure/part 2/zero copy replication/default value OK 17s 689ms
/s3/azure/part 2/zero copy replication/delete OK 18s 373ms
/s3/azure/part 2/zero copy replication/delete all OK 21s 913ms
/s3/azure/part 2/zero copy replication/drop replica OK 46s 532ms
/s3/azure/part 2/zero copy replication/global setting OK 1m 33s
/s3/azure/part 2/zero copy replication/insert multiple replicas OK 24s 967ms
/s3/azure/part 2/zero copy replication/metadata Skip 1ms
/s3/azure/part 2/zero copy replication/migration OK 31s 597ms
/s3/azure/part 2/zero copy replication/offline alter replica OK 45s 728ms
/s3/azure/part 2/zero copy replication/performance alter OK 1m 29s
/s3/azure/part 2/zero copy replication/performance insert OK 1m 46s
/s3/azure/part 2/zero copy replication/performance select OK 1m 55s
/s3/azure/part 2/zero copy replication/stale alter replica OK 1m 48s
/s3/azure/part 2/zero copy replication/ttl delete XFail 2m 15s
/s3/azure/part 2/zero copy replication/ttl move OK 2m 14s
/s3/azure/part 2/reconnect OK 3m 41s
/s3/azure/part 2/reconnect/local and s3 disk OK 1m 13s
/s3/azure/part 2/reconnect/local and s3 volumes OK 1m 4s
/s3/azure/part 2/reconnect/s3 disk OK 1m 23s
/s3/azure/part 2/backup OK 4m 9s
/s3/azure/part 2/backup/local and s3 disk OK 1m 21s
/s3/azure/part 2/backup/local and s3 volumes OK 1m 7s
/s3/azure/part 2/backup/s3 disk OK 1m 39s
/s3/azure/part 2/settings OK 35m 22s
/s3/azure/part 2/settings/setting combinations OK 34m 30s

Generated by TestFlows Open-Source Test Framework v2.0.250110.1002922