Copyright 2025, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

S3 Test Run Report

DateApr 03, 2025 22:10
Duration2h 33m
Framework TestFlows 2.0.250110.1002922

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#688/2ec25273d5c7eeb0782547e5a2383d0dc8ff24df/regression/aarch64/with_analyzer/zookeeper/without_thread_fuzzer/s3/azure/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/PRs/688/2ec25273d5c7eeb0782547e5a2383d0dc8ff24df/package_aarch64/clickhouse-common-static_24.12.2.20238.altinityantalya_arm64.deb
version24.12.2.20238.altinityantalya
user.namezvonand
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashbd31e738c0cedaca253d15a05ed245c41b6e0b6a
job.nameS3
job.retry1
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/14252367922
archaarch64
localTrue
clickhouse_versionNone
clickhouse_pathhttps://s3.amazonaws.com/altinity-build-artifacts/PRs/688/2ec25273d5c7eeb0782547e5a2383d0dc8ff24df/package_aarch64/clickhouse-common-static_24.12.2.20238.altinityantalya_arm64.deb
as_binaryFalse
base_osNone
keeper_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerTrue
reuse_envFalse
storages['azure']
minio_uriSecret(name='minio_uri')
minio_root_userSecret(name='minio_root_user')
minio_root_passwordSecret(name='minio_root_password')
aws_s3_bucketSecret(name='aws_s3_bucket')
aws_s3_regionSecret(name='aws_s3_region')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_access_keySecret(name='aws_s3_access_key')
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')
azure_account_nameSecret(name='azure_account_name')
azure_storage_keySecret(name='azure_storage_key')
azure_containerSecret(name='azure_container')

Summary

84.8%OK
11.2%Known

Statistics

Units Skip OK Fail Error XFail Retried
Modules
1
1
Features
10
1
9
Scenarios
185
13
133
39
Checks
54
54
Examples
43
43
Steps
21911
63
21761
9
6
72

Known Fails

Test NameResultMessage
/s3/azure/disk/cacheXFail 3ms
Under development for 22.8 and newer.
None
/s3/azure/disk/cache defaultXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/disk/cache pathXFail 924us
Under development for 22.8 and newer.
None
/s3/azure/disk/low cardinality offsetXFail 1m 0s
https://github.com/ClickHouse/ClickHouse/pull/44875
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 694, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 675, in regression
    Feature(test=azure_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 549, in azure_regression
    Feature(test=load("s3.tests.disk", "azure"))()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2568, in azure
    disk_tests(uri=None, bucket_prefix=None)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2538, in disk_tests
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2500, in low_cardinality_offset
    assert output == "23999\n", error()
           ^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert output == "23999\n", error()

Assertion values
  assert output == "23999\n", error()
         ^ is '23999'
  assert output == "23999\n", error()
                ^ is = False

  assert output == "23999\n", error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py', line 2500 in 'low_cardinality_offset'

2492\|                      "1",
2493\|                  ),
2494\|                  (
2495\|                      "merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem",
2496\|                      "1",
2497\|                  ),
2498\|              ],
2499\|          ).output
2500\|>         assert output == "23999\n", error()
2501\|  
2502\|  
2503\|  @TestFeature
/s3/azure/disk/no restartXFail 1ms
https://github.com/ClickHouse/ClickHouse/issues/58924
None
/s3/azure/invalid disk/access failed skip checkXFail 1ms
Not working, needs investigation
None
/s3/azure/invalid disk/cache path conflictXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/zero copy replication/ttl deleteXFail 2m 14s
https://github.com/ClickHouse/ClickHouse/issues/22679
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 694, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 675, in regression
    Feature(test=azure_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 552, in azure_regression
    Feature(test=load("s3.tests.zero_copy_replication", "azure"))()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1734, in azure
    outline(uri=None, bucket_prefix=None)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1706, in outline
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1040, in ttl_delete
    check_query_node(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py", line 719, in check_query_node
    assert r == expected, error()
           ^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == expected, error()

Assertion values
  assert r == expected, error()
         ^ is '1441794'
  assert r == expected, error()
              ^ is '1310721'
  assert r == expected, error()
           ^ is = False
    @@ -1 +1 @@
    -1441794
    +1310721
  assert r == expected, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py', line 719 in 'check_query_node'

711\|  
712\|  @TestStep(Then)
713\|  def check_query_node(self, node, num, query, expected):
714\|      node = current().context.node
715\|  
716\|      with By(f"executing query {num}", description=query):
717\|          r = node.query(query).output.strip()
718\|          with Then(f"result should match the expected", description=expected):
719\|>             assert r == expected, error()
720\|  
721\|  
722\|  def get_s3_file_content(cluster, bucket, filename, decode=True):

Results

Test Name Result Duration
/s3 OK 2h 33m
/s3/azure OK 2h 33m
/s3/azure/sanity OK 1m 27s
/s3/azure/sanity/sanity OK 32s 905ms
/s3/azure/alter OK 30m 50s
/s3/azure/alter/normal OK 9m 9s
/s3/azure/alter/normal/attach from OK 28s 128ms
/s3/azure/alter/normal/columns OK 29s 385ms
/s3/azure/alter/normal/detach OK 1m 2s
/s3/azure/alter/normal/drop OK 2m 2s
/s3/azure/alter/normal/fetch OK 1m 4s
/s3/azure/alter/normal/freeze OK 57s 669ms
/s3/azure/alter/normal/index OK 19s 612ms
/s3/azure/alter/normal/move to table OK 47s 438ms
/s3/azure/alter/normal/order by OK 10s 393ms
/s3/azure/alter/normal/projection OK 22s 660ms
/s3/azure/alter/normal/replace OK 45s 276ms
/s3/azure/alter/normal/sample by OK 10s 549ms
/s3/azure/alter/normal/update delete OK 29s 529ms
/s3/azure/alter/encrypted OK 9m 48s
/s3/azure/alter/encrypted/attach from OK 25s 703ms
/s3/azure/alter/encrypted/columns OK 35s 419ms
/s3/azure/alter/encrypted/detach OK 1m 8s
/s3/azure/alter/encrypted/drop OK 2m 16s
/s3/azure/alter/encrypted/fetch OK 1m 2s
/s3/azure/alter/encrypted/freeze OK 57s 298ms
/s3/azure/alter/encrypted/index OK 23s 227ms
/s3/azure/alter/encrypted/move to table OK 53s 327ms
/s3/azure/alter/encrypted/order by OK 15s 452ms
/s3/azure/alter/encrypted/projection OK 26s 202ms
/s3/azure/alter/encrypted/replace OK 43s 101ms
/s3/azure/alter/encrypted/sample by OK 10s 516ms
/s3/azure/alter/encrypted/update delete OK 30s 647ms
/s3/azure/alter/zero copy OK 5m 3s
/s3/azure/alter/zero copy/attach from OK 27s 651ms
/s3/azure/alter/zero copy/columns OK 29s 319ms
/s3/azure/alter/zero copy/detach Skip 2ms
/s3/azure/alter/zero copy/drop Skip 6ms
/s3/azure/alter/zero copy/fetch Skip 1ms
/s3/azure/alter/zero copy/freeze OK 57s 299ms
/s3/azure/alter/zero copy/index OK 22s 89ms
/s3/azure/alter/zero copy/move to table OK 47s 999ms
/s3/azure/alter/zero copy/order by OK 10s 261ms
/s3/azure/alter/zero copy/projection OK 22s 426ms
/s3/azure/alter/zero copy/replace OK 45s 723ms
/s3/azure/alter/zero copy/sample by OK 10s 342ms
/s3/azure/alter/zero copy/update delete OK 30s 179ms
/s3/azure/alter/zero copy encrypted OK 5m 5s
/s3/azure/alter/zero copy encrypted/attach from OK 26s 734ms
/s3/azure/alter/zero copy encrypted/columns OK 35s 920ms
/s3/azure/alter/zero copy encrypted/detach Skip 1ms
/s3/azure/alter/zero copy encrypted/drop Skip 1ms
/s3/azure/alter/zero copy encrypted/fetch Skip 972us
/s3/azure/alter/zero copy encrypted/freeze OK 52s 64ms
/s3/azure/alter/zero copy encrypted/index OK 23s 556ms
/s3/azure/alter/zero copy encrypted/move to table OK 51s 245ms
/s3/azure/alter/zero copy encrypted/order by OK 10s 260ms
/s3/azure/alter/zero copy encrypted/projection OK 25s 632ms
/s3/azure/alter/zero copy encrypted/replace OK 40s 696ms
/s3/azure/alter/zero copy encrypted/sample by OK 10s 258ms
/s3/azure/alter/zero copy encrypted/update delete OK 29s 167ms
/s3/azure/disk OK 50m 46s
/s3/azure/disk/access OK 58s 784ms
/s3/azure/disk/access skip check OK 57s 356ms
/s3/azure/disk/add storage OK 2m 2s
/s3/azure/disk/alter move OK 1m 7s
/s3/azure/disk/alter on cluster modify ttl OK 2m 8s
/s3/azure/disk/cache XFail 3ms
/s3/azure/disk/cache default XFail 1ms
/s3/azure/disk/cache path XFail 924us
/s3/azure/disk/compact parts OK 56s 322ms
/s3/azure/disk/config over restart OK 1m 41s
/s3/azure/disk/default move factor OK 1m 43s
/s3/azure/disk/delete OK 8m 33s
/s3/azure/disk/download appropriate disk OK 1m 45s
/s3/azure/disk/drop sync OK 1m 12s
/s3/azure/disk/environment credentials Skip 2ms
/s3/azure/disk/exports Skip 1ms
/s3/azure/disk/generic url Skip 1ms
/s3/azure/disk/imports Skip 993us
/s3/azure/disk/log OK 3m 45s
/s3/azure/disk/low cardinality offset XFail 1m 0s
/s3/azure/disk/max single part upload size syntax OK 58s 946ms
/s3/azure/disk/mergetree OK 5m 13s
/s3/azure/disk/mergetree collapsing OK 1m 20s
/s3/azure/disk/mergetree versionedcollapsing OK 1m 19s
/s3/azure/disk/metadata OK 1m 15s
/s3/azure/disk/min bytes for seek syntax OK 57s 503ms
/s3/azure/disk/multiple storage OK 1m 24s
/s3/azure/disk/multiple storage query OK 1m 30s
/s3/azure/disk/no restart XFail 1ms
/s3/azure/disk/perform ttl move on insert OK 1m 48s
/s3/azure/disk/perform ttl move on insert default OK 1m 16s
/s3/azure/disk/performance ttl move OK 1m 46s
/s3/azure/disk/remote host filter OK 1m 49s
/s3/azure/disk/specific url Skip 2ms
/s3/azure/disk/syntax OK 1m 15s
/s3/azure/disk/wide parts OK 56s 481ms
/s3/azure/invalid disk OK 1m 21s
/s3/azure/invalid disk/access default OK 9s 748ms
/s3/azure/invalid disk/access failed OK 10s 722ms
/s3/azure/invalid disk/access failed skip check XFail 1ms
/s3/azure/invalid disk/cache path conflict XFail 1ms
/s3/azure/invalid disk/empty endpoint OK 10s 760ms
/s3/azure/invalid disk/invalid endpoint OK 28s 907ms
/s3/azure/invalid disk/invalid type OK 21s 533ms
/s3/azure/combinatoric table Skip 2ms
/s3/azure/zero copy replication OK 23m 23s
/s3/azure/zero copy replication/add remove one replica OK 27s 588ms
/s3/azure/zero copy replication/add remove replica parallel OK 45s 514ms
/s3/azure/zero copy replication/add replica global setting OK 1m 34s
/s3/azure/zero copy replication/add replica local setting OK 25s 138ms
/s3/azure/zero copy replication/alter Skip 2ms
/s3/azure/zero copy replication/bad detached part OK 1m 16s
/s3/azure/zero copy replication/check refcount after mutation OK 22s 866ms
/s3/azure/zero copy replication/consistency during conflicting mutation OK 25s 60ms
/s3/azure/zero copy replication/consistency during double mutation OK 24s 444ms
/s3/azure/zero copy replication/default value OK 17s 602ms
/s3/azure/zero copy replication/delete OK 18s 91ms
/s3/azure/zero copy replication/delete all OK 21s 779ms
/s3/azure/zero copy replication/drop replica OK 46s 620ms
/s3/azure/zero copy replication/global setting OK 1m 32s
/s3/azure/zero copy replication/insert multiple replicas OK 24s 100ms
/s3/azure/zero copy replication/metadata Skip 1ms
/s3/azure/zero copy replication/migration OK 29s 328ms
/s3/azure/zero copy replication/offline alter replica OK 44s 820ms
/s3/azure/zero copy replication/performance alter OK 1m 29s
/s3/azure/zero copy replication/performance insert OK 1m 55s
/s3/azure/zero copy replication/performance select OK 1m 54s
/s3/azure/zero copy replication/stale alter replica OK 1m 58s
/s3/azure/zero copy replication/ttl delete XFail 2m 14s
/s3/azure/zero copy replication/ttl move OK 2m 13s
/s3/azure/reconnect OK 3m 29s
/s3/azure/reconnect/local and s3 disk OK 1m 11s
/s3/azure/reconnect/local and s3 volumes OK 1m 1s
/s3/azure/reconnect/s3 disk OK 1m 17s
/s3/azure/backup OK 4m 0s
/s3/azure/backup/local and s3 disk OK 1m 14s
/s3/azure/backup/local and s3 volumes OK 1m 6s
/s3/azure/backup/s3 disk OK 1m 38s
/s3/azure/settings OK 34m 15s
/s3/azure/settings/setting combinations OK 33m 22s

Generated by TestFlows Open-Source Test Framework v2.0.250110.1002922