Copyright 2025, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

S3 Test Run Report

DateMar 31, 2025 13:39
Duration2h 28m
Framework TestFlows 2.0.250110.1002922

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#690/9cc18c29345b843524fe9f9f15856514100af4dc/regression/aarch64/with_analyzer/zookeeper/without_thread_fuzzer/s3/azure/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/PRs/690/9cc18c29345b843524fe9f9f15856514100af4dc/package_aarch64/clickhouse-common-static_24.8.14.10008.altinitytest_arm64.deb
version24.8.14.10008.altinitytest
user.nameianton-ru
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashbd31e738c0cedaca253d15a05ed245c41b6e0b6a
job.nameS3
job.retry2
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/14128423176
archaarch64
localTrue
clickhouse_versionNone
clickhouse_pathhttps://s3.amazonaws.com/altinity-build-artifacts/PRs/690/9cc18c29345b843524fe9f9f15856514100af4dc/package_aarch64/clickhouse-common-static_24.8.14.10008.altinitytest_arm64.deb
as_binaryFalse
base_osNone
keeper_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerTrue
reuse_envFalse
storages['azure']
minio_uriSecret(name='minio_uri')
minio_root_userSecret(name='minio_root_user')
minio_root_passwordSecret(name='minio_root_password')
aws_s3_bucketSecret(name='aws_s3_bucket')
aws_s3_regionSecret(name='aws_s3_region')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_access_keySecret(name='aws_s3_access_key')
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')
azure_account_nameSecret(name='azure_account_name')
azure_storage_keySecret(name='azure_storage_key')
azure_containerSecret(name='azure_container')

Summary

84%OK
11.3%Known

Statistics

Units Skip OK Fail Error XFail Retried
Modules
1
1
Features
10
1
9
Scenarios
185
15
131
39
Checks
54
54
Examples
39
39
Steps
21785
63
21633
10
6
73

Known Fails

Test NameResultMessage
/s3/azure/disk/cacheXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/disk/cache defaultXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/disk/cache pathXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/disk/low cardinality offsetXFail 54s 977ms
https://github.com/ClickHouse/ClickHouse/pull/44875
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 694, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 675, in regression
    Feature(test=azure_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 549, in azure_regression
    Feature(test=load("s3.tests.disk", "azure"))()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2568, in azure
    disk_tests(uri=None, bucket_prefix=None)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2538, in disk_tests
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2500, in low_cardinality_offset
    assert output == "23999\n", error()
           ^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert output == "23999\n", error()

Assertion values
  assert output == "23999\n", error()
         ^ is '23999'
  assert output == "23999\n", error()
                ^ is = False

  assert output == "23999\n", error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py', line 2500 in 'low_cardinality_offset'

2492\|                      "1",
2493\|                  ),
2494\|                  (
2495\|                      "merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem",
2496\|                      "1",
2497\|                  ),
2498\|              ],
2499\|          ).output
2500\|>         assert output == "23999\n", error()
2501\|  
2502\|  
2503\|  @TestFeature
/s3/azure/disk/no restartXFail 2ms
https://github.com/ClickHouse/ClickHouse/issues/58924
None
/s3/azure/invalid disk/access failed skip checkXFail 2ms
Not working, needs investigation
None
/s3/azure/invalid disk/cache path conflictXFail 1ms
Under development for 22.8 and newer.
None
/s3/azure/zero copy replication/ttl deleteXFail 2m 11s
https://github.com/ClickHouse/ClickHouse/issues/22679
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 694, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 675, in regression
    Feature(test=azure_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 552, in azure_regression
    Feature(test=load("s3.tests.zero_copy_replication", "azure"))()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1734, in azure
    outline(uri=None, bucket_prefix=None)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1706, in outline
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/zero_copy_replication.py", line 1040, in ttl_delete
    check_query_node(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py", line 719, in check_query_node
    assert r == expected, error()
           ^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == expected, error()

Assertion values
  assert r == expected, error()
         ^ is '1441794'
  assert r == expected, error()
              ^ is '1310721'
  assert r == expected, error()
           ^ is = False
    @@ -1 +1 @@
    -1441794
    +1310721
  assert r == expected, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py', line 719 in 'check_query_node'

711\|  
712\|  @TestStep(Then)
713\|  def check_query_node(self, node, num, query, expected):
714\|      node = current().context.node
715\|  
716\|      with By(f"executing query {num}", description=query):
717\|          r = node.query(query).output.strip()
718\|          with Then(f"result should match the expected", description=expected):
719\|>             assert r == expected, error()
720\|  
721\|  
722\|  def get_s3_file_content(cluster, bucket, filename, decode=True):

Results

Test Name Result Duration
/s3 OK 2h 28m
/s3/azure OK 2h 28m
/s3/azure/sanity OK 1m 23s
/s3/azure/sanity/sanity OK 34s 918ms
/s3/azure/alter OK 29m 55s
/s3/azure/alter/normal OK 9m 30s
/s3/azure/alter/normal/attach from OK 32s 961ms
/s3/azure/alter/normal/columns OK 30s 56ms
/s3/azure/alter/normal/detach OK 1m 6s
/s3/azure/alter/normal/drop OK 2m 5s
/s3/azure/alter/normal/fetch OK 1m 2s
/s3/azure/alter/normal/freeze OK 56s 759ms
/s3/azure/alter/normal/index OK 19s 344ms
/s3/azure/alter/normal/move to table OK 48s 90ms
/s3/azure/alter/normal/order by OK 15s 320ms
/s3/azure/alter/normal/projection OK 23s 12ms
/s3/azure/alter/normal/replace OK 44s 964ms
/s3/azure/alter/normal/sample by OK 15s 246ms
/s3/azure/alter/normal/update delete OK 30s 279ms
/s3/azure/alter/encrypted OK 9m 56s
/s3/azure/alter/encrypted/attach from OK 31s 742ms
/s3/azure/alter/encrypted/columns OK 36s 885ms
/s3/azure/alter/encrypted/detach OK 1m 8s
/s3/azure/alter/encrypted/drop OK 2m 14s
/s3/azure/alter/encrypted/fetch OK 1m 0s
/s3/azure/alter/encrypted/freeze OK 57s 145ms
/s3/azure/alter/encrypted/index OK 22s 909ms
/s3/azure/alter/encrypted/move to table OK 52s 408ms
/s3/azure/alter/encrypted/order by OK 15s 279ms
/s3/azure/alter/encrypted/projection OK 25s 684ms
/s3/azure/alter/encrypted/replace OK 44s 239ms
/s3/azure/alter/encrypted/sample by OK 10s 197ms
/s3/azure/alter/encrypted/update delete OK 36s 139ms
/s3/azure/alter/zero copy OK 4m 16s
/s3/azure/alter/zero copy/attach from OK 33s 379ms
/s3/azure/alter/zero copy/columns OK 29s 608ms
/s3/azure/alter/zero copy/detach Skip 1ms
/s3/azure/alter/zero copy/drop Skip 1ms
/s3/azure/alter/zero copy/fetch Skip 923us
/s3/azure/alter/zero copy/freeze Skip 809us
/s3/azure/alter/zero copy/index OK 21s 989ms
/s3/azure/alter/zero copy/move to table OK 49s 486ms
/s3/azure/alter/zero copy/order by OK 10s 226ms
/s3/azure/alter/zero copy/projection OK 22s 236ms
/s3/azure/alter/zero copy/replace OK 44s 851ms
/s3/azure/alter/zero copy/sample by OK 15s 219ms
/s3/azure/alter/zero copy/update delete OK 29s 746ms
/s3/azure/alter/zero copy encrypted OK 4m 34s
/s3/azure/alter/zero copy encrypted/attach from OK 26s 380ms
/s3/azure/alter/zero copy encrypted/columns OK 34s 985ms
/s3/azure/alter/zero copy encrypted/detach Skip 1ms
/s3/azure/alter/zero copy encrypted/drop Skip 3ms
/s3/azure/alter/zero copy encrypted/fetch Skip 831us
/s3/azure/alter/zero copy encrypted/freeze Skip 842us
/s3/azure/alter/zero copy encrypted/index OK 28s 289ms
/s3/azure/alter/zero copy encrypted/move to table OK 52s 412ms
/s3/azure/alter/zero copy encrypted/order by OK 15s 225ms
/s3/azure/alter/zero copy encrypted/projection OK 25s 771ms
/s3/azure/alter/zero copy encrypted/replace OK 45s 56ms
/s3/azure/alter/zero copy encrypted/sample by OK 10s 156ms
/s3/azure/alter/zero copy encrypted/update delete OK 35s 993ms
/s3/azure/disk OK 48m 30s
/s3/azure/disk/access OK 53s 137ms
/s3/azure/disk/access skip check OK 52s 215ms
/s3/azure/disk/add storage OK 1m 59s
/s3/azure/disk/alter move OK 1m 2s
/s3/azure/disk/alter on cluster modify ttl OK 2m 2s
/s3/azure/disk/cache XFail 1ms
/s3/azure/disk/cache default XFail 1ms
/s3/azure/disk/cache path XFail 1ms
/s3/azure/disk/compact parts OK 52s 734ms
/s3/azure/disk/config over restart OK 1m 37s
/s3/azure/disk/default move factor OK 1m 33s
/s3/azure/disk/delete OK 8m 31s
/s3/azure/disk/download appropriate disk OK 1m 41s
/s3/azure/disk/drop sync OK 1m 9s
/s3/azure/disk/environment credentials Skip 1ms
/s3/azure/disk/exports Skip 824us
/s3/azure/disk/generic url Skip 984us
/s3/azure/disk/imports Skip 821us
/s3/azure/disk/log OK 3m 31s
/s3/azure/disk/low cardinality offset XFail 54s 977ms
/s3/azure/disk/max single part upload size syntax OK 53s 356ms
/s3/azure/disk/mergetree OK 4m 57s
/s3/azure/disk/mergetree collapsing OK 1m 13s
/s3/azure/disk/mergetree versionedcollapsing OK 1m 15s
/s3/azure/disk/metadata OK 1m 9s
/s3/azure/disk/min bytes for seek syntax OK 53s 271ms
/s3/azure/disk/multiple storage OK 1m 23s
/s3/azure/disk/multiple storage query OK 1m 27s
/s3/azure/disk/no restart XFail 2ms
/s3/azure/disk/perform ttl move on insert OK 1m 43s
/s3/azure/disk/perform ttl move on insert default OK 1m 13s
/s3/azure/disk/performance ttl move OK 1m 43s
/s3/azure/disk/remote host filter OK 1m 45s
/s3/azure/disk/specific url Skip 1ms
/s3/azure/disk/syntax OK 1m 15s
/s3/azure/disk/wide parts OK 53s 477ms
/s3/azure/invalid disk OK 1m 22s
/s3/azure/invalid disk/access default OK 10s 679ms
/s3/azure/invalid disk/access failed OK 10s 697ms
/s3/azure/invalid disk/access failed skip check XFail 2ms
/s3/azure/invalid disk/cache path conflict XFail 1ms
/s3/azure/invalid disk/empty endpoint OK 10s 685ms
/s3/azure/invalid disk/invalid endpoint OK 28s 815ms
/s3/azure/invalid disk/invalid type OK 21s 327ms
/s3/azure/combinatoric table Skip 2ms
/s3/azure/zero copy replication OK 23m 13s
/s3/azure/zero copy replication/add remove one replica OK 27s 138ms
/s3/azure/zero copy replication/add remove replica parallel OK 52s 552ms
/s3/azure/zero copy replication/add replica global setting OK 1m 34s
/s3/azure/zero copy replication/add replica local setting OK 24s 385ms
/s3/azure/zero copy replication/alter Skip 1ms
/s3/azure/zero copy replication/bad detached part OK 1m 17s
/s3/azure/zero copy replication/check refcount after mutation OK 22s 649ms
/s3/azure/zero copy replication/consistency during conflicting mutation OK 35s 418ms
/s3/azure/zero copy replication/consistency during double mutation OK 24s 777ms
/s3/azure/zero copy replication/default value OK 17s 248ms
/s3/azure/zero copy replication/delete OK 17s 834ms
/s3/azure/zero copy replication/delete all OK 21s 377ms
/s3/azure/zero copy replication/drop replica OK 45s 79ms
/s3/azure/zero copy replication/global setting OK 1m 33s
/s3/azure/zero copy replication/insert multiple replicas OK 24s 171ms
/s3/azure/zero copy replication/metadata Skip 1ms
/s3/azure/zero copy replication/migration OK 31s 523ms
/s3/azure/zero copy replication/offline alter replica OK 44s 262ms
/s3/azure/zero copy replication/performance alter OK 1m 29s
/s3/azure/zero copy replication/performance insert OK 1m 43s
/s3/azure/zero copy replication/performance select OK 1m 52s
/s3/azure/zero copy replication/stale alter replica OK 1m 48s
/s3/azure/zero copy replication/ttl delete XFail 2m 11s
/s3/azure/zero copy replication/ttl move OK 2m 13s
/s3/azure/reconnect OK 3m 27s
/s3/azure/reconnect/local and s3 disk OK 1m 9s
/s3/azure/reconnect/local and s3 volumes OK 1m 1s
/s3/azure/reconnect/s3 disk OK 1m 17s
/s3/azure/backup OK 4m 0s
/s3/azure/backup/local and s3 disk OK 1m 19s
/s3/azure/backup/local and s3 volumes OK 1m 5s
/s3/azure/backup/s3 disk OK 1m 35s
/s3/azure/settings OK 32m 53s
/s3/azure/settings/setting combinations OK 32m 4s

Generated by TestFlows Open-Source Test Framework v2.0.250110.1002922