Copyright 2025, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Tiered Storage Test Run Report

DateJun 27, 2025 15:13
Duration1h 49m
Framework TestFlows 2.0.250110.1002922

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/d1f73c287081665b9e9ca2767a633a3cc8a41f08/regression/aarch64/with_analyzer/zookeeper/without_thread_fuzzer/tiered_storage/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.8/d1f73c287081665b9e9ca2767a633a3cc8a41f08/package_aarch64/clickhouse-common-static_24.8.14.10501.altinitytest_arm64.deb
version24.8.14.10501.altinitytest
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashe3c00be97a045aa04e9d1a6ec50cc64f4c387b70
job.nameCommon
job.retry1
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/15925737638
archaarch64
localTrue
clickhouse_versionNone
clickhouse_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.8/d1f73c287081665b9e9ca2767a633a3cc8a41f08/package_aarch64/clickhouse-common-static_24.8.14.10501.altinitytest_arm64.deb
as_binaryFalse
base_osNone
keeper_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerTrue
reuse_envFalse
with_minioFalse
with_s3amazonFalse
with_s3gcsFalse
aws_s3_access_keySecret(name='aws_s3_access_key')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_uriNone
gcs_uriNone
gcs_key_idNone
gcs_key_secretNone

Summary

96.7%OK
3.3%Known

Statistics

Units OK Fail Error XFail
Modules
1
1
Features
1
1
Scenarios
94
90
4
Checks
92
90
2
Examples
84
81
3
Steps
12648
12425
217
6

Known Fails

Test NameResultMessage
/tiered storage/normal/attach or replace partition different policiesXFail 549ms
known issue
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 436, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 425, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 224, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/attach_or_replace_partition_different_policies.py", line 54, in scenario
    node.query(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py", line 1180, in query
    assert message in r.output, error(r.output)
           ^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert message in r.output, error(r.output)

Assertion values
  assert message in r.output, error(r.output)
         ^ is 'Exception:'
  assert message in r.output, error(r.output)
                    ^ is 
  assert message in r.output, error(r.output)
                    ^ is = ''
  assert message in r.output, error(r.output)
                 ^ is = False
  assert message in r.output, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py', line 1180 in 'query'

1172\|                  assert r.exitcode == exitcode, error(r.output)
1173\|  
1174\|          if message is not None:
1175\|              with (
1176\|                  Then(f"output should contain message", description=message)
1177\|                  if steps
1178\|                  else NullStep()
1179\|              ):
1180\|>                 assert message in r.output, error(r.output)
1181\|  
1182\|          if not ignore_exception:
1183\|              if message is None or "Exception:" not in message:
/tiered storage/normal/double move while selectXFail 7s 745ms
not yet supported
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 436, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 425, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 295, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py", line 120, in scenario
    assert r == [
           ^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == [
      "jbod1" if positive else "external"
  ], error()

Assertion values
  assert r == [
         ^ is ['jbod1']
      "jbod1" if positive else "external"
  ], error()
  assert r == [
      "jbod1" if positive else "external"
                 ^ is 0
  ], error()
  assert r == [
      "jbod1" if positive else "external"
      ^ is = 'external'
  ], error()
  assert r == [
              ^ is = ['external']
      "jbod1" if positive else "external"
  ], error()
  assert r == [
           ^ is = False
    @@ -1 +1 @@
    -['jbod1']
    +['external']
      "jbod1" if positive else "external"
  ], error()
  assert r == [
  ^ is False
      "jbod1" if positive else "external"
  ], error()

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py', line 122 in 'scenario'

114\|                                      .output.strip()
115\|                                      .splitlines()
116\|                                  )
117\|                                  with Then(
118\|                                      "if select locked old part on the destination disk the move shall fail"
119\|                                  ):
120\|                                      assert r == [
121\|                                          "jbod1" if positive else "external"
122\|>                                     ], error()
123\|                          finally:
124\|                              with Finally("I join the thread"):
125\|                                  task.result(timeout=60)
/tiered storage/normal/manual move with downtimeXFail 1s 157ms
https://altinity.atlassian.net/browse/CH-124
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 436, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 425, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 307, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/manual_move_with_downtime.py", line 109, in scenario
    assert all_paths_start_with_external, error()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert all_paths_start_with_external, error()

Assertion values
  assert all_paths_start_with_external, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/manual_move_with_downtime.py', line 109 in 'scenario'

101\|  
102\|                      with And(f"all paths should start with '{external_dir}'"):
103\|                          all_paths_start_with_external = all(
104\|                              path.startswith(external_dir)
105\|                              for path in get_paths_for_partition_from_part_log(
106\|                                  node, name, "201904"
107\|                              )[:2]
108\|                          )
109\|>                         assert all_paths_start_with_external, error()
110\|  
111\|                  with When("I manually move partition 201904 to back disk 'jbod1'"):
112\|                      node.query(f"ALTER TABLE {name} DETACH PARTITION 201904")

Results

Test Name Result Duration
/tiered storage OK 1h 49m
/tiered storage/normal OK 1h 47m
/tiered storage/normal/startup and queries OK 40s 566ms
/tiered storage/normal/metadata OK 11s 594ms
/tiered storage/normal/no changes to queries OK 12s 468ms
/tiered storage/normal/volume configuration either max_data_part_size_bytes or max_data_part_size_ratio OK 16s 285ms
/tiered storage/normal/system tables OK 214ms
/tiered storage/normal/system․detached_parts OK 4s 742ms
/tiered storage/normal/attach or replace partition different policies XFail 549ms
/tiered storage/normal/query parser OK 723ms
/tiered storage/normal/keep free space OK 22s 816ms
/tiered storage/normal/no warning about zero max data part size OK 668ms
/tiered storage/normal/round robin OK 1s 478ms
/tiered storage/normal/max data part size OK 8s 493ms
/tiered storage/normal/jbod overflow OK 51s 695ms
/tiered storage/normal/start stop moves OK 24s 21ms
/tiered storage/normal/mutate to another disk OK 20s 817ms
/tiered storage/normal/alter table policy OK 34s 596ms
/tiered storage/normal/simple replication and moves OK 1m 11s
/tiered storage/normal/download appropriate disk OK 4s 397ms
/tiered storage/normal/download appropriate disk advanced OK 22s 605ms
/tiered storage/normal/download appropriate disk max data part size OK 12s 582ms
/tiered storage/normal/rename OK 10s 911ms
/tiered storage/normal/freeze OK 10s 434ms
/tiered storage/normal/double move while select XFail 7s 745ms
/tiered storage/normal/background move OK 6m 25s
/tiered storage/normal/alter move OK 14m 1s
/tiered storage/normal/manual move with downtime XFail 1s 157ms
/tiered storage/normal/merge parts different volumes OK 11s 610ms
/tiered storage/normal/merge parts different volumes no space OK 30s 931ms
/tiered storage/normal/ttl moves OK 1h 12m
/tiered storage/normal/change config norestart OK 6m 49s

Generated by TestFlows Open-Source Test Framework v2.0.250110.1002922