Copyright 2025, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

Tiered Storage Test Run Report

DateJun 27, 2025 14:22
Duration1h 52m
Framework TestFlows 2.0.250110.1002922

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/d1f73c287081665b9e9ca2767a633a3cc8a41f08/regression/aarch64/with_analyzer/zookeeper/without_thread_fuzzer/tiered_storage/minio/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.8/d1f73c287081665b9e9ca2767a633a3cc8a41f08/package_aarch64/clickhouse-common-static_24.8.14.10501.altinitytest_arm64.deb
version24.8.14.10501.altinitytest
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashe3c00be97a045aa04e9d1a6ec50cc64f4c387b70
job.nameTieredStorage
job.retry1
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/15925737638
archaarch64
localTrue
clickhouse_versionNone
clickhouse_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.8/d1f73c287081665b9e9ca2767a633a3cc8a41f08/package_aarch64/clickhouse-common-static_24.8.14.10501.altinitytest_arm64.deb
as_binaryFalse
base_osNone
keeper_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerTrue
reuse_envFalse
with_minioTrue
with_s3amazonFalse
with_s3gcsFalse
aws_s3_access_keySecret(name='aws_s3_access_key')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_uriSecret(name='aws_s3_uri')
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')

Summary

96.7%OK
3.3%Known

Statistics

Units OK Fail Error XFail
Modules
1
1
Features
1
1
Scenarios
94
90
4
Checks
92
90
2
Examples
84
81
3
Steps
12629
12409
214
6

Known Fails

Test NameResultMessage
/tiered storage/with minio/attach or replace partition different policiesXFail 646ms
known issue
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 436, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 425, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 224, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/attach_or_replace_partition_different_policies.py", line 54, in scenario
    node.query(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py", line 1180, in query
    assert message in r.output, error(r.output)
           ^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert message in r.output, error(r.output)

Assertion values
  assert message in r.output, error(r.output)
         ^ is 'Exception:'
  assert message in r.output, error(r.output)
                    ^ is 
  assert message in r.output, error(r.output)
                    ^ is = ''
  assert message in r.output, error(r.output)
                 ^ is = False
  assert message in r.output, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py', line 1180 in 'query'

1172\|                  assert r.exitcode == exitcode, error(r.output)
1173\|  
1174\|          if message is not None:
1175\|              with (
1176\|                  Then(f"output should contain message", description=message)
1177\|                  if steps
1178\|                  else NullStep()
1179\|              ):
1180\|>                 assert message in r.output, error(r.output)
1181\|  
1182\|          if not ignore_exception:
1183\|              if message is None or "Exception:" not in message:
/tiered storage/with minio/double move while selectXFail 8s 130ms
not yet supported
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 436, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 425, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 295, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py", line 120, in scenario
    assert r == [
           ^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r == [
      "jbod1" if positive else "external"
  ], error()

Assertion values
  assert r == [
         ^ is ['jbod1']
      "jbod1" if positive else "external"
  ], error()
  assert r == [
      "jbod1" if positive else "external"
                 ^ is 0
  ], error()
  assert r == [
      "jbod1" if positive else "external"
      ^ is = 'external'
  ], error()
  assert r == [
              ^ is = ['external']
      "jbod1" if positive else "external"
  ], error()
  assert r == [
           ^ is = False
    @@ -1 +1 @@
    -['jbod1']
    +['external']
      "jbod1" if positive else "external"
  ], error()
  assert r == [
  ^ is False
      "jbod1" if positive else "external"
  ], error()

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/double_move_while_select.py', line 122 in 'scenario'

114\|                                      .output.strip()
115\|                                      .splitlines()
116\|                                  )
117\|                                  with Then(
118\|                                      "if select locked old part on the destination disk the move shall fail"
119\|                                  ):
120\|                                      assert r == [
121\|                                          "jbod1" if positive else "external"
122\|>                                     ], error()
123\|                          finally:
124\|                              with Finally("I join the thread"):
125\|                                  task.result(timeout=60)
/tiered storage/with minio/manual move with downtimeXFail 1s 25ms
https://altinity.atlassian.net/browse/CH-124
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 436, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 425, in regression
    Feature(name, test=feature)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/regression.py", line 307, in feature
    Scenario(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../tiered_storage/tests/manual_move_with_downtime.py", line 83, in scenario
    node.query(f"ALTER TABLE {name} ATTACH PARTITION 201904")
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py", line 1188, in query
    assert False, error(r.output)
           ^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 24.8.14):
Code: 27. DB::Exception: Received from localhost:9000. DB::Exception: Cannot parse input: expected '\n' before: '{"columns":[{"kind":"Default","name":"EventDate","num_defaults":0,"num_rows":1},{"kind":"Default","name":"number","num_defaults":0,"num_rows":1}],"version":0}'. (CANNOT_PARSE_INPUT_ASSERTION_FAILED)
(query: ALTER TABLE manual_move_mt ATTACH PARTITION 201904
)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/tiered_storage/../helpers/cluster.py', line 1188 in 'query'

1180\|                  assert message in r.output, error(r.output)
1181\|  
1182\|          if not ignore_exception:
1183\|              if message is None or "Exception:" not in message:
1184\|                  with Then("check if output has exception") if steps else NullStep():
1185\|                      if "Exception:" in r.output:
1186\|                          if raise_on_exception:
1187\|                              raise QueryRuntimeException(r.output)
1188\|>                         assert False, error(r.output)
1189\|  
1190\|          return r
1191\|

Results

Test Name Result Duration
/tiered storage OK 1h 52m
/tiered storage/with minio OK 1h 50m
/tiered storage/with minio/startup and queries OK 41s 268ms
/tiered storage/with minio/metadata OK 12s 12ms
/tiered storage/with minio/no changes to queries OK 13s 156ms
/tiered storage/with minio/volume configuration either max_data_part_size_bytes or max_data_part_size_ratio OK 16s 474ms
/tiered storage/with minio/system tables OK 229ms
/tiered storage/with minio/system․detached_parts OK 4s 870ms
/tiered storage/with minio/attach or replace partition different policies XFail 646ms
/tiered storage/with minio/query parser OK 771ms
/tiered storage/with minio/keep free space OK 23s 622ms
/tiered storage/with minio/no warning about zero max data part size OK 696ms
/tiered storage/with minio/round robin OK 1s 558ms
/tiered storage/with minio/max data part size OK 9s 240ms
/tiered storage/with minio/jbod overflow OK 53s 999ms
/tiered storage/with minio/start stop moves OK 25s 418ms
/tiered storage/with minio/mutate to another disk OK 21s 593ms
/tiered storage/with minio/alter table policy OK 36s 677ms
/tiered storage/with minio/simple replication and moves OK 1m 15s
/tiered storage/with minio/download appropriate disk OK 6s 95ms
/tiered storage/with minio/download appropriate disk advanced OK 24s 976ms
/tiered storage/with minio/download appropriate disk max data part size OK 14s 134ms
/tiered storage/with minio/rename OK 12s 267ms
/tiered storage/with minio/freeze OK 11s 250ms
/tiered storage/with minio/double move while select XFail 8s 130ms
/tiered storage/with minio/background move OK 6m 42s
/tiered storage/with minio/alter move OK 15m 6s
/tiered storage/with minio/manual move with downtime XFail 1s 25ms
/tiered storage/with minio/merge parts different volumes OK 11s 812ms
/tiered storage/with minio/merge parts different volumes no space OK 32s 427ms
/tiered storage/with minio/ttl moves OK 1h 12m
/tiered storage/with minio/change config norestart OK 7m 1s

Generated by TestFlows Open-Source Test Framework v2.0.250110.1002922