Engines Test Run Report

DateJun 30, 2026 23:34
Duration5m 53s
Framework TestFlows 2.0.250110.1002922

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#REFs/v26.3.16.10001.altinitystable/8de06fed91fa7a6545a72f37c98e81d4cc024bb1/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
user.namestrtgbb
version26.3.16.10001.altinitystable
packagehttps://altinity-build-artifacts.s3.amazonaws.com/REFs/v26.3.16.10001.altinitystable/8de06fed91fa7a6545a72f37c98e81d4cc024bb1/build_arm_binary/clickhouse
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash6cd9d2e8627aa513bd1c71610e41fe2dfff39bb0
job.nameengines
job.retry1
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/28467419577
archaarch64
localTrue
clickhouse_versionNone
clickhouse_pathhttps://altinity-build-artifacts.s3.amazonaws.com/REFs/v26.3.16.10001.altinitystable/8de06fed91fa7a6545a72f37c98e81d4cc024bb1/build_arm_binary/clickhouse
as_binaryFalse
base_osNone
keeper_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerTrue
reuse_envFalse
cicdTrue

Summary

94.6%OK
5.4%Known

Statistics

Units OK Fail XFail
Modules
1
1
Features
18
18
Scenarios
18
16
2
Steps
491
487
4

Known Fails

Test NameResultMessage
/engines/summing_merge_tree/clear column validation consistencyXFail 291ms
https://github.com/ClickHouse/ClickHouse/issues/101953 - fixed in >=26.6
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/regression.py", line 88, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/argparser.py", line 180, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/regression.py", line 79, in regression
    Feature(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../engines/tests/summing_merge_tree/summing_merge_tree.py", line 129, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../engines/tests/summing_merge_tree/summing_merge_tree.py", line 108, in clear_column_validation_consistency
    alter_table_clear_column_in_partition(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/alter/column.py", line 189, in alter_table_clear_column_in_partition
    node.query(query, **query_kwargs)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/cluster.py", line 1260, in query
    assert False, error(r.output)
           ^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 26.3.16):
Code: 524. DB::Exception: Received from localhost:9000. DB::Exception: Trying to ALTER DROP columns to sum (c) column. (ALTER_OF_COLUMN_IS_FORBIDDEN)
(query: ALTER TABLE summing_explicit_1778fa29_74dd_11f1_9eb4_120d8b90de0f CLEAR COLUMN c IN PARTITION 1
)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/cluster.py', line 1260 in 'query'

1252\|                  assert message in r.output, error(r.output)
1253\|  
1254\|          if not ignore_exception:
1255\|              if message is None or "Exception:" not in message:
1256\|                  with Then("check if output has exception") if steps else NullStep():
1257\|                      if "Exception:" in r.output:
1258\|                          if raise_on_exception:
1259\|                              raise QueryRuntimeException(r.output)
1260\|>                         assert False, error(r.output)
1261\|  
1262\|          return r
1263\|
/engines/summing_merge_tree/zero row deletion with clear columnXFail 385ms
https://github.com/ClickHouse/ClickHouse/issues/101953 - fixed in >=26.6
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/regression.py", line 88, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/argparser.py", line 180, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/regression.py", line 79, in regression
    Feature(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../engines/tests/summing_merge_tree/summing_merge_tree.py", line 129, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../engines/tests/summing_merge_tree/summing_merge_tree.py", line 83, in zero_row_deletion_with_clear_column
    assert_row_count(node=node, table_name=name, rows=1)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/queries.py", line 186, in assert_row_count
    assert actual_count == rows, error()
           ^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert actual_count == rows, error()

Assertion values
  assert actual_count == rows, error()
         ^ is 2
  assert actual_count == rows, error()
                         ^ is 1
  assert actual_count == rows, error()
                      ^ is = False
  assert actual_count == rows, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/queries.py', line 186 in 'assert_row_count'

178\|  def assert_row_count(
179\|      self, table_name: str, rows: int, node: ClickHouseNode = None, timeout: int = 30
180\|  ) -> None:
181\|      """Assert that the number of rows in a table matches the expected value."""
182\|      if node is None:
183\|          node = self.context.node
184\|  
185\|      actual_count = get_row_count(node=node, table_name=table_name, timeout=timeout)
186\|>     assert actual_count == rows, error()
187\|  
188\|  
189\|  @TestStep

Results

Test Name Result Duration
/engines OK 5m 53s
/engines/replacing_merge_tree OK 4s 675ms
/engines/replacing_merge_tree/clean deleted rows with is deleted OK 531ms
/engines/replacing_merge_tree/clean deleted rows with is deleted/clean deleted rows with is deleted OK 530ms
/engines/replacing_merge_tree/clean deleted rows without is deleted OK 432ms
/engines/replacing_merge_tree/clean deleted rows without is deleted/clean deleted rows without is deleted OK 431ms
/engines/replacing_merge_tree/final OK 435ms
/engines/replacing_merge_tree/final/final OK 435ms
/engines/replacing_merge_tree/incorrect data insert OK 218ms
/engines/replacing_merge_tree/incorrect data insert/incorrect data insert OK 218ms
/engines/replacing_merge_tree/incorrect data insert with disabled optimize on insert OK 403ms
/engines/replacing_merge_tree/incorrect data insert with disabled optimize on insert/incorrect data insert with disabled optimize on insert OK 403ms
/engines/replacing_merge_tree/incorrect data type OK 113ms
/engines/replacing_merge_tree/incorrect data type/incorrect data type OK 113ms
/engines/replacing_merge_tree/update OK 452ms
/engines/replacing_merge_tree/update/update OK 451ms
/engines/replacing_merge_tree/update distributed OK 1s 191ms
/engines/replacing_merge_tree/update distributed/update distributed OK 1s 191ms
/engines/replacing_merge_tree/with is deleted OK 437ms
/engines/replacing_merge_tree/with is deleted/with is deleted OK 437ms
/engines/replacing_merge_tree/without is deleted OK 455ms
/engines/replacing_merge_tree/without is deleted/without is deleted OK 454ms
/engines/replicated_replacing_merge_tree OK 4s 274ms
/engines/replicated_replacing_merge_tree/update distributed OK 1s 63ms
/engines/replicated_replacing_merge_tree/update distributed/update distributed OK 1s 63ms
/engines/replicated_replacing_merge_tree/with is deleted OK 867ms
/engines/replicated_replacing_merge_tree/with is deleted/with is deleted OK 866ms
/engines/replicated_replacing_merge_tree/with is deleted distributed OK 975ms
/engines/replicated_replacing_merge_tree/with is deleted distributed/with is deleted distributed OK 974ms
/engines/replicated_replacing_merge_tree/without is deleted OK 532ms
/engines/replicated_replacing_merge_tree/without is deleted/without is deleted OK 532ms
/engines/replicated_replacing_merge_tree/without is deleted distributed OK 834ms
/engines/replicated_replacing_merge_tree/without is deleted distributed/without is deleted distributed OK 833ms
/engines/summing_merge_tree OK 1s 55ms
/engines/summing_merge_tree/clear column validation consistency XFail 291ms
/engines/summing_merge_tree/zero row deletion with clear column XFail 385ms
/engines/summing_merge_tree/zero row deletion with update OK 377ms

Generated by TestFlows Open-Source Test Framework v2.0.250110.1002922