Engines Test Run Report

DateJun 02, 2026 14:30
Duration6m 9s
Framework TestFlows 2.0.250110.1002922

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#REFs/antalya-26.3/0ef53ddec34514b1d64cb3b44a678f1350c72876/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
user.namestrtgbb
version26.3.10.20001.altinityantalya
packagehttps://altinity-build-artifacts.s3.amazonaws.com/REFs/antalya-26.3/0ef53ddec34514b1d64cb3b44a678f1350c72876/build_arm_binary/clickhouse
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash3dc71e7459ce4dc1762152aeae0986d9a3ccb54c
job.nameengines
job.retry1
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/26818784939
archaarch64
localTrue
clickhouse_versionNone
clickhouse_pathhttps://altinity-build-artifacts.s3.amazonaws.com/REFs/antalya-26.3/0ef53ddec34514b1d64cb3b44a678f1350c72876/build_arm_binary/clickhouse
as_binaryFalse
base_osNone
keeper_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerTrue
reuse_envFalse
cicdTrue

Summary

94.6%OK
5.4%Known

Statistics

Units OK Fail XFail
Modules
1
1
Features
18
18
Scenarios
18
16
2
Steps
491
487
4

Known Fails

Test NameResultMessage
/engines/summing_merge_tree/clear column validation consistencyXFail 293ms
https://github.com/ClickHouse/ClickHouse/issues/101953 - fixed in >=26.6
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/regression.py", line 88, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/argparser.py", line 179, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/regression.py", line 79, in regression
    Feature(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../engines/tests/summing_merge_tree/summing_merge_tree.py", line 129, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../engines/tests/summing_merge_tree/summing_merge_tree.py", line 108, in clear_column_validation_consistency
    alter_table_clear_column_in_partition(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/alter/column.py", line 189, in alter_table_clear_column_in_partition
    node.query(query, **query_kwargs)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/cluster.py", line 1163, in query
    assert False, error(r.output)
           ^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 26.3.10):
Code: 524. DB::Exception: Received from localhost:9000. DB::Exception: Trying to ALTER DROP columns to sum (c) column. (ALTER_OF_COLUMN_IS_FORBIDDEN)
(query: ALTER TABLE summing_explicit_7d617cc4_5e90_11f1_adf3_12febaf30779 CLEAR COLUMN c IN PARTITION 1
)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/cluster.py', line 1163 in 'query'

1155\|                  assert message in r.output, error(r.output)
1156\|  
1157\|          if not ignore_exception:
1158\|              if message is None or "Exception:" not in message:
1159\|                  with Then("check if output has exception") if steps else NullStep():
1160\|                      if "Exception:" in r.output:
1161\|                          if raise_on_exception:
1162\|                              raise QueryRuntimeException(r.output)
1163\|>                         assert False, error(r.output)
1164\|  
1165\|          return r
1166\|
/engines/summing_merge_tree/zero row deletion with clear columnXFail 373ms
https://github.com/ClickHouse/ClickHouse/issues/101953 - fixed in >=26.6
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/regression.py", line 88, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/argparser.py", line 179, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/regression.py", line 79, in regression
    Feature(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../engines/tests/summing_merge_tree/summing_merge_tree.py", line 129, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../engines/tests/summing_merge_tree/summing_merge_tree.py", line 83, in zero_row_deletion_with_clear_column
    assert_row_count(node=node, table_name=name, rows=1)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/queries.py", line 182, in assert_row_count
    assert actual_count == rows, error()
           ^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert actual_count == rows, error()

Assertion values
  assert actual_count == rows, error()
         ^ is 2
  assert actual_count == rows, error()
                         ^ is 1
  assert actual_count == rows, error()
                      ^ is = False
  assert actual_count == rows, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/queries.py', line 182 in 'assert_row_count'

174\|  def assert_row_count(
175\|      self, table_name: str, rows: int, node: ClickHouseNode = None, timeout: int = 30
176\|  ) -> None:
177\|      """Assert that the number of rows in a table matches the expected value."""
178\|      if node is None:
179\|          node = self.context.node
180\|  
181\|      actual_count = get_row_count(node=node, table_name=table_name, timeout=timeout)
182\|>     assert actual_count == rows, error()
183\|  
184\|  
185\|  @TestStep

Results

Test Name Result Duration
/engines OK 6m 9s
/engines/replacing_merge_tree OK 4s 596ms
/engines/replacing_merge_tree/clean deleted rows with is deleted OK 517ms
/engines/replacing_merge_tree/clean deleted rows with is deleted/clean deleted rows with is deleted OK 516ms
/engines/replacing_merge_tree/clean deleted rows without is deleted OK 427ms
/engines/replacing_merge_tree/clean deleted rows without is deleted/clean deleted rows without is deleted OK 426ms
/engines/replacing_merge_tree/final OK 421ms
/engines/replacing_merge_tree/final/final OK 421ms
/engines/replacing_merge_tree/incorrect data insert OK 217ms
/engines/replacing_merge_tree/incorrect data insert/incorrect data insert OK 217ms
/engines/replacing_merge_tree/incorrect data insert with disabled optimize on insert OK 384ms
/engines/replacing_merge_tree/incorrect data insert with disabled optimize on insert/incorrect data insert with disabled optimize on insert OK 384ms
/engines/replacing_merge_tree/incorrect data type OK 114ms
/engines/replacing_merge_tree/incorrect data type/incorrect data type OK 113ms
/engines/replacing_merge_tree/update OK 446ms
/engines/replacing_merge_tree/update/update OK 444ms
/engines/replacing_merge_tree/update distributed OK 1s 204ms
/engines/replacing_merge_tree/update distributed/update distributed OK 1s 203ms
/engines/replacing_merge_tree/with is deleted OK 433ms
/engines/replacing_merge_tree/with is deleted/with is deleted OK 433ms
/engines/replacing_merge_tree/without is deleted OK 427ms
/engines/replacing_merge_tree/without is deleted/without is deleted OK 427ms
/engines/replicated_replacing_merge_tree OK 3s 951ms
/engines/replicated_replacing_merge_tree/update distributed OK 937ms
/engines/replicated_replacing_merge_tree/update distributed/update distributed OK 936ms
/engines/replicated_replacing_merge_tree/with is deleted OK 872ms
/engines/replicated_replacing_merge_tree/with is deleted/with is deleted OK 872ms
/engines/replicated_replacing_merge_tree/with is deleted distributed OK 870ms
/engines/replicated_replacing_merge_tree/with is deleted distributed/with is deleted distributed OK 870ms
/engines/replicated_replacing_merge_tree/without is deleted OK 511ms
/engines/replicated_replacing_merge_tree/without is deleted/without is deleted OK 510ms
/engines/replicated_replacing_merge_tree/without is deleted distributed OK 757ms
/engines/replicated_replacing_merge_tree/without is deleted distributed/without is deleted distributed OK 756ms
/engines/summing_merge_tree OK 1s 40ms
/engines/summing_merge_tree/clear column validation consistency XFail 293ms
/engines/summing_merge_tree/zero row deletion with clear column XFail 373ms
/engines/summing_merge_tree/zero row deletion with update OK 372ms

Generated by TestFlows Open-Source Test Framework v2.0.250110.1002922