Engines Test Run Report

DateAug 22, 2026 6:46
Duration8m 41s
Framework TestFlows 2.0.250110.1002922

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#REFs/antalya-25.8/9a0a892f662ee32f81183f3866f05ea646540e3d/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
user.namezvonand
version25.8.30.20001.altinityantalya
packagehttps://altinity-build-artifacts.s3.amazonaws.com/REFs/antalya-25.8/9a0a892f662ee32f81183f3866f05ea646540e3d/build_arm_binary/clickhouse
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashf0303a396f45c3eb19267322977aed77b3a918b5
job.nameengines
job.retry1
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/32553110256
archaarch64
localTrue
clickhouse_versionNone
clickhouse_pathhttps://altinity-build-artifacts.s3.amazonaws.com/REFs/antalya-25.8/9a0a892f662ee32f81183f3866f05ea646540e3d/build_arm_binary/clickhouse
as_binaryFalse
base_osNone
keeper_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerTrue
reuse_envFalse
cicdTrue
use_casFalse

Summary

94.6%OK
5.4%Known

Statistics

Units OK Fail XFail
Modules
1
1
Features
18
18
Scenarios
18
16
2
Steps
492
488
4

Known Fails

Test NameResultMessage
/engines/summing_merge_tree/clear column validation consistencyXFail 739ms
https://github.com/ClickHouse/ClickHouse/issues/101953 - fixed in >=26.6
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/regression.py", line 113, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/argparser.py", line 180, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/regression.py", line 104, in regression
    Feature(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../engines/tests/summing_merge_tree/summing_merge_tree.py", line 129, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../engines/tests/summing_merge_tree/summing_merge_tree.py", line 108, in clear_column_validation_consistency
    alter_table_clear_column_in_partition(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/alter/column.py", line 189, in alter_table_clear_column_in_partition
    node.query(query, **query_kwargs)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/cluster.py", line 1289, in query
    assert False, error(r.output)
           ^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Received exception from server (version 25.8.30):
Code: 524. DB::Exception: Received from localhost:9000. DB::Exception: Trying to ALTER DROP columns to sum (c) column. (ALTER_OF_COLUMN_IS_FORBIDDEN)
(query: ALTER TABLE summing_explicit_5df9577f_9df6_11f1_b100_de000130a9dd CLEAR COLUMN c IN PARTITION 1
)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/cluster.py', line 1289 in 'query'

1281\|                  assert message in r.output, error(r.output)
1282\|  
1283\|          if not ignore_exception:
1284\|              if message is None or "Exception:" not in message:
1285\|                  with Then("check if output has exception") if steps else NullStep():
1286\|                      if "Exception:" in r.output:
1287\|                          if raise_on_exception:
1288\|                              raise QueryRuntimeException(r.output)
1289\|>                         assert False, error(r.output)
1290\|  
1291\|          return r
1292\|
/engines/summing_merge_tree/zero row deletion with clear columnXFail 803ms
https://github.com/ClickHouse/ClickHouse/issues/101953 - fixed in >=26.6
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/regression.py", line 113, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/argparser.py", line 180, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/regression.py", line 104, in regression
    Feature(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../engines/tests/summing_merge_tree/summing_merge_tree.py", line 129, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../engines/tests/summing_merge_tree/summing_merge_tree.py", line 83, in zero_row_deletion_with_clear_column
    assert_row_count(node=node, table_name=name, rows=1)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/queries.py", line 186, in assert_row_count
    assert actual_count == rows, error()
           ^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert actual_count == rows, error()

Assertion values
  assert actual_count == rows, error()
         ^ is 2
  assert actual_count == rows, error()
                         ^ is 1
  assert actual_count == rows, error()
                      ^ is = False
  assert actual_count == rows, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/engines/../helpers/queries.py', line 186 in 'assert_row_count'

178\|  def assert_row_count(
179\|      self, table_name: str, rows: int, node: ClickHouseNode = None, timeout: int = 30
180\|  ) -> None:
181\|      """Assert that the number of rows in a table matches the expected value."""
182\|      if node is None:
183\|          node = self.context.node
184\|  
185\|      actual_count = get_row_count(node=node, table_name=table_name, timeout=timeout)
186\|>     assert actual_count == rows, error()
187\|  
188\|  
189\|  @TestStep

Results

Test Name Result Duration
/engines OK 8m 41s
/engines/replacing_merge_tree OK 10s 171ms
/engines/replacing_merge_tree/clean deleted rows with is deleted OK 1s 198ms
/engines/replacing_merge_tree/clean deleted rows with is deleted/clean deleted rows with is deleted OK 1s 196ms
/engines/replacing_merge_tree/clean deleted rows without is deleted OK 979ms
/engines/replacing_merge_tree/clean deleted rows without is deleted/clean deleted rows without is deleted OK 976ms
/engines/replacing_merge_tree/final OK 1s 205ms
/engines/replacing_merge_tree/final/final OK 1s 203ms
/engines/replacing_merge_tree/incorrect data insert OK 449ms
/engines/replacing_merge_tree/incorrect data insert/incorrect data insert OK 448ms
/engines/replacing_merge_tree/incorrect data insert with disabled optimize on insert OK 905ms
/engines/replacing_merge_tree/incorrect data insert with disabled optimize on insert/incorrect data insert with disabled optimize on insert OK 904ms
/engines/replacing_merge_tree/incorrect data type OK 284ms
/engines/replacing_merge_tree/incorrect data type/incorrect data type OK 282ms
/engines/replacing_merge_tree/update OK 764ms
/engines/replacing_merge_tree/update/update OK 762ms
/engines/replacing_merge_tree/update distributed OK 2s 511ms
/engines/replacing_merge_tree/update distributed/update distributed OK 2s 510ms
/engines/replacing_merge_tree/with is deleted OK 925ms
/engines/replacing_merge_tree/with is deleted/with is deleted OK 923ms
/engines/replacing_merge_tree/without is deleted OK 936ms
/engines/replacing_merge_tree/without is deleted/without is deleted OK 934ms
/engines/replicated_replacing_merge_tree OK 8s 587ms
/engines/replicated_replacing_merge_tree/update distributed OK 2s 217ms
/engines/replicated_replacing_merge_tree/update distributed/update distributed OK 2s 215ms
/engines/replicated_replacing_merge_tree/with is deleted OK 1s 888ms
/engines/replicated_replacing_merge_tree/with is deleted/with is deleted OK 1s 886ms
/engines/replicated_replacing_merge_tree/with is deleted distributed OK 1s 773ms
/engines/replicated_replacing_merge_tree/with is deleted distributed/with is deleted distributed OK 1s 771ms
/engines/replicated_replacing_merge_tree/without is deleted OK 1s 129ms
/engines/replicated_replacing_merge_tree/without is deleted/without is deleted OK 1s 127ms
/engines/replicated_replacing_merge_tree/without is deleted distributed OK 1s 573ms
/engines/replicated_replacing_merge_tree/without is deleted distributed/without is deleted distributed OK 1s 572ms
/engines/summing_merge_tree OK 2s 344ms
/engines/summing_merge_tree/clear column validation consistency XFail 739ms
/engines/summing_merge_tree/zero row deletion with clear column XFail 803ms
/engines/summing_merge_tree/zero row deletion with update OK 798ms

Generated by TestFlows Open-Source Test Framework v2.0.250110.1002922