Copyright 2025, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

S3 Test Run Report

DateApr 01, 2025 22:12
Duration2h 35m
Framework TestFlows 2.0.250110.1002922

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#708/12fb72fa077bd3f529f48fabb290d280d46348de/regression/aarch64/with_analyzer/zookeeper/without_thread_fuzzer/s3/gcs/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/PRs/708/12fb72fa077bd3f529f48fabb290d280d46348de/package_aarch64/clickhouse-common-static_24.12.2.20221.altinityantalya_arm64.deb
version24.12.2.20221.altinityantalya
user.nameianton-ru
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashbd31e738c0cedaca253d15a05ed245c41b6e0b6a
job.nameS3
job.retry1
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/14205957338
archaarch64
localTrue
clickhouse_versionNone
clickhouse_pathhttps://s3.amazonaws.com/altinity-build-artifacts/PRs/708/12fb72fa077bd3f529f48fabb290d280d46348de/package_aarch64/clickhouse-common-static_24.12.2.20221.altinityantalya_arm64.deb
as_binaryFalse
base_osNone
keeper_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerTrue
reuse_envFalse
storages['gcs']
minio_uriSecret(name='minio_uri')
minio_root_userSecret(name='minio_root_user')
minio_root_passwordSecret(name='minio_root_password')
aws_s3_bucketSecret(name='aws_s3_bucket')
aws_s3_regionSecret(name='aws_s3_region')
aws_s3_key_idSecret(name='aws_s3_key_id')
aws_s3_access_keySecret(name='aws_s3_access_key')
gcs_uriSecret(name='gcs_uri')
gcs_key_idSecret(name='gcs_key_id')
gcs_key_secretSecret(name='gcs_key_secret')
azure_account_nameSecret(name='azure_account_name')
azure_storage_keySecret(name='azure_storage_key')
azure_containerSecret(name='azure_container')

Summary

85.8%OK
10.9%Known

Statistics

Units Skip OK Fail Error XFail XError
Modules
1
1
Features
13
2
11
Scenarios
194
11
140
39
4
Checks
54
54
Examples
78
78
Steps
21493
30
21429
15
19

Known Fails

Test NameResultMessage
/s3/gcs/invalid table function/invalid pathXError 30s 47ms
https://github.com/ClickHouse/ClickHouse/issues/59084
ExpectTimeoutError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/venv/lib/python3.12/site-packages/testflows/uexpect/uexpect.py", line 223, in read
    d = self.queue.get(timeout=timeleft)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/venv/lib/python3.12/site-packages/testflows/uexpect/uexpect.py", line 187, in expect
    data = self.read(timeout=min(timeleft, 0.1), raise_exception=True)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/venv/lib/python3.12/site-packages/testflows/uexpect/uexpect.py", line 235, in read
    raise TimeoutError(timeout)
testflows.uexpect.uexpect.TimeoutError: Timeout 0.040s

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 694, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 666, in regression
    Feature(test=gcs_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 610, in gcs_regression
    Feature(test=load("s3.tests.table_function_invalid", "gcs"))(uri=uri)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/table_function_invalid.py", line 411, in gcs
    outline(uri=uri)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/table_function_invalid.py", line 395, in outline
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/table_function_invalid.py", line 114, in invalid_path
    insert_to_s3_function_invalid(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/table_function_invalid.py", line 34, in insert_to_s3_function_invalid
    node.query(query, message=message, exitcode=exitcode, timeout=timeout)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/cluster.py", line 1140, in query
    r = self.cluster.bash(self.name)(command, *args, **kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
testflows.uexpect.uexpect.ExpectTimeoutError: Timeout 30.000s for '(bash# )\|(\n)'
/s3/gcs/invalid table function/invalid wildcardXFail 1s 23ms
doesn't work <25.1 https://github.com/ClickHouse/ClickHouse/issues/75492
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 694, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 666, in regression
    Feature(test=gcs_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 610, in gcs_regression
    Feature(test=load("s3.tests.table_function_invalid", "gcs"))(uri=uri)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/table_function_invalid.py", line 411, in gcs
    outline(uri=uri)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/table_function_invalid.py", line 395, in outline
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/table_function_invalid.py", line 158, in invalid_wildcard
    insert_from_s3_function_invalid(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/table_function_invalid.py", line 66, in insert_from_s3_function_invalid
    node.query(query, message=message, exitcode=exitcode, timeout=timeout)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/cluster.py", line 1172, in query
    assert r.exitcode == exitcode, error(r.output)
           ^^^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r.exitcode == exitcode, error(r.output)

Assertion values
  assert r.exitcode == exitcode, error(r.output)
         ^ is 
  assert r.exitcode == exitcode, error(r.output)
         ^ is = 0
  assert r.exitcode == exitcode, error(r.output)
                       ^ is 243
  assert r.exitcode == exitcode, error(r.output)
                    ^ is = False
  assert r.exitcode == exitcode, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/cluster.py', line 1172 in 'query'

1164\|                      **kwargs,
1165\|                  )
1166\|  
1167\|          if no_checks:
1168\|              return r
1169\|  
1170\|          if exitcode is not None:
1171\|              with Then(f"exitcode should be {exitcode}") if steps else NullStep():
1172\|>                 assert r.exitcode == exitcode, error(r.output)
1173\|  
1174\|          if message is not None:
1175\|              with (
/s3/gcs/disk/cacheXFail 1ms
Under development for 22.8 and newer.
None
/s3/gcs/disk/cache defaultXFail 4ms
Under development for 22.8 and newer.
None
/s3/gcs/disk/cache pathXFail 943us
Under development for 22.8 and newer.
None
/s3/gcs/disk/low cardinality offsetXFail 54s 849ms
https://github.com/ClickHouse/ClickHouse/pull/44875
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 694, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 666, in regression
    Feature(test=gcs_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 611, in gcs_regression
    Feature(test=load("s3.tests.disk", "gcs"))(uri=uri, bucket_prefix=bucket_prefix)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2560, in gcs
    disk_tests(uri=uri, bucket_prefix=bucket_prefix)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2538, in disk_tests
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py", line 2500, in low_cardinality_offset
    assert output == "23999\n", error()
           ^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert output == "23999\n", error()

Assertion values
  assert output == "23999\n", error()
         ^ is '23999'
  assert output == "23999\n", error()
                ^ is = False

  assert output == "23999\n", error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/disk.py', line 2500 in 'low_cardinality_offset'

2492\|                      "1",
2493\|                  ),
2494\|                  (
2495\|                      "merge_tree_min_bytes_for_concurrent_read_for_remote_filesystem",
2496\|                      "1",
2497\|                  ),
2498\|              ],
2499\|          ).output
2500\|>         assert output == "23999\n", error()
2501\|  
2502\|  
2503\|  @TestFeature
/s3/gcs/disk/no restartXFail 2ms
https://github.com/ClickHouse/ClickHouse/issues/58924
None
/s3/gcs/invalid disk/cache path conflictXFail 2ms
Under development for 22.8 and newer.
None
/s3/gcs/combinatoric table/engine=VersionedCollapsingMergeTree,replicated=True,n_cols=2000,n_tables=3,part_type=wideXFail 4m 26s
Needs investigation, rows not appearing
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 694, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 666, in regression
    Feature(test=gcs_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 616, in gcs_regression
    Feature(test=load("s3.tests.combinatoric_table", "feature"))(uri=uri)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/combinatoric_table.py", line 182, in feature
    Scenario(title, test=check_table_combination)(**table_config)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/combinatoric_table.py", line 149, in check_table_combination
    retry(assert_row_count, timeout=60, delay=5)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py", line 1668, in assert_row_count
    assert rows == actual_count, error()
           ^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert rows == actual_count, error()

Assertion values
  assert rows == actual_count, error()
         ^ is 1500
  assert rows == actual_count, error()
                 ^ is 0
  assert rows == actual_count, error()
              ^ is = False
  assert rows == actual_count, error()
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/common.py', line 1668 in 'assert_row_count'

1660\|  
1661\|  @TestStep(Then)
1662\|  def assert_row_count(self, node, table_name: str, rows: int = 1000000):
1663\|      """Assert that the number of rows in a table is as expected."""
1664\|      if node is None:
1665\|          node = current().context.node
1666\|  
1667\|      actual_count = get_row_count(node=node, table_name=table_name)
1668\|>     assert rows == actual_count, error()
1669\|  
1670\|  
1671\|  @TestStep(Then)
/s3/gcs/combinatoric table/engine=AggregatingMergeTree,replicated=True,n_cols=2000,n_tables=3,part_type=compactXError 8m 2s
Times out, needs investigation
ExpectTimeoutError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/venv/lib/python3.12/site-packages/testflows/uexpect/uexpect.py", line 223, in read
    d = self.queue.get(timeout=timeleft)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/venv/lib/python3.12/site-packages/testflows/uexpect/uexpect.py", line 187, in expect
    data = self.read(timeout=min(timeleft, 0.1), raise_exception=True)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/venv/lib/python3.12/site-packages/testflows/uexpect/uexpect.py", line 235, in read
    raise TimeoutError(timeout)
testflows.uexpect.uexpect.TimeoutError: Timeout 0.100s

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 694, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 666, in regression
    Feature(test=gcs_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 616, in gcs_regression
    Feature(test=load("s3.tests.combinatoric_table", "feature"))(uri=uri)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/combinatoric_table.py", line 182, in feature
    Scenario(title, test=check_table_combination)(**table_config)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/combinatoric_table.py", line 117, in check_table_combination
    table = create_test_table(
            ^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/combinatoric_table.py", line 81, in create_test_table
    yield create_table(
          ^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/tables.py", line 482, in create_table
    node.query(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/cluster.py", line 1116, in query
    r = self.cluster.bash(None)(command, *args, **kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
testflows.uexpect.uexpect.ExpectTimeoutError: Timeout 300.000s for '(bash# )\|(\n)'
/s3/gcs/combinatoric table/engine=SummingMergeTree,replicated=True,n_cols=2000,n_tables=3,part_type=compactXError 8m 2s
Times out, needs investigation
ExpectTimeoutError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/venv/lib/python3.12/site-packages/testflows/uexpect/uexpect.py", line 223, in read
    d = self.queue.get(timeout=timeleft)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/venv/lib/python3.12/site-packages/testflows/uexpect/uexpect.py", line 187, in expect
    data = self.read(timeout=min(timeleft, 0.1), raise_exception=True)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/venv/lib/python3.12/site-packages/testflows/uexpect/uexpect.py", line 235, in read
    raise TimeoutError(timeout)
testflows.uexpect.uexpect.TimeoutError: Timeout 0.091s

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 694, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 666, in regression
    Feature(test=gcs_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 616, in gcs_regression
    Feature(test=load("s3.tests.combinatoric_table", "feature"))(uri=uri)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/combinatoric_table.py", line 182, in feature
    Scenario(title, test=check_table_combination)(**table_config)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/combinatoric_table.py", line 117, in check_table_combination
    table = create_test_table(
            ^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/combinatoric_table.py", line 81, in create_test_table
    yield create_table(
          ^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/tables.py", line 482, in create_table
    node.query(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/cluster.py", line 1116, in query
    r = self.cluster.bash(None)(command, *args, **kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
testflows.uexpect.uexpect.ExpectTimeoutError: Timeout 300.000s for '(bash# )\|(\n)'
/s3/gcs/combinatoric table/engine=MergeTree,replicated=True,n_cols=10,n_tables=3,part_type=unspecifiedXError 7m 48s
Times out, needs investigation
ExpectTimeoutError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/venv/lib/python3.12/site-packages/testflows/uexpect/uexpect.py", line 223, in read
    d = self.queue.get(timeout=timeleft)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/venv/lib/python3.12/site-packages/testflows/uexpect/uexpect.py", line 187, in expect
    data = self.read(timeout=min(timeleft, 0.1), raise_exception=True)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/venv/lib/python3.12/site-packages/testflows/uexpect/uexpect.py", line 235, in read
    raise TimeoutError(timeout)
testflows.uexpect.uexpect.TimeoutError: Timeout 0.089s

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 694, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/argparser.py", line 348, in capture_s3_args
    return func(self, s3_args=s3_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 666, in regression
    Feature(test=gcs_regression)(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/regression.py", line 616, in gcs_regression
    Feature(test=load("s3.tests.combinatoric_table", "feature"))(uri=uri)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/combinatoric_table.py", line 182, in feature
    Scenario(title, test=check_table_combination)(**table_config)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/combinatoric_table.py", line 117, in check_table_combination
    table = create_test_table(
            ^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../s3/tests/combinatoric_table.py", line 81, in create_test_table
    yield create_table(
          ^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/tables.py", line 482, in create_table
    node.query(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/s3/../helpers/cluster.py", line 1140, in query
    r = self.cluster.bash(self.name)(command, *args, **kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
testflows.uexpect.uexpect.ExpectTimeoutError: Timeout 300.000s for '(bash# )\|(\n)'

Results

Test Name Result Duration
/s3 OK 2h 35m
/s3/gcs OK 2h 35m
/s3/gcs/sanity OK 1m 9s
/s3/gcs/sanity/sanity OK 19s 34ms
/s3/gcs/table function OK 1m 45s
/s3/gcs/table function/auto OK 9s 67ms
/s3/gcs/table function/compression OK 9s 506ms
/s3/gcs/table function/credentials OK 886ms
/s3/gcs/table function/data format OK 15s 66ms
/s3/gcs/table function/measure file size Skip 1ms
/s3/gcs/table function/multipart OK 7s 950ms
/s3/gcs/table function/multiple columns OK 1s 285ms
/s3/gcs/table function/partition OK 1s 239ms
/s3/gcs/table function/remote host filter OK 49s 866ms
/s3/gcs/table function/syntax OK 1s 0ms
/s3/gcs/table function/wildcard OK 7s 625ms
/s3/gcs/invalid table function OK 34s 885ms
/s3/gcs/invalid table function/empty path OK 272ms
/s3/gcs/invalid table function/empty structure OK 262ms
/s3/gcs/invalid table function/invalid bucket OK 235ms
/s3/gcs/invalid table function/invalid compression OK 259ms
/s3/gcs/invalid table function/invalid credentials OK 526ms
/s3/gcs/invalid table function/invalid format OK 518ms
/s3/gcs/invalid table function/invalid path XError 30s 47ms
/s3/gcs/invalid table function/invalid region Skip 882us
/s3/gcs/invalid table function/invalid structure OK 1s 711ms
/s3/gcs/invalid table function/invalid wildcard XFail 1s 23ms
/s3/gcs/disk OK 41m 8s
/s3/gcs/disk/access OK 52s 331ms
/s3/gcs/disk/access skip check OK 50s 27ms
/s3/gcs/disk/add storage OK 1m 42s
/s3/gcs/disk/alter move OK 1m 1s
/s3/gcs/disk/alter on cluster modify ttl OK 1m 56s
/s3/gcs/disk/cache XFail 1ms
/s3/gcs/disk/cache default XFail 4ms
/s3/gcs/disk/cache path XFail 943us
/s3/gcs/disk/compact parts OK 51s 902ms
/s3/gcs/disk/config over restart OK 1m 20s
/s3/gcs/disk/default move factor OK 1m 30s
/s3/gcs/disk/delete OK 3m 30s
/s3/gcs/disk/download appropriate disk OK 1m 28s
/s3/gcs/disk/drop sync OK 58s 973ms
/s3/gcs/disk/environment credentials Skip 2ms
/s3/gcs/disk/exports OK 55s 131ms
/s3/gcs/disk/generic url Skip 1ms
/s3/gcs/disk/imports OK 57s 90ms
/s3/gcs/disk/log OK 3m 16s
/s3/gcs/disk/low cardinality offset XFail 54s 849ms
/s3/gcs/disk/max single part upload size syntax OK 53s 938ms
/s3/gcs/disk/mergetree OK 4m 14s
/s3/gcs/disk/mergetree collapsing OK 59s 580ms
/s3/gcs/disk/mergetree versionedcollapsing OK 1m 2s
/s3/gcs/disk/metadata OK 59s 853ms
/s3/gcs/disk/min bytes for seek syntax OK 54s 743ms
/s3/gcs/disk/multiple storage OK 1m 2s
/s3/gcs/disk/multiple storage query OK 1m 2s
/s3/gcs/disk/no restart XFail 2ms
/s3/gcs/disk/perform ttl move on insert OK 1m 48s
/s3/gcs/disk/perform ttl move on insert default OK 1m 6s
/s3/gcs/disk/performance ttl move OK 1m 15s
/s3/gcs/disk/remote host filter OK 1m 44s
/s3/gcs/disk/specific url Skip 1ms
/s3/gcs/disk/syntax OK 1m 1s
/s3/gcs/disk/wide parts OK 52s 238ms
/s3/gcs/invalid disk OK 3m 55s
/s3/gcs/invalid disk/access default OK 12s 724ms
/s3/gcs/invalid disk/access failed OK 13s 738ms
/s3/gcs/invalid disk/access failed skip check OK 50s 756ms
/s3/gcs/invalid disk/cache path conflict XFail 2ms
/s3/gcs/invalid disk/empty endpoint OK 10s 728ms
/s3/gcs/invalid disk/invalid endpoint OK 2m 5s
/s3/gcs/invalid disk/invalid type OK 21s 412ms
/s3/gcs/alter OK 16m 42s
/s3/gcs/alter/normal OK 4m 4s
/s3/gcs/alter/normal/attach from OK 14s 327ms
/s3/gcs/alter/normal/columns OK 12s 624ms
/s3/gcs/alter/normal/detach OK 25s 846ms
/s3/gcs/alter/normal/drop OK 54s 95ms
/s3/gcs/alter/normal/fetch OK 31s 279ms
/s3/gcs/alter/normal/freeze OK 23s 13ms
/s3/gcs/alter/normal/index OK 10s 748ms
/s3/gcs/alter/normal/move to table OK 18s 896ms
/s3/gcs/alter/normal/order by OK 7s 451ms
/s3/gcs/alter/normal/projection OK 12s 128ms
/s3/gcs/alter/normal/replace OK 18s 193ms
/s3/gcs/alter/normal/sample by OK 7s 560ms
/s3/gcs/alter/normal/update delete OK 8s 550ms
/s3/gcs/alter/encrypted OK 5m 32s
/s3/gcs/alter/encrypted/attach from OK 17s 578ms
/s3/gcs/alter/encrypted/columns OK 18s 932ms
/s3/gcs/alter/encrypted/detach OK 38s 207ms
/s3/gcs/alter/encrypted/drop OK 1m 11s
/s3/gcs/alter/encrypted/fetch OK 37s 591ms
/s3/gcs/alter/encrypted/freeze OK 31s 901ms
/s3/gcs/alter/encrypted/index OK 15s 804ms
/s3/gcs/alter/encrypted/move to table OK 29s 681ms
/s3/gcs/alter/encrypted/order by OK 8s 532ms
/s3/gcs/alter/encrypted/projection OK 17s 787ms
/s3/gcs/alter/encrypted/replace OK 20s 764ms
/s3/gcs/alter/encrypted/sample by OK 8s 468ms
/s3/gcs/alter/encrypted/update delete OK 15s 490ms
/s3/gcs/alter/zero copy OK 2m 13s
/s3/gcs/alter/zero copy/attach from OK 13s 606ms
/s3/gcs/alter/zero copy/columns OK 12s 546ms
/s3/gcs/alter/zero copy/detach Skip 1ms
/s3/gcs/alter/zero copy/drop Skip 1ms
/s3/gcs/alter/zero copy/fetch Skip 937us
/s3/gcs/alter/zero copy/freeze OK 22s 661ms
/s3/gcs/alter/zero copy/index OK 10s 932ms
/s3/gcs/alter/zero copy/move to table OK 18s 680ms
/s3/gcs/alter/zero copy/order by OK 7s 643ms
/s3/gcs/alter/zero copy/projection OK 12s 632ms
/s3/gcs/alter/zero copy/replace OK 18s 178ms
/s3/gcs/alter/zero copy/sample by OK 7s 563ms
/s3/gcs/alter/zero copy/update delete OK 8s 947ms
/s3/gcs/alter/zero copy encrypted OK 3m 11s
/s3/gcs/alter/zero copy encrypted/attach from OK 16s 224ms
/s3/gcs/alter/zero copy encrypted/columns OK 18s 602ms
/s3/gcs/alter/zero copy encrypted/detach Skip 1ms
/s3/gcs/alter/zero copy encrypted/drop Skip 1ms
/s3/gcs/alter/zero copy encrypted/fetch Skip 1ms
/s3/gcs/alter/zero copy encrypted/freeze OK 31s 752ms
/s3/gcs/alter/zero copy encrypted/index OK 16s 152ms
/s3/gcs/alter/zero copy encrypted/move to table OK 30s 630ms
/s3/gcs/alter/zero copy encrypted/order by OK 8s 728ms
/s3/gcs/alter/zero copy encrypted/projection OK 17s 900ms
/s3/gcs/alter/zero copy encrypted/replace OK 28s 328ms
/s3/gcs/alter/zero copy encrypted/sample by OK 8s 497ms
/s3/gcs/alter/zero copy encrypted/update delete OK 15s 51ms
/s3/gcs/combinatoric table OK 42m 56s
/s3/gcs/combinatoric table/engine=MergeTree,replicated=True,n_cols=2000,n_tables=3,part_type=compact OK 45s 814ms
/s3/gcs/combinatoric table/engine=MergeTree,replicated=False,n_cols=500,n_tables=1,part_type=wide OK 5m 8s
/s3/gcs/combinatoric table/engine=ReplacingMergeTree,replicated=True,n_cols=500,n_tables=3,part_type=unspecified OK 1m 20s
/s3/gcs/combinatoric table/engine=ReplacingMergeTree,replicated=False,n_cols=2000,n_tables=1,part_type=compact OK 7s 880ms
/s3/gcs/combinatoric table/engine=CollapsingMergeTree,replicated=True,n_cols=10,n_tables=1,part_type=wide OK 27s 355ms
/s3/gcs/combinatoric table/engine=CollapsingMergeTree,replicated=False,n_cols=2000,n_tables=3,part_type=unspecified OK 23s 425ms
/s3/gcs/combinatoric table/engine=VersionedCollapsingMergeTree,replicated=True,n_cols=2000,n_tables=3,part_type=wide XFail 4m 26s
/s3/gcs/combinatoric table/engine=VersionedCollapsingMergeTree,replicated=False,n_cols=10,n_tables=3,part_type=compact OK 13s 495ms
/s3/gcs/combinatoric table/engine=AggregatingMergeTree,replicated=True,n_cols=2000,n_tables=3,part_type=compact XError 8m 2s
/s3/gcs/combinatoric table/engine=AggregatingMergeTree,replicated=False,n_cols=500,n_tables=1,part_type=unspecified OK 7s 594ms
/s3/gcs/combinatoric table/engine=SummingMergeTree,replicated=True,n_cols=2000,n_tables=3,part_type=compact XError 8m 2s
/s3/gcs/combinatoric table/engine=SummingMergeTree,replicated=False,n_cols=500,n_tables=1,part_type=compact OK 7s 361ms
/s3/gcs/combinatoric table/engine=MergeTree,replicated=True,n_cols=10,n_tables=3,part_type=unspecified XError 7m 48s
/s3/gcs/combinatoric table/engine=ReplacingMergeTree,replicated=True,n_cols=10,n_tables=3,part_type=wide OK 1m 17s
/s3/gcs/combinatoric table/engine=CollapsingMergeTree,replicated=True,n_cols=500,n_tables=3,part_type=compact OK 43s 555ms
/s3/gcs/combinatoric table/engine=VersionedCollapsingMergeTree,replicated=True,n_cols=500,n_tables=1,part_type=unspecified OK 14s 777ms
/s3/gcs/combinatoric table/engine=AggregatingMergeTree,replicated=True,n_cols=10,n_tables=3,part_type=wide OK 1m 17s
/s3/gcs/combinatoric table/engine=SummingMergeTree,replicated=True,n_cols=10,n_tables=3,part_type=wide OK 1m 17s
/s3/gcs/combinatoric table/engine=SummingMergeTree,replicated=True,n_cols=10,n_tables=1,part_type=unspecified OK 12s 1ms
/s3/gcs/zero copy replication Skip 2ms
/s3/gcs/backup OK 3m 29s
/s3/gcs/backup/local and s3 disk OK 1m 9s
/s3/gcs/backup/local and s3 volumes OK 1m 4s
/s3/gcs/backup/s3 disk OK 1m 14s
/s3/gcs/orphans Skip 1ms
/s3/gcs/settings OK 29m 37s
/s3/gcs/settings/setting combinations OK 28m 44s
/s3/gcs/table function performance OK 10m 16s
/s3/gcs/table function performance/setup OK 786ms
/s3/gcs/table function performance/wildcard OK 10m 15s

Generated by TestFlows Open-Source Test Framework v2.0.250110.1002922