Dns Test Run Report

DateJul 23, 2026 18:19
Duration5m 25s
Framework TestFlows 2.0.250110.1002922

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#REFs/stable-25.8/568824f4327b379e86bce93f12b9cebe0cfd9ff5/regression/

Attributes

projectAltinity/ClickHouse
project.id159717931
user.namemkmkme
version25.8.28.10001.altinitytest
packagehttps://altinity-build-artifacts.s3.amazonaws.com/REFs/stable-25.8/568824f4327b379e86bce93f12b9cebe0cfd9ff5/build_arm_binary/clickhouse
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hash4d525637d2f2b663511096026f26fbf5220aa19c
job.namedns
job.retry1
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/30019476182
archaarch64
localTrue
clickhouse_versionNone
clickhouse_pathhttps://altinity-build-artifacts.s3.amazonaws.com/REFs/stable-25.8/568824f4327b379e86bce93f12b9cebe0cfd9ff5/build_arm_binary/clickhouse
as_binaryFalse
base_osNone
keeper_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerTrue
reuse_envFalse
cicdTrue

Summary

83.3%OK
16.7%Known

Statistics

Units OK Fail XFail
Modules
1
1
Features
1
1
Scenarios
4
3
1
Steps
119
117
2

Known Fails

Test NameResultMessage
/dns/lookupXFail 31s 284ms
https://github.com/ClickHouse/ClickHouse/issues/17202
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/regression.py", line 60, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../helpers/argparser.py", line 180, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/regression.py", line 55, in regression
    Scenario(run=load("dns.tests.lookup.scenario", "scenario"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../dns/tests/lookup/scenario.py", line 58, in scenario
    cluster.command(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../helpers/cluster.py", line 2369, in command
    assert r.exitcode == exitcode, error(r.output)
           ^^^^^^^^^^^^^^^^^^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert r.exitcode == exitcode, error(r.output)

Description
  Bash: regression/dns/tests/lookup/example.com: No such file or directory

Assertion values
  assert r.exitcode == exitcode, error(r.output)
         ^ is 
  assert r.exitcode == exitcode, error(r.output)
         ^ is = 1
  assert r.exitcode == exitcode, error(r.output)
                       ^ is 0
  assert r.exitcode == exitcode, error(r.output)
                    ^ is = False
  assert r.exitcode == exitcode, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/dns/../helpers/cluster.py', line 2369 in 'command'

2361\|                  Then(f"exitcode should be {exitcode}", format_name=False)
2362\|                  if steps
2363\|                  else NullStep()
2364\|              ):
2365\|                  if str(exitcode).startswith("!="):
2366\|                      exitcode = int(str(exitcode).split("!=", 1)[-1].strip())
2367\|                      assert r.exitcode != exitcode, error(r.output)
2368\|                  else:
2369\|>                     assert r.exitcode == exitcode, error(r.output)
2370\|  
2371\|          if messages is None:
2372\|              messages = []

Results

Test Name Result Duration
/dns OK 5m 25s
/dns/lookup XFail 31s 284ms
/dns/ipv6 OK 316ms
/dns/ipv6/Test host regexp multiple ptr v4 fails with wrong resolution OK 172ms
/dns/ipv6/Test host regexp multiple ptr v4 OK 69ms
/dns/ipv6/Test host regexp multiple ptr v6 OK 67ms

Generated by TestFlows Open-Source Test Framework v2.0.250110.1002922