Copyright 2025, Altinity Inc.. All Rights Reserved. All information contained herein is, and remains the property of Altinity Inc.. Any dissemination of this information or reproduction of this material is strictly forbidden unless prior written permission is obtained from Altinity Inc..

External User Directory Test Run Report

DateJun 27, 2025 14:23
Duration34m 39s
Framework TestFlows 2.0.250110.1002922

Artifacts

Test artifacts can be found at https://altinity-build-artifacts.s3.amazonaws.com/index.html#0/d1f73c287081665b9e9ca2767a633a3cc8a41f08/regression/aarch64/with_analyzer/zookeeper/without_thread_fuzzer/ldap/external_user_directory/

Attributes

projectAltinity/ClickHouse
project.id159717931
packagehttps://s3.amazonaws.com/altinity-build-artifacts/24.8/d1f73c287081665b9e9ca2767a633a3cc8a41f08/package_aarch64/clickhouse-common-static_24.8.14.10501.altinitytest_arm64.deb
version24.8.14.10501.altinitytest
user.nameEnmk
repositoryhttps://github.com/Altinity/clickhouse-regression
commit.hashe3c00be97a045aa04e9d1a6ec50cc64f4c387b70
job.nameLDAP
job.retry1
job.urlhttps://github.com/Altinity/ClickHouse/actions/runs/15925737638
archaarch64
localTrue
clickhouse_versionNone
clickhouse_pathhttps://s3.amazonaws.com/altinity-build-artifacts/24.8/d1f73c287081665b9e9ca2767a633a3cc8a41f08/package_aarch64/clickhouse-common-static_24.8.14.10501.altinitytest_arm64.deb
as_binaryFalse
base_osNone
keeper_pathNone
zookeeper_versionNone
use_keeperFalse
stressFalse
collect_service_logsTrue
thread_fuzzerFalse
with_analyzerTrue
reuse_envFalse

Summary

92.8%OK
7.2%Known

Statistics

Units OK Fail Error XFail
Features
7
7
Scenarios
83
79
4
Examples
21
17
4
Steps
6092
6074
12
6

Known Fails

Test NameResultMessage
/external user directory/restart/parallel loginXFail 2ms
fails on 22.3
None
/external user directory/connection protocols/tls cipher suiteXFail 23s 926ms
can't get it to work
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/ldap/external_user_directory/regression.py", line 130, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/ldap/external_user_directory/../../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/ldap/external_user_directory/regression.py", line 124, in regression
    Feature(run=load("ldap.external_user_directory.tests.connections", "feature"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/ldap/external_user_directory/../../ldap/external_user_directory/tests/connections.py", line 323, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/ldap/external_user_directory/../../ldap/external_user_directory/tests/connections.py", line 266, in tls_cipher_suite
    login(servers, "openldap4", *users)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/ldap/external_user_directory/../../ldap/external_user_directory/tests/common.py", line 269, in login
    current().context.node.query(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/ldap/external_user_directory/../../helpers/cluster.py", line 1188, in query
    assert False, error(r.output)
           ^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Code: 516. DB::Exception: Received from localhost:9000. DB::Exception: user4: Authentication failed: password is incorrect, or there is no user with such name.. (AUTHENTICATION_FAILED)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/ldap/external_user_directory/../../helpers/cluster.py', line 1188 in 'query'

1180\|                  assert message in r.output, error(r.output)
1181\|  
1182\|          if not ignore_exception:
1183\|              if message is None or "Exception:" not in message:
1184\|                  with Then("check if output has exception") if steps else NullStep():
1185\|                      if "Exception:" in r.output:
1186\|                          if raise_on_exception:
1187\|                              raise QueryRuntimeException(r.output)
1188\|>                         assert False, error(r.output)
1189\|  
1190\|          return r
1191\|
/external user directory/connection protocols/tls require cert default demandXFail 23s 547ms
can't be tested with self-signed certificates
AssertionError
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/ldap/external_user_directory/regression.py", line 130, in 
    regression()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/ldap/external_user_directory/../../helpers/argparser.py", line 171, in capture_cluster_args
    return func(self, cluster_args=cluster_args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/ldap/external_user_directory/regression.py", line 124, in regression
    Feature(run=load("ldap.external_user_directory.tests.connections", "feature"))
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/ldap/external_user_directory/../../ldap/external_user_directory/tests/connections.py", line 323, in feature
    scenario()
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/ldap/external_user_directory/../../ldap/external_user_directory/tests/connections.py", line 219, in tls_require_cert_default_demand
    login(servers, "openldap2", *users)
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/ldap/external_user_directory/../../ldap/external_user_directory/tests/common.py", line 269, in login
    current().context.node.query(
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/ldap/external_user_directory/../../helpers/cluster.py", line 1188, in query
    assert False, error(r.output)
           ^^^^^
AssertionError: Oops! Assertion failed

The following assertion was not satisfied
  assert False, error(r.output)

Description
  Code: 516. DB::Exception: Received from localhost:9000. DB::Exception: user2: Authentication failed: password is incorrect, or there is no user with such name.. (AUTHENTICATION_FAILED)

Assertion values
  assert False, error(r.output)
  ^ is False

Where
  File '/home/ubuntu/_work/ClickHouse/ClickHouse/ldap/external_user_directory/../../helpers/cluster.py', line 1188 in 'query'

1180\|                  assert message in r.output, error(r.output)
1181\|  
1182\|          if not ignore_exception:
1183\|              if message is None or "Exception:" not in message:
1184\|                  with Then("check if output has exception") if steps else NullStep():
1185\|                      if "Exception:" in r.output:
1186\|                          if raise_on_exception:
1187\|                              raise QueryRuntimeException(r.output)
1188\|>                         assert False, error(r.output)
1189\|  
1190\|          return r
1191\|
/external user directory/roles/not present role addedXFail 1ms
roles are not being applied to active clickhouse-client connections in 23.8 
None

Results

Test Name Result Duration
/external user directory OK 34m 39s
/external user directory/sanity OK 1s 732ms
/external user directory/simple OK 22s 977ms
/external user directory/restart OK 1m 42s
/external user directory/restart/dynamically added users OK 35s 798ms
/external user directory/restart/multiple external user directories OK 33s 167ms
/external user directory/restart/one external user directory OK 33s 249ms
/external user directory/restart/parallel login XFail 2ms
/external user directory/server config OK 3m 40s
/external user directory/server config/auth dn value OK 23s 699ms
/external user directory/server config/empty ca cert dir OK 22s 523ms
/external user directory/server config/empty ca cert file OK 22s 641ms
/external user directory/server config/empty host OK 2s 106ms
/external user directory/server config/empty server name OK 2s 104ms
/external user directory/server config/invalid auth dn prefix OK 23s 880ms
/external user directory/server config/invalid auth dn suffix OK 24s 175ms
/external user directory/server config/invalid enable tls value OK 2s 124ms
/external user directory/server config/invalid host OK 24s 308ms
/external user directory/server config/invalid port OK 24s 421ms
/external user directory/server config/invalid tls require cert value OK 24s 285ms
/external user directory/server config/invalid verification cooldown value OK 11s 755ms
/external user directory/server config/missing host OK 6s 332ms
/external user directory/server config/syntax OK 6s 254ms
/external user directory/external user directory config OK 3m 32s
/external user directory/external user directory config/defined twice roles OK 24s 592ms
/external user directory/external user directory config/defined twice server OK 23s 853ms
/external user directory/external user directory config/empty roles OK 22s 924ms
/external user directory/external user directory config/empty server OK 23s 787ms
/external user directory/external user directory config/invalid role in roles OK 22s 746ms
/external user directory/external user directory config/invalid server OK 23s 830ms
/external user directory/external user directory config/missing roles OK 22s 839ms
/external user directory/external user directory config/missing server OK 23s 833ms
/external user directory/external user directory config/more than one user directory OK 23s 936ms
/external user directory/connection protocols OK 8m 11s
/external user directory/connection protocols/plain text OK 23s 879ms
/external user directory/connection protocols/plain text with custom port OK 24s 11ms
/external user directory/connection protocols/starttls OK 1m 36s
/external user directory/connection protocols/starttls with custom port OK 24s 342ms
/external user directory/connection protocols/tls OK 1m 39s
/external user directory/connection protocols/tls cipher suite XFail 23s 926ms
/external user directory/connection protocols/tls enable tls default yes OK 25s 159ms
/external user directory/connection protocols/tls minimum protocol version OK 2m 4s
/external user directory/connection protocols/tls require cert default demand XFail 23s 547ms
/external user directory/connection protocols/tls with custom port OK 25s 431ms
/external user directory/user authentications OK 13m 6s
/external user directory/user authentications/empty username and empty password OK 137ms
/external user directory/user authentications/invalid long username and valid short password OK 214ms
/external user directory/user authentications/invalid username and valid password OK 170ms
/external user directory/user authentications/login after clickhouse server is restarted OK 15s 0ms
/external user directory/user authentications/login after ldap server is restarted OK 3s 900ms
/external user directory/user authentications/login after user cn changed in ldap OK 280ms
/external user directory/user authentications/login after user is added to ldap OK 196ms
/external user directory/user authentications/login after user is deleted from ldap OK 274ms
/external user directory/user authentications/login after user password changed in ldap OK 394ms
/external user directory/user authentications/parallel login OK 31s 736ms
/external user directory/user authentications/parallel login with rbac users OK 32s 981ms
/external user directory/user authentications/parallel login with the same user OK 32s 521ms
/external user directory/user authentications/user lookup priority OK 619ms
/external user directory/user authentications/valid ascii username and utf8 password OK 189ms
/external user directory/user authentications/valid long username and short password OK 177ms
/external user directory/user authentications/valid short username and invalid long password OK 155ms
/external user directory/user authentications/valid short username and long password OK 174ms
/external user directory/user authentications/valid username and invalid empty password OK 142ms
/external user directory/user authentications/valid username and invalid password OK 133ms
/external user directory/user authentications/valid username and password OK 183ms
/external user directory/user authentications/valid username and password invalid server OK 62ms
/external user directory/user authentications/valid username with valid empty password OK 158ms
/external user directory/user authentications/valid utf8 username and ascii password OK 186ms
/external user directory/user authentications/login after ldap external user directory is removed OK 16s 862ms
/external user directory/user authentications/parallel login with multiple servers OK 1m 25s
/external user directory/user authentications/parallel login with rbac and multiple servers OK 1m 52s
/external user directory/user authentications/parallel login with the same user multiple servers OK 52s 878ms
/external user directory/user authentications/default verification cooldown value OK 24s 506ms
/external user directory/user authentications/verification cooldown reset when invalid password is provided OK 24s 708ms
/external user directory/user authentications/valid verification cooldown value cn change OK 27s 945ms
/external user directory/user authentications/valid verification cooldown value ldap unavailable OK 30s 97ms
/external user directory/user authentications/valid verification cooldown value password change OK 26s 822ms
/external user directory/user authentications/verification cooldown performance OK 2m 10s
/external user directory/user authentications/verification cooldown reset on server auth dn prefix parameter change OK 28s 183ms
/external user directory/user authentications/verification cooldown reset on server auth dn suffix parameter change OK 27s 67ms
/external user directory/user authentications/verification cooldown reset on server host parameter change OK 26s 829ms
/external user directory/user authentications/verification cooldown reset on server port parameter change OK 26s 967ms
/external user directory/roles OK 1m 57s
/external user directory/roles/add privilege OK 20s 96ms
/external user directory/roles/new role OK 17s 914ms
/external user directory/roles/not present role added XFail 1ms
/external user directory/roles/readd privilege by readding role OK 20s 362ms
/external user directory/roles/remove privilege OK 18s 77ms
/external user directory/roles/remove privilege by removing role OK 18s 98ms
/external user directory/roles/remove role OK 17s 860ms

Generated by TestFlows Open-Source Test Framework v2.0.250110.1002922