View Issue Details

IDProjectCategoryView StatusLast Update
0004610CTT UA Test Case4 - Test Case Definitionpublic2024-02-01 16:44
ReporterMatthias Mosé Assigned ToAlexander Allmendinger  
PrioritynormalSeverityminorReproducibilityalways
Status closedResolutionfixed 
PlatformPCOSWindowsOS Version10
Fixed in Version1.03.09.503 
Summary0004610: Discovery Get Endpoints Testcase 009 differs from official description
Description

The CTT testcase "Discovery Get Endpoints Testcase 009" differs from the official description ( https://apps.opcfoundation.org/ProfileReporting/testcases/Server/DiscoveryGetEndpoints.html ).

Expected Behaviour:

  • Testcase connects to server via different hostnames and checks if the returned certificate always contains the used hostname.

Actual Behaviour:

  • Testcase connects with one hostname to the server and checks if all hostnames present in the server certificate are hostnames of the client (!) OS.
TagsNo tags attached.
Files Affected

Relationships

related to 0005201 assignedSebastian Allmendinger Compliance Test Tool (CTT) Unified Architecture Discovery GetEndpoints test cases should not require running on same host as server 

Activities

Paul Hunkar

2019-02-14 16:10

administrator   ~0009893

update test case description to match what test is doing

Paul Hunkar

2019-10-25 16:01

administrator   ~0011170

Updated description in the CTT - See related mantis issue for other script fix

Alexander Allmendinger

2024-01-25 17:24

developer   ~0020715

We should rediscuss the test case. When reworking it and comparing it with other test cases I have the feeling it should stay unchanged but become a manual test, as it is not automatically verifiable.

Even when a system has multiple hostnames the server doesn't need to return endpoints urls for all hostnames he is aware of. Ergo an UA Client wouldn't have the information whether multiple hostnames are configured.
For the certificate we have the problematic, that the application could use one certificate specifying all hostnames or it could use multiple certificates for every endpoint set. Again there is no requirement for one or the other in the specification.

Because of that, I would keep it as a manual test case to verify, whether servers which support this combination do indeed return a matching certificate to the provided default endpointurls.

Alexander Allmendinger

2024-01-26 16:28

developer   ~0020718

CMP Meeting: Change this test to a manual test. Then update the script to be skipped in general but if run individually bring up a message box which shows the certificate details and ask the user whether the certificate matches the hostnames/ip-addresses configured for the system under test.

Alexander Allmendinger

2024-02-01 13:14

developer   ~0020744

Test case been updated to be a manual test case.
Script update will be tracked in related mantis issue.

Paul Hunkar

2024-02-01 16:44

administrator   ~0020748

reviewed in call - agreed to update and closed issue

Issue History

Date Modified Username Field Change
2019-02-08 12:55 Matthias Mosé New Issue
2019-02-14 16:10 Paul Hunkar Assigned To => Paul Hunkar
2019-02-14 16:10 Paul Hunkar Status new => assigned
2019-02-14 16:10 Paul Hunkar Category 1 - Script Issue => 4 - Test Case Definition
2019-02-14 16:10 Paul Hunkar Note Added: 0009893
2019-10-25 15:59 Alexander Allmendinger Relationship added related to 0005201
2019-10-25 16:01 Paul Hunkar Category 4 - Test Case Definition => 1 - Script Issue
2019-10-25 16:01 Paul Hunkar Note Added: 0011170
2019-10-25 16:01 Paul Hunkar Assigned To Paul Hunkar => Alexander Allmendinger
2022-08-02 20:23 Paul Hunkar Project Compliance Test Tool (CTT) Unified Architecture => .NET API
2022-08-02 20:23 Paul Hunkar Category 1 - Script Issue => Api Change
2022-08-04 14:24 Paul Hunkar Project .NET API => Compliance Test Tool (CTT) Unified Architecture
2024-01-25 17:24 Alexander Allmendinger Note Added: 0020715
2024-01-26 16:28 Alexander Allmendinger Note Added: 0020718
2024-02-01 13:14 Alexander Allmendinger Status assigned => resolved
2024-02-01 13:14 Alexander Allmendinger Resolution open => fixed
2024-02-01 13:14 Alexander Allmendinger Note Added: 0020744
2024-02-01 16:42 Paul Hunkar Project Compliance Test Tool (CTT) Unified Architecture => CTT UA Test Case
2024-02-01 16:43 Paul Hunkar Category Api Change => 4 - Test Case Definition
2024-02-01 16:43 Paul Hunkar Product Version 1.03.340.380 =>
2024-02-01 16:43 Paul Hunkar Fixed in Version => 1.03.09.503
2024-02-01 16:44 Paul Hunkar Status resolved => closed
2024-02-01 16:44 Paul Hunkar Note Added: 0020748