View Issue Details

IDProjectCategoryView StatusLast Update
0007989Compliance Test Tool (CTT) Unified ArchitectureApi Changepublic2022-10-13 16:02
ReporterElliot Gawthrop Assigned ToArchie Miller  
PrioritynormalSeverityfeatureReproducibilityalways
Status closedResolutionduplicate 
Product Version1.04.09.401 
Summary0007989: A&C Skip Messages Are Too Noisy
Description

The A&C test cases add skip messages for all alarm types that are not encountered. In order for the user to verify that the system is working correctly, it is necessary for them to
1) determine which alarm types they are actually expecting
2) on each test case, on each test run, go through the list of up to 22 skip messages on each test case and check whether all the expected alarm types are not in the list

This is an error prone and time consuming process, which could lead to the user not noticing that the server was not conformant.

It would be more convenient if the user could configure which alarm types to expect, and then only produce skipped (or warnings?) for expected alarm types that were not detected.

This would make the A&C conformance testing more consistent with how static nodes are tested.

TagsNo tags attached.
Files Affected

Relationships

duplicate of 0007476 closedArchie Miller CTT UA Scripts A&C compliance test: alarms are not discovered leads to many tests skipped 

Activities

Paul Hunkar

2022-10-13 16:02

administrator   ~0018032

Agreed in call to duplicate, closed issue

Issue History

Date Modified Username Field Change
2022-05-12 19:32 Elliot Gawthrop New Issue
2022-05-13 14:36 Paul Hunkar Severity major => crash
2022-05-13 14:36 Paul Hunkar Severity crash => feature
2022-05-13 14:36 Paul Hunkar Assigned To => Archie Miller
2022-05-13 14:36 Paul Hunkar Status new => assigned
2022-05-13 14:37 Archie Miller Status assigned => resolved
2022-05-13 14:37 Archie Miller Resolution open => duplicate
2022-05-13 14:37 Archie Miller Relationship added duplicate of 0007476
2022-08-02 20:03 Paul Hunkar Project Compliance Test Tool (CTT) Unified Architecture => CTT UA Scripts
2022-08-02 20:23 Paul Hunkar Project CTT UA Scripts => .NET API
2022-08-02 20:23 Paul Hunkar Category 1 - Script Issue => Api Change
2022-08-04 14:24 Paul Hunkar Project .NET API => Compliance Test Tool (CTT) Unified Architecture
2022-10-13 16:02 Paul Hunkar Status resolved => closed
2022-10-13 16:02 Paul Hunkar Note Added: 0018032