View Issue Details

Jump to NotesJump to History
IDProjectCategoryView StatusDate SubmittedLast Update
0004057CTT UA Scripts1 - Script Issuepublic2017-11-15 12:342022-10-07 11:54
Reporterlil Assigned ToYannik Klaass  
PrioritynormalSeveritymajorReproducibilityalways
Status closedResolutionfixed 
Fixed in Version1.03.501 
Summary0004057: Server limitations specified in Server_ServerCapabilites_OperationLimits are not used in CTT tests
Description

CTT does not ask for and use the server limitations that are specified in Server_ServerCapabilites_OperationLimits.
For example is there a readRequest in beforeTest.js where serveral nodes are read even if the number of nodes are larger that the limit specified in Server_ServerCapabilites_OperationLimits_MaxNodesPerRead causing the test to fail.

Steps To Reproduce

run beforeTest.js with a server that has a limits the number of nodes per read to 20.

TagsNo tags attached.
Files Affected

/library/Base/serverCapabilities.js
/library/RunOnce/beforeTest.js
/library/ServiceBased/AttributeServiceSet/HistoryRead.js
/library/ServiceBased/AttributeServiceSet/HistoryUpdate.js
/library/ServiceBased/AttributeServiceSet/Read.js
/library/ServiceBased/AttributeServiceSet/Write.js
/library/ServiceBased/MonitoredItemServiceSet/DeleteMonitoredItems.js
/library/ServiceBased/MonitoredItemServiceSet/ModifyMonitoredItems.js
/library/ServiceBased/MonitoredItemServiceSet/SetMonitoringMode.js
/library/ServiceBased/MonitoredItemServiceSet/SetTriggering.js
/library/ServiceBased/NodeManagementServiceSet/AddNodes.js
/library/ServiceBased/NodeManagementServiceSet/AddReferences.js
/library/ServiceBased/NodeManagementServiceSet/DeleteNodes.js
/library/ServiceBased/NodeManagementServiceSet/DeleteReferences.js
/library/ServiceBased/ViewServiceSet/Browse/number_of_continuation_points_test.js
/library/ServiceBased/ViewServiceSet/RegisterNodes/register_nodes_test.js
/library/ServiceBased/ViewServiceSet/TranslateBrowsePathsToNodeIds/test_translateBrowsePathsToNodeIds_mix.js
/library/ServiceBased/ViewServiceSet/TranslateBrowsePathsToNodeIds/translateBrowsePathsToNodeIdsHelper.js
/library/ServiceBased/ViewServiceSet/UnregisterNodes/unregister_nodes_test.js
/library/ServiceBased/ViewServiceSet/Browse.js
/library/ServiceBased/ViewServiceSet/BrowseNext.js
/library/ServiceBased/ViewServiceSet/RegisterNodes.js
/library/ServiceBased/ViewServiceSet/TranslateBrowsePathsToNodeIds.js
/library/ServiceBased/ViewServiceSet/UnregisterNodes.js
/maintree/Base Information/Base Info ResendData Method/Test Cases/005.js
/maintree/Base Information/Base Info ResendData Method/Test Cases/006.js
/maintree/Base Information/Base Info Server Capabilities/Test Cases/002.js
/maintree/Base Information/Base Info Server Capabilities/Test Cases/015.js
/maintree/Base Information/Base Info Server Capabilities/Test Cases/016.js
/maintree/Data Access/Data Access PercentDeadBand/Test Cases/006.js
/maintree/Monitored Item Services/Monitor Basic/Test Cases/Err-023.js
/maintree/Monitored Item Services/Monitor Basic/Test Cases/Err-027.js
/maintree/Monitored Item Services/Monitor Items 2/Test Cases/Err-001.js
/maintree/Monitored Item Services/Monitor Items 5000/Test Cases/Err-001.js
/maintree/Monitored Item Services/Monitor Items Deadband Filter/Test Cases/006.js
/maintree/Monitored Item Services/Monitor MinQueueSize_02/Test Cases/007.js
/maintree/Monitored Item Services/Monitor Triggering/Test Cases/002.js
/maintree/Monitored Item Services/Monitor Triggering/Test Cases/024.js
/maintree/Monitored Item Services/Monitor Triggering/Test Cases/Err-002.js
/maintree/Monitored Item Services/Monitor Triggering/Test Cases/Err-003.js
/maintree/Monitored Item Services/Monitor Triggering/Test Cases/Err-005.js
/maintree/Monitored Item Services/Monitor Triggering/Test Cases/Err-008.js
/maintree/Node Management Services/Node Management Add Node/Test Cases/Err-002.js
/maintree/Node Management Services/Node Management Delete Node/Test Cases/Err-002.js
/maintree/Subscription Services/Subscription Basic/Test Cases/063.js
/maintree/Subscription Services/Subscription Basic/Test Cases/Err-030.js
/maintree/Subscription Services/Subscription Minimum 02/Test Cases/003.js
/maintree/Subscription Services/Subscription Minimum 02/Test Cases/006.js
/maintree/Subscription Services/Subscription Minimum 02/Test Cases/007.js
/maintree/Subscription Services/Subscription Minimum 02/Test Cases/008.js
/maintree/Subscription Services/Subscription Transfer/Test Cases/006.js
/maintree/View Services/View Basic/Test Cases/008.js
/maintree/View Services/View Minimum Continuation Point 05/Test Cases/003.js
/maintree/View Services/View Minimum Continuation Point 05/Test Cases/004.js
/maintree/View Services/View RegisterNodes/Test Cases/006.js
/maintree/View Services/View RegisterNodes/Test Cases/007.js
/maintree/View Services/View RegisterNodes/Test Cases/Err-002.js
/maintree/View Services/View RegisterNodes/Test Cases/Err-005.js
/maintree/View Services/View RegisterNodes/Test Cases/Err-006.js
/maintree/View Services/View TranslateBrowsePath/Test Cases/Err-021.js

Relationships

related to 0004083 closedAlexander Allmendinger Compliance Test Tool (CTT) Unified Architecture OperationLimits.MaxNodesPerRead not working 
related to 0007524 closedYannik Klaass CTT UA Scripts Several tests in View Services - View RegisterNodes fails when only MaxNodesPerRegisterNodes is 1 
related to 0006716 closedYannik Klaass CTT UA Scripts createMonitoredItems5000 may send more monitored item in a single CreateMonitoredItemCall than allowed 
child of 0008284 closedYannik Klaass CTT UA Scripts Monitor Item 2 / Err-001: Script sends empty Delete Monotired items request 

Activities

Alexander Allmendinger

2017-11-17 14:19

developer   ~0008720

Hi Lil,

as there are certain test scripts which need to run with specified maximums we can't just do it in the base scripts. Is there any other script execpt for the beforeTest.js where you're running into an issue?

lil

2017-12-12 09:29

reporter   ~0008788

Hi,
We see the same issue in the following tests where the test is trying to read ServerCapabilities with 38 nodes. Since we only support to read 20 nodes it would be better to read only OperationLimits first instead of the entire ServerCapabilities.

Test trying to read more nodes than MaxNodesPerRead:

  • Attribute Read test 12 and Err-008
  • Session Minimum test 1
  • Session General Service Behaviour test 1-3
  • Session Base test 1-13
  • View Minimum Continuation Point 01

Test not using the limitation in MaxNodesPerTranslateBrowsePathsToNodeIds (our limit is 20) :

  • Base Info Core Structure test 1

These are only examples of tests. There might be more tests that have the same issue.

Alexander Allmendinger

2018-11-01 00:02

developer   ~0009511

The issue with the Read has already been addressed.

Alexander Allmendinger

2019-02-02 00:09

developer   ~0009873

The MaxNodesPerWrite is now honored as well.

Yannik Klaass

2022-10-04 07:42

developer   ~0017922

All services and scripts have been modified to enable the CTT to cope with all OperationLimits (Fixing along Manits 0007524, 0006716 and 0008284)

Paul Hunkar

2022-10-06 15:39

administrator   ~0017961

Review all changes in call, agreed to updates, closed issue

Issue History

Date Modified Username Field Change
2017-11-15 12:34 lil New Issue
2017-11-17 14:19 Alexander Allmendinger Note Added: 0008720
2017-11-17 14:19 Alexander Allmendinger Assigned To => Alexander Allmendinger
2017-11-17 14:19 Alexander Allmendinger Status new => feedback
2017-12-07 16:44 Paul Hunkar Relationship added related to 0004083
2017-12-07 16:44 Paul Hunkar Status feedback => assigned
2017-12-07 16:45 Paul Hunkar Target Version => 1.03
2017-12-12 09:29 lil Note Added: 0008788
2018-11-01 00:02 Alexander Allmendinger Note Added: 0009511
2019-01-07 16:42 Paul Hunkar Target Version 1.03 => 1.04
2019-01-28 14:10 Paul Hunkar Category Script Issue => 1 - Script Issue
2019-02-02 00:09 Alexander Allmendinger Note Added: 0009873
2022-05-03 23:49 Alexander Allmendinger Assigned To Alexander Allmendinger => Yannik Klaass
2022-08-02 20:22 Paul Hunkar Project Compliance Test Tool (CTT) Unified Architecture => CTT UA Scripts
2022-09-07 12:25 Yannik Klaass Relationship added related to 0007524
2022-09-07 12:26 Yannik Klaass Relationship added related to 0006716
2022-10-04 07:39 Yannik Klaass Relationship added child of 0008284
2022-10-04 07:42 Yannik Klaass Status assigned => resolved
2022-10-04 07:42 Yannik Klaass Resolution open => fixed
2022-10-04 07:42 Yannik Klaass Note Added: 0017922
2022-10-06 15:39 Paul Hunkar Status resolved => closed
2022-10-06 15:39 Paul Hunkar Fixed in Version => 1.03.501
2022-10-06 15:39 Paul Hunkar Note Added: 0017961
2022-10-07 11:54 Paul Hunkar Files Affected => /library/Base/serverCapabilities.js
/library/RunOnce/beforeTest.js
/library/ServiceBased/AttributeServiceSet/HistoryRead.js
/library/ServiceBased/AttributeServiceSet/HistoryUpdate.js
/library/ServiceBased/AttributeServiceSet/Read.js
/library/Servi...