View Issue Details

IDProjectCategoryView StatusLast Update
0006841CTT UA Scripts1 - Script Issuepublic2022-08-25 03:09
ReporterHock, Christian Assigned ToAlexander Allmendinger  
PrioritynormalSeverityminorReproducibilityalways
Status assignedResolutionopen 
Summary0006841: Test-Cases: Base Information / Base Info Server Capabilities / 005.js, 006.js and 007.js generates warnings
Description

MaxArrayLength, MaxStringLength and MaxByteStringLength is set to a value above 10000. OperationLimit will be limited to this value.

  • This is a limitation in the CTT.
    • Expected result "Good", because all test can be done up to this CTT-Limitation.

Btw: With Test-Cases "Monitored Item Services / Monitor Value Change / 024.js, 026.js and 028.js" we figured out, that the OperationLimit (at least) for Strings is 25.000 and NOT 10.000.

  • This seems to be a bug in CTT.
Steps To Reproduce

Every Server which has for these Limits '0' or >10.000.

TagsNo tags attached.
Attached Files
image.png (48,779 bytes)   
image.png (48,779 bytes)   
Files Affected

Relationships

has duplicate 0007792 closedPaul Hunkar Base Information / Base Info Server Capabilities / 005.js, 006.js and 007.js 
related to 0006844 closedAlexander Allmendinger Script: View Services / View Basic / 018.js shows "Warning" 

Activities

Paul Hunkar

2021-04-22 20:50

administrator   ~0014249

The warning is an indication that the test lab should check the results manually, I see no problem with reporting a warning if the limit is above what the tool can check. The limit listed in the server was not checked is what the warning indicates.

Paul Hunkar

2022-03-04 16:43

administrator   ~0016202

Need to figure out a better way to do this (split test cases), but also look at different report - since not really a skip, but more a not testable or something

Paul Hunkar

2022-08-04 15:42

administrator   ~0017288

Last edited: 2022-08-04 15:43

After discussion

  • we have Not Implemented for tests where scripts do not exist
  • we need a Not Applicable - for test where they do not apply to the application (we do not have this state)
  • we use Skip for tests where the tool can not handle a test (or the device needs a different configuration or does not provide mechanism needed to automate the test) - these are tests where the lab need to look and run the test in a manual manner. The key point is that a skipped test need to be review and in most cases could be run manually

[make sure the result interpretation section includes all of this information]

Review all warning, skip and not implemented test to ensure they follow these rules

Issue History

Date Modified Username Field Change
2021-04-22 18:56 Hock, Christian New Issue
2021-04-22 18:56 Hock, Christian File Added: image.png
2021-04-22 20:50 Paul Hunkar Note Added: 0014249
2021-05-06 14:23 Paul Hunkar Status new => acknowledged
2021-05-06 14:23 Paul Hunkar Priority high => normal
2021-05-06 14:23 Paul Hunkar Target Version 1.04.09.399 =>
2021-05-06 14:23 Paul Hunkar Description Updated
2022-03-01 17:02 Hock, Christian Relationship added related to 0007792
2022-03-04 16:40 Paul Hunkar Relationship replaced has duplicate 0007792
2022-03-04 16:43 Paul Hunkar Note Added: 0016202
2022-08-04 15:42 Paul Hunkar Note Added: 0017288
2022-08-04 15:42 Paul Hunkar Assigned To => Alexander Allmendinger
2022-08-04 15:42 Paul Hunkar Status acknowledged => assigned
2022-08-04 15:43 Paul Hunkar Note Edited: 0017288
2022-08-04 15:55 Paul Hunkar Relationship added related to 0006844
2022-08-25 03:09 Paul Hunkar Project Compliance Test Tool (CTT) Unified Architecture => CTT UA Scripts