View Issue Details

IDProjectCategoryView StatusLast Update
000931810000-014: PubSubSpecpublic2023-12-19 16:45
ReporterRandy Armstrong Assigned ToJim Luth  
PrioritynormalSeverityminorReproducibilityhave not tried
Status closedResolutionno change required 
Product Version1.05.03 
Target Version1.05.04 RC1 
Summary0009318: JSON + MQTT has a lot of overhead when streaming unrelated data to the cloud
Description

The current PubSub model presumes DataSetWriters are created based some logical structure within the source address space.

There are applications that have no logical structure and instead random variables from the source address space are streamed to the cloud.

Applications that use this model do not have clearly defined DataSetWriters that can be created and have to

1) Create a single DataSetWriter of all variables where the field name is a unique id for the Variable instead of a Name;
2) Create a DataSetWriter for each variable which causes the Connection object change every time a Variable is added or removed.

Proposal: add a new NetworkMessage flag: 'DynamicDataSetWriters'.

This flag indicates that DataSetWriters are dynamic and list of DataSetWriterIds is not known in advance. The DataSetMetaData will be published for each DataSetWriter and provides the DataSetWriterId for an active DataSetWriter. When using this mode NetworkMessage/DataSetMessage headers shall be present the PublisherId and DataSetWriterId shall be specified.

The PubSubConnnection metadata shall have a single DataSetWriter which is the template for all DataSetWriters. The MetaDataQueue name shall have the DataSetWriter Name as the last topic level. DataSetWriter name for the dynamically generated DataSetWriters shall be <templatename>.<datasetwriterid> (each unique DataSetWriter needs its own topic name since DataSetMetaData messages are sent with Retain=TRUE).

TagsNo tags attached.
Commit Version
Fix Due Date

Activities

Jim Luth

2023-12-19 16:45

administrator   ~0020534

We don't think this will be an issue and do not want to add more complexity to PubSub.

Issue History

Date Modified Username Field Change
2023-12-18 07:51 Randy Armstrong New Issue
2023-12-18 07:58 Randy Armstrong Description Updated
2023-12-18 08:03 Randy Armstrong Description Updated
2023-12-18 08:28 Randy Armstrong Description Updated
2023-12-19 16:45 Jim Luth Assigned To => Jim Luth
2023-12-19 16:45 Jim Luth Status new => closed
2023-12-19 16:45 Jim Luth Resolution open => no change required
2023-12-19 16:45 Jim Luth Note Added: 0020534