Stream Documents Processing Invariance in Situation-Oriented Databases
- DOI
- 10.2991/itids-19.2019.55How to use a DOI?
- Keywords
- situation-oriented database, built-in dynamic model, streaming data processing, DOM, HSM, XML, JSON.
- Abstract
Data stream processing in situational-oriented databases (SODB) is discussed. SODB is a heterogeneous data integrator operating under the control of the built-in hierarchical situational model (HSM). The processed data is defined in the HSM as virtual documents (VD) mapped to real data stores. HSM specifies the loading of a VD data into Data Processing Objects (DPO), the data transformation in DPO, and unloading of processing results to a VD. Stream processing of large documents that do not fit entirely into RAM is discussed. A VD model involving multiple pieces of data that can be processed separately is considered. Portions of data are extracted from the VD input stream, processed in the DPO, and then sent to the VD output stream. Invariance should ensure the independence of the DPO model when the VD model changes. Invariance to different schemes streaming data is discussed. Algorithms for loading and unloading DPO are considered, ensuring invariance due to the hidden cyclical processing of data portions. The proposed solutions are illustrated with examples of processing XML and JSON documents.
- Copyright
- © 2019, the Authors. Published by Atlantis Press.
- Open Access
- This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).
Cite this article
TY - CONF AU - Valeriy Mironov AU - Artem Gusarenko AU - Nafisa Yusupova PY - 2019/05 DA - 2019/05 TI - Stream Documents Processing Invariance in Situation-Oriented Databases BT - Proceedings of the 7th Scientific Conference on Information Technologies for Intelligent Decision Making Support (ITIDS 2019) PB - Atlantis Press SP - 309 EP - 315 SN - 1951-6851 UR - https://doi.org/10.2991/itids-19.2019.55 DO - 10.2991/itids-19.2019.55 ID - Mironov2019/05 ER -