Proceedings of the 2017 2nd Joint International Information Technology, Mechanical and Electronic Engineering Conference (JIMEC 2017)

Architectural Design Of Data Stream-Based Big Data Real-Time Analysis System

Authors
Qiang Liu, Junmin Lv, Xun Yuan, Renyi Luo, Dekui Lv
Corresponding Author
Qiang Liu
Available Online October 2017.
DOI
10.2991/jimec-17.2017.34How to use a DOI?
Keywords
Data stream, Big data, Real-time computing (RT computing), Architectural design.
Abstract

Conducting the RT analysis of large-scale data stream severely challenges the IT hardware facilities and system Architecture. To cope with the needs of large-scale RT analysis, the article analyzes and compares the mainstream open-source technology and then designs the system architecture that consists of data collection, data distribution,real-time computing, persistent storage, resource allocation and scheduling.

Copyright
© 2017, the Authors. Published by Atlantis Press.
Open Access
This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

Volume Title
Proceedings of the 2017 2nd Joint International Information Technology, Mechanical and Electronic Engineering Conference (JIMEC 2017)
Series
Advances in Computer Science Research
Publication Date
October 2017
ISBN
978-94-6252-366-1
ISSN
2352-538X
DOI
10.2991/jimec-17.2017.34How to use a DOI?
Copyright
© 2017, the Authors. Published by Atlantis Press.
Open Access
This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Cite this article

TY  - CONF
AU  - Qiang Liu
AU  - Junmin Lv
AU  - Xun Yuan
AU  - Renyi Luo
AU  - Dekui Lv
PY  - 2017/10
DA  - 2017/10
TI  - Architectural Design Of Data Stream-Based Big Data Real-Time Analysis System
BT  - Proceedings of the 2017 2nd Joint International Information Technology, Mechanical and Electronic Engineering Conference (JIMEC 2017)
PB  - Atlantis Press
SP  - 153
EP  - 156
SN  - 2352-538X
UR  - https://doi.org/10.2991/jimec-17.2017.34
DO  - 10.2991/jimec-17.2017.34
ID  - Liu2017/10
ER  -