Proceedings of the 2016 International Conference on Engineering Management (Iconf-EM 2016)

Research on the Application of Bank Transaction Data Stream Storage based on HBase

Authors
Xiaoguo Wang, Yuxiang Liu, Lin Zhang
Corresponding Author
Xiaoguo Wang
Available Online January 2017.
DOI
10.2991/iconfem-16.2016.46How to use a DOI?
Keywords
Hbase, secondary indexing, transaction data stream, distribution
Abstract

In the bank transaction monitoring and anti-fraud system, how to manage and analyze massive amount of data efficiently is a great challenge. Compared to RDBMS, NoSQL databases such as HBase, is more attractive in addressing big data problem. In this paper, we proposed an HBase based data storage and retrieval solution method for bank transaction data stream. We constructed table schema based on the user historical behaviours, and we used strategies of row key optimization and table pre-partition to improve efficiency. Also, for those query fields are not in the leading position of the row key, we build secondary index to optimize this kind of query operations. We have experimented and evaluated the performance of this solution. The experiment results demonstrated the improvement in query performance of our solution.

Copyright
© 2016, the Authors. Published by Atlantis Press.
Open Access
This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

Volume Title
Proceedings of the 2016 International Conference on Engineering Management (Iconf-EM 2016)
Series
Advances in Economics, Business and Management Research
Publication Date
January 2017
ISBN
10.2991/iconfem-16.2016.46
ISSN
2352-5428
DOI
10.2991/iconfem-16.2016.46How to use a DOI?
Copyright
© 2016, the Authors. Published by Atlantis Press.
Open Access
This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Cite this article

TY  - CONF
AU  - Xiaoguo Wang
AU  - Yuxiang Liu
AU  - Lin Zhang
PY  - 2017/01
DA  - 2017/01
TI  - Research on the Application of Bank Transaction Data Stream Storage based on HBase
BT  - Proceedings of the 2016 International Conference on Engineering Management (Iconf-EM 2016)
PB  - Atlantis Press
SP  - 46
EP  - 51
SN  - 2352-5428
UR  - https://doi.org/10.2991/iconfem-16.2016.46
DO  - 10.2991/iconfem-16.2016.46
ID  - Wang2017/01
ER  -