Research on the Application of Bank Transaction Data Stream Storage based on HBase

DOI

10.2991/iconfem-16.2016.46How to use a DOI?

Keywords

Hbase, secondary indexing, transaction data stream, distribution

Abstract

In the bank transaction monitoring and anti-fraud system, how to manage and analyze massive amount of data efficiently is a great challenge. Compared to RDBMS, NoSQL databases such as HBase, is more attractive in addressing big data problem. In this paper, we proposed an HBase based data storage and retrieval solution method for bank transaction data stream. We constructed table schema based on the user historical behaviours, and we used strategies of row key optimization and table pre-partition to improve efficiency. Also, for those query fields are not in the leading position of the row key, we build secondary index to optimize this kind of query operations. We have experimented and evaluated the performance of this solution. The experiment results demonstrated the improvement in query performance of our solution.

Copyright

© 2016, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Xiaoguo Wang
AU  - Yuxiang Liu
AU  - Lin Zhang
PY  - 2017/01
DA  - 2017/01
TI  - Research on the Application of Bank Transaction Data Stream Storage based on HBase
BT  - Proceedings of the 2016 International Conference on Engineering Management (Iconf-EM 2016)
PB  - Atlantis Press
SP  - 46
EP  - 51
SN  - 2352-5428
UR  - https://doi.org/10.2991/iconfem-16.2016.46
DO  - 10.2991/iconfem-16.2016.46
ID  - Wang2017/01
ER  -