Design and Development of the Mass Image Storage Platform Based on Hadoop

DOI

10.2991/icsnce-18.2018.9How to use a DOI?

Keywords

Massive Images; Hadoop; Distributed Calculation; Storage Framework

Abstract

With fast development and deep appliance of the Internet, the problem of mass image data storage stands out, so the problem of low management efficiency, low storage ability and high cost of traditional storage framework has appeared. The appearance of Hadoop provides a new thought. However, Hadoop itself is not suit for the handle of small files. This paper puts forward a storage framework of mass image files based on Hadoop, and solved the internal storage bottleneck of NameNode when small files are excessive through classification algorithm of preprocessing module and lead-in of high efficiency and first-level of index mechanism. The test manifests that the system is safe, easy to defend and has fine extension quality; as a result, it can reach to a fine effect.

Copyright

© 2018, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Zhou Xiaoqing
AU  - Gou Jiangjing
AU  - Zhou Zhiyong
AU  - Sun Jiaxiu
PY  - 2018/04
DA  - 2018/04
TI  - Design and Development of the Mass Image Storage Platform Based on Hadoop
BT  - Proceedings of the 2018 Second International Conference of Sensor Network and Computer Engineering (ICSNCE 2018)
PB  - Atlantis Press
SP  - 39
EP  - 42
SN  - 2352-538X
UR  - https://doi.org/10.2991/icsnce-18.2018.9
DO  - 10.2991/icsnce-18.2018.9
ID  - Xiaoqing2018/04
ER  -