Design and Development of the Mass Image Storage Platform Based on Hadoop
- 10.2991/icsnce-18.2018.9How to use a DOI?
- Massive Images; Hadoop; Distributed Calculation; Storage Framework
With fast development and deep appliance of the Internet, the problem of mass image data storage stands out, so the problem of low management efficiency, low storage ability and high cost of traditional storage framework has appeared. The appearance of Hadoop provides a new thought. However, Hadoop itself is not suit for the handle of small files. This paper puts forward a storage framework of mass image files based on Hadoop, and solved the internal storage bottleneck of NameNode when small files are excessive through classification algorithm of preprocessing module and lead-in of high efficiency and first-level of index mechanism. The test manifests that the system is safe, easy to defend and has fine extension quality; as a result, it can reach to a fine effect.
- © 2018, the Authors. Published by Atlantis Press.
- Open Access
- This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).
Cite this article
TY - CONF AU - Zhou Xiaoqing AU - Gou Jiangjing AU - Zhou Zhiyong AU - Sun Jiaxiu PY - 2018/04 DA - 2018/04 TI - Design and Development of the Mass Image Storage Platform Based on Hadoop BT - Proceedings of the 2018 Second International Conference of Sensor Network and Computer Engineering (ICSNCE 2018) PB - Atlantis Press SP - 39 EP - 42 SN - 2352-538X UR - https://doi.org/10.2991/icsnce-18.2018.9 DO - 10.2991/icsnce-18.2018.9 ID - Xiaoqing2018/04 ER -