HDFS distributed metadata management research

DOI

10.2991/asei-15.2015.190How to use a DOI?

Keywords

hdfs;Metadata Management;Consistency;Two-phase commit protocol

Abstract

As it can provide high throughput data access, and easy to deploy on a cheap machine ,Distributed File System HDFS is used widely.All HDFS file access requests are required by the metadata server node .so the single metadata server nodes often become the bottleneck of the whole system problem, this paper design a multi-node distributed metadata management solution in the directory Hash-based metadata storage strategy, proposed a protocol based on two-phase commit to ensure distributed metadata consistency. Experimental results show that the program can improve HDFS file system metadata management efficiency.

Copyright

© 2015, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - An-ping Xiong
AU  - Jin-yong Ma
PY  - 2015/05
DA  - 2015/05
TI  - HDFS distributed metadata management research
BT  - Proceedings of the 2015 International conference on Applied Science and Engineering Innovation
PB  - Atlantis Press
SP  - 956
EP  - 961
SN  - 2352-5401
UR  - https://doi.org/10.2991/asei-15.2015.190
DO  - 10.2991/asei-15.2015.190
ID  - Xiong2015/05
ER  -