Buffering Strategies In Hdfs Environment With Storm Framework

Istvan Finta,Lorant Farkas,Sandor Szenasi,Szabolcs Sergyan

2015 16TH IEEE INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND INFORMATICS (CINTI)（2015）

引用 2|浏览4

暂无评分

摘要

Hadoop Distributed File System (HDFS) is the de facto file system in vanilla Hadoop and most of open source Hadoop distributions. However HDFS suffers from the so called Small File Problem. Storm is a parallelized stream processing framework. In this paper we evaluate buffering strategies to mitigate the small file problem. In our evaluations Storm will be the small file source.

查看译文

关键词

HDFS,NameNode,overload,buffering,sequence file,synchronization,Storm,streaming

AI 理解论文

溯源树

样例

生成溯源树，研究论文发展脉络

Chat Paper

正在生成论文摘要