Live Demonstration: An Fpga Based Hardware Compression Accelerator For Hadoop System

Hadoop is an emerging data application for the big data processing. In Hadoop system, data compression is a significant part in processing big data effectively. Achieving this in software requires significant compute processing. In this paper we present the detailed design of a hardware compression accelerators. We also measure the performance of the hardware accelerators. Our analysis shows that hardware acceleration has the potential to improve the data compression by as much as 12x. As a result, our hardware accelerator provides a real time data processing of big data.