Battling the CPU Bottleneck in Apache Parquet to Arrow Conversion Using FPGA

2020 International Conference on Field-Programmable Technology (ICFPT)(2020)

引用 6|浏览17
暂无评分
摘要
In the domain of big data analytics, the bottleneck of converting storage-focused file formats to in-memory data structures has shifted from the bandwidth of storage to the performance of decoding and decompression software. Two widely used formats for big data storage and in-memory data are Apache Parquet and Apache Arrow, respectively. In order to improve the speed at which data can be loaded fr...
更多
查看译文
关键词
Bandwidth,Metadata,Big Data,Data structures,Throughput,Encoding,Decoding
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要