Battling the CPU Bottleneck in Apache Parquet to Arrow Conversion Using FPGA
2020 International Conference on Field-Programmable Technology (ICFPT)(2020)
摘要
In the domain of big data analytics, the bottleneck of converting storage-focused file formats to in-memory data structures has shifted from the bandwidth of storage to the performance of decoding and decompression software. Two widely used formats for big data storage and in-memory data are Apache Parquet and Apache Arrow, respectively. In order to improve the speed at which data can be loaded fr...
更多查看译文
关键词
Bandwidth,Metadata,Big Data,Data structures,Throughput,Encoding,Decoding
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要