Finding the forest in the trees: Enabling performance optimization on heterogeneous architectures through data science analysis of ensemble performance data

In this work, we develop novel data science methodologies for ensemble performance data that have the potential to uncover orders of magnitude of performance that is unknowingly being left on the table. Building on years of successful performance tool design and tool integration into million-line codes at Lawrence Livermore National Laboratory (Caliper (Boehme et al. 2016), Hatchet (Bhatele et al. 2019; Brink et al. 2020))-successes highlighted as key deliverables in meeting LLNL's L1 and L2 milestones (Rieben and Weiss 2020)-we design a data science methodology for integrating multi-dimensional, multi-scale, multi-architecture, and multi-tool performance data, and provide data analytics and interactive visualization capabilities for further analysis and exploration of the data. Our work provides developers with a comprehensive multi-dimensional performance landscape, enabling enhanced capabilities for pinpointing performance bottlenecks on emerging hardware platforms composed of heterogeneous elements.