Alchemist: An Apache Spark ⇔ MPI interface
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2019.
The Apache Spark framework for distributed computation is popular in the data analytics community due to its ease of use, but its MapReduce-style programming model can incur significant overheads when performing computations that do not map directly onto this model. One way to mitigate these costs is to off-load computations onto MPI code...More
Full Text (Upload PDF)
PPT (Upload PPT)