Adaptive Verifiable Coded Computing: Towards Fast, Secure and Private Distributed Machine Learning
arXiv.org(2021)
摘要
Stragglers, Byzantine workers, and data privacy are the main bottlenecks in
distributed cloud computing. Some prior works proposed coded computing
strategies to jointly address all three challenges. They require either a large
number of workers, a significant communication cost or a significant
computational complexity to tolerate Byzantine workers. Much of the overhead in
prior schemes comes from the fact that they tightly couple coding for all three
problems into a single framework. In this paper, we propose Adaptive Verifiable
Coded Computing (AVCC) framework that decouples the Byzantine node detection
challenge from the straggler tolerance. AVCC leverages coded computing just for
handling stragglers and privacy, and then uses an orthogonal approach that
leverages verifiable computing to mitigate Byzantine workers. Furthermore, AVCC
dynamically adapts its coding scheme to trade-off straggler tolerance with
Byzantine protection. We evaluate AVCC on a compute-intensive distributed
logistic regression application. Our experiments show that AVCC achieves up to
4.2× speedup and up to 5.1% accuracy improvement over the
state-of-the-art Lagrange coded computing approach (LCC). AVCC also speeds up
the conventional uncoded implementation of distributed logistic regression by
up to 7.6×, and improves the test accuracy by up to 12.1%.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要