The number of Smartphone users in the world is expected to pass the five billion in 2019. The major credit for this exponential growth is the competition between Smartphones manufacturing companies and increasing Internet availability in the world. Processing power considered to be one of the most important features in Smartphones and it is evolving year by year. Until now, building a distributed computing system done exclusively using PCs and other server infrastructure. In this paper we will propose a new architecture for a distributed computing system consists of a network of Smartphones and use their computation power to execute machine learning models on each Smartphone. As proof of concept, our solution will provide a stable layer to execute large data-sets using common machine learning algorithms such as Linear Regression.