Delft University of Technology
Hofman, Stefan (author).
Federated Learning for Mobile and Embedded Systems.
Degree: 2020, Delft University of Technology
An increase in the performance of mobile devices has started a revolution in deploying artificial intelligence (AI) algorithms on mobile and embedded systems. In addition, fueled by the need for privacy-aware insights into data, we see a strong push towards federated machine learning, where data is stored locally and not shared with a central server. By allowing data to stay on client devices and do training locally, we work towards a more privacy-friendly future. Furthermore, utilizing federated machine learning enables machine learning in data-constrained environments where bandwidth is not sufficient to upload the entire dataset. In this thesis, we look at the recent trend into less complex machine learning models. These models optimize resource usage while reducing accuracy loss. We investigate how these simpler models hold up within a federated setting. We also look into the developments of AI frameworks and their capabilities for mobile platforms. Based on these findings, we propose that model-hyper-parameter optimization is possible to maximize accuracy for smaller networks during federated learning. We show that it is possible to reduce the accuracy loss from 15% to only 0.04%. We then demonstrate what a mobile implementation looks like and the performance we see from an iPhone X. We show that an iPhone implementation takes less than 2x the amount of a regular laptop implementation. Finally, we demonstrate that we can reduce the model-size by up to 7x using modern weight quantization methods.
Advisors/Committee Members: Al-Ars, Z. (mentor), van Leuken, T.G.R.M. (graduation committee), Hoozemans, J.J. (graduation committee), Delft University of Technology (degree granting institution).
Subjects/Keywords: Federater learning; Artificial Intelligence; MobileNetV2; Embedded Systems; CoreML; On-device Learning
to Zotero / EndNote / Reference
APA (6th Edition):
Hofman, S. (. (2020). Federated Learning for Mobile and Embedded Systems. (Masters Thesis). Delft University of Technology. Retrieved from http://resolver.tudelft.nl/uuid:505e7f5b-a78d-444f-a92e-a88bcc7c08d0
Chicago Manual of Style (16th Edition):
Hofman, Stefan (author). “Federated Learning for Mobile and Embedded Systems.” 2020. Masters Thesis, Delft University of Technology. Accessed January 16, 2021.
MLA Handbook (7th Edition):
Hofman, Stefan (author). “Federated Learning for Mobile and Embedded Systems.” 2020. Web. 16 Jan 2021.
Hofman S(. Federated Learning for Mobile and Embedded Systems. [Internet] [Masters thesis]. Delft University of Technology; 2020. [cited 2021 Jan 16].
Available from: http://resolver.tudelft.nl/uuid:505e7f5b-a78d-444f-a92e-a88bcc7c08d0.
Council of Science Editors:
Hofman S(. Federated Learning for Mobile and Embedded Systems. [Masters Thesis]. Delft University of Technology; 2020. Available from: http://resolver.tudelft.nl/uuid:505e7f5b-a78d-444f-a92e-a88bcc7c08d0