Uploaded byCloudera, Inc.
Federated Learning: ML with Privacy on the Edge 11.15.18
The document discusses federated learning, highlighting its applications in various sectors such as healthcare, industrial IoT, and retail. It addresses challenges like power consumption and data privacy, referencing notable studies and frameworks in the field. Additionally, it outlines questions and potential projects related to federated learning, including its implementation and personalization.
In this document
Powered by AI
Introduction to federated learning and contributors involved in the project.
Overview of the federated learning environment and its structure.
Discussion of the Federated Averaging technique for efficient training from decentralized data.
Exploration of challenges in federated learning including power consumption, dropped connections, and stragglers.
Examples of applications such as predictive maintenance, healthcare, mobile devices, and retail analytics.
Questions addressed by key experts on federated learning, its applications, challenges, and tools.
Recommended blogs and papers for deeper understanding of federated learning principles and implementations.
More Related Content
Similar to Federated Learning: ML with Privacy on the Edge 11.15.18
More from Cloudera, Inc.
Federated Learning: ML with Privacy on the Edge 11.15.18
- 1. © Cloudera, Inc.All rights reserved. FEDERATED LEARNING Mike Lee Williams (Cloudera) Virginia Smith (CMU), Eric Tramel (Owkin), and Andrew Trask (OpenMined)
- 4. © Cloudera, Inc.All rights reserved.© Cloudera, Inc. All rights reserved. THE FEDERATED LEARNING SETTING 4
- 5. © Cloudera, Inc.All rights reserved. 5
- 6. © Cloudera, Inc.All rights reserved. 6
- 7. © Cloudera, Inc.All rights reserved. 7
- 8. © Cloudera, Inc.All rights reserved. 8
- 9. © Cloudera, Inc.All rights reserved.© Cloudera, Inc. All rights reserved. FEDERATED AVERAGING Communication-Efficient Learning of Deep Networks from Decentralized Data by McMahan et al. 2016 9
- 10. © Cloudera, Inc.All rights reserved. 10
- 11. © Cloudera, Inc.All rights reserved. 11
- 12. © Cloudera, Inc.All rights reserved. 12
- 13. © Cloudera, Inc.All rights reserved. 13
- 14. © Cloudera, Inc.All rights reserved. 14
- 15. © Cloudera, Inc.All rights reserved. 15
- 16. © Cloudera, Inc.All rights reserved. 16
- 17. © Cloudera, Inc.All rights reserved. 17
- 18. © Cloudera, Inc.All rights reserved.© Cloudera, Inc. All rights reserved. TURBOFAN TYCOON turbofan.fastforwardlabs.com 18
- 19. © Cloudera, Inc.All rights reserved.© Cloudera, Inc. All rights reserved. CHALLENGES 19
- 20. © Cloudera, Inc.All rights reserved. Power consumption Dropped connections Stragglers
- 21. © Cloudera, Inc.All rights reserved. 21
- 22. © Cloudera, Inc.All rights reserved. 22 Deep Models Under the GAN: Information Leakage from Collaborative Deep Learning by Hitaj et al. (2017)
- 23. © Cloudera, Inc.All rights reserved.© Cloudera, Inc. All rights reserved. USE CASES • Predictive maintenance/industrial IOT • Smartphones • Healthcare (wearables, drug discovery, prognostics, etc.) • Browsers • Retail video analytics • Enterprise/corporate IT (chat, issue trackers, email, etc.) 23
- 24. © Cloudera, Inc.All rights reserved.© Cloudera, Inc. All rights reserved. Q&A 24
- 25. © Cloudera, Inc.All rights reserved.© Cloudera, Inc. All rights reserved. ANDREW TRASK OPENMINED 25 What is the OpenMined project? What are secure aggregation and differential privacy? Could you tell us about PySyft? And what is the open source landscape like for federated learning? What other tools are out there to build upon?
- 26. © Cloudera, Inc.All rights reserved.© Cloudera, Inc. All rights reserved. ERIC TRAMEL OWKIN 26 What are the use cases for federated learning in healthcare? What healthcare challenges is Owkin working on? Can you tell us a little bit about how what you do differs algorithmically from the simple version described earlier? And what problems are you still working on?
- 27. © Cloudera, Inc.All rights reserved.© Cloudera, Inc. All rights reserved. VIRGINIA SMITH CMU 27 What does it mean to personalize federated learning? What are the use cases for this, and how does it work at a high level? Does federated learning work, i.e. do we end up with the same trained model as we’d have got it we moved the training data to our datacenter? What open problems are you interested in?
- 28. © Cloudera, Inc.All rights reserved.© Cloudera, Inc. All rights reserved. Cloudera Fast Forward Labs • An introduction to Federated Learning (Cloudera VISION blog, business audience) • Federated learning: distributed machine learning with data locality and privacy (FFL blog, more technical) • Turbofan Tycoon (working prototype, see FFL blog post for some details) Other blog posts • Collaborative Machine Learning without Centralized Training Data (Google research blog) • Federated Learning for Firefox (Firefox on florian.github.io) • Federated Learning for wake word detection (snips.ai on medium.com) Papers • Communication-Efficient Learning of Deep Networks from Decentralized Data by McMahan et al. (Google, 2016) • Practical Secure Aggregation for Privacy-Preserving Machine Learning by Bonawitz et al. (Google, 2017) • Federated Multi-Task Learning by Smith et al. (2017) • A generic framework for privacy preserving deep learning by Ryffel et al. (2018, and see also github.com/OpenMined/PySyft) • Federated Learning for Mobile Keyboard Prediction by Hard et al. (Google, 2018) 28
Editor's Notes
- #3 Fast Forward Labs builds product prototypes and writes reports about advances in machine intelligence. We also advise our clients on retainer. You might want to become a subscriber! I’ll tell you how later.