Split Learning versus Federated Learning for Data Transparent ML, Camera Culture Group, MIT Media Lab

1. Raskar, Camera Culture, MIT Media Lab Camera Culture Ramesh Raskar Data Transparent ML + Health Privacy vs Societal Benefits Training NN without Raw Data Ramesh Raskar Associate Professor MIT

2. Pooling ‘small’ data No Exchange of Raw Patient Data

3. Technologies Individual Organization Population Physical Diagnostic Devices EHR DigitalGlobal Pop-health Health Vault Health Data Market Health OS Removing Data Friction New Capture + Analysis Patient Scale  World Scale Existing Data + Techniques  

4. ‘Invisible’ Health Data ‘Small Data’ ‘Small Data’‘Small Data’

5. a. Distributed Data b. Patient privacy c. Incentives d. ML Expertise e. Labeling Low Bandwidth Low Compute ‘Small’ Data ML for Health Data

6. Gupta, Raskar ‘Distributed training of deep neural network over several agents’, 2017 No Exchange of Raw Patient Data Train Neural Nets

7. Training Deep Networks No sharing of Raw data Server Client Invisible Data / Data Friction

8. Ease Incentive Trust Regulation Ayushman Blockchain AI/ SplitNN Overcoming Data Friction

9. Automating ML : AI building AI Published in International Conference on Learning Representations (2017) Otkrist Gupta, Baker, Naik, Raskar, ICLR 2017 Teacher Student

10. Anonymize Protect Data Obfuscate Encrypt

11. Protect Raw Data Share Wisdom Data Utility Train Model EncryptSmashObfuscate Add Noise Private Data Protect Infer Statistics Anonymize Share Wisdom, Not Data

12. Federated Learning Nets trained at Clients Merged at Server Differential Privacy Obfuscate with noise Hide unique samples Homomorphic Encryption Basic Math over Encrypted Data (+, x) Split Learning (MIT) Nets split over network Trained at both

13. Federated Learning Server Client1 Client2 Client3 ..

14. Partial Leakage Differential Privacy Homomorphic Encryption Oblivious Transfer, Garbled Circuits Federated Learning Split Learning Protect data Distributed Training Inference but no training Praneeth Vepakomma, Tristan Swedish, Otkrist Gupta, Abhi Dubey, Raskar 2018

15. Memory Compute Bandwidth ConvergenceFederated Split

16. Technologies Individual Organization Population Physical Diagnostic Devices EHR DigitalGlobal Pop-health Health Vault Health Data Market Health OS Removing Data Friction New Capture + Analysis Patient Scale  World Scale Existing Data + Techniques  

Split Learning versus Federated Learning for Data Transparent ML, Camera Culture Group, MIT Media Lab

You are reading a preview.

Check these out next

Split Learning versus Federated Learning for Data Transparent ML, Camera Culture Group, MIT Media Lab

More Related Content

Slideshows for you (20)

Similar to Split Learning versus Federated Learning for Data Transparent ML, Camera Culture Group, MIT Media Lab (20)

More from Camera Culture Group, MIT Media Lab (20)

Recently uploaded (20)