Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Web-based data sharing and analysis

3 views

Published on

Up2U Workshop at TNC 2018

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Web-based data sharing and analysis

  1. 1. TNC18 Intelligent networks, cool edges? Michał Zimniewicz, PSNC Greetings to Enrico Bocchi, CERN IT-ST Web-based data sharing and analysis Trondheim, Norway 14.06.2018
  2. 2. TNC18 Intelligent networks, cool edges? 2
  3. 3. TNC18 Intelligent networks, cool edges? A use case •Large Hadron Collider •100+ of bilions of files stored, 100+ PB •10k writes per second, 1k new files per second 3 CERNBox & SWAN
  4. 4. TNC18 Intelligent networks, cool edges? Service for Web-based ANalysis 4 SWAN • Simple web interface • Rich interactive notebooks • Text, code, equations, plots, pictures, videos…
  5. 5. TNC18 Intelligent networks, cool edges? 5 CERNBox + +
  6. 6. TNC18 Intelligent networks, cool edges? 6 Scalable CERNBox & SWAN 6EOS File Storage Servers Ability to scale-out storage Management Node … Open Source disk-based storage
  7. 7. TNC18 Intelligent networks, cool edges? 7 Scalable CERNBox & SWAN 7EOS CERNBox File Storage Servers Ability to scale-out storage Management Node CERNBox Gateway … CERNBox Open Source disk-based storage Synchronization and Sharing
  8. 8. TNC18 Intelligent networks, cool edges? Open Source disk-based storage Scalable CERNBox & SWAN SWAN EOS CERNBox File Storage Servers Ability to scale-out storage Management Node CERNBox Gateway … JupyterHu b CVMFS Client EOS Fuse Mount Single-user Jupyter Server Ability to scale-out according to user population CERNBox Synchronization and Sharing Interactive Notebooks in a Browser
  9. 9. TNC18 Intelligent networks, cool edges? 9 Scalable CERNBox & SWAN SWAN EOS CERNBox File Storage Servers Ability to scale-out storage Management Node CERNBox Gateway User Sync Client … JupyterHu b CVMFS Client EOS Fuse Mount Single-user Jupyter Server Ability to scale-out according to user population CERNBox
  10. 10. TNC18 Intelligent networks, cool edges? 10 Open Cloud Mesh for Up2U CERN PSNC GWDG
  11. 11. TNC18 Intelligent networks, cool edges? 11 CERNBox demo
  12. 12. TNC18 Intelligent networks, cool edges? 12 CERNBox demo
  13. 13. TNC18 Intelligent networks, cool edges? 13 CERNBox demo List of user’s private file in her CERNBox She can:  Pick any file and add it to Moodle  Browse subfolders
  14. 14. TNC18 Intelligent networks, cool edges? 14 CERNBox demo Upon clicking on a file… As it will appear in Moodle Metadata from CERNBox
  15. 15. TNC18 Intelligent networks, cool edges? 15 SWAN demo
  16. 16. TNC18 Intelligent networks, cool edges? Thank you Any Questions? © GÉANT Association on behalf of the GN4-2 project. The research leading to these results has received funding from the European Union’s Horizon 2020research and innovation programmeunder Grant Agreement No. 731122 (GN4-2). contact@lists.up2university.eu

×