SlideShare a Scribd company logo
1 of 26
Catania Science Gateway
Framework
Motivations, architecture, features
Catania, 10/03/2014Riccardo Rotondo
riccardo.rotondo@ct.infn.it
Catania Science Gateway Framerwork
2
 Authentication & Authorisation
 Job Management
 e-Infrastructure Service & Data Service
 Cloud
3
AuthN/AuthZ Schema
4
e-Infrastructures
Federation
2. Forwarded
to the IdP
Retrieve e-Infrastructure
credentialsScience Gateway
VAMP Workshop 2013 – Helsinki, 30/9-1/10/2013
Federated User
5
Science
Gateway
Social User
6
Science
Gateway
Roles & Privileges
 Surfing a Science Gateway changes according different
roles
 Mapping between Liferay roles and LDAP group
 Similar mapping available on grid (i.e. voms roles)
 Liferay allows administrator to fully customize users
experience assigning different roles to each components
(pages, wikis, plugins, data)
7
Liferay user database
 Liferay supports several system to store users data, both
local and remote
 Supporting the largest number of users in the easiest way
 A modular way to distinguish between different services
and privileges is need
 Science Gateways stores users on an LDAP server
8
Authentication
 Authentication is demanded on external IDP
 Communication between Liferay and the IDP happens
thanks to Shibboleth
 Shibboleth plugin, installed on Liferay, is responsible to
read the token coming from the IDP and to pass it to
Liferay
9
Authorisation
 Authorisation is demanded to the LDAP server
 Liferay, through a plugin implemented, request to
Shibboleth the mail address(es) an try a match with the
ones stored (local, remote)
10
Registration
 In the act of registration user data must be written on
the LDAP connected to Liferay
 A portlet has been developed to perform this actions
11
12
Integrated Services
GRIDCLOUD
JSR 168/268
JSR 168/268
JSR 168/268
JSR 168/268
Catania Science Gateway Framework
Local Cluster
13
Job Engine at
work
October 8th, 2013Riccardo Rotondo14
1. Sign in
eTokenServer
User
Track-
ing DB
5. e-Infra
Interactions
5.
Tracking
2. Grid
Request
6. Getting
Results
* or equivalent e-Infra auth
Job Engine - Architecture
WT
Worker Threads for Job Submission
WT
Worker Threads for
Job Check Status
USERS
TRACKING
DB
MONITORING
MODULE
Resources
Jobs Queue
WT WT
WT WT WT
WT
WT WT
Jobs
Submission
Jobs
Check status/
Get output
15
Glassfish Integration
 Access to database is not direct but make use of Glassfish
connection pools and hibernate
 JNDI resource are used as well in order to offer some
functionalities working behind the scene of job
submission:
 Thread pool responsible for job submission
 Thread pool responsible for job status updates
 Thread pool responsible for retrieving job output
16
17
Science Gateway paradigm
 Efforts to grant easy yet secure access to remote
services and related resources brought to the birth
of Science Gateways
 Virtual Research Communities access remote
resources in a collaboration environment that hides
the underlying complexity
 SGs help many users to better use the enormous
grid computational power
 Is large grid&cloud data
storage accessible as well in
such an easy way?
18
Motivations
Um… isn’t your
computer on fire
?
It’s ok, my files
are stored in a
safer place.
Image source: 1919
Grid Data Management Challenges
 Make interfaces simple for non expert users
 CLI-based Grid storage interface is not straightforward
 Transactions to different e-Infrastructures require
different authentication method
 Should this transaction involve the Science Gateway
directly?
 Complexity of current protocols to manage different
storage elements
 Offer an easy intuitive interface to the end users
20
Requirements
 Storage complexity hidden to end users
 Users move files from/to a portal and see it as simple
external storage accessible from a web interface and do
not care about grid (or any other) technologies behind
 File management smoothly integrated with all the
services provided in the SG
 Underlining architecture exposes a file-system-like
view (i.e., aVirtual File System orVFS) through which
users can perform the following actions:
 Create, move, delete files/directories with the desired
structure
 Share files with other users
 Set the number of backup copies desired
21
Implementations
 Virtual File System requires a database to map users,
virtual resource and real resource
 Object-relation mapping approach
 Liferay Service Builder
 Database tables are not used only to keep trace of
resource (file) but to define referring e-Infrastructures
too
 Planning to support up to 4 different e-Infrastructures:
local, remote, grid, cloud
22
References
 Catania Science Gateways url: http://www.catania-
science-gateways.it
 Catania Science Gateway Sourceforge Project:
http://sourceforge.net/projects/ctsciencegtwys/
 Gilda Portal (for developers): http://gilda.ct.infn.it/
23
24
My Cloud (cloud interoperability based on OCCI
Standard
25
Questions ?
26

More Related Content

Viewers also liked (6)

e-Infrastructure & Data Service
e-Infrastructure & Data Servicee-Infrastructure & Data Service
e-Infrastructure & Data Service
 
Job Managment Portlet
Job Managment PortletJob Managment Portlet
Job Managment Portlet
 
Gromacs on Science Gateway
Gromacs on Science GatewayGromacs on Science Gateway
Gromacs on Science Gateway
 
Web Application Development
Web Application DevelopmentWeb Application Development
Web Application Development
 
Portlets 2.0 JSR286
Portlets 2.0 JSR286Portlets 2.0 JSR286
Portlets 2.0 JSR286
 
Science Gateways: one portal, many e-Infrastructures and related services
Science Gateways: one portal, many e-Infrastructures and related servicesScience Gateways: one portal, many e-Infrastructures and related services
Science Gateways: one portal, many e-Infrastructures and related services
 

Similar to Catania Science Gateway Framework

Ogce Workflow Suite
Ogce Workflow SuiteOgce Workflow Suite
Ogce Workflow Suite
smarru
 

Similar to Catania Science Gateway Framework (20)

Apache Airavata SGCI Webinar 8 April 2020
Apache Airavata SGCI Webinar 8 April 2020Apache Airavata SGCI Webinar 8 April 2020
Apache Airavata SGCI Webinar 8 April 2020
 
FIWARE Generic Enablers introduction
FIWARE Generic Enablers introductionFIWARE Generic Enablers introduction
FIWARE Generic Enablers introduction
 
FIWARE Overview of Generic Enablers
FIWARE Overview of Generic EnablersFIWARE Overview of Generic Enablers
FIWARE Overview of Generic Enablers
 
IRJET- Blockchain based Secure Data Storage
IRJET-  	  Blockchain based Secure Data StorageIRJET-  	  Blockchain based Secure Data Storage
IRJET- Blockchain based Secure Data Storage
 
Zou Layered VO PDCAT2008 V0.5 Concise
Zou Layered VO PDCAT2008 V0.5 ConciseZou Layered VO PDCAT2008 V0.5 Concise
Zou Layered VO PDCAT2008 V0.5 Concise
 
stackconf 2021 | Setup Min.io and Open Policy Agent for a multi purpose scien...
stackconf 2021 | Setup Min.io and Open Policy Agent for a multi purpose scien...stackconf 2021 | Setup Min.io and Open Policy Agent for a multi purpose scien...
stackconf 2021 | Setup Min.io and Open Policy Agent for a multi purpose scien...
 
Adoption Blockchain Smart Contracts in Developing Information Systems.pdf
Adoption Blockchain Smart Contracts in Developing Information Systems.pdfAdoption Blockchain Smart Contracts in Developing Information Systems.pdf
Adoption Blockchain Smart Contracts in Developing Information Systems.pdf
 
Ogce Workflow Suite
Ogce Workflow SuiteOgce Workflow Suite
Ogce Workflow Suite
 
StratusLab: A IaaS Cloud Distribution Focusing on Simplicity
StratusLab: A IaaS Cloud Distribution Focusing on SimplicityStratusLab: A IaaS Cloud Distribution Focusing on Simplicity
StratusLab: A IaaS Cloud Distribution Focusing on Simplicity
 
The Overview of Discovery and Reconciliation of LTE Network
The Overview of Discovery and Reconciliation of LTE NetworkThe Overview of Discovery and Reconciliation of LTE Network
The Overview of Discovery and Reconciliation of LTE Network
 
OSFair2017 Workshop | EGI applications database
OSFair2017 Workshop | EGI applications databaseOSFair2017 Workshop | EGI applications database
OSFair2017 Workshop | EGI applications database
 
Integration of Things (Sam Vanhoutte @Iglooconf 2017)
Integration of Things (Sam Vanhoutte @Iglooconf 2017) Integration of Things (Sam Vanhoutte @Iglooconf 2017)
Integration of Things (Sam Vanhoutte @Iglooconf 2017)
 
IRJET- Sandbox Technology
IRJET- Sandbox TechnologyIRJET- Sandbox Technology
IRJET- Sandbox Technology
 
C04932125
C04932125C04932125
C04932125
 
IRJET - Cloud based Datacenter in Virtual Private Network
IRJET - Cloud based Datacenter in Virtual Private NetworkIRJET - Cloud based Datacenter in Virtual Private Network
IRJET - Cloud based Datacenter in Virtual Private Network
 
Sup documentation
Sup documentationSup documentation
Sup documentation
 
StratusLab at FOSDEM'13
StratusLab at FOSDEM'13StratusLab at FOSDEM'13
StratusLab at FOSDEM'13
 
Real Time, Web 2.0, and Grid Systems
Real Time, Web 2.0, and Grid Systems Real Time, Web 2.0, and Grid Systems
Real Time, Web 2.0, and Grid Systems
 
Introduction to FIWARE Cloud & Context Broker
Introduction to FIWARE Cloud & Context BrokerIntroduction to FIWARE Cloud & Context Broker
Introduction to FIWARE Cloud & Context Broker
 
LOD2 webinar series: Virtuoso by OpenLink Software
LOD2 webinar series: Virtuoso by OpenLink SoftwareLOD2 webinar series: Virtuoso by OpenLink Software
LOD2 webinar series: Virtuoso by OpenLink Software
 

Recently uploaded

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 

Recently uploaded (20)

Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxOn_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the Classroom
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptxExploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
REMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptxREMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptx
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 

Catania Science Gateway Framework

  • 1. Catania Science Gateway Framework Motivations, architecture, features Catania, 10/03/2014Riccardo Rotondo riccardo.rotondo@ct.infn.it
  • 2. Catania Science Gateway Framerwork 2  Authentication & Authorisation  Job Management  e-Infrastructure Service & Data Service  Cloud
  • 3. 3
  • 4. AuthN/AuthZ Schema 4 e-Infrastructures Federation 2. Forwarded to the IdP Retrieve e-Infrastructure credentialsScience Gateway VAMP Workshop 2013 – Helsinki, 30/9-1/10/2013
  • 7. Roles & Privileges  Surfing a Science Gateway changes according different roles  Mapping between Liferay roles and LDAP group  Similar mapping available on grid (i.e. voms roles)  Liferay allows administrator to fully customize users experience assigning different roles to each components (pages, wikis, plugins, data) 7
  • 8. Liferay user database  Liferay supports several system to store users data, both local and remote  Supporting the largest number of users in the easiest way  A modular way to distinguish between different services and privileges is need  Science Gateways stores users on an LDAP server 8
  • 9. Authentication  Authentication is demanded on external IDP  Communication between Liferay and the IDP happens thanks to Shibboleth  Shibboleth plugin, installed on Liferay, is responsible to read the token coming from the IDP and to pass it to Liferay 9
  • 10. Authorisation  Authorisation is demanded to the LDAP server  Liferay, through a plugin implemented, request to Shibboleth the mail address(es) an try a match with the ones stored (local, remote) 10
  • 11. Registration  In the act of registration user data must be written on the LDAP connected to Liferay  A portlet has been developed to perform this actions 11
  • 12. 12
  • 13. Integrated Services GRIDCLOUD JSR 168/268 JSR 168/268 JSR 168/268 JSR 168/268 Catania Science Gateway Framework Local Cluster 13
  • 14. Job Engine at work October 8th, 2013Riccardo Rotondo14 1. Sign in eTokenServer User Track- ing DB 5. e-Infra Interactions 5. Tracking 2. Grid Request 6. Getting Results * or equivalent e-Infra auth
  • 15. Job Engine - Architecture WT Worker Threads for Job Submission WT Worker Threads for Job Check Status USERS TRACKING DB MONITORING MODULE Resources Jobs Queue WT WT WT WT WT WT WT WT Jobs Submission Jobs Check status/ Get output 15
  • 16. Glassfish Integration  Access to database is not direct but make use of Glassfish connection pools and hibernate  JNDI resource are used as well in order to offer some functionalities working behind the scene of job submission:  Thread pool responsible for job submission  Thread pool responsible for job status updates  Thread pool responsible for retrieving job output 16
  • 17. 17
  • 18. Science Gateway paradigm  Efforts to grant easy yet secure access to remote services and related resources brought to the birth of Science Gateways  Virtual Research Communities access remote resources in a collaboration environment that hides the underlying complexity  SGs help many users to better use the enormous grid computational power  Is large grid&cloud data storage accessible as well in such an easy way? 18
  • 19. Motivations Um… isn’t your computer on fire ? It’s ok, my files are stored in a safer place. Image source: 1919
  • 20. Grid Data Management Challenges  Make interfaces simple for non expert users  CLI-based Grid storage interface is not straightforward  Transactions to different e-Infrastructures require different authentication method  Should this transaction involve the Science Gateway directly?  Complexity of current protocols to manage different storage elements  Offer an easy intuitive interface to the end users 20
  • 21. Requirements  Storage complexity hidden to end users  Users move files from/to a portal and see it as simple external storage accessible from a web interface and do not care about grid (or any other) technologies behind  File management smoothly integrated with all the services provided in the SG  Underlining architecture exposes a file-system-like view (i.e., aVirtual File System orVFS) through which users can perform the following actions:  Create, move, delete files/directories with the desired structure  Share files with other users  Set the number of backup copies desired 21
  • 22. Implementations  Virtual File System requires a database to map users, virtual resource and real resource  Object-relation mapping approach  Liferay Service Builder  Database tables are not used only to keep trace of resource (file) but to define referring e-Infrastructures too  Planning to support up to 4 different e-Infrastructures: local, remote, grid, cloud 22
  • 23. References  Catania Science Gateways url: http://www.catania- science-gateways.it  Catania Science Gateway Sourceforge Project: http://sourceforge.net/projects/ctsciencegtwys/  Gilda Portal (for developers): http://gilda.ct.infn.it/ 23
  • 24. 24
  • 25. My Cloud (cloud interoperability based on OCCI Standard 25