0
e-Infrastructure & Data Services
Features and implementations
Catania, 14/03/2014Riccardo Rotondo
riccardo.rotondo@ct.infn...
Outline
 Requirements
 e-Infrastructure Service
 Data Service
 Workflow
 Javadocs
 Implementations
 Demo
2
e-Infrastructure & Data Service
 We designed the architecture to provide a Service
accessible from your application.
 Mo...
e-Infrastructure Service
 Four different kind of e-Infrastructure identified:
 Local
 Remote
 Grid
 Cloud
 Possibili...
e-Infrastructure Service
 If you want to copy a file on a file system you plug-in
an external storage to it.
5
HFS
ext4
N...
e-Infrastructure Service
 On a SG now you are able to plug-in an e-
Infrastructure.
6
Local Storage
Remote Storage
Grid S...
Data Services
 Business logic related to file management totally
independent from the underneath technology
 All the com...
Data Service
8
Local Storage
Remote Storage
Grid Storage
Cloud Storage
Different
implementations
of the same
storage inter...
Upload
workflow
9
1.
Sign
in
Database
5. File
Upload
4. e-Infra
found
7. Update
6. Upload on
e-Infras
2. Upload
request
3....
Data Management on various
e-Infrastructures
10
Dec ’13:
release 0.1
Service Implementation
 Package name
 Namespace
 Entity
 Interface type
 Finder
 Ordered value
 One-to-many relatio...
Database created (automatically by service
buider)
12
mysql> show tables like 'eInfrSrv%';
+------------------------------...
Javadocs
13
 http://www.catania-science-gateways.it/javadocs/einfrsrv-portlet/index.html
Model & Service Implementation
14
Custom model
implementation
Custom service
implementation
Main features
15
 e-Infrastructure:
 Define several e-Infrastructures;
 Associate each e-Infra with Policy and Quota
 ...
e-Infrastructure Service
(it.infn.ct.einfrsrv.sb.service.impl.InfrastructureLocalServiceImpl)
16
 Infrastructure
getDefau...
Data Service Storage (it.infn.ct.einfrsrv.data.storage)
17
 java.lang.StringgetStoragePath()
 boolean isURLAvailable(jav...
Data Service File
(it.infn.ct.einfrsrv.sb.service.impl.FileLocalServiceImpl)
18
 boolean upload(long companyId, java.lang...
Data Service Directory
(it.infn.ct.einfrsrv.sb.service.impl.VirtualPathLocalServiceImpl)
19
 VirtualPath makeDir(java.lan...
Portlet accessing the service
20
 Add to liferay-plugin-package.properties:
 required-deployment-contexts=einfrsrv-portl...
Source & Binary
21
 Sourceforge:
http://sourceforge.net/p/ctsciencegtwys/einfsrv/sourc
es/HEAD/tree/
 Rel 0.1:
http://so...
Demo
22
 Whishing to see e-Infra & Data service in action? Request
access to GARR Science Gateway (https://sgw.garr.it)
...
Questions ?
23
Upcoming SlideShare
Loading in...5
×

e-Infrastructure & Data Service

249

Published on

Published in: Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
249
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "e-Infrastructure & Data Service"

  1. 1. e-Infrastructure & Data Services Features and implementations Catania, 14/03/2014Riccardo Rotondo riccardo.rotondo@ct.infn.it
  2. 2. Outline  Requirements  e-Infrastructure Service  Data Service  Workflow  Javadocs  Implementations  Demo 2
  3. 3. e-Infrastructure & Data Service  We designed the architecture to provide a Service accessible from your application.  Modular attachable resources available to the SG thanks to the straight coupled service that allows read/write data from several e-Infrastructures. 3
  4. 4. e-Infrastructure Service  Four different kind of e-Infrastructure identified:  Local  Remote  Grid  Cloud  Possibility of defining different Policy and Quota according e-infrastructures/users availability/needs  Default and favorite e-Infrastructures selectable  Disaster recovery and (cross) file replica. 4
  5. 5. e-Infrastructure Service  If you want to copy a file on a file system you plug-in an external storage to it. 5 HFS ext4 NFS FAT
  6. 6. e-Infrastructure Service  On a SG now you are able to plug-in an e- Infrastructure. 6 Local Storage Remote Storage Grid Storage Cloud Storage
  7. 7. Data Services  Business logic related to file management totally independent from the underneath technology  All the common features associated to file provided: create, copy, delete, move and sharing.  For each features, we implemented a different Storage Interface that translates the single commands according to the technology  All data are stored in different tables in order to let users organise files on a virtual file system. 7
  8. 8. Data Service 8 Local Storage Remote Storage Grid Storage Cloud Storage Different implementations of the same storage interface
  9. 9. Upload workflow 9 1. Sign in Database 5. File Upload 4. e-Infra found 7. Update 6. Upload on e-Infras 2. Upload request 3. e-Infra Discovery
  10. 10. Data Management on various e-Infrastructures 10 Dec ’13: release 0.1
  11. 11. Service Implementation  Package name  Namespace  Entity  Interface type  Finder  Ordered value  One-to-many relation  Many-to-many relation  Fake entity Riccardo RotondoTutorial on Science Gateways, Roma, service.xml
  12. 12. Database created (automatically by service buider) 12 mysql> show tables like 'eInfrSrv%'; +---------------------------------+ | Tables_in_lportal61 (eInfrSrv%) | +---------------------------------+ | eInfrSrv_File | | einfrsrv_files_tags | | einfrsrv_files_virtualpaths | | einfrsrv_infrastructure | | einfrsrv_properties | | einfrsrv_storageurls | | einfrsrv_tag | | einfrsrv_virtualpath | +---------------------------------+ File Directory File url on storage e-Infrastructures File tags Properties (reffered to e-Infra)
  13. 13. Javadocs 13  http://www.catania-science-gateways.it/javadocs/einfrsrv-portlet/index.html
  14. 14. Model & Service Implementation 14 Custom model implementation Custom service implementation
  15. 15. Main features 15  e-Infrastructure:  Define several e-Infrastructures;  Associate each e-Infra with Policy and Quota  Storage interface:  A standard interface defined to support any storage solution simply implementing the abstract method  Directory:  File tree data organisation
  16. 16. e-Infrastructure Service (it.infn.ct.einfrsrv.sb.service.impl.InfrastructureLocalServiceImpl) 16  Infrastructure getDefaultInfrastructure(long companyId, long userId, java.lang.String portletId, java.lang.String type)
  17. 17. Data Service Storage (it.infn.ct.einfrsrv.data.storage) 17  java.lang.StringgetStoragePath()  boolean isURLAvailable(java.lang.String url)  java.lang.StringputFile(java.lang.String filePath)  java.lang.StringputFile(java.lang.String source, java.lang.String destination)  boolean writeFileToStream(java.lang.String filePath, java.io.OutputStream out)  boolean removeFile(java.lang.String filePath)
  18. 18. Data Service File (it.infn.ct.einfrsrv.sb.service.impl.FileLocalServiceImpl) 18  boolean upload(long companyId, java.lang.String companyName, long userId, java.lang.String portletId, Infrastructure infraParam, java.lang.String fileName, java.lang.String source, java.lang.String virtualPathParam, java.lang.String[] tagsParam)  java.util.List<File> listFiles(long userId, java.lang.String virtualPathParam)  boolean writeFileToStream(long userId, long fileId, java.io.OutputStream out)  java.net.URL getURL(long userId, long fileId)
  19. 19. Data Service Directory (it.infn.ct.einfrsrv.sb.service.impl.VirtualPathLocalServiceImpl) 19  VirtualPath makeDir(java.lang.String parentPath, java.lang.String path, long userId)
  20. 20. Portlet accessing the service 20  Add to liferay-plugin-package.properties:  required-deployment-contexts=einfrsrv-portlet
  21. 21. Source & Binary 21  Sourceforge: http://sourceforge.net/p/ctsciencegtwys/einfsrv/sourc es/HEAD/tree/  Rel 0.1: http://sourceforge.net/p/ctsciencegtwys/einfsrv/sources/H EAD/tree/tags/release-0.1/  Binaryhttps://sourceforge.net/projects/ctsciencegtwys/files /eInfrastructureService/Release/0.1/
  22. 22. Demo 22  Whishing to see e-Infra & Data service in action? Request access to GARR Science Gateway (https://sgw.garr.it)  Remember the service is still under development so your feedback is welcome!
  23. 23. Questions ? 23
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×