0
CommunityCommunity
Clouds from ScratchClouds from Scratch
A Real World Introduction
jguijarro@cesca..cat – Berlin 2013 Ope...
About
What CloudWhat Cloud
Computing reallyComputing really
means for R&Emeans for R&E
A strategy, a tactical solution...
jguija...
A Research and Education Network is a
non-profit Internet service provider
dedicated to supporting the needs of the
resear...
R&E Networks
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
JUST A BUZZWORD?
What Cloud Computing really means for R&E Community ?
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf ...
What Cloud Computing really means
SELFSERVICE(s)?
jguijarro@cescajguijarro@cesca,.cat – Reykjavik 2012,.cat – Reykjavik 20...
What Cloud Computing really mean for R&E Community?
RESPONSIBILITIES...
jguijarro@cescajguijarro@cesca,.cat – Reykjavik 20...
MEGHA WorkingMEGHA Working
GroupGroup
Let's pull all together...
jguijarro@cescajguijarro@cesca,.cat – Reykjavik 2012,.cat...
MISSION
MEGHA Working Group
the development of
innovation in Cloud
Computing technologies
within the scope of the
institut...
Deploy a federated Cloud infrastructure
as a platform for innovation and
evaluation.
Explore the possibilities for the
app...
MEGHA IntercloudMEGHA Intercloud
projectproject
From myth to reality...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf...
INITIAL STAGE
MEGHA Intercloud Project
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
CESCA Cloud InfrastructureCESCA Cloud Infrastructure
CESGA Cloud InfrastructureCESGA Cloud Infrastructure
INTEROPERABILITY
MEGHA Intercloud Project
A “Virtual Poka Yoke” ?A “Virtual Poka Yoke” ?
jguijarro@cesca..cat – Berlin 201...
OPEN PLEASE!
MEGHA Intercloud Project
Director,...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
INTEROPERABLE
MEGHA Intercloud Project
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
FEDERATED
MEGHA Intercloud Project
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
FEDERATED
MEGHA Intercloud Project
PKIRISGRID
X.509 Cert
UI
OpenNebula3.8
r
jguijarro@cesca..cat – Berlin 2013 OpenNebula ...
Public high speed connectivity.
Images, instances and networks management.
SSH access (root).
User manual & Service Provid...
MAIN PLAYERS
MEGHA Intercloud Project
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
Some Real WorldSome Real World
User CasesUser Cases
Cloudified...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
UOC: Learning Apps
REAL WORLD USER CASES
A store on the
internet inspired by
Apple's App Store
which focuses on
educationa...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
PIC: Grid & Cloud
REAL WORLD USER CASES
DIRAC (Interware)
allows homogeneous
access to
heterogeneous
computing resources.
...
PIC: Grid & Cloud
REAL WORLD USER CASES
DIRAC WMS
Task
Queue
VM Scheduler
VM Director
MeghaCloud
Infrastructure
Command-li...
PIC: Grid & Cloud
REAL WORLD USER CASES
Víctor Méndez (www.pic.es)
DIRAC WMS
Task
Queue
VM Scheduler
OCCI Director
(VM Dir...
PIC: Grid & Cloud
REAL WORLD USER CASES
jguijarro@cescajguijarro@cesca,.cat – Reykjavik 2012,.cat – Reykjavik 2012 TNC 201...
Next Steps...Next Steps...
This is only the tip of the iceberg
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
DETECTED PROBLEMS
NEXT STEPS...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
Small and medium Scientific Resear...
TEST PLATFORM
NEXT STEPS FOR...
VO's ? SUNSTONE FEDERATION ?
COMPATIBILITY AND FEATURES
TO BUILD A MARKETPLACE ?
jguijarro...
REAL SCENARIO
NEXT STEPS...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
SomeSome
conclusions...conclusions...
Options to cater to all tastes!
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2...
NEW CHALLENGES
NEXT STEPS...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
Federated user authentication and aut...
Distributed scenario
FUTURE COMMUNITY FEDERATED CLOUD MODELFUTURE COMMUNITY FEDERATED CLOUD MODEL
Scalability (Commercial ...
Strategy, strategy, strategy, ...
Dedicated to those who made ​​MEGHA possible.
Gràcies!Gràcies!
Gracias!Gracias!
ThanksTh...
Community Clouds from Scratch
Community Clouds from Scratch
Upcoming SlideShare
Loading in...5
×

Community Clouds from Scratch

2,153

Published on

Cloud Computing represents a radical change in the way we organize and use computing resources and storage. The scientific and academic communities face the challenge of not only adapting their procedures to this new paradigm, but also contributing Cloud Computing development and leading its evolution towards open, secure and interoperable computing infrastructures, which will playing a key role in the community clouds paradigm.

The Spanish MEGHA initiative promotes and coordinates contributions to cloud computing R&D, education and management made by institutions affiliated with RedIRIS [7] in Spain. In the first phase (2010–2012), MEGHA validated federated cloud platforms using Opennebula and OCCI [10] to streamline the use of cloud technologies among R&E service centers. Representative infrastructure providers (CESCA, CESGA, PIC), middleware providers (OpenNebula, RedIRIS, OSAmI-Commons) and users (UAB, UOC, UM) together with intermediate/identity/brokers resources (RedIRIS) joined efforts to demonstrate the viability of this approach.

The results stimulated the development of use cases including e-learning platforms on demand (Learning Apps project), a distributed HPC platform (e-Science), and Virtual Labs (VDI) in a hybrid scenario (Academic services).

Next Steps?

As next goal, the Spanish research and academic community is working to assess the possibilities of creating a productive Infrastructure Cloud Computing service within member institutions. With this new approach new challenges appear:

Federated user authentication and authorization mechanisms.
Brokering architecture scenario.
Secure VM image distribution and validation.
A federated cloud accounting system integrating the accounting records of multiple cloud managers and supporting federated cloud governance.
Monitoring and notification of unpredictable changes in availability and readability status.
Security Policies and Service Level Agreements (SLA’s).

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
2,153
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
12
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Community Clouds from Scratch"

  1. 1. CommunityCommunity Clouds from ScratchClouds from Scratch A Real World Introduction jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013 Jordi Guijarro - jguijarro@cesca.cat @cloudadms
  2. 2. About
  3. 3. What CloudWhat Cloud Computing reallyComputing really means for R&Emeans for R&E A strategy, a tactical solution... jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  4. 4. A Research and Education Network is a non-profit Internet service provider dedicated to supporting the needs of the research and education communities. It has a high-speed backbone network. Research and Education Networks are usually the places where new Internet protocols and architectures are introduced before their public deployment: R&E Networks Protocols: IPv6 and multicast. Architecture: Client/Server and Cloud Computing jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  5. 5. R&E Networks jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  6. 6. JUST A BUZZWORD? What Cloud Computing really means for R&E Community ? jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  7. 7. What Cloud Computing really means SELFSERVICE(s)? jguijarro@cescajguijarro@cesca,.cat – Reykjavik 2012,.cat – Reykjavik 2012 TNC 2012TNC 2012jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  8. 8. What Cloud Computing really mean for R&E Community? RESPONSIBILITIES... jguijarro@cescajguijarro@cesca,.cat – Reykjavik 2012,.cat – Reykjavik 2012 TNC 2012TNC 2012jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  9. 9. MEGHA WorkingMEGHA Working GroupGroup Let's pull all together... jguijarro@cescajguijarro@cesca,.cat – Reykjavik 2012,.cat – Reykjavik 2012 TNC 2012TNC 2012jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  10. 10. MISSION MEGHA Working Group the development of innovation in Cloud Computing technologies within the scope of the institutions affiliated to RedIRIS for the application of open and interoperable Cloud technologies in other areas in which it can influence, such as business in government. TO PROMOTE TO ACT AS A CATALYST INTEROPERABLE OPEN PROMOTION USE CASES TESTBED IDENTITY http://wiki.rediris.es/megha jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  11. 11. Deploy a federated Cloud infrastructure as a platform for innovation and evaluation. Explore the possibilities for the application of Cloud computing has in research, academic and management environments. Facilitate the creation of an ecosystem of open-source middleware components to deploy interoperable Clouds and coordinate training and education activities for its deployment. MAIN OBJECTIVES MEGHA Working Group jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  12. 12. MEGHA IntercloudMEGHA Intercloud projectproject From myth to reality... jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  13. 13. INITIAL STAGE MEGHA Intercloud Project jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  14. 14. CESCA Cloud InfrastructureCESCA Cloud Infrastructure
  15. 15. CESGA Cloud InfrastructureCESGA Cloud Infrastructure
  16. 16. INTEROPERABILITY MEGHA Intercloud Project A “Virtual Poka Yoke” ?A “Virtual Poka Yoke” ? jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  17. 17. OPEN PLEASE! MEGHA Intercloud Project Director,... jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  18. 18. INTEROPERABLE MEGHA Intercloud Project jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  19. 19. FEDERATED MEGHA Intercloud Project jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  20. 20. FEDERATED MEGHA Intercloud Project PKIRISGRID X.509 Cert UI OpenNebula3.8 r jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  21. 21. Public high speed connectivity. Images, instances and networks management. SSH access (root). User manual & Service Provider Howtos (ONE 3.x) “Terms of Service”. MATURING TOGETHER jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  22. 22. MAIN PLAYERS MEGHA Intercloud Project jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  23. 23. Some Real WorldSome Real World User CasesUser Cases Cloudified... jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  24. 24. UOC: Learning Apps REAL WORLD USER CASES A store on the internet inspired by Apple's App Store which focuses on educational applications The provision of the educational environments is automated (OCCI 0.8) and the amount of infr. depends on parameters such as a preconfigured concurrency. RESTFUL API http://www.learningappsstore.org/ ON DEMAND ACADEMICACADEMIC EDUCATION AUTOMATION CONTEXTUALIZATION jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  25. 25. jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  26. 26. PIC: Grid & Cloud REAL WORLD USER CASES DIRAC (Interware) allows homogeneous access to heterogeneous computing resources. Providing transparent access and interoperability between Grids and Clouds OCCI 1.1 interface. SCIENTIFICINTEGRATION CONTEXTUALIZATION DIRACINTERWARE Víctor Méndez (www.pic.es) jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  27. 27. PIC: Grid & Cloud REAL WORLD USER CASES DIRAC WMS Task Queue VM Scheduler VM Director MeghaCloud Infrastructure Command-line DIRAC API Web Portal Virtual Machine User Admin Image Repo Cloud Manager DIRAC CS Cloud Driver Integration Design: VM Job Running Víctor Méndez (www.pic.es) jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  28. 28. PIC: Grid & Cloud REAL WORLD USER CASES Víctor Méndez (www.pic.es) DIRAC WMS Task Queue VM Scheduler OCCI Director (VM Director) MeghaCloud Infrastructure Virtual Machine Image Repo OCCI / OpenNebula ? OCCI Image OCCI RESTful Client Integration Design: Occi VM Submission jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  29. 29. PIC: Grid & Cloud REAL WORLD USER CASES jguijarro@cescajguijarro@cesca,.cat – Reykjavik 2012,.cat – Reykjavik 2012 TNC 2012TNC 2012 Virtual Machine VM Monitor Job Agent DIRAC WMS Task Queue VM Manager Job Cloud Manager Virtual Machine MeghaCloud Infrastructure VM VM VM Job Run CPU statistics Job State Update Job Matcher Víctor Méndez (www.pic.es) Integration Design: VM Job Running jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  30. 30. Next Steps...Next Steps... This is only the tip of the iceberg jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  31. 31. DETECTED PROBLEMS NEXT STEPS... jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013 Small and medium Scientific Research centers don ́t have the manpower or know-how to build a 24/365 data center Server deployment takes a long time Can ́t solve peak problems Usually can ́t have more than one data center
  32. 32. TEST PLATFORM NEXT STEPS FOR... VO's ? SUNSTONE FEDERATION ? COMPATIBILITY AND FEATURES TO BUILD A MARKETPLACE ? jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  33. 33. REAL SCENARIO NEXT STEPS... jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  34. 34. SomeSome conclusions...conclusions... Options to cater to all tastes! jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  35. 35. NEW CHALLENGES NEXT STEPS... jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013 Federated user authentication and authorization mechanisms and user management between different cloud managers. Secure VM image distribution and validation. among heterogeneous cloud managers. Federated Cloud accounting system integrating the accounting records of multiple cloud managers and supporting the Federated Cloud governance. Monitoring and notification of unpredictable change of availability.
  36. 36. Distributed scenario FUTURE COMMUNITY FEDERATED CLOUD MODELFUTURE COMMUNITY FEDERATED CLOUD MODEL Scalability (Commercial prov. included) Resource sharing High Availability Efficient use of infrastructure jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
  37. 37. Strategy, strategy, strategy, ... Dedicated to those who made ​​MEGHA possible. Gràcies!Gràcies! Gracias!Gracias! ThanksThanks!! Jordi Guijarro jguijarro@cesca.cat @cloudadms
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×