1
Building a University Community PaaS
Using Cloud Foundry
Yaohui Jin, Deputy Director, Network & Information Center,
Shanghai Jiao Tong University, China
Wei-Min Lu, CEO, Anchora/MoPaaS, China
2014-06-10
2
About SJTU and NIC
 Shanghai Jiao Tong University (SJTU)
• One of the top 5 universities in China
• Faculty & staff members: 7,000+
• Students: 36,000+
 Center for Network & Information (NIC)
• Providing IT services for education and research etc
• 40+ employees
• π, No. 204 of TOP500 supercomputer
• 250+ servers in datacenter
6/19/2014
3
About Anchora
• Leading Cloud Platform & Service Provider
in China
– Streamlines app lifecycle management
– The first open public PaaS (MoPaaS) in China
– MoPaaS national network consolidates public/
community PaaS’s
– Top ten most innovative cloud company in China
• Products and Services: MoPaaS
– Public PaaS
– Virtual Private/Community PaaS
– MoPaaS Enterprise Edition: InPaaS
6/19/2014
4
The MoPaaS Network in China
• MoPaaS Core System
– MoPaaS Cloud App Engine
– Virtual Private Cloud PaaS
• MoPaaS Extended System
– Public Cloud Service Providers
– Community Cloud Service Providers
– MoPaaS Integration
• MoPaaS Cloud Services
– Virtual Private PaaS
– Virtual Community PaaS
– Public PaaS
6/19/2014
5
SJTU PaaS Jointly Built and Operated
by SJTU NIC and Anchora/MoPaaS
The First University Community PaaS in China
http://www.cf.sjtu.edu.cn/
6/19/2014
6
Requirements for SJTU PaaS
 Research:Providing research individuals & groups with a unified IT
environment for research projects
 Teaching:A unified development/testing environment for class projects
• The students develop their code on their PCs, and then deploy and test their
apps on the PaaS.
• The teachers monitor the students’ progresses, and run and evaluate their
projects on the PaaS
 Innovation and Entrepreneurship:The university encourages
entrepreneurship; an online incubator for students
6/19/2014
7
The SJTU PaaS Is Built on OpenStack
Controller 2×E5 2670,64GB,2×300GB,10GE
Compute Node 2×E5 2670,64GB,2×300GB SAS + 4×3TB SATA,10GE
Storage Node 2×E5 2670,64GB,12×2T SATA,10GE
Networking 10GE
6/19/2014
8
SJTU PaaS Is Based on Cloud Foundry
6/19/2014
The third party
services
Services
9
SJTU PaaS Integration with MoPaaS
• MoPaaS Core Systems
– MoPaaS Cloud App Engine
– Virtual Private Cloud PaaS
• SJTU PaaS System
– Community PaaS
– MoPaaS Integration
• Extended PaaS Services
– Limited resources with SJTU PaaS
– Easy Migration to MoPaaS
6/19/2014
10
Case Studies: Innovation
• The Mobile App Innovation Challenge at STJU
• 67 teams
• Apps on the CF-based PaaS
6/19/2014
11
Case Study:SJTU WIFI Monitoring Platform
6/19/2014
12
Case Study: Air Pollution Monitoring and
Analyzing System
6/19/2014
13
Summary
 SJTU PaaS Is Based on Cloud Foundry
• The first community PaaS in China
• Built on SJTU NIC OpenStack-based IaaS
• Based on MoPaaS
 SJTU PaaS Is Used as a Platform for
• Research
• Teaching
• Innovation and Entrepreneurship
6/19/2014
14
Contact Us
 Prof. Yaohui Jin:
• Deputy Director, SJTU NIC
• jinyh@sjtu.edu.cn
• +86-139-1848-5071
 Dr. Wei-Min Lu:
• CEO, Anchora/CEO
• wmlu@anchora.me
• +1-408-658-8166
• +86-186-2623-3286
6/19/2014
© 2014
FOUR LEVELS OF HA IN CLOUD FOUNDRY
Cornelia Davis  @cdavisafc  cdavis@gopivotal.com
I work on a PaaS…
“For us, PaaS is a set of services aimed at
developers that helps them develop and test apps
without having to worry about the underlying
infrastructure. Developers don't want to have to
worry about provisioning the servers, storage and
backup associated with developing and launching
an app.”
[1] http://www.javaworld.com/article/2078801/java-app-dev/forrester--paas-makes-developers-happy.html
[2] http://www.infoworld.com/d/cloud-computing/paas-primer-what-platform-service-and-why-does-it-matter-212696
I work on a PaaS…
“For us, PaaS is a set of services aimed at
developers that helps them develop and test apps
without having to worry about the underlying
infrastructure. Developers don't want to have to
worry about provisioning the servers, storage and
backup associated with developing and launching
an app.”
[1] http://www.javaworld.com/article/2078801/java-app-dev/forrester--paas-makes-developers-happy.html
[2] http://www.infoworld.com/d/cloud-computing/paas-primer-what-platform-service-and-why-does-it-matter-212696
Application Instances and Availability Zones
Router
DEA
DEA
DEA
Cloud Foundry
Elastic Runtime
DEA
DEA
DEA
Zone 1 Zone 2
App Ops
Application Instances and Availability Zones
Router
DEA
DEA
DEA
Cloud Foundry
Elastic Runtime
DEA
DEA
DEA
Zone 1 Zone 2 Application instances are
evenly distributed over
two availability zones.
App Ops
Application Instances and Availability Zones
Router
DEA
DEA
DEA
Cloud Foundry
Elastic Runtime
DEA
DEA
DEA
Zone 1 Zone 2 Application instances are
evenly distributed over
two availability zones.
Loosing an AZ keeps
instances running and
available.
App Ops
Router
Failed Application Instances Replaced
Blobstore
Cloud
Controller
Health Manager
Messaging
(NATS)
DEA DEA DEA
App Ops
Cloud Foundry
Elastic Runtime
Router
Failed Application Instances Replaced
Blobstore
Cloud
Controller
Health Manager
Actual State
Messaging
(NATS)
DEA DEA DEA
App Ops
Cloud Foundry
Elastic Runtime
Router
Failed Application Instances Replaced
Blobstore
Cloud
Controller
Health Manager
Actual StateDesired State
Messaging
(NATS)
DEA DEA DEA
App Ops
Cloud Foundry
Elastic Runtime
Router
Failed Application Instances Replaced
Blobstore
Cloud
Controller
Health Manager
Actual StateDesired State
Messaging
(NATS)
DEA DEA DEA
App Ops
Cloud Foundry
Elastic Runtime
Router
Failed Application Instances Replaced
Blobstore
Cloud
Controller
Health Manager
Actual StateDesired State
Messaging
(NATS)
DEA DEA DEA
App Ops
Cloud Foundry
Elastic Runtime
Message Bus
ERS Processes are Monitored
IaaSCloud Foundry BOSH
Health Monitor
Health Manager
DEA
Cloud Controller
Responders:
pager
email
monitoring
…
PaaS Ops
Message Bus
ERS Processes are Monitored
IaaSCloud Foundry BOSH
Health Monitor
Health Manager
DEA
Cloud Controller
Responders:
pager
email
monitoring
…
PaaS Ops
Message Bus
ERS Processes are Monitored
IaaSCloud Foundry BOSH
Health Monitor
Health Manager
DEA
Cloud Controller
Responders:
pager
email
monitoring
…
PaaS Ops
Message Bus
VMs are Monitored
IaaS
Health Monitor
Health Manager
Cloud Controller
DEA
Responders:
pager
email
monitoring
resurrector
…
BOSH Director
Actual State
DEA
PaaS Ops
Cloud Foundry BOSH
Message Bus
VMs are Monitored
IaaS
Health Monitor
Health Manager
Cloud Controller
DEA
Responders:
pager
email
monitoring
resurrector
…
BOSH Director
Actual State
DEA
PaaS Ops
Cloud Foundry BOSH
Desired State
Message Bus
VMs are Monitored
IaaS
Health Monitor
Health Manager
Cloud Controller
DEA
Responders:
pager
email
monitoring
resurrector
…
BOSH Director
Actual StateDesired State
PaaS Ops
Cloud Foundry BOSH
Message Bus
VMs are Monitored
IaaS
Health Monitor
Health Manager
Cloud Controller
Responders:
pager
email
monitoring
resurrector
…
BOSH Director
(CPI)
Actual StateDesired State
DEA
PaaS Ops
Cloud Foundry BOSH
Four levels of HA in PCF
Elastic Runtime (ERS):
Distribution across availability zones
Application health management and recovery
BOSH (cluster management):
Process monitoring, recovery and alerting
Virtual machine health monitoring, recovery
and alerting

Building a University Community PaaS Using Cloud Foundry (Cloud Foundry Summit 2014)

  • 1.
    1 Building a UniversityCommunity PaaS Using Cloud Foundry Yaohui Jin, Deputy Director, Network & Information Center, Shanghai Jiao Tong University, China Wei-Min Lu, CEO, Anchora/MoPaaS, China 2014-06-10
  • 2.
    2 About SJTU andNIC  Shanghai Jiao Tong University (SJTU) • One of the top 5 universities in China • Faculty & staff members: 7,000+ • Students: 36,000+  Center for Network & Information (NIC) • Providing IT services for education and research etc • 40+ employees • π, No. 204 of TOP500 supercomputer • 250+ servers in datacenter 6/19/2014
  • 3.
    3 About Anchora • LeadingCloud Platform & Service Provider in China – Streamlines app lifecycle management – The first open public PaaS (MoPaaS) in China – MoPaaS national network consolidates public/ community PaaS’s – Top ten most innovative cloud company in China • Products and Services: MoPaaS – Public PaaS – Virtual Private/Community PaaS – MoPaaS Enterprise Edition: InPaaS 6/19/2014
  • 4.
    4 The MoPaaS Networkin China • MoPaaS Core System – MoPaaS Cloud App Engine – Virtual Private Cloud PaaS • MoPaaS Extended System – Public Cloud Service Providers – Community Cloud Service Providers – MoPaaS Integration • MoPaaS Cloud Services – Virtual Private PaaS – Virtual Community PaaS – Public PaaS 6/19/2014
  • 5.
    5 SJTU PaaS JointlyBuilt and Operated by SJTU NIC and Anchora/MoPaaS The First University Community PaaS in China http://www.cf.sjtu.edu.cn/ 6/19/2014
  • 6.
    6 Requirements for SJTUPaaS  Research:Providing research individuals & groups with a unified IT environment for research projects  Teaching:A unified development/testing environment for class projects • The students develop their code on their PCs, and then deploy and test their apps on the PaaS. • The teachers monitor the students’ progresses, and run and evaluate their projects on the PaaS  Innovation and Entrepreneurship:The university encourages entrepreneurship; an online incubator for students 6/19/2014
  • 7.
    7 The SJTU PaaSIs Built on OpenStack Controller 2×E5 2670,64GB,2×300GB,10GE Compute Node 2×E5 2670,64GB,2×300GB SAS + 4×3TB SATA,10GE Storage Node 2×E5 2670,64GB,12×2T SATA,10GE Networking 10GE 6/19/2014
  • 8.
    8 SJTU PaaS IsBased on Cloud Foundry 6/19/2014 The third party services Services
  • 9.
    9 SJTU PaaS Integrationwith MoPaaS • MoPaaS Core Systems – MoPaaS Cloud App Engine – Virtual Private Cloud PaaS • SJTU PaaS System – Community PaaS – MoPaaS Integration • Extended PaaS Services – Limited resources with SJTU PaaS – Easy Migration to MoPaaS 6/19/2014
  • 10.
    10 Case Studies: Innovation •The Mobile App Innovation Challenge at STJU • 67 teams • Apps on the CF-based PaaS 6/19/2014
  • 11.
    11 Case Study:SJTU WIFIMonitoring Platform 6/19/2014
  • 12.
    12 Case Study: AirPollution Monitoring and Analyzing System 6/19/2014
  • 13.
    13 Summary  SJTU PaaSIs Based on Cloud Foundry • The first community PaaS in China • Built on SJTU NIC OpenStack-based IaaS • Based on MoPaaS  SJTU PaaS Is Used as a Platform for • Research • Teaching • Innovation and Entrepreneurship 6/19/2014
  • 14.
    14 Contact Us  Prof.Yaohui Jin: • Deputy Director, SJTU NIC • jinyh@sjtu.edu.cn • +86-139-1848-5071  Dr. Wei-Min Lu: • CEO, Anchora/CEO • wmlu@anchora.me • +1-408-658-8166 • +86-186-2623-3286 6/19/2014
  • 15.
  • 16.
    FOUR LEVELS OFHA IN CLOUD FOUNDRY Cornelia Davis  @cdavisafc  cdavis@gopivotal.com
  • 17.
    I work ona PaaS… “For us, PaaS is a set of services aimed at developers that helps them develop and test apps without having to worry about the underlying infrastructure. Developers don't want to have to worry about provisioning the servers, storage and backup associated with developing and launching an app.” [1] http://www.javaworld.com/article/2078801/java-app-dev/forrester--paas-makes-developers-happy.html [2] http://www.infoworld.com/d/cloud-computing/paas-primer-what-platform-service-and-why-does-it-matter-212696
  • 18.
    I work ona PaaS… “For us, PaaS is a set of services aimed at developers that helps them develop and test apps without having to worry about the underlying infrastructure. Developers don't want to have to worry about provisioning the servers, storage and backup associated with developing and launching an app.” [1] http://www.javaworld.com/article/2078801/java-app-dev/forrester--paas-makes-developers-happy.html [2] http://www.infoworld.com/d/cloud-computing/paas-primer-what-platform-service-and-why-does-it-matter-212696
  • 19.
    Application Instances andAvailability Zones Router DEA DEA DEA Cloud Foundry Elastic Runtime DEA DEA DEA Zone 1 Zone 2 App Ops
  • 20.
    Application Instances andAvailability Zones Router DEA DEA DEA Cloud Foundry Elastic Runtime DEA DEA DEA Zone 1 Zone 2 Application instances are evenly distributed over two availability zones. App Ops
  • 21.
    Application Instances andAvailability Zones Router DEA DEA DEA Cloud Foundry Elastic Runtime DEA DEA DEA Zone 1 Zone 2 Application instances are evenly distributed over two availability zones. Loosing an AZ keeps instances running and available. App Ops
  • 22.
    Router Failed Application InstancesReplaced Blobstore Cloud Controller Health Manager Messaging (NATS) DEA DEA DEA App Ops Cloud Foundry Elastic Runtime
  • 23.
    Router Failed Application InstancesReplaced Blobstore Cloud Controller Health Manager Actual State Messaging (NATS) DEA DEA DEA App Ops Cloud Foundry Elastic Runtime
  • 24.
    Router Failed Application InstancesReplaced Blobstore Cloud Controller Health Manager Actual StateDesired State Messaging (NATS) DEA DEA DEA App Ops Cloud Foundry Elastic Runtime
  • 25.
    Router Failed Application InstancesReplaced Blobstore Cloud Controller Health Manager Actual StateDesired State Messaging (NATS) DEA DEA DEA App Ops Cloud Foundry Elastic Runtime
  • 26.
    Router Failed Application InstancesReplaced Blobstore Cloud Controller Health Manager Actual StateDesired State Messaging (NATS) DEA DEA DEA App Ops Cloud Foundry Elastic Runtime
  • 27.
    Message Bus ERS Processesare Monitored IaaSCloud Foundry BOSH Health Monitor Health Manager DEA Cloud Controller Responders: pager email monitoring … PaaS Ops
  • 28.
    Message Bus ERS Processesare Monitored IaaSCloud Foundry BOSH Health Monitor Health Manager DEA Cloud Controller Responders: pager email monitoring … PaaS Ops
  • 29.
    Message Bus ERS Processesare Monitored IaaSCloud Foundry BOSH Health Monitor Health Manager DEA Cloud Controller Responders: pager email monitoring … PaaS Ops
  • 30.
    Message Bus VMs areMonitored IaaS Health Monitor Health Manager Cloud Controller DEA Responders: pager email monitoring resurrector … BOSH Director Actual State DEA PaaS Ops Cloud Foundry BOSH
  • 31.
    Message Bus VMs areMonitored IaaS Health Monitor Health Manager Cloud Controller DEA Responders: pager email monitoring resurrector … BOSH Director Actual State DEA PaaS Ops Cloud Foundry BOSH Desired State
  • 32.
    Message Bus VMs areMonitored IaaS Health Monitor Health Manager Cloud Controller DEA Responders: pager email monitoring resurrector … BOSH Director Actual StateDesired State PaaS Ops Cloud Foundry BOSH
  • 33.
    Message Bus VMs areMonitored IaaS Health Monitor Health Manager Cloud Controller Responders: pager email monitoring resurrector … BOSH Director (CPI) Actual StateDesired State DEA PaaS Ops Cloud Foundry BOSH
  • 34.
    Four levels ofHA in PCF Elastic Runtime (ERS): Distribution across availability zones Application health management and recovery BOSH (cluster management): Process monitoring, recovery and alerting Virtual machine health monitoring, recovery and alerting