Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Supporting research in the Cloud:
Our experiences and future
directions
Simon Woodman
Digital Institute
Newcastle Universi...
Digital Institute
• In 2001, NEReSC was formed to help researchers
– £17M funding
• Bioinformatics, Neuroscience, Aging & ...
Research
World-leading
Teaching
Specialist
Skills
& Knowledge
Engagemen
t
Impact on
Industry &
Public Sector
Innovation
Cy...
Having 100s of machines
available to process data doesn’t
automatically help
Building a data management and
processing platform
• An environment to store, manage and process data
– Every project need...
Provenance
Features of e-SC
• Data storage
– Cloud: infinite scale
• Data processing
– Best-of-breed open source tools (R / Octave)
•...
All our projects have significant storage,
processing and collaboration needs
Use of the platform
Movement monitoring
Coll...
Cap Ex v Op Ex
Service Provision v
Research
One eScience
Central to rule them
all.
Learning from Industry -
DevOps
The Phoenix Project: A Novel About IT, DevOps, and Helping Your Business Win.
Gene Kim, Ke...
Cloud Innovation Centre
• £1M funding from DCMS
• Offerings
– Training
– Architecture Reviews
– Consultancy
– KTPs
– Cloud...
Cloud Computing for Big Data
CDT
• £7M funding from EPSRC
• 60 Students
• 5 years
• High level of industry engagement
Clou...
Challenges
• Past
– Cost of on-boarding
– Scaling
• Present
– Licensing
– Researchers doing Sys Admin
• Future
– Manage th...
Questions?
Simon Woodman
simon.woodman@ncl.ac.uk
RCUK Cloud Workshop
RCUK Cloud Workshop
RCUK Cloud Workshop
RCUK Cloud Workshop
RCUK Cloud Workshop
Upcoming SlideShare
Loading in …5
×

RCUK Cloud Workshop

250 views

Published on

How the Digital Institute is enabling the Long Tail of Science

Published in: Technology
  • Be the first to comment

  • Be the first to like this

RCUK Cloud Workshop

  1. 1. Supporting research in the Cloud: Our experiences and future directions Simon Woodman Digital Institute Newcastle University
  2. 2. Digital Institute • In 2001, NEReSC was formed to help researchers – £17M funding • Bioinformatics, Neuroscience, Aging & Health, Chemical Engineering, Transport, Video archiving – Core UK e-Science funding programme • Became the Digital Institute – Similar remit but more diverse: Humanities, Medical Science, BIM – £40M funding • Provided computing aspect of many research projects • Frequently same requirements
  3. 3. Research World-leading Teaching Specialist Skills & Knowledge Engagemen t Impact on Industry & Public Sector Innovation Cycle Cloud Innovation Centre Events, engagement & partnerships EPSRC Centre for Doctoral training in Cloud Computing for Big Data Developing the next generation of leaders World- leading Research in Cloud computin g & data analytics Digital Institute
  4. 4. Having 100s of machines available to process data doesn’t automatically help
  5. 5. Building a data management and processing platform • An environment to store, manage and process data – Every project needed this, volumes growing – Open Source • A platform that can operate in a number of different locations – Laptop – On Premise – On a cloud provider (Amazon and MS) • An expandable system – API to connect other software – Data processing code can be added • A platform for our academic research – Scalability, data management, provenance
  6. 6. Provenance
  7. 7. Features of e-SC • Data storage – Cloud: infinite scale • Data processing – Best-of-breed open source tools (R / Octave) • Provenance – Audit of everything performed • Scalability – Easy to run at large scale • External communications – Rich APIs
  8. 8. All our projects have significant storage, processing and collaboration needs Use of the platform Movement monitoring Collaboration ModellingStroke rehabilitation Care home design
  9. 9. Cap Ex v Op Ex
  10. 10. Service Provision v Research
  11. 11. One eScience Central to rule them all.
  12. 12. Learning from Industry - DevOps The Phoenix Project: A Novel About IT, DevOps, and Helping Your Business Win. Gene Kim, Kevin Behr, George Spafford. ISBN 0988262509
  13. 13. Cloud Innovation Centre • £1M funding from DCMS • Offerings – Training – Architecture Reviews – Consultancy – KTPs – Cloud time • £700k Private and Public Cloud infrastructure
  14. 14. Cloud Computing for Big Data CDT • £7M funding from EPSRC • 60 Students • 5 years • High level of industry engagement Cloud Computing Bayesian Statistics Group Projects Internships Thesis Retreats Professional Skills
  15. 15. Challenges • Past – Cost of on-boarding – Scaling • Present – Licensing – Researchers doing Sys Admin • Future – Manage the relationship with Central IT – Staff costs/time
  16. 16. Questions? Simon Woodman simon.woodman@ncl.ac.uk

×