• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content

Loading…

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

Like this presentation? Why not share!

Tien3

on

  • 487 views

 

Statistics

Views

Total Views
487
Views on SlideShare
487
Embed Views
0

Actions

Likes
0
Downloads
8
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • 29 Active partners (vs. 32 in EGEE) ~ 29 FTEs (average 1 per partner)
  • 29 partners spread throughout Europe Widespread geographical coverage
  • Number of
  • To give a flavour of the type of events NA3 provide this chjart provides a breakdown of the event types. Predominantly User induction sessions, But also app developer, training events designed specifically for applications, and also training the trainer events which we have been providing more recently.
  • Mention NA2 images and ISSEG material
  • Historically used throughout EGEE project for storing training content created
  • Better picture from Roerto
  • ICEAGE project final review 8/5/08
  • Training team looking at new eLearning methods of providing training aimed at scalability Organised the winter school series, in collaboration with other technology groups
  • 8/5/08 ICEAGE project final review
  • 38 successful applicants from 16 countries
  • Add feedback, and more info about elearning for future

Tien3 Tien3 Presentation Transcript

  • From Training to Technology Transfer: experiences from an EU perspective in the Asia and Pacific region and opportunities/challenges presented by Cloud Computing
    • David Fergusson
  • The problem
    • We can build technologies and infrastructures.
    • However without USERS this means nothing.
    • Only when these tools are used (in this case to create new science) do they have any meaning.
    • To do this we have to go out to the communities, they will not come to us.
  • NeSC Training, Outreach and Education
    • Founded in 2004 based on national and EU grants (EGEE).
    • Grown from 2 staff to 13 in 3 years.
    • Courses in UK, in Europe, elsewhere
      • China, Korea, Japan, Australia, Africa, South America
  • TOE projects
    • EGEE, EGEE II EGEE III
    • European Grid Institute Design Study
    • EGI-Inspire
    • UK National Grid Service
    • OMII-Europe
    • NextGrid
    • ICEAGE
    • University of Edinburgh, eLearning & MSc
    • JISC eLearning
    • JISC eUptake
  • TOE services
    • Based around digital library to curate material
      • Different project views: EGEE, ICEAGE, OMII-EU, NGS
      • RSS feeds
      • Multimedia (video/audio/presentations)
      • Community editable metadata
    • eLearning services
      • Online assessment
      • ePortfolios
      • T-Infrastructure integration
    http://egee.lib.ed.ac.uk/ http://baillie.lib.ed.ac.uk:8080/
  • Training & Education Spectrum
    • Training
      • Targeted
      • Immediate goals
      • Specific skills
      • Building a workforce
    • Education
      • Pervasive
      • Long term and sustained
      • Generic conceptual models
      • Developing a culture
    • Both are needed
    Invests Prepares Create Enriches Organisation Skilled Workers Training Services & Applications Invests Prepares Develop Strengthens Changing Culture Society Graduates Education Innovation
  • EGEE to EGI
    • Building a sustainable international distributed infrastructure
  • Activity overview
  • Geographical spread of events http://bit.ly/EGEEtrainingmap 18 5 events in EGEE-III 80 separate locations worldwide 2 312 participants Training designated as a NGI task
  • UPDATE Training event locations 2008 - 2010
  • UPDATE Training event data in EGEE-III
    • <- Event duration
      • Average course length 2.5 days
  • Breakdown by event type
  • EGEE collaboration events
  • Services for sustainable training
    • GILDA VO became part of the production infrastructure
      • No difference in infrastructure monitoring & maintenance between production and t-infrastructure
      • NGIs can contribute to training with production resources
    • Accreditation of trainers
    • Training support services in EGI
      • Digital library
      • Training event database
      • Trainer registry
      • GILDA VO
  • Digital Library
  • Audio and video in Library
  • Digital library - updates Improved Search & Filter New eLearning modules Rebranding
  • Digital Library
    • Open to everyone for search, retrieval, linking http://egee.lib.ed.ac.uk
    • Also accessible via web services - by negotiation
    • Based on Fedora open source repository and international standards
    • Contains now over 6900 learning resources! (>100 videos)
  • GILDA t-Infrastructure Training Infrastructure for EGEE and other European projects, providing resources for training events GILDA is now one VO of the production infrastructure 13 site ~1100 cpu
  • Development of EGEE trainers
    • Training the trainers
      • Provide partner autonomy
      • Experts ensure quality of message
    • Trainer Accreditation
      • Accreditation process:
        • Peer approval
        • Details of training experience
      • Currently 104 trainers
  • Location of accredited trainers (Y1) 4 2 7 1 1 3 6 7 16 5 3 1 2 15 2 5 2 1 4 7 1
  • Location of accredited trainers (Current; increase in Y2) 6 2 7 17 1 3 8 7 16 5 3 1 2 15 2 5 2 1 4 7 1 Taiwan – 8 Australia – 1 Japan - 1 5 3 +2 +3 +2 +5 +16
  • ICEAGE
    • Stimulating academic take up of grid subjects in education
    • Supporting summer schools - educational cutting edge
      • International Summer School for Grid Computing
      • Biomed SS, GridKa, CERN summer school & others
    • International shared t-Infrastructure
      • Working with OMII-Europe & EGEE to extend
    • Stimulating policy and standards to enable sharing of educational resources and materials
  • ICEAGE Web site (www.iceage-eu.org)
  • Collection of Masters courses
  • Collection of Summer Schools
  • Policy activity - OGF
  • OGF E&T Workgroup Wiki
  • International Summer School for Grid Computing
  • Biomed Grid Summer School
  • ICEAGE FORUM
  • E-Infrastructures Reflection Group
  • e-uptake Project Rob Procter, David Fergusson Lorna Hughes, Alex Voss
  • Overview
    • WP1
    • WP2
    • Sustainability and integration with other projects
    • Dissemination
    • Resourcing status
    • Extension request
  • WP1: Fieldwork Phase I
    • Aim to develop understanding of academic use of
    • e-Infrastructure.
    • Methodology: desk-based research; questionnaire, and semi-structured interviews:
      • 50 interviews: 8 respondents per RC (AHRC, BBSRC, EPSRC, ESRC, MRC, NERC) plus STFC.
      • Respondents academic users of e-Infrastructure services selected on basis of desk research and questionnaire.
      • Conducted within Community Engagement Framework of Understanding.
  • WP1: Fieldwork Phase I
    • Respondents asked about their use of e-Infrastructure services:
      • Services used and role in research lifecycle
      • How services facilitated research
      • How respondents found out about them
      • Whether training and other kinds of support were available and made use of
      • Barriers encountered, if and how they were overcome
      • Enablers that would improve use of services
    • Transcripts systematically coded up using scheme developed from typology.
  • WP1: Top Level Typology
  • WP1: Data Analysis
    • Identify barriers, understand their causes and implications.
    • Identify enablers, what they achieve and scope.
    • Evolve the typology.
    • Identify issues to feed into phase II fieldwork.
    • Identify candidate interventions for:
      • WP2
      • Service ‘intermediaries’, service providers, JISC programme managers
    • Feeds into other deliverables:
      • Current state of adoption
      • Training recommendations
      • Other recommendations
  • Barrier: Lack of Awareness
    • Description: There seems to be a lack of systematic introduction to the services and the training available, which results in a lack of awareness as well as a a lack of understanding of how services and methods can facilitate research and what different options exist.
    • Examples:
      • [MR02], [EP02], [AH04]
      • “ one barrier is not having heard of these things” [AH03]
    • Candidate responses:
      • Boundary spanning
      • Opportunities for learning about e-Research / e-Infrastructure
      • Systematic training of young researchers
    • Typology:
      • Social Issues / Training, Education and Outreach / Early Engagement & Outreach
  • Enabler: Boundary Spanning
    • Description : Boundary spanning refers to the moving of people from one discipline to another. It can help transfer ideas, knowledge and skills across disciplinary boundaries.
    • Example : As one Arts and Humanities researcher put it: “before I was at [my current institution], I was at an engineering department at [other institution] and so I was kind of aware of a lot of these things that we are talking about – Access Grid, e-Science.” [AH01]
    • Barriers addressed:
      • Lack of awareness of services
    • Typology
      • Social Issues / Individual / Career Choices
      • Training, Education and Outreach
  • User Requirements
    • On-going collection of information
    • Maintaining form of data set to allow aggregations
  • 2008 Training Survey Results
    • 110 attendees completed surveys at the All Hands Meeting, Oxford e-Research Conference and EGEE 2008 in September.
    • The top five training requirements from existing categories are:
        • Introduction to e-Science (25)
        • Application development (15)
        • Monitoring (11)
        • Security (9)
        • Semantic grid (7)
  • UK vs International Focus
    • Remain generally very similar.
    • Differences:
      • International - Application porting, Monitoring*, Deployment*, Job Submission
      • UK - OGSA-DAI, UNICORE, Campus Grid, IPR, Management issues, Cloud
  • 2008 Training Survey Results: New Categories
    • Seven new categories for training have been identified from 2008
    • Results:
      • Data management (10)
      • Access Grid (6)
      • Interoperation (3)
      • Project management in a distributed environment (3)
      • Campus grid (1)
      • IPR and grid/e-Science (1)
      • Cloud computing (1)
    • Of these new categories, DATA MANAGEMENT ranks in the top five across old and new categories (4).
  • One Stop Shop
    • Atom/RSS/web services/podcast feeds available
    • Improving filtering based on:
      • Community projects’ requirements meeting (filtering requirements)
      • Practical experiences with ENGAGE (eg. chunking)
    • Improved merging of materials and events data
    • Moving to Digital Library@NeSC as single data source
    • Improving support for the creation for community specific clients
    • NGS will implement new versions of clients
    • Discussions agreed for OMII - data & presentation
  • Interventions I
    • Earlier Social Science/Arts & Humanities event
      • allowed investigation of new modes of delivery but poor community engagement at that point
    • Lead to adjustment of plans using outputs of UK & International workshops (eUptake and ICEAGE)
  • Interventions II
    • More focussed events
      • joint event with NGS for specific communities
    • Policy and stakeholder level events (outreach)- eRoadshows
    • Greater profile/impact - NGS sponsored UK summer school
      • ADSSS
    • Introductory “text book”
      • Research in a connected world pamphlet
  • eRoadshows
    • Introductory events
    • Delivered to communities in their own locations
  •  
  • WP1: Barriers and Enablers
    • Social:
      • Lack of systematic introduction to services and training available
      • Lack of support bridging gap between initial interest and specific training
      • Lack of link with existing ICT training programmes
      • Lack of capacity for exploring possible use cases and technical configurations
      • Importance of advertising success stories
      • Need for more direct collaboration and more ‘hybrids’
      • Relationship to generation of scientific knowledge
      • General cultural differences
      • Personal careers
      • Maintaining confidence in the eventual pay-offs materialising
      • RAE impact
      • e-Science dominated by technologists
      • Problems of multidisciplinary understanding
      • Publishing multi-disciplinary work
      • Lack of researchers with necessary computing skills
      • Funding arrangements for services and (perceptions about) their sustainability
      • State of software produced
      • Lack of time and funding to explore services
      • Problem of costing compute services
      • Opportunity for an organic growth of national compute resources
      • Barriers at the departmental level
      • Charging external users
      • Getting a large enough share of national resources
      • Availability of local IT support
  • WP1: Barriers and Enablers
    • Technical:
      • Reliability of services
      • Network problems
      • Lack of support for use of multicasts
      • Software lifecycle and support
      • Documentation
      • Advanced support for specific services
      • Co-location with support and development teams
      • Not having the same environment on different NGS nodes
      • Problems with submitting many jobs
      • Different types of Access Grid nodes
      • Mismatch between computational needs and provision
      • Lack of standardised rules and systems to access services
      • Procedure for acquiring UK e-Science certificate
      • Slow development of services
  • WP1: Barriers and Enablers
    • Digital Resources:
      • Discovery process not always effective or reliable
      • Lack of agreement over metadata standards
      • Legal and ethical issues
      • Licensing policies still in formative stage
      • Confidentiality preserving measures
      • Lack of secure environments
      • Heterogeneous data formats
      • Variable data quality
      • Repository practices not ‘user-centric’
      • Lack of adequate financial support
      • Inadequate metadata
  •  
  • Model for learning - IWSGC eLearning school Resources eLearning event with collaboration between gLite, Globus, UNICORE, Condor
    • 4 technology weeks
    • ~17 hours per week (student average)
    • 35 Participants
  • Course design – technology week Training Infrastructure Content Winter School IWSGC site Virtual Learning Environment Live Talks Keynotes Tutor chat Exercises Tutor Recorded presentations Training documents Research papers Student mailing List Discussion Forum Digital Library COURSE
  • Objective
    • To set up an e-Learning version of the International Summer School in Grid Computing
  • Repository Registry t-Infrastructure Content People Student Tutor Owner Marker Student VLE NA3 support services were necessary to complete the winter school Digital Library Assessment COURSE
  • Application Application form Admission process Acceptance Presentations Registration Assessment Pre-requisite exercises Winter School IWSGC site People registry Create new user Update Tutorials Digital Library ISSGC Student process for Winter school UNIX Java XML Certificate
  • Application Application form Admission process Acceptance Registration Assessment Pre-requisite exercises Winter School IWSGC site People registry Create new user Update Digital Library ISSGC t-Infrastructure (GILDA) Presentations exercises
  • Application Application form Admission process Acceptance Registration Assessment Pre-requisite exercises Winter School IWSGC site Create new user Update Digital Library ISSGC Tutors Presentations exercises Coordinator People registry
  • Course Structure 1
    • Course had 4 “technology weeks”
      • gLite
      • Globus
      • Condor
      • OGSA-DAI
    • Each week:
      • Reading material/online presentations
      • Tutorials to be completed
      • Mon-Thu – Tutor available (email/ forum)
      • Fri – Chat session with Tutor
  • Course Structure 1
    • Course had 4 “technology weeks”
      • gLite
      • Globus
      • Condor
      • OGSA-DAI
    • Each week:
      • Reading material/online presentations
      • Tutorials to be completed
      • Mon-Thu – Tutor available (email/ forum)
      • Fri – Chat session with Tutor
    VLE GILDA
  • Keynotes
    • To provide high points for the school (idea taken from ISSGC)
    • 3 Keynote talks
      • Ian Foster
      • Miron Livny
      • Malcolm Atkinson
    • Live broadcasts
    • Provided opportunity for students to chat with some of the prominent grid experts
    • Adobe Connect
  •  
  •  
  • Applicants
    • The IWSGC’08 Admissions Committee received:
      • 55 complete applications
      • 38 prospective participants started working on Preparatory Exercises
      • 29 from 16 countries participants successfully completed all exercises and were invited to register
      • 28 participants successfully completed the School
      • 1 dropout participant had to give up because of unexpected commitments.
  • Applicant demographics
    • 38 applicants from 16 countries
  • Sustained engagement in IWSGC’08 Wednesday, 6th February 15:00 GM Iain Foster Invited 39 Peak Users 34 Tuesday, 26th February 15:00 GMT Miron Livny Invited 40 Peak Users 34 Wednesday, 12th March 15:00 GMT Malcolm Atkinson Invited 39 Peak Users 40
  • Participant Feedback Question: How did you find the level of commitment required?
  • Participant Feedback
    • 93% completed questionnaire
    • 75% structure “good”
    • 90% course “correct length
    • 80% interested in individual technology week
  • Statistics
    • 600 messages on forum
    • 200 emails sent via VLE
    • Average student working time 20 hours per week
    • Average user sessions per day:43
      • Average user sessions per day on weekdays:54
      • Average user sessions per day on weekends:16
  • Summary
    • A month long “Winter School” in February 2008 & 2009.
      • Use of support components
        • Adobe Connect, WebCT, GILDA t-Infrastructure , Digital Library, NeSC People Registry.
        • Integration of Training Support services in workflow with existing tools
      • 4 technologies presentations and practicals
        • gLite, Globus, Condor, OGSA-DAI
      • 28 students from 16 countries, 9 tutors from 4 countries
      • 3 live presentations by leaders in the field
        • with chat sessions
      • High levels of satisfaction from students and presenters
  • Head in the clouds?
    • Dynamic (service) provisioning
    • How is it applicable to the NGS/Edinburgh?
    • Training
      • Rapidly deploy services for teaching
      • Isolate training from production
    • Other
      • Specialised research environments
      • Rapid deployment
    • Identify use cases and gather requirements
  • NGS 3 EWP2
    • “ NGS Agile Deployment Environments”
    • EPSRC funded, 2 years
    • People
      • Matteo Turilli (OeRC, Oxford) [0.75 FTE]
      • Steve Thorn (NeSC, Edinburgh) [0.5 FTE]
      • David Fergussion (NeSC, Edinburgh) [WP Leader]
  • Overview (cont.)‏
    • Realistic usage
      • Training event on virtualized infrastructure
    • Hosting infrastructure?
      • Amazon EC2 compatible
        • De facto standard currently, with open source implementation
      • Ease of deployment
      • Eucalyptus, Nimbus and others
    • Hardware
      • Edinburgh: 8 cores ⇒ 16+ dual cores
      • Oxford: 64 cores (older)‏
  • Eucalyptus
    • “ Elastic Utility Computing Architecture Linking Your Programs To Useful Systems”
    • Open source and Commercial
    • Amazon Web Services API compatible
      • EC2, storage - S3, Elastic Block Store (EBS)‏
    • Easy to install
    • Xen and KVM hypervisors
      • Commercial version supports others (inc. VMWare)‏
  • Eucalyptus architecture
    • Cloud controller
      • Entry point
      • Gathers information
    • Cluster controller
      • Schedules VM execution
      • Manages virtual network
    • Node controller
      • Controls VM execution
    • (Xen running on node)‏
      • Storage controller (Walrus)‏
        • implements Amazon’s S3 interface
  • Prototype service
    • Eucalyptus 1.6.2 (current 2.0)
      • Migration in next few months
    • Call for users for prototype
      • > 20 groups expressed interest
      • > 25 registered users on system
      • Increasing constantly
    • May be reaching the limits of current support
  • Research domains
    • Social science
      • Population simulations (York, St Andrews)
    • Cloud interface development
    • Advanced teaching
      • Edinburgh (MSc)
      • Canfield (MSc)
    • Bioscience
      • Next gen sequencing, micro array
      • Taxonomic analysis
    • Geospatial analysis
    • Civil Engineering (flood risk management)
    • MyGrid on the cloud