eAssessment in the Cloud,                                         Sunshine or Thunderstorm?                               ...
The promise of the cloud             Using “clouds” for computing tasks              promises a revolution in IT similar ...
Questionmark offer both, so I can be neutral             Installable assessment                                          ...
Key factors             Access to innovation             Speed/flexibility of deployment             Reliability and up...
Access to innovation             Key advantage of On-demand is frequent updates              without effort              ...
What happens if I don’t want innovation?             With an On-demand system, you are usually upgraded              auto...
Speed/flexibility of deployment                    On-premise                                                             ...
Reliability and uptime             For high reliability/uptime, redundancy is key                 Power supplies        ...
Typical On-demand redundancy                                                                                              ...
Some key questions to ask a provider          What SLA is available?          What are support hours? Do they match our ...
Scalability and peaks in demand          Typical eAssessment           load:              Formative: steady during      ...
Security and cheating          Just like a castle              Security needs investment &               vigilance      ...
Some key questions to ask a provider?          Data center security              Is it certified?              Are ther...
Can governments access my data?          Be realistic!              Governments mostly well-intentioned              Do...
Data protection                  On-premise                                                                               ...
Some key questions to ask a provider          Employees background checked?          Employees sign confidentiality agre...
Ease of customization/integration                                                                           On-demand     ...
Connectivity          In campus universities, local connectivity can favour           On-premise          Speed of light...
Can you change providers?          Whatever system you use              Questions              Assessments            ...
Getting IT bandwidth          eAssessment and the IT department              eAssessment critical so needs professional ...
Costs, features and other factors          When considering cost include:              Hardware              System sof...
Summary           On-demand may be stronger           • Access to innovation           • Speed/flexibility of deployment  ...
Some further resources          UCISA Cloud Computing Briefing Paper (2011)              Download from www.ucisa.ac.uk  ...
Sunshine or thunderstorm: your questions              Copyright © 1995-2012 Questionmark Corporation and/or Questionmark C...
Upcoming SlideShare
Loading in...5
×

eAssessment in the cloud

1,186

Published on

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,186
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
9
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

eAssessment in the cloud

  1. 1. eAssessment in the Cloud, Sunshine or Thunderstorm? John Kleeman, Questionmark www.questionmark.comCopyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmarkis a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  2. 2. The promise of the cloud  Using “clouds” for computing tasks promises a revolution in IT similar to the birth of the web and e-commerce (McKinsey)  What does this mean for eAssessment in HE?  Technology pros and cons  Installing eAssessment software locally “On-premise”  Using an eAssessment service “On- demand” Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 2 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  3. 3. Questionmark offer both, so I can be neutral  Installable assessment  Questionmark provides management system service at cloud data center  You  You  Purchase servers & software  Contract for the service  Install software  Connect to the service over  Install updates the Internet  Create your own eAssessment  Delegate running the service offering based on the 24/7 to Questionmark software  Use the service for your eAssessment offering Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 3 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  4. 4. Key factors  Access to innovation  Speed/flexibility of deployment  Reliability and uptime  Scalability and peaks in demand  Security and cheating  Governments accessing your data  Data protection  Ease of customization/integration  Connectivity  Can you change providers?  IT bandwidth  Cost, features and other factors Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 4 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  5. 5. Access to innovation  Key advantage of On-demand is frequent updates without effort  Support of mobile devices  Support of new interoperability standards  Support of uptodate browsers  Feature improvements Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 5 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  6. 6. What happens if I don’t want innovation?  With an On-demand system, you are usually upgraded automatically  Most providers will  Give notice of upgrades  Give opportunity to test  Make sure upgrade is upwardly compatible  Not a problem in practice with a good provider Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 6 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  7. 7. Speed/flexibility of deployment On-premise On-demand  Hardware needs purchase  Turn on within days  System needs provisioning  Increase capacity easily  Software needs installing  Reduce capacity easily  Ramp up for temporary courses or one-off events  Needs planning and can be slow to deploy or increase scale Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 7 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  8. 8. Reliability and uptime  For high reliability/uptime, redundancy is key  Power supplies  Internet connectivity  Firewalls  Servers  Database servers  Application servers  Offsite backup  Everything needs a backup  On-demand will usually be superior as long as participants have Internet connectivity Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 8 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  9. 9. Typical On-demand redundancy Tapes Off Site Data Back Ups Internet Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  10. 10. Some key questions to ask a provider  What SLA is available?  What are support hours? Do they match our hours?  Is there a public status page?  What is historical uptime?  What protection vs power outages?  How often are results backed up, e.g. hourly?  Are back-ups off-site?  Is every server load-balanced?  Is there redundancy for everything?  Is there monitoring for failures?  What happens with planned maintenance?  How strong is the provider’s disaster recovery plan? Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 10 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  11. 11. Scalability and peaks in demand  Typical eAssessment load:  Formative: steady during year  Summative peak at end of term  On-premise  Need to scale system to cope with peaks  On-demand  Gives an advantage Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 11 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  12. 12. Security and cheating  Just like a castle  Security needs investment & vigilance  UCISA: “In practice, data is probably more secure in cloud services than can be provided by in house solutions.” Picture by Simon Ledingham from geograph project, licensed under Creative Commons Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 12 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  13. 13. Some key questions to ask a provider?  Data center security  Is it certified?  Are there 24/7 onsite guards?  Are all visitors escorted and videoed?  Fire suppression, 24/7 monitoring?  Tiered architecture, firewalls between each tier?  All traffic uses HTTPS?  Separate production and staging/development areas?  Can developers access production area?  Security built into application development? Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 13 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  14. 14. Can governments access my data?  Be realistic!  Governments mostly well-intentioned  Does government want your assessment data?  Does it matter if they have it?  If you are concerned  Make sure service provider in an acceptable country  If you are concerned re US Patriot act, then these should all be outside USA  Service provider  Data center  Data center owner Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 14 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  15. 15. Data protection On-premise On-demand  The institution controls and  Institution = data controller is responsible for data  Provider = data processor protection  Questions for provider  Employee confidentiality?  Background checks?  Employee training/testing?  Data encrypted in transit?  One tenant protected from other?  Hard drives degaussed? Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 15 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  16. 16. Some key questions to ask a provider  Employees background checked?  Employees sign confidentiality agreement?  How do they monitor third party suppliers?  Training (and testing) in data security?  Are end-of-life disks degaussed?  Is data encrypted if moved?  If US, is provider enrolled in Safe Harbor Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 16 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  17. 17. Ease of customization/integration On-demand On-premise Configure and template   Change core code X  Direct database integration X  Web services   E-learning standards   Connect to Moodle, Blackboard etc   Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 17 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  18. 18. Connectivity  In campus universities, local connectivity can favour On-premise  Speed of light also small factor  But … Ray Fleming, Microsoft (2011):  I saw some statistics yesterday that says over 85% of the use of the Deakin University LMS takes place outside of the University. So there is a huge logic for putting things into the Cloud, as your users are out on the Internet – not necessarily in the institution when using your systems Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 18 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  19. 19. Can you change providers?  Whatever system you use  Questions  Assessments  Results  Are your data  On-premise and On-demand  Make sure that the format of data is documented and open  On-demand  Make sure that you have the rights to copies of your data Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 19 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  20. 20. Getting IT bandwidth  eAssessment and the IT department  eAssessment critical so needs professional maintenance  IT departments overloaded, IT skills in short supply  eAssessment is specialist IT skill  Tasks performed once per year difficult to train for  What can happen in On-premise  eAssessment projects have to queue for priority in IT  Often a bottleneck  A challenge which On-demand resolves Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 20 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  21. 21. Costs, features and other factors  When considering cost include:  Hardware  System software  License costs  IT time  Support costs  Other factors  Contract  Trust  Features  Training and SLA Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 21 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  22. 22. Summary On-demand may be stronger • Access to innovation • Speed/flexibility of deployment • Reliability and uptime • Scalability • Security and cheating • Getting IT bandwidth On-premise may be stronger • Ease of customization/integration • Connectivity • Governments accessing your data Needs review • Data protection • Can you change providers? • Costs, features and other factors Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 22 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  23. 23. Some further resources  UCISA Cloud Computing Briefing Paper (2011)  Download from www.ucisa.ac.uk  How to decide between On-demand and On-premise eAssessment (presented at 2012 CAA conference)  http://caaconference.co.uk/pastConferences/2012/caa2012_ submission_23.pdf Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 23 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  24. 24. Sunshine or thunderstorm: your questions Copyright © 1995-2012 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. QuestionmarkSlide 24 is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×