Presentation for TNC2013 on what Norwegian universities and colleges are working on for digital exams. Include checklist for digital exams today, and a pre-study on BYOD for 10000 concurrent students in a cloud based solution.
Digital exams – when students are left to their own devices. Building support infrastructure for secure BYOD environmentsUniversities are the largest bring your own device (BYOD) institutions in the world, since millions of students bring their own devices to their campus every day. For some use cases there is a need for the university to control the client environment the student operates in. Building BYOD solutions for large scale student use with control over clients changes the current infrastructure. This presentation looks at the requirements for network and security infrastructure needed for digital exams in a BYOD environment.
Universities are the largest bring your own device (BYOD) institutions in the world, since millions of students bring their own devices to their campus every day. For some use cases there is a need for the university to control the client environment the student operates in. Building BYOD solutions for large scale student use with control over clients changes the current infrastructure. This presentation looks at the requirements for network and security infrastructure needed for digital exams in a BYOD environment.
Photo: Torstein Frogner (from Wikimedia)
BYOD for exams: leaving students to their own devices
Digital exams: when students are left totheir own devicesTNC2013, Maastricht, 2013-06-05Ingrid Melve, Uninett
Presenting Bring your own device to campus Bring your own device to your exam Checklist for digital exams Working group report Investigating exam from security perspective BYOD technologies available today Results from study done by Evry Ongoing discussions Further work
Digital exams? Exam types Oral Skype, video conference, web meeting Digital exam may be stored and reviewed Home exam Submission in VLE/LMS or othersolutions Similar solution for non-exam School exam Essay form or answering questions Multiple choice Programming, using other software(excel etc) Other exams, case based or practical
Power to the students Wireless networks Physical locations for exams vary: on campus, in sportsfacilites, conference halls «anywhere indoors with largesurface» Ad hoc networking: need to extend eduroam/Wifi coverage Ensure reliable backend fiber from base stations to campus Restricting access Pushing access restrictions at edges (virtual desktops, clientfirewalls) Access restrictions at network layer – per exam Power supply Rough estimate: 75W/student (3000 students = 225 kW) Ad hoc power supply, need to rig fast
Taskforce: use of student PCson digital school exams Mandate Find scaleable technical solutions for digital school examsASAP Networking the local projects and people Discuss technical solutions for “school exams” Technology for exam mode on student devices(PC, Mac, tablets) Virtual desktops, domain control, bootable USB sticks, lockdownbrowser Security and access restrictions Deliverables Checklist for digital exams Investigating maturity of technology solutions (with thehelp of Evry) Collating results from the local projects
What do we need for digital exams? Working group on national level for local projects University projects: hundreds of students/day do digitalexams College projects: tens of students/day do digital exams Sharing pain, sharing gain Based on project result, checklist Preparation before exam start Exam day Technical solutions Support solutions Tidying up after exam day and input to exam workflow
Check list before the exam day Managing student expectations Test exams Responsibilities: bring your own device (and powersupply) Prepare student devices Controlling hardware and devices Software requirements Logging Support and organizational systems Usability IT support team available Test exam, organizational learning systems
Exam mode Configure equipment and environment in exam mode Students must release private devices to controlled exam mode Exam is a controlled exercise Audit is required of security system (holistic, not just ICT) Exam mode has max stressed out users: usability Exam mode Total control over the device: subject to university domainpolicy Virtual machine on the device: exam mode, with extrasurveillance Lockdown browser: Test exams are important tools for IT, security and enduser
Domain policylockdown, notBYODVirtual desktop(VDI)LockdownbrowserenvironmentVirtual learningenvironment,exam modeBased oninstitution ownedequipmentRecommended incombination withlockdown browserMay be combinedwith VDI orLMS/VLEOften used forterm papers, lacksome functionalitySecure controlledenvironment ondeviceSecure controlledenvironment ondeviceSecure controlledenvironment ondeviceDoes not supportextended securitymode on deviceEasy to preparevariousconfigurationsRequireschanges toexisting licensingmodel andsoftware installRequiressoftwareinstallationNo softwarerequirementsDigital exam mode: alternatives
Report: Large scale digital exams (1) Study on available technical solutions for large scaledigital exams Requirements gathered from Norwegian universities Thanks to NTNU, UiA and UiO Report (Myhre&Brede, Evry) April 2013 Yes, large scale VDI is possible today for digital exams Cloud server solution Clients available for PC, Mac (and tablets) Further investigation of two solutions Microsoft Hyper-V with XenDesktop + Lockdown browser Inspera Assessment 2.0
Report (2): Ranking solutions1. Inspera Assessments2.02. Hyper-V withXenDesktop3. Hyper-V with XenApp4. VMWare Horizon View5. Microsoft VDI6. Microsoft RDS7. Windows To Go /Bootfrom USB Criteria: Scaling Client support forPC, Mac and tablets Cost and cost models Stability Supporting softwarevariations(programming, spreadsheets etc) Skill required for localsupport and operations Integration
Cheating on your exams Restricted use of sources Clear policies Limit access Monitor physical and networkuse Restrict communications Monitor communications Restrict access Authentication: who was thestudent? Checking identity Surveillance and audit Plagiarism Automated checks forplagiarism Citation practices Post information aboutrequirements andregulations Train exam proctors Monitor PC activity, logging Restrict exam area Block line of sight Restrict network access topermissible sites on examnetwork Restrict access to examnetwork only Check for plagiarism
Cheating: the security view Paradox: students need access to (limited) informationresource, but should not be able to communicate The Internet was built for communication,now we need to turn off the most useful features Monitor and audit Exam is controlled environment, audit documentation vital Users (students) are max stressed Ability to process input goes down significantly, may forget tobring PC or power or student ID Exams are time limited, and uptime must be 100% Storage and backup are vital, snapshots used to increaseuptime We love proctors!
Handing in exam Document formats PDF for text documents Possibility for other formats, for example Programming exams: program files Economics: spreadsheets Avoid Office files as end product Anonymization: stripping metadata in files Final version submitted: close exam mode Remember receipt for student (with copy of exam) Submitting as file across the network to storage
Checklist: after the exam Clear away exam mode Physical location: clear away power cables and network Remove network restrictions Remove logging Students (and their devices) must exit exam mode Outside taskforce mandate Grading and workflow for involving external gradingand/or audit Administrative work: who passed exams etc Feedback to students Archiving
Further work Investigate recommended VDI solution lockdown browser mode solution Formal requirements document Shared procurement? Awaits working group decision Prediction: More digital exams next semester We are running out of time