The document summarizes UCL's pilot of using a lockdown browser for digital assessments. It describes the rationale for using a lockdown browser, details four pilot programs conducted or planned at UCL involving different locations, devices and numbers of students, and key areas of interest being evaluated including device type, online management and invigilation, and student and staff perspectives. The goal is to assess the viability and scalability of using lockdown browsers to help ensure academic integrity for digital assessments conducted in-person.
LMS stands for Learning Management System. SRDT LMS allow you to manage every aspect of a course, from the registration of students to the storing of test results, as well as allowing you to accept assignments digitally and keep in touch with your students.
LMS stands for Learning Management System. SRDT LMS allow you to manage every aspect of a course, from the registration of students to the storing of test results, as well as allowing you to accept assignments digitally and keep in touch with your students.
User Experience Showcase lightning talks - University of EdinburghNeil Allison
Lightning talk slide decks from a University of Edinburgh User Experience event held 13 October 2017. Topics: User needs, Web strategy, Digital Standards, Edinburgh Global Experience Language, Current student UX case study.
The use of gamification (using game rules in non-game contexts) to make the Vula forum and wiki more interesting to use. The honours project ultimately looked at gamifying only the Vula wiki and here is a link to it http://people.cs.uct.ac.za/~dtakpuie/Project/
Bb on Tour 2016 | Innovation and Your Institution (Part 1) | Panel SessionBlackboard APAC
In this session we’ve assembled the innovation crew of which you’ll be a key ingredient. Through the session we’ll explore the following topics and facilitate round table discussion amongst the team to unpick and build a plan for seeding Innovation back at your campus.
Strategies for Assessing, Planning, Seeding & Mainstreaming innovation at your institution.
Mobility bringing the University to your students with Bb Student.
Industry Alignment & Graduate Outcomes with Competency Dashboards & MyEDU.
Maximizing Student Engagement and Flexibility with Blackboard Collaborate.
Connected Assessment Ecosystem with Blackboard Collaborate.
Presenters:
Chris Ross, Director, International Solutions, APAC
Mick Garner, Senior Solutions Engineer, ANZ
Blackboard
Conducting Remote Unmoderated Usability Testing: Part 2UserZoom
After learning the basics of remote unmoderated usability testing in Part 1, view this webinar on-demand with Ann Rochanayon, Director of UX/CX Research at UserZoom, to learn how usability studies are set up in UserZoom. Ann shows you why UserZoom leads the pack by taking you through the step-by-step study design as well as the research findings.
View this 30-min webinar on-demand to learn:
-How to set up a usability study in UserZoom
-How to build questions
-How to build tasks
-How to validate tasks
Online course registration system development software engineering project pr...MD.HABIBUR Rahman
Autometed Online Course Registration System is a software development project final presentation. here , I applyed . and software development waterfall feedback model. Development Software Engineering Project Presentation
eTechSchool provides a suite of applications in a fully integrated manner, to cater to the needs of large educational organizations having several institutes and multiple disciplines under each Institute, either various colleges(Arts, Science etc.) or Departments (Electrical, Mechanical etc.). It is also suitable for a single entity like Institute.
Ways to ensure “buy in” from the academics in the transition to digitised ass...Marieke Guy
Ways to ensure “buy in” from the academics in the transition to digitised assessments
Marieke Guy (Head of Digital Assessment) & Claudia Cox (Digital Assessment Advisor)
Uniwise partner meeting
2nd November 2023
User Experience Showcase lightning talks - University of EdinburghNeil Allison
Lightning talk slide decks from a University of Edinburgh User Experience event held 13 October 2017. Topics: User needs, Web strategy, Digital Standards, Edinburgh Global Experience Language, Current student UX case study.
The use of gamification (using game rules in non-game contexts) to make the Vula forum and wiki more interesting to use. The honours project ultimately looked at gamifying only the Vula wiki and here is a link to it http://people.cs.uct.ac.za/~dtakpuie/Project/
Bb on Tour 2016 | Innovation and Your Institution (Part 1) | Panel SessionBlackboard APAC
In this session we’ve assembled the innovation crew of which you’ll be a key ingredient. Through the session we’ll explore the following topics and facilitate round table discussion amongst the team to unpick and build a plan for seeding Innovation back at your campus.
Strategies for Assessing, Planning, Seeding & Mainstreaming innovation at your institution.
Mobility bringing the University to your students with Bb Student.
Industry Alignment & Graduate Outcomes with Competency Dashboards & MyEDU.
Maximizing Student Engagement and Flexibility with Blackboard Collaborate.
Connected Assessment Ecosystem with Blackboard Collaborate.
Presenters:
Chris Ross, Director, International Solutions, APAC
Mick Garner, Senior Solutions Engineer, ANZ
Blackboard
Conducting Remote Unmoderated Usability Testing: Part 2UserZoom
After learning the basics of remote unmoderated usability testing in Part 1, view this webinar on-demand with Ann Rochanayon, Director of UX/CX Research at UserZoom, to learn how usability studies are set up in UserZoom. Ann shows you why UserZoom leads the pack by taking you through the step-by-step study design as well as the research findings.
View this 30-min webinar on-demand to learn:
-How to set up a usability study in UserZoom
-How to build questions
-How to build tasks
-How to validate tasks
Online course registration system development software engineering project pr...MD.HABIBUR Rahman
Autometed Online Course Registration System is a software development project final presentation. here , I applyed . and software development waterfall feedback model. Development Software Engineering Project Presentation
eTechSchool provides a suite of applications in a fully integrated manner, to cater to the needs of large educational organizations having several institutes and multiple disciplines under each Institute, either various colleges(Arts, Science etc.) or Departments (Electrical, Mechanical etc.). It is also suitable for a single entity like Institute.
Ways to ensure “buy in” from the academics in the transition to digitised ass...Marieke Guy
Ways to ensure “buy in” from the academics in the transition to digitised assessments
Marieke Guy (Head of Digital Assessment) & Claudia Cox (Digital Assessment Advisor)
Uniwise partner meeting
2nd November 2023
The blandness is its formulaic style’: insights to help understand the impact...Marieke Guy
The blandness is its formulaic style’: insights to help understand the impact of AI on assessments
ChangeMakers AI Lunch & Learn sessions
Wednesday 1st November, 1-2pm
Redesigning assessments for a world with artificial intelligenceMarieke Guy
Redesigning assessments for a world with artificial intelligence presentation By Marieke Guy, Head of Digital Assessment, UCL
QAA Annual Conference, The Future of Quality: What’s Next?
Wednesday 13 September 2023
MCQs_ The joys of making your mind up.pdfMarieke Guy
Explore the benefits and challenges of using MCQs in both formative and summative assessment, and get practical guidance on designing good MCQs in AssessmentUCL.
4 March, 10.30am-11.30am. Online event.
Multiple choice questions have often had a bad rap in education, sometimes seen as assessing only lower level skills such as factual recall. However, with good question design this assessment approach can allow for testing of more complex cognitive processes. Add in the increasing sophistication of options offered by digital assessment platforms, which allow automatic grading and statistical analysis, and you can begin to significantly streamline your marking processes.
This workshop will explore the benefits and challenges of using MCQs in both formative and summative assessment and provide practical guidance on:
Constructing good MCQs
The range of MCQs available on digital platforms, focussing on AssessmentUCL.
There will be time for discussion and questions.
After attending this session, you will be able to:
Create worthwhile MCQs that test a range of learning outcomes.
Understand the range of MCQs available on digital platforms and how they can be used, focussing on AssessmentUCL.
Who should attend this session
All those engaged in teaching, assessment and the support of learning (academics, administrators, professional service colleagues).
Rubrics_ removing the glitch in the assessment matrix (1).pdfMarieke Guy
Rubrics bring together criteria, grades and feedback into a single scoring matrix. This session will explore how to design a good rubric and the benefits and potential challenges of using rubrics in assessments.
Would you like to increase reliability and consistency in marking, ensure alignment with intended learning outcomes and provide an efficient feedback mechanism for students? If so, this session on rubrics is for you.
Rubrics are a useful way of bringing together criteria, grades and feedback into a single scoring matrix to help streamline marking, provide transparency and support learners to understand how their performance will be judged.
This workshop will focus on the benefits and potential challenges of using rubrics in assessment within your subject area and provide practical guidance on:
How to design a good rubric
Creating and marking with rubrics in Assessment UCL
There will be opportunities for discussion and questions.
After attending this session, you will be able to:
Understand the benefits and potential challenges of using rubrics in assessment
Design an appropriate rubric for your assessments
Understand how to create and mark with rubrics in Assessment UCL
Who should attend this session
All those engaged in teaching, assessment and the support of learning (academics, administrators, professional service colleagues).
This is a presentation by Dada Robert in a Your Skill Boost masterclass organised by the Excellence Foundation for South Sudan (EFSS) on Saturday, the 25th and Sunday, the 26th of May 2024.
He discussed the concept of quality improvement, emphasizing its applicability to various aspects of life, including personal, project, and program improvements. He defined quality as doing the right thing at the right time in the right way to achieve the best possible results and discussed the concept of the "gap" between what we know and what we do, and how this gap represents the areas we need to improve. He explained the scientific approach to quality improvement, which involves systematic performance analysis, testing and learning, and implementing change ideas. He also highlighted the importance of client focus and a team approach to quality improvement.
Instructions for Submissions thorugh G- Classroom.pptxJheel Barad
This presentation provides a briefing on how to upload submissions and documents in Google Classroom. It was prepared as part of an orientation for new Sainik School in-service teacher trainees. As a training officer, my goal is to ensure that you are comfortable and proficient with this essential tool for managing assignments and fostering student engagement.
How to Make a Field invisible in Odoo 17Celine George
It is possible to hide or invisible some fields in odoo. Commonly using “invisible” attribute in the field definition to invisible the fields. This slide will show how to make a field invisible in odoo 17.
We all have good and bad thoughts from time to time and situation to situation. We are bombarded daily with spiraling thoughts(both negative and positive) creating all-consuming feel , making us difficult to manage with associated suffering. Good thoughts are like our Mob Signal (Positive thought) amidst noise(negative thought) in the atmosphere. Negative thoughts like noise outweigh positive thoughts. These thoughts often create unwanted confusion, trouble, stress and frustration in our mind as well as chaos in our physical world. Negative thoughts are also known as “distorted thinking”.
Synthetic Fiber Construction in lab .pptxPavel ( NSTU)
Synthetic fiber production is a fascinating and complex field that blends chemistry, engineering, and environmental science. By understanding these aspects, students can gain a comprehensive view of synthetic fiber production, its impact on society and the environment, and the potential for future innovations. Synthetic fibers play a crucial role in modern society, impacting various aspects of daily life, industry, and the environment. ynthetic fibers are integral to modern life, offering a range of benefits from cost-effectiveness and versatility to innovative applications and performance characteristics. While they pose environmental challenges, ongoing research and development aim to create more sustainable and eco-friendly alternatives. Understanding the importance of synthetic fibers helps in appreciating their role in the economy, industry, and daily life, while also emphasizing the need for sustainable practices and innovation.
Model Attribute Check Company Auto PropertyCeline George
In Odoo, the multi-company feature allows you to manage multiple companies within a single Odoo database instance. Each company can have its own configurations while still sharing common resources such as products, customers, and suppliers.
The Indian economy is classified into different sectors to simplify the analysis and understanding of economic activities. For Class 10, it's essential to grasp the sectors of the Indian economy, understand their characteristics, and recognize their importance. This guide will provide detailed notes on the Sectors of the Indian Economy Class 10, using specific long-tail keywords to enhance comprehension.
For more information, visit-www.vavaclasses.com
How to Split Bills in the Odoo 17 POS ModuleCeline George
Bills have a main role in point of sale procedure. It will help to track sales, handling payments and giving receipts to customers. Bill splitting also has an important role in POS. For example, If some friends come together for dinner and if they want to divide the bill then it is possible by POS bill splitting. This slide will show how to split bills in odoo 17 POS.
Palestine last event orientationfvgnh .pptxRaedMohamed3
An EFL lesson about the current events in Palestine. It is intended to be for intermediate students who wish to increase their listening skills through a short lesson in power point.
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdfTechSoup
In this webinar you will learn how your organization can access TechSoup's wide variety of product discount and donation programs. From hardware to software, we'll give you a tour of the tools available to help your nonprofit with productivity, collaboration, financial management, donor tracking, security, and more.
Read| The latest issue of The Challenger is here! We are thrilled to announce that our school paper has qualified for the NATIONAL SCHOOLS PRESS CONFERENCE (NSPC) 2024. Thank you for your unwavering support and trust. Dive into the stories that made us stand out!
1. The UCL lockdown
browser pilot
UCL Education Conference 2023
Marieke Guy, Head of Digital Assessment
m.guy@ucl.ac.uk
2. What is a lockdown browser?
• A lockdown browser provides the necessary tools for a student
to complete their exam but restricts the device from accessing
unauthorised material during the assessment duration
• Supports supervised closed-book and open-book assessment
• Available as part of AssessmentUCL / Wiseflow
• Can either be:
1. FlowLock – a written assessment conducted in the browser
(text-editor)
2. FlowMulti (with lock) – an MCQ conducted in the browser
• Includes an appendix manager that supports drawing, taking
images, latex, uploading files.
3. Rationale for a
lockdown browser
• Digital assessments offer benefits e.g.
allowing students to type which also
supports online marking
• Combining digital assessments with in-
person invigilation helps ensure academic
integrity
• Requirement from departments for in-
person digital assessments
• Meetings with Brunel (BYOD)
• Multiple pilots scoped to considering the
cost and feasibility for implementing a
particular model scale at UCL
4. UCL pilots
Pilot Number
of
students
Location Device type Date
1.BYOD mini-pilot 10 Students’ own
device
August 2022
2. BYOD pilot with
Pharmacy
14 Maplethorpe
lecture theatre
Students’ own
device
Dec 2022 –
Jan 2023
3. iPad pilot in Medicine 300+ Royal Free
and other
locations
iPads owned
by Medicine
2022 - 2023
4. TeamCo pilot 600+ ExCeL Laptops hired
from TeamCo
May 2023
5. Areas of interest for pilot
•Location
• Appropriate rooms
• Room booking
• Room set including
spacing
• Furniture
•Device
• Standardised
equipment
• Laptop loan
• App download
• Laptop requirements
• Set up on UCL
computers
FlowLock
assessment
• Guidance & support
• Functionality and
appendix manager
• Whitelisted sites
• Messaging
• Departmental needs
e.g. languages
Online
management and
invigilation
• Buffer window time
for login
• Passwords
• Attendance recording
and participation logs
• Offline access
Mitigation and
risk management
• Risk register
• Regulations
• Dealing with issues
Staff and student
perspectives
• Managing
expectations
• Support and
guidance
• Feedback collection
6. 1. Lockdown browser
BYOD mini-pilot
• Pharmacy research students – paid for
time
• Low-stakes assessment
• Guidance prior to assessment
• Focus group session
• 2 physical invigilators, 1 online invigilator,
1 manager
• Tasks to use appendix manager
• 1 staff played student, went offline
7. Downloading the
Lockdown browser
• From AssessmentUCL
• Name > Edit profile > System
requirements
• Download appropriate version
• Also options to verify the version of the
browser and try out the browser
John
8. 2. BYOD pilot with
Pharmacy
• Live and mock – PHAY0024
• 12th December mock, 12th January live
(in Maplethorpe lecture theatre)
• 2 presentations given to students
• Practice assessment and guidance
• CAT invigilation support
• Feeding back into regulations
• Laptop loan use around 1/3rd
• Buffer set at 45 minutes
•
9. Practice assessment
• Students added to practice assessments
for FlowLock and for FlowMulti (with lock)
• Explains the layout of the browser and
shows all the functionality available
including use of appendix manager:
uploading images, drawing etc.
• Receive a message from
AssessmentUCL as notification
• Shared and tested with Central
assessment Team, Digital Assessment
Team, accessibility team and TeamCo for
feedback
10. 3. iPad pilot in
Medicine
• Run by Taylor Bennie and UCL Medical
school
• iPads are managed by UCL but student
owned
• Taken place in Royal Free Campus,
Bloomsbury and Whittington, 3 District
General hospitals and Royal Horticulture
halls
• Some wifi issues and app set up issues
• Learnosity issues when using Jamf
11. 4. TeamCo pilot
• 12 modules including languages
• Staff Q&A session, student Q&A session
• Master machine to image and then the
creation of different profiles
• Passwords
• Each laptop will have the lockdown
browser already installed
• Each workstation will have:
1 x laptop (15.6” screen)
1 x keyboard
1 x mouse / mat
1 x ear plugs
12. Invigilator training
• Training for all of Central
Assessment Team and TeamCo
invigilators
• Coverage of problem areas for
students during assessments
• Support model for the day
(physical invigilation and online
invigilation)
13. What we need from you…
1. Details about your assessment content
• If you require any whitelisted sites (optional)
• Physical resources
• Changes to appendix manager (default =
drawing feature + Webcam)
2. Details about your marking
• Section-based marking is problematic
• Same interface as PDF marking, but advised
that instructions for students is clear re:
around labelling question responses
John
Team site
(AssessmentUCL User Group
> Lockdown Browser pilot)
14. Areas for consideration
• Room availability and set up, timetabling
• Devices
• Naming
• Regulations – online, in-person or a third way?
• Upload time
• Late arrivals
• Preparation and issues during an assessment
• Set up
15. Intended outputs
• Assess viability
• Develop formal regulations
• Scalability
• Costs
• Suitability
• Present back to UCL to
determine trajectory of
travel for in-person
assessments
Editor's Notes
Hi I’m
As it explains here A lockdown browser provides the necessary tools for a student to complete their exam but restricts the device from accessing unauthorised material during the assessment duration. It does this through an app that is installed on a device. This app closes down all other services on the machine and prohibits access to files. You then complete the assessment in a browser window
In wiseflow (the platform also known as AssessmentUCL) the lockdown browser used in the respondus browser and is known by Wiseflow as FlowLock
So why are we piloting this browser. Obviously during Covid we were restricted to online assessments, but now that Covid is no longer so prevalent there has been considerable interest in moving back to in-person assessments to ensure academic integrity. While we are spending time looking at assessment design and how it can encourage student engagement and reduce instances of collusion and misconduct we are also exploring other technical measures.
Digital assessments offer benefits e.g. allowing students to type which also supports online marking
Combining digital assessments with in-person invigilation helps ensure academic integrity
The pilot itself was driven by conversatiosn with Pharmacy
In order to run a mini-pilot testing the browser on a low stakes assessment we utilised a small group of postgraduate Pharmacy students who were carrying out research activities over the summer and therefore available on site. The students were invited along to a session in which they would complete an exam that had been already used earlier in the year and then participate in a focus group asking for their feedback on the experience. The students were paid for their time.
Preparation
Prior to the pilot the students were provided with guidance on how to download the lockdown browser is available from the WISEflow support page. The students were asked to ensure that their laptop was fully charged and had all the latest updates installed for the Operating System and any anti-virus software required. We also asked them to ensure they could connect to Eduroam (on campus) and that their password did not require updating. Those without a suitable laptop were asked to contact us in advance.
On the day, once students had arrived and were seated at the desk with their name we gave a short briefing introducing ourselves and outlining how the pilot would run.
Participant password on main screen This covered:
a quick overview of the FLOWlock browser and the login process
timings for the session
an explanation of the participant password (used to start the exam) and invigilator password (used to submit the exam and for technical issues)
requirements for the exam – what we wanted the students to test out (e.g. the drawing and appendix features, permitted/whitelisted sites)
general examination regulations (e.g. remaining silent, turning off phones) – while this wasn’t a real exam we wanted to replicate the exam environment as much as possible without causing too much stress
how to get help if there were any issues
Are they in-person online assessments? Or in-person digital assessments? Or even digital invigilated assessments?
There is already information in the regulations on laptop preparation as part of the technical failures policy. It will be important to reiterate the need for a fully charged laptop, good Eduroam connection, that the Flowlock app is downloaded, that the latest updates (laptop and Flowlock browser) have been carried out, that a laptop loan has been expressly asked for. Brunel say "Laptops will not be available for those arriving for a WISEflow exam without a suitably prepared device. " It is also important that students are aware of their password and checked that they are logged in as themselves.