This document discusses online assessment solutions and principles for the future of assessment. It summarizes the work of an Online Assessment Special Interest Group established in 2020 with 18 member institutions. The group focuses on assessment design, trust and ethics, and operational processes for online assessment. Principles for future assessment include being authentic, accessible, appropriately automated, continuous and secure. Features of future assessment include being grounded in realism, providing cognitive challenge, and embedding assessment in the learning process. The group aims to support members and contribute to the development of better online assessment practices.
Define your pedagogical approach; Define your business model; Define (inter)national opportunities and threats; Define institutional opportunities and threats; Define student attractors and deterrents; Review your pedagogical model; Review your business model
Knowledge Management in Project-Based OrganizationsOlivier Serrat
Projects ought to be vehicles for both practical benefits and organizational learning. However, if an organization is designed for the long term, a project exists only for its duration. Project-based organizations face an awkward dilemma: the project-centric nature of their work makes knowledge management, hence learning, difficult.
Describes four levels of knowledge capture: eliciting from individuals, harvesting from communities, gathering from networks, and exploring cyberspace.
Define your pedagogical approach; Define your business model; Define (inter)national opportunities and threats; Define institutional opportunities and threats; Define student attractors and deterrents; Review your pedagogical model; Review your business model
Knowledge Management in Project-Based OrganizationsOlivier Serrat
Projects ought to be vehicles for both practical benefits and organizational learning. However, if an organization is designed for the long term, a project exists only for its duration. Project-based organizations face an awkward dilemma: the project-centric nature of their work makes knowledge management, hence learning, difficult.
Describes four levels of knowledge capture: eliciting from individuals, harvesting from communities, gathering from networks, and exploring cyberspace.
Guest lecture given at SciencesPO (Paris School of International Affairs) to a Masters course on Trends in Comparative Education Policy (26 April 2017)
Designing an Effective Knowledge Partnership ProcessOlivier Serrat
Knowledge partnerships are about joint purpose in the identification, creation, storage, sharing, and use of knowledge; sadly, the state of the art in creating, managing, monitoring, and evaluating them remains immature.
This is my final research work I embarked during my BBA final year studies.
The world is now considered to be a knowledge economy in which organizations’ sharing and creation of knowledge form an important role in integration and innovation. Knowledge creation is recognized as strategically important organizational learning and innovation tool.
Knowledge can be created through a continuous dialogue process between tacit and explicit knowledge, as well as through four patterns, namely; interactions or socialization, combination, internalization and externalization. The research problem was based on the fact that knowledge can become obsolete, so it is imperative that knowledge creation and management is a continuous process enabling efficient and effective business practices.
Jordan Hill - Presentation of Engaging with education research- With a little...EduSkills OECD
Jordan Hill from the OECD Strengthening the Impact of Education Research project presents at the OECD webinar 'Engaging with education research- With a little help from the system' on 26 January 2024.
The Why and How of Knowledge Management: Some Applications in Teaching and Le...Olivier Serrat
Knowledge management—the process of identifying, creating, storing, sharing, and using organizational knowledge—aims to provide support for improved decision making. Its higher objective is to advance organizational performance. It is best exercised if the motive behind knowledge management initiatives is clear, with sundry possible areas of activity and associated perspectives.
Presentation exploring the relationship between policy and practice in the development of e-assessment in higher education and the importance of establishing a policy framework - developed in collaboration with all key stakeholders - to support wider uptake among academic staff.
Guest lecture given at SciencesPO (Paris School of International Affairs) to a Masters course on Trends in Comparative Education Policy (26 April 2017)
Designing an Effective Knowledge Partnership ProcessOlivier Serrat
Knowledge partnerships are about joint purpose in the identification, creation, storage, sharing, and use of knowledge; sadly, the state of the art in creating, managing, monitoring, and evaluating them remains immature.
This is my final research work I embarked during my BBA final year studies.
The world is now considered to be a knowledge economy in which organizations’ sharing and creation of knowledge form an important role in integration and innovation. Knowledge creation is recognized as strategically important organizational learning and innovation tool.
Knowledge can be created through a continuous dialogue process between tacit and explicit knowledge, as well as through four patterns, namely; interactions or socialization, combination, internalization and externalization. The research problem was based on the fact that knowledge can become obsolete, so it is imperative that knowledge creation and management is a continuous process enabling efficient and effective business practices.
Jordan Hill - Presentation of Engaging with education research- With a little...EduSkills OECD
Jordan Hill from the OECD Strengthening the Impact of Education Research project presents at the OECD webinar 'Engaging with education research- With a little help from the system' on 26 January 2024.
The Why and How of Knowledge Management: Some Applications in Teaching and Le...Olivier Serrat
Knowledge management—the process of identifying, creating, storing, sharing, and using organizational knowledge—aims to provide support for improved decision making. Its higher objective is to advance organizational performance. It is best exercised if the motive behind knowledge management initiatives is clear, with sundry possible areas of activity and associated perspectives.
Presentation exploring the relationship between policy and practice in the development of e-assessment in higher education and the importance of establishing a policy framework - developed in collaboration with all key stakeholders - to support wider uptake among academic staff.
An assessment workshop on the six critical areas that need to be addressed in developing online assessment at scale. Led by the Centre for Online and Distance Education with a delegation of VCs and senior leaders from Nigerian Universities, and senior representatives from the National Universities Commission of Nigeria. Held on 24th March 2023.
Presentation at the conference ecdea.org, 8 of June 2018Mats Brenner
Presentation of the Project Digital Exam II - SUNET Inkubator - for 1st European Conference on digital Exams and Assessment (ECDEA 2018), 8:th of June 2018 in Gothenborg, Sweden
An institutional perspective on analytics that focusses on a particular tool developed using an agile methodology to visualise learner behaviours in MOOCs via Sankey diagrams.
User Experience Showcase lightning talks - University of EdinburghNeil Allison
Lightning talk slide decks from a University of Edinburgh User Experience event held 13 October 2017. Topics: User needs, Web strategy, Digital Standards, Edinburgh Global Experience Language, Current student UX case study.
Overcoming Barriers to Online Engagement through carefull design and delivery...EADTU
Empower Webinar Week. Disclaimer: Funded by the European Union. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or the European Education and Culture Executive Agency (EACEA). Neither the European Union nor EACEA can be held responsible for them.
Instructions for Submissions thorugh G- Classroom.pptxJheel Barad
This presentation provides a briefing on how to upload submissions and documents in Google Classroom. It was prepared as part of an orientation for new Sainik School in-service teacher trainees. As a training officer, my goal is to ensure that you are comfortable and proficient with this essential tool for managing assignments and fostering student engagement.
Palestine last event orientationfvgnh .pptxRaedMohamed3
An EFL lesson about the current events in Palestine. It is intended to be for intermediate students who wish to increase their listening skills through a short lesson in power point.
Unit 8 - Information and Communication Technology (Paper I).pdfThiyagu K
This slides describes the basic concepts of ICT, basics of Email, Emerging Technology and Digital Initiatives in Education. This presentations aligns with the UGC Paper I syllabus.
The Roman Empire A Historical Colossus.pdfkaushalkr1407
The Roman Empire, a vast and enduring power, stands as one of history's most remarkable civilizations, leaving an indelible imprint on the world. It emerged from the Roman Republic, transitioning into an imperial powerhouse under the leadership of Augustus Caesar in 27 BCE. This transformation marked the beginning of an era defined by unprecedented territorial expansion, architectural marvels, and profound cultural influence.
The empire's roots lie in the city of Rome, founded, according to legend, by Romulus in 753 BCE. Over centuries, Rome evolved from a small settlement to a formidable republic, characterized by a complex political system with elected officials and checks on power. However, internal strife, class conflicts, and military ambitions paved the way for the end of the Republic. Julius Caesar’s dictatorship and subsequent assassination in 44 BCE created a power vacuum, leading to a civil war. Octavian, later Augustus, emerged victorious, heralding the Roman Empire’s birth.
Under Augustus, the empire experienced the Pax Romana, a 200-year period of relative peace and stability. Augustus reformed the military, established efficient administrative systems, and initiated grand construction projects. The empire's borders expanded, encompassing territories from Britain to Egypt and from Spain to the Euphrates. Roman legions, renowned for their discipline and engineering prowess, secured and maintained these vast territories, building roads, fortifications, and cities that facilitated control and integration.
The Roman Empire’s society was hierarchical, with a rigid class system. At the top were the patricians, wealthy elites who held significant political power. Below them were the plebeians, free citizens with limited political influence, and the vast numbers of slaves who formed the backbone of the economy. The family unit was central, governed by the paterfamilias, the male head who held absolute authority.
Culturally, the Romans were eclectic, absorbing and adapting elements from the civilizations they encountered, particularly the Greeks. Roman art, literature, and philosophy reflected this synthesis, creating a rich cultural tapestry. Latin, the Roman language, became the lingua franca of the Western world, influencing numerous modern languages.
Roman architecture and engineering achievements were monumental. They perfected the arch, vault, and dome, constructing enduring structures like the Colosseum, Pantheon, and aqueducts. These engineering marvels not only showcased Roman ingenuity but also served practical purposes, from public entertainment to water supply.
How to Split Bills in the Odoo 17 POS ModuleCeline George
Bills have a main role in point of sale procedure. It will help to track sales, handling payments and giving receipts to customers. Bill splitting also has an important role in POS. For example, If some friends come together for dinner and if they want to divide the bill then it is possible by POS bill splitting. This slide will show how to split bills in odoo 17 POS.
Model Attribute Check Company Auto PropertyCeline George
In Odoo, the multi-company feature allows you to manage multiple companies within a single Odoo database instance. Each company can have its own configurations while still sharing common resources such as products, customers, and suppliers.
1. Designing Online Assessment
Solutions that are rigorous, trusted, flexible and scalable
Klaus-Dieter Rossade, José Janssen, Carlton Wood & George Ubachs
EADTU-EUSummit, 11 May 2022
2. Online Assessment Special Interest Group
• Establishment of SIG January 2020; First
meeting March 2021; 5 meetings in 2021-2022
• 18 members institutions from 14 countries
• 37 HE practitioners + 18 contributors of good
practice
• 15 Good Practice case studies
• 4 Focus areas
• Assessment Futures
• Assessment Design
• Trust, Privacy and Ethics
• Operational processes, technology and support
https://online-assessment.eadtu.eu
3. Assessment Future is already present
• Online Assessment is here to stay
• Transition phase from exam hall to
online home exams
• Distance Teaching sector long
history of home-based assessment
• EADTU member institutions best
placed to lead
• Great variety of hybrid solutions
to online assessment
4. Principles for future assessment
• Authentic, i.e. a move away from acquiring knowledge to acquiring transferable
skills assessed in a more realistic way;
• Accessible i.e. the aspiration to design assessment within an accessibility-first
principle and delivered in multiple ways depending on the needs of future
learners;
• Appropriately automated which includes a mix of automated and human
marking and feedback that benefits learners;
• Continuous refers to the data and analytics to assess the effectiveness and
impact of continuous assessment; and
• Secure which should include elements of authoring detection and biometric
authentication for identity and remote proctoring
JISC (2020). The future of assessment: five principles, five targets for 2025.
https://repository.jisc.ac.uk/7733/1/the-future-of-assessment-report.pdf
5. Features of future assessment
• Assessment remains “most significant prompt for learning” (Boud, 1995)
• Authentic assessment that is grounded in realism, provides cognitive challenge and
trains authentic evaluative judgement, (Villaroel et. al., 2018) i.e. ability to assess
quality within any given discipline
• “Encourage and support, not undermine the learning process” (Shute & Kim, 2013)
• “stealth assessment” embedded in the learning process – “weaving assessment
directly into the learning environments” and ”provide formative information whenever
possible” (Shute & Kim, 2013)
• Low stakes assessment points, allow frequent repeat, dynamic personalised
progression, performance data to contribute to final course results
6. Assessment Design (Chapter 1)
• Number of assessment points
• Stakes: formative or summative, weighting
• Format: open/closed book exams, time limits,
• Evidence based implementation with future in mind
• Navigate quality standards, student needs,
institutional and regulatory context
• Balance of existing vs. new technologies
• Choice and flexibility as part of the design
• Authenticity and personalization by design
• Take academic staff along the journey
7. Good Practice: Flexibility and Choice
Universidade Aberta, Portugal, offers flexibility through its
virtual pedagogical model (VPM) by stipulating “a degree
of choice” in assessment. Student can opt for continuous
assessment via three submissions or a single endpoint
assessment, typically a written exam.
At TAMK, Finland, flexibility and student choice led to
adding weekly assessment to the final exams on a online
engineering course. These weekly assignment points were
automated and students could retake them as often as
they wanted at a time that suited them.
8. Trust, Privacy and Ethics (Chapter 2)
Multi-layered concept (Edwards et al., 2018)
1. technology (e.g., functions reliably and as
expected; usability)
2. deployment of technology (e.g. transparency,
teacher competence)
3. organisation deploying e-assessment (e.g. based on
reputation)
4. privacy and personal data processing (e.g., data
processed as agreed and intended; informed
consent).
5. reliability/fairness process (identity and authorship
verification)
9. Wholistic approaches to enhance trust (1)
Build a narrative for stable, sustainable, robust and data-privacy
respectful solutions
Technology and its deployment
chose technology for usability and ease of support.
provide careful guidance and opportunities to try out the system
Organisation
balance academic standards with ethical consideration to student experience of
‘feeling overly scrutinized’
involve students as partners in decision making
10. Wholistic approaches to enhance trust (2)
Build a narrative for stable, sustainable, robust and data-privacy
respectful solutions
Privacy and personal data processing
be transparent about purpose of data processing in relation to each assessment
ensure cybersecurity and GDPR compliance of tools used
Reliability/fairness process
verify identity and authorship
build trust in assessor and the assessment of invigilation recordings
provide clear protocols for fraud detection and follow up with students
11. Trust is a two-way street
“Academic integrity is a pedagogical issue and should not be limited to not getting
caught during an exam. We need to be able to trust our students that they will not lie
about their methods, falsify their results or plagiarise. These are fundamental values
of academic work and need to be developed as such.”
“We need to teach our students to be critical of the surveillance society in which we
live, not force them to accept it.”
SIG member Henrietta Carbonell, personal communication, 10-2-2022
“It’s nasty to be treated as a fraud suspect”
“To feel you’re being watched is very unpleasant. I even didn’t dare look out of the
window for fear of being considered a fraud”
Student evaluation, in: Nielissen, 2021
12. Operational processes, technology
and support (Chapter 3)
• Text
Challenges during the pandemic
• How did institutions organise themselves to
deliver the required operational processes?
• Could face-to-face provision be adapted for on-line
delivery?
• To what extent was technology deployed to assist
in the delivery of operational process?
• How did Universities support staff and students
whilst delivering the process?
13. Deployment of Technology – Themes
• Range of solutions that were employed
• Solutions developed in house versus those
available commercially
• Deployment of technology – proctoring and
plagiarism tools
• Changes that were introduced could increase
concern/anxiety amongst students
• Difficulties that were encountered with
technology
14. Online Assessment beyond the pandemic
Meet the challenge of delivering “capable, competent, informed citizens
adequate to the challenges of a twenty-first century lifetime” (Ashford, 2014)
• Online assessment part of growing demand for shorter and flexible education
(Certificates and Diplomas, Microcredentials), short learning programmes (SLP)
and Continuing Education and Professional Development (CEPD)
• SIG has captured members’ local expertise in how to design and plan institutional
online assessment strategies (during pandemic and post-pandemic)
• Deliverables: inventory of challenges, practices and new developments, examples
of research and innovation in online assessment, identification of policies and
frameworks that define the context of assessment for the institutions.
• SIG will continue to provide the peer support to help address future challenges,
contribute to further community building to develop better assessment without
the need to re-invent the wheel every time.
15. References
Boud, D. 1995. “Assessment and Learning: Contradictory or Complementary?” In Assessment for Learning in
Higher Education, edited by P. T. Knight, 35–48. London.
JISC (2020). The future of assessment: five principles, five targets for 2025.
https://repository.jisc.ac.uk/7733/1/the-future-of-assessment-report.pdf
Emerge and JISC (2020). Assessment Rebooted. From 2020s quick fixes to future transformation.
https://repository.jisc.ac.uk/7854/1/assessment-rebooted-report.pdf
Kevin Ashford-Rowe, K, Janice Herrington, J. and Brown, C (2014) Establishing the critical elements that
determine authentic assessment, Assessment & Evaluation in Higher Education, 39:2, 205-222, DOI:
10.1080/02602938.2013.819566
Nielissen, G. (2021). Studeren in coronatijd. Thuistentamens en andere aspecten van studeren in de
coronaperiode. Open Universiteit. Expertisecentrum Onderwijs (ECO).
Shute, V. J., Y. J. Kim. 2013. “Formative and Stealth Assessment.” In Handbook of Research on Educational
Communications and Technology, 4th ed., edited by J. M. Spector, D. M. Merrill, J. Elen, and M. J. Bishop, 311-
321. New York: Springer Science Business Media.