E-Testing based on Service Oriented Architecture

  • 369 views
Uploaded on

 

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
369
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
10
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. 10-th International Computer Assisted Assessment Conference e-Testing based on Service Oriented Architecture Goce Armenski, M.Sc (armenski@ii.edu.mk) Institute of Informatics - FNS University “Ss. Ciryl and Methodious” – Skopje, Macedonia
  • 2. 1. Content CONTENT - ЕТЕСТ – SYSTEM FOR ELECTRONIC TESTING - INTRODUCTION - АRCHITECTURE, CONCEPTS AND FUNCTIONALITY OF ЕТEST - APPLICATION OF ETEST - RESULTS - SERVICE ORIENTED ARCHITECTURE - SOA IN EASSESSMENT - COMMON FRAMEWORK - CONCLUSION 10-th International Computer Assisted Assessment
  • 3. 2. Introduction 1. INTRODUCTION Changes in the way people live influenced by: - Globalization - Increased meaning of knowledge - Information and communication revolution Changes in the education (lot more students) - Lecturing process - Delivery of materials - Knowledge assessment 10-th International Computer Assisted Assessment
  • 4. 3. Introduction New education paradigms Teacher  Student centered education 10-th International Computer Assisted Assessment
  • 5. 4. Introduction MOTIVATION AND GOAL Institute of Informatics (FNS) - every year 150+ students - 4 questions (assignments) x 150 students = 600 questions - 5 min for marking a question - 3000 min / 50 hours How long the marking will take??? Ontime feedback??? Personalized feedback??? Objectivity??? 10-th International Computer Assisted Assessment
  • 6. 5. Motivation and goal Development of a system for assessment of large number of students (more that 150) every month, which can be used in distance learning, as well as any other form of knowledge or skill assessment. - Motivation for test construction Different tests for every student with same weight Lowering the possibility for memorizing - Motivation for simple data entry Possibility for bulk entering of data - Motivation for reports creation Statistical analyses of gathered information 10-th International Computer Assisted Assessment
  • 7. 6. еТest – concepts and functionality 2. еТEST – CONCEPTS AND FUNCTIONALITY Basic concepts of systems for eTesting QuestionMark, BlackBoard, WEB CT, Top Class, EduSystem - Question bank, - Algorithms for test creation, - Systems for data presentation, - Result reports 10-th International Computer Assisted Assessment
  • 8. 7. еТest – concepts and functionality еТest Technology Web based sollutions VS desktop based sollutions - Web based application - Active Server Pages (ASP) - JavaScript - SQL Server 2000 - NT Server and Win 2000 compatible - IIS 4.0 or newer Web Browser (Netscape 4.x or Internet Explorer 4.x, and above) JScript SQL Server Email IIS 4.0 + ASP Access (SMTP) 10-th International Computer Win 2000 Server Assisted Assessment
  • 9. 8. еТest – concepts and functionality еТest Architecture user interface Web Server (system modules) application logic SQL statements Data data laye r Database Fig. 2 Three tier architecture of the eTesting system 10-th International Computer Assisted Assessment
  • 10. 9. еТest – concepts and functionality еТест Concepts - Course organization - Types of questions - Test creation algorithm - System for data presentation - Marking and reporting 10-th International Computer Assisted Assessment
  • 11. 10. еТest – concepts and functionality Course organization - learning objects - three structure LECTURE PART A PART B PART C SET SET SET SET A1 A2 A3 A4 Fig. 3 Course organization 10-th International Computer Assisted Assessment
  • 12. 11. еТest – concepts and functionality Types of questions • Multichoice questions (choose one of many, choose many of many, yes/no answers); • Short entry answer (text or numerical); • Essay answer. • Questions can have pictures or graphs in the text or offered answers 10-th International Computer Assisted Assessment
  • 13. 12. еТest – concepts and functionality Test creation algorithm Linear Dynamic Testlets Mastery Adaptive linear models Level of adaptation of the test Fig. 4 Algorithms for test creation - dynamic linear tests (fixed number of questions) Marking and reporting - results are shown at the end of the test 10-th International Computer - negative marking Assisted Assessment
  • 14. 13. еТest – concepts and functionality Statistical data analyses • Identification of content which is not well presented; • Personalized feedback to students; • Identification of week questions which need to be revised before used again; • Identifying the individual weaknesses of students. 10-th International Computer Assisted Assessment
  • 15. 14. Application of eTest 4. APPLICATION OF еТEST - Integration in the process of learning - Controlled learning проучи тестирај проучи тестирај проучи тестирај проучи тестирај проучи тестирај А1 А1 А2 А2 А3 А3 А4 А4 А А (А 1 ,А2 , А3 , А 4 ) (А 1 ,А2, А3, А 4 ) Fig. 5 Way of passing the learning objects Successful strategy?? - all questions - N questions in a row - N right questions 10-th International Computer - 3 right questions in a row Statistical analyses of the user activities Assisted Assessment
  • 16. 15. Results 5. RESULTS Practical Implementation • Institute of Informatics , FNS (2001) • А.D. Mobimak (2002) • UNDP (2003-2004) The use of technology in education is very dependent of the organization - logistics - social changes Synchronization with other systems 10-th International Computer Technical infrastructure Assisted Assessment
  • 17. 16. Results Data gathering Institute of Informatics, FNS (january 2001) - 26 courses - 12391 questions - 589 scheduled assessments - 9861 generated tests Does eTesting provides more effective and more objective assessment compared to the traditional forms, and does it help the learning process 10-th International Computer Assisted Assessment
  • 18. 17. Results Problems Facing with Installed in 4 Faculties from 3 Universities - not interoperable - does not allow searching or using common question bank - does not allow cross-institutional cooperation - not fully standards compliant 10-th International Computer Assisted Assessment
  • 19. 18. Results Possible Solution 10-th International Computer Assisted Assessment 10-th International Computer Assisted Assessment Conference
  • 20. 19. Service Oriented Architecture 6. SERVICE ORIENTED ARCHITECTURE IT Architecture Requirements • Simplicity • Software that reflects the need of business • Agility and flexibility • Reusability • Technology independent • Promote integration 10-th International Computer Built to Change Assisted Assessment 10-th International Computer Assisted Assessment Conference
  • 21. 20. Service Oriented Architecture Evolution of the Web HTML, XML HTML HTML HTML, XML 10-th International Computer Generation 1 Generation 2 Generation 3 Static HTML Web Applications Web Services Assisted Assessment 10-th International Computer Assisted Assessment Conference
  • 22. 21. Service Oriented Architecture SERVICE ORIENTED ARCHITECTURE An approach for building distributed computing systems based on encapsulating business functions as services that can be easily accessed in a loosely coupled fashion. 10-th International Computer Assisted Assessment 10-th International Computer Assisted Assessment Conference
  • 23. 22. Service Oriented Architecture SOA: It’s Not a Thing It’s not a: • Product • A specific technology • An application • A specific standard • A specific set of rules An Approach for Building Agile and Flexible 10-th International Computer Business Applications Assisted Assessment 10-th International Computer Assisted Assessment Conference
  • 24. 23. SOA in eLearning 7. SOA in eLearning • JISC Technical Framework to support e-Learning (ELF). • IMS Abstract Framework (IAF) • LeAPP Learning Architecture Project • Carnegie Mellon’s Learning Services Architecture 10-th International Computer Assisted Assessment 10-th International Computer Assisted Assessment Conference
  • 25. 24. SOA in eLearning e-Learning (ELF) 10-th International Computer Assisted Assessment 10-th International Computer Assisted Assessment Conference
  • 26. 25. SOA in eAssessment 8. SOA in eAssessment • FREMA. • TENCompetence Assessment Model 10-th International Computer Assisted Assessment 10-th International Computer Assisted Assessment Conference
  • 27. 26. SOA in eAssessment FREMA Core Services • Support Services • Assessment Services – Schedule – Assign – Notify – Author item – Track – Author assessment – Authorise and – Validate assessment Authenticate Reference – Take assessment Impl’ – Mark assessment Service Profiles – Moderate assessment Gap Analysis – Grade Assessment – View Feedback Use Cases Use Cases Use Cases Common Usage Patterns 10-th International Computer Assessment Domain Definition Assisted Assessment 10-th International Computer Assisted Assessment Conference
  • 28. 27. SOA in eAssessment TENCompetence - Phases in the assessment process Assessment Design Item Construction Assessment Construction Assessment Delivery Respons Evaluation 10-th International Computer Decision Making Assisted Assessment 10-th International Computer Assisted Assessment Conference
  • 29. 28. SOA in eAssessment eTest Core Services • Assessment Services • Support Services – Item Construction – Schedule – Test Construction – Notify and Announce – Test Delivery – Results Collecting – Track – Marking – Authentication – Decision Making – User Management – Statistical Analysis 10-th International Computer Assisted Assessment 10-th International Computer Assisted Assessment Conference
  • 30. 29. SOA in eAssessment SOA Projects in eAssessment – Research Projects • TOIA – Technologies for Interoperable assessment • ASSIS – Assessment Sequencing • APIS – assessment Provision through Interoperability • … and many others – Standards Bodies • In Assessment – IMS, OSIDs … • In Web Services - SOAP, WSDL, WSRF, W3C … 10-th International Computer Assisted Assessment
  • 31. 30. Conclusion 6. CONCLUSION and FUTURE FORK Service Oriented Architecture • Advantages over monolithic applications for Testing Review of existing SOA models for eAssessment • Design of Common Framework by service identification • Practical realization Extend the ASSIS project with different test delivery models • Dependent on context • Game based learning 10-th International Computer Assisted Assessment
  • 32. Thank you for your time! 10-th International Computer Assisted Assessment