Integration of Third-party  Components into TAO   The ItemBuilder Example
Overview• History and Background Information  Heiko Rölke (roelke@dipf.de), DIPF• Technical Information  Michel Dorochevsk...
History• Concrete Idea: 2006  – PISA 2009 – ERA  – Item Development in Luxembourg and Germany• Prototype in Spring 2007  –...
History -2-PIAAC (since 2008)• Runtime re-factoring (+ new name)• Emphasis on complex interaction modes• Equating/Mode eff...
Main Ideas• Empower Item Developpers  – Authoring System  – WYSIWYG  – Templates• Separate Design from Execution  – Stand-...
CBA Item Builder ComponentsCBA Item Builder:            standalone authoring tool with previewCBA Item:                   ...
CBA Item BuilderStandalone Visual Editor for building CBA Items   Rich Text    Fields    (static/    interactive)   Inpu...
Examples of CBA ItemsTypical Examples Simulation of an “Email / Web Scenario”    The test person receives an email and sh...
Implementation and Architecture1. Massive re-use of existing Open Source Components/Frameworks for Development and   Runti...
Integration in TAOExample PIAAC 2011   CBA Item integrated as a    web component (stimulus)    into the TAO test frame. ...
CBA TAO AdapterStimulus Area (CBA Item Area) implemented using HTML Element “iframe”
API TAO AdapterCBA TAO API (in Flash) StartTask(Task, X, Y, W, H, SnapshotRef) EndTask(TaskID)TAO Callback Messages not...
CBA Item Life-CycleLife-Cycle of a “CBA Item“ at Runtime Loaded     CBA Item is loaded the first time a task is     calle...
Java Script APIMore General Java Script API (without Flash Adapter)Start/Restart a task of a CBA Item     function: StartT...
Usage and ExamplesCBA Item Builder:  – Editor with graphical user interface  – Easy to handle for non-IT-specialists  – Wi...
Usage and Examples   Usage: The user interface of the CBA IB                                                             E...
Usage and ExamplesWhat types of items does the CBA IB support?• Static / dynamic• Simple / complex• Text only / multimedia...
Usage and ExamplesExamples: Simple questionnaire
Usage and ExamplesExamples: Simple multiple choice item
Usage and ExamplesExamples: Simulation of a technology rich  environment                                  - Web Browser Si...
Usage and ExamplesExamples: Problem solving scenario                                     - Simulation of a                ...
Usage and ExamplesExamples: Interaction and response modes• Click responses (via mouse)  – Radiobuttons, Buttons, Checkbox...
Usage and ExamplesExamples: Click responses                                Radiobuttons       Clickable                   ...
Usage and ExamplesExamples: Highlighting text
Usage and ExamplesExamples: Highlighting text
Usage and ExamplesExamples: Numeric and textual entries
Questions?
Upcoming SlideShare
Loading in …5
×

TAO DAYS - Integration of 3rd party components into TAO

954 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
954
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
9
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

TAO DAYS - Integration of 3rd party components into TAO

  1. 1. Integration of Third-party Components into TAO The ItemBuilder Example
  2. 2. Overview• History and Background Information Heiko Rölke (roelke@dipf.de), DIPF• Technical Information Michel Dorochevsky (Michel.Dorochevsky@softcon.de), SOFTCON AG• ItemBuilder Usage and Examples Gabriele Gissler (gissler@dipf.de), DIPF
  3. 3. History• Concrete Idea: 2006 – PISA 2009 – ERA – Item Development in Luxembourg and Germany• Prototype in Spring 2007 – HyperText Builder• All ERA items (re)developped – Browser – Mail Client
  4. 4. History -2-PIAAC (since 2008)• Runtime re-factoring (+ new name)• Emphasis on complex interaction modes• Equating/Mode effectsComplex Problem Solving• MicroDYN• Finite State Machine controlled items
  5. 5. Main Ideas• Empower Item Developpers – Authoring System – WYSIWYG – Templates• Separate Design from Execution – Stand-alone Designer – Generated Executable
  6. 6. CBA Item Builder ComponentsCBA Item Builder: standalone authoring tool with previewCBA Item: result of authoring is deployed on delivery platformCBA Runtime: executes the item Test Developer PC Delivery Platform CBA Item Builder CBA Runtime <<generates>> <<executes>> <<is deployed>> CBA Item CBA ItemMany different delivery platforms available: CBA Server => e.g. PIAAC Translation and Test Portal Web Delivery Environment => Integration in other Test Platforms (e.g. VMWare Integration with TAO) CBA Execution Environment => Web, Intranet, Soft Appliance, Memory Stick
  7. 7. CBA Item BuilderStandalone Visual Editor for building CBA Items Rich Text Fields (static/ interactive) InputFields Buttons Links CheckBox Images ImageMaps Video/Audio MediaPlayer …
  8. 8. Examples of CBA ItemsTypical Examples Simulation of an “Email / Web Scenario” The test person receives an email and should book cinema tickets online. Explore and understand a dynamic model (MicroDYN) The test person should explore and master a dynamic system with input (exogenous) variables influencing output (endogenous) variables. Understand an automaton based on a Finite State Machine (MicroFIN) The test person should interact with a mobile phone and set time to summertime.
  9. 9. Implementation and Architecture1. Massive re-use of existing Open Source Components/Frameworks for Development and Runtime  Item Development: CBA Item Builder Java, Eclipse RCP, Eclipse GMF/EMF, openArchitectureWare, in a second step also Xtext  Item Delivery: CBA Runtime GUI Framework: initially Adobe Flash (asWing), now Eclipse RAP (Rich AJAX Platform) Platform: JBoss Application Server, OSGi Framework: Spring, EJB Apache SCXML (for FSM engine)2. Architecture  model-driven  component oriented
  10. 10. Integration in TAOExample PIAAC 2011 CBA Item integrated as a web component (stimulus) into the TAO test frame. TAO controls the test execution and the lifecycle of the CBA Item at runtime TAO communication based on Flash/JavaScript TAO Adapter (cba_rte.swf) provides API
  11. 11. CBA TAO AdapterStimulus Area (CBA Item Area) implemented using HTML Element “iframe”
  12. 12. API TAO AdapterCBA TAO API (in Flash) StartTask(Task, X, Y, W, H, SnapshotRef) EndTask(TaskID)TAO Callback Messages notify() Return message record_trace() Trace events record all user interactionsTask corresponds to an “inquiry” in TAO. A CBA Item maycontain several tasks e.g starting with different pages.Snapshot represents the state of a CBA Item, allowsrestoring when going back to a task.
  13. 13. CBA Item Life-CycleLife-Cycle of a “CBA Item“ at Runtime Loaded CBA Item is loaded the first time a task is called (global resource) Active CBA Item is initialized for the session and the requested task (session state)StartTask() First initialization when calling the task for the first time (no snapshot) or Restore last state (using snapshot) when continuing a taskEndTask() Saves the current state and returns a snapshot Computes the score “on the fly” and returns the score result (useful for adaptive testing)
  14. 14. Java Script APIMore General Java Script API (without Flash Adapter)Start/Restart a task of a CBA Item function: StartTask() callback function: extCBAEvent(logText)Stop a running task function: StopTask() callback function: extCBAEndTaskResponse(itemScore, snapshotUrl)Notify about any user interaction callback function: extCBAEvent(logText)Save an intermediary state function: RequestSnapshot() callback function: extCBASnapshotResponse(snapshotUrl)
  15. 15. Usage and ExamplesCBA Item Builder: – Editor with graphical user interface – Easy to handle for non-IT-specialists – Wide spectrum of graphical possibilities, templates – WYSYWYG (preview of test item) – Short development times – Support of test development process (translation and adaptation of test items)
  16. 16. Usage and Examples Usage: The user interface of the CBA IB Editor for single graphicalSet of componentspages Project Designer view Toolbar Properties view view (page editor) Tool set for Graphical graphical interface / components drawing board
  17. 17. Usage and ExamplesWhat types of items does the CBA IB support?• Static / dynamic• Simple / complex• Text only / multimedia• Linear structure / hypertext structure
  18. 18. Usage and ExamplesExamples: Simple questionnaire
  19. 19. Usage and ExamplesExamples: Simple multiple choice item
  20. 20. Usage and ExamplesExamples: Simulation of a technology rich environment - Web Browser Simulation - Simulation of a web application including search functionality - Hypertext structure
  21. 21. Usage and ExamplesExamples: Problem solving scenario - Simulation of a dynamic system consisting of states, events and transistions - Graphical representation of an automaton - Keys are linked to events and trigger transitions - Display represents states
  22. 22. Usage and ExamplesExamples: Interaction and response modes• Click responses (via mouse) – Radiobuttons, Buttons, Checkboxes etc. – Clickable image areas – Clicking on a hyperlink – Choosing an item from a drop down box – Menu items• Highlighting (via mouse)• Numeric and textual entries (via keyboard)
  23. 23. Usage and ExamplesExamples: Click responses Radiobuttons Clickable (1 out of x) Image Area Checkboxes (x Button out of y) Link to a page Dropdown Trigger of event menu (1 out of x) Menu items Text link
  24. 24. Usage and ExamplesExamples: Highlighting text
  25. 25. Usage and ExamplesExamples: Highlighting text
  26. 26. Usage and ExamplesExamples: Numeric and textual entries
  27. 27. Questions?

×