IVY workbench evaluation Diogo Martins Nuno Job Rui Freitas

1. IVY workbench
evaluation
Diogo Martins 10910
Nuno Pinto 12797
Rui Freitas 10908

2. Outline
• HCI and IVY workbench
• Objectives
• Interface evaluation
• The case study
• The experience results
• The statistical results
• Conclusions

3. HCI

5. IVY workbench

6. Objectives

7. Objectives

8. Objectives

9. Objectives
?

10. Interface evaluation
• Methods

11. Interface evaluation
• Methods
• Groups

12. Interface evaluation
• Methods
• Groups
• Local

13. Interface evaluation
• Methods
• Groups
• Local
• The experience

14. The case study
• Problem description
• Given examples

15. The case study
• Problem description

16. The case study
• Given examples

17. The experience results
• User’s behavior
• previous knowledge in Model Checking
• no previous knowledge in Model Checking
• User’s opinions
• physical states
• tabular

19. User’s behavior
• Users with previous knowledge in Model Checking:
• Comfortable
• Easy learning
• Problem identified

21. User’s behavior
• Users without previous knowledge in Model Checking:
• Difficulties in understanding the Tabular representation
• Easy understanding in the Physical States representation
• Problem identified in both cases

22. User’s opinions
• Physical states

23. User’s opinions
- Action Highlight

24. User’s opinions
- Components Highlight

25. User’s opinions
- State variables inside
the state boxes

26. User’s opinions
- Zoom

27. User’s opinions
- Horizontal diagram (reduce scroll, easier to compare states)

28. User’s opinions
- Loop Arrow connected
and should have the action

29. User’s opinions
- Highlight changed variables

30. User’s opinions
- Highlight condition violation

31. User’s opinions
• Tabular

32. User’s opinions
- Explain the yellow color

33. User’s opinions
- Loop

34. User’s opinions
- Highlight the action

35. User’s opinions
- System component

36. User’s opinions
- Highlight condition violation

37. The statistical results

38. Conclusions