2020 9th International Conference on Software and Computer Applications (ICSCA 2020) http://www.icsca.org/ Journal of Software http://www.jsoftware.us/index.php?m=content&c=index&a=show&catid=217&id=2990

1. Measurable Interactive Application
to Find Out User Recognition and
Strategy when Problem Solving
Taku Yamaguchi, snowy Hokkaido, Japan
Michiko Oba @Future University Hakodate
Feb. 19, 2018
in Langkawi, Malaysia
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 1

2. Background
Fostering the ability to think is important in
education.
“cognitive capabilities, including critical and rational
thinking, to identify solutions to 'unsolvable' issues”
is “required in a matured society”
The Central Council for Education,
Ministry of Education, Culture, Sports, Science and Technology,
Japan, 2012
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 2

3. Challenge
How can we detect and evaluate the process to
solve “unsolvable” problems?
• without interviews or watching video
recordings
• the process may involve trial-and-error.
• the solution may not be something like “the
shortest route to the correct answer” because
the problem may not have correct answers.
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 3

4. Method
• Measurable interactive application
• Temporal co-occurrence analysis
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 4

5. Measurable interactive applications
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 5

6. Measurable interactive application
Designed such that
• the UI objects
are associated with terms that are used to
describe the user's recognition or strategies.
• the user operations/actions are recorded
through the UI objects
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 6

7. UI and strategy description
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 7
p.1
p.2
...
• Introduction
• Methods
• Results
...
pages organizational structureUI objects
“Read page 2 first,
then page 4
and exit.”
“Read Methods first,
then Results
and exit.”
... to read papers efficiently
strategy
description

8. Examples
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 8

9. Worksheet writing “Topic Writer”
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 9
• UI objects are the cells in the
“worksheet”.
cell to writelabel of the cell

10. Worksheet writing “Topic Writer”
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 10
• If the users write with the
same worksheet Glossary,
we may find out that they
tend to edit “Characters of
the readers” and “Benefits”
alternately,
• even if they may produce
different texts,
nor we do not have the
produced texts.

11. Composing puzzle “Jigsaw Text”
• the UI objects, the pieces
of a puzzle, are
fragments of a text.
• Fragments are randomly
ordered when started
• Players rearrange the
fragments using a drag &
drop function to create
correctly ordered text.
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 11

12. Measurement
• s4, s7, ... are ID's
of the pieces
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 12
As a derivative of this, the scammers ...s5
However, the real problem may be that ...s7
There are two main types of 'it's me' scam.s2
The damage of 'it's me' scam does not ...s1
One is precisely an 'it's me' scam that ...s3
One is that scammers impersonate ...s4
operation: drag start
target piece: s4
previous piece: s5
next piece: s2
timestamp: 2018-08-30 10:37:49
operation: dropped
target piece: s4
previous piece: s3
next piece: s1
timestamp: 2018-08-30 10:37:50

13. Temporal co-occurrence analysis
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 13

14. • Temporal co-occurrence patterns in user
operations.
• When two operations frequently occur at close
to the same time, it indicates that, for the user,
there is some relationship between those
operations
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 14

15. operation sequence ...
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 15
As a derivative of this, the scammers ...s5
However, the real problem may be that ...s7
There are two main types of 'it's me' scam.s2
The damage of 'it's me' scam does not ...s1
One is precisely an 'it's me' scam that ...s3
One is that scammers impersonate ...s4
As a derivative of this, the scammers ...s5
However, the real problem may be that ...s7
There are two main types of 'it's me' scam.s2
The damage of 'it's me' scam does not ...s1
One is precisely an 'it's me' scam that ...s3
One is that scammers impersonate ...s4
nth operation (n + 1)th operation

16. Temporal co-occurrence matrix
• s3 is moved in the nth operation
• s4 is moved in the (n + 1)th operation
• this co-occurrence is counted as below
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 16
s1 s2 s3 s4 s5 s6 s7
s1
s2
s3 +1
s4
s5
s6
s7
nth
(n + 1)th

17. Temporal co-occurrence matrix
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 17
• mean + SD <
• mean + 2SD <
• The diagonal cells are
excluded because of the
focus to the relation of
different pieces
yellow bg.
red bg.

18. Temporal co-occurrence analysis
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 18
frequently moved
succesively:
s3 - s4, s4 - s5
inferred relationship:
s3 - s4, s4 - s5

19. Proof of Concept
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 19
“Jigsaw Code”
programming version
of Jigsaw Text
just started
correct
answer

20. Proof of Concept
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 20
Co-occurrence matrix
• 32 students solved
the puzzle
• some relationship
s4 - s6, s6 - s3
Puzzle
• data is an array
• instructed to calculate the
average of data

21. Players tend to
1. arrange the for-loop skeleton
2. and then place the variable declaration
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 21

22. The strategy found from data analysis
• without interviews nor watching video
recordings
• regardless they reached the correct answer
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 22

23. Conclusion
• proposed the measurable interactive apps and
the temporal co-occurrence analysis.
• POC for programming skills assessment
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 23

24. Also expect these methods to apply:
• Usability assessment
• Knowledge management
knowledge is the strategies taken in processes
• Human Resource
skill is strategies they can take
• Quality Control
control strategies they take in process
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 24
appsinteraction usability
assessment
student
assessment

25. Thank you
ICSCA 2020, Feb. 19, 2018 Taku Yamaguchi 25