Exploratory Sequential Data Analysis (ESDA) is used to analyze sequential data to identify patterns over time in order to help understand systems, environments, and behaviors. ESDA analyzes preserved sequential data in an exploratory manner guided by methodological traditions to seek meaning related to a research or design question. It is used to observe what people do over time and includes both quantitative techniques like statistical analysis and qualitative techniques like interaction analysis. An example of ESDA output is a timeline that shows the lag sequential analysis of events.

1. Exploratory Sequential Data Analysis (ESDA) Angela Tan M6603 Human Factors Methods

2. What is ESDA? E xploratory vs Confirmatory S equential – ordinal, temporal, pattern D ata A nalysis

3. Why do we need these patterns? Steelmaker’s problem-solving process (Bainbridge & Sanderson, 1995) Interaction of airport ground operations (Suchman & Trigg, 1991) Communication sequence between effective and ineffective crews in flight simulation (Bowers, Jentsch, Salas & Bruan, 1998)

4. What is ESDA? (Sanderson & Fisher,1994) ESDA is any empirical undertaking seeking to analyze systems, environmental, and/or behaviour data (usually recorded) in which the sequential integrity of events has been preserved. The analysis of such data (a) represents a quest for their meaning in relation to some research or design question, (b) is guided methodologically by one or more traditions of practice, and (c) is approached (at least at the outset) in an exploratory mode.

5. In a nutshell ESDA is used when we want to observe what people do over time. ESDA is a family of observational methodologies

6. How do we do ESDA?

7. system environmental behavioral events System – configurations, modes, responses, ouputs Environmental – work request, interruptions, network loads Behavioral – eye movement, gestures, talk

8. The 8 Cs

9. Some ESDA Techniques (Quantitative) Statistical sequential data analysis Markov analysis Lag sequential analysis Grammatical Techniques Probabilistic finite state automata Fisher’s cycles Maximal repeating patterns Regular expressions Rewriting Comparison Techniques Sequential comparisons Item comparisons

10. Some ESDA Techniques (Qualitative) Cognitive Protocol analysis Social Qualitative classification Constant comparisons (grounded theory) Interaction Analysis Visualization techniques Indentations Tree structures Timeline displays Link diagrams Quasi-realism

11. An example A C A E F D B C D A C A A E F E F D B C D B C D A A C A E F D A B A B C A E F D C A E F D B A C A D B B C D B B C E F D A A C A D A B A C A E F D B C E F E F D B C D B C E F E F D A B A C A E F E F D

12. An example A C A E F D B C D A C A A E F E F D B C D B C D A A C A E F D A B A B C A E F D C A E F D B A C A D B B C D B B C E F D A A C A D A B A C A E F D B C E F E F D B C D B C E F E F D A B A C A E F E F D

13. An example A C A E F D B C D A C A A E F E F D B C D B C D A A C A E F D A B A B C A E F D C A E F D B A C A D B B C D B B C E F D A A C A D A B A C A E F D B C E F E F D B C D B C E F E F D A B A C A E F E F D

14. Timeline

15. Lag Sequential Analysis D B C A E F

16. Theoretical concepts notions of usability, models of cognition, a body of knowledge Methodological concepts conformity to the scientific method appropriate methods of sampling

17. Cognitive Behavioral Social

18. When do we use ESDA Sequencing and temporal organization of activity is important The analyst is confident that he can make use of the logs to get from the design question to the statement Extra time needed in using the technique is worth the effort

19. Thank You!

20. Confirmatory vs Exploratory

21. Frequency