ICRM conference - Workshop on Visual Analysis with Christina Silver.pdf

International Creative Methods Conference 2023 12/09/2023
Christina Silver , PhD
Associate Professor (Teaching), University of Surrey
CAQDAS Networking Project
c.silver@surrey.ac.uk
Choosing, using and refining digital tools for
visual analysis in creative research projects:
what’s available in CAQDAS-packages and what else do
creative researchers need?
Workshop at the International Creative Methods Festival
12th September, 11am – 1pm
Christina Silver, PhD, SFHEA, FAcSS
Director, CAQDAS Networking Project (CNP)
Founder, Qualitative Data Analysis Services (QDAS)
https://linktr.ee/Christina_QDAS
Choosing, using and refining digital tools for
visual analysis in creative research projects:
what’s available in CAQDAS-packages and what else do
creative researchers need?
Christina Silver
1
2

Context and purpose (being a bit rebellious)
• Little has changed in the CAQDAS-field regarding tools for visual analysis for
many years (with a few notable exceptions)
• This workshop is an opportunity to try and change this
https://www.qdaservices.co.uk/post/pull-up-your-socks-caqdas-developers
Digital Tools for Creative Data
Analysis: Opportunities, Challenges,
and Future Directions
Christina Silver, Sarah L Bulloch and Michelle Salmona
https://www.bloomsbury.com/uk/bloomsbury-handbook-of-creative-research-methods-9781350355743/
3
4

Topics
• Handling visual materials
• Visual analysis techniques
• Tools facilitating creative reflexivity
• Representing and communicating visual analysis
• Tools: . Illustrations from several CAQDAS-packages, including
ATLAS.ti, MAXQDA, QDA Miner, NVivo, Quirkos and Transana
• This isn’t a comparison or exhaustive description of tools
• Discussion: about what tools we need – to feedback to developers
CAQDAS tools
•Computer Assisted Qualitative Data AnalysiS
•Not the only tools – appropriateness and combining
•Benefits of CAQDAS – access and interconnectivity
5
6

• What visual materials are being worked with?
• What’s the role of them in the project?
• How have they been generated, when and by whom?
• What are you trying to understand from visual materials?
• What analytic method is being employed/constructed to
understand them?
• What output requirements are there?
Can’t talk tools without talking methods
Handling visual materials
7
8

Types of visual materials & types of tools
• any form of still and/or moving images
• photos, drawings, art, maps, films, videos, screencasts…etc…
• generated in any kind of way/ by anyone
• participant/ researcher-generated/ co-produced/ archival/ online…etc…
Digital tools for analysis: two distinctions
Tools for analysing visual materials
• “direct” analysis
• marking, annotating/ coding/ organising the materials themselves
• “indirect” analysis
• generating representations of them to work with…e.g. synchronised
and dynamic transcripts or summaries
•Visual tools for analysis
• Beyond conventional ‘direct’ analysis
9
10

The direct/ indirect distinction
How does that look when working
with visual materials?
11
12

Limitations of lack of interconnectivity
Konecki 2011:143-144
Interconnectivity between the visual and the textual
in CAQDAS packages (examples in NVivo)
Still images
Moving images
13
14

The power of interconnectivity: synchronizing
transcripts of moving images (examples in ATLAS.ti & Dedoose)
The power of interconnectivity: synchronizing
transcripts of moving images (examples in MAXQDA & Transana)
15
16

Higer-fidelity interconnectivity: multiple synchronised
videos and transcripts in Transana
The way visual material is presented for analysis matters
‘Photographing Everyday Life: Ageing, Lived Experiences, Time and Space’,
funded by the ESRC (RES-061-25-0459).
https://actproject.ca/act/photographing-everyday-life/
17
18

What about when working with
materials of different types?
Integrating
multiple
sources
relating to
one unit
19
20

Methods questions
1a. What are the benefits/challenges of
working indirectly, directly and/or
concurrently with visual materials?
1b. What implications might these
choices have on your analysis?
1c. If you’re working with moving
images – what format/display would suit
your analytic needs?
Tools questions
1d. How do you need to handle,
integrate and present visual materials
for analytic purposes?
1e. What tools do you use to handle
visual materials right now?
1f. What challenges do you experience
handling visual materials?
1g. What tools would you like to see
developed for handling visual materials
Discussion: thinking about the visual materials you work with
Visual analysis techniques
21
22

Beyond conventional “coding”
Incorporating analysis done outside of CAQDAS
23
24

Different formats in Word (sequential vs tabular)
25
26

Imports nicely in sequential format (high fidelity)
Images lost in tabular format (low fidelity)
27
28

PDF tabular formal = no coding / comments
transferred in tabular format (low fidelity)
Into ATLAS.ti – visual annotation misaligned and only
comments imported (not highlights) (low fidelity)
29
30

2a. When working with still images – what format/display would suit
your analytic needs?
2b. How would the orientation of displaying still images alongside
reflections about them affect the analysis?
2c. Who and how might be involved in the analysis by marking/
reflecting on data outside of an analysis tool?
Visualising
codes
the spatial
canvas in
Quirkos
a form of
direct
working
31
32

visual
annotation
From Silver & Patashnick, 2011:56
a form of
direct
working
Low fidelity visual
annotation
examples
(via coding)
34
35

Higher fidelity visual annotation example
(via coding)
Even higher
fidelity
visual
annotation
example
36
37

What about visual annotation on moving
images…???
MiMeG
Emoji-coding
38
39

Visualising emoji-coding of images
Combining emojis for
more nuanced coding
40
41

https://www.quirkos.com/blog/post/using-emoji-for-qualitative-data-analysis/
Beyond conventional coding: Emoji-coding
42
43

Methods questions
3a. How might visual annotation or
emoji-coding differ to other ways of
capturing meaning?
3b. Might you need different tools for
different types of analysis, or at
different stages of an analysis?
3c. Can you foresee any challenges
with working with visual materials in
these ways?
Tools questions
3d. Have you used other (non-CAQDAS)
tools for visual annotation of still or
moving images? Which ones? How has
working in these ways been useful or
challenging?
3e. How would you ideally like visual
annotations to be visualizable?
3f. To what extent would the availability
of finer tools for visual annotation
affect your likelihood of using tools?
Are you interested in learning more about emoji-coding? Seek out Anuja and
Daniel for a chat and watch their workshop recording!
Hyperlinking: visualizing and navigating
associations that are not code-based
44
45

• What do we mean by hyperlinking?
Beyond conventional coding: hyperlinking
Some provide
pairs of links
between data
segments
Useful but low
fidelity
youtube.com/@ChristinaSilverPhD
High-fidelity hyperlinks between
data segments
46
47

High-fidelity hyperlinks between data segments
Creative reflexivity
48
49

Conceptual diagram : where notes can be linked
Transcription as an
analytic act – and the
capturing of analytic
thoughts visually
50
51

Integrating and visualising analytic notes with ‘data’
Methods questions
4a. What aspects of the visual would
hyperlinking allow the capturing of
in your materials?
4b. To what extent would this aid
your analysis, if at all?
4c. Do you consider your own
reflections as “data”? Why? How
does this affect the way you go
about analysis?
Tools questions
4d. How important would it be to
your analysis to be able to label the
relations you create between data
segments?
4e. How important would it be to
your analysis to be able to create
trials of hyperlinks?
4f. How important is it that the same
tools are available for analysing your
own reflections as other materials in
your project?
52
53

Representing and communicating visual analysis
The missing link?
CAQDAS falls
down in this
respect for
visual
materials
Playback of coded
or uncoded video
clips directly within
networks
High fidelity for still
and moving images
within, less so
outside
(screenshot only
basically)
Mapping flexibility for analysis and communication within tools
54
55

Presenting within the tool
:Presentation mode
• All windows
• Media only
• Media and transcript only
• Audio and transcript only
High fidelity
for still and
moving images
Exporting / presenting: outside of the tool
Low fidelity
for
still and
moving
images
56
57

Within vs outside
Formats outside the tool
Medium
fidelity for
still images
58
59

For video data – coded clips can often be exported
But the analysis done on them is lost
Methods questions
5a. Do you think about how you
might represent findings from
visual research when planning an
analysis?
5b. What audiences do you need
to communicate to? How does
the audience influence the nature
of the outputs you need?
Tools questions
5c. How have you/do you present the
findings of visual research?
5d.Are there any ways you’d like to be
able to present findings that you have
found difficult to accomplish?
5e. What tools could be provided that
would aid the communication of
findings?
60
61

Handling visual
materials Analytic
techniques
(Re)presentation
Linking
Transcribing
Coding
Zooming
File formats
Frame control
Mapping
Memo-ing
Annotating
Outputting
Charting
Grouping
CAQDAS tools for visual analysis
Synchronising
From Silver & Patashnick, 2011
Thank you
For the slides and to connect with me
To add more detail to your feedback to developers…
https://tinyurl.com/ICRMC23visual
62
63

• Cabraal A (2022) Using emoji for qualitative data analysis. Quirkps Blog post
https://www.quirkos.com/blog/post/using-emoji-for-qualitative-data-analysis/
• Silver, C & Patashnick, J (2011). Finding Fidelity: Advancing Audiovisual Analysis Using
Software [88 paragraphs]. Forum Qualitative Sozialforschung / Forum: Qualitative Social
Research, 12(1), Art. 37, http://nbn-resolving.de/urn:nbn:de:0114-fqs1101372.
• Pilcher, K., Martin, W. and Williams, V. (2015) 'Issues of collaboration,
representation, meaning and emotions: Utilising participant-led visual diaries
to capture the everyday lives of people in mid to later life'. International Journal
of Social Research Methodology, 19 (6). pp. 677 - 692.
• Analysing audio-visual data using CAQDAS-packages, CAQDAS Networking Project archive
https://www.surrey.ac.uk/computer-assisted-qualitative-data-analysis/archive/analysing-
audiovisual-data
References
64

ICRM conference - Workshop on Visual Analysis with Christina Silver.pdf

Recommended

Recommended

More Related Content

Similar to ICRM conference - Workshop on Visual Analysis with Christina Silver.pdf

Similar to ICRM conference - Workshop on Visual Analysis with Christina Silver.pdf (20)

Recently uploaded

Recently uploaded (20)

ICRM conference - Workshop on Visual Analysis with Christina Silver.pdf