This document outlines the key stages and considerations for conducting new media research, including relating methods to the research question, data collection, analysis, and presentation. It discusses qualitative and quantitative approaches and tools for gathering data like observations, questionnaires, interviews, and focus groups. The stages of a user experience research process are defined, including understanding users, conceptual design, prototyping, testing functionality and design, and evaluating emotional design and usability. Methods for each stage like walkthroughs, scenarios, card sorts, think aloud protocols, and heuristics are also described.
Using Qualitative Methods for Library Evaluation: An Interactive WorkshopLynn Connaway
Connaway, Lynn Silipigni, and Marie L. Radford. 2016. "Using Qualitative Methods for Library Evaluation: An Interactive Workshop." Presented at the Libraries in the Digital Age (LIDA) Conference, Zadar, Croatia, June 14.
This is the third lecture about contextmapping given for the experience design master class at HITLab, Canterbury University in New Zealand. Contextmapping is an important exercise in the early design phase when the designer needs to confront his / her assumptions with the real world the users live in. It is a great preparation for user research.
User Research: trying to answer the why and how questionsAgnieszka Szóstek
This is the first part of my fourth lecture at the HITLab, Canterbury University in New Zealand. As a design practitioner I am frequently getting a question from other practitioners, why would they do user research in the first place. Once I manage to convince them why it makes sense, the follow up question typically regards the issue of choosing the right people for that research. In this presentation I am trying to highlight two different approaches to user research, which I will describe in more detail in the next presentation.
Using Qualitative Methods for Library Evaluation: An Interactive WorkshopLynn Connaway
Connaway, Lynn Silipigni, and Marie L. Radford. 2016. "Using Qualitative Methods for Library Evaluation: An Interactive Workshop." Presented at the Libraries in the Digital Age (LIDA) Conference, Zadar, Croatia, June 14.
This is the third lecture about contextmapping given for the experience design master class at HITLab, Canterbury University in New Zealand. Contextmapping is an important exercise in the early design phase when the designer needs to confront his / her assumptions with the real world the users live in. It is a great preparation for user research.
User Research: trying to answer the why and how questionsAgnieszka Szóstek
This is the first part of my fourth lecture at the HITLab, Canterbury University in New Zealand. As a design practitioner I am frequently getting a question from other practitioners, why would they do user research in the first place. Once I manage to convince them why it makes sense, the follow up question typically regards the issue of choosing the right people for that research. In this presentation I am trying to highlight two different approaches to user research, which I will describe in more detail in the next presentation.
How to design surveys; describes differences between approaches to measuring awareness, opinions, perceptions, behaviors, needs and attitudes; describes roles of survey sponsor and researcher.
Providing a compelling user experience is pivotal to developing a successful product. As a product manager, you are often tasked with difficult decisions that require a deep understanding of customer needs and how to deliver the best experience possible. User research is an effective way to both generate insights and validate direction.
In this workshop you will learn:
* The skills to effectively integrate user research into the product development process with a strong return on investment.
* How foundational user research can help product teams understand user goals, generate insights, and narrow focus.
* How to use research to evaluate and iterate on product concepts.
* How to validate design and product decisions to ready your product for launch.
How to design surveys; describes differences between approaches to measuring awareness, opinions, perceptions, behaviors, needs and attitudes; describes roles of survey sponsor and researcher.
Providing a compelling user experience is pivotal to developing a successful product. As a product manager, you are often tasked with difficult decisions that require a deep understanding of customer needs and how to deliver the best experience possible. User research is an effective way to both generate insights and validate direction.
In this workshop you will learn:
* The skills to effectively integrate user research into the product development process with a strong return on investment.
* How foundational user research can help product teams understand user goals, generate insights, and narrow focus.
* How to use research to evaluate and iterate on product concepts.
* How to validate design and product decisions to ready your product for launch.
This presentation was provided by Serena Rosenhan of ProQuest, during Session Four of the NISO event "Agile Product and Project Management for Information Products and Services," held on June 4, 2020.
User Experience Design Fundamentals - Part 2: Talking with UsersLaura B
#2 in a 3-part series on UX Fundamentals: Talking with Users
Understand why you should talk to users to uncover, validate and/or understand their goals.
Learn how and when to talk with your users:
User research methods
Planning
Best practices for interviews
Getting Started With User Research, Presented at Agile2010Carol Smith
The gap between a good product and a great one can be bridged by understanding your users.
This presentation shared how better systems are built by taking small, iterative steps to understand the users desires, needs and abilities.
Attendees will learn how to get information about users quickly and cheaply. For those that have more time (and perhaps a small budget) Carol introduced methods to use to get more detailed information from your users. Carol also introduced ways to effectively share and communicate this information.
2 hours training on Mobile UX with Farah Nuraini, Interaction Designer at Traveloka, Indonesia
45 min theory: Research, Analysis, Design solutions and Testing
+ 1h15 min of hands-on exercises with the 5 facilitators from Traveloka.
UX Research & PP projects @UXScotland 2014Abi Reynolds
I gave this presentation at UX Scotland 2014. I talked about UX Research in the product development process and discussed different methods and methodologies that can be used to generate user insights at different stages of the design process. The session focused on my experience as UX Research Manager in Paddy Power.
Using Qualitative Methods for Library Evaluation: An Interactive WorkshopOCLC
Connaway, Lynn Silipigni, and Marie L. Radford. 2016. "Using Qualitative Methods for Library Evaluation: An Interactive Workshop." Presented at the Libraries in the Digital Age (LIDA) Conference, Zadar, Croatia, June 14.
UXPA 2023: UX Fracking: Using Mixed Methods to Extract Hidden InsightsUXPA International
Users do not always accurately describe what they mean or feel. There are many reasons for this, ranging from politeness to poor introspection, to lack of sufficient technical vocabulary. Fortunately, UX researchers have tools in their trade to deduce what was really meant. We call this UX Fracking, a mixed methods approach that is optimized for extracting hidden user insights. We will illustrate the dangers of inadequate, superficial research, and how this may lead to outcomes incapable of addressing the users’ core issues. We will explore ways to avoid these pitfalls by leveraging mixed research methods to test hypotheses about the users’ intent and needs. This starts with a thorough understanding of who the user is, their goals, and how they work today, to an approach that combines surveys, interviews, and comment analysis with behavioral observation, and finally, validating the newly discovered user insights with the users themselves.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Session1 methods research_question
1. New Media Research Methods
Part 1 – How research
methods relate to the
research question
Part 2- Qualitative and
Quantitative
Part 3 – Data collection
Part 4 – Presentation and
analysis
2. New Media Research Methods- Part 1
Using Methods, Data and Tools to explore User’s Experience.
How methods relate to research questions?
Gosia Kwiatkowska gosia@uel.ac.uk
5. What is your research question?
General - Is it clear and specific?
Focused - Is it feasible in the time allowed?
Refined - Clear, specific, feasible and
relevant for the target audience
6. Good question
“Well-crafted questions guide the
systematic planning of research.
Formulating your questions precisely
enables you to design a study with a
good chance of answering them.”
Light, Singer, Willett (1990)
7. Research terminology
• Method – the
process of gathering
and analysing data
about a user
experience.
! It is also how you
approach the
relation between IV
and DV.
8. Research terminology
• Data – refers to
factual or sensory
information taken
from your tests,
observations,
surveysetc.
10. Think about the stages of your
method!
• Logic
• Choice of tools
• How the data
captured feeds into
the next phase of
testing?
11. Convenience + Design – Cost = User Experience
http://www.nnyman.com/personal/2005/11/18/the-user-experience-equation/
12. Analysis
Design
Implementation
New Media Research process
13. Beginning the process of UX research
• Brainstorming ideas
• Who are the users? And what are
their needs?
Analysis
– Tools:
• Observations
• Questionnaires
• Interviews
• Focus groups
• Ethnography
• Personas
14. Observations
• Interactions
• Human dynamics
• Patterns
• Full picture
• but can be subjective
15. Questionnaires
• Cheap and quick
• Easy
• Q’s and A’s
standardised
• Mainly quantitative
• Cross-sectional
• Replicable
19. Personas
• Made up
• User
friendly
• Used for
testing
http://www.webcredible.co.uk/user-friendly-resources/web-usability/personas.shtml
20. UX research – what are you looking
for?
• What data?
• How are you going to capture it?
• How will this data inform the next
Analysis
phase?
21. User’s mental model vs your initial
design?
• Conceptual design model:
– Walkthroughs
– Scenarios
– Card sorts
Design
– Prototypes
Set up a design phase to include early
paper prototypes to confirm what
you have designed corresponds
with the user’s mental model.
25. UX research – what are you looking
for?
• What data?
• How are you going to capture it?
• How will this data inform the next
Design
phase?
26. UX research – functionality and
aesthetics
• From paper prototype to beta
versions- testing basic
Implementation
functionality and design
aesthetic.
• What aspects to you need/want
to understand more about?
27. UX research – emotional design
• Tasks
•
Implementation
Levels of frustration/satisfaction
• Errors
• Specific responses to your
aesthetics
28. UX research – what tools?
• Observations
•
Implementation
Think aloud
• Post test questionnaire
• Heuristic testing
• Task based tests
30. Think aloud
• Tasks
• Levels of
frustration/satisfaction
• Errors
• Specific responses to
your aesthetics
31. Post test questionnaires
• Tasks
• Levels of
frustration/satisfaction
• Errors
• Specific responses to
your aesthetics
32. Heuristics – Nielson’s
‘Rules of Thumb’
1. Visibility of system status
2. Match between system and the real world
3. User control and freedom
4. Consistency and standards
5. Error prevention
6. Recognition rather than recall
7. Flexibility and efficiency of use
8. Aesthetic and minimalist design
9. Help users recognise, diagnose, and recover from
errors
10. Help and documentation
34. UX research – what are you looking
for?
• What data?
• How are you going to capture it?
Implementation
• How will this data inform the next
phase?
35. Analysis
Design
Implementation
Research process
36. Research Question?
“Well-crafted questions
guide the systematic
planning of research.
Formulating your
questions precisely
enables you to design a
study with a good
chance of answering
them.”
Light, Singer, Willett (1990)
37. Activity
• Refine your research question:
– Is your question clear and relevant to your goal?
– What is your target audience?
– What is your independent variable?
– What is your dependent variable?
– What kind of research methods you might need to
use?
– What can impact or influence your findings?
– What you will need to use to collect data?
– Will your research influence users? How?
38. References
• Light, Singer, Willett, By Design (1990)
• http://www.nnyman.com/personal/2005/11/
18/the-user-experience-equation/
• Kozinets, Robert V. (2010), “Netnography: The
Marketer’s Secret Weapon”; White Paper.
Editor's Notes
Is it clear, specific, and feasible for you to answer adequately in the time available?Is it linked to your project goal?What is the target audience? – is your question relevant for the audience?What are you hoping to achieve?How are you going to study this? How best to collect this data? How many people will you need to involve?What can influence your outcomes?
Netnography is the branch of ethnography that analyses the free behaviour of individuals on the Internet that uses online marketing research techniques to provide useful insights. The word “netnography” comes from “Inter[net]” and “eth[nography]” and was a process and term coined by Dr. Robert V. Kozinets. As a method, “netnography” can be faster, simpler, and less expensive than ethnography, and more naturalistic and unobtrusive than focus groups or interviews (Kozinets, 2010), (del Fresno, 2011). Netnography is similar to ethnography in five ways: 1. It is naturalistic 2. It is immersive 3. It is descriptive 4. It is multi-method 5. It is adaptable. It provides information on the symbolism, meanings, and consumption patterns of online consumer groups (Kozinets, 2010) or online communities consumption unrelated but online sociability based on the exchange of information (del Fresno, 2011). Netnography is focused on cultural, symbolic o information insights.
In general, a walkthrough has one or two broad objectives: to gain feedback about the technical quality or content of the document; and/or to familiarize the audience with the content.A walkthrough is normally organized and directed by the author of the technical document. Any combination of interested or technically qualified personnel (from within or outside the project) may be included as seems appropriate.Typically four questions are asked::Will the user try to achieve the effect that the subtask has? Does the user understand that this subtask is needed to reach the user's goal?Will the user notice that the correct action is available? E.g. is the button visible?Will the user understand that the wanted subtask can be achieved by the action? E.g. the right button is visible but the user does not understand the text and will therefore not click on it.Does the user get feedback? Will the user know that they have done the right thing after performing the action?By answering the questions for each subtask usability problems will be noticed
Task analysis is the analysis of how a task is accomplished, including a detailed description of both manual and mental activities, task and element durations, task frequency, task allocation, task complexity, environmental conditions, necessary clothing and equipment, and any other unique factors involved in or required for one or more people to perform a given task.[1] Task analysis emerged from research in applied behavior analysis and still has considerable research in that area.Information from a task analysis can then be used for many purposes, such as personnel selection and training, tool or equipment design,[2] procedure design (e.g., design of checklists or decision support systems) and automation. Though very distinct, task analysis is related to user analysis.