Job Shadow Ethnographic Research Tool Shipra Gupta Sr. Usability Engineer Kern Communications Pvt. Ltd.

Method Job shadowing is an ethnographic research method used in the “requirements gathering” stage of UCD process where the observer follows the participant around his work place, ideally for a week and records their Activities Tools used Interaction with: team, environment… Human Behavior

Job shadowing is an ethnographic research method used in the “requirements gathering” stage of UCD process where the observer follows the participant around his work place, ideally for a week and records their

Activities

Tools used

Interaction with: team, environment…

Human Behavior

Format This is a paper-based template, which the observer carries around following the user. The IA of the template is essentially divided into activities performed and physical environment, which takes care that the observer takes quick and organized notes. The information required to capture is chunked as: Time Activity Observations Special Comments Physical environment Sample

This is a paper-based template, which the observer carries around following the user. The IA of the template is essentially divided into activities performed and physical environment, which takes care that the observer takes quick and organized notes. The information required to capture is chunked as:

Time

Activity

Observations

Special Comments

Physical environment

Sample

Pre-requisites A few things that the observer needs to take care before he conducts Job shadowing: He needs to set clear goals and objectives of the study. Need to be educated of the users work culture Should be aware of the ethnographic technique Have good observational and communication skills A template for capturing the observations Identification of the right set of users Equipments for audio/video recordings

A few things that the observer needs to take care before he conducts Job shadowing:

He needs to set clear goals and objectives of the study.

Need to be educated of the users work culture

Should be aware of the ethnographic technique

Have good observational and communication skills

A template for capturing the observations

Identification of the right set of users

Equipments for audio/video recordings

Tools A template to capture the observations Pen or pencil Paper pad Camera- still pictures Video and Audio recordings

A template to capture the observations

Pen or pencil

Paper pad

Camera- still pictures

Video and Audio recordings

Process (Checklist) Identify the user Seek their availability Brief the user about the process and his role clearly Fix day and time for shadowing Educate yourself about the users work culture Choose the right place for observation Get briefed about the users planned day Seek their permission to shadow them in their meeting and other work locations Make short quick notes on the template Observe Ask user to “Think Aloud” to keep the observer update of his activities. ‘What are you doing now? Can you explain?” Take note of any point that the observer would need to clarify during the follow up interview Schedule the next interview with the user Analyze the samples.

Identify the user

Seek their availability

Brief the user about the process and his role clearly

Fix day and time for shadowing

Educate yourself about the users work culture

Choose the right place for observation

Get briefed about the users planned day

Seek their permission to shadow them in their meeting and other work locations

Make short quick notes on the template

Observe

Ask user to “Think Aloud” to keep the observer update of his activities. ‘What are you doing now? Can you explain?”

Take note of any point that the observer would need to clarify during the follow up interview

Schedule the next interview with the user

Analyze the samples.

Identify the user: Identification of the right set of users is very crucial for the study. The observer needs to have a clear profile of the target users.

Identification of the right set of users is very crucial for the study. The observer needs to have a clear profile of the target users.

Seek their availability: Once the target users are identified, you need to approach them to seek their availability and conformation to be a part of the study. This can be done through Emails Share their work calendar Meet them personally Make a phone call SMS

Once the target users are identified, you need to approach them to seek their availability and conformation to be a part of the study. This can be done through

Emails

Share their work calendar

Meet them personally

Make a phone call

SMS

Brief the user about the process and his role clearly Explain the user the purpose of the study and how this will help you Its important to let them know that you are not shadowing them as individual, but as a potential user of the product to be designed to understand his needs and requirements which will help design better usable products for the user. The user should feel an equal partner in gathering requirements for the product he needs to use. You should let him know that he need not put any extra efforts but carry on his activities as he would in your absence, and that you would like to observe him in his typical work environment.

Explain the user the purpose of the study and how this will help you

Its important to let them know that you are not shadowing them as individual, but as a potential user of the product to be designed to understand his needs and requirements which will help design better usable products for the user.

The user should feel an equal partner in gathering requirements for the product he needs to use.

You should let him know that he need not put any extra efforts but carry on his activities as he would in your absence, and that you would like to observe him in his typical work environment.

Tip The verbal communication is very important at this stage; one needs to be very conscious of the language and words used. For eg: The user will feel better if you say, “ I would like to observe you” Vs “ I would like to shadow you”

The verbal communication is very important at this stage; one needs to be very conscious of the language and words used.

For eg: The user will feel better if you say,

“ I would like to observe you” Vs

“ I would like to shadow you”

Fix day and time for shadowing: Once the user gives his conformation to be a part of the study, you need to fix the time to shadow him. An ideal day / period would be when the user is performing multiple activities, so that you get to observe him in different work situations, locations, moods and behavior.

Once the user gives his conformation to be a part of the study, you need to fix the time to shadow him.

An ideal day / period would be when the user is performing multiple activities, so that you get to observe him in different work situations, locations, moods and behavior.

Educate yourself about the users work culture: Its very important for the observe to have a basic idea about the work culture of the user to be a participant in his activities and understand the tasks he is performing.

Its very important for the observe to have a basic idea about the work culture of the user to be a participant in his activities and understand the tasks he is performing.

Choose the right place for observation: It’s important to visit the location prior to the study and look out for an ideal place to observe from. This could be the neighbors cube/desk if not occupied, any desk along the users cube, else add a chair in the users cube. Its important to be near the user and not too far off. You should be able to keep a track and observe the screen, or the users main working area.

It’s important to visit the location prior to the study and look out for an ideal place to observe from.

This could be the neighbors cube/desk if not occupied, any desk along the users cube, else add a chair in the users cube.

Its important to be near the user and not too far off.

You should be able to keep a track and observe the screen, or the users main working area.

Get briefed about the users planned day Before you start the shadowing ask the user to brief you about his planned day. About the tasks he plans to work on, any meeting that he is to attend… This will help the observer to keep pace with the users activities.

Seek their permission to shadow them in their meeting and other work locations Once the observer is briefed about the users planned day, seek for permission to shadow the user in the meetings and any other location other than his main work area. This could be labs etc.

Once the observer is briefed about the users planned day, seek for permission to shadow the user in the meetings and any other location other than his main work area. This could be labs etc.

Make short quick notes on the template The observer has to be quick at taking notes. Mark comments and spl. observations precisely. Its important not to miss out on any details, things might look and sound irrelevant at the moment, but this can later be of value at the analysis stage. The observer needs to be open minded while taking notes and not have any self imposed restrictions during the shadowing session.

The observer has to be quick at taking notes. Mark comments and spl. observations precisely.

Its important not to miss out on any details, things might look and sound irrelevant at the moment, but this can later be of value at the analysis stage. The observer needs to be open minded while taking notes and not have any self imposed restrictions during the shadowing session.

Take note of any point that the observer would need to clarify during the follow up interview When the observer takes notes, its important to see that they are structured and can make sense later for analysis. Mark any special comments or observations in the template. If the observer has any questions or clarifications mark these and ask the user at break, end of session or the follow up interview.

When the observer takes notes, its important to see that they are structured and can make sense later for analysis.

Mark any special comments or observations in the template. If the observer has any questions or clarifications mark these and ask the user at break, end of session or the follow up interview.

Ask user to “Think Aloud” To keep the observer update of his activities, the users should at intervals prompt of what he is doing. Or the observer can prompt the user at intervals ‘ What are you doing now? Can you explain?”

To keep the observer update of his activities, the users should at intervals prompt of what he is doing. Or the observer can prompt the user at intervals

‘ What are you doing now? Can you explain?”

Observe The observer needs to be very sharp at observing and tracking the details and the happenings around the users work place. A checklist: Artifacts Environment The users interaction with the environment Applications and tools used Their preferred colour scheme Mental models Interfaces Interaction with GUI Human behavior This will include: Their decision-making skills Tolerance Tackling problems Understanding of tasks

The observer needs to be very sharp at observing and tracking the details and the happenings around the users work place.

A checklist:

Artifacts

Environment

The users interaction with the environment

Applications and tools used

Their preferred colour scheme

Mental models

Interfaces

Interaction with GUI

Human behavior

This will include:

Their decision-making skills

Tolerance

Tackling problems

Understanding of tasks

Schedule the next interview with the user After the session schedule the next meeting with the user, for clarifications of any issues that the observer might have.

After the session schedule the next meeting with the user, for clarifications of any issues that the observer might have.

Analyze the samples After the session with the user, the observer should analyze the sample to map to the goals and objectives he had set before launching the study. Look out for emerging patterns and make the requirement list and other unseen needs that is reflected form shadowing.

After the session with the user, the observer should analyze the sample to map to the goals and objectives he had set before launching the study. Look out for emerging patterns and make the requirement list and other unseen needs that is reflected form shadowing.

Advantages The observer gets to study the users behavior. Be a part of the users physical work environment and study its effects on the users behavior Understand his mental models Know the interfaces he is used to interact with Identity the unidentified needs The study is open ended, thus has a broader scope of understanding the users needs The observation made at this stage can come of help at a later stage of design process, for its been open ended and the captured data can be of help to the designer to understand the users behavior and needs at any stage of the design process. The observer gets first hand information about the user, unlike in other methods where it’s at distance and through third parties. This helps in designing appropriate user profiles and scenarios. This leaves very less room for any ambiguity about the user and his needs.

The observer gets to study the users behavior.

Be a part of the users physical work environment and study its effects on the users behavior

Understand his mental models

Know the interfaces he is used to interact with

Identity the unidentified needs

The study is open ended, thus has a broader scope of understanding the users needs

The observation made at this stage can come of help at a later stage of design process, for its been open ended and the captured data can be of help to the designer to understand the users behavior and needs at any stage of the design process.

The observer gets first hand information about the user, unlike in other methods where it’s at distance and through third parties.

This helps in designing appropriate user profiles and scenarios.

This leaves very less room for any ambiguity about the user and his needs.

Disadvantages Users crucial needs are not identified The observer needs to spend long hours with the user to identify his work patter, needs. The current setup has space limitations. It cannot accommodate a observer for long hours Observer needs to be educated about the users work culture, habits. The user and the observer need to match their schedules. They need to share same language. If the user is not highly motivated he might loose on details, which might be crucial for study. The users might not feel comfortable in the observer’s presence, and thus not behave in a normal fashion, in the given setup. The users might not be open to share information with the observer, for he might feel intruded.

Users crucial needs are not identified

The observer needs to spend long hours with the user to identify his work patter, needs.

The current setup has space limitations. It cannot accommodate a observer for long hours

Observer needs to be educated about the users work culture, habits.

The user and the observer need to match their schedules.

They need to share same language.

If the user is not highly motivated he might loose on details, which might be crucial for study.

The users might not feel comfortable in the observer’s presence, and thus not behave in a normal fashion, in the given setup.

The users might not be open to share information with the observer, for he might feel intruded.

Things to remember It is your responsibility to make the user feel comfortable in your presence. He should not feel invaded. You should not interfere in-between his work. If you have any doubts or need to clarify anything, make a note and clarify this at the end of the session An early visit to the location will help you get a feel of the place and decided you placement for the study. More of Visual documentation will help not loose on details. Ideally the user should be video recorded. Audio, video and stills are good for later reference, and the study will be less dependent on the observer’s skills.

It is your responsibility to make the user feel comfortable in your presence. He should not feel invaded.

You should not interfere in-between his work.

If you have any doubts or need to clarify anything, make a note and clarify this at the end of the session

An early visit to the location will help you get a feel of the place and decided you placement for the study.

More of Visual documentation will help not loose on details.

Ideally the user should be video recorded.

Audio, video and stills are good for later reference, and the study will be less dependent on the observer’s skills.

Deliverables User information User needs Scenarios New Product Ideas

User information

User needs

Scenarios

New Product Ideas