SlideShare a Scribd company logo
Needs Assessment  Methods and Tools Brett Christensen Kayleen Grage Mike Hajba Barb Spice
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Dilbert on Data Collection
Background ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Background ,[object Object],[object Object]
Data Collection Methods
Archival Method ,[object Object],[object Object],[object Object],[object Object]
Using Archival Data ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Archival Data Pros & Cons ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Dogbert on Data Mining
Dogbert on Qualitative Data
Interview Method ,[object Object],[object Object],[object Object],[object Object]
Using Interviews ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Interview Pros and Cons ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Dogbert on Interviews
Cause Analysis Worksheet ,[object Object],[object Object],[object Object],[object Object],WHAT IT IS HOW TO USE IT BENEFITS
Cause Analysis Worksheet ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],HOW TO USE IT BENEFITS
Cause Analysis Worksheet Example BEM Factor Force Field Weighting BEM  Sub Factors
Cause Analysis Worksheet Adaptation for Project BEM  Factor BEM Sub Factors FACTORS DRIVING FORCES RESTRAINING FORCES INFORMATION Clear Expectations 1a.  Expectations for the project status reporting process are clear. Relevant Feedback 1b. Feedback given to me on my project status reports is timely. 1c. I receive feedback on my project status reports for  good   performance. 1d. I receive feedback on my project status reports for  not so good   performance. 1e. Feedback I have received on my performance on my project  status reports is relevant. Relevant guides/job aids 1f. The handout (containing job aids, templates, and examples) for  project status reporting is useful. Performance coaching 1g. I receive coaching regarding the quality of my performance on  project status reports. Purpose/use of the reports 1h. I understand how my project status reports will be used by others.
Cause Analysis Worksheet ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],BENEFITS
Cause Analysis Worksheet ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Dogbert on Cause Analysis
Surveys ,[object Object],[object Object],[object Object],[object Object]
Using Surveys ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Surveys: Pros & Cons ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Dogbert on Surveys
Lessons Learned Key Points Things to Consider Planning ,[object Object],[object Object],[object Object],[object Object],Instrument Design ,[object Object],[object Object],[object Object]
Lessons Learned Key Points Things to Consider Interviews ,[object Object],[object Object],[object Object],Surveys ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Questions
How Did We Do? ,[object Object]
References ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

More Related Content

What's hot

Reducing Response Burden
Reducing Response BurdenReducing Response Burden
Reducing Response Burden
Syracuse University
 
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...Institute of Development Studies
 
Consumer Oriented Evaluation Ppt
Consumer Oriented Evaluation PptConsumer Oriented Evaluation Ppt
Consumer Oriented Evaluation Ppt
Speedballjr
 
Developing a Workplace Health and Safety Action Plan with NVivo
Developing a Workplace Health and Safety Action Plan with NVivoDeveloping a Workplace Health and Safety Action Plan with NVivo
Developing a Workplace Health and Safety Action Plan with NVivo
QSR International
 
Research overview
Research overviewResearch overview
Research overview
Rosemary McGuinness
 
Challenges and opportunities in research evaluation: toward a better evaluati...
Challenges and opportunities in research evaluation: toward a better evaluati...Challenges and opportunities in research evaluation: toward a better evaluati...
Challenges and opportunities in research evaluation: toward a better evaluati...
ORCID, Inc
 
Needs assessments in program development
Needs assessments in program developmentNeeds assessments in program development
Needs assessments in program developmentkrobinson-ucn
 
Alternative Views Of Evaluation
Alternative Views Of EvaluationAlternative Views Of Evaluation
Alternative Views Of Evaluationmandy fontenot
 
Conducting Integrated Mixed Methods Research and Analysis Using NVivo
Conducting Integrated Mixed Methods Research and Analysis Using NVivoConducting Integrated Mixed Methods Research and Analysis Using NVivo
Conducting Integrated Mixed Methods Research and Analysis Using NVivo
QSR International
 
Implementation Plan
Implementation PlanImplementation Plan
Implementation Plan
certus1
 
Moderation and Mediation | Dissertation Webinar
Moderation and Mediation | Dissertation WebinarModeration and Mediation | Dissertation Webinar
Moderation and Mediation | Dissertation Webinar
Statistics Solutions
 
Selecting an Ideal Survey Instrument for a Quantitative Study
Selecting an Ideal Survey Instrument for a Quantitative StudySelecting an Ideal Survey Instrument for a Quantitative Study
Selecting an Ideal Survey Instrument for a Quantitative Study
Statistics Solutions
 
Meta Evaluation and Evaluation Dissemination(Manual 3)
Meta Evaluation and Evaluation Dissemination(Manual 3)Meta Evaluation and Evaluation Dissemination(Manual 3)
Meta Evaluation and Evaluation Dissemination(Manual 3)Dawit Wolde
 
EDLD808 Program Evaluation Final Project - Online Education
EDLD808 Program Evaluation Final Project - Online EducationEDLD808 Program Evaluation Final Project - Online Education
EDLD808 Program Evaluation Final Project - Online Education
Paul Gruhn
 
Meta Evaluation
Meta EvaluationMeta Evaluation
Meta Evaluation
Mohsen Sharifirad
 
Outline model Impact Evaluation toolkit
Outline model Impact Evaluation toolkitOutline model Impact Evaluation toolkit
Outline model Impact Evaluation toolkit
NIDA-Net
 
Managing assessment and reducing workloads
Managing assessment and reducing workloadsManaging assessment and reducing workloads
Managing assessment and reducing workloads
jjacoby
 
六合彩-香港六合彩
六合彩-香港六合彩六合彩-香港六合彩
六合彩-香港六合彩
hphrryl
 
Impact evaluation methods: Qualitative Methods
Impact evaluation methods: Qualitative MethodsImpact evaluation methods: Qualitative Methods
Introduction To Evaluation
Introduction To EvaluationIntroduction To Evaluation
Introduction To Evaluation
FacetoFace
 

What's hot (20)

Reducing Response Burden
Reducing Response BurdenReducing Response Burden
Reducing Response Burden
 
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
 
Consumer Oriented Evaluation Ppt
Consumer Oriented Evaluation PptConsumer Oriented Evaluation Ppt
Consumer Oriented Evaluation Ppt
 
Developing a Workplace Health and Safety Action Plan with NVivo
Developing a Workplace Health and Safety Action Plan with NVivoDeveloping a Workplace Health and Safety Action Plan with NVivo
Developing a Workplace Health and Safety Action Plan with NVivo
 
Research overview
Research overviewResearch overview
Research overview
 
Challenges and opportunities in research evaluation: toward a better evaluati...
Challenges and opportunities in research evaluation: toward a better evaluati...Challenges and opportunities in research evaluation: toward a better evaluati...
Challenges and opportunities in research evaluation: toward a better evaluati...
 
Needs assessments in program development
Needs assessments in program developmentNeeds assessments in program development
Needs assessments in program development
 
Alternative Views Of Evaluation
Alternative Views Of EvaluationAlternative Views Of Evaluation
Alternative Views Of Evaluation
 
Conducting Integrated Mixed Methods Research and Analysis Using NVivo
Conducting Integrated Mixed Methods Research and Analysis Using NVivoConducting Integrated Mixed Methods Research and Analysis Using NVivo
Conducting Integrated Mixed Methods Research and Analysis Using NVivo
 
Implementation Plan
Implementation PlanImplementation Plan
Implementation Plan
 
Moderation and Mediation | Dissertation Webinar
Moderation and Mediation | Dissertation WebinarModeration and Mediation | Dissertation Webinar
Moderation and Mediation | Dissertation Webinar
 
Selecting an Ideal Survey Instrument for a Quantitative Study
Selecting an Ideal Survey Instrument for a Quantitative StudySelecting an Ideal Survey Instrument for a Quantitative Study
Selecting an Ideal Survey Instrument for a Quantitative Study
 
Meta Evaluation and Evaluation Dissemination(Manual 3)
Meta Evaluation and Evaluation Dissemination(Manual 3)Meta Evaluation and Evaluation Dissemination(Manual 3)
Meta Evaluation and Evaluation Dissemination(Manual 3)
 
EDLD808 Program Evaluation Final Project - Online Education
EDLD808 Program Evaluation Final Project - Online EducationEDLD808 Program Evaluation Final Project - Online Education
EDLD808 Program Evaluation Final Project - Online Education
 
Meta Evaluation
Meta EvaluationMeta Evaluation
Meta Evaluation
 
Outline model Impact Evaluation toolkit
Outline model Impact Evaluation toolkitOutline model Impact Evaluation toolkit
Outline model Impact Evaluation toolkit
 
Managing assessment and reducing workloads
Managing assessment and reducing workloadsManaging assessment and reducing workloads
Managing assessment and reducing workloads
 
六合彩-香港六合彩
六合彩-香港六合彩六合彩-香港六合彩
六合彩-香港六合彩
 
Impact evaluation methods: Qualitative Methods
Impact evaluation methods: Qualitative MethodsImpact evaluation methods: Qualitative Methods
Impact evaluation methods: Qualitative Methods
 
Introduction To Evaluation
Introduction To EvaluationIntroduction To Evaluation
Introduction To Evaluation
 

Viewers also liked

Break Out of the Training Box with the Six Boxes® Approach
Break Out of the Training Box with the Six Boxes® ApproachBreak Out of the Training Box with the Six Boxes® Approach
Break Out of the Training Box with the Six Boxes® Approach
carlbinder
 
The Gilbert Human Performance Management Matrix
The Gilbert Human Performance Management MatrixThe Gilbert Human Performance Management Matrix
The Gilbert Human Performance Management Matrix
SUSTAIN America PAC
 
Gilbert and Harless: So Happy Together
Gilbert and Harless: So Happy Together Gilbert and Harless: So Happy Together
Gilbert and Harless: So Happy Together
Eboni DuBose
 
Cgs channel enablement services nn bm
Cgs channel enablement services  nn bmCgs channel enablement services  nn bm
Cgs channel enablement services nn bm
Bill McCready
 
Ship building-ind
Ship building-indShip building-ind
Ship building-ind
shakib362
 
9 box model with titles
9 box model with titles9 box model with titles
9 box model with titles
Rye Cruz
 
9 box matrix
9 box matrix9 box matrix
9 box matrixshakib362
 

Viewers also liked (7)

Break Out of the Training Box with the Six Boxes® Approach
Break Out of the Training Box with the Six Boxes® ApproachBreak Out of the Training Box with the Six Boxes® Approach
Break Out of the Training Box with the Six Boxes® Approach
 
The Gilbert Human Performance Management Matrix
The Gilbert Human Performance Management MatrixThe Gilbert Human Performance Management Matrix
The Gilbert Human Performance Management Matrix
 
Gilbert and Harless: So Happy Together
Gilbert and Harless: So Happy Together Gilbert and Harless: So Happy Together
Gilbert and Harless: So Happy Together
 
Cgs channel enablement services nn bm
Cgs channel enablement services  nn bmCgs channel enablement services  nn bm
Cgs channel enablement services nn bm
 
Ship building-ind
Ship building-indShip building-ind
Ship building-ind
 
9 box model with titles
9 box model with titles9 box model with titles
9 box model with titles
 
9 box matrix
9 box matrix9 box matrix
9 box matrix
 

Similar to Needs Assessment Webinar to AFC of ISPI

User Research Techniques by Vikram Rao, RSA
User Research Techniques by Vikram Rao, RSAUser Research Techniques by Vikram Rao, RSA
User Research Techniques by Vikram Rao, RSA
STC India UX SIG
 
Section b
Section bSection b
Section bPCTE
 
Usability Testing Basics: What's it All About? at Web SIG Cleveland
Usability Testing Basics: What's it All About? at Web SIG ClevelandUsability Testing Basics: What's it All About? at Web SIG Cleveland
Usability Testing Basics: What's it All About? at Web SIG Cleveland
Carol Smith
 
Text, Tags and Thumbnails: Latest Trends in Bioscience Literature Search
Text, Tags and Thumbnails:Latest Trends in Bioscience Literature SearchText, Tags and Thumbnails:Latest Trends in Bioscience Literature Search
Text, Tags and Thumbnails: Latest Trends in Bioscience Literature Searchmarti_hearst
 
TYPES OF DATA COLLECTION
TYPES  OF DATA COLLECTIONTYPES  OF DATA COLLECTION
TYPES OF DATA COLLECTION
mehwishmanzoor4
 
Research and advocacy by Seetal Daas
Research and advocacy by Seetal DaasResearch and advocacy by Seetal Daas
Research and advocacy by Seetal DaasSeetal Daas
 
Techniques
TechniquesTechniques
Techniques
CARLOS JR. RABAGO
 
SCIENTIFIC MERIT ACTION RESEARCH TEMPLATE (SMART) FORMa..docx
SCIENTIFIC MERIT ACTION RESEARCH TEMPLATE (SMART) FORMa..docxSCIENTIFIC MERIT ACTION RESEARCH TEMPLATE (SMART) FORMa..docx
SCIENTIFIC MERIT ACTION RESEARCH TEMPLATE (SMART) FORMa..docx
kenjordan97598
 
SMART Learner FormPSL Scientific Merit Action Research Te.docx
SMART Learner FormPSL Scientific Merit Action Research Te.docxSMART Learner FormPSL Scientific Merit Action Research Te.docx
SMART Learner FormPSL Scientific Merit Action Research Te.docx
rosemariebrayshaw
 
CIB 3103: Requirements Capture
CIB 3103: Requirements CaptureCIB 3103: Requirements Capture
CIB 3103: Requirements CaptureAhmad Ammari
 
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan Berlin
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan BerlinExperience Research Best Practices - UX Meet Up Boston 2013 - Dan Berlin
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan Berlin
Mad*Pow
 
Experience Research Best Practices
Experience Research Best PracticesExperience Research Best Practices
Experience Research Best Practices
Dan Berlin
 
Research Writing Methodology
Research Writing MethodologyResearch Writing Methodology
Research Writing Methodology
Aiden Yeh
 
Co Inst Eval Presentation 09
Co Inst Eval Presentation 09Co Inst Eval Presentation 09
Co Inst Eval Presentation 09June Gothberg
 
R.M Evaluation Program complete research.pptx
R.M Evaluation Program complete research.pptxR.M Evaluation Program complete research.pptx
R.M Evaluation Program complete research.pptx
talhaaziz78
 
May/June 2010 Scenario 4
May/June 2010 Scenario 4May/June 2010 Scenario 4
May/June 2010 Scenario 4ianwbhs
 
Sad Lec3
Sad Lec3Sad Lec3
Sad Lec3
Waqas !!!!
 

Similar to Needs Assessment Webinar to AFC of ISPI (20)

Questionnaire2002
Questionnaire2002Questionnaire2002
Questionnaire2002
 
User Research Techniques by Vikram Rao, RSA
User Research Techniques by Vikram Rao, RSAUser Research Techniques by Vikram Rao, RSA
User Research Techniques by Vikram Rao, RSA
 
Section b
Section bSection b
Section b
 
Usability Testing Basics: What's it All About? at Web SIG Cleveland
Usability Testing Basics: What's it All About? at Web SIG ClevelandUsability Testing Basics: What's it All About? at Web SIG Cleveland
Usability Testing Basics: What's it All About? at Web SIG Cleveland
 
Text, Tags and Thumbnails: Latest Trends in Bioscience Literature Search
Text, Tags and Thumbnails:Latest Trends in Bioscience Literature SearchText, Tags and Thumbnails:Latest Trends in Bioscience Literature Search
Text, Tags and Thumbnails: Latest Trends in Bioscience Literature Search
 
TYPES OF DATA COLLECTION
TYPES  OF DATA COLLECTIONTYPES  OF DATA COLLECTION
TYPES OF DATA COLLECTION
 
Ch03 research plan
Ch03 research planCh03 research plan
Ch03 research plan
 
Research and advocacy by Seetal Daas
Research and advocacy by Seetal DaasResearch and advocacy by Seetal Daas
Research and advocacy by Seetal Daas
 
problem
problemproblem
problem
 
Techniques
TechniquesTechniques
Techniques
 
SCIENTIFIC MERIT ACTION RESEARCH TEMPLATE (SMART) FORMa..docx
SCIENTIFIC MERIT ACTION RESEARCH TEMPLATE (SMART) FORMa..docxSCIENTIFIC MERIT ACTION RESEARCH TEMPLATE (SMART) FORMa..docx
SCIENTIFIC MERIT ACTION RESEARCH TEMPLATE (SMART) FORMa..docx
 
SMART Learner FormPSL Scientific Merit Action Research Te.docx
SMART Learner FormPSL Scientific Merit Action Research Te.docxSMART Learner FormPSL Scientific Merit Action Research Te.docx
SMART Learner FormPSL Scientific Merit Action Research Te.docx
 
CIB 3103: Requirements Capture
CIB 3103: Requirements CaptureCIB 3103: Requirements Capture
CIB 3103: Requirements Capture
 
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan Berlin
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan BerlinExperience Research Best Practices - UX Meet Up Boston 2013 - Dan Berlin
Experience Research Best Practices - UX Meet Up Boston 2013 - Dan Berlin
 
Experience Research Best Practices
Experience Research Best PracticesExperience Research Best Practices
Experience Research Best Practices
 
Research Writing Methodology
Research Writing MethodologyResearch Writing Methodology
Research Writing Methodology
 
Co Inst Eval Presentation 09
Co Inst Eval Presentation 09Co Inst Eval Presentation 09
Co Inst Eval Presentation 09
 
R.M Evaluation Program complete research.pptx
R.M Evaluation Program complete research.pptxR.M Evaluation Program complete research.pptx
R.M Evaluation Program complete research.pptx
 
May/June 2010 Scenario 4
May/June 2010 Scenario 4May/June 2010 Scenario 4
May/June 2010 Scenario 4
 
Sad Lec3
Sad Lec3Sad Lec3
Sad Lec3
 

Recently uploaded

Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Nexer Digital
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
Uni Systems S.M.S.A.
 
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
SOFTTECHHUB
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofszkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
Alex Pruden
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIEnchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Vladimir Iglovikov, Ph.D.
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
SOFTTECHHUB
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Adtran
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
James Anderson
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Neo4j
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
Kumud Singh
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
Rohit Gautam
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 

Recently uploaded (20)

Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
 
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofszkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIEnchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 

Needs Assessment Webinar to AFC of ISPI

  • 1. Needs Assessment Methods and Tools Brett Christensen Kayleen Grage Mike Hajba Barb Spice
  • 2.
  • 3. Dilbert on Data Collection
  • 4.
  • 5.
  • 7.
  • 8.
  • 9.
  • 10. Dogbert on Data Mining
  • 12.
  • 13.
  • 14.
  • 16.
  • 17.
  • 18. Cause Analysis Worksheet Example BEM Factor Force Field Weighting BEM Sub Factors
  • 19. Cause Analysis Worksheet Adaptation for Project BEM Factor BEM Sub Factors FACTORS DRIVING FORCES RESTRAINING FORCES INFORMATION Clear Expectations 1a. Expectations for the project status reporting process are clear. Relevant Feedback 1b. Feedback given to me on my project status reports is timely. 1c. I receive feedback on my project status reports for good performance. 1d. I receive feedback on my project status reports for not so good performance. 1e. Feedback I have received on my performance on my project status reports is relevant. Relevant guides/job aids 1f. The handout (containing job aids, templates, and examples) for project status reporting is useful. Performance coaching 1g. I receive coaching regarding the quality of my performance on project status reports. Purpose/use of the reports 1h. I understand how my project status reports will be used by others.
  • 20.
  • 21.
  • 22. Dogbert on Cause Analysis
  • 23.
  • 24.
  • 25.
  • 27.
  • 28.
  • 30.
  • 31.

Editor's Notes

  1. Introduce Team: BIOS:
  2. On 11 September 2008 a new Project Management Process was implemented within the client organization following a one day training event. The Project Officers were advised that each project assigned to them would consist of a project charter, a project plan, bi-weekly status reports, and a final project report. From September 2008 to January 2009, only two of the seven Project Officers completed all the status reports as required. In October the Project Officers requested that the bi-weekly reporting requirement be dropped to monthly. It was, however, reporting continued to drop off. In January 2009, the project status reporting requirement was put on hold pending the outcome of this needs assessment.
  3. DO POLL HERE When you conduct a needs assessment do you include data gathering?
  4. There are all kinds of ways to collect DATA What is DATA? DATA is Wikipedia: Data are often viewed as a lowest level of abstraction from which information and knowledge are derived. Dictionary.com: The plural of datum. Individual facts, statistics, or items of information: Merriam-Webster: factual information (as measurements or statistics) used as a basis for reasoning, discussion, or calculation Seems everyone agrees that data is a snippet that we can look at with other snippets and turn it into information based on how we – the analysts – perceive it! Knowing what data is, is fine… now we need to know how to get it!
  5. Definition “ Qualitative or quantitative data collected for governmental, research, education, or service purposes and available to researchers in usable raw data forms and formats” (Schensul, Schensul, and LeCompte, 1999, p. 201). Purpose: Archival Data is information that may or may not relate to the need being assessed. For example, data may pertain to a different organization, a time period, or else it may have been collected by people other than the practitioner who will use it. Archival Data is different from other data sources such as interviews, focus groups, surveys, and observations. While these sources can be influenced by the HPT practitioner, archival data cannot. In other words, the practitioner can only work with the archival data already available.
  6. Ways You Can Use Archival Data As a general rule, first-hand data is preferable to archival data. However, there are several situations in which the use of archival data can be beneficial to a Needs Assessment. Should Use Archival Data If: data exists that is relevant to the group being assessed primary data is not available obtaining primary data would be overly costly or time-consuming the practitioner conducting the needs assessment has insufficient resources to obtain accurate primary data the practitioner seeks to compare an existing situation to those outside of the organization the practitioner seeks to identify trends among other groups (Explain this point – trend across several groups taking the same course for example) Should Not Use Archival Data If: available archival data requires significant manipulation to be relevant to the needs assessment being conducted the practitioner is not capable of analyzing the data properly (e.g., lacks knowledge in statistical analysis) public data is not readily available obtaining Archival Data is cost-prohibitive the methodology to obtain the Archival Data is flawed the accuracy of the Archival Data cannot be verified How We Used Archival Data: To determine actual reporting frequency by project officer and by project To determine exemplar vs average vs poor performers To assist in creation of BOTG
  7. Pros Cost effective Limited time commitment Can help validate observations or other findings (UNICEF, 2005) Can help to identify data trends May provide a larger context for the data (UNICEF, 2005) Society-wide, larger amounts of information are being stored electronically (IBM, 2007), increasing the quantity of archival data available Cons Data is often not a direct match to current situation Data may require difficult manipulation to make it relevant Some secondary data may only be available at a cost (Schensul, Schensul, and LeCompte, 1999) Data may not be current
  8. DO Poll here I would use archival data to... Correct answer is Find trends among other groups (Y)
  9. DEFINITION: “A data-collection method used with individuals that can be conducted in person, by phone, or by computer technology (such as online cameras, or videoconferencing).” Gupta et al. (2007) p.309 Individuals rather than groups, as more than 1 person may be considered a “focus group” we all know group dynamics can come into play with focus groups may shut down some interviewees, arguments, and the “Boss is in the room” our means of interviewing via technology are increasing all the time PURPOSE: (your general purpose might be…)
  10. WAYS TO USE/APPROACH interviews: (you might use them to…) use to get by-in: if done on client, mgrs., employees > (helps with ownership of findings and willingness to support change effort) use to help gage change mgt. progress and acceptance use as a tool in evaluation of the initiative’s results as part of a Performance Analysis (especially is doing one apart from the NA as part of your Cause Analysis as part of your Change Mgt. process to see how the initiative is being received as part of your Evaluation to deepen or expand your knowledge in a certain area or field POLLING QUESTION : OVERALL FORMAT/ QUESTION FORMS : Structured (questions laid out, limit possible answers, very focused) Semi-structured (some questions laid out, maybe probes written down to remind interviewee to expand on their answers, open to giving interviewee some latitude in their responses while still keeping the interview focused) Unstructured (much more of a relaxed approach, may still have a general focus, but very open to where the interviewee takes you) QUESTION FORMS: Open ended (gives the person lots of room to respond as they see fit, may give you things you would not have thought of) Closed ended (somehow limits the person’s response, maybe used especially when you are trying to make sure the data will be easily quantifiable) Probing (maybe written down under your main open ended q’s to remind you to make sure to get more detailed information on something incase the interviewee does not hit on it during his open response) HOW WE USED THE INTERVIEWS : some questions based on BEM factors as a means to juxtapose supervisor perception with employee perception to add qualitative data in addition to our qualitative data
  11. PROS: (electronic) gives reach to hard-to-get-at people (outpost in Alaska) (electronic) convenience for interviewee, maybe interviewer also (electronic) give control / flexibility to interviewee cut / past features (electronic) good for limited budget programs (travel, time…) (electronic) may be set up for anonymity / confidentiality (in-person) good interviewer can build trust and rapport CONS: (in-person) no chance for anonymity, person may be afraid to tell it as it is (in-person) nervousness on part of interviewee, may change answers due to same
  12. DO POLL HERE The most common method of collecting data is... Correct answer is INTERVIEWS
  13. Take a side step here to talk about the tool that was important for data gathering and led to smooth analysis, which is the cause analysis worksheet. This tool, which was developed by Roger Chevalier, has it’s origins in Gilbert’s Behavior Engineering Model and Kurt Lewin’s force field analysis tools. If you’re not familiar with the Force Field Analysis, it is a method for listing, discussing, and evaluating the various forces for and against a proposed change – which in this case would be a gap. The cause analysis worksheet overlays these two models, which we’ll see in a minute. There is quite a bit of background information on this model, and we would encourage you to read the reference noted in the job aid, which is titled “the evolution of a performance analysis job aid” – because it has evolved quite interestingly over the past few years.
  14. DEFINITION “ A data-collection method typically used to gather data from many people at one time; can be mailed, e-mailed, or offered online” (Gupta, 2007, p. 313). PURPOSE To collect qualitative and quantitative data of things that cannot be observed, such as opinions, knowledge, and feelings. WAYS YOU CAN USE IT
  15. In our Needs Assessment, we used surveys to gather data regarding expectations, feedback, knowledge and skill levels, consequences, incentives, motives – all of which fall into the Six Factors of Gilbert’s BEM, which is what we used to develop and structure our questions (Information, Resources, Incentives, Knowledge, Capacity, and Motives). We revised and refined our questions several times and decided to conduct a pilot survey. After the pilot survey we again revised our questions and then sent out the final survey. We used 4 point Likert-scale matrix questions, grouped together in sets, with each set followed by an open-ended question. We chose to conduct the survey electronically, via Opinio web-based software. We had an 86% participant rate, which we fill gave us sufficient data. PILOT Six sets of matrix questions, 27 total Four-point Likert scale (Strongly Disagree, Disagree, Agree, Strongly Agree) Open-ended textbox after each set Five questions regarding survey construction Time requirement, unclear questions, terminology, etc. Two participants FINAL Questions revised based on Pilot survey Six sets of matrix questions, 29 total Four-point Likert scale (Strongly Disagree, Disagree, Agree, Strongly Agree) Open-ended textbox after each set 86% completion rate
  16. There are several pros & cons outlined in the job aid we’ve provided, and here are the ones we found most relevant to our needs assessment project. PROS Electronic surveys don’t cost anything to send out unless you have to pay for the survey tool. But there are some tools out there, like survey monkey, which are free. Questions are the same for everyone so there’s no variability between surveys like with interviews. Whenever possible, it’s good to send surveys to a larger group than you actually need to ensure you get sufficient data. (e.g., if you want 50 participants, maybe send it to 100 people) CONS It’s easy to ignore or forget about a survey, so reminder notes are a good idea. Participants may misread or misinterpret questions, which is another reason pilot surveys are beneficial. PROS Quantitative data that is gathered is easy to compile and analyze; Time Commitment – much quicker to take a 5-10 minute survey than 30-60 minute interview Participant size – In turn, you can have a larger participant size because data is more manageable Question preparation – no variability between participants No time constraints – they don’t have to be completed within 10 minutes CONS Paper surveys can be expensive (paper, ink, postage, etc.) Electronic surveys – require computer, internet Additional Info – limited to the questions in the survey
  17. DO POLL Fill in the blank: I_____complete surveys I receive at work
  18. DO 6X WEBINAR EVAL POLLING QUESTIONS HERE