SlideShare a Scribd company logo
1 of 29
Ask an Expert Task Force:
 Findings and Decisions
Agenda
•   Objectives
•   Methodologies
•   Some numbers
•   Observations
•   Steps forward
•   Discussion
Objectives
• Assess CES' ability to operate an AaE
  system
• Assess the performance to date
• Determine people’s expectations
• Assess AaE system usability
• Determine resources required to
  operate the system
Methodologies
• Survey of the public users
• Focus groups of
  specialists/educators/volunteers
• Interviews with Directors and
  Administrators
• Analysis of logs and other metrics
Methodologies
• Survey sent to 6,557 clientele
  o response rate:   504
  o P (.05)= 376
• Interviews with
  Directors/Administrators in 14 states
• 5 focus groups (Specialists/Agents)
• Log analysis
Some Numbers
Questions Submitted/Answered
Who is Answering Questions:
The Ask an Expert Long Tail
Who is Asking Questions:
     Demographics
Knowledge of CES
Observations
How Does the Public Perceive
 Answers from eXtension?

Not based              Science-based
on science




Not trusted
                       Trusted
Science-based/Trusted
What the clientele said:

“I am glad to have my other research confirmed
however by a trustworthy source.”

“I got a reply that, although not what I wanted to
hear, I trusted”

“I had a very prompt reply, with very accurate
information plus direction to a paper.”

“A Google search provided an answer but I needed
someone with authority and experience to
corroborate...”
How Did the Public
              Describe Their Question?

A curiosity                        Critically
                                   important




  Of little                        Of significant
economic                           economic
   need                            need
Importance
What the clientele said:

“I was worried about food safety for my family if I
planted my vegetable garden as planned.”

“Squirrels have been eating my house. We tried
several suggestions, and the situation is improving.”

“He gave practical information about how to decide
what is best for my family, as opposed to necessarily
doing what's best for the tree. Very helpful.”
Speed of Response
Speed of Response
What the clientele said:

“I didn’t expect an answer so quickly. In the matter of
an hour or so..the response was very helpful. I am
thrilled with this service”

“I will not keep a client waiting a week for a
response. My suggestion would be that if you are
going to provide this question and answer service,
you need to respond in a timely fashion (within 2
days)”
Speed of Response
Our CES faculty/educators say it is
unreasonable for us to expect them to
respond to questions over weekends
and holidays... “Office hours should be
published... But, during such office
hours, 48 hours seems an appropriate
response time.”

- Faculty/Agent focus group
Utility by Response Time
(What role did the answer play in solving the problem)
                Questions answered in 2 days or less



Insignificant                                          Very important
         role                                          role



                  Questions answered in 3-7 days
Utility of Answer
What the clientele said:

“We were supplied with the information we wanted in
an expedient, competent and professional manner
(which is so unbelievably rare these days).”

“I do know it took four days for me to get an answer
and I thought at the time if the answer was needed
was urgent, I would have been in trouble.”

“To be frank, it’s kinda hit or miss and I’m not sold on
the 'quick' response promised.”
Visualization of Quality of Answer




This cluster of user        Axes
stories indicates that eX   – science-based
answers are mostly          – trusted
viewed as Trusted and       – simple/complex
Science-based.
Simplicity/Complexity
What the clientele said:

“I did not really get an answer...I did ask a fairly long,
drawn out and complicated question. I was rather
disappointed in the short answer.”

“The answer was well-written and included even
more information that I had expected.”

“The ‘Expert’ forwarded an article but it did not
address the specifics of my question... ”

“As a person who has been involved in Dairy
business, I knew what we should do... but
unfortunately what I got was very simple concepts.”
Valued Activity
Administrators observed that AaE
is not considered scholarly work,
but saw the value in reaching-out to
clientele.

- Director/Adminstrator interviews
Valued Activity
Responding to questions coming
through AaE generally receives little
professional credit… most tenure-
track faculty receive little credit for
such activity.
- Director/Administrator interviews/Focus
groups
Decisions
Decisions
• Need more people within and outside
  CoPs answering questions.
• CoPs need to focus on recruiting and
  identifying appropriate responders,
  and on professional development.
• Must answer questions outside of
  currently launched CoPs. Need
  strategy.
Decisions
• Performance metrics must match
  clientele expectations.
• Develop content that appeals to more
  diverse demographic.
• Focus on online engagement.
• Recognize AaE is reaching new,
  online audiences.
Discussion
Findings and Decisions from the Ask an Expert Task Force

More Related Content

Similar to Findings and Decisions from the Ask an Expert Task Force

Googling is core and the textbook is extra: information-seeking behaviour and...
Googling is core and the textbook is extra: information-seeking behaviour and...Googling is core and the textbook is extra: information-seeking behaviour and...
Googling is core and the textbook is extra: information-seeking behaviour and...tbirdcymru
 
AGR CONFERENCE 2013 Practical tips on integrating a strengths based assessmen...
AGR CONFERENCE 2013 Practical tips on integrating a strengths based assessmen...AGR CONFERENCE 2013 Practical tips on integrating a strengths based assessmen...
AGR CONFERENCE 2013 Practical tips on integrating a strengths based assessmen...EmmaAGR
 
Dr.fuziah presentation information seeking
Dr.fuziah presentation information seekingDr.fuziah presentation information seeking
Dr.fuziah presentation information seekingMohd Iqbal Al-farabi
 
Digicorp meets Yuva Unstoppable
Digicorp meets Yuva UnstoppableDigicorp meets Yuva Unstoppable
Digicorp meets Yuva UnstoppableDigicorp
 
Assessments in Career Counseling
Assessments in Career CounselingAssessments in Career Counseling
Assessments in Career CounselingRahila Narejo
 
Getting The Most Out of Your Data Analyst - HAS Session 9
Getting The Most Out of Your Data Analyst - HAS Session 9Getting The Most Out of Your Data Analyst - HAS Session 9
Getting The Most Out of Your Data Analyst - HAS Session 9Health Catalyst
 
DATA COLLECTION.pptx
DATA COLLECTION.pptxDATA COLLECTION.pptx
DATA COLLECTION.pptxSuzie De Leon
 
eXtension Nareee Presentation 2009
eXtension Nareee Presentation 2009eXtension Nareee Presentation 2009
eXtension Nareee Presentation 2009Dan Cotton
 
V10 getting the_job_outline_of_important_things
V10 getting the_job_outline_of_important_thingsV10 getting the_job_outline_of_important_things
V10 getting the_job_outline_of_important_thingsSadashiv_Dhulashetti
 
Research Problem ppt.pptx
Research Problem ppt.pptxResearch Problem ppt.pptx
Research Problem ppt.pptxmahendra singh
 
Assessment preparation
Assessment preparationAssessment preparation
Assessment preparationSridharKumar53
 
Critical thinking cetl feb 2015
Critical thinking cetl feb 2015Critical thinking cetl feb 2015
Critical thinking cetl feb 2015brmontgo
 
Action research: moving research forward + how it fits with dissertation or...
Action research:  moving research  forward + how it fits with dissertation or...Action research:  moving research  forward + how it fits with dissertation or...
Action research: moving research forward + how it fits with dissertation or...DoctoralNet Limited
 
Your Career Unlocked 2014
Your Career Unlocked 2014Your Career Unlocked 2014
Your Career Unlocked 2014Natalia Dobias
 
business research method chp 7]
business research method  chp 7]business research method  chp 7]
business research method chp 7]fizza tanvir
 

Similar to Findings and Decisions from the Ask an Expert Task Force (20)

Googling is core and the textbook is extra: information-seeking behaviour and...
Googling is core and the textbook is extra: information-seeking behaviour and...Googling is core and the textbook is extra: information-seeking behaviour and...
Googling is core and the textbook is extra: information-seeking behaviour and...
 
AGR CONFERENCE 2013 Practical tips on integrating a strengths based assessmen...
AGR CONFERENCE 2013 Practical tips on integrating a strengths based assessmen...AGR CONFERENCE 2013 Practical tips on integrating a strengths based assessmen...
AGR CONFERENCE 2013 Practical tips on integrating a strengths based assessmen...
 
BDI Training
BDI TrainingBDI Training
BDI Training
 
Dr.fuziah presentation information seeking
Dr.fuziah presentation information seekingDr.fuziah presentation information seeking
Dr.fuziah presentation information seeking
 
Digicorp meets Yuva Unstoppable
Digicorp meets Yuva UnstoppableDigicorp meets Yuva Unstoppable
Digicorp meets Yuva Unstoppable
 
Assessments in Career Counseling
Assessments in Career CounselingAssessments in Career Counseling
Assessments in Career Counseling
 
Getting The Most Out of Your Data Analyst - HAS Session 9
Getting The Most Out of Your Data Analyst - HAS Session 9Getting The Most Out of Your Data Analyst - HAS Session 9
Getting The Most Out of Your Data Analyst - HAS Session 9
 
Action research
Action researchAction research
Action research
 
Interviewing Collection
Interviewing CollectionInterviewing Collection
Interviewing Collection
 
DATA COLLECTION.pptx
DATA COLLECTION.pptxDATA COLLECTION.pptx
DATA COLLECTION.pptx
 
eXtension Nareee Presentation 2009
eXtension Nareee Presentation 2009eXtension Nareee Presentation 2009
eXtension Nareee Presentation 2009
 
Interview workshop slides final
Interview workshop slides  finalInterview workshop slides  final
Interview workshop slides final
 
V10 getting the_job_outline_of_important_things
V10 getting the_job_outline_of_important_thingsV10 getting the_job_outline_of_important_things
V10 getting the_job_outline_of_important_things
 
How to ace the viva dcu
How to ace the viva dcuHow to ace the viva dcu
How to ace the viva dcu
 
Research Problem ppt.pptx
Research Problem ppt.pptxResearch Problem ppt.pptx
Research Problem ppt.pptx
 
Assessment preparation
Assessment preparationAssessment preparation
Assessment preparation
 
Critical thinking cetl feb 2015
Critical thinking cetl feb 2015Critical thinking cetl feb 2015
Critical thinking cetl feb 2015
 
Action research: moving research forward + how it fits with dissertation or...
Action research:  moving research  forward + how it fits with dissertation or...Action research:  moving research  forward + how it fits with dissertation or...
Action research: moving research forward + how it fits with dissertation or...
 
Your Career Unlocked 2014
Your Career Unlocked 2014Your Career Unlocked 2014
Your Career Unlocked 2014
 
business research method chp 7]
business research method  chp 7]business research method  chp 7]
business research method chp 7]
 

Recently uploaded

Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphThiyagu K
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxpboyjonauth
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationnomboosow
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformChameera Dedduwage
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991RKavithamani
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...Marc Dusseiller Dusjagr
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docxPoojaSen20
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpinRaunakKeshri1
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfchloefrazer622
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 

Recently uploaded (20)

Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptx
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
 
Staff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSDStaff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSD
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docx
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpin
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdf
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 

Findings and Decisions from the Ask an Expert Task Force

  • 1. Ask an Expert Task Force: Findings and Decisions
  • 2. Agenda • Objectives • Methodologies • Some numbers • Observations • Steps forward • Discussion
  • 3. Objectives • Assess CES' ability to operate an AaE system • Assess the performance to date • Determine people’s expectations • Assess AaE system usability • Determine resources required to operate the system
  • 4. Methodologies • Survey of the public users • Focus groups of specialists/educators/volunteers • Interviews with Directors and Administrators • Analysis of logs and other metrics
  • 5. Methodologies • Survey sent to 6,557 clientele o response rate: 504 o P (.05)= 376 • Interviews with Directors/Administrators in 14 states • 5 focus groups (Specialists/Agents) • Log analysis
  • 8. Who is Answering Questions: The Ask an Expert Long Tail
  • 9. Who is Asking Questions: Demographics
  • 12. How Does the Public Perceive Answers from eXtension? Not based Science-based on science Not trusted Trusted
  • 13. Science-based/Trusted What the clientele said: “I am glad to have my other research confirmed however by a trustworthy source.” “I got a reply that, although not what I wanted to hear, I trusted” “I had a very prompt reply, with very accurate information plus direction to a paper.” “A Google search provided an answer but I needed someone with authority and experience to corroborate...”
  • 14. How Did the Public Describe Their Question? A curiosity Critically important Of little Of significant economic economic need need
  • 15. Importance What the clientele said: “I was worried about food safety for my family if I planted my vegetable garden as planned.” “Squirrels have been eating my house. We tried several suggestions, and the situation is improving.” “He gave practical information about how to decide what is best for my family, as opposed to necessarily doing what's best for the tree. Very helpful.”
  • 17. Speed of Response What the clientele said: “I didn’t expect an answer so quickly. In the matter of an hour or so..the response was very helpful. I am thrilled with this service” “I will not keep a client waiting a week for a response. My suggestion would be that if you are going to provide this question and answer service, you need to respond in a timely fashion (within 2 days)”
  • 18. Speed of Response Our CES faculty/educators say it is unreasonable for us to expect them to respond to questions over weekends and holidays... “Office hours should be published... But, during such office hours, 48 hours seems an appropriate response time.” - Faculty/Agent focus group
  • 19. Utility by Response Time (What role did the answer play in solving the problem) Questions answered in 2 days or less Insignificant Very important role role Questions answered in 3-7 days
  • 20. Utility of Answer What the clientele said: “We were supplied with the information we wanted in an expedient, competent and professional manner (which is so unbelievably rare these days).” “I do know it took four days for me to get an answer and I thought at the time if the answer was needed was urgent, I would have been in trouble.” “To be frank, it’s kinda hit or miss and I’m not sold on the 'quick' response promised.”
  • 21. Visualization of Quality of Answer This cluster of user Axes stories indicates that eX – science-based answers are mostly – trusted viewed as Trusted and – simple/complex Science-based.
  • 22. Simplicity/Complexity What the clientele said: “I did not really get an answer...I did ask a fairly long, drawn out and complicated question. I was rather disappointed in the short answer.” “The answer was well-written and included even more information that I had expected.” “The ‘Expert’ forwarded an article but it did not address the specifics of my question... ” “As a person who has been involved in Dairy business, I knew what we should do... but unfortunately what I got was very simple concepts.”
  • 23. Valued Activity Administrators observed that AaE is not considered scholarly work, but saw the value in reaching-out to clientele. - Director/Adminstrator interviews
  • 24. Valued Activity Responding to questions coming through AaE generally receives little professional credit… most tenure- track faculty receive little credit for such activity. - Director/Administrator interviews/Focus groups
  • 26. Decisions • Need more people within and outside CoPs answering questions. • CoPs need to focus on recruiting and identifying appropriate responders, and on professional development. • Must answer questions outside of currently launched CoPs. Need strategy.
  • 27. Decisions • Performance metrics must match clientele expectations. • Develop content that appeals to more diverse demographic. • Focus on online engagement. • Recognize AaE is reaching new, online audiences.