Successfully reported this slideshow.
Texas Library Association Annual Conference, 2004San Antonio, Texas             Research Methodology 101                  ...
What question do you have aboutthe research methodologies inthese studies? 1. A study assessing student learning outcomes ...
What question do you have aboutthe research methodologies inthese studies?2. An experimental study thatproposes a fund all...
What question do you have aboutthe research methodologies inthese studies?3. A newspaper article you read just theother da...
What question do you have aboutthe research methodologies inthese studies? 4. A 2004 article on a library use and services...
What question do you have aboutthe research methodologies inthese studies?  5. An outcomes assessment research  project of...
What question do you have aboutthe research methodologies inthese studies? 6. Over a one year period, researchers studied ...
What question do you have aboutthe research methodologies inthese studies? 7. A survey of faculty found that the majority ...
First things first► Basics► Topic ideas► Typical methodologies► Common pitfalls► Getting started and putting it all  toget...
Basic steps of a research            project►Find a topicWhat, When►Formulate questionsWhat, Why►Define populationWho, ...
Figuring out your study►What?►Who?►When?►Why?►And How?
Topic ideas►Online chat reference  ● Types of questions     Subject? Type?     # of turnaways*  ● Difference in discours...
Topic Ideas►E-book usage►Usability studies of  ● Online tutorial(s)  ● ‘My Library” portals►Analysis of library web sites ...
Types of methodologies►QuaLitative Measures  ● Descriptive  ● Numbers not the primary focus  ● Interpretive, ethnographic,...
QuaLitative measures►Content Analysis  ● Analyzed course syllabi of    library use through discipline    and level (Ramble...
QuaLitative Measures►Discourse Analysis  ● Analyzed student responses in writing    and discussions to a short film &    c...
QuaLitative Measures►Interviews  ● Studied 25 HS students’ web use for    research assignments (Lorenzen)  ● Looked at wha...
QuaLitative Measures►Think Aloud Protocols  ● Studied how users navigate a library    web site (Cockrell & Jayne)►Usabilit...
7QuaNtitative measures►CompareThings►Count Things►Survey People About Things
FQuaNtitative measures►Comparison studies  ● Experimental and control groups  ● Instructional methodologies (Colaric;    C...
GQuaNtitative measures►Pre & Post Tests (Van Scoyoc)►Measures & Scales      Bostick’s Library Anxiety Scale (Onwuegbuzie ...
FQuaNtitative measures►Numeric Studies  ● Citation AnalysisBibliometrics    (Dellavalle)  ● Webometrics (Bar-Ilian)
Ready Made Data Sets►National Survey of Student Engagement (Whitmire)►College Student Experiences Questionnaire (Kuh and G...
Common Pitfalls►Problems with population  ● Sampling?     Representativeness?     Self-selection?
Research Problem #1A study assessing student learningoutcomes in 2 broad categories(concepts, techniques) by examiningstud...
Research Problem #4A 2004 article on a library use andservices satisfaction study that usedas its measurement tool a surve...
Research Problem #5An outcomes assessment researchproject of a 5 year old IL program inwhich all incoming freshmen mustpar...
Common Pitfalls►Problems with operationalization  ● Defining of what is measured
Research Problem #2 An experimental study that proposesa fund allocation formula for academiclibrary collections based on ...
Research Problem #3A newspaper article you read just theother day stated that in a recentlypublished study done at a major...
Research Problem #4 A 2004 article on a library use andservices satisfaction study that usedas its measurement tool a surv...
Research Problem #5Over a one year period, researchersstudied the occurrence of turn-awaysin a virtual reference service a...
Common Pitfalls►Problems with generalizability  ● False conclusions  ● Transformations
Research Problem #1A study assessing student learningoutcomes in 2 broad categories(concepts, techniques) by examiningstud...
Research Problem #7A survey of faculty found that themajority of those interviewed interactedmost with librarians at the r...
Keep In Mind That►No study is perfect►“All data is dirty is some way or another; research is what you do with that dirty d...
Be Critical About Numbers                            (Best 2001)►“Every statistic is a way of summarizing complex informat...
Be Critical About Numbers►How was the choice for the measurement made?►What type of sample was gathered & how does that af...
Getting Started► Read to learn; read to analyze  ● About research methodology  ● Studies on similar topics  ● Interesting ...
Getting Started►Finding a topic needn’t be traumatic  ● Work projects Research studies     P&T overhaul     Library GO ...
Getting Started►Data collection involves agreement & consent►Forge partnerships►At some point you will need to leave the c...
Just get out and do it!
Questions?
Upcoming SlideShare
Loading in …5
×

Research methodology 101

1,220 views

Published on

Published in: Education, Technology
  • Be the first to comment

Research methodology 101

  1. 1. Texas Library Association Annual Conference, 2004San Antonio, Texas Research Methodology 101 Yes! You CAN Do a Research Study in Your Library A presentation by Kate Manuel, Instruction Coordinator and Susan E. Beck, Collection Development Coordinator New Mexico State University Library
  2. 2. What question do you have aboutthe research methodologies inthese studies? 1. A study assessing student learning outcomes in 2 broad categories (concepts, techniques) by examining student research journals in 1 section of an elective information literacy course in fall semester.
  3. 3. What question do you have aboutthe research methodologies inthese studies?2. An experimental study thatproposes a fund allocation formula foracademic library collections based onthe following:average of overall book price + average of overallserial prices * degree level (10 for undergraduate to30 for doctorate) / the number of students enrolledin degree program as majors + the total number offaculty in the department * three * total number ofstudents in program. (OAB + OAS) * D/(Sn +(Fn*3))*SnN.B. Not a standard formula
  4. 4. What question do you have aboutthe research methodologies inthese studies?3. A newspaper article you read just theother day stated that in a recentlypublished study done at a major U.S.university, researchers found thatdomestic violence affects 1 in every 4women.
  5. 5. What question do you have aboutthe research methodologies inthese studies? 4. A 2004 article on a library use and services satisfaction study that used as its measurement tool a survey given to every nth person entering the library building on 40 randomly selected days throughout the school year.
  6. 6. What question do you have aboutthe research methodologies inthese studies? 5. An outcomes assessment research project of a 5 year old IL program in which all incoming freshmen must participate. Total student population on campus is divided between 32% freshmen to senior (or 4 year) and 68% transfer students.
  7. 7. What question do you have aboutthe research methodologies inthese studies? 6. Over a one year period, researchers studied the occurrence of turn-aways in a virtual reference service and noted that the significantly high occurrence of turn-aways indicates increased need for virtual reference service.
  8. 8. What question do you have aboutthe research methodologies inthese studies? 7. A survey of faculty found that the majority of those interview interacted most with librarians at the reference desk. The researchers concluded that most faculty view librarians in a servile role.
  9. 9. First things first► Basics► Topic ideas► Typical methodologies► Common pitfalls► Getting started and putting it all together► Questions/discussion
  10. 10. Basic steps of a research project►Find a topicWhat, When►Formulate questionsWhat, Why►Define populationWho, When►Select design & measurementHow►Gather evidenceHow►Interpret evidenceWhy►Tell about what you did and found out
  11. 11. Figuring out your study►What?►Who?►When?►Why?►And How?
  12. 12. Topic ideas►Online chat reference ● Types of questions  Subject? Type?  # of turnaways* ● Difference in discourse  In-person vs. chat ● Partnership studies  Similar libraries with same software
  13. 13. Topic Ideas►E-book usage►Usability studies of ● Online tutorial(s) ● ‘My Library” portals►Analysis of library web sites or library instruction sites or pathfinders by best practices►Student learning outcomes in LI programs
  14. 14. Types of methodologies►QuaLitative Measures ● Descriptive ● Numbers not the primary focus ● Interpretive, ethnographic, naturalistic►QuaNtitative Measures ● N for numbers ● Statistical ● Quantifiable
  15. 15. QuaLitative measures►Content Analysis ● Analyzed course syllabi of library use through discipline and level (Rambler) ● Studied online tutorials, applying best practices recommendations (Tancheva)
  16. 16. QuaLitative Measures►Discourse Analysis ● Analyzed student responses in writing and discussions to a short film & compared findings to parallel study with LIS grad Ss (Vandergrift)►Focus Groups ● Discussed how participants experience & use the library (Von Seggern & Young) ● Studied why students use the Internet and how much time they use it (Wilson)
  17. 17. QuaLitative Measures►Interviews ● Studied 25 HS students’ web use for research assignments (Lorenzen) ● Looked at what type of information first year students need and how they go about acquiring it (Seamans)►Observation (obtrusive) ● Observed students as they conducted online research & noted their activities (Dunn)►Observation (Unobtrusive) ● Retrieval of discarded cheat sheets to analyze academic misconduct (Pullen et. al.)
  18. 18. QuaLitative Measures►Think Aloud Protocols ● Studied how users navigate a library web site (Cockrell & Jayne)►Usability testing ● Examined students’ mental models of online tutorials (Veldof & Beavers)
  19. 19. 7QuaNtitative measures►CompareThings►Count Things►Survey People About Things
  20. 20. FQuaNtitative measures►Comparison studies ● Experimental and control groups ● Instructional methodologies (Colaric; Cudiner & Harmon) ● Program assessment using before/after analysis of research papers(Emmons & Martin)
  21. 21. GQuaNtitative measures►Pre & Post Tests (Van Scoyoc)►Measures & Scales  Bostick’s Library Anxiety Scale (Onwuegbuzie & Jiao; Van Scoyoc)  Procrastination Assessment Scale (Onwuegbuzie & Jiao)
  22. 22. FQuaNtitative measures►Numeric Studies ● Citation AnalysisBibliometrics (Dellavalle) ● Webometrics (Bar-Ilian)
  23. 23. Ready Made Data Sets►National Survey of Student Engagement (Whitmire)►College Student Experiences Questionnaire (Kuh and Gonyea)►The Web ● Internet Archive (Ryan, Field & Olfman) ● Electronic journals (Dellavalle)►Library server logs
  24. 24. Common Pitfalls►Problems with population ● Sampling?  Representativeness?  Self-selection?
  25. 25. Research Problem #1A study assessing student learningoutcomes in 2 broad categories(concepts, techniques) by examiningstudent research journals in 1 sectionof an elective information literacycourse in fall semester.
  26. 26. Research Problem #4A 2004 article on a library use andservices satisfaction study that usedas its measurement tool a surveygiven to every nth person enteringthe library building on 40 randomlyselected days throughout the schoolyear.
  27. 27. Research Problem #5An outcomes assessment researchproject of a 5 year old IL program inwhich all incoming freshmen mustparticipate. Total student population oncampus is divided between 32%freshmen to senior (or 4 year) and68% transfer students.
  28. 28. Common Pitfalls►Problems with operationalization ● Defining of what is measured
  29. 29. Research Problem #2 An experimental study that proposesa fund allocation formula for academiclibrary collections based on thefollowing:average of overall book price + average ofoverall serial prices * degree level (10 forundergraduate to 30 for doctorate) / the number ofstudents enrolled in degree program as majors +the total number of faculty in the department * three* total number of students in program. (OAB + OAS) * D/(Sn +(Fn*3))*SnN.B. Not a standard formula
  30. 30. Research Problem #3A newspaper article you read just theother day stated that in a recentlypublished study done at a major U.S.university, researchers found thatdomestic violence affects 1 in every 4women.
  31. 31. Research Problem #4 A 2004 article on a library use andservices satisfaction study that usedas its measurement tool a surveygiven to every nth person entering thelibrary building on 40 randomlyselected days throughout the schoolyear.
  32. 32. Research Problem #5Over a one year period, researchersstudied the occurrence of turn-awaysin a virtual reference service and notedthat the significantly high occurrence ofturn-aways indicates increased needfor virtual reference service.
  33. 33. Common Pitfalls►Problems with generalizability ● False conclusions ● Transformations
  34. 34. Research Problem #1A study assessing student learningoutcomes in 2 broad categories(concepts, techniques) by examiningstudent research journals in 1 sectionof an elective information literacycourse in fall semester.
  35. 35. Research Problem #7A survey of faculty found that themajority of those interviewed interactedmost with librarians at the referencedesk. The researchers concluded thatmost faculty view librarians in aservile role.
  36. 36. Keep In Mind That►No study is perfect►“All data is dirty is some way or another; research is what you do with that dirty data” (Manuel)►Measurement involves making choices
  37. 37. Be Critical About Numbers (Best 2001)►“Every statistic is a way of summarizing complex information into relatively simple numbers.” (Best)►How did the researchers arrive at these numbers?►Who produced the numbers and what is their bias?►How can key terms be defined & in how many different ways?
  38. 38. Be Critical About Numbers►How was the choice for the measurement made?►What type of sample was gathered & how does that affect result?►Is the statistical result interpreted correctly?►If comparisons are made, are they appropriate?►Are there competing statistics?
  39. 39. Getting Started► Read to learn; read to analyze ● About research methodology ● Studies on similar topics ● Interesting studies ● Non-library studies
  40. 40. Getting Started►Finding a topic needn’t be traumatic ● Work projects Research studies  P&T overhaul  Library GO Bond Proposal Project  Library workshop trends  User repair strategies
  41. 41. Getting Started►Data collection involves agreement & consent►Forge partnerships►At some point you will need to leave the comfort zone of reading and literature gathering and …
  42. 42. Just get out and do it!
  43. 43. Questions?

×