SlideShare a Scribd company logo
1 of 29
DESIGNING THE
QUESTIONAIRE AND
ESTABLISHING VALIDITY
AND RELIABILITY
LESSON 21
DESIGNING THE QUESTIONNAIRE
A questionnaire is an instrument for collecting data. It
consists of a series of questions that respondents provide
answers to a research study.
Steps in DESIGNING THE
QUESTIONNAIRE
Step 1 –BACKGROUND
◦ You do a basic research on the background of the chosen variable
or construct, choose a construct that you can use to craft the
purpose and objective of the questionnaire.
◦ Example of construct are weight, height, age, IQ, Academic
Performance.
◦ After identifying the construct, you can easily state the purpose
and objective of the questionnaire and the research questions as
well; only then can you frame the hypothesis of the study.
Steps in DESIGNING THE
QUESTIONNAIRE
Step 2- QUESTIONNAIRE CONCEPTUALIZATION
◦Choose the responses scale to use. This is how your
respondents to answer in your study. You can choose from the
following response scales.
◦ Yes/No
◦ Yes/No/Don’t Know
◦ This type of response scale allows the respondent to select only one
answer. The don’t know answer is the neutral response.
Steps in DESIGNING THE
QUESTIONNAIRE
Step 2- QUESTIONNAIRE CONCEPTUALIZATION
◦Likert Scale
◦ It is a very popular rating scale used by researchers to measure behaviors
and attitudes quantitively. It consist of choices that range from one extreme
to another from where respondents choose a degree of their opinions. It
the best tool for measuring the level of opinions.
Example of Likert scale
Frequency of Occurrence Frequency of Use
Very frequently Always
Frequently Often
Occasionally Sometimes
Rarely Rarely
Very Rarely Never
Example of Likert scale
Degree of importance Quality
Very important Strongly Agree
Important Agree
Moderately Important Undecided
Of little importance Disagree
Not important Strongly Disagree
Example of Likert scale
Level of Satisfaction Agreement
Very satisfied Strongly Agree
Satisfied Agree
Undecided Undecided
Unsatisfied Disagree
Very unsatisfied Strongly Disagree
GUIDELINES IN MAKING QUESTIONS in
your QUESTIONNAIRE
1. The questions should be clear, concise and simple using
minimum number of words. Avoid lengthy and confusing
lay-out.
2. Classify your questions under each statement based on
your problem statement.
3. Questions should be consistent within the needs of the
study.
4. Avoid sensitive or highly debatable question.
TYPES OF QUESTIONS
1. DICHOTOMOUS QUESTIONS
◦This is a Yes/No or Like/Dislike questions where only two (2)
choices are provided. Male/Female and Good/bad are also
examples of dichotomous choices.
◦2. OPEN-ENDED QUESTIONS
◦ This types of questions usually answers the questions “why”. It allows
the respondents to give their ideas and insights on a particular issue.
This type of questions gives additional challenge to the researcher
who must review each response before assigning codes and analyzing
the data.
Example 1: What are your favorite
movies? (specify their titles)
Example 2: What do you like most about
your school? (specify their titles)
CLOSED QUESTIONS
These are called multiple choice questions. These questions may
consist of three or more mutually exclusive questions with
different categories.
Example 1: How often do you watch TV at home?
Never……………………………………………………………………………….1
1 or 2 times a week…………………………………………………………..2
3 or 4 times a week……………………………………………………………3
Nearly everyday…………………………………………………………………..4
Example 2
What is the highest level of education that your mother has
completed? (Please put a check mark (√) on one box only).
Elementary School
High School
College
Don’t know
RANK-ORDER SCALE QUESTIONS
Respondents are asked to rank their choices on each
statement or item.
Ranking requires that a set of items be ranked in order to
compare each item to all other.
Example 3: Please rank the following activities in order of
importance in your work as senior high school student.
(please use “5” as the most important activity. “1”is the least
important
Importance Ranking
a. Doing Homework Activities
b. Going to the library
c. Using the computer
d. Joining academic organizations
e. Doing homeworks
RATING SCALE QUESTIONS
You construct a scale like those examples given for Likert
Scale ratings.
STEP 3-Establish the Validity of the
Questionnaire
Validity is traditionally defined as “degree to which a test measures
what it claims or purports to be measuring”.
A questionnaire undergoes a validation procedure to make sure that
it accurately measure what it aims to do. A valid questionnaire helps
to collect reliable and accurate data.
Kinds of Validity
1. Face Validity- this is a superficial or subjective
assessment. The questionnaire appears to measure the
construct or variable that the researcher study is supposed
to measure.
2. Content Validity- is most often measured by experts or
people who are familiar with the construct being measured.
The experts are asked to provide feedback on how well each
questions measure the variable or construct under study.
Kinds of Validity
3. Criterion-related validity
◦This type of validity measures the relationship between a
measure and an outcome.
◦Criterion related validity can be further divided into
concurrent and predictive validity.
◦4. Concurrent validity
◦ This type of validity measures how well the results of an evaluation or
assessment correlate with other assessments measuring the same
variables or constructs.
Kinds of Validity
5. Predictive validity
◦ This measures how well the results of an assessment can predict a
relationship between the construct being measured and future
behavior. For example the academic performance of a student in grade
11 math may be predicted by his/her math performance in junior high
school.
6. Construct Validity
This is concerned with the extent to which a measure is related to
other measures as specified in a theory or previous research. It is an
experimental demonstration that a test is measuring the construct it
claims to be measuring.
Step 4: Establishing the Reliability of the
Questionnaire
Reliability indicates the accuracy or precision of the
measuring instrument. It refers to a condition where
measurement process yields consistent responses
over repeated measurements.
Ways to assess the Reliability of the
Questionnaire
Test-retest reliability
◦This is the simplest method of assessing reliability. The
same test or questionnaire is administered twice and
correlation between the two sets of scores is
computed.
Ways to assess the Reliability of the
Questionnaire
Split-half method.
◦This method is also called equivalent or parallel
forms. In this method, two different test covering
the same topics are used and the correlation
between the two sets of scores is calculated.
Ways to assess the Reliability of the
Questionnaire
Internal Consistency
◦This method is used in assessing reliability of questions measured
on an interval or ratio scale. The reliability estimate is based on a
single form of test administered on a single occasion.
◦One popular formula to measure internal consistency is called
Cronbach’s alpha.
◦This can be computed using manual and electronic computations
such as the SPSS.
◦Cronbach’s alpha ranges from 0 (poor) to 1 (perfect reliability).
Anything above 0.70 is considered sufficiently reliable.
STEP 5. PILOT TESTING OF THE
QUESTIONNAIRE
Pilot testing a questionnaire is important before you use it to collect
data. Through this process, you can identify questions or statements
which are not clear to the participants or there might be some
problems with the relevance of the questionnaire to the current study.
STEP 5. PILOT TESTING OF THE
QUESTIONNAIRE
After designing the questionnaire, you may find 10-15 people from
your target group to pre-test the questionnaires. You design or provide
spaces where the testers can freely indicate their remarks.
Such remarks are the following:
◦“Delete this statement”. I don’t understand the questions.
◦“revise the question/statement.
◦“retain the questions”
◦The question is too long”
STEP 6 REVISE THE QUESTIONNAIRE
After identifying the problem areas in your questionnaire,
revise the instrument as needed based on the feedback
provided during the pre-testing or pilot-testing.
The best questionnaire is one that is edited and refined
towards producing clear questions arranged logically and in
sequential order.
The questionnaire should match with the research
objectives.
Lesson 21 designing the questionaire and establishing validity and reliabilty

More Related Content

What's hot

Lesson 4 Characteristics, Strengths, and Weaknesses of Qualitative Research.pptx
Lesson 4 Characteristics, Strengths, and Weaknesses of Qualitative Research.pptxLesson 4 Characteristics, Strengths, and Weaknesses of Qualitative Research.pptx
Lesson 4 Characteristics, Strengths, and Weaknesses of Qualitative Research.pptx
Aiza Santos
 

What's hot (20)

Characteristics, strengths, weaknesses, and kinds
Characteristics, strengths, weaknesses, and kindsCharacteristics, strengths, weaknesses, and kinds
Characteristics, strengths, weaknesses, and kinds
 
TYPES OF VARIABLES
TYPES OF VARIABLESTYPES OF VARIABLES
TYPES OF VARIABLES
 
Lesson 2 importance of quant r
Lesson 2 importance of quant rLesson 2 importance of quant r
Lesson 2 importance of quant r
 
Lesson 4 Characteristics, Strengths, and Weaknesses of Qualitative Research.pptx
Lesson 4 Characteristics, Strengths, and Weaknesses of Qualitative Research.pptxLesson 4 Characteristics, Strengths, and Weaknesses of Qualitative Research.pptx
Lesson 4 Characteristics, Strengths, and Weaknesses of Qualitative Research.pptx
 
FORMULATING ASSERTIONS
FORMULATING ASSERTIONSFORMULATING ASSERTIONS
FORMULATING ASSERTIONS
 
Agenda
AgendaAgenda
Agenda
 
Quantitative research design
Quantitative research designQuantitative research design
Quantitative research design
 
Nature of Inquiry and Research
Nature of Inquiry and ResearchNature of Inquiry and Research
Nature of Inquiry and Research
 
Practical research 2 charateristics strengths_weaknesses_kinds_tvv
Practical research 2 charateristics strengths_weaknesses_kinds_tvvPractical research 2 charateristics strengths_weaknesses_kinds_tvv
Practical research 2 charateristics strengths_weaknesses_kinds_tvv
 
Practical Research 2 - Lesson Plan on Research Variables.docx
Practical Research 2 - Lesson Plan on Research Variables.docxPractical Research 2 - Lesson Plan on Research Variables.docx
Practical Research 2 - Lesson Plan on Research Variables.docx
 
INQUIRY, INVESTIGATION AND IMMERSION-M1.pptx
INQUIRY, INVESTIGATION AND IMMERSION-M1.pptxINQUIRY, INVESTIGATION AND IMMERSION-M1.pptx
INQUIRY, INVESTIGATION AND IMMERSION-M1.pptx
 
Chapter 4
Chapter 4Chapter 4
Chapter 4
 
NATURE OF RESEARCH AND INQUIRY
NATURE OF RESEARCH AND INQUIRYNATURE OF RESEARCH AND INQUIRY
NATURE OF RESEARCH AND INQUIRY
 
Statistics and probability lesson 4
Statistics and probability lesson 4Statistics and probability lesson 4
Statistics and probability lesson 4
 
Chapter 1 Research
Chapter 1 ResearchChapter 1 Research
Chapter 1 Research
 
Identifying the Inquiry and Stating the Problem
Identifying the Inquiry and Stating the ProblemIdentifying the Inquiry and Stating the Problem
Identifying the Inquiry and Stating the Problem
 
Practical Research 2 - Quantitative Research (Nature of Inquiry & Research)
Practical Research 2 - Quantitative Research (Nature of Inquiry & Research)Practical Research 2 - Quantitative Research (Nature of Inquiry & Research)
Practical Research 2 - Quantitative Research (Nature of Inquiry & Research)
 
Practical Research 1
Practical Research 1Practical Research 1
Practical Research 1
 
Introduction to Capstone Project
Introduction to Capstone ProjectIntroduction to Capstone Project
Introduction to Capstone Project
 
Lesson 1 introduction to quantitative research
Lesson 1 introduction to quantitative researchLesson 1 introduction to quantitative research
Lesson 1 introduction to quantitative research
 

Similar to Lesson 21 designing the questionaire and establishing validity and reliabilty

Unit 2.pptx
Unit 2.pptxUnit 2.pptx
Unit 2.pptx
Samruddhi Chepe
 
Know how of question bank development
Know how of question bank developmentKnow how of question bank development
Know how of question bank development
Manoj Bhatt
 

Similar to Lesson 21 designing the questionaire and establishing validity and reliabilty (20)

CRITERIA AND VALIDITY PRESENTATIONS.pptx
CRITERIA AND VALIDITY PRESENTATIONS.pptxCRITERIA AND VALIDITY PRESENTATIONS.pptx
CRITERIA AND VALIDITY PRESENTATIONS.pptx
 
Educational Assessment and Evaluation
Educational Assessment and Evaluation Educational Assessment and Evaluation
Educational Assessment and Evaluation
 
DEVELOPMENT AND EVALUATION OF SCALES/INSTRUMENTS IN PSYCHIATRY
DEVELOPMENT AND EVALUATION OF SCALES/INSTRUMENTS IN PSYCHIATRYDEVELOPMENT AND EVALUATION OF SCALES/INSTRUMENTS IN PSYCHIATRY
DEVELOPMENT AND EVALUATION OF SCALES/INSTRUMENTS IN PSYCHIATRY
 
TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)
 
Assessment in Learning 1-Reporting Lesson 9.pptx
Assessment in Learning 1-Reporting Lesson 9.pptxAssessment in Learning 1-Reporting Lesson 9.pptx
Assessment in Learning 1-Reporting Lesson 9.pptx
 
Usability Testing
Usability TestingUsability Testing
Usability Testing
 
Development of pyschologica test construction
Development of pyschologica test constructionDevelopment of pyschologica test construction
Development of pyschologica test construction
 
tools of research
tools of researchtools of research
tools of research
 
6.tools of research
6.tools of research6.tools of research
6.tools of research
 
Assessment of Learning
Assessment of LearningAssessment of Learning
Assessment of Learning
 
Assessment of Learning
Assessment of LearningAssessment of Learning
Assessment of Learning
 
Unit 2.pptx
Unit 2.pptxUnit 2.pptx
Unit 2.pptx
 
Aiou Code 837
Aiou Code 837Aiou Code 837
Aiou Code 837
 
Measurement & Evaluation pptx
Measurement & Evaluation pptxMeasurement & Evaluation pptx
Measurement & Evaluation pptx
 
Measurement, scaling and sampling
Measurement, scaling and samplingMeasurement, scaling and sampling
Measurement, scaling and sampling
 
Measurement , Attitude Measurement and Scaling
Measurement , Attitude Measurement and ScalingMeasurement , Attitude Measurement and Scaling
Measurement , Attitude Measurement and Scaling
 
Cognitive affective and psychomotor domains
Cognitive affective and psychomotor domainsCognitive affective and psychomotor domains
Cognitive affective and psychomotor domains
 
Test appraisal
Test appraisalTest appraisal
Test appraisal
 
Assessment of Learning Presentation
Assessment of Learning PresentationAssessment of Learning Presentation
Assessment of Learning Presentation
 
Know how of question bank development
Know how of question bank developmentKnow how of question bank development
Know how of question bank development
 

More from mjlobetos

More from mjlobetos (20)

Lesson 32 presenting a research workbook
Lesson 32 presenting a research workbookLesson 32 presenting a research workbook
Lesson 32 presenting a research workbook
 
Lesson 31 presenting the written research report
Lesson 31 presenting the written research reportLesson 31 presenting the written research report
Lesson 31 presenting the written research report
 
Lesson 30 listing references
Lesson 30 listing referencesLesson 30 listing references
Lesson 30 listing references
 
Lesson 29 formualting recommendations
Lesson 29 formualting recommendationsLesson 29 formualting recommendations
Lesson 29 formualting recommendations
 
Lesson 28 drawing logical conclusions from research findings
Lesson 28 drawing logical conclusions from research findingsLesson 28 drawing logical conclusions from research findings
Lesson 28 drawing logical conclusions from research findings
 
Lesson 27 using statistical techniques in analyzing data
Lesson 27 using statistical techniques in analyzing dataLesson 27 using statistical techniques in analyzing data
Lesson 27 using statistical techniques in analyzing data
 
Lesson 26 presenting and interpreting data in tabular and graphical froms
Lesson 26 presenting and interpreting data in tabular and graphical fromsLesson 26 presenting and interpreting data in tabular and graphical froms
Lesson 26 presenting and interpreting data in tabular and graphical froms
 
Lesson 24 testing the hypothesis
Lesson 24 testing the hypothesisLesson 24 testing the hypothesis
Lesson 24 testing the hypothesis
 
Lesson 23 planning data analyses using statistics
Lesson 23 planning data analyses using statisticsLesson 23 planning data analyses using statistics
Lesson 23 planning data analyses using statistics
 
Lesson 20 describing sample size and sampling procedures
Lesson 20 describing sample size and sampling proceduresLesson 20 describing sample size and sampling procedures
Lesson 20 describing sample size and sampling procedures
 
Lesson 19 choosing an appropriate research design
Lesson 19  choosing an appropriate research designLesson 19  choosing an appropriate research design
Lesson 19 choosing an appropriate research design
 
Lesson 18 listing research hypotheses
Lesson 18 listing research hypothesesLesson 18 listing research hypotheses
Lesson 18 listing research hypotheses
 
Lesson 17 defining terms in the study
Lesson 17 defining terms in the studyLesson 17 defining terms in the study
Lesson 17 defining terms in the study
 
Lesson 16 illustrating and explaining conceptual framewok
Lesson 16 illustrating and explaining conceptual framewokLesson 16 illustrating and explaining conceptual framewok
Lesson 16 illustrating and explaining conceptual framewok
 
Lesson 15 following ethical standards in writing literature
Lesson 15 following ethical standards in writing literatureLesson 15 following ethical standards in writing literature
Lesson 15 following ethical standards in writing literature
 
Lesson 14 writing coherent review of literature
Lesson 14 writing coherent review of literatureLesson 14 writing coherent review of literature
Lesson 14 writing coherent review of literature
 
Lesson 13 synthesizing information from relavant literature
Lesson 13 synthesizing information from relavant literatureLesson 13 synthesizing information from relavant literature
Lesson 13 synthesizing information from relavant literature
 
Lesson 11 selecting relevant literature
Lesson 11 selecting relevant literatureLesson 11 selecting relevant literature
Lesson 11 selecting relevant literature
 
Lesson 9 citing benefits and beneficiaries of research study
Lesson 9 citing benefits and beneficiaries of research studyLesson 9 citing benefits and beneficiaries of research study
Lesson 9 citing benefits and beneficiaries of research study
 
Lesson 8 indicating the scope and delimitation
Lesson 8  indicating the scope and delimitationLesson 8  indicating the scope and delimitation
Lesson 8 indicating the scope and delimitation
 

Recently uploaded

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 

Recently uploaded (20)

Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Philosophy of china and it's charactistics
Philosophy of china and it's charactisticsPhilosophy of china and it's charactistics
Philosophy of china and it's charactistics
 
21st_Century_Skills_Framework_Final_Presentation_2.pptx
21st_Century_Skills_Framework_Final_Presentation_2.pptx21st_Century_Skills_Framework_Final_Presentation_2.pptx
21st_Century_Skills_Framework_Final_Presentation_2.pptx
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
Basic Intentional Injuries Health Education
Basic Intentional Injuries Health EducationBasic Intentional Injuries Health Education
Basic Intentional Injuries Health Education
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
Plant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxPlant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptx
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
OSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & SystemsOSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & Systems
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
latest AZ-104 Exam Questions and Answers
latest AZ-104 Exam Questions and Answerslatest AZ-104 Exam Questions and Answers
latest AZ-104 Exam Questions and Answers
 

Lesson 21 designing the questionaire and establishing validity and reliabilty

  • 1. DESIGNING THE QUESTIONAIRE AND ESTABLISHING VALIDITY AND RELIABILITY LESSON 21
  • 2. DESIGNING THE QUESTIONNAIRE A questionnaire is an instrument for collecting data. It consists of a series of questions that respondents provide answers to a research study.
  • 3. Steps in DESIGNING THE QUESTIONNAIRE Step 1 –BACKGROUND ◦ You do a basic research on the background of the chosen variable or construct, choose a construct that you can use to craft the purpose and objective of the questionnaire. ◦ Example of construct are weight, height, age, IQ, Academic Performance. ◦ After identifying the construct, you can easily state the purpose and objective of the questionnaire and the research questions as well; only then can you frame the hypothesis of the study.
  • 4. Steps in DESIGNING THE QUESTIONNAIRE Step 2- QUESTIONNAIRE CONCEPTUALIZATION ◦Choose the responses scale to use. This is how your respondents to answer in your study. You can choose from the following response scales. ◦ Yes/No ◦ Yes/No/Don’t Know ◦ This type of response scale allows the respondent to select only one answer. The don’t know answer is the neutral response.
  • 5. Steps in DESIGNING THE QUESTIONNAIRE Step 2- QUESTIONNAIRE CONCEPTUALIZATION ◦Likert Scale ◦ It is a very popular rating scale used by researchers to measure behaviors and attitudes quantitively. It consist of choices that range from one extreme to another from where respondents choose a degree of their opinions. It the best tool for measuring the level of opinions.
  • 6. Example of Likert scale Frequency of Occurrence Frequency of Use Very frequently Always Frequently Often Occasionally Sometimes Rarely Rarely Very Rarely Never
  • 7. Example of Likert scale Degree of importance Quality Very important Strongly Agree Important Agree Moderately Important Undecided Of little importance Disagree Not important Strongly Disagree
  • 8. Example of Likert scale Level of Satisfaction Agreement Very satisfied Strongly Agree Satisfied Agree Undecided Undecided Unsatisfied Disagree Very unsatisfied Strongly Disagree
  • 9. GUIDELINES IN MAKING QUESTIONS in your QUESTIONNAIRE 1. The questions should be clear, concise and simple using minimum number of words. Avoid lengthy and confusing lay-out. 2. Classify your questions under each statement based on your problem statement. 3. Questions should be consistent within the needs of the study. 4. Avoid sensitive or highly debatable question.
  • 10. TYPES OF QUESTIONS 1. DICHOTOMOUS QUESTIONS ◦This is a Yes/No or Like/Dislike questions where only two (2) choices are provided. Male/Female and Good/bad are also examples of dichotomous choices. ◦2. OPEN-ENDED QUESTIONS ◦ This types of questions usually answers the questions “why”. It allows the respondents to give their ideas and insights on a particular issue. This type of questions gives additional challenge to the researcher who must review each response before assigning codes and analyzing the data.
  • 11. Example 1: What are your favorite movies? (specify their titles)
  • 12. Example 2: What do you like most about your school? (specify their titles)
  • 13. CLOSED QUESTIONS These are called multiple choice questions. These questions may consist of three or more mutually exclusive questions with different categories. Example 1: How often do you watch TV at home? Never……………………………………………………………………………….1 1 or 2 times a week…………………………………………………………..2 3 or 4 times a week……………………………………………………………3 Nearly everyday…………………………………………………………………..4
  • 14. Example 2 What is the highest level of education that your mother has completed? (Please put a check mark (√) on one box only). Elementary School High School College Don’t know
  • 15. RANK-ORDER SCALE QUESTIONS Respondents are asked to rank their choices on each statement or item. Ranking requires that a set of items be ranked in order to compare each item to all other.
  • 16. Example 3: Please rank the following activities in order of importance in your work as senior high school student. (please use “5” as the most important activity. “1”is the least important Importance Ranking a. Doing Homework Activities b. Going to the library c. Using the computer d. Joining academic organizations e. Doing homeworks
  • 17. RATING SCALE QUESTIONS You construct a scale like those examples given for Likert Scale ratings.
  • 18. STEP 3-Establish the Validity of the Questionnaire Validity is traditionally defined as “degree to which a test measures what it claims or purports to be measuring”. A questionnaire undergoes a validation procedure to make sure that it accurately measure what it aims to do. A valid questionnaire helps to collect reliable and accurate data.
  • 19. Kinds of Validity 1. Face Validity- this is a superficial or subjective assessment. The questionnaire appears to measure the construct or variable that the researcher study is supposed to measure. 2. Content Validity- is most often measured by experts or people who are familiar with the construct being measured. The experts are asked to provide feedback on how well each questions measure the variable or construct under study.
  • 20. Kinds of Validity 3. Criterion-related validity ◦This type of validity measures the relationship between a measure and an outcome. ◦Criterion related validity can be further divided into concurrent and predictive validity. ◦4. Concurrent validity ◦ This type of validity measures how well the results of an evaluation or assessment correlate with other assessments measuring the same variables or constructs.
  • 21. Kinds of Validity 5. Predictive validity ◦ This measures how well the results of an assessment can predict a relationship between the construct being measured and future behavior. For example the academic performance of a student in grade 11 math may be predicted by his/her math performance in junior high school. 6. Construct Validity This is concerned with the extent to which a measure is related to other measures as specified in a theory or previous research. It is an experimental demonstration that a test is measuring the construct it claims to be measuring.
  • 22. Step 4: Establishing the Reliability of the Questionnaire Reliability indicates the accuracy or precision of the measuring instrument. It refers to a condition where measurement process yields consistent responses over repeated measurements.
  • 23. Ways to assess the Reliability of the Questionnaire Test-retest reliability ◦This is the simplest method of assessing reliability. The same test or questionnaire is administered twice and correlation between the two sets of scores is computed.
  • 24. Ways to assess the Reliability of the Questionnaire Split-half method. ◦This method is also called equivalent or parallel forms. In this method, two different test covering the same topics are used and the correlation between the two sets of scores is calculated.
  • 25. Ways to assess the Reliability of the Questionnaire Internal Consistency ◦This method is used in assessing reliability of questions measured on an interval or ratio scale. The reliability estimate is based on a single form of test administered on a single occasion. ◦One popular formula to measure internal consistency is called Cronbach’s alpha. ◦This can be computed using manual and electronic computations such as the SPSS. ◦Cronbach’s alpha ranges from 0 (poor) to 1 (perfect reliability). Anything above 0.70 is considered sufficiently reliable.
  • 26. STEP 5. PILOT TESTING OF THE QUESTIONNAIRE Pilot testing a questionnaire is important before you use it to collect data. Through this process, you can identify questions or statements which are not clear to the participants or there might be some problems with the relevance of the questionnaire to the current study.
  • 27. STEP 5. PILOT TESTING OF THE QUESTIONNAIRE After designing the questionnaire, you may find 10-15 people from your target group to pre-test the questionnaires. You design or provide spaces where the testers can freely indicate their remarks. Such remarks are the following: ◦“Delete this statement”. I don’t understand the questions. ◦“revise the question/statement. ◦“retain the questions” ◦The question is too long”
  • 28. STEP 6 REVISE THE QUESTIONNAIRE After identifying the problem areas in your questionnaire, revise the instrument as needed based on the feedback provided during the pre-testing or pilot-testing. The best questionnaire is one that is edited and refined towards producing clear questions arranged logically and in sequential order. The questionnaire should match with the research objectives.

Editor's Notes

  1. To apply this concept in research, you need a questionnaire that is reliable. You need questions that yield consistent scores when asked repeatedly.
  2. To apply this concept in research, you need a questionnaire that is reliable. You need questions that yield consistent scores when asked repeatedly.
  3. To apply this concept in research, you need a questionnaire that is reliable. You need questions that yield consistent scores when asked repeatedly.
  4. To apply this concept in research, you need a questionnaire that is reliable. You need questions that yield consistent scores when asked repeatedly.