SlideShare a Scribd company logo
DESIGNING THE
QUESTIONAIRE AND
ESTABLISHING VALIDITY
AND RELIABILITY
LESSON 21
DESIGNING THE QUESTIONNAIRE
A questionnaire is an instrument for collecting data. It
consists of a series of questions that respondents provide
answers to a research study.
Steps in DESIGNING THE
QUESTIONNAIRE
Step 1 –BACKGROUND
◦ You do a basic research on the background of the chosen variable
or construct, choose a construct that you can use to craft the
purpose and objective of the questionnaire.
◦ Example of construct are weight, height, age, IQ, Academic
Performance.
◦ After identifying the construct, you can easily state the purpose
and objective of the questionnaire and the research questions as
well; only then can you frame the hypothesis of the study.
Steps in DESIGNING THE
QUESTIONNAIRE
Step 2- QUESTIONNAIRE CONCEPTUALIZATION
◦Choose the responses scale to use. This is how your
respondents to answer in your study. You can choose from the
following response scales.
◦ Yes/No
◦ Yes/No/Don’t Know
◦ This type of response scale allows the respondent to select only one
answer. The don’t know answer is the neutral response.
Steps in DESIGNING THE
QUESTIONNAIRE
Step 2- QUESTIONNAIRE CONCEPTUALIZATION
◦Likert Scale
◦ It is a very popular rating scale used by researchers to measure behaviors
and attitudes quantitively. It consist of choices that range from one extreme
to another from where respondents choose a degree of their opinions. It
the best tool for measuring the level of opinions.
Example of Likert scale
Frequency of Occurrence Frequency of Use
Very frequently Always
Frequently Often
Occasionally Sometimes
Rarely Rarely
Very Rarely Never
Example of Likert scale
Degree of importance Quality
Very important Strongly Agree
Important Agree
Moderately Important Undecided
Of little importance Disagree
Not important Strongly Disagree
Example of Likert scale
Level of Satisfaction Agreement
Very satisfied Strongly Agree
Satisfied Agree
Undecided Undecided
Unsatisfied Disagree
Very unsatisfied Strongly Disagree
GUIDELINES IN MAKING QUESTIONS in
your QUESTIONNAIRE
1. The questions should be clear, concise and simple using
minimum number of words. Avoid lengthy and confusing
lay-out.
2. Classify your questions under each statement based on
your problem statement.
3. Questions should be consistent within the needs of the
study.
4. Avoid sensitive or highly debatable question.
TYPES OF QUESTIONS
1. DICHOTOMOUS QUESTIONS
◦This is a Yes/No or Like/Dislike questions where only two (2)
choices are provided. Male/Female and Good/bad are also
examples of dichotomous choices.
◦2. OPEN-ENDED QUESTIONS
◦ This types of questions usually answers the questions “why”. It allows
the respondents to give their ideas and insights on a particular issue.
This type of questions gives additional challenge to the researcher
who must review each response before assigning codes and analyzing
the data.
Example 1: What are your favorite
movies? (specify their titles)
Example 2: What do you like most about
your school? (specify their titles)
CLOSED QUESTIONS
These are called multiple choice questions. These questions may
consist of three or more mutually exclusive questions with
different categories.
Example 1: How often do you watch TV at home?
Never……………………………………………………………………………….1
1 or 2 times a week…………………………………………………………..2
3 or 4 times a week……………………………………………………………3
Nearly everyday…………………………………………………………………..4
Example 2
What is the highest level of education that your mother has
completed? (Please put a check mark (√) on one box only).
Elementary School
High School
College
Don’t know
RANK-ORDER SCALE QUESTIONS
Respondents are asked to rank their choices on each
statement or item.
Ranking requires that a set of items be ranked in order to
compare each item to all other.
Example 3: Please rank the following activities in order of
importance in your work as senior high school student.
(please use “5” as the most important activity. “1”is the least
important
Importance Ranking
a. Doing Homework Activities
b. Going to the library
c. Using the computer
d. Joining academic organizations
e. Doing homeworks
RATING SCALE QUESTIONS
You construct a scale like those examples given for Likert
Scale ratings.
STEP 3-Establish the Validity of the
Questionnaire
Validity is traditionally defined as “degree to which a test measures
what it claims or purports to be measuring”.
A questionnaire undergoes a validation procedure to make sure that
it accurately measure what it aims to do. A valid questionnaire helps
to collect reliable and accurate data.
Kinds of Validity
1. Face Validity- this is a superficial or subjective
assessment. The questionnaire appears to measure the
construct or variable that the researcher study is supposed
to measure.
2. Content Validity- is most often measured by experts or
people who are familiar with the construct being measured.
The experts are asked to provide feedback on how well each
questions measure the variable or construct under study.
Kinds of Validity
3. Criterion-related validity
◦This type of validity measures the relationship between a
measure and an outcome.
◦Criterion related validity can be further divided into
concurrent and predictive validity.
◦4. Concurrent validity
◦ This type of validity measures how well the results of an evaluation or
assessment correlate with other assessments measuring the same
variables or constructs.
Kinds of Validity
5. Predictive validity
◦ This measures how well the results of an assessment can predict a
relationship between the construct being measured and future
behavior. For example the academic performance of a student in grade
11 math may be predicted by his/her math performance in junior high
school.
6. Construct Validity
This is concerned with the extent to which a measure is related to
other measures as specified in a theory or previous research. It is an
experimental demonstration that a test is measuring the construct it
claims to be measuring.
Step 4: Establishing the Reliability of the
Questionnaire
Reliability indicates the accuracy or precision of the
measuring instrument. It refers to a condition where
measurement process yields consistent responses
over repeated measurements.
Ways to assess the Reliability of the
Questionnaire
Test-retest reliability
◦This is the simplest method of assessing reliability. The
same test or questionnaire is administered twice and
correlation between the two sets of scores is
computed.
Ways to assess the Reliability of the
Questionnaire
Split-half method.
◦This method is also called equivalent or parallel
forms. In this method, two different test covering
the same topics are used and the correlation
between the two sets of scores is calculated.
Ways to assess the Reliability of the
Questionnaire
Internal Consistency
◦This method is used in assessing reliability of questions measured
on an interval or ratio scale. The reliability estimate is based on a
single form of test administered on a single occasion.
◦One popular formula to measure internal consistency is called
Cronbach’s alpha.
◦This can be computed using manual and electronic computations
such as the SPSS.
◦Cronbach’s alpha ranges from 0 (poor) to 1 (perfect reliability).
Anything above 0.70 is considered sufficiently reliable.
STEP 5. PILOT TESTING OF THE
QUESTIONNAIRE
Pilot testing a questionnaire is important before you use it to collect
data. Through this process, you can identify questions or statements
which are not clear to the participants or there might be some
problems with the relevance of the questionnaire to the current study.
STEP 5. PILOT TESTING OF THE
QUESTIONNAIRE
After designing the questionnaire, you may find 10-15 people from
your target group to pre-test the questionnaires. You design or provide
spaces where the testers can freely indicate their remarks.
Such remarks are the following:
◦“Delete this statement”. I don’t understand the questions.
◦“revise the question/statement.
◦“retain the questions”
◦The question is too long”
STEP 6 REVISE THE QUESTIONNAIRE
After identifying the problem areas in your questionnaire,
revise the instrument as needed based on the feedback
provided during the pre-testing or pilot-testing.
The best questionnaire is one that is edited and refined
towards producing clear questions arranged logically and in
sequential order.
The questionnaire should match with the research
objectives.
Lesson 21 designing the questionaire and establishing validity and reliabilty

More Related Content

What's hot

Lesson 20 describing sample size and sampling procedures
Lesson 20 describing sample size and sampling proceduresLesson 20 describing sample size and sampling procedures
Lesson 20 describing sample size and sampling procedures
mjlobetos
 
Scope and Limitations.pptx
Scope and Limitations.pptxScope and Limitations.pptx
Scope and Limitations.pptx
JPAballe
 
Lesson 23 planning data analyses using statistics
Lesson 23 planning data analyses using statisticsLesson 23 planning data analyses using statistics
Lesson 23 planning data analyses using statistics
mjlobetos
 
Statistics and probability lesson 1
Statistics and probability lesson 1Statistics and probability lesson 1
Statistics and probability lesson 1
MARIA CHRISTITA POLINAG
 
PRACTICAL RESEARCH 1.pptx
PRACTICAL RESEARCH 1.pptxPRACTICAL RESEARCH 1.pptx
PRACTICAL RESEARCH 1.pptx
EdithaBallesteros3
 
Lesson 17 defining terms in the study
Lesson 17 defining terms in the studyLesson 17 defining terms in the study
Lesson 17 defining terms in the study
mjlobetos
 
Practical Research 2 Chapter 3: Common Statistical Tools
 Practical Research 2 Chapter 3: Common Statistical Tools Practical Research 2 Chapter 3: Common Statistical Tools
Practical Research 2 Chapter 3: Common Statistical Tools
DaianMoreno1
 
Lesson 19 choosing an appropriate research design
Lesson 19  choosing an appropriate research designLesson 19  choosing an appropriate research design
Lesson 19 choosing an appropriate research design
mjlobetos
 
Chapter 1 Research
Chapter 1 ResearchChapter 1 Research
Chapter 1 Research
Monte Christo
 
TYPES OF RESEARCH
TYPES OF RESEARCHTYPES OF RESEARCH
TYPES OF RESEARCH
Jimnaira Abanto
 
module 1.pptx
module 1.pptxmodule 1.pptx
module 1.pptx
JhonEguna
 
Chapter 1 Research
Chapter 1 ResearchChapter 1 Research
Chapter 1 Research
Jimnaira Abanto
 
Designs a Research Used in Daily Life.pptx
Designs a Research Used in Daily Life.pptxDesigns a Research Used in Daily Life.pptx
Designs a Research Used in Daily Life.pptx
MaryJoySalas1
 
Practical research 2 charateristics strengths_weaknesses_kinds_tvv
Practical research 2 charateristics strengths_weaknesses_kinds_tvvPractical research 2 charateristics strengths_weaknesses_kinds_tvv
Practical research 2 charateristics strengths_weaknesses_kinds_tvv
school
 
Writing the research title
Writing the research titleWriting the research title
Writing the research title
school
 
Lesson 2 importance of quant r
Lesson 2 importance of quant rLesson 2 importance of quant r
Lesson 2 importance of quant r
mjlobetos
 
Nature of inquiry and research
Nature of inquiry and researchNature of inquiry and research
Nature of inquiry and research
Department of Education
 
Lesson 4 Characteristics, Strengths, and Weaknesses of Qualitative Research.pptx
Lesson 4 Characteristics, Strengths, and Weaknesses of Qualitative Research.pptxLesson 4 Characteristics, Strengths, and Weaknesses of Qualitative Research.pptx
Lesson 4 Characteristics, Strengths, and Weaknesses of Qualitative Research.pptx
Aiza Santos
 
Lesson 28 drawing logical conclusions from research findings
Lesson 28 drawing logical conclusions from research findingsLesson 28 drawing logical conclusions from research findings
Lesson 28 drawing logical conclusions from research findings
mjlobetos
 
Lesson 1 practical research 1
Lesson 1 practical research 1Lesson 1 practical research 1
Lesson 1 practical research 1
Melody01082019
 

What's hot (20)

Lesson 20 describing sample size and sampling procedures
Lesson 20 describing sample size and sampling proceduresLesson 20 describing sample size and sampling procedures
Lesson 20 describing sample size and sampling procedures
 
Scope and Limitations.pptx
Scope and Limitations.pptxScope and Limitations.pptx
Scope and Limitations.pptx
 
Lesson 23 planning data analyses using statistics
Lesson 23 planning data analyses using statisticsLesson 23 planning data analyses using statistics
Lesson 23 planning data analyses using statistics
 
Statistics and probability lesson 1
Statistics and probability lesson 1Statistics and probability lesson 1
Statistics and probability lesson 1
 
PRACTICAL RESEARCH 1.pptx
PRACTICAL RESEARCH 1.pptxPRACTICAL RESEARCH 1.pptx
PRACTICAL RESEARCH 1.pptx
 
Lesson 17 defining terms in the study
Lesson 17 defining terms in the studyLesson 17 defining terms in the study
Lesson 17 defining terms in the study
 
Practical Research 2 Chapter 3: Common Statistical Tools
 Practical Research 2 Chapter 3: Common Statistical Tools Practical Research 2 Chapter 3: Common Statistical Tools
Practical Research 2 Chapter 3: Common Statistical Tools
 
Lesson 19 choosing an appropriate research design
Lesson 19  choosing an appropriate research designLesson 19  choosing an appropriate research design
Lesson 19 choosing an appropriate research design
 
Chapter 1 Research
Chapter 1 ResearchChapter 1 Research
Chapter 1 Research
 
TYPES OF RESEARCH
TYPES OF RESEARCHTYPES OF RESEARCH
TYPES OF RESEARCH
 
module 1.pptx
module 1.pptxmodule 1.pptx
module 1.pptx
 
Chapter 1 Research
Chapter 1 ResearchChapter 1 Research
Chapter 1 Research
 
Designs a Research Used in Daily Life.pptx
Designs a Research Used in Daily Life.pptxDesigns a Research Used in Daily Life.pptx
Designs a Research Used in Daily Life.pptx
 
Practical research 2 charateristics strengths_weaknesses_kinds_tvv
Practical research 2 charateristics strengths_weaknesses_kinds_tvvPractical research 2 charateristics strengths_weaknesses_kinds_tvv
Practical research 2 charateristics strengths_weaknesses_kinds_tvv
 
Writing the research title
Writing the research titleWriting the research title
Writing the research title
 
Lesson 2 importance of quant r
Lesson 2 importance of quant rLesson 2 importance of quant r
Lesson 2 importance of quant r
 
Nature of inquiry and research
Nature of inquiry and researchNature of inquiry and research
Nature of inquiry and research
 
Lesson 4 Characteristics, Strengths, and Weaknesses of Qualitative Research.pptx
Lesson 4 Characteristics, Strengths, and Weaknesses of Qualitative Research.pptxLesson 4 Characteristics, Strengths, and Weaknesses of Qualitative Research.pptx
Lesson 4 Characteristics, Strengths, and Weaknesses of Qualitative Research.pptx
 
Lesson 28 drawing logical conclusions from research findings
Lesson 28 drawing logical conclusions from research findingsLesson 28 drawing logical conclusions from research findings
Lesson 28 drawing logical conclusions from research findings
 
Lesson 1 practical research 1
Lesson 1 practical research 1Lesson 1 practical research 1
Lesson 1 practical research 1
 

Similar to Lesson 21 designing the questionaire and establishing validity and reliabilty

CRITERIA AND VALIDITY PRESENTATIONS.pptx
CRITERIA AND VALIDITY PRESENTATIONS.pptxCRITERIA AND VALIDITY PRESENTATIONS.pptx
CRITERIA AND VALIDITY PRESENTATIONS.pptx
MammeNkwelle
 
Educational Assessment and Evaluation
Educational Assessment and Evaluation Educational Assessment and Evaluation
Educational Assessment and Evaluation
HennaAnsari
 
DEVELOPMENT AND EVALUATION OF SCALES/INSTRUMENTS IN PSYCHIATRY
DEVELOPMENT AND EVALUATION OF SCALES/INSTRUMENTS IN PSYCHIATRYDEVELOPMENT AND EVALUATION OF SCALES/INSTRUMENTS IN PSYCHIATRY
DEVELOPMENT AND EVALUATION OF SCALES/INSTRUMENTS IN PSYCHIATRY
Pawan Sharma
 
TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)
HennaAnsari
 
Assessment in Learning 1-Reporting Lesson 9.pptx
Assessment in Learning 1-Reporting Lesson 9.pptxAssessment in Learning 1-Reporting Lesson 9.pptx
Assessment in Learning 1-Reporting Lesson 9.pptx
AlfranDaveAmpoyos
 
Usability Testing
Usability TestingUsability Testing
Usability Testing
mbrosset
 
Development of pyschologica test construction
Development of pyschologica test constructionDevelopment of pyschologica test construction
Development of pyschologica test construction
Kiran Dammani
 
Assessment of Learning
Assessment of LearningAssessment of Learning
Assessment of Learning
JanMacLoydAballe
 
Assessment of Learning
Assessment of LearningAssessment of Learning
Assessment of Learning
jesselmaeugmad
 
Unit 2.pptx
Unit 2.pptxUnit 2.pptx
Unit 2.pptx
Samruddhi Chepe
 
Aiou Code 837
Aiou Code 837Aiou Code 837
Aiou Code 837
Zahid Mehmood
 
Measurement & Evaluation pptx
Measurement & Evaluation pptxMeasurement & Evaluation pptx
Measurement & Evaluation pptx
Aliimtiaz35
 
Measurement, scaling and sampling
Measurement, scaling and samplingMeasurement, scaling and sampling
Measurement, scaling and sampling
RajThakuri
 
Measurement , Attitude Measurement and Scaling
Measurement , Attitude Measurement and ScalingMeasurement , Attitude Measurement and Scaling
Measurement , Attitude Measurement and Scaling
Bibek Regmi
 
Cognitive affective and psychomotor domains
Cognitive affective and psychomotor domainsCognitive affective and psychomotor domains
Cognitive affective and psychomotor domains
benetalokesh
 
Test appraisal
Test appraisalTest appraisal
Test appraisal
AbdullahMir3
 
Assessment of Learning Presentation
Assessment of Learning PresentationAssessment of Learning Presentation
Assessment of Learning Presentation
Nahla Tero
 
Know how of question bank development
Know how of question bank developmentKnow how of question bank development
Know how of question bank developmentManoj Bhatt
 

Similar to Lesson 21 designing the questionaire and establishing validity and reliabilty (20)

CRITERIA AND VALIDITY PRESENTATIONS.pptx
CRITERIA AND VALIDITY PRESENTATIONS.pptxCRITERIA AND VALIDITY PRESENTATIONS.pptx
CRITERIA AND VALIDITY PRESENTATIONS.pptx
 
Educational Assessment and Evaluation
Educational Assessment and Evaluation Educational Assessment and Evaluation
Educational Assessment and Evaluation
 
DEVELOPMENT AND EVALUATION OF SCALES/INSTRUMENTS IN PSYCHIATRY
DEVELOPMENT AND EVALUATION OF SCALES/INSTRUMENTS IN PSYCHIATRYDEVELOPMENT AND EVALUATION OF SCALES/INSTRUMENTS IN PSYCHIATRY
DEVELOPMENT AND EVALUATION OF SCALES/INSTRUMENTS IN PSYCHIATRY
 
TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)
 
Assessment in Learning 1-Reporting Lesson 9.pptx
Assessment in Learning 1-Reporting Lesson 9.pptxAssessment in Learning 1-Reporting Lesson 9.pptx
Assessment in Learning 1-Reporting Lesson 9.pptx
 
Usability Testing
Usability TestingUsability Testing
Usability Testing
 
Development of pyschologica test construction
Development of pyschologica test constructionDevelopment of pyschologica test construction
Development of pyschologica test construction
 
tools of research
tools of researchtools of research
tools of research
 
6.tools of research
6.tools of research6.tools of research
6.tools of research
 
Assessment of Learning
Assessment of LearningAssessment of Learning
Assessment of Learning
 
Assessment of Learning
Assessment of LearningAssessment of Learning
Assessment of Learning
 
Unit 2.pptx
Unit 2.pptxUnit 2.pptx
Unit 2.pptx
 
Aiou Code 837
Aiou Code 837Aiou Code 837
Aiou Code 837
 
Measurement & Evaluation pptx
Measurement & Evaluation pptxMeasurement & Evaluation pptx
Measurement & Evaluation pptx
 
Measurement, scaling and sampling
Measurement, scaling and samplingMeasurement, scaling and sampling
Measurement, scaling and sampling
 
Measurement , Attitude Measurement and Scaling
Measurement , Attitude Measurement and ScalingMeasurement , Attitude Measurement and Scaling
Measurement , Attitude Measurement and Scaling
 
Cognitive affective and psychomotor domains
Cognitive affective and psychomotor domainsCognitive affective and psychomotor domains
Cognitive affective and psychomotor domains
 
Test appraisal
Test appraisalTest appraisal
Test appraisal
 
Assessment of Learning Presentation
Assessment of Learning PresentationAssessment of Learning Presentation
Assessment of Learning Presentation
 
Know how of question bank development
Know how of question bank developmentKnow how of question bank development
Know how of question bank development
 

More from mjlobetos

Lesson 32 presenting a research workbook
Lesson 32 presenting a research workbookLesson 32 presenting a research workbook
Lesson 32 presenting a research workbook
mjlobetos
 
Lesson 31 presenting the written research report
Lesson 31 presenting the written research reportLesson 31 presenting the written research report
Lesson 31 presenting the written research report
mjlobetos
 
Lesson 30 listing references
Lesson 30 listing referencesLesson 30 listing references
Lesson 30 listing references
mjlobetos
 
Lesson 29 formualting recommendations
Lesson 29 formualting recommendationsLesson 29 formualting recommendations
Lesson 29 formualting recommendations
mjlobetos
 
Lesson 27 using statistical techniques in analyzing data
Lesson 27 using statistical techniques in analyzing dataLesson 27 using statistical techniques in analyzing data
Lesson 27 using statistical techniques in analyzing data
mjlobetos
 
Lesson 26 presenting and interpreting data in tabular and graphical froms
Lesson 26 presenting and interpreting data in tabular and graphical fromsLesson 26 presenting and interpreting data in tabular and graphical froms
Lesson 26 presenting and interpreting data in tabular and graphical froms
mjlobetos
 
Lesson 24 testing the hypothesis
Lesson 24 testing the hypothesisLesson 24 testing the hypothesis
Lesson 24 testing the hypothesis
mjlobetos
 
Lesson 18 listing research hypotheses
Lesson 18 listing research hypothesesLesson 18 listing research hypotheses
Lesson 18 listing research hypotheses
mjlobetos
 
Lesson 16 illustrating and explaining conceptual framewok
Lesson 16 illustrating and explaining conceptual framewokLesson 16 illustrating and explaining conceptual framewok
Lesson 16 illustrating and explaining conceptual framewok
mjlobetos
 
Lesson 15 following ethical standards in writing literature
Lesson 15 following ethical standards in writing literatureLesson 15 following ethical standards in writing literature
Lesson 15 following ethical standards in writing literature
mjlobetos
 
Lesson 14 writing coherent review of literature
Lesson 14 writing coherent review of literatureLesson 14 writing coherent review of literature
Lesson 14 writing coherent review of literature
mjlobetos
 
Lesson 13 synthesizing information from relavant literature
Lesson 13 synthesizing information from relavant literatureLesson 13 synthesizing information from relavant literature
Lesson 13 synthesizing information from relavant literature
mjlobetos
 
Lesson 12 citing related literature using standard styles
Lesson 12 citing related literature using standard stylesLesson 12 citing related literature using standard styles
Lesson 12 citing related literature using standard styles
mjlobetos
 
Lesson 11 selecting relevant literature
Lesson 11 selecting relevant literatureLesson 11 selecting relevant literature
Lesson 11 selecting relevant literature
mjlobetos
 
Lesson 9 citing benefits and beneficiaries of research study
Lesson 9 citing benefits and beneficiaries of research studyLesson 9 citing benefits and beneficiaries of research study
Lesson 9 citing benefits and beneficiaries of research study
mjlobetos
 
Lesson 8 indicating the scope and delimitation
Lesson 8  indicating the scope and delimitationLesson 8  indicating the scope and delimitation
Lesson 8 indicating the scope and delimitation
mjlobetos
 
Lesson 5 writing a research title
Lesson 5 writing a research titleLesson 5 writing a research title
Lesson 5 writing a research title
mjlobetos
 
Lesson 4 designing a research usefu; in daily life
Lesson 4 designing a research usefu; in daily lifeLesson 4 designing a research usefu; in daily life
Lesson 4 designing a research usefu; in daily life
mjlobetos
 
Lesson 1 charcteristics of quant r
Lesson 1 charcteristics of quant rLesson 1 charcteristics of quant r
Lesson 1 charcteristics of quant r
mjlobetos
 

More from mjlobetos (19)

Lesson 32 presenting a research workbook
Lesson 32 presenting a research workbookLesson 32 presenting a research workbook
Lesson 32 presenting a research workbook
 
Lesson 31 presenting the written research report
Lesson 31 presenting the written research reportLesson 31 presenting the written research report
Lesson 31 presenting the written research report
 
Lesson 30 listing references
Lesson 30 listing referencesLesson 30 listing references
Lesson 30 listing references
 
Lesson 29 formualting recommendations
Lesson 29 formualting recommendationsLesson 29 formualting recommendations
Lesson 29 formualting recommendations
 
Lesson 27 using statistical techniques in analyzing data
Lesson 27 using statistical techniques in analyzing dataLesson 27 using statistical techniques in analyzing data
Lesson 27 using statistical techniques in analyzing data
 
Lesson 26 presenting and interpreting data in tabular and graphical froms
Lesson 26 presenting and interpreting data in tabular and graphical fromsLesson 26 presenting and interpreting data in tabular and graphical froms
Lesson 26 presenting and interpreting data in tabular and graphical froms
 
Lesson 24 testing the hypothesis
Lesson 24 testing the hypothesisLesson 24 testing the hypothesis
Lesson 24 testing the hypothesis
 
Lesson 18 listing research hypotheses
Lesson 18 listing research hypothesesLesson 18 listing research hypotheses
Lesson 18 listing research hypotheses
 
Lesson 16 illustrating and explaining conceptual framewok
Lesson 16 illustrating and explaining conceptual framewokLesson 16 illustrating and explaining conceptual framewok
Lesson 16 illustrating and explaining conceptual framewok
 
Lesson 15 following ethical standards in writing literature
Lesson 15 following ethical standards in writing literatureLesson 15 following ethical standards in writing literature
Lesson 15 following ethical standards in writing literature
 
Lesson 14 writing coherent review of literature
Lesson 14 writing coherent review of literatureLesson 14 writing coherent review of literature
Lesson 14 writing coherent review of literature
 
Lesson 13 synthesizing information from relavant literature
Lesson 13 synthesizing information from relavant literatureLesson 13 synthesizing information from relavant literature
Lesson 13 synthesizing information from relavant literature
 
Lesson 12 citing related literature using standard styles
Lesson 12 citing related literature using standard stylesLesson 12 citing related literature using standard styles
Lesson 12 citing related literature using standard styles
 
Lesson 11 selecting relevant literature
Lesson 11 selecting relevant literatureLesson 11 selecting relevant literature
Lesson 11 selecting relevant literature
 
Lesson 9 citing benefits and beneficiaries of research study
Lesson 9 citing benefits and beneficiaries of research studyLesson 9 citing benefits and beneficiaries of research study
Lesson 9 citing benefits and beneficiaries of research study
 
Lesson 8 indicating the scope and delimitation
Lesson 8  indicating the scope and delimitationLesson 8  indicating the scope and delimitation
Lesson 8 indicating the scope and delimitation
 
Lesson 5 writing a research title
Lesson 5 writing a research titleLesson 5 writing a research title
Lesson 5 writing a research title
 
Lesson 4 designing a research usefu; in daily life
Lesson 4 designing a research usefu; in daily lifeLesson 4 designing a research usefu; in daily life
Lesson 4 designing a research usefu; in daily life
 
Lesson 1 charcteristics of quant r
Lesson 1 charcteristics of quant rLesson 1 charcteristics of quant r
Lesson 1 charcteristics of quant r
 

Recently uploaded

Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......
Ashokrao Mane college of Pharmacy Peth-Vadgaon
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
Pavel ( NSTU)
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
bennyroshan06
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
BhavyaRajput3
 
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup   New Member Orientation and Q&A (May 2024).pdfWelcome to TechSoup   New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
TechSoup
 
The Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve ThomasonThe Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve Thomason
Steve Thomason
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
joachimlavalley1
 
How to Break the cycle of negative Thoughts
How to Break the cycle of negative ThoughtsHow to Break the cycle of negative Thoughts
How to Break the cycle of negative Thoughts
Col Mukteshwar Prasad
 
The Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdfThe Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdf
kaushalkr1407
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
Sandy Millin
 
Sectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdfSectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdf
Vivekanand Anglo Vedic Academy
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
Jisc
 
Introduction to Quality Improvement Essentials
Introduction to Quality Improvement EssentialsIntroduction to Quality Improvement Essentials
Introduction to Quality Improvement Essentials
Excellence Foundation for South Sudan
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
MIRIAMSALINAS13
 
How to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS ModuleHow to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS Module
Celine George
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
Vivekanand Anglo Vedic Academy
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
Atul Kumar Singh
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
Thiyagu K
 
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptxStudents, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
EduSkills OECD
 

Recently uploaded (20)

Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
 
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup   New Member Orientation and Q&A (May 2024).pdfWelcome to TechSoup   New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
 
The Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve ThomasonThe Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve Thomason
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
 
Additional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdfAdditional Benefits for Employee Website.pdf
Additional Benefits for Employee Website.pdf
 
How to Break the cycle of negative Thoughts
How to Break the cycle of negative ThoughtsHow to Break the cycle of negative Thoughts
How to Break the cycle of negative Thoughts
 
The Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdfThe Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdf
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
 
Sectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdfSectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdf
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
 
Introduction to Quality Improvement Essentials
Introduction to Quality Improvement EssentialsIntroduction to Quality Improvement Essentials
Introduction to Quality Improvement Essentials
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
 
How to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS ModuleHow to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS Module
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
 
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptxStudents, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptx
 

Lesson 21 designing the questionaire and establishing validity and reliabilty

  • 1. DESIGNING THE QUESTIONAIRE AND ESTABLISHING VALIDITY AND RELIABILITY LESSON 21
  • 2. DESIGNING THE QUESTIONNAIRE A questionnaire is an instrument for collecting data. It consists of a series of questions that respondents provide answers to a research study.
  • 3. Steps in DESIGNING THE QUESTIONNAIRE Step 1 –BACKGROUND ◦ You do a basic research on the background of the chosen variable or construct, choose a construct that you can use to craft the purpose and objective of the questionnaire. ◦ Example of construct are weight, height, age, IQ, Academic Performance. ◦ After identifying the construct, you can easily state the purpose and objective of the questionnaire and the research questions as well; only then can you frame the hypothesis of the study.
  • 4. Steps in DESIGNING THE QUESTIONNAIRE Step 2- QUESTIONNAIRE CONCEPTUALIZATION ◦Choose the responses scale to use. This is how your respondents to answer in your study. You can choose from the following response scales. ◦ Yes/No ◦ Yes/No/Don’t Know ◦ This type of response scale allows the respondent to select only one answer. The don’t know answer is the neutral response.
  • 5. Steps in DESIGNING THE QUESTIONNAIRE Step 2- QUESTIONNAIRE CONCEPTUALIZATION ◦Likert Scale ◦ It is a very popular rating scale used by researchers to measure behaviors and attitudes quantitively. It consist of choices that range from one extreme to another from where respondents choose a degree of their opinions. It the best tool for measuring the level of opinions.
  • 6. Example of Likert scale Frequency of Occurrence Frequency of Use Very frequently Always Frequently Often Occasionally Sometimes Rarely Rarely Very Rarely Never
  • 7. Example of Likert scale Degree of importance Quality Very important Strongly Agree Important Agree Moderately Important Undecided Of little importance Disagree Not important Strongly Disagree
  • 8. Example of Likert scale Level of Satisfaction Agreement Very satisfied Strongly Agree Satisfied Agree Undecided Undecided Unsatisfied Disagree Very unsatisfied Strongly Disagree
  • 9. GUIDELINES IN MAKING QUESTIONS in your QUESTIONNAIRE 1. The questions should be clear, concise and simple using minimum number of words. Avoid lengthy and confusing lay-out. 2. Classify your questions under each statement based on your problem statement. 3. Questions should be consistent within the needs of the study. 4. Avoid sensitive or highly debatable question.
  • 10. TYPES OF QUESTIONS 1. DICHOTOMOUS QUESTIONS ◦This is a Yes/No or Like/Dislike questions where only two (2) choices are provided. Male/Female and Good/bad are also examples of dichotomous choices. ◦2. OPEN-ENDED QUESTIONS ◦ This types of questions usually answers the questions “why”. It allows the respondents to give their ideas and insights on a particular issue. This type of questions gives additional challenge to the researcher who must review each response before assigning codes and analyzing the data.
  • 11. Example 1: What are your favorite movies? (specify their titles)
  • 12. Example 2: What do you like most about your school? (specify their titles)
  • 13. CLOSED QUESTIONS These are called multiple choice questions. These questions may consist of three or more mutually exclusive questions with different categories. Example 1: How often do you watch TV at home? Never……………………………………………………………………………….1 1 or 2 times a week…………………………………………………………..2 3 or 4 times a week……………………………………………………………3 Nearly everyday…………………………………………………………………..4
  • 14. Example 2 What is the highest level of education that your mother has completed? (Please put a check mark (√) on one box only). Elementary School High School College Don’t know
  • 15. RANK-ORDER SCALE QUESTIONS Respondents are asked to rank their choices on each statement or item. Ranking requires that a set of items be ranked in order to compare each item to all other.
  • 16. Example 3: Please rank the following activities in order of importance in your work as senior high school student. (please use “5” as the most important activity. “1”is the least important Importance Ranking a. Doing Homework Activities b. Going to the library c. Using the computer d. Joining academic organizations e. Doing homeworks
  • 17. RATING SCALE QUESTIONS You construct a scale like those examples given for Likert Scale ratings.
  • 18. STEP 3-Establish the Validity of the Questionnaire Validity is traditionally defined as “degree to which a test measures what it claims or purports to be measuring”. A questionnaire undergoes a validation procedure to make sure that it accurately measure what it aims to do. A valid questionnaire helps to collect reliable and accurate data.
  • 19. Kinds of Validity 1. Face Validity- this is a superficial or subjective assessment. The questionnaire appears to measure the construct or variable that the researcher study is supposed to measure. 2. Content Validity- is most often measured by experts or people who are familiar with the construct being measured. The experts are asked to provide feedback on how well each questions measure the variable or construct under study.
  • 20. Kinds of Validity 3. Criterion-related validity ◦This type of validity measures the relationship between a measure and an outcome. ◦Criterion related validity can be further divided into concurrent and predictive validity. ◦4. Concurrent validity ◦ This type of validity measures how well the results of an evaluation or assessment correlate with other assessments measuring the same variables or constructs.
  • 21. Kinds of Validity 5. Predictive validity ◦ This measures how well the results of an assessment can predict a relationship between the construct being measured and future behavior. For example the academic performance of a student in grade 11 math may be predicted by his/her math performance in junior high school. 6. Construct Validity This is concerned with the extent to which a measure is related to other measures as specified in a theory or previous research. It is an experimental demonstration that a test is measuring the construct it claims to be measuring.
  • 22. Step 4: Establishing the Reliability of the Questionnaire Reliability indicates the accuracy or precision of the measuring instrument. It refers to a condition where measurement process yields consistent responses over repeated measurements.
  • 23. Ways to assess the Reliability of the Questionnaire Test-retest reliability ◦This is the simplest method of assessing reliability. The same test or questionnaire is administered twice and correlation between the two sets of scores is computed.
  • 24. Ways to assess the Reliability of the Questionnaire Split-half method. ◦This method is also called equivalent or parallel forms. In this method, two different test covering the same topics are used and the correlation between the two sets of scores is calculated.
  • 25. Ways to assess the Reliability of the Questionnaire Internal Consistency ◦This method is used in assessing reliability of questions measured on an interval or ratio scale. The reliability estimate is based on a single form of test administered on a single occasion. ◦One popular formula to measure internal consistency is called Cronbach’s alpha. ◦This can be computed using manual and electronic computations such as the SPSS. ◦Cronbach’s alpha ranges from 0 (poor) to 1 (perfect reliability). Anything above 0.70 is considered sufficiently reliable.
  • 26. STEP 5. PILOT TESTING OF THE QUESTIONNAIRE Pilot testing a questionnaire is important before you use it to collect data. Through this process, you can identify questions or statements which are not clear to the participants or there might be some problems with the relevance of the questionnaire to the current study.
  • 27. STEP 5. PILOT TESTING OF THE QUESTIONNAIRE After designing the questionnaire, you may find 10-15 people from your target group to pre-test the questionnaires. You design or provide spaces where the testers can freely indicate their remarks. Such remarks are the following: ◦“Delete this statement”. I don’t understand the questions. ◦“revise the question/statement. ◦“retain the questions” ◦The question is too long”
  • 28. STEP 6 REVISE THE QUESTIONNAIRE After identifying the problem areas in your questionnaire, revise the instrument as needed based on the feedback provided during the pre-testing or pilot-testing. The best questionnaire is one that is edited and refined towards producing clear questions arranged logically and in sequential order. The questionnaire should match with the research objectives.

Editor's Notes

  1. To apply this concept in research, you need a questionnaire that is reliable. You need questions that yield consistent scores when asked repeatedly.
  2. To apply this concept in research, you need a questionnaire that is reliable. You need questions that yield consistent scores when asked repeatedly.
  3. To apply this concept in research, you need a questionnaire that is reliable. You need questions that yield consistent scores when asked repeatedly.
  4. To apply this concept in research, you need a questionnaire that is reliable. You need questions that yield consistent scores when asked repeatedly.