0
# 7 Location In The Research Process<br />Formulating<br />Research<br />Questions<br />Appropriate<br />Design<br />Craft...
Measurement II<br />What did we catch?<br />Was it the same as the others?<br />How do we know we caught it?<br />
Properties of Instruments<br />Reliability<br />The stability and consistency of a measure<br />Validity<br />How we know ...
AN INSTRUMENT MUST HAVE RELIABILITY BEFORE IT CAN HAVE VALIDITY!<br />
Reliability<br />The stability and consistency of an instrument<br />Stability<br />Similar results over time<br />Consist...
Stability<br />Measured using test-retest reliability checks<br />A participant completes the test at one point in time<br...
Consistency<br />Internal consistency<br />The items all measure the same core construct<br />Measured using the Cronbach'...
First Question<br />The Juvenile Court Administrator wants to evaluate a new assessment tool to find out if you can tell w...
Validity<br />How we know that our instrument captures what we're interested in<br />Concept translation<br />How well our...
Validity<br />Face Validity<br />Convergent / Concurrent Validity<br />Discriminant Validity<br />Predictive Validity<br />
Face Validity<br />How well an instrument apparently accomplishes concept translation<br />How completely an instrument sa...
Convergent / Concurrent Validity<br />How well an instrument relates to other measures of the same or similar concepts<br ...
Discriminant Validity<br />How well an instrument discriminates between the presence or absence of concept components<br /...
Predictive Validity<br />How well an instrument predicts future events or behavior<br />Useful concepts will predict pheno...
Second Question<br />The DCFS Area Regional Director wants to be able to tell how many future CPS referrals families are l...
Upcoming SlideShare
Loading in...5
×

Lecture 7 measurement ii

502

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
502
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
16
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Lecture 7 measurement ii"

  1. 1. # 7 Location In The Research Process<br />Formulating<br />Research<br />Questions<br />Appropriate<br />Design<br />Craft<br />Knowledge<br />Appropriate<br />Sampling<br />Decisions<br />Previous<br />Research<br />Ensure<br />Research<br />Ethics<br />Data<br />Collection<br />&<br />Management<br />Data<br />Analysis<br />Ongoing<br />Research<br />Interpretation<br />Dissemination<br />
  2. 2. Measurement II<br />What did we catch?<br />Was it the same as the others?<br />How do we know we caught it?<br />
  3. 3. Properties of Instruments<br />Reliability<br />The stability and consistency of a measure<br />Validity<br />How we know that our measure captures what we're interested in<br />
  4. 4. AN INSTRUMENT MUST HAVE RELIABILITY BEFORE IT CAN HAVE VALIDITY!<br />
  5. 5. Reliability<br />The stability and consistency of an instrument<br />Stability<br />Similar results over time<br />Consistency<br />Test items will be consistent with each other<br />Items will be consistent with the overall score on the test<br />
  6. 6. Stability<br />Measured using test-retest reliability checks<br />A participant completes the test at one point in time<br />After a period of time elapses they complete the test again<br />Usually at least 6 weeks<br />Assessed using correlation coefficients<br />Pearson r<br />Spearman <br />
  7. 7. Consistency<br />Internal consistency<br />The items all measure the same core construct<br />Measured using the Cronbach's Alpha Coefficient <br />A form of multiple correlation<br />Measures how much the individual items in a test or scale have in common statistically<br />
  8. 8. First Question<br />The Juvenile Court Administrator wants to evaluate a new assessment tool to find out if you can tell which kids, once released from Detention, will recidivate or not.<br />What is the first thing that must be done to solve your groups research problem?<br />How do you propose to do it?<br />
  9. 9. Validity<br />How we know that our instrument captures what we're interested in<br />Concept translation<br />How well our instrument translates a concept into a variable<br />Validity is reported as correlations of varying complexity<br />
  10. 10. Validity<br />Face Validity<br />Convergent / Concurrent Validity<br />Discriminant Validity<br />Predictive Validity<br />
  11. 11. Face Validity<br />How well an instrument apparently accomplishes concept translation<br />How completely an instrument samples all of the components of a concept<br />Panels of experts<br />In the domain being measured<br />Who have experience with the target<br />
  12. 12. Convergent / Concurrent Validity<br />How well an instrument relates to other measures of the same or similar concepts<br />Compare an instrument with:<br />Other existing instruments<br />Expert opinions<br />Behavioral observations<br />Assessed when the measure is given to subjects<br />
  13. 13. Discriminant Validity<br />How well an instrument discriminates between the presence or absence of concept components<br />An instrument can discriminate between known groups, assessed when the measure is given to subjects<br />
  14. 14. Predictive Validity<br />How well an instrument predicts future events or behavior<br />Useful concepts will predict phenomena<br />Predictive validity assessment - examines how we know that our measure captures what we are interested in<br />Compare the instrument with other predictive factors<br />Test prediction of the measure alone<br />Assessed longitudinally, after the instrument is given to subjects<br />
  15. 15. Second Question<br />The DCFS Area Regional Director wants to be able to tell how many future CPS referrals families are likely to have after their first CPS referral. He devises a questionnaire for the child’s mother to complete.<br />What type of validity is involved in your research problem?<br />What data might you use to address the validity question?<br />
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×