Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Presentation Validity & Reliability

163,514 views

Published on

Published in: Education, Technology, Business
  • DOWNLOAD THIS BOOKS INTO AVAILABLE FORMAT (2019 Update) ......................................................................................................................... ......................................................................................................................... Download Full PDF EBOOK here { https://soo.gd/irt2 } ......................................................................................................................... Download Full EPUB Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download Full doc Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download PDF EBOOK here { https://soo.gd/irt2 } ......................................................................................................................... Download EPUB Ebook here { https://soo.gd/irt2 } ......................................................................................................................... Download doc Ebook here { https://soo.gd/irt2 } ......................................................................................................................... ......................................................................................................................... ................................................................................................................................... eBook is an electronic version of a traditional print book THIS can be read by using a personal computer or by using an eBook reader. (An eBook reader can be a software application for use on a computer such as Microsoft's free Reader application, or a book-sized computer THIS is used solely as a reading device such as Nuvomedia's Rocket eBook.) Users can purchase an eBook on diskette or CD, but the most popular method of getting an eBook is to purchase a downloadable file of the eBook (or other reading material) from a Web site (such as Barnes and Noble) to be read from the user's computer or reading device. Generally, an eBook can be downloaded in five minutes or less ......................................................................................................................... .............. Browse by Genre Available eBooks .............................................................................................................................. Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, ......................................................................................................................... ......................................................................................................................... .....BEST SELLER FOR EBOOK RECOMMEND............................................................. ......................................................................................................................... Blowout: Corrupted Democracy, Rogue State Russia, and the Richest, Most Destructive Industry on Earth,-- The Ride of a Lifetime: Lessons Learned from 15 Years as CEO of the Walt Disney Company,-- Call Sign Chaos: Learning to Lead,-- StrengthsFinder 2.0,-- Stillness Is the Key,-- She Said: Breaking the Sexual Harassment Story THIS Helped Ignite a Movement,-- Atomic Habits: An Easy & Proven Way to Build Good Habits & Break Bad Ones,-- Everything Is Figureoutable,-- What It Takes: Lessons in the Pursuit of Excellence,-- Rich Dad Poor Dad: What the Rich Teach Their Kids About Money THIS the Poor and Middle Class Do Not!,-- The Total Money Makeover: Classic Edition: A Proven Plan for Financial Fitness,-- Shut Up and Listen!: Hard Business Truths THIS Will Help You Succeed, ......................................................................................................................... .........................................................................................................................
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Unlock Her Legs - How to Turn a Girl On In 10 Minutes or Less... ♥♥♥ http://ishbv.com/unlockher/pdf
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • DOWNLOAD THAT BOOKS INTO AVAILABLE FORMAT (2019 Update) ......................................................................................................................... ......................................................................................................................... Download Full PDF EBOOK here { https://urlzs.com/UABbn } ......................................................................................................................... Download Full EPUB Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... Download Full doc Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... Download PDF EBOOK here { https://urlzs.com/UABbn } ......................................................................................................................... Download EPUB Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... Download doc Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... ......................................................................................................................... ................................................................................................................................... eBook is an electronic version of a traditional print book that can be read by using a personal computer or by using an eBook reader. (An eBook reader can be a software application for use on a computer such as Microsoft's free Reader application, or a book-sized computer that is used solely as a reading device such as Nuvomedia's Rocket eBook.) Users can purchase an eBook on diskette or CD, but the most popular method of getting an eBook is to purchase a downloadable file of the eBook (or other reading material) from a Web site (such as Barnes and Noble) to be read from the user's computer or reading device. Generally, an eBook can be downloaded in five minutes or less ......................................................................................................................... .............. Browse by Genre Available eBooks .............................................................................................................................. Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, Cookbooks, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult, Crime, Ebooks, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, ......................................................................................................................... ......................................................................................................................... .....BEST SELLER FOR EBOOK RECOMMEND............................................................. ......................................................................................................................... Blowout: Corrupted Democracy, Rogue State Russia, and the Richest, Most Destructive Industry on Earth,-- The Ride of a Lifetime: Lessons Learned from 15 Years as CEO of the Walt Disney Company,-- Call Sign Chaos: Learning to Lead,-- StrengthsFinder 2.0,-- Stillness Is the Key,-- She Said: Breaking the Sexual Harassment Story That Helped Ignite a Movement,-- Atomic Habits: An Easy & Proven Way to Build Good Habits & Break Bad Ones,-- Everything Is Figureoutable,-- What It Takes: Lessons in the Pursuit of Excellence,-- Rich Dad Poor Dad: What the Rich Teach Their Kids About Money That the Poor and Middle Class Do Not!,-- The Total Money Makeover: Classic Edition: A Proven Plan for Financial Fitness,-- Shut Up and Listen!: Hard Business Truths that Will Help You Succeed, ......................................................................................................................... .........................................................................................................................
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Manifestation Magic� - $27 - By Alexander Wilson - 96% Off ♣♣♣ http://ishbv.com/manifmagic/pdf
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Earn a 6-Figure Side-Income Online... Signup for the free training HERE  http://ishbv.com/j1r2c/pdf
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Presentation Validity & Reliability

  1. 1. VALIDITY, RELIABILITY & PRACTICALITY Prof. Rosynella Cardozo Prof. Jonathan Magdalena
  2. 2. QUALITIES OF MEASUREMENT DEVICES <ul><li>Validity </li></ul><ul><ul><li>Does it measure what it is supposed to measure? </li></ul></ul><ul><li>Reliability </li></ul><ul><ul><li>How representative is the measurement? </li></ul></ul><ul><li>Practicality </li></ul><ul><ul><li>Is it easy to construct, administer, score and interpret? </li></ul></ul><ul><li>Backwash </li></ul><ul><ul><li>What is the impact of the test on the teaching/learning process? </li></ul></ul>
  3. 3. VALIDITY <ul><li>The term validity refers to whether or not a test measures what it intends to measure . </li></ul><ul><li>On a test with high validity the items will be closely linked to the test’s intended focus. For many certification and licensure tests this means that the items will be highly related to a specific job or occupation. If a test has poor validity then it does not measure the job-related content and competencies it ought to. </li></ul><ul><li>There are several ways to estimate the validity of a test, including content validity, construct validity, criterion-related validity ( concurrent & predictive ) and face validity. </li></ul>
  4. 4. VALIDITY <ul><li>Content ”: related to objectives and their sampling. </li></ul><ul><li>“ Construct ”: referring to the theory underlying the target. </li></ul><ul><li>“ Criterion ”: related to concrete criteria in the real world. It can be concurrent or predictive. </li></ul><ul><li>“ Concurrent ”: correlating high with another measure already validated. </li></ul><ul><li>“ Predictive ”: Capable of anticipating some later measure. </li></ul><ul><li>“ Face ”: related to the test overall appearance. </li></ul>
  5. 5. 1. CONTENT VALIDITY <ul><li>Content validity refers to the connections between the test items and the subject-related tasks. The test should evaluate only the content related to the field of study in a manner sufficiently representative, relevant, and comprehensible . </li></ul>
  6. 6. 2. CONSTRUCT VALIDITY <ul><li>It implies using the construct correctly (concepts, ideas, notions). Construct validity seeks agreement between a theoretical concept and a specific measuring device or procedure. For example, a test of intelligence nowadays must include measures of multiple intelligences, rather than just logical-mathematical and linguistic ability measures. </li></ul>
  7. 7. 3. CRITERION-RELATED VALIDITY <ul><li>Also referred to as instrumental validity , it states that the criteria should be clearly defined by the teacher in advance. It has to take into account other teachers´ criteria to be standardized and it also needs to demonstrate the accuracy of a measure or procedure compared to another measure or procedure which has already been demonstrated to be valid. </li></ul>
  8. 8. 4. CONCURRENT VALIDITY <ul><li>Concurrent validity is a statistical method using correlation, rather than a logical method. </li></ul><ul><li>Examinees who are known to be either masters or non-masters on the content measured by the test are identified before the test is administered. Once the tests have been scored, the relationship between the examinees’ status as either masters or non-masters and their performance (i.e., pass or fail) is estimated based on the test. This type of validity provides evidence that the test is classifying examinees correctly. The stronger the correlation is, the greater the concurrent validity of the test is. </li></ul>
  9. 9. 5. PREDICTIVE VALIDITY <ul><li>This is another statistical approach to validity that estimates the relationship of test scores to an examinee's future performance as a master or non-master. Predictive validity considers the question, &quot;How well does the test predict examinees' future status as masters or non-masters?&quot; For this type of validity, the correlation that is computed is based on the test results and the examinee’s later performance. This type of validity is especially useful for test purposes such as selection or admissions. </li></ul>
  10. 10. 6. FACE VALIDITY <ul><li>Like content validity, face validity is determined by a review of the items and not through the use of statistical analyses. Unlike content validity, face validity is not investigated through formal procedures. Instead, anyone who looks over the test, including examinees, may develop an informal opinion as to whether or not the test is measuring what it is supposed to measure. While it is clearly of some value to have the test appear to be valid, face validity alone is insufficient for establishing that the test is measuring what it claims to measure. </li></ul>
  11. 11. QUALITIES OF MEASUREMENT DEVICES <ul><li>Validity </li></ul><ul><ul><li>Does it measure what it is supposed to measure? </li></ul></ul><ul><li>Reliability </li></ul><ul><ul><li>How representative is the measurement? </li></ul></ul><ul><li>Practicality </li></ul><ul><ul><li>Is it easy to construct, administer, score and interpret? </li></ul></ul><ul><li>Backwash </li></ul><ul><ul><li>What is the impact of the test on the teaching/learning process? </li></ul></ul>
  12. 12. RELIABILITY <ul><li>Reliability is the extent to which an experiment, test, or any measuring procedure shows the same result on repeated trials. Without the agreement of independent observers able to replicate research procedures, or the ability to use research tools and procedures that produce consistent measurements, researchers would be unable to satisfactorily draw conclusions, formulate theories, or make claims about the generalizability of their research. For researchers, four key types of reliability are: </li></ul>
  13. 13. RELIABILITY <ul><li>“ Equivalency ”: related to the co-occurrence of two items </li></ul><ul><li>“ Stability ”: related to time consistency </li></ul><ul><li>“ Internal ”: related to the instruments </li></ul><ul><li>“ Inter-rater ”: related to the examiners’ criterion </li></ul><ul><li>“ Intra-rater ”: related to the examiners’ criterion </li></ul>
  14. 14. 1. EQUIVALENCY RELIABILITY <ul><li>Equivalency reliability is the extent to which two items measure identical concepts at an identical level of difficulty. Equivalency reliability is determined by relating two sets of test scores to one another to highlight the degree of relationship or association. For example, a researcher studying university English students happened to notice that when some students were studying for finals, they got sick. Intrigued by this, the researcher attempted to observe how often, or to what degree, these two behaviors co-occurred throughout the academic year. The researcher used the results of the observations to assess the correlation between “studying throughout the academic year” and “getting sick”. The researcher concluded there was poor equivalency reliability between the two actions. In other words, studying was not a reliable predictor of getting sick. </li></ul>
  15. 15. 2. STABILITY RELIABILITY <ul><li>Stability reliability (sometimes called test, re-test reliability ) is the agreement of measuring instruments over time. To determine stability, a measure or test is repeated on the same subjects at a future date. Results are compared and correlated with the initial test to give a measure of stability. This method of evaluating reliability is appropriate only if the phenomenon that the test measures is known to be stable over the interval between assessments. The possibility of practice effects should also be taken into account. </li></ul>
  16. 16. 3. INTERNAL CONSISTENCY <ul><li>Internal consistency is the extent to which tests or procedures assess the same characteristic, skill or quality. It is a measure of the precision between the measuring instruments used in a study. This type of reliability often helps researchers interpret data and predict the value of scores and the limits of the relationship among variables. For example, analyzing the internal reliability of the items on a vocabulary quiz will reveal the extent to which the quiz focuses on the examinee’s knowledge of words. </li></ul>
  17. 17. 4. INTER-RATER RELIABILITY <ul><li>Inter-rater reliability is the extent to which two or more individuals (coders or raters) agree. Inter-rater reliability assesses the consistency of how a measuring system is implemented. For example, when two or more teachers use a rating scale with which they are rating the students’ oral responses in an interview (1 being most negative, 5 being most positive). If one researcher gives a &quot;1&quot; to a student response, while another researcher gives a &quot;5,&quot; obviously the inter-rater reliability would be inconsistent. Inter-rater reliability is dependent upon the ability of two or more individuals to be consistent. Training, education and monitoring skills can enhance inter-rater reliability. </li></ul>
  18. 18. 4. INTRA-RATER RELIABILITY <ul><li>Intra-rater reliability is a type of reliability assessment in which the same assessment is completed by the same rater on two or more occasions. These different ratings are then compared, generally by means of correlation. Since the same individual is completing both assessments, the rater's subsequent ratings are contaminated by knowledge of earlier ratings. </li></ul>
  19. 19. SOURCES OF ERROR <ul><li>Examinee (is a human being) </li></ul><ul><li>Examiner (is a human being) </li></ul><ul><li>Examination (is designed by and for human beings) </li></ul>
  20. 20. RELATIONSHIP BETWEEN VALIDITY & RELIABILITY <ul><li>Validity and reliability are closely related. </li></ul><ul><li>A test cannot be considered valid unless the measurements resulting from it are reliable. </li></ul><ul><li>Likewise, results from a test can be reliable and not necessarily valid. </li></ul>
  21. 21. QUALITIES OF MEASUREMENT DEVICES <ul><li>Validity </li></ul><ul><ul><li>Does it measure what it is supposed to measure? </li></ul></ul><ul><li>Reliability </li></ul><ul><ul><li>How representative is the measurement? </li></ul></ul><ul><li>Practicality </li></ul><ul><ul><li>Is it easy to construct, administer, score and interpret? </li></ul></ul><ul><li>Backwash </li></ul><ul><ul><li>What is the impact of the test on the teaching/learning process? </li></ul></ul>
  22. 22. PRACTICALITY <ul><li>It refers to the economy of time, effort and money in testing. In other words, a test should be… </li></ul><ul><li>Easy to design </li></ul><ul><li>Easy to administer </li></ul><ul><li>Easy to mark </li></ul><ul><li>Easy to interpret (the results) </li></ul>
  23. 23. QUALITIES OF MEASUREMENT DEVICES <ul><li>Validity </li></ul><ul><ul><li>Does it measure what it is supposed to measure? </li></ul></ul><ul><li>Reliability </li></ul><ul><ul><li>How representative is the measurement? </li></ul></ul><ul><li>Practicality </li></ul><ul><ul><li>Is it easy to construct, administer, score and interpret? </li></ul></ul><ul><li>Backwash </li></ul><ul><ul><li>What is the impact of the test on the teaching/learning process? </li></ul></ul>
  24. 24. BACKWASH EFFECT <ul><li>Backwash effect (also known as washback) is the influence of testing on teaching and learning. It is also the potential impact that the form and content of a test may have on learners’ conception of what is being assessed (language proficiency) and what it involves. Therefore, test designers, delivers and raters have a particular responsibility, considering that the testing process may have a substantial impact, either positive or negative. </li></ul>
  25. 25. LEVELS OF BACKWASH <ul><li>It is believed that backwash is a subset of a test’s impact on society, educational systems and individuals. Thus, test impact operates at two levels: </li></ul><ul><li>The micro level (the effect of the test on individual students and teachers) </li></ul><ul><li>The macro level (the impact of the test on society and the educational system) </li></ul><ul><li> Bachman and Palmer (1996) </li></ul>
  26. 26. <ul><li>THANKS </li></ul>

×