Relationship of reliability and validity

Relation between Validity and Reliability of a Test

relationship of reliability and validity

As mentioned in Key Concepts, reliability and validity are closely related. To better understand this relationship, let's step out of the world of testing and onto a . "goodness" of the rules reflects on the reliability and validity of the measurement-- . relationship between the measured concept (variable) and other concept. Reliability and validity are important not be any necessary relationship between the two.

Here, you can clearly see that reliability is directly related to the variability of your measure. The third scenario shows a case where your hits are spread across the target and you are consistently missing the center.

Your measure in this case is neither reliable nor valid. Finally, we see the "Robin Hood" scenario -- you consistently hit the center of the target. Your measure is both reliable and valid I bet you never thought of Robin Hood in those terms before.

  • Reliability and validity
  • Reliability & Validity

Another way we can think about the relationship between reliability and validity is shown in the figure below. Here, we set up a 2x2 table. The columns of the table indicate whether you are trying to measure the same or different concepts.

relationship of reliability and validity

The rows show whether you are using the same or different methods of measurement. Imagine that we have two concepts we would like to measure, student verbal and math ability.

Relation between Validity and Reliability of a Test

Furthermore, imagine that we can measure each of these in two ways. Second, we can ask the student's classroom teacher to give us a rating of the student's ability based on their own classroom observation. The first cell on the upper left shows the comparison of the verbal written test score with the verbal written test score.

But how can we compare the same measure with itself? We could do this by estimating the reliability of the written test through a test-retest correlation, parallel forms, or an internal consistency measure See Types of Reliability.

Reliability and validity - Wikiversity

What we are estimating in this cell is the reliability of the measure. The cell on the lower left shows a comparison of the verbal written measure with the verbal teacher observation rating.

Because we are trying to measure the same concept, we are looking at convergent validity See Measurement Validity Types. The cell on the upper right shows the comparison of the verbal written exam with the math written exam. Here, we are comparing two different concepts verbal versus math and so we would expect the relationship to be lower than a comparison of the same concept with itself e.

Thus, we are trying to discriminate between two concepts and we would consider this discriminant validity. Reliability is a prerequisite of validity.

relationship of reliability and validity

A highly reliable test is always a valid measure of some function. Thus, reliability controls validity.

Social Research Methods - Knowledge Base - Reliability & Validity

Reliability may be said as the dependability of measurement. Maximum reliability is found in case of homogeneous items. Maximum reliability requires items of equal difficulty and high inter- correlation among test items.

Validity co-efficient does not exceed the square root of reliability coefficient.

relationship of reliability and validity

The reliability is the proportion of true variance. We cannot claim that a reliable test is also valid. This may or may not be true.

relationship of reliability and validity

A test measures consistently, but it may not measure what it intends to measure. For example, when a man wrongly reports his date of birth consistently, it may be reliable but not valid.

Reliability and Validity: Relationship with a Measure (Part 7 of Course) -

Relation Validity of a Test: Validity is concerned with the extent to which the purpose of the test is being served. It studies how truthfully the test measures what it purports to measure. On the other hand, validity is the correlation of the test with some outside external criteria. A test to be valid, has to be reliable. A test which possesses poor reliability is not expected to yield high validity.