What types of reliability evidence has Janice collected, and do each indicate that the measure is reliable or not?

What types of reliability evidence has Janice collected, and do each indicate that the measure is reliable or not?
(f) Name two things that can be measured on each of the scales below:
• Nominal:
• Ordinal:
• Ratio:
• Interval:
In-Class Assignment: Measurement
(a) Define validity as it relates to measurement.
(b) Define reliability as it relates to measurement.
(c) Construct validity needs to be established for the SAT exam. How might a researcher establish this (describe the process)?
1. Face validity could be established by…
2. Convergent validity could be established by…
3. Discriminant validity could be established by…
4. Predictive validity could be established by…
(d) Reliability needs to be established for the SAT exam. How might a researcher establish this (describe the process)?
1. Establishing reliability through test-retest would involve…
2. Establishing reliability through split-half would involve…
(e) Janice creates a measure of child behavior problems that consists of 10 items, rated by observers. She first sends this measure out to several researchers in the field to see if the items make sense to them and these individuals respond that they do. She then brings in participants and has two separate raters apply this system. The raters agree at a kappa of .80 (good agreement). Janice notices, however, that one of the items does not seem to contribute to the overall scale in the same manner as the others, resulting in an alpha of .52 (poor). She removes this item and the alpha improves to .77 (acceptable).
What types of reliability evidence has Janice collected, and do each indicate that the measure is reliable or not?
(f

Last Completed Projects