Validity generalization in the context of situational models
Article Abstract:
A primary objective of validity generalization (VG) analysis is to decompose the between-situation variance in validities into (a) variance attributable to between-situation differences in statistical artifacts and (b) variance attributable to between-situation differences in (unidentified) situational moderators. This process is based on the assumption that the effects of statistical artifacts on validities are independent of the effects of situational moderators on validities. The present article seeks to question the independence assumption by theoretically integrating situational variables into the VG estimation process. It is shown that the independence assumption may be untenable because at least one artifact - criterion reliability - is a function of, rather than independent of, the situational variables that moderate validities. An alternative approach to VG analysis is recommended. This approach rests heavily on proactive research designs in which potential situational moderators are included in the generalizability analysis. (Reprinted by permission of the publisher)
Publication Name: Journal of Applied Psychology
Subject: Social sciences
ISSN: 0021-9010
Year: 1992
User Contributions:
Comment about this article or add new information about this topic:
A note on validity generalization procedures
Article Abstract:
A review of validity generalization procedures suggests that such generalizations are prone to errors, due to the fallacy of affirming the consequent. The discussion also questions assumptions that form the basis for validity generalization procedures and statistical techniques that employ cross-situational consistency models. The use of Fisher z transformation techniques is suggested as being possibly superior to validity generalization procedures.
Publication Name: Journal of Applied Psychology
Subject: Social sciences
ISSN: 0021-9010
Year: 1986
User Contributions:
Comment about this article or add new information about this topic:
- Abstracts: Refinements in validity generalization methods: implications for the situational specificity hypothesis. Problems and pitfalls in using capital budgeting and financial accounting techniques in assessing the utility of personnel programs
- Abstracts: Validity generalization and situational specificity: a second look at the 75% rule and Fisher's z transformation