| |
| |
Preface | |
| |
| |
The Assessment of Individuals: The Critical Role and Fundamentals of Measurement | |
| |
| |
Measurement in the Physical Sciences | |
| |
| |
Measurement in the Social Sciences | |
| |
| |
Historical Highlights of Measurement | |
| |
| |
Statistics Background | |
| |
| |
The First Step: Identifying the Construct | |
| |
| |
Links Between Constructs | |
| |
| |
Construct Cleanliness | |
| |
| |
Single versus Multiple Constructs | |
| |
| |
Summary and Next Step | |
| |
| |
Problems and Exercises | |
| |
| |
Designing and Writing Items Empirical, Theoretical and Rational Approaches to Item | |
| |
| |
Empirical, Theoretical and Rational Approaches to Item | |
| |
| |
Literature Search | |
| |
| |
Subject Matter Experts | |
| |
| |
How Many Items? | |
| |
| |
Attitudinal Items: Early Work in Item Generation | |
| |
| |
Assessing Behaviors | |
| |
| |
Pilot Testing | |
| |
| |
Summary and Next Step | |
| |
| |
Problems and Exercises | |
| |
| |
Designing and Scoring Responses | |
| |
| |
Open-Ended Responses | |
| |
| |
Closed-Ended Questions | |
| |
| |
Example 1: Proportional Differences for a Single Variable | |
| |
| |
Example 2: Proportional Differences for Two Variables | |
| |
| |
Dichotomous Responses | |
| |
| |
Multiple Choice Tests | |
| |
| |
Continuous Responses | |
| |
| |
Ipsative versus Normative Scales | |
| |
| |
Difference and Change Scores | |
| |
| |
Summary and Next Step | |
| |
| |
Problems and Exercises | |
| |
| |
Collecting Data: Sampling and Screening | |
| |
| |
Probability Sampling | |
| |
| |
Non-Probability Sampling | |
| |
| |
Sample Sizes | |
| |
| |
Missing Data | |
| |
| |
Preparing to Analyze Your Data | |
| |
| |
Summary and Next Step | |
| |
| |
Problems and Exercises | |
| |
| |
Classical Test Theory: Assumptions, Equations, Limitations and Item Analyses | |
| |
| |
Classical Test Theory | |
| |
| |
Theory of True and Error Scores: Description and Assumptions | |
| |
| |
Ramifications and Limitations of Classical Test Theory Assumptions | |
| |
| |
Item Analysis within CTT: Approaches, Statistical Analyses, and Interpretation | |
| |
| |
Descriptive Statistics | |
| |
| |
Summary | |
| |
| |
Problems and Exercises | |
| |
| |
Modern Test Theory: Assumptions, Equations, Limitations and Item Analyses | |
| |
| |
Modern Test Theory | |
| |
| |
Models | |
| |
| |
One-Parameter Logistic Model | |
| |
| |
Two-Parameter Logistic Model | |
| |
| |
Three-Parameter Logistic Model | |
| |
| |
Multiple-response IRT Models | |
| |
| |
Parameter Estimation | |
| |
| |
Scoring Respondents | |
| |
| |
Model Fit | |
| |
| |
Assumptions | |
| |
| |
Ramifications of the Assumptions of Modern Test Theory | |
| |
| |
Practical Advantages of Modern Test Theory | |
| |
| |
Limitations of Modern Test Theory | |
| |
| |
Computer Programs | |
| |
| |
Practical Considerations | |
| |
| |
Summary | |
| |
| |
Next Steps | |
| |
| |
Problems and Exercises | |
| |
| |
Reliability of Test Scores and Test Items | |
| |
| |
Test-retest Reliability | |
| |
| |
Alternative Forms Reliability | |
| |
| |
Measures of Internal Consistency | |
| |
| |
Setting Confidence Intervals | |
| |
| |
Reliability of a Composite | |
| |
| |
Difference Scores - A Reliability Concern | |
| |
| |
Practical Questions | |
| |
| |
Summary and Next Steps | |
| |
| |
Problems and Exercises | |
| |
| |
Reliability of Raters | |
| |
| |
Inter-Rater Reliability Indices | |
| |
| |
Reliability Generalization | |
| |
| |
Modern Test Theory Approaches to Reliability | |
| |
| |
Summary and Next Steps | |
| |
| |
Problems and Exercises | |
| |
| |
Assessing Validity Using Content and Criterion | |
| |
| |
Methods | |
| |
| |
Asking the Test Takers | |
| |
| |
Asking the Subject Matter Experts | |
| |
| |
Assessments Using Correlation and Regression: Criterion-Related Studies | |
| |
| |
Classification Approaches to Test Score Validation | |
| |
| |
Group Differences and Test Bias | |
| |
| |
Extending the Inferences of Criterion-Related Validity Studies | |
| |
| |
Summary | |
| |
| |
Problems and Exercises | |
| |
| |
Assessing Validity Via Item Internal Structure | |
| |
| |
Principal Components Analysis | |
| |
| |
Common Factor Analysis | |
| |
| |
Common Factor Analysis using Analysis of Covariance | |
| |
| |
Structures | |
| |
| |
Some Other Issues in Factor Analysis | |
| |
| |
Practical Issues | |
| |
| |
Concluding Comments on Internal Structure and Validity | |
| |
| |
Threats to the Validity of Scores | |
| |
| |
Multitrait-Multimethod Assessment | |
| |
| |
Closing Comments on Test Score Validity | |
| |
| |
Summary | |
| |
| |
Problems and Exercises | |
| |
| |
Ethics and Professional Issues in Testing | |
| |
| |
Professional Standards and Guidelines | |
| |
| |
Ethical Procedures and Protocols | |
| |
| |
Test Administration | |
| |
| |
Integrity Testing | |
| |
| |
Computerized Testing | |
| |
| |
Coaching, Testwiseness, and Re-takes | |
| |
| |
Testing Legislation | |
| |
| |
Test Item Bias and Adverse Impact | |
| |
| |
Translation Issues | |
| |
| |
Electronic Presentation and Capture | |
| |
| |
Summary | |
| |
| |
Problems and Exercises | |
| |
| |
Brief Reviews of Some Selected Tests and Concluding Comments | |
| |
| |
Information about Existing Tests | |
| |
| |
Some Intelligence Tests | |
| |
| |
Academic Achievement Tests | |
| |
| |
Structured Personality Tests | |
| |
| |
Career Interest/Guidance Instruments | |
| |
| |
Chapter Summary | |
| |
| |
A Quick Book Review | |
| |
| |
Concluding Comments | |
| |
| |
Problems and Exercises | |
| |
| |
Appendices | |
| |
| |
References | |
| |
| |
Index | |