CHAPTER 5: OF TEST SND TESTING
Responses on tests are thought to PREDICT REAL-WORLD BEHAVIOR. The obrained sample of behavior is expected to predict FUTURE behavior
Assumption 3: Test-related Behavior Predicts Non-Test-Related Behavior
An example of this an administrator PREDICTS a HIGH SCORE in the admission examination would PREDICT SUCCESS IN COLLEGE
Assumption 3: Test-Related Behavior Predicts Non-Test-Related Behavior
Tas in some test MIMIC THE ACTUAL BEHAVIORS that the test user is attempting to understand
Assumption 3: Test-Related Behavior Predicts Non-Test-Related Behavior
You must understand the following:
• DETAILS about the tests they use
• How a test was DEVELOPED
• Under which it is APPROPRIATE to ADMINISTER THE TEST
• HOW the test should be ADMINISTERED and to WHOM, and HOW thes TEST RESULTS should be INTERPRETED.
Assumption 4: Tests and Other Measurement Techniques Have Strengths and Weaknesses
USERS UNDERSTAND and APPRECIATE the LIMITATIONS of the tests they use as well as HOW those LIMITATIONS might be COMPENSATED for by data from other sources
Assumption 4: Tests and Other Measurement Techniques Have Strengths and Weaknesses
What is the first part of the manual usually about?
The purpose and development of the test
Refers to a LONG-STANDING ASSUMPTION that factors other than what a TEST ATTEMPTS to MEASURE will INFLUENCE performance on the test
Error
The COMPONENT of a TEST SCORE ATTRIBUTABLE to sources other than the trait or ability measured
Error variance
All major test publishers strive to develop instruments that are fair when used in strict accordance with guidelines in the test manual
Assumption 6: Testing and Assessment Can Be Conducted in a Fair and Unbiased Manner
• Problems arise if the test is used with people for whom it was not intended
• Some problems are more political than psychometric nature
Assumption 6: Testing and Assessment Can Be Conducted in a Fair and Unbiased Manner
There is a great need for tests, especially good tests, considering the many areas of our lives that they benefit.
Assumption 7: Testing and Assessment Benefit Society
Involves CONSISTENCY of the measuring tools; the precision with which the test measures and the extent to which error is present in measurements
Reliability
A test is considered valid for a particular purpose if it does, in fact, measure what its PURPORTS to MEASURE.
Validity
Which of the following TESTS is HIGHLY COMPLEX and measures different domains, such as VERBAL ABILITY, and costs over a hundred thousand pesos?
Wechsler Adult Intelligence Scale
For PARTICIPANTS BELOW 7 years old, at which ITEM number should the EXAMINER START the test?
Item number 1
What happens if the CLIENT GETS THREE CONSECUTIVE INCORRECT ANSWERS during the test?
The client is allowed to stop and does not need to complete the entire test
What should be done when a TEST has certain WEAKNESSES?
Compensate by using another assessment form to validate and confirm the results
What is IMPORTANT to CONSIDER when DRAWING CONCLUSIONs from a depression anxiety test?
Results of the test, interview findings, and case history
How can a potential DIAGNOSIS of depression be VALIDATED IN A CLIENT?
By using multiple materials, such as another test and case history
What should you CONSIDER when you GET A LOW SCORE, such as 25/75, on an exam?
There may be other factors that influenced your score, including possible errors
Why does an IQ SCORE NOT REPRESENT your ENTIRE INTELLECT?
Your IQ score might be influenced by external factors, and it doesn’t capture all aspects of intellect
What is often QUESTIONED when EVALUATING TEST SCORES
The degree to which the measurement process includes error
What is ERROR VARIANCE?
The component of a test score attributable to sources other than the trait or ability being measured
What does CLASSICAL or TRUE SCORE THEORY assume about each test taker?
Each test taker has a true score that could be obtained without the influence of measurement error
What are the THREE MAJOR CLASSIFICATIONS of ERROR VARIANCE?
Condition of the assessee, assessors, measuring instruments
Which of the following is an example of HOW the CONDITION of the ASSESSEE CAN AFFECT ERROR VARIANCE?
The flu or sadness of the test taker
What is the most EFFECTIVE STRATEGY to ADMINISTER a TEST FAIRLY?
Follow the guidelines or manual while administering the test
Where does the ERROR typically ARISE in the TESTING PROCESS?
From a holistic view of how you interpret and release the test scores
What defines a "GOOD TEST"?
It has psychometric soundness, which includes reliability and validity
What does RELIABILITY in a TESTING instrument refer to?
The consistency of results regardless of when or how the measurement is taken
Which of the following is an example of RELIABILITY?
A weighing scale that shows the same weight regardless of when it is used
What is one INDICATOR that a MEASUREMENT IS VALID?
High reliability of the measurement
Can a TEST be RELIABLE WITHOUT BEING VALID?
Yes, a test can be reliable without being valid
What happens if you MEASURE ANXIETY USING A DEPRESSION SCALE?
It is not valid for the purpose of measuring anxiety
How can VALIDITY be AFFECTED in a CONSTRUCTED TEST for MEASURING AGGRESSION?
By including items unrelated to aggression
What is the PURPOSE of the CONTENT VALIDITY INDEX?
To assess the degree of validity of a test
BEFORE ADMINISTERING a CONSTRUCTED TEST, what should be done to ensure content VALIDITY?
Validate the test with three experts
What does it indicate if a THERMOMETER SHOWS DIFFERENT TEMPERATURES each time UNDER CONTROLLED CONDITIONS?
The thermometer is probably malfunctioning, affecting the validity of measurements
What does it suggest if a SYMPTOM QUESTIONNAIRE RESULTS in a RELIABLE DIAGNOSIS when ANSWERED at DIFFERENT TIMES and by DIFFERENT DOCTORS?
It indicates high validity as a measurement of the medical condition
What are NORMS in the context of TESTING?
Test performance data of a particular group used as a reference for evaluating individual scores
Why are NORMS IMPORTANT when INTERPRETING TEST SCORES?
They help determine if an individual’s score is low or high compared to a reference point
What is a NORMATIVE SAMPLE?
Reference performance group
What does NORMING refer to?
Process of deriving norms
NORM-REFERENCED TESTING COMPARES an INDIVIDUAL’S SCORE to what?
Group test scores
How are SCORES TRANSFORMED during NORMING?
Into standard form
What is RACE NORMING?
Adjusting for race
USER NORMS are based on what type of statistics?
Descriptive statistics
What does STANDARDIZATION/TEST STANDARDIZATION involve?
Administering tests for establishing norms
SAMPLING refers to what process in TEST DEVELOPMENT?
Selecting participants that has at least one common observable characteristic
A STATIC used to ESTIMATE how LARGE a DIFFERENCE BETWEEN TWO SCORES should be before the difference is considered STATISTICALLY SIGNIFICANT
Standard error of difference
A SAMPLE OF THE POPULATION is what?
Portion representing whole
STRATIFIED RANDOM SAMPLING ensures what?
Equal chance of selection
In stratified random sampling, STRATA refer to what?
Specific subgroups
INCIDENTAL SAMPLING involves what?
Close proximity selection
CRITERION-REFERENCED EVALUATION compares scores to what?
Fixed standard
NORM-REFERENCED EVALUATION is BASED on SCORES from what?
Same test group
An EXAMPLE of CRITERION-REFERENCED ASSESSMENT is what?
Board exam
What should responsible TEST USERS RESEARCH BEFORE SELECTING A TEST?
Available norms
CULTURALLY INFORMED ASSESSMENT considers what?
Test culture and era
When INTERPRETING TEST RESULTS, why is CULTURE IMPORTANT?
Provides context
What is the PURPOSE of NORMING in testing?
Deriving standards
What is the main characteristic of INCIDENTAL SAMPLING?
Convenience-based
What do NORMS provide in the context of ASSESSMENT?
Reference for evaluation
In STRATIFIED RANDOM SAMPLING, if RTU students are used as the normative sample, what does the "STRATA" refer to?
The different colleges in the university
What is a PSYCHOLOGICAL TRAIT?
A relatively enduring way in which one individual differs from another
Which of the following is an example of a PSYCHOLOGICAL TRAIT TERM RELATED to HUMAN SEXUALITY?
Androgynous
How does CONTEXT INFLUENCE the LABELING of BEHAVIOR, such as someone praying aloud?
The behavior might be seen as religious or deviant, depending on the setting
Why is it IMPORTANT for TEST DEVELOPERS to PROVIDE CLEAR OPERATIONAL DEFINITIONS of CONSTRUCTS like aggression?
To clarify what behaviors indicate the trait being measured
What does CUMULATIVE SCORING in PSYCHOLOGICAL TESTS involve
Summing responses to a series of test items to derive a score
How is a TRAIT defined according to Guilford (1959)?
A distinguishable, relatively enduring way in which one individual varies from another
What is the primary DIFFERENCE between TRAITS and STATES as mentioned in the passage?
States are relatively less enduring compared to traits
What methods can be used to OBTAIN SAMPLES OF BEHAVIOR for ASSESSING TRAITS?
Various methods, including direct observation and self-report statements
What is meant by "OVERT BEHAVIOR" in this context?
An observable action or the product of an observable action
Why can CONSTRUCTS NOT BE DIRECTLY PERCEIVED according to the passage. But we can INFER their EXISTENCE from OVERT BEHAVIOR
They cannot be seen, heard, or touched
What is a crucial FIRST STEP in INTERPRETING a PERSONALITY TEST SCORE RELATED to AGGRESSION?
Understanding how aggression was defined by the test developer
What does the term "POPULATION" refer to in the context of TEST DEVELOPMENT?
The complete universe of individuals with at least one common observable characteristic
Which of the following is NOT mentioned as an example of a potential population for test development?
All children in a particular school district
What are PERCENTILE NORMS?
Raw data converted to percentile form
What does the XTH PERCENTILE indicate?
The score at or below which x% of scores fall
What do AGE NORMS indicate?
The average performance of test-takers across various age groups
Why are AGE NORM tables for PSYCHOLOGICAL CHARACTERISTICS often CONTROVERSIAL?
They generalize too much based on mental age
What do GRADE NORMS indicate?
Average test performance of test-takers in a specific school grade
What are NATIONAL NORMS derived from?
A normative sample that is nationally representative
What do NATIONAL ANCHOR NORMS provide?
A stability to test scores by anchoring them to other test scores
What are SUBGROUP NORMS?
Norms segmented by specific criteria used in selecting subjects
Who might BENEFIT from USING LOCAL NORMS?
A local company’s personnel director
Why might a SCHOOL DEVELOP its OWN LOCAL NORMS?
To better reflect the performance of local students
Which type of NORM is specifically DESIGNED for USE in SCHOOLS?
Grade norms
What is a primary concern when ESTABLISHING NATIONAL NORMS?
The sample must be nationally representative
What is the primary focus of NORM-REFERENCED EVALUATION?
Evaluating a test score in relation to other scores on the same test
Which of the following is an example of CRITERION-REFERENCED EVALUATION?
A student must score at least 75% to pass an exam
What is the primary PURPOSE of CRITERION-REFERENCED ASSESSMENT?
To evaluate whether individuals meet a specific standard or criterion
What is the primary focus of NORM-REFERENCED INTERPRETATIONS of TEST DATA?
How an individual performed relative to others who took the test
What is ANOTHER TERM often used to DESCRIBE CRITERION-REFERENCED TESTS?
Mastery tests
How can NORM-REFERENCED and CRITERION-REFERENCED approaches to ASSESSMENT be VIEWED in RELATION TO EACH OTHER?
They can be used in conjunction to provide a fuller picture of performance.
What was the primary purpose of APPLYING PERSONALITY TESTING and BEHAVIORAL INTERVIEWING for the CHICAGO BULLS during PLAYER SELECTION?
To evaluate competencies necessary for success in the league
Which PERSONALITY ASSESSMENT tool did the CHICAGO BULLS UTILIZE in their SELECTION PROCESS?
16PF–fifth edition
What type of sampling is described as SELECTING a SAMPLE that helps PREVENT SAMPLING BIAS by ENSURING REPRESENTATION from DIFFERENT SUBGROUPS of a POPULATION?
Stratified sampling
What is the primary DANGER of USING PURPOSIVE SAMPLING?
It may lead to biased results if the sample is not representative.
What is the main DIFFERENCE between IDEAL SAMPLING and PRACTICAL SAMPLING as described in the text?
Ideal sampling represents the perfect sample, while practical sampling often involves constraints
DOMAIN SAMPLING THEORY primarily focuses on:
Estimating the contribution of specific variations in the test
Ex: A psychologist studies how different question types on a test affect the overall score accuracy.
INCIDENTAL SAMPLING is best described as:
A convenient or available sample used due to practical constraints.
These are examples of what?
Surveying College Students: A researcher gives surveys to students in a nearby cafeteria for convenience, despite it not representing all college students.
Observing Behavior in a Park: A psychologist observes only kids near the park entrance, ignoring those playing farther away.
Using Class Participants: A psychology student uses classmates for a group dynamics experiment due to their availability, rather than seeking a diverse sample.
Incidental sampling
Which STANDARDIZED TEST is historically known for USING A FIXED REFERENCE GROUP SCORING SYSTEM?
SAT Scholastic Aptitude Test
What is one primary CONSIDERATION when CHOOSING A PSYCHOLOGICAL TEST?
The objectives of the test and how well the test meets those objectives
What is a potential ISSUE when USING DIFFERENT RATERS to ASSESS the SAME CHILD’S BEHAVIOR?
It can lead to discrepancies in reported behavior
Why is it IMPORTANT to have MULTIPLE SOURCES OF DATA when ASSESSING a CHILD'S BEHAVIOR?
To provide a more accurate representation of the child's behavior
What does VALIDITY refer to in the context of PSYCHOLOGICAL TESTING?
The extent to which a test measures what it claims to measure
What is the main focus of assessing the RELIABILITY of a PSYCHOLOGICAL INSTRUMENT?
To ensure consistent measurement
Is an INFORMED, SCIENTIFIC CONCEPT, developed or constructed to DESCRIBE or EXPLAIN BEHAVIOR. We CAN'T see, hear, or touch, but we can INFER their EXISTENCE from OVERT BEHAVIOR
Construct
A trait is measured by a SERIES of TEST ITEMS. EACH RESPONSES to a test item is CONVERTED to a NUMBER according to a test "key".
Example: correct =1 and incorrect=0
Cumulative scoring