Every member has an equal chance of being selected
Proportions of an important subgroup of the population must be represented (ex. 75% female, 25% male)
Randomly choosing from a cluster of people with the same trait
Simply asking the people around you, non-representative
Only recruiting until you reach the number you need
Asking participants to tell people they know to participate in the study
Quota
convience
snowball
Reliable and consitent results
produce the same results over and over
Measures what it is supposed to measure
How effective a study LOOKS
Will the test be able to predict what happens for future events
extent that the test properly meaasures what it is designed to
Assigning numbers to classify into groups (numbers as names for people)
Numbers indicate rank ordering
- Doesn't indicate distance between two points
Scores indicate quantities BUT zero is just a point on the continume (doesn't mean an absence of something)
Scores idicate quantities BUT zero means nothing is there
Describes the sample data
Lets us infer conclussions from that data
Relationship between variables in the population expected
Rejecting null hypothesis but being wrong
Sailure to reject null error but you're wrong
Relationship between variables in population is expected given the sample
range that the population is likely to be found
Chance of rejecting a null hypothesis
1) Manipulated IV
2) Experimental Groups
3) Control groups
Any uncontrolled conditions
Task is too easy so everyone scores high
Task is too hard so everyone scores low
Things already existing within participants that cannot be controlled or manipulated
1) Generalize to other populations
2) Generalize to otehr envoirnments
3) Generalize to other times
How well does the study generalize to contexts outside of the study
How well the study actually answers the proposed question
1) Valid operational defintions
2) Valid measures
3) No confounds
how one matures over time of the study
Checking at later times may change results
issues with expired/not working equipment or methods
CLusters of people who drop out with the same characteristics
Comparing the difference between two sets opf subjects
Creating equivalent groups
Deliberate control over a potential confound
Looking for a difference within a group
aka repeated measure design
Difference in results based on the order contition is presented in (order effect)
Altering the order of experiemental conditions
Random sampling of all possible combinations is selected
Testing in every possible order at least once
between subject design (potential for cohort effect)
Within-subject design, Subjects tested at differentg points in their life
testing different generations for the same thing
experimenters expectations can influence subject behavoir
double blind procedure
Knwoing one is in a study
Participants tend to be cooperative to please researcher
Participants behave in ideal ways to avoid negative evaluation
Cues giving away true purpose of the study