By Ivory A. Toldson and Donna Y. Ford—June 11, 2019
Adverse experiences and social privilege are both life circumstances that can alter a test-taker’s score on standardized tests. However, the College Board, with their recent announcement of an “adversity score,” highlighted the disadvantages of adversity, while ignoring the advantages of privilege. In doing so, the College Board treats adversity as a handicap to be accommodated, while missing an opportunity to address a myriad of noncognitive factors that make SAT scores either lower or higher than they should be for different racial and ethnic groups, and socio-economic statuses. In short, while the adversity score effort is good, it missed the mark by not acknowledging the adversity of racism and ignoring the impact of social privilege on test score gaps.
What the College Board got right. Context matters. Two people can have identical scores on the SAT, but because of their unique life circumstances, the same score could be high within one context, and mediocre in another. In theory, the 100-point scale that the college board will use to consider 31 aspects of a student’s academic life, such as academic rigor and poverty, can help admissions counselor better understand the score. Scoring adversity is the College Board’s attempt to standardize what many prudent universities already do subjectively to open opportunities to diverse and under-represented students whose SAT score may not accurately reflect their academic potential.
What the College Board ignored. It goes without saying that poverty often takes a toll on students’ academic progress. Thus, the College Board’s focus on poverty and interrelated adversities is important. However, intersectionality was ignored in the adversity score index. A disproportional percentage of Black, Hispanic and Native American groups live in poverty. However, numerically, more White people live in poverty. This begs the question of who will actually benefit from this colorblind adversity index. The variables in the adversity score index ignore the realities of racial injustices and discrimination in formal schooling.
Also ignored are: (a) suspension rates by income and race; (b) over-representation in high incidence areas of special education; and (c) less access to both gifted and talented education programs (GATE) and Advanced Placement (AP) classes. Black students overall, and Black males in particular, are suspended at higher rates than all other groups for subjective reasons. Racial discrimination by educators is the central factor. When students are suspended, so is their opportunity to learn. This negatively affects their grades and test scores. Students with unaddressed emotional and behavioral disorders also have a higher probability of getting low test scores and low chances of applying to and getting admitted to college, especially the more selective ones. Relative to gifted and talented education and AP, White and Asian students are significantly over-represented; Black, Hispanic and Native American students are extensively under-represented. These programs, if implemented correctly, are more rigorous than general education courses. AP and GATE programs increase the likelihood that more affluent students will get admitted to higher education, and competitive colleges and universities in particular.
What the College Board got wrong. Adversity is not the only source of shortsighted interpretations of SAT scores. Some SAT scores are artificially inflated because of social privilege. Like all standardized tests, SAT scores are normally distributed, with the most frequently achieved scores clustered around a mean and the less frequently achieved, extremely high and low, scores at opposite ends of a bell curve. The adversity score cautions against reading too much into low scores among test takers with social disadvantages and limited English proficiency. However, the adversity index does nothing to help admissions counselors temper their enthusiasm for students with high scores because their parents paid a premium for test preparation or illegally had scores manipulated as, with the college admissions scandal. Ignoring the social advantages and privilege that certain students have harms students with disadvantages more than reactive accommodations help them.
The appropriate application of Classical Test Theory can help the College Board create a fairer testing circumstance for all students, while helping admissions counselors make more careful and pragmatic decisions from test scores. Classical Test Theory tells us a person’s true score is always unknown (X). The true score, X, is the product of the measured score and error (E). Theoretically, we can be more or less confident in the measured score depending on the amount of error – noncognitive factors that can alter the measured score.
Students who have, and have not, taken SAT prep factors into the E (error). Currently, test preparation materials began at $25 and test preparation courses and tutoring can cost up to $6,600. Affluent families spend more money to “train” their children to take tests, which often involves skills that have little to do with crystalizing the knowledge they should have gained in high school.
The significant gains in SAT and ACT scores achieved by students who participate in the more expensive test programs, as reported by the test prep companies, call into question the integrity of the tests, and raises a number of questions: Should the measurable differences in scores that are statistically attributed to test prep be viewed as differences in test takers’ dose of achievement, even when a good chunk of the training involves strategies and techniques unrelated to the subject matter? Does test prep permanently or temporary help students compensate for knowledge that should have been gained in school, or does it help the test taker “game” the test? Is either one of these scenarios fair and equitable?
Beyond the error associated with test prep, the college admissions scandal revealed the insidious tactics by which many wealthy families either produce higher SAT scores, or diminish the impact of low SAT scores, for their children. The college admission scandal revealed that many affluent families pay for not only test preparation, but also the actual tests and test scores.
Read more at Diverse Education.