Medical students around the country cheered and jeered this week’s announcement that the results of a much-feared compulsory exam known as Step 1 would cease to be reported with a three-digit score but would instead become pass/fail as early as 2022. The announcement by the sponsors of the U.S. Medical Licensing Examination (USMLE) said the change was made in part to “address concerns about Step 1 scores impacting student well-being and medical education.” Students usually take the seven-hour exam after the second year of medical school. It is the first in a series of three exams that doctors-to-be must pass to become licensed physicians in the U.S. Initially designed to gauge how well a medical student can apply scientific concepts to the practice of medicine, in recent years the scores were used by some residency programs to screen potential candidates. Opinions are divided on reporting scores: Some think it makes sense and moving to pass/fail would be “root rot.” Others point out how striving for scores induced egregious stress and has changed how medicine is being taught. However, I do worry that making the test pass/fail could reinforce the hierarchy that exists among medical schools. My friends at so-called low-tiered medical schools, international medical schools, and schools of osteopathic medicine have expressed great concern that they won’t be able to use their Step 1 scores as a way to make themselves more competitive for residency programs. A pass/fail system privileges students like me who attend higher ranked medical schools. Therefore, it will be imperative that residency directors institute fair, objective ways to avoid the biases of the existing system. While it will be challenging, it is an opportunity to reevaluate the validity of medical school rankings and perhaps redefine what qualities make a good doctor in the 21st century. Most important, the change to pass/fail does nothing to resolve the racial and systemic inequities entrenched in the residency application process. With many medical schools’ transitions to pass/fail curricula, Step 1 was the last major objective measure that residency programs could use to evaluate candidates. When Step 1 scores disappear, more emphasis will be placed on research experience, publication, and subjective evaluations from students’ preceptors. Studies have shown that students of color tend to receive lower scores on subjective evaluations during their clinical years. For the Step 1 change to result in true improvement, we must address how these biases are baked into the evaluations of students from marginalized backgrounds. Despite the positives, this decision to make the test pass/fail is not popular with medical students. In a 2011 survey, only 26% of medical students agreed that Step 1 should be pass/fail; in the 2019 Invitational Conference on USMLE Scoring assessment, under half of respondents said they would support changes to numeric Step 1 scoring. Why? The removal of Step 1 scores, which have been continually ranked at the top of residency program directors’ priorities in evaluating candidates, begs the question of what will replace them. It seems natural to think that the search for another objective metric might lead residency program admissions committees to shift emphasis to Step 2. But since Step 2 is typically taken in July at the end of the third year of med school, a poor result could be disastrous. Students who perform poorly on the exam would learn they aren’t competitive for their residencies of choice just a month or so before applications are due. These students would also have already arranged their sub-internships for fourth year. Student wellness was given as one reason for making Step 1 pass/fail. How do we ensure that the stress it generates during the first two years of medical school isn’t simply being redirected toward the clinical years and Step 2? And if there is a move to make that test pass/fail as well, what other metrics should be used to equitably and accurately appraise a candidate’s abilities? And then, in the blink of an eye, I took the exam and moved on with my life. I started my clinical years of medical school, rotating with different specialties in the hospital. These rotations were the perfect antidote to my Step 1 experience. The diseases I had studied in textbooks jumped off the page and manifested as real people with real illnesses that I now get to help diagnose and treat. I continue to prepare for tests — Step 2 is looming on the horizon — but I now learn alongside practicing medicine. As such, I now study with an excitement and curiosity I had rarely felt in my months of library isolation during Step 1 prep. Perhaps Step 1 is a bit like giving birth: It was exceedingly difficult at the time, but afterward I fell in love with medicine and instantly forgot much of the pain I endured to get here. I can’t predict how the change to reporting Step 1 scores will affect medical trainees, but my hope is that it will help us realign our learning with patient care — for our patients’ health and well-being as much as for our own. Max Jordan Nguemeni Tiako Reporting the scores of the Step 1 exam as pass/fail is step in the right direction that I believe will contribute to alleviating the burden of standardized testing on medical students, especially those like me who are underrepresented in medicine. I spent nine weeks reviewing 800 pages of minute details of basic science. I answered 6,000 practice questions. It was a time of heightened anxiety, social isolation, and misery. I had hit rough patches in medical school before the test, but I had never before doubted whether I could get through medical school like I did during this period. I worried I might fail and be exposed as a fraud, proving to whoever might have thought it before that I didn’t deserve a seat at Yale as a Black medical student. I began to regret my heavy involvement in extracurricular activities and service to my medical school. Until Step 1 reared its ugly head, I had been immersed in a student-led committee focused on diversity, inclusion, and social justice at Yale. We evaluated the curriculum and lobbied the administration for changes in education, the admissions process, resource allocation for research, and more. I even started a podcast focusing on health disparities. All that was possible because the Yale system deemphasizes the importance of tests and grades during medical education. I studied because I wanted to become the best doctor for my future patients, not because I was preparing for a test. Then the reality of Step 1 hit me like a ton of bricks. If I wanted to try for a competitive specialty like dermatology, neurosurgery, or ophthalmology, it was either buckle down for the test or write off those dreams. Using Step 1 scores to screen residency applications puts students who are underrepresented in medicine at a disadvantage. For instance,a 2019 study of orthopedic surgery residency programs (the specialty with the lowest percentage of underrepresented students among its trainees) showed that between 2005 and 2014, Black and Latinx applicants were accepted into residency programs at a significantly lower rate (61%) than white applicants (71%). An earlier study in internal medicine showed that when Step 1 scores were used to screen applicants for interviews, a significantly greater proportion of Black students were refused interviews. The reality is that Step 1 is neither precise nor does it predict students’ performance as residents beyond a certain threshold. With a standard error of eight points, two applicants with scores as far as 15 points apart may not be meaningfully different and yet several programs use singular cutoff points as screening tools. While underrepresented students are more likely to go into primary care, there is no evidence that we express a preference for primary care early in medical training. It is likely that the chances of successfully matching into specialties with higher average Step 1 scores continue to be affected by arbitrary cut-off scores, discouraging students from considering those specialties. Source
