This was successfully posted to your pofile.
This box will close automatically in a few seconds. Close this window
We don't have an e-mail address on file for you. To use AAFP Connection, you must have an e-mail address in our records. Click Here
University of Texas Medical Branch
Integrated Curriculum Leads to Student Success on USMLE Step 1, Study Finds
By Barbara Bein
In addition, mean scores on Step 1 increased by 14 points, with improvements across the entire range of student scores on the Medical College Admission Test, or MCAT, according to faculty members.
The difference, said the educators, was that the 2003-05 classes were exposed to an integrated medical curriculum that emphasized problem-based learning as opposed to traditional rote memorization and lectures.
Lead author Steven Lieberman, M.D., vice dean for academic affairs and a professor of internal medicine at UTMB School of Medicine, told AAFP News Now that both administrators and faculty members were surprised at the enormous improvement after the comprehensive curriculum changes. The paper describes Step 1 scores as "critical" outcomes that are used for residency selection.
Decline Seen in MCAT's Ability to Predict USMLE Step 2 Performance
In fact, according to a study in the June issue of Academic Medicine, a decline has been seen in the predictive validity of more recent versions of the MCAT on USMLE Step 2 scores. USMLE 2 tests students' ability to apply medical knowledge and skills to patient care.
The study examined the USMLE scores and other performance predictors of 7,859 students in 36 classes entering Jefferson Medical College in Philadelphia between 1970 and 2005. The students were divided into three groups according to which MCAT version they took: the pre-1978 version; the version used between 1978 and 1991; and the latest, post-1991, version.
Overall, the authors noted, "the MCAT predictive validity coefficients obtained in this study are encouraging and support the use of the MCAT scores in the screening of a large applicant pool."
However, they added, "there was an unexpected pattern of systematic decline in the validity of the MCAT in predicting Part II/Step 2 performance."
"This downward trend is important, given the ongoing consideration by the National Board of Medical Examiners to have only one licensing examination during undergraduate medical education, most likely to be used for evaluation at the time that the Step 2 examination is now taken."
"Although the findings support the short- and long-term predictive validity of the MCAT, opportunities to strengthen it remain," the study's authors concluded. "Subsequent revisions should increase the test's ability to predict performance on United States Medical Licensing Examination Step 2 and must minimize the differential validity for gender."
The study comes at a time when the Association of American Medical Colleges is reviewing the MCAT and expects to come out with a revamped exam no earlier than 2013.
According to Lieberman, medical educators are keenly interested in making comprehensive changes in medical education, but many end up focusing on a single innovation because of institutional factors such as departmental autonomy, overburdened faculty, limited resources and institutional inertia.
Lieberman said that in 1998, the medical school started implementing changes to the curriculum during the program's first two years -- the basic science/preclinical years -- to modernize the program. The changes were implemented gradually and continue to be fine-tuned, he said.
One central change was a hybrid set of teaching methods that emphasized problem-based learning and active, student-centered learning and inquiry. The methods also highlighted self-direction, applicability of material to students' careers and solving authentic problems.
Tests stressed knowledge integration and the application of concepts learned to clinical scenarios. Examinations were rewritten in the style of the Step 1 exam so students could gain deliberate practice in taking Step 1.
The medical school made other changes, as well. To help students who were having difficulties with the new teaching and testing styles, the school launched a support system that included peer tutoring and professional academic counseling. Students at high risk for academic difficulty were identified early and offered additional preparation and support.
The results were striking:
- Only 2.3 percent of students in UTMB's integrated medical curriculum failed on their initial Step 1 attempt, while the national failure rate on the Step 1 exam during the same period was 6 percent to 7 percent.
- Compared with 9 percent of female students in a traditional curriculum, only 1.9 percent of female students in the integrated curriculum failed on their first Step 1 attempt, a decrease of almost 79 percent. Failure rates among males declined from 6.6 percent for those in a traditional curriculum to 2.8 percent among those in the integrated program, a decrease of nearly 58 percent.
- Among underrepresented minorities (e.g., black, Hispanic, Puerto Rican and American Indian/Alaskan native students), the Step 1 failure rate decreased by about 77 percent, from 16.6 percent to 3.9 percent. Black students showed the greatest improvement, with the failure rate decreasing by 94 percent, from 25 percent to 1.6 percent.
- Mean scores on Step 1 among students in the integrated medical curriculum increased 14 points compared with students in a traditional curriculum. The increase was even larger, at 14.6 points, among underrepresented minorities. Black students had the highest gains at 20.8 points. In fact, students across the entire range of MCAT scores benefited from the integrated curriculum.