Criteria for Excellence | Chapter 7: Program Accreditation
Build systems that support accreditation, self-monitoring and continuous improvement.
Authors: John Gazewood, MD; Alan Douglass, MD; Judith Pauwels, MD
Maintaining ACGME accreditation in family medicine residency programs
A Program of Excellence is fully accredited without significant areas of concern, including both the core program and any dependent tracks and/or fellowships. Programs of Excellence are leaders in the discipline by meeting and exceeding expectations on the Accreditation Council for Graduate Medical Education (ACGME) Core Requirements and Outcome Requirements and by innovating to meet the Detail Requirements. These programs have systems in place to monitor outcomes, predict areas of challenge for strategic planning, look for opportunities for improvement, and proactively develop action plans to maximize success.
A Program of Excellence has specific, recurrent process timelines related to the following:
Systematic reporting and monitoring of content
Assessment of competence (i.e., Milestones)
Systematic documentation of compliance
Program review
Paths for receiving feedback
The self-study process and the need for continuous self-monitoring line up directly with the process of strategic planning. Program administration must identify patterns and have real-time systems of data collection, analysis, tracking, and reporting.
Understanding ACGME core and detail requirements
Programs of Excellence seek not just to meet the baseline requirements set forth by the ACGME but to exceed them. Robust systems of process and quality improvement are embedded in the residency program so that efficient change can be a continuous activity that is part of the program’s administrative workflow. Programs of Excellence are nimble enough to respond to change while maintaining compliance and full accreditation. They meet new or
evolving requirements, improve systems, and respond to deficiencies using a robust set of process and quality improvement tools (e.g., Plan-Do-Study-Act [PDSA] cycles, Lean Six Sigma) that are widely used in industry to identify weakness and push change.
Core requirements
Core requirements are inflexible major areas to which the residency must adhere exactly as stated. All programs must comply with the core requirements.
Detail requirements
Detail requirements expand on some of the core requirements. They are explanatory in nature and may add information to a core statement to describe what the ACGME expects compliance with the core requirement to encompass.
New programs are expected to comply exactly with the detail requirements. By contrast, established programs without major concerns are given some leeway. These programs may judiciously use an equivalent alternative approach to meet the intent of the detail statement.
However, significant innovation around a requirement should always be cleared in advance with the ACGME Review Committee.
Build continuous quality improvement into accreditation processes
Programs of Excellence seek not just to meet the baseline requirements set forth by the ACGME but to exceed them. Robust systems of process and quality improvement are embedded in the residency program so that efficient change can be a continuous activity that is part of the program’s administrative workflow.
Programs of Excellence are nimble enough to respond to change while maintaining compliance and full accreditation. They meet new or evolving requirements, improve systems, and respond to deficiencies using a robust set of process and quality improvement tools (e.g., Plan-Do-Study-Act [PDSA] cycles, Lean Six Sigma) that are widely used in industry to identify weakness and push change.
Support process and quality improvement in the residency program
Key factors and activities that support effective change in the residency program and promote progress include the following:
Key members of the residency administration include the program director (PD), associate PD, administrator, and coordinator. Appropriate recruitment, education, and retention are essential. Recruitment of appropriate staff depends on the organization’s human resources/recruiting staff’s understanding of the unique attributes of commonly hired positions relative to the educational needs of the program (e.g., information technology [IT] staff) and the positions unique to residency programs (e.g., residency coordinators and/or managers).
- The residency coordinator and/or manager is an essential part of every
residency program’s administration. Their many roles include providing essential accreditation system organization, supporting the PD and faculty, and supporting residents and fellows. They can provide an early warning to the PD about areas in which compliance lags to help monitor resident engagement, provision of information by the residents, work-hour compliance, and proactive scheduling. They are also core personnel that can help identify areas for process improvement. - The residency program or sponsor’s IT staff must be responsible for and responsive to data collection and processing of information essential to the accreditation process. The residency coordinator also plays a key role in helping to monitor data collection and progress toward resident goals by ensuring the flow of ongoing, accurate, and current data from IT and from residents documenting experiences.
Core faculty must be thoroughly educated in the accreditation requirements, including the need to monitor residents’ acquisition of required experiences. The faculty advisor role is essential for monitoring the successful outcome of individual resident’s educational needs to ensure graduates’ success and keep the program in full compliance.
Programs can identify areas of curricular weakness by conducting an annual review of curriculum to determine compliance with the Review Committee for Family Medicine (RC-FM) requirement for accreditation and by using In-Training Examination (ITE) scores. An active and engaged Program Evaluation
Committee (PEC), with support staff to assist in gathering data and monitoring and tracking interventions and recommendations, is key to ongoing assessment and improvement. To proactively ensure quality, programs may seek external validation of innovations and programmatic compliance (e.g., through a formal external program review).
The Common Program Requirements and the Institutional Requirements are in rapid evolution, as are their interpretation and best practices for their implementation. Program leadership must actively participate in continuous learning about application, interpretation, and best practices through attendance at appropriate educational conferences and other activities. Leadership and faculty should be encouraged to innovate and to present their curricular innovations at national educational forums.
Community and health system concerns may impede the program’s achievement of some of the ACGME requirements for accreditation. Sponsoring institutions (SIs), hospitals, and clinical systems also have priorities that could be viewed as conflicting with a residency program’s educational mission and requirements. Actively engaging hospital and clinical administration in the educational process with the PD is essential to gain understanding and support for required activities and to promote appropriate participation by the larger physician community. In partnership with the SI or other physician leadership, the PD must identify and directly address productivity pressure on the clinical system, data “protection” in the
system, institutionalized and/or historical community standards, and scopes of
practice. Program requirements specific to family physicians who provide maternity care, inpatient adult and pediatric care, and procedural care must be recognized as mandatory, and residents must be able to acquire these skills in a supportive environment.
A Program of Excellence has resources for residents who need academic support (e.g., test-taking skills, remediation of deficits in clinical reasoning and/or understanding of core knowledge content). It also offers confidential employee assistance programs and other resources to address behavioral health concerns and needs. The standard curriculum is structured, documented, and tracked to guarantee each resident has the learning experiences necessary to meet each core requirement, and the program can redirect residents’ work if they fall behind.
Best practices for residency accreditation self-assessment
Benchmarks for self-assessment can be a helpful starting point for improvement, either to define future goals or to identify areas of success. The following describe best practices seen in a Program of Excellence:
The self-study/accreditation cycle length and the number of resolved and unresolved citations or concerns reflect overall compliance with RC-FM requirements. For a Program of Excellence, a self-study cycle length of 10 years with no stated areas of concern or past lingering citations is the goal or current state.
Milestone tracking throughout residency proactively identifies program- wide and individual resident concerns to ensure that plans for curriculum, schedules, and individual mentoring can occur as needed. The Clinical Competency Committee (CCC) functions independently of the PD. The PD makes promotion and graduation decisions based on the CCC’s recommendations in all or most cases.
A Program of Excellence encourages continuous professional development by faculty and provides resources so leadership can acquire information on evolving accreditation systems and requirements on an ongoing basis. Faculty and leadership get encouragement and support to learn and share best practices in resident education by participating in and contributing to national educators’ forums annually.
A Program of Excellence has robust self-assessment tools that support continuous review of current accreditation status and point toward an ideal future state. The PEC meets regularly and is charged with providing an in- depth, interdisciplinary document annually. This Annual Program Evaluation proactively identifies potential deficiencies and areas for growth, as well as any accreditation threats or concerns. Recommendations for improvement are tied to timelines and specific outcomes with clearly delineated responsibilities for achievement. Progress and success in addressing action items is specifically reported upon in subsequent annual reviews.
Board passage rate in a highly functioning program is 100%, with rare exceptions. Residents who have knowledge and/or test-taking skill issues are identified early in residency and given support to remediate these weaknesses.
Key resources
- Allen S. Learning from the implementation of Milestones. Fam Med. 2021;53(7):593-594.
- Clements DS, Holmboe ES, Newton WP. Milestones in family medicine: lessons for the specialty. Fam Med. 2021;53(7):618-621.
- Hoekzema GS, Cagno CK. A wealth of data, a paucity of outcomes: what can we learn from the ACGME Accreditation Data System? Fam Med. 2021;53(7):580-582.
- Newton WP, Mitchell KB. Shaping the future of family medicine: re-envisioning family medicine residency education. Fam Med. 2021;53(7):490-498.