AAFP Criteria for Performance Measures
Physician level clinical performance measures may be used for local improvement efforts, public reporting, accountability or pay for performance programs. The AAFP participates in the Physician Consortium for Performance Improvement sponsored by the American Medical Association and works closely with the National Quality Forum (NQF), the National Committee on Quality Assurance (NCQA), and the Ambulatory Care Quality Alliance (AQA), all of which are involved in performance measurement development, endorsement or implementation.
The AAFP encourages the utilization of performance measures that are consistent with the criteria described below for evaluating and improving patient care.
Statement of Principles
The American Academy of Family Physicians is committed to promoting quality, cost-effective health care. The Academy supports health care quality improvement endeavors, including the development and application of performance measures (whether single or in aggregate) which have the following attributes:
- Aimed at improving important processes and outcomes of care in terms that matter to patients;
- Responsive to informed patients’ cultures, values and preferences;
- Based on best evidence and reflect variations in care consistent with appropriate professional judgment;
- Are practical given variations of systems and resources available across practice settings;
- Are cognizant of the burden of data collection, particularly in the aggregation of multiple measures;
- Assess patient well-being, satisfaction, access to care, and health status; and,
- Are updated regularly
The spirit in which performance measures are developed and applied should be one of continuous improvement. The primary purpose of performance measurement should be to identify opportunities to improve patient care. Some measures will have usefulness for accountability, public reporting or pay for performance programs.
Only the most evidence-based, widely accepted, and important measures should be used for accountability, pay for performance or other significant decisions. When comparisons are made, they should be risk-adjusted, consider differences in denominator populations and account for variations in patient preferences, values, access, and availability of services.
The value of the application of performance measures should also be assessed in terms of physician, practice and health system burden, economic costs and savings, and impact on patient-oriented outcomes that matter.
The AAFP participates in the development of performance measures by nominating family physicians to represent the membership on pertinent workgroups. This work is accomplished primarily through the American Medical Association-sponsored Physician Consortium for Performance Improvement. The Consortium has developed Physician Performance Measurement Sets which offer clinical performance tools to support physicians in their efforts to enhance quality of patient care.
The following criteria shall be used by the AAFP to evaluate performance measures.
[ top of page ]
Only the most evidence-based, widely accepted, and important measures should be used for accountability, pay for performance or other significant decisions. When comparisons are made, they should be risk-adjusted, consider differences in denominator populations and account for variations in patient preferences, values, access, and availability of services.
The value of the application of performance measures should also be assessed in terms of physician, practice and health system burden, economic costs and savings, and impact on patient-oriented outcomes that matter.
The AAFP participates in the development of performance measures by nominating family physicians to represent the membership on pertinent workgroups. This work is accomplished primarily through the American Medical Association-sponsored Physician Consortium for Performance Improvement. The Consortium has developed Physician Performance Measurement Sets which offer clinical performance tools to support physicians in their efforts to enhance quality of patient care.
The following criteria shall be used by the AAFP to evaluate performance measures.
[ top of page ]
Importance
Grounded in science. The measure should be evidence-based, explicit, and reflect the degree of scientific certainty. The aim of the measure should be to improve outcomes that are meaningful to patients. When intermediate processes of care are assessed, the causal pathway to improved patient-oriented outcomes should be strong.
Substantial potential for improvement. A significant gap should exist between optimal and current clinical practice. The gap should be amenable to substantial improvement by means of feasible interventions.
Severity and prevalence. The condition and its prevalence in the population should be significant enough to justify targeting the condition for improvement.
Substantial impact. The measure should be patient-centered, hold the potential for substantial impact on the health status, health outcomes, and satisfaction of individual patients and be capable of maintaining and/or improving the health of a community or population of patients.
Relevant. The measure should be important to physicians and their patients and should be amenable to evaluation.
Improve value. Measures should have the potential to improve value of health services for patients, plans, and purchasers of health care.
[ top of page ]
Substantial potential for improvement. A significant gap should exist between optimal and current clinical practice. The gap should be amenable to substantial improvement by means of feasible interventions.
Severity and prevalence. The condition and its prevalence in the population should be significant enough to justify targeting the condition for improvement.
Substantial impact. The measure should be patient-centered, hold the potential for substantial impact on the health status, health outcomes, and satisfaction of individual patients and be capable of maintaining and/or improving the health of a community or population of patients.
Relevant. The measure should be important to physicians and their patients and should be amenable to evaluation.
Improve value. Measures should have the potential to improve value of health services for patients, plans, and purchasers of health care.
[ top of page ]
Measurability
Accurate and reliable. The measure should be clearly defined, reliable, and consistent across different practice settings.
Valid. The measure is scientifically valid and based on high quality evidence of efficacy and effectiveness. There is face validity, indicating obvious appropriateness or agreement by experts; and, construct validity, indicating a comprehensive picture of the care being provided. Comparisons should be statistically valid, risk-adjusted and account for differences in denominator populations or patient settings. The translation of best evidence of effectiveness into practice should be demonstrated.
Precisely defined and specified. The measure specifications should include:
Valid. The measure is scientifically valid and based on high quality evidence of efficacy and effectiveness. There is face validity, indicating obvious appropriateness or agreement by experts; and, construct validity, indicating a comprehensive picture of the care being provided. Comparisons should be statistically valid, risk-adjusted and account for differences in denominator populations or patient settings. The translation of best evidence of effectiveness into practice should be demonstrated.
Precisely defined and specified. The measure specifications should include:
- The rationale or intent of the measure;
- A description of the performance measure population;
- A well-defined denominator with clear inclusion and exclusion criteria;
- Defined sampling procedures, when applicable;
- Defined data elements and data sources;
- Instructions for collecting data for the measure; and,
- Provide that data are able to be verified by the practice/physicians that is being assessed.
Easily interpreted. The measure can be interpreted consistently by those using the information.
Risk adjusted. If the measure is intended for meaningful comparison with the performance of others, it should be risk adjusted, as possible and appropriate. Consideration should be given to variations given differences in practice settings, patient preferences, cultural and social factors, and appropriate physician-patient decision-making. While adjustment should consider characteristics that impact health outcomes among different populations, including those beyond a health system’s control, it is important to retain accountability for developing systems and processes that strive for continuous quality improvement.
[ top of page ]
Risk adjusted. If the measure is intended for meaningful comparison with the performance of others, it should be risk adjusted, as possible and appropriate. Consideration should be given to variations given differences in practice settings, patient preferences, cultural and social factors, and appropriate physician-patient decision-making. While adjustment should consider characteristics that impact health outcomes among different populations, including those beyond a health system’s control, it is important to retain accountability for developing systems and processes that strive for continuous quality improvement.
[ top of page ]
Achievability
Improvement attainable. The health outcome goal of the measure can be achieved, or an improvement can be accomplished, in the settings in which it is applied.
Reasonable cost. The measure should not impose an inappropriate financial burden on those collecting the data. The cost of collecting the data and affecting improvements should be justified by impact on patient-oriented outcomes. There should be alignment between the cost of data measurement and performance improvement and funds dedicated to these processes.
Feasible. The measure should be feasible for a physician to meet. For example,
Reasonable cost. The measure should not impose an inappropriate financial burden on those collecting the data. The cost of collecting the data and affecting improvements should be justified by impact on patient-oriented outcomes. There should be alignment between the cost of data measurement and performance improvement and funds dedicated to these processes.
Feasible. The measure should be feasible for a physician to meet. For example,
- Data for the measures are readily available;
- Patient confidentiality must be maintained;
- The number of required measures is reasonable;
- Realistic time frames are allowed for data collection;
- To the extent possible, measures and specifications should remain consistent over a period of time long enough to complete a cycle of improvement;
- Instructive materials should accompany performance measures;
- Consideration is given to variation given differences in practice settings, patient preferences, cultural and social factors, and appropriate physician-patient decision-making;
- Performance improvement can be implemented and maintained with reasonable effort; and,
- The measurement is current and cost-effective.
