This was successfully posted to your pofile.
This box will close automatically in a few seconds. Close this window
We don't have an e-mail address on file for you. To use AAFP Connection, you must have an e-mail address in our records. Click Here
New Research on Performance Measurement
Few Primary Care Practices Large Enough for Reliable Measurement of Quality, Costs
By News Staff
"It is unlikely that individual primary care physicians annually see a sufficient number of eligible patients to produce statistically reliable performance measurements on common quality and cost measures, calling into question whether their performance can be differentiated with respect to national benchmarks," say the study authors.
The study, which appears in the Dec. 9 issue of the Journal of the American Medical Association, is significant in light of the fact that CMS has invested in programs such as the Physician Quality Reporting Initiative and numerous pay-for-performance demonstration projects around the country.
The researchers calculated the national mean Medicare costs for ambulatory care using reimbursement data from a 2005 Part B sample. Process measures of quality were quality indicators identified in 2005 Part B claims data -- mammography for women ages 65-69 and hemoglobin A1c testing for individuals with diabetes ages 65-75. Outcome measures of quality used also were drawn from 2005 claims data -- preventable hospitalizations associated with any of 13 adult ambulatory care-sensitive conditions, as well as hospital readmission for any reason within 30 days of discharge for congestive heart failure.
The study authors note that they chose the 10 percent marker because they thought it represented a meaningful difference and an appropriate starting point for measuring costs and quality.
After analyzing one year of caseload samplings, the researchers found that
- virtually no practices with fewer than six physicians had enough patients to detect the desired 10 percent relative difference in costs or in any quality measure;
- about 9 percent of practices with six to 10 physicians had a sufficient number of patients to detect a 10 percent relative difference in costs;
- less than 3 percent of any primary care physician practices could detect 10 percent relative differences in mammography or hemoglobin A1c testing.
Researchers also found that more than half of practices with 21-50 physicians and all practices with more than 50 physicians had enough patients to detect 10 percent relative differences in costs, mammography and hemoglobin A1c testing. However, no physician practices had large enough caseloads to detect relative differences for preventable hospitalization or 30-day readmission after discharge for congestive heart failure.
Implications for Value-Based Purchasing
"Only the largest primary care physician practices, which are also the most uncommon," would have sufficient numbers of patients to measure significant differences in performances, say the authors.
Without a majority of physicians with caseloads large enough to detect the 10 percent relative differences, the authors suggest formulating new approaches to performance measurement in ambulatory care.
For example, patients could be pooled from all payer sources or pooled across a variety of measures rather than for each single measure. Another suggestion is to measure performance during a two- to three-year period.
Researchers note that the medical home recently has been identified as a model of care that works well in terms of identifying an accountable entity responsible for delivering a patient's care. However, the authors note, their findings "suggest that it would be extremely difficult to surmount the limitations of performance measurement for a medical home the size of the typical primary care physician practice."
In addition, because the study indicates that practices need at least 50 or more primary care physicians to be able to make reliable measurements, the authors question whether smaller practices could be aggregated into "virtual groups of networks" of more than 50 physicians.
Finally, the researchers conclude that their study results "call into question the wisdom of pay-for-performance programs and quality reporting initiatives that focus on differentiating the value of care delivery to the Medicare population by primary care physicians."