Am Fam Physician. 2013 Dec 1;88(11):733-738.
An article in American Family Physician summarizing the top 20 research studies of 2011 reported on a number of practical, patient-oriented findings.1 One striking feature of this article is the inclusion of several studies that challenge traditional medical opinion. In the 1990s, for example, high-carbohydrate, low-fat diets were all the rage; now the Mediterranean diet is shown to have better results in managing and preventing disease. Other studies show that using tight control in patients with diabetes mellitus has produced fewer benefits than previously thought, and long-term treatment with bisphosphonates does not reduce the risk of femoral neck fracture.
These examples highlight just a few of the time-honored treatment recommendations we have had to rethink in the past few decades. In a reversal that is now well-accepted, the U.S. Preventive Services Task Force recently recommended against hormone therapy as a preventive measure against chronic disease in postmenopausal women.2 Yet 20 years ago, a gynecology textbook advised physicians that hormone therapy was the “main treatment” for climacteric symptoms and to prevent long-term adverse effects, such as osteoporosis, cardiovascular disease, and urogenital atrophy.3 Although there is now greater public awareness of the potential risks of hormone therapy, which except for limited use in managing symptoms generally outweigh the benefits, there was a time when as many as 90 million prescriptions were filled for this treatment every year.4 More recently, physicians have learned that the long-claimed reduction in post–myocardial infarction mortality associated with beta blockers may, in fact, have been overstated. This conflicts with efforts to improve physician compliance with guidelines that recommend indefinite post–myocardial infarction beta blockade.5,6 To cite yet another more recent example, physicians have also learned that in many contexts, computed tomography is not only unnecessary and costly, but potentially harmful.7–9
How is it that we have seen such dramatic modifications, if not retractions, of important practice recommendations? How can we trust that we will not make the same mistakes in the future?
Clinical recommendations may be more vulnerable to reversal when research conditions favor bias and error. For example, declining effect size when studies are replicated has been attributed to both publication bias and unconscious errors in data interpretation.10,11 Other flaws in scientific studies include the following:
Poor design and small size.10 Recommendations for hormone therapy, for example, were based on observational studies and were later challenged by prospective trials.
Focus on disease-oriented evidence.12 Disease-oriented evidence, which concentrates on surrogate markers such as blood levels, imaging findings, and results of other tests, is often conflicting and inconsistent. Studies that measure patient-oriented outcomes, which address morbidity, mortality, and quality of life, often follow (and contradict) disease-oriented outcomes. In the case of hormone therapy, high-density lipoprotein levels were improved, but patient-oriented cardiovascular outcomes were not affected.
Application of findings to nonstudy populations. The use of erythropoietin for anemia in patients on dialysis was expanded to treat anemia across a broad spectrum of patients without benefit. In some cases, this treatment caused serious harm.13 Recommendations of tight control in type 1 diabetes were applied to some groups of patients with type 2 diabetes (e.g., patients with renal disease, older persons) without demonstrated benefit.14
Unidentified harms. Subsequent to recommendations, follow-up studies raise questions about adverse effects of medications, such as the potentially deleterious cardiovascular effects of calcium supplementation.15 Studies can also raise questions about harms associated with technology (such as radiation exposure from computed tomography) and testing (such as the harms of interventions initiated based on prostate-specific antigen testing exceeding the benefits of this testing).16
Economic factors. Economic conflicts of interest encourage harmful or unproven technologies and treatments (e.g., pharmaceutical companies that pressured physicians to expand use of erythropoietin)17; public pressure creates demand (e.g., increased prostate-specific antigen screening in response to widespread fear of prostate cancer) and high-profile media coverage of medical “breakthroughs” may be unwarranted or premature.
Where do these observations leave us? Fortunately, primary care physicians are well-adapted to medical uncertainty. To minimize the dizzying impact of changing recommendations, physicians should focus on patient-oriented evidence, and not be distracted by disease-oriented evidence.1 Physicians should become familiar with the basic principles of good research, and avoid drawing premature conclusions from observational studies or studies with design flaws.18 Physicians should also recognize the pharmaceutical industry's influence on research studies and practice recommendations.19
Adherence to current standards of care and shared decision making should be coupled with a well-reasoned reticence in responding to new findings.18 Clinical experience matters, and the insight a family physician acquires from knowing patients (and often, their families) is another invaluable tool. Treatments with a strong track record should be considered proportionately more trustworthy when a new study confirms that treatment's benefit.10 Educating our patients, applying evidence judiciously, and avoiding undue influences will help us avoid the pitfalls of the ever-changing practice of medicine.
EDITOR'S NOTE: Caroline Wellbery, MD, PhD, is associate deputy editor of American Family Physician.
REFERENCESshow all references
1. Ebell MH, Grad R. Top 20 research studies of 2011 for primary care physicians. Am Fam Physician. 2012;86(9):835–840....
2. U.S. Preventive Services Task Force. Menopausal hormone therapy for the primary prevention of chronic conditions. October 2012. http://www.uspreventiveservicestaskforce.org/uspstf/uspspmho.htm. Accessed November 12, 2012.
3. Nichols DH, Sweeney PJ. Ambulatory Gynecology. 2nd ed. Philadelphia, Pa.: Lippincott; 1995:233.
4. Hersh AL, Stefanick ML, Stafford RS. National use of postmenopausal hormone therapy: annual trends and response to recent evidence. JAMA. 2004;291(1):47–53.
5. Krumholz HM, Radford MJ, Wang Y, Chen J, Heiat A, Marciniak TA. National use and effectiveness of beta-blockers for the treatment of elderly patients after acute myocardial infarction: National Cooperative Cardiovascular Project [published correction appears in JAMA. 1999;281(1):37]. JAMA. 1998;280(7):623–629.
6. Bangalore S, Steg G, Deedwania P, et al.; REACH Registry Investigators. β-blocker use and clinical outcomes in stable outpatients with and without coronary artery disease. JAMA. 2012;308(13):1340–1349.
7. Einstein AJ, Henzlova MJ, Rajagopalan S. Estimating risk of cancer associated with radiation exposure from 64-slice computed tomography coronary angiography. JAMA. 2007;298(3):317–323.
8. Smith-Bindman R, Lipson J, Marcus R, et al. Radiation dose associated with common computed tomography examinations and the associated lifetime attributable risk of cancer. Arch Intern Med. 2009;169(22):2078–2086.
9. Berrington de González A, Mahesh M, Kim KP, et al. Projected cancer risks from computed tomographic scans performed in the United States in 2007. Arch Intern Med. 2009;169(22):2071–2077.
10. Ioannidis JP. Why most published research findings are false. PLoS Med. 2005;8:e124.
11. Schooler J. Unpublished results hide the decline effect. Nature. 2011;470(7335):437.
12. Shaughnessy AF, Slawson DC, Bennett JH. Becoming an information master: a guidebook to the medical information jungle. J Fam Pract. 1994;39(5):489–499.
13. Juneja V, Keegan P, Gootenberg JE, et al. Continuing reassessment of the risks of erythropoiesis-stimulating agents in patients with cancer. Clin Cancer Res. 2008;14(11):3242–3247.
14. Finucane TE. “Tight control” in geriatrics: the emperor wears a thong. J Am Geriatr Soc. 2012;60(8):1571–1575.
15. Bolland MJ, Grey A, Avenell A, Gamble GD, Reid IR. Calcium supplements with or without vitamin D and risk of cardiovascular events: reanalysis of the Women's Health Initiative limited access dataset and meta-analysis. BMJ. 2011;342:d2040.
16. U.S. Preventive Services Task Force. Screening for prostate cancer. May 2012. http://www.uspreventiveservicestaskforce.org/prostatecancerscreening.htm. Accessed November 12, 2012.
17. Whoriskey P. Anemia drugs made billions, but at what cost? Washington Post . July 19, 2012. http://articles.washingtonpost.com/2012-07-19/business/35487840_1_anemia-drugs-aranesp-prescription-drugs. Accessed March 28, 2013.
18. Prasad V, Vandross A, Toomey C, et al. A decade of reversal: an analysis of 146 contradicted medical practices. Mayo Clin Proc. 2013;88(8):790–798.
19. Fugh-Berman A, Siwek J. Compromising the medical literature: the hidden influence of industry-biased articles. Am Fam Physician. 2011;84(5):489–490.
Copyright © 2013 by the American Academy of Family Physicians.
This content is owned by the AAFP. A person viewing it online may make one printout of the material and may use that printout only for his or her personal, non-commercial reference. This material may not otherwise be downloaded, copied, printed, stored, transmitted or reproduced in any medium, whether now known or later invented, except as authorized in writing by the AAFP. Contact firstname.lastname@example.org for copyright questions and/or permission requests.
Want to use this article elsewhere? Get Permissions