Letters to the Editor
Selecting POEMs Studies from the Larger Body of Evidence
Am Fam Physician. 2017 Nov 1;96(9):565-566.
Original Article: Top POEMs of 2015 Consistent with the Principles of the Choosing Wisely Campaign
Issue Date: October 1, 2016
Available online at: http://www.aafp.org/afp/2016/1001/p566.html
to the editor: I applaud the main intent of this article: using current evidence to critically assess testing and treatments for common conditions in family medicine. I am a fan of the daily POEMs (patient-oriented evidence that matters) series, and I regularly distribute them to my residents.
I have a question about the process of selecting articles to be POEMs. Are the articles themselves “chosen wisely”? This is most important when a single article is selected from a larger body of evidence and used to support a recommendation for practice.
For example, the article cited a randomized controlled trial (RCT) with 192 patients 1 and advised readers “… do not prescribe platelet-rich plasma injections over hyaluronic acid.” However, this is only one among numerous RCTs addressing the subject of platelet-rich plasma injections for osteoarthritis of the knee.
There are two meta-analyses of several RCTs (seven RCTs, N = 722 patients 2 and six RCTs, N = 739 patients 3) and a systematic review 4 with multiple meta-analyses (each with six to 16 RCTs and totals of 577 to 1,543 patients) all evaluating the same question. Although the meta-analyses overlap to some extent (some of the same RCTs are included in each meta-analysis), in general, they found that platelet-rich plasma injections reduced knee pain scores by approximately 25% more than hyaluronic acid for several months. This is a different conclusion than that of the single RCT discussed in this article.
Would it be possible to alter the methodology of the POEMs selection process and describe single studies in the context of the larger body of evidence?
Author disclosure: No relevant financial affiliations.
REFERENCESshow all references
1. Filardo G, Di Matteo B, Di Martino A, et al. Platelet-rich plasma intra-articular knee injections show no superiority versus viscosupplementation: a randomized controlled trial. Am J Sports Med. 2015;43(7):1575–1582....
2. Sadabad HN, Behzadifar M, Arasteh F, Behzadifar M, Dehghan HR. Efficacy of platelet-rich plasma versus hyaluronic acid for treatment of knee osteoarthritis: a systematic review and meta-analysis. Electron Physician. 2016;8(3):2115–2122.
3. Meheux CJ, McCulloch PC, Lintner DM, Varner KE, Harris JD. Efficacy of intra-articular platelet rich plasma injections in knee osteoarthritis: a systematic review. Arthroscopy. 2016;32(3):495–505.
4. Campbell KA, Saltzman BM, Mascarenhas R, et al. Does intra-articular platelet-rich plasma injection provide clinically superior outcomes compared with other therapies in the treatment of knee osteoarthritis? A systematic review of overlapping meta-analyses. Arthroscopy. 2015;31(11):2213–2221.
in reply: Thank you for asking about the process of selecting articles to become POEMs. This is related to your concern about how to know when the evidence is ripe enough to support a change of practice.
Whereas some POEMs are based on single research studies within a larger body of evidence, knowing when POEM evidence is strong enough to spark a change of practice can be challenging. Of note, in Tables 1 through 4, we did specify that these are “clinical actions to consider for Choosing Wisely.” This is in line with the accompanying editorial, which stated that the Choosing Wisely campaign “identifies wasteful and unnecessary medical tests, treatments, and procedures—not to prohibit them but to get physicians and other health care professionals thinking more critically….” 1
Concerning your main question, in the methods section of a previous article, we provided information describing how POEMs are selected. Briefly, this process begins with a search of the tables of contents of 102 journals for original research or systematic reviews. In the discussion section of this same paper, we wrote: “A second limitation of this work is related to the process of selecting research articles for the creation of POEMs. A primary research study or systematic review that never became a POEM would not be rated in the ongoing CME program. … The extent of any selection bias in the identification of ‘POEM-worthy’ articles is unknown and therefore is a subject for research.” 2
We currently do not include Arthroscopy as one of the journals reviewed each month, but we will certainly consider adding it. Systematic reviews are often covered in POEMs, and we place high value on them as a way to synthesize the literature and help family physicians and their patients make more informed decisions. On the other hand, not all systematic reviews are of high quality; some have weak methodology or authors with conflicts of interest.3
You also ask about describing single studies in the context of the larger body of evidence. POEMs often provide some context or mention other studies. However, making them much longer (i.e., essentially writing a mini review article) would defeat the purpose by making them too long to read quickly. The POEMs provide overviews of common medical topics by the authors and editors who contribute and sustain knowledge resources, such as Essential Evidence Plus.
Author disclosure: Dr. Grad has no relevant financial affiliations. Dr. Ebell is cofounder and editor-in-chief of Essential Evidence Plus, published by Wiley-Blackwell, Inc.
1. Shaughnessy AF. Of wise choices, evidence that matters, and leaving old friends behind. Am Fam Physician. 2016;94(7):540.
2. Grad R, Pluye P, Tang D, Shulha M, Slawson DC, Shaughnessy AF. Patient-oriented evidence that matters (POEMs) suggest potential clinical topics for the Choosing Wisely campaign. J Am Board Fam Med. 2015;28(2):184–189.
3. Ioannidis JP. The mass production of redundant, misleading, and conflicted systematic reviews and meta-analyses. Milbank Q. 2016;94(3):485–514.
Send letters to firstname.lastname@example.org, or 11400 Tomahawk Creek Pkwy., Leawood, KS 66211-2680. Include your complete address, e-mail address, and telephone number. Letters should be fewer than 400 words and limited to six references, one table or figure, and three authors.
Letters submitted for publication in AFP must not be submitted to any other publication. Possible conflicts of interest must be disclosed at time of submission. Submission of a letter will be construed as granting the AAFP permission to publish the letter in any of its publications in any form. The editors may edit letters to meet style and space requirements.
This series is coordinated by Kenny Lin, MD, MPH, Associate Deputy Editor for AFP Online.
Copyright © 2017 by the American Academy of Family Physicians.
This content is owned by the AAFP. A person viewing it online may make one printout of the material and may use that printout only for his or her personal, non-commercial reference. This material may not otherwise be downloaded, copied, printed, stored, transmitted or reproduced in any medium, whether now known or later invented, except as authorized in writing by the AAFP. Contact email@example.com for copyright questions and/or permission requests.
Want to use this article elsewhere? Get Permissions