Nov-Dec 2003 Table of Contents

LETTERS

Fam Pract Manag. 2003 Nov-Dec;10(10):10-12.

Evaluating online EBM

To the Editor:

“Practical Evidence-Based Internet Resources” [July/August 2003, page 49] by Dr. Brian Alper highlights an important topic: How do physicians get answers to their questions at the point of care – and not just any answers, but answers based on the best available evidence? Unfortunately, the article and comparison table neglect the following important features of a good point-of-care, evidence-based source:

  • Are formal criteria for relevance used to filter the information for primary care physicians, reducing the amount of “noise”?

  • Is each item labeled with a “level of evidence,” or are recommendations labeled with a “strength of recommendation”?

  • Are tools provided to help clinicians apply clinical decision rules and interpret diagnostic tests?

  • Is the information fully peer-reviewed?

  • Does the source provide a tool for “foraging” (keeping up-to-date on a daily basis with new information) as well as “hunting” (searching for the answers to clinical questions)?

The article’s table also incorrectly states that InfoRetriever does not cite the best available evidence where rigorous evidence is lacking. This is simply not true; much of the information in the POEMs, diagnostic test database, Cochrane Database, Griffith’s 5-Minute Clinical Consult and practice guideline summaries (all part of InfoRetriever) fits this description. We agree that evidence-based medicine means basing decisions on the best available evidence, not the best possible evidence.

While we agree none of these tools is perfect, all provide valuable guidance to physicians at the point of care. As family physicians, we are not only in the health care business, we are in the knowledge business, and it is important that we become comfortable using advanced knowledge tools like those described in the article.

Note: The authors are co-founders of InfoPOEMs (http://www.infopoems.com).

 

Author’s response:

I appreciate the opportunity to address the concerns of the InfoPOEMs editors, who are pioneers in this area. I’d like to respond to several points:

  • DynaMed uses formal criteria for relevance based on InfoPOEMs criteria (designed for clinical alerting) and modified to update a clinical reference;

  • “Level of evidence” labels can be easily misinterpreted. The important feature for clinicians, stating methods and quality of evidence related to “facts” and recommendations, is done to varying degrees by all evidence-based resources;

  • “Foraging” tools are provided by InfoPOEMs (weekdays), DynaMed (whenever new updates warrant mass alerting), and UpToDate (“what’s new” summary every four months). This function is separate from answering clinical questions, and it warrants its own article.

Other “neglected” features were in fact addressed in the text of the article.

I stand by my original interpretation of best available evidence, defined as “high likelihood of finding research citations when the best available evidence consists of less rigorous studies.” Griffith’s 5-Minute Clinical Consult, the InfoRetriever component with greatest breadth, doesn’t typically provide research citations. The only evidence-based resources with evidence for answering a substantial proportion of clinical questions are DynaMed (55 percent) and UpToDate (34 to 45 percent).1,2,3

1. Alper BS, Stevermer JJ, White DS, Ewigman BG. Answering family physicians’ clinical questions using electronic medical databases. J Fam Pract. 2001;50:960–965.

2. Blackman D, Cifu A, Levinson W. Can an electronic database help busy physicians answer clinical questions? J Gen Intern Med. 2002;17(suppl 1):220.

3. Schilling L, Steiner J, Anderson R. Patient-specific clinical questions: ask, seek, and receive. J Gen Intern Med. 2003;18(suppl 1):255.

Note: The author is founder of DynaMed (http://www.dynamicmedical.com).

 

WE WANT TO HEAR FROM YOU

Send your comments to fpmedit@aafp.org. Submission of a letter will be construed as granting AAFP permission to publish the letter in any of its publications in any form. We cannot respond to all letters we receive. Those chosen for publication will be edited for length and style.

Copyright © 2003 by the American Academy of Family Physicians.
This content is owned by the AAFP. A person viewing it online may make one printout of the material and may use that printout only for his or her personal, non-commercial reference. This material may not otherwise be downloaded, copied, printed, stored, transmitted or reproduced in any medium, whether now known or later invented, except as authorized in writing by the AAFP. Contact fpmserv@aafp.org for copyright questions and/or permission requests.

Want to use this article elsewhere? Get Permissions


Article Tools

  • Print page
  • Share this page
  • FPM CME Quiz

Information From Industry