- Letter to the Editor
- Open access
- Published:
The conundrum of guidelines, recommendations, and strength of recommendation
Ain-Shams Journal of Anesthesiology volume 11, Article number: 23 (2019)
To the Editor,
Clinicians often get perplexed by the ever-updating evidence, recommendations, and guidelines in their respective specialties and subspecialties. The United States Department of Health and Human Services Agency for Health Care Policy and Research drafted the “Statements of Evidence and Grades of Recommendations” which is shown in Tables 1 and 2 (United States Department of Health and Human Services Agency for Health Care Policy and Research 1993). Practice guidelines released by experts provide recommendations for managing a particular disease or justification for a particular intervention and treatment modality. They are either evidence-based, i.e., based on systematic reviews or meta-analysis or are consensus statements, i.e., based on expert opinion made by certain societies based on the currently available evidence (Atkins et al. 2004).
These recommendations are made after a detailed review of the advantages and disadvantages of a particular modality for a given clinical situation or an intervention. Recommendations also depend on the clinical question under evaluation and the most appropriate study suitable for finding an answer to that question. The recommendation is low if the type of study used to find the answer is not appropriate. These recommendations are usually graded based on current evidence along with rating the quality of evidence from which the information is gathered. Level of evidence is described as high (high confidence that the evidence reflects the true effect), moderate (moderate confidence that the evidence reflects the true effect), low (low confidence that the evidence reflects the true effect), insufficient, or very low (evidence either is unavailable or does not permit a conclusion) (Definition of levels of evidence (LoE) and overall strength of evidence (SoE) 2015).
The recommendations should be easy to understand, generated from unbiased, robust evidence, and practical to use and implement. Confounding factors, publication bias, and inappropriate study designs all lead to misinterpretation of pooled data, thereby leading to the formulation of practical guidelines which are not only based on low-quality evidence but also lead to the implementation of scientifically incorrect guidelines.
The grading system usually used to have several flaws like the confusion between the strength of recommendations and quality of evidence leading to misinterpretation, lack of transparent judgments, and difficulty to implement on occasions. To overcome these issues and to have a comprehensive, unbiased evidence-based recommendation, GRADE (Grading of Recommendations, Assessment, Development and Evaluations) system was introduced. GRADE system is used to derive recommendations for systematic reviews and guidelines. GRADE differs from other tools because it separates the quality of evidence and strength of recommendation, quality of evidence is assessed for each outcome, observational studies can be upgraded if they meet certain criteria, and language used is simple and not confusing to clinicians implementing guidelines (Goldet and Howick 2013).
The GRADE approach rates the quality of evidence by analyzing the study design, i.e., randomized trials, case-control studies, cohort studies, and observational studies. Based on the study design, GRADE either rates down the quality of evidence (by analyzing 5 reasons: limitations in study design, inconsistent results, indirect evidence, imprecision, and publication bias) or rates up the quality of evidence (by analyzing 3 reasons: large magnitude of effect, dose-response gradient, and less confounding factors (Zhang et al. 2018).
Four factors determine the direction and strength of recommendation. They are balance between desirable and undesirable outcomes, confidence in values and preferences, quality of evidence, and costs of the intervention. GRADE describes two categories of the strength of a recommendation: strong and weak. The strength of a recommendation implies the extent to which a guideline is confident about the desirable effects of an intervention or treatment outweighing undesirable effects. GRADE ranking of recommendation is shown in Table 3.
GRADE system is used by many societies to draft guidelines and recommendations; the recent one is that of Missair et al.’s “Impact of perioperative pain management on cancer recurrence: an ASRA/ESRA (American Society of Regional Anesthesia/European Society of Regional Anesthesia) special article” in Regional Anesthesia and Pain Medicine Journal (Missair et al. 2019).
To conclude, clinicians should know and understand the methodology used for drafting guidelines and recommendations. GRADE system is used by many researchers and guideline makers which describe the quality and strength of recommendation. The ease of using the GRADE system and the simple language used in describing the details are possibly the reasons why the system is preferred.
Availability of data and materials
Not applicable
Abbreviations
- ASRA/ESRA:
-
American Society of Regional Anesthesia/European Society of Regional Anesthesia
- GRADE:
-
Grading of Recommendations, Assessment, Development and Evaluations
References
Atkins D, Best D, Briss PA et al (2004) Grading quality of evidence and strength of recommendations. BMJ. 328(7454):1490
Definition of levels of evidence (LoE) and overall strength of evidence (SoE). Global Spine J. 2015;5:262
Goldet G, Howick J (2013) Understanding GRADE: an introduction. J Evid Based Med 6:50–54
Missair A, Cata JP, Votta-Velis G, Johnson M, Borgeat A, Tiouririne M et al (2019) Impact of perioperative pain management on cancer recurrence: an ASRA/ESRA special article. Reg Anesth Pain Med 44:13–28
United States Department of Health and Human Services Agency for Health Care Policy and Research. Acute pain management: operative or procedures and trauma. The Agency 1993; Clinical Practice Guideline No. 1; No. 92–0023-0107
Zhang Y, Akl EA, Schünemann HJ (2018) Using systematic reviews in guideline development: the GRADE approach. Res Synth Methods. https://doi.org/10.1002/jrsm.1313 [Epub ahead of print]
Acknowledgements
Not applicable
Funding
Not applicable
Author information
Authors and Affiliations
Contributions
ASN contributed to the concepts, design, literature review, manuscript preparation, and image permission and design. SD contributed to the manuscript review, final draft, and literature review. Both authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable
Consent for publication
Not applicable
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Nair, A.S., Diwan, S. The conundrum of guidelines, recommendations, and strength of recommendation. Ain-Shams J Anesthesiol 11, 23 (2019). https://doi.org/10.1186/s42077-019-0041-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s42077-019-0041-y