Are clinical guidelines designed according to guidelines? Cross-sectional assessment of quality and transparency of clinical guidelines in urology

Purpose Guidelines and recommendations become increasingly important in clinical urologic practice. This study aims to inform clinicians using guidelines on how to evaluate the quality of the methodology and transparency of these documents. Methods The guidelines on management of castration-resistant prostate cancer of the American Urology Association, European Association of Urology, National Comprehensive Cancer Network, National Institute for Health and Care Excellence, European Society of Medical Oncology were reviewed using the AGREE-II tool (Appraisal of Guidelines for Research and Evaluation). We reported and compared the domain scores for the domains 1 scope and purpose, 2 stakeholder involvement, 3 rigor of development, 4 clarity of presentation, 5 applicability, and 6 editorial independence (100% indicates highest-best quality score). Results The domains evaluated highest and with lowest variability were 'editorial independence' (92% {88-95%}) and 'clarity of presentation' (83% {72-90%}), while the domains with the lowest scores and most variability were 'stakeholder involvement' (56% {36-79%}) and 'applicability' (40% {30-63%}). Length and extent of detail of guidelines vary considerably, each with its own strengths and limitations and adapted to target users. Standard external review using AGREE criteria may be preferable. A formal search strategy was not performed. Findings may be outdated by guidelines' updates. Conclusions Clinicians using practice guidelines need to be aware of the different domains of methodology and transparency used to assess the quality of guidelines contents and recommendations. Patient summary Urologists increasingly use guidelines for support in evidence-based recommendations in clinical practice. It is very important to know how to assess these documents. This study applies standard criteria to compare the design and background of different available guidelines on prostate cancer no longer responding to hormonal treatment.