Quality of the World Professional Association for Transgender Health Guideline Standards of Care 8: An Appraisal Using the AGREE II Instrument

Abstract

In 2022, the World Professional Association for Transgender Health (WPATH) released their guidelines, Standards of Care Version 8 (SOC8), which have been regarded as establishing standards for the management of transgender patients. To conduct a quality assessment of the WPATH’s SOC8 using the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument, we recruited a diverse group of international health professionals as assessors, including six clinicians and two guideline methodologists, who were trained in the AGREE II tool and underwent a calibration exercise. They independently assessed six SOC8 chapters: adolescents, children, hormone therapy, mental health, primary care, and surgery. We summarized the ratings across assessors for all items to present the strengths and limitations of the guidelines. The evaluations identified that the SOC8 chapters had limitations in the AGREE II domains of applicability (ranging from 28% to 40% across chapters), editorial independence (ranging from 43% to 44% across chapters), and rigor of development (ranging from 39% to 47% across chapters). On a scale of 1 to 7 (7 = highest quality), the median overall quality score was 3.5 to 4 for all chapters. Two of eight assessors recommended using the guideline chapters, while three recommended use with modification, and three recommended not to use the reviewed guideline chapters due to methodological concerns. Evidence-based guidelines addressing the needs of transidentified people are urgently needed, but it is imperative that healthcare providers, researchers, and policymakers recognize and address the limitations present in these six SOC8 chapters.