The randomized controlled trial occupies an ambivalent position within the Seba depth-psychology corpus. On one side stand empirically oriented researchers—Chambless and Hollon, Miller and Wilbourne, McPheeters, and the systematic-review tradition broadly—who treat the RCT as the methodological gold standard for establishing treatment efficacy, the necessary foundation upon which any claim to ‘empirically supported therapy’ must rest. On the other side, voices such as Roesler and de Maat document the uncomfortable fact that depth-psychological modalities—Jungian and psychoanalytic therapies preeminently—have generated naturalistic outcome evidence rather than RCT evidence, raising the question whether the RCT’s requirements of randomization, blinding, and homogeneous samples systematically disadvantage relational and long-form treatments. Chambless and Hollon acknowledge this tension directly, noting that RCT participants, though selected for homogeneity, are not necessarily less complex than clinical populations, and that efficacy findings require extension into effectiveness and cost-utility research before their generalizability is assured. Miller’s Mesa Grande project sharpens the epistemological stakes: methodological quality of clinical trials, not mere RCT designation, determines inferential strength. Taken together, the corpus treats the RCT not as a transparent window onto therapeutic truth but as a contested instrument whose authority depends on design logic, allegiance effects, attrition management, and the degree to which standardized conditions can capture the interpersonal reality of psychotherapy.
there is a widespread belief that the patients studied in RCTs are necessarily less complex and easier to treat than the patients typically encountered in everyday clinical practice. However, this is not necessarily true.
Chambless and Hollon challenge the assumption that RCT samples are unrepresentative of clinical populations, defending the external validity of efficacy trials while acknowledging their design limitations.
, Defining Empirically Supported Therapies, 1998thesis
a project that has now spanned more than a decade, to evaluate by objective criteria the methodological quality of clinical trials in the alcohol field
Miller’s Mesa Grande project proposes that inferential strength in the alcohol treatment literature depends on rigorous methodological scoring of controlled trials rather than RCT status alone.
, Mesa Grande: a methodological analysis of clinical trials of treatments for alcohol use disorders, 2002thesis
two levels of inferential strength of design were used to designate an OLS when the study failed to provide support for the specific efficacy of a treatment modality
Miller formalizes a hierarchy of inferential confidence within controlled-trial designs, distinguishing placebo-controlled from active-comparator studies in the assignment of methodological weight.
, Mesa Grande: a methodological analysis of clinical trials of treatments for alcohol use disorders, 2002thesis
the greatest weight should be given to efficacy trials but that these trials should be followed by research on effectiveness in clinical settings and with various populations and by cost-effectiveness research
Chambless and Hollon position the RCT-based efficacy trial as the first but not final word in establishing empirically supported therapies, requiring subsequent effectiveness and cost-utility evidence.
, Defining Empirically Supported Therapies, 1998thesis
meta-analyses do not eliminate the need to make informed judgments about the quality of the studies reviewed, and, all too often, the people who conduct these analyses know more about the quantitative aspects of their task than about the substantive issues
Chambless and Hollon caution that aggregating RCT data through meta-analysis does not substitute for expert substantive judgment about individual study quality and allegiance effects.
, Defining Empirically Supported Therapies, 1998supporting
Prospective, naturalistic outcome studies and retrospective studies using standardized instruments and health insurance data as well as several qualitative studies of aspects of the psychotherapeutic process will be summarized.
Roesler’s review of Jungian psychotherapy evidence implicitly contests RCT primacy by marshaling naturalistic and qualitative designs as legitimate evidence for depth-psychological treatment effectiveness.
, Evidence for the Effectiveness of Jungian Psychotherapy: A Review of Empirical Studies, 2013supporting
RCT = randomized controlled trial; RoB = risk of bias.
McPheeters’s systematic review operationalizes RCT evidence through structured risk-of-bias assessment, treating randomization, allocation concealment, and attrition as the key quality determinants.
, Pharmacotherapy for Adults With Alcohol Use Disorder in Outpatient Settings: Systematic Review, 2023supporting
Withdrawals due to AEs 16; 5,480 Medium to high; RCTs Inconsistent Direct Imprecise RR, 1.16 (0.86 to 1.56) Low
McPheeters demonstrates how evidence grading within an RCT-based systematic review degrades from ‘moderate’ to ‘low’ strength when findings across trials are inconsistent or imprecise.
, Pharmacotherapy for Adults With Alcohol Use Disorder in Outpatient Settings: Systematic Review, 2023supporting
naltrexone are currently being further tested, individually and in combination with each other and with psychotherapy, within the multi-site COMBINE study
Miller identifies the COMBINE study as a methodological benchmark—multi-site, controlled, combining pharmacotherapy and psychotherapy arms—that defines best-practice RCT design in the alcohol field.
, Mesa Grande: a methodological analysis of clinical trials of treatments for alcohol use disorders, 2002supporting
in a meta-analysis of PTSD treatment studies, Bradley and colleagues
Lanius situates CBT’s PTSD evidence base within meta-analytic synthesis of controlled trials, using RCT-derived data to guide decisions about therapy-client matching in trauma treatment.
, The impact of early life trauma on health and disease the, 2010supporting
Behavior change counseling in the emergency department to reduce injury risk: A randomized, controlled trial.
Miller cites a randomized controlled trial of brief motivational intervention in an emergency department as part of the growing evidentiary scaffold for motivational interviewing’s efficacy.
, Motivational Interviewing: Helping People Change, Third Edition, 2013aside