Evidence-Based Therapy: Science or Marketing?
Expert therapists know better than to follow treatment manuals
Posted October 2, 2013
A study from a prestigious psychology journal recently crossed my desk. It found that therapists who provide cognitive behavior therapy or CBT—including the most experienced—routinely depart from CBT techniques described in CBT treatment manuals. “Only half of the clinicians claiming to use CBT use an approach that even approximates to CBT,” the authors wrote.1
This is not surprising, since treatment manuals do not improve outcomes and therapists in the real world naturally adapt their approaches to the needs of individual patients. Their practice methods evolve over time as they learn through hard-won experience what is helpful to patients and what isn’t.
In fact, studies show that when CBT is effective, it is in part because the more skilled practitioners depart from the manuals and use methods that are fundamentally psychodynamic. These include open-ended, unstructured sessions (versus following an agenda from a manual), working with defenses, focusing on the therapy relationship as a window into problematic relationship patterns, and drawing connections between the therapy relationship and other relationships.
So the research finding was no surprise. Something would be seriously amiss if experienced clinicians practiced like beginners, following an instruction manual like a consumer trying to assemble an appliance. What caught my eye was the authors’ conclusion that clinicians should be trained to adhere to CBT interventions “to give patients the best chance of recovery.”
The study did not measure outcomes and the authors actually had no idea which therapists were effective or which patients got better. They just declared, without evidence, that departure from treatment manuals means worse therapy. This presumption—which flies in the face of actual scientific evidence—slipped right past the “evidence-oriented” reviewers and editors of a prestigious research journal. They probably never gave it a second thought.
The Big Lie
Academic researchers have appropriated the term “evidence based” to refer to a group of therapies conducted according to instruction manuals (“manualized” therapies). The other things these therapies have in common are that they are typically brief, scripted, and almost exclusively identified with CBT. The term “evidence-based therapy” is also, de facto, a code word for “not psychodynamic.”
It doesn't matter that scientific research actually shows that psychodynamic therapy is at least as effective (see my article, The Efficacy of Psychodynamic Psychotherapy or for a popularized version, Getting to Know Me: What's behind psychoanalysis). Advocates of “evidence-based therapy” often denigrate psychodynamic treatment (or rather, their mistaken stereotypes and caricatures of it). When they use the term “evidence based,” it is often with an implicit wink and a nod and the unspoken message: “Manualized treatment is Science. Psychodynamic treatment is superstition.”
Some explanation is in order, since this is not how things are usually portrayed in textbooks or university classrooms. In past decades, most psychotherapists practiced psychodynamic therapy or were strongly influenced by psychodynamic thought. Psychodynamic therapies aim at enhancing self-knowledge in the context of a meaningful relationship between therapist and patient.
Psychodynamic or psychoanalytic clinicians in the old days were not especially supportive of empirical research. Many believed therapy required a level of privacy that precluded independent observation. Many also believed that research could not measure crucial treatment benefits like self-awareness, freedom from inner constraints, or deeper relationships with others. In contrast, academic researchers routinely conducted controlled research trials comparing manualized CBT to control groups. These manualized forms of CBT were therefore called “empirically validated” (the preferred term later morphed into “empirically supported” and most recently, “evidence based”).
No research ever suggested that manualized CBT was more effective than psychodynamic therapy. It was just more often researched. There is a world of difference between saying a treatment is less often researched and saying it has been scientifically discredited. But academic researchers routinely blurred this distinction, sometime carelessly and sometimes knowingly and disingenuously. A culture developed in academic psychology that promoted a myth that manualized CBT had proven superior. Some academic researchers—those with little regard for actual scientific evidence—even began saying it was "unethical" to practice psychodynamic therapy because research showed CBT was more effective. The only problem is that research showed nothing of the sort.
This may shed some light on why the authors of the study I described above could so glibly assert that therapists should adhere to CBT treatment manuals "to give patients the best chance of recovery"—and how this falsehood sailed right through the editorial review process of a reputable research journal.
Stay tuned for future posts (here), where I will discuss whether patients who receive “evidence-based therapies” actually get well. The answer may surprise you.
© 2013 by Jonathan Shedler, PhD
1Waller, G., Stringer, H. Meyer, C. (2012). What cognitive behavioral techniques do therapists report using when delivering cognitive behavioral therapy for the eating disorders? Journal of Consulting and Clinical Psychology, 80, 171-175. doi: 10.1037/a0026559