Therapeutics Advances
Copyright ©The Author(s) 2018. Published by Baishideng Publishing Group Inc. All rights reserved.
World J Clin Pediatr. Feb 8, 2018; 7(1): 1-8
Published online Feb 8, 2018. doi: 10.5409/wjcp.v7.i1.1
Best practices in supervising cognitive behavioral therapy with youth
Robert D Friedberg
Robert D Friedberg, Center for the Study and Treatment of Anxious Youth, Palo Alto University, Palo Alto, CA 94304, United States
ORCID number: Robert D Friedberg (0000-0001-8821-1723).
Author contributions: This manuscript was written completely by the stated author.
Conflict-of-interest statement: The author declares no conflict of interest.
Open-Access: This article is an open-access article which was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Correspondence to: Robert D Friedberg, PhD, ABPP, ACT Professor, Director, Center for the Study and Treatment of Anxious Youth, Palo Alto University, 1791 Arastradero Rd, Palo Alto, CA 94304, United States. rfriedberg@paloaltou.edu
Telephone: +1-408-7754904
Received: November 8, 2017
Peer-review started: November 9, 2017
First decision: December 1, 2017
Revised: December 16, 2017
Accepted: January 7, 2018
Article in press: January 7, 2018
Published online: February 8, 2018

Abstract

Clinical supervision of cognitive behavioral therapy (CBT) with youth ensures better patient care and fosters trainees' professional development. However, often insufficient attention is directed toward disseminating best practices in supervision of CBT with youth. This Therapeutic Advances contribution aims to communicate the core content of supervision. Additionally, the key supervisory practices associated with CBT with youth are described. Supervisory outcomes are summarized and recommendations for supervisory practices are made.

Key Words: Cognitive behavioral therapy, Pediatric populations, Supervision

Core tip: There are several core tips in this therapeutic advances article. First, the pivotal content of supervision of cognitive behavioral therapy with youth include training in case conceptualization, ethics/laws, collaborative empiricism, guided discovery, session structure, embracing immediacy, measurement-based care, and cognitive-behavioral technique. Enactive supervision characterized by behavioral rehearsal is essential. Further, tracking trainee progress via objective rating scales and providing frequent, constructive feedback is indispensable.



INTRODUCTION

Fortunately, the state of the science of cognitive behavioral therapy (CBT) with youth is strong[1-3]. CBT shows good results with patients diagnosed with multiple disorders including depression[4], anxiety[5] obsessive-compulsive disorder[6], trauma[7], and disruptive behavior disorders[8,9].

Equipping supervisees with state-of-the-practice cognitive behavioral therapy skills for youth is an important yet very challenging training imperative. Didactic training acquired in classes and workshops is not a powerful way to change professional practices[10,11]. On-going consultation potentiates didactic training. More specifically, “consultation likely provides therapists with a venue for clarification and practice of concepts, learning concepts over time, case consultation, and using problem solving to overcome implementation barriers”[10].

Clinical supervision of CBT with youth is a multi-pronged professional activity that targets various foci[12,13]. Of course, assuring the emotional and psychological well-being of young patients is the pre-eminent goal. Additionally, building trainees skills, knowledge and attitudes is a second pivotal task. Finally, assisting supervisees with difficult patients and igniting their professional development are important undertakings. Achieving these meritorious goals is both a rewarding and challenging endeavor.

This therapeutic advances article highlights several issues. The paper begins with a discussion about the importance of supervision. Second, the common content of supervision is explicated. Next, core supervisory practices are explained. A consideration of supervisory outcomes follows. The article concludes with recommendations for proper supervision of CBT with youth.

IMPORTANCE OF SUPERVISION

In the United States, there is a growing call for evidence-based approaches for treating psychiatric disorders in youth[14]. Lack of access to good supervision is commonly seen as an obstacle to effective implementation in community contexts[15]. Many clinicians label themselves as cognitive behavioral therapists, but this self-identification does not reflect the actual behaviors demonstrated in sessions[14]. In particular, a recent study found that 71% of clinicians who self-labeled as CBT therapists failed to display evidence of CBT competence[14]. Further, there were equivalent levels of non-competence between those clinicians who did and did not identify themselves as CBT clinicians. Additionally, over 50% of community clinicians trained in CBT reported departing from the approach suggesting that CBT is not being implemented with sufficient fidelity[16]. Truth in labeling is imperative. If clinicians inaccurately claim a CBT orientation, the treatment dose is diluted and the delivery method is compromised. Competent supervision enables essential quality control. Without this quality control, clinicians are free to go rogue and suffer sizeable theoretical/technical drift.

CONTENT OF SUPERVISION

CBT clinicians are made not born. There is much to learn when becoming a cognitive behavioral therapist with youth[17]. Good CBT with youth involves numerous competencies[17-21]. Appreciating the state of the science supporting CBT and the theoretical foundations which underlie the approach is imperative. Fashioning flexible and robust case formulations is also expected. Employing guided discovery and collaborative empiricism throughout the clinical work is another vital component. Adhering to the prototypical cognitive therapy session structure is de rigeur. Of course, mastery of the variety of CBT procedures and processes such as Socratic questioning, self-instruction, problem solving, imagery, behavioral activation, social skills training, behavioral experiments, and exposure/response prevention is fundamental.

Supervision is portrayed as the “pedagogical engine” of clinical training in CBT[22]. Attention to core content areas and allocating sufficient time for training are vital. Research has indicated that in community based clinics, there is little discussion of evidence based procedures in supervision[23]. Insufficient training times are associated with trainees’ overestimation of their competence[24]. Indeed, there is much heavy lifting to do in CBT training. Therefore, supervisors must promote high level didactic, procedural, and self-reflective learning experiences in an efficient manner. Fortunately, CBT supervision is described as goal-directed, structured, time limited, and personalized to the trainee[25,26].

Supervisors and trainees are wise to remember that “cognitive therapy is work not magic”[27]. This section details the core elements embedded in good supervision of CBT with youth including training in case conceptualization, ethical and legal alertness, multicultural responsiveness, employing collaborative empiricism and guided discovery, measurement based care, technical proficiency, as well as addressing trainees’ beliefs about the clinical work.

Case conceptualization[13,17-21,28-32] is an indispensable task. In fact, case conceptualization is seen as the nucleus of good CBT practice[19]. Case formulation obviates an eclectic approach and bag of tricks mentality. Authors[33] recently argued, “We have no data to suggest that an ‘a la carte’ approach to CBT produces positive patient outcomes”. The selection, timing, and targets of various interventions are launched by case conceptualization. However, the ability to formulate cases is an acquired skill set[20,34]. Case conceptualization involves several component bits of knowledge[19,20]. More specifically, fluency in operant, classical, and social learning theory paradigms is essential. Additionally, full comprehension of theoretical tenets such as the hierarchical organizational model[35,36] and the content-specificity hypothesis[37-41] is necessary. Appreciation of socio-cultural variables and developmental vicissitudes is also pivotal. Required reading lists are encouraged to bulk up trainees’ knowledge bases. Fortunately, several excellent teaching and training resources exist[42-46]. Additionally, completing written case formulations and receiving supervisory feedback on them is also recommended[30].

Instruction in ethics and legal regulations is also necessary when supervising CBT with youth[13,17,47]. Attention to issues of confidentiality are especially important when working with young patients. Clinicians need to be ever mindful regarding WHO is their patient. Additionally, alertness to child abuse and maltreatment is a priority. Training supervisees in identifying and managing common hazardous issues such as self-injurious, suicidal, homicidal, risky sexual and substance abusing behaviors is also pivotal.

Training in collaborative empiricism[32,48] is an indispensable pedagogical task. Collaboration is especially valuable since it promotes trust and fosters experimentation with techniques[32]. The empiricism part of the equation refers to the transparent data based nature of CBT with youth. Moreover, the reliance on data coming directly from young patients and their families is linked to CBT’s phenomenological roots[49]. In particular, collaboration is a difficult practice to develop especially for supervisees who are more comfortable with either overly prescriptive or non-directive approaches.

Teaching trainees the rudiments of guided discovery is important yet quite challenging[48]. Many supervisees perceive guided discovery as a common pitfall in clinical practice[33]. Simply stated, guided discovery involves helping young patients form more adaptive conclusions and flexible attitudes based on their personal data base. Similar to collaborative empiricism, guided discovery is rooted in a hypothesis testing stance[50]. Simply stated, guided discovery facilitates the art of the possible[45]. Empathic listening, Socratic dialogues homework assignments and behavioral experiments are components of guided discovery.

Teaching trainees’ to implement the trademark session structure is another crucial task. Mood check-ins, agenda setting, processing session content, assigning homework, and eliciting feedback are the requisite components[51]. Applying a regular format to sessions is typically foreign to most beginning trainees. It is also helpful to teach them that these elements are both procedures and processes so they are less likely to apply a mechanical, stereotyped approach to session structure.

Embracing immediacy in CBT with is another core skill[52-54]. Immediacy involves addressing emotionally evocative moments in the here and now. A contemporary article contended immediacy occurs when “psychotherapeutic moments are charged with the urgency and genuineness of emotional experience in present tense and real time[53].” Immediacy in session avoids an intellectualized, emotionally sterile, and mechanical approach to CBT with young people.

Measurement based care (MBC) is another vital content element. MBC ensures accountability and collaborative monitoring of treatment progress. Simply, MBC involves regular periodic examination of patients’ functioning through a combination of symptom scales, indices of functional improvement, and patient satisfaction measures[55].

Instruction in the theory, empirical support and practice of traditional cognitive behavioral techniques is standard fare in CBT supervision with youth[56-67]. Teaching psychoeducational, behavioral tasks, cognitive restructuring techniques, and exposure procedures typically involves reading assignments, verbal discussion, modeling, and opportunities for trainees to rehearse the intervention. Of course, practice is accompanied by supervisory feedback.

Supervisees’ experience various thoughts and feelings regarding clinical work with young patients. Accordingly, processing trainees’ thoughts, feelings and actions[13,21,25-27,30,45-47,57,67-69] is an integral supervisory responsibility. Trainees hold various dysfunctional beliefs about their competence and adhere to unrelenting performance standards. Moreover, trainees may be impatient and intolerant of ambiguity. Some supervisees may be reluctant to address patients’ heightened negative affectivity. Others may fear their young patients’ anger. Trainees may also worry about risking their supervisees’ disapproval. It is not uncommon for students’ to resent getting direction from their supervisors. Regardless of the particular beliefs about their clinical work that go through supervisees’ minds, supervisors apply cognitive behavioral practices and processes such as collaboration, guided discovery, and socratic dialogues to straighten out crooked thinking during training.

SUPERVISORY PROCEDURES AND PROCESSES

Supervisees’ skills are sharpened via audio/video taped review didactic instruction, Socratic methods, modeling, behavioral rehearsal, and feedback[12,13]. The procedures and processes utilized in supervision of CBT for youth are embedded within a productive learning environment. This section discusses the deployment of audiotaped/review, enactive supervision, and structured rating scales during training.

Trainees appear to learn best from supervisory relationships that are characterized by supportiveness, authenticity, and are clinically relevant[70]. Moreover, supervisors who are respectful, knowledgeable, and collaborative appear most effective[62]. Supervisees appreciate sessions that address clinical practice[70]. In short, supervisors are well advised to cultivate a productive learning environment[30].

Audio and/or video-taped review of trainees sessions with young patients is widely recommended[12,13,18,22,23,59,60,62,63,70,71]. However, the actual use in community settings is disappointing[23,71-74]. Several studies in the United Kingdom found reviews of tapes to occur inn 6%[74] and 20% of cases[72]. Further, only 18% of supervisors studied in the United Kingdom reported reviewing tapes[72]. These low incidences also characterize supervision in the United States. Only 12% of supervisors studied employed video-tape review and 8% used audiotape[23].

Enactive supervision is recommended a best training strategy[12,13,20,30,31,69]. Behavioral rehearsal is a powerful training tool[26,63,75-78]. In a recent study[78], the procedure was defined as “a simulated interaction between a trainee and another individual”. Essentially, behavioral rehearsal facilitates learning through repeated practice. Authors[63] have argued that “providing an opportunity for trainees to experiment with nascent skills promotes greater self-efficacy and better conceptual understanding”.

Supervisors are advised to keep several guidelines for role-playing in mind[20,78]. Role-plays need to be explicitly and systematically processed. The lessons learned through the role-play need to be reviewed with the supervisee. Second, role-plays need to be emotionally similar to real life clinical scenarios in order to facilitate transfer of learning. More specifically, “if role plays are too emotionally sanitized and dissimilar to genuine therapist-patient interactions they are merely abstract intellectualized activities rather than experiential learning exercises” [20].

There is some evidence that BR is anxiety producing for trainees[79]. For instance, in one study, fewer trainees were willing to participation in a study involving performance evaluations based on BR and there was a high attrition rate. There appears to be a dose effect for BR with a 2:1 passive to active learning ratio suggested[70]. Supervisors should strike a balance between exhausting trainees with too much BR and electing to do too little practice. Additionally, behavioral rehearsal is shown to be most effective with supervisees who are most engaged in the learning process[77].

Providing positive and negative feedback to supervisees is another critical task[12,13,29,61,80]. More specifically, trainees who engaged in behavioral rehearsal tended to overestimate their performance following the role-play[81]. Further, supervisors tend to be overly complimentary perhaps in a desire to please their trainees[26]. When constructive feedback is given, the criticisms are generally vague and unstructured[26]. Feedback is important so supervisees can identify and address their smart spots, dumb spots and blind spots[20]. In particular, smart spots are strengths, dumb spots refer to gaps in knowledge, and blind spots are errors caused by lack of awareness and/or obliviousness to the patient[20].

Recording trainee progress on rating scales is an essential practice for providing feedback[12,13,21,22,57,80]. Various instruments for measuring trainee progress were recently summarized[22]. Most of the available measurement methods are based on work with trainees treating adults. The instruments emphasize application of procedural knowledge. The Cognitive Therapy Rating Scale (CTRS)[56] is a widely used gold standard. It includes 11 items evaluated on a 6 point Likert scale. The items include understanding, interpersonal effectiveness, pacing, agenda setting, feedback, homework, focus on key cognitions, strategy for change, collaboration, guided discovery, and proficiency in cognitive behavioral procedures.

The Cognitive Behavioural Therapy Scale for Children and Young People (CBTS-CYP)[64] assesses supervisees’ performance on across various competency areas. These domains include general skills, investigating, partnership, empathy, cognitive techniques, behavioral techniques, emotional techniques, formulation, and discovery experiments. Initial data indicates very sound psychometric properties.

The Cognitive Therapy Rating Scale for Children and Adolescents[65,81,82] is a promising new measure that is based on the original CTRS but is modified to fit the needs of clinicians working with young patients. It retains items addressing pacing, interpersonal effectiveness/empathy, agenda setting, feedback, homework, strategy for change, focus on key cognitions, guided discovery, collaboration, and technical proficiency. However, the CTRS-CA adds extra items evaluated clinicians’ playfulness, informality, and credibility. Initial reports indicate supervisors’ high levels of satisfaction with the instrument[83].

The Self-evaluation learning form (SELF)[83] was originally developed for supervision with psychiatric residents, but it is also applicable to work with trainees from other disciplines. The SELF tracks patient metrics and supervisees’ progress as well as summarizing content from each supervisory session. The worksheet also serves as a reminder for any homework tasks assigned to the supervisee.

Training professionals to become supervisors is an area gaining increased attention. Most recently, meta-supervision is being employed as a training procedure. Meta-supervision is defined as the circumstance where “a highly experienced clinician serves as a consultant to a clinical supervisor[84].” Essentially, this is supervision of supervision. Meta-supervision works to improve supervision skills, operationalize progress through performance ratings, and offers case management tips[84].

A useful rubric and accompanying rating scale for meta-supervision is recently available[25]. The rating scale addresses the supervisory context, aims, session structure, use of educational principles, CBT competencies, feedback, theoretical faithfulness, intervention methods, supervisory relationship issues as well as pacing and timing. The items are scored on a 1 (incompetent)-6 (expert) scale with higher scores indicating greater skillfulness. Further, the Cognitive Therapy Supervision Checklist[85] is a checklist for supervisors to rate trainees’ competence. The scale evaluates clinical proficiency on various CBT procedures and processes. It explicitly addresses competencies set for by the American Association of Directors of Psychiatric Residency Training (AADPRT).

SUPERVISION OUTCOMES

While clinical supervision is the primary way trainees learn to do psychotherapy, there is minimal literature evaluating its effectiveness[23]. Effectiveness may be studied in a variety of ways. Outcomes could be operationalized as positive changes in supervisory performance or young patients’ clinical presentations. For instance, effectiveness could be measured as increases in young people’s adaptive functioning or improved symptom scores. Alternatively, good supervisory outcomes could be evaluated in terms of trainees’ acquisition/application of skills, fidelity to a treatment approach, and/or self-reflection.

Clinical effectiveness or improved treatment outcome is defined as the “acid test” of good supervision[86-88]. In a recent study, supervision was found to have a significant moderate effect on clinical outcomes[88]. More specifically, supervision accounted for 18% of the variance in patient outcomes. This effect is approximately two times the effect size owned by the common factors research[88]. In general, there is wide agreement that good CBT training on is associated with improved supervisee performance[74,89,90]. Effective training improves staff performance and technical proficiency[15].

There is a growing body of research examining the effectiveness of supervision emphasizing self-practice and self-reflection[90-94]. Self-reflection and self-practice increased trainees understanding of the cognitive model[91-93]. Additionally, this model of supervision enhanced supervisees’ technical proficiency[90-92]. Finally, supervisees’ flexibility was improved via this practice[91].

LIMITATIONS

The majority of work on supervision of cognitive behavioral therapy is characterized by anecdotal reports, case studies, surveys, and quasi-experimental designs rendering the results vulnerable to various threats to internal and external validity. Factors such differential history, maturity, selection bias, and attrition compromise scientific conclusions. Finally, there is significant ambiguity regarding the selection of proper outcome variables or measures. Some investigators propose patient improvement as the gold-standard or acid-test whereas others employ indices reflecting improved skills, knowledge, and attitudes. The unclarity of outcome measures truncates generalizability of results.

RECOMMENDATIONS

Delivering and receiving good clinical supervision in CBT with youth are necessary steps toward improving the care of young patients. Achieving these lofty goals requires deliberate action. Based on the literature reviewed, several recommendations for advancing the science and practice of CBT supervision follows.

Competent supervision for CBT with youth requires that trainers are skillful in both clinical practice with young patients and training inexperienced colleagues. Consequently, supervisors need to be properly credentialed in the approach. Fortunately, credentialing bodies exist (American Board of Professional Psychology, Academy of Cognitive Therapy, British Association of Behavioral and Cognitive Psychotherapy, Oxford University, etc.). In short, supervisees are well-advised to seek supervision from documented experts.

Focused attention should be directed to the core content in supervision of CBT with youth. Acquiring and applying didactic and procedural knowledge is essential for trainees. Enactive supervision is highly recommended. Consequently, the opportunity to engage in behavioral rehearsal is key. In an action-oriented approach, practicing procedures is a priority. Behavioral rehearsal seems especially important when training supervisees in exposure techniques. Gaining greater self-efficacy in this crucial intervention may increase more application in clinical settings.

In order to do their job well, supervisors need first- hand knowledge of their students’ work and young patients’ functioning. Audiotape, videotape, or direct observation of sessions is a preferred pedagogical strategy. Reviewing tapes is commonly anxiety producing to supervisees. Additionally, tape review is time-consuming for supervisors. Finally, taping requires the proper electronic equipment which translates to increased cost to agencies. Perhaps, these are some the reasons that tape reviews are relatively rare in treatment-as-usual settings.

Hiring competent supervisors and creating a training infra-structure that supports best practices in supervision are costly endeavors. Good training efforts should be scalable and reach as many practitioners as possible. In an environment where lean budgets are pervasive, scalability of training is clearly linked with economic considerations.

Administrators, clinical supervisors, and front-line staff should be on the same page regarding the value of good supervision. However, often these multiple stakeholders are at odds with each other. Administrators worry about the loss of revenue when staff are engaged in activities that do not involve reimbursable clinical encounters. Staff then become concerned about their ability to meet productivity benchmarks if they take time away for supervision. Advocates for better supervision and training must persuade stakeholders that these educational activities are good returns on their investment of time and money. The studies listed in the supervisory outcome section offers a nice launching pad for arguments regarding returns on investment.

This therapeutic advances article made the case for providing competent supervision to clinicians conducting CBT with youth. The value of supervision was delineated. The core elements of supervision of CBT with youth were outlined and the fundamental supervisory processes were discussed. Finally, a sample of supervisory outcome studies were summarized. Ideally, this contribution in therapeutic advances spurs academicians, clinicians, and behavioral health care administrators to fully invest in competent supervision of clinicians who provide CBT to young patients.

Footnotes

Manuscript source: Invited manuscript

Specialty type: Pediatrics

Country of origin: United States

Peer-review report classification

Grade A (Excellent): 0

Grade B (Very good): B, B, B

Grade C (Good): 0

Grade D (Fair): 0

Grade E (Poor): 0

P- Reviewer: Kute VBB, Sergi CM, Watanabe T S- Editor: Kong JX L- Editor: A E- Editor: Li RF

References
1.  Weisz JR, Kuppens S, Ng MY, Eckshtain D, Ugueto AM, Vaughn-Coaxum R, Jensen-Doss A, Hawley KM, Krumholz Marchette LS, Chu BC. What five decades of research tells us about the effects of youth psychological therapy: A multilevel meta-analysis and implications for science and practice. Am Psychol. 2017;72:79-117.  [PubMed]  [DOI]
2.  Weisz JR, Kazdin AE.  Evidence-based psychotherapies for children and adolescents. New York: Guilford Publications 2017; .  [PubMed]  [DOI]
3.  Flessner CA, Piacentini JC.  Clinical handbook of psychological disorders in children and adolescents. New York: Guilford Publications 2017; .  [PubMed]  [DOI]
4.  David-Ferdon C, Kaslow NJ. Evidence-based psychosocial treatments for child and adolescent depression. J Clin Child Adolesc Psychol. 2008;37:62-104.  [PubMed]  [DOI]
5.  Kendall PC, Peterman JS. CBT for Adolescents With Anxiety: Mature Yet Still Developing. Am J Psychiatry. 2015;172:519-530.  [PubMed]  [DOI]
6.  Wu Y, Lang Z, Zhang H. Efficacy of Cognitive-Behavioral Therapy in Pediatric Obsessive-Compulsive Disorder: A Meta-Analysis. Med Sci Monit. 2016;22:1646-1653.  [PubMed]  [DOI]
7.  Dorsey S, McLaughlin KA, Kerns SEU, Harrison JP, Lambert HK, Briggs EC, Revillion Cox J, Amaya-Jackson L. Evidence Base Update for Psychosocial Treatments for Children and Adolescents Exposed to Traumatic Events. J Clin Child Adolesc Psychol. 2017;46:303-330.  [PubMed]  [DOI]
8.  Comer JS, Chow C, Chan PT, Cooper-Vince C, Wilson LA. Psychosocial treatment efficacy for disruptive behavior problems in very young children: a meta-analytic examination. J Am Acad Child Adolesc Psychiatry. 2013;52:26-36.  [PubMed]  [DOI]
9.  McCart MR, Sheidow AJ. Evidence-Based Psychosocial Treatments for Adolescents With Disruptive Behavior. J Clin Child Adolesc Psychol. 2016;45:529-563.  [PubMed]  [DOI]
10.  Beidas RS, Edmunds JM, Marcus SC, Kendall PC. Training and consultation to promote implementation of an empirically supported treatment: A randomized trial. Psychiatr Serv. 2012;63:660-665.  [PubMed]  [DOI]
11.  Edmunds JM, Brodman DM, Ringle VA, Read KL, Kendall PC, Beidas RS. Examining adherence to components of cognitive-behavioral therapy for youth anxiety after training and consultation. Prof Psychol Res Pr. 2017;48:54-61.  [PubMed]  [DOI]
12.  Newman CF. Training cognitive behavioral supervisors: Didactics, simulated practice, and “meta-supervision.”. J Cog Psychother. 2013;27:5-16.  [PubMed]  [DOI]
13.  Newman C, Kaplan D.  Supervision essentials for cognitive-behavioral therapy. Washington, DC: American Psychological Association; 2016; .  [PubMed]  [DOI]
14.  Creed TA, Wolk CB, Feinberg B, Evans AC, Beck AT. Beyond the Label: Relationship Between Community Therapists’ Self-Report of a Cognitive Behavioral Therapy Orientation and Observed Skills. Adm Policy Ment Health. 2016;43:36-43.  [PubMed]  [DOI]
15.  Herschell AD, Kolko DJ, Baumann BL, Davis AC. The role of therapist training in the implementation of psychosocial treatments: a review and critique with recommendations. Clin Psychol Rev. 2010;30:448-466.  [PubMed]  [DOI]
16.  Wiltsey Stirman S, Calloway A, Toder K, Miller CJ, Devito AK, Meisel SN, Xhezo R, Evans AC, Beck AT, Crits-Christoph P. Community mental health provider modifications to cognitive therapy: implications for sustainability. Psychiatr Serv. 2013;64:1056-1059.  [PubMed]  [DOI]
17.  Sburlati ES, Schniering CA, Lyneham HJ, Rapee RM. A model of therapist competencies for the empirically supported cognitive behavioral treatment of child and adolescent anxiety and depressive disorders. Clin Child Fam Psychol Rev. 2011;14:89-109.  [PubMed]  [DOI]
18.  Dobson KS, Shaw BF. The training of cognitive therapists: What we have learned from treatment manuals? Psychotherapy: Theory, Research, Practice, and Training. 1993;30:573-577.  [PubMed]  [DOI]
19.  Friedberg RD. Where’s the Beef? Concrete Elements When Supervising Cognitive-Behavioral Therapy With Youth. J Am Acad Child Adolesc Psychiatry. 2015;54:527-531.  [PubMed]  [DOI]
20.  Friedberg RD, Gorman AA, Beidel DC. Training psychologists for cognitive-behavioral therapy in the raw world: a rubric for supervisors. Behav Modif. 2009;33:104-123.  [PubMed]  [DOI]
21.  Sudak DM, Beck JS, Wright J. Cognitive behavioral therapy: a blueprint for attaining and assessing psychiatry resident competency. Acad Psychiatry. 2003;27:154-159.  [PubMed]  [DOI]
22.  Friedberg RD, Mahr S, Mahr F. Training psychiatrists in cognitivebehavioral psychotherapy: Current status and horizons. Curr Psychiatry Rev. 2010;6:159-170.  [PubMed]  [DOI]
23.  Accurso EC, Taylor RM, Garland AF. Evidence-based Practices Addressed in Community-based Children’s Mental Health Clinical Supervision. Train Educ Prof Psychol. 2011;5:88-96.  [PubMed]  [DOI]
24.  Kavanaugh DJ. Issues in the multidisciplinary training of cognitive behavioural nterventions. Behaviour Change. 1994;11:38-44.  [PubMed]  [DOI]
25.  Corrie S, Lane DA.  CBT supervision. Thousand Oaks, CA: Sage 2015; .  [PubMed]  [DOI]
26.  Milne D, Aylott H, Fitzpatrick J, Ellis MV. How does clinical supervision work? Using a “best evidence synthesis” approach to construct a basic model of supervision. Clin Superv. 2008;27:170-190.  [PubMed]  [DOI]
27.  Friedberg RD, McClure JM, Garcia JH.  Cognitive therapy techniques for children and adolescents. New York: Guilford Publications 2009; .  [PubMed]  [DOI]
28.  Newman CF Core competencies in cognitive behavior therapy: Becoming a highly effective and competent cognitive behavioral therapist. New York: Routledge 2013; .  [PubMed]  [DOI]
29.  Nadeem E, Gleacher A, Beidas RS. Consultation as an implementation strategy for evidence-based practices across multiple contexts: unpacking the black box. Adm Policy Ment Health. 2013;40:439-450.  [PubMed]  [DOI]
30.  Friedberg RD, Taylor LA. Perspectives on supervision in cognitive therapy. J Ration Emot Cogn Behav Ther. 1994;12:147-162.  [PubMed]  [DOI]
31.  Friedberg RD, Clark CA.  Supervision of cognitive therapy with youth. In Neill TK, editors. Helping others help children: Clinical supervision of child psychotherapy. Washington, DC: American Psychological Association 2006; 109-122.  [PubMed]  [DOI]
32.  Pearl AM, Mahr FM, Friedberg RD. Supervising child psychiatrists in cognitive behavioral therapy. J Cogn Psychother. 2013;27:61-70.  [PubMed]  [DOI]
33.  Waltman S, Hall BC, McFarr LM, Beck AT, Creed TA. In session stuck points and pitfalls of community clinicians learning CBT: Qualitative Investigation. Cogn Behav Pract. 2016;.  [PubMed]  [DOI]
34.  Padesky CA. The next frontier: Building positive qualities with cognitive behavior therapy. Invited address presented at the 5th World Congress of Behavioral and Cognitive Therapies; 2007 July; Barcelona, Spain. .  [PubMed]  [DOI]
35.  Beck AT, Clark , DA . Anxiety and depression: An information processing perspective. Anx Res. 1988;1:23-36.  [PubMed]  [DOI]
36.  Ingram RE, Kendall PC. Cognitive clinical psychology: Implications of an information-processing perspective. Information processing approaches to clinical psychology. Orlando, FLA: Academic Press 1986; 3-21.  [PubMed]  [DOI]
37.  Beck AT Cognitive therapy and the emotional disorders. New York: International Universities Press 1976; .  [PubMed]  [DOI]
38.  Jolly JB. A multimethod test of the content-specificity hypothesis in young adolescents. J Anxiety Disord. 1993;7:223-233.  [PubMed]  [DOI]
39.  Jolly JB, Dyckman RA. Using self-report data to differentiate anxious and epressive symptoms in adolescents: Cognitive content-specificity and global distress. Cognit Ther Res. 1994;18:25-27.  [PubMed]  [DOI]
40.  Jolly JB, Kramer TA. The hierarchical arrangement of internalizing cognitions. Cognit Ther Res. 1994;18:1-14.  [PubMed]  [DOI]
41.  Kuyken W, Padesky CA, Dudley R.  Collaborative case conceptualization. New York: Guilford Publications 2009; .  [PubMed]  [DOI]
42.  Manassis K Case formulation with children and adolescents. New York: Guilford Publications 2014; .  [PubMed]  [DOI]
43.  Persons JB The case formulation approach to cognitive behavioral therapy. New York: Guilford Publications 2012; .  [PubMed]  [DOI]
44.  Friedberg RD, Gorman AA, Hollar-Wilt L, Buickians A, Murray M.  Cognitive behavior therapy for the busy child psychiatrist and other mental health professionals. New York: Routledge 2011; .  [PubMed]  [DOI]
45.  Friedberg RD, McClure JM.  Clinical practice of cognitive therapy with children and adolescents: The nuts and bolts, 2nd Ed. New York: Guilford Publications 2002; .  [PubMed]  [DOI]
46.  Beidas RS, Ditty M, Downey MM, Edmunds J. Professional evidence based ractice with children and adolescents. Evidence based CBT for anxiety and depression in children and adolescents: Acompetencies based approach. New York: Wiley Blackwell; 2014; 36-48.  [PubMed]  [DOI]
47.  Padesky CA. Staff and patient education. Cognitive therapy with inpatients: Developing a cognitive milieu. New York: Guilford Publications 1993; 393-413.  [PubMed]  [DOI]
48.  Alford BA, Beck AT.  The integrative power of cognitive therapy. New York: Guilford Publications 1997; .  [PubMed]  [DOI]
49.  Perris C Cognitive therapy with schizophrenic patients. New York: Guilford Publications 1989; .  [PubMed]  [DOI]
50.  Cummings JA, Ballantyne EC, Scallion LM. Essential processes for cognitive behavioral clinical supervision: Agenda setting, problem-solving, and formative feedback. Psychotherapy (Chic). 2015;52:158-163.  [PubMed]  [DOI]
51.  Gosch EA, Flannery-Schroeder E, Mauro CF, Compton SN. Principles of cognitive-behavioral therapy for anxiety disorders in children. J Cogn Psychother. 2006;20:247-262.  [PubMed]  [DOI]
52.  Friedberg RD, Gorman AA. Integrating psychotherapeutic processes with cognitive ehavioral procedures. J Contemp Psychother. 2007;37:185-193.  [PubMed]  [DOI]
53.  Friedberg RD, Tabbarah S, Poggesi RM. Therapeutic presence, immediacy, and the transparency with youth: Carpe the moment. Cogn Beh Therapist. 2013;.  [PubMed]  [DOI]
54.  Scott K, Lewis CC. Using Measurement-Based Care to Enhance Any Treatment. Cogn Behav Pract. 2015;22:49-59.  [PubMed]  [DOI]
55.  Young JE, Beck AT. Cognitive therapy rating scale. University of Pennsylvania. 1980;.  [PubMed]  [DOI]
56.  Sudak DM. Training in cognitive behavioral therapy in psychiatry residency: An overview for educators. Behav Modif. 2009;33:124-137.  [PubMed]  [DOI]
57.  Trafalis S, Friedberg RD, Sullivan PJ, Teague AM, Hoyman LC, Berlyant MJ. Training community clinicians in CBT for youth. Curr Psychiatry Rev. 2016;12:88-96.  [PubMed]  [DOI]
58.  Padesky CA. Developing therapist competency: training and supervision models. In: Salkovskis PM, editor. Frontiers of cognitive therapy. New York: Guilford Publications, 266-292. .  [PubMed]  [DOI]
59.  Liese BS, Alford BA. Recent advances in cognitive therapy supervision. J Cogn Psychother. 1998;12:91-94.  [PubMed]  [DOI]
60.  Rahovshik SG, McManus F. Establishing evidence-based training in cognitive behavioral therapy: a review of current empirical findings and theoretical guidance. Clin Psychol Rev. 2010;30:496-516.  [PubMed]  [DOI]
61.  Newman CF, Beck JS.  Selecting, training, and supervising therapists. In Nezu AM, Nezu CM, editors. Evidence based outcome research: A practical guide to conducting randomized controlled trials for psychosocial interventions. Oxford, UK: Oxford University Press 2007; 245-263.  [PubMed]  [DOI]
62.  Friedberg RD, Fidaleo RA. Training inpatient staff in cognitive therapy. J Cogn Psychother. 1992;6:105-112.  [PubMed]  [DOI]
63.  Stallard P, Myles P, Branson A. The Cognitive Behaviour Therapy Scale for Children and Young People (CBTS-CYP): development and psychometric properties. Behav Cogn Psychother. 2014;42:269-282.  [PubMed]  [DOI]
64.  Friedberg RD, Thordarson MA. Cognitive Therapy Rating Scale for Children and Adolescents (CTRS-CA). Center for the Study and Anxious Youth. .  [PubMed]  [DOI]
65.  Sudak DM, Codd RT, Ludgate J, Sokol L, Fox MG, Reiser R, Milne DL.  Teaching and supervising cognitive-behavioral therapy. Hoboken, NJ: Wiley 2010; .  [PubMed]  [DOI]
66.  Jones E, Mannassis K. Effective training methods. Evidence based CBT for anxiety and depression in children and adolescents: A competencies based approach. New York: Wiley Blackwell 2014; 10-22.  [PubMed]  [DOI]
67.  Rosenbaum M, Ronen T. Clinical supervision from the standpoint of cognitive-behavior therapy. Psychotherapy. 1998;35:220-230.  [PubMed]  [DOI]
68.  Ronen T, Rosenbaum M. Beyond direct verbal instructions in cognitive behavioral supervision. Cogn Beh Pract. 1998;5:7-23 [DOI 10.1016/S1077-7229(98)80019-9].  [PubMed]  [DOI]
69.  Beidas RS, Edmunds JM, Cannuscio CC, Gallagher M, Downey MM, Kendall PC. Therapists perspectives on the effective elements of consultation following training. Adm Policy Ment Health. 2013;40:507-517.  [PubMed]  [DOI]
70.  Gordon PK. Ten steps to cognitive behavioral supervision. Cognitive Behavioural herapist. 2012;5:71-82.  [PubMed]  [DOI]
71.  Townsend M, Iannetta L, Freeston M, Hayes J. Clinical supervision in practice: A survey of UK cognitive-behavioral psychotherapies accredited by BABCP. Behav Cogn Psychother. 2002;30:485-500.  [PubMed]  [DOI]
72.  Milne DL, Westerman C. Evidence-based clinical supervision: Rationale and illustration. Clin Psychol Psychother. 2001;8:444-457.  [PubMed]  [DOI]
73.  Milne D, James I. A systematic review of effective cognitive-behavioural supervision. Br J Clin Psychol. 2000;39:111-127.  [PubMed]  [DOI]
74.  Tompkins MA. Enhancing self-efficacy to achieve competence. J Cogn Psychother. 2013;27:71-80.  [PubMed]  [DOI]
75.  Bearman SK, Weisz JR, Chorpita BF, Hoagwood K, Ward A, Ugueto AM, Bernstein A; Research Network on Youth Mental Health. More practice, less preach? the role of supervision processes and therapist characteristics in EBP implementation. Adm Policy Ment Health. 2013;40:518-529.  [PubMed]  [DOI]
76.  Bearman SK, Schneiderman RL, Zoloth E. Building an evidence base for effective supervision practices: an analogue experiment of supervision to increase EBT Fidelity. Adm Policy Ment Health. 2017;44:293-307.  [PubMed]  [DOI]
77.  Friedberg RD, Brelsford GM. Training methods in cognitive behavioral therapy. J Cogn Psychother. 2013;27:9-29.  [PubMed]  [DOI]
78.  Beidas RS, Cross W, Dorsey S. Show Me, Don’t Tell Me: Behavioral Rehearsal as a Training and Analogue Fidelity Tool. Cogn Behav Pract. 2014;21:1-11.  [PubMed]  [DOI]
79.  Dorsey S, Lyon AR, Pullmann MD, Jungbluth N, Berliner L, Beidas R. Behavioral Rehearsal for Analogue Fidelity: Feasibility in a State-Funded Children’s Mental Health Initiative. Adm Policy Ment Health. 2017;44:395-404.  [PubMed]  [DOI]
80.  Nakamura BJ, Selbo-Bruns A, Okamura K, Chang J, Slavin L, Shimabukuro S. Developing a systematic evaluation approach for training programs within a train-the-trainer model for youth cognitive behavior therapy. Behav Res Ther. 2014;53:10-19.  [PubMed]  [DOI]
81.  Friedberg RD. Manual for the Cognitive Therapy Rating Scale for children and adolescents. Palo Alto, CA: Center for the Study and Treatment of Anxious Youth 2014; .  [PubMed]  [DOI]
82.  Thordarson MA, Friedberg RD, Fanniff A, Cordova M. The Cognitive Therapy Rating Scale for Children and Adolescents (CTRS-CA): A pilot study. Poster presentation delivered at the 50th annual meeting of the Association for Behavioral and Cognitive Therapies; New York; 2016. .  [PubMed]  [DOI]
83.  Ularntinon S, Friedberg RD. The SELF: a Supervisory Tool for Enhancing Residents’ Self-Reflective Learning in CBT with Youth. Acad Psychiatry. 2016;40:172-176.  [PubMed]  [DOI]
84.  Newman CF. Training cognitive behavioral therapy supervisors: Didactics, simulated practice and “meta-supervision.”. J Cogn Psychother. 2013;27:5-18.  [PubMed]  [DOI]
85.  Sudak DM, Wright JH, Bienenfeld D, Beck JS. Cognitive therapy supervision checklist. Unpublished scale (Online). 2001;.  [PubMed]  [DOI]
86.  Ellis M, Ladany N. Inferences concerning supervisees and clients in clinical supervision: An integrative review. Handbook of psychotherapy supervision. Chicester, UK: John Wiley 1997; 447-507.  [PubMed]  [DOI]
87.  Milne D. Beyond the “acid test”: a conceptual review and reformulation of outcome evaluation in clinical supervision. Am J Psychother. 2014;68:213-230.  [PubMed]  [DOI]
88.  Callahan JL, Almstrom CM, Swift JK, Borja SE, Heath CJ. Exploring the contribution of supervisors to intervention outcomes. Train Educ Prof Psychol. 2009;3:72-77.  [PubMed]  [DOI]
89.  James IA, Blackburn IM, Milne DL, Reichfelt FK. Moderators of trainee therapists’ competence in cognitive therapy. Br J Clin Psychol. 2001;40:131-141.  [PubMed]  [DOI]
90.  Milne DL, Baker C, Blackburn IM, James I, Reichelt K. Effectiveness of cognitive therapy training. J Behav Ther Exp Psychiatry. 1999;30:81-92.  [PubMed]  [DOI]
91.  Laireiter AR, Willutski U. Self-reflection and self-practice in training of cognitive ehavioural therapy: an overview. Clin Psychol Psychother. 2003;18:19-30.  [PubMed]  [DOI]
92.  Bennett-Levy J, Lee N, Travers K, Pohlman S, Hamernick H. Cognitive therapy from the inside: enhancing therapist skills through practicing what we preach. Behav Cogn Psychother. 2003;31: 143-158.  [PubMed]  [DOI]
93.  Bennett_Levy J, Turner F, Beaty T, Smith M, Paterson B, Farmer S. The value of self-practice of cognitive therapy techniques and self-reflection in the training of cognitive therapists. Behav Cogn Psychother. 2001;29: 203-220.  [PubMed]  [DOI]
94.  Haarhoff B, Gibson K, Flett R. Improving the quality of cognitive behaviour therapy case conceptualization: the role of self-practice/self-reflection. Behav Cogn Psychother. 2011;39:323-339.  [PubMed]  [DOI]
95.  Thwaites R, Bennett-Levy J, Davis M, Chaddock A.  Using Self-practice and self-reflection to enhance CBT competence and meta-competence. In Whittington A, Grey N, editors. How to become a more effective CBT therapist: Mastering meta-competence in clinical practice. New York: John Wiley 2014; 241-254.  [PubMed]  [DOI]