Wednesday, March 13, 2019

We found no evidence that either therapist effects or therapeutic alliance significantly predicted changes in the two primary outcomes, fatigue and physical functioning, in a randomized controlled trial. The power calculation revealed that we had adequate power to detect effects of moderate size. Inspection of a table of correlations between therapeutic alliance and changes in outcomes, for each therapy and for each therapist at each assessment point revealed no consistent pattern of correlations (data in S1 Table). On this basis, it seems likely that the relationship between therapist effects, therapeutic alliance and outcome is not present in this study, rather than a lack of statistical power accounting for the results.
It is unusual, although not unknown, to find no therapist effects or effects of therapeutic alliance in trials of psychological or behavioural therapies. Perry and Howard (1989, cited in [17]) suggest therapist experience may be a critical factor, and that a sample of highly experienced therapists may yield significant variability on symptomatic outcome, whereas a sample containing less experienced therapists may yield more obvious therapist effects (up to 50% of outcome variance). The nurses used in the FINE trial were experienced primary care practitioners but prior to training were inexperienced in delivering therapy for CFS, and inexperienced at working within the confines of a research protocol. They were recruited specially to deliver the interventions in the FINE Trial, and all received identical training in both the delivery of the interventions and working to a protocol. Training involved supervised practice, role play and discussions, and the therapists received regular supervision during the time they were delivering the intervention. At the end of training all the therapists were considered competent to deliver the interventions. Fidelity to the treatment approaches was judged good by independent raters. It is possible therefore, that although prior to training we had three inexperienced therapists, at the end of training and during intervention delivery, we actually had three therapist who were closely matched for competence, and with similar approaches to patients. Our findings are in contrast to the findings of Wiborg et al.[20]. In Wiborg’s study, therapists were recruited from existing services. Therapist variation on symptomatic outcome was attributed to variation in therapists’ attitudes towards a manualised approach to treatment delivery. We did not measure therapists’ attitudes to the two interventions in the present study. Our therapists were not in the position of having to adjust prior practice to meet the demands of a research trial setting.
Godfrey et al. observed significantly higher alliance scores when therapists delivered CBT compared to when delivering counselling. The authors, who used a fuller version of the CALPAS scale than the one we used, suggested that this may be due to an artefact of the CALPAS items selected, which included more technically than interpersonally focussed elements of therapy. The PACE trial [2] found no difference in the level of therapeutic alliance across treatment groups. In the FINE trial, the patient-rated early therapeutic alliance scores were, on average, higher when participants received PR (which has similarities to CBT) than when they received SL. However, this effect was only significant for therapist three. For therapists one and two, the differences in the mean alliance formed when delivering PR compared to SL were small. Comparison to other studies  suggested that the therapeutic alliance scores were typical for this patient group; meaning the results of the present study cannot be explained by unusually high or low alliances being formed.
No prior research in this area has randomized the allocation of therapist. The effects observed in prior research where patients were not randomized to therapists may be a mixture of treatment and selection effects. It is possible that in our study, by randomizing the therapist, we eliminated selection effects. Additionally, ours was a well-conducted study with adequate safeguards against sources of bias. Crits-Christoph and Mintz found that studies with high quality control showed reduced therapist variation. It is possible that a combination of the use of high quality control and randomisation of therapists eliminated therapist effects in the present study. Whether it would be feasible or desirable to try to eliminate therapist effects in standard clinical practice is less clear. Attempts to standardise treatment delivery to more closely resemble the conditions of a controlled clinical trial might be difficult in clinical practice when therapists have a variety of priorities and calls on their time. Experienced therapists may not wish to alter aspects of their practice and mode of delivery of therapy which had worked for them over the years. It would be necessary to ensure that the most effective therapeutic techniques were combined with a standardised best therapist practice. Probably a more feasible approach would be to develop clearly defined and measurable therapist competencies and to ensure through appointment procedures and clinical supervision that therapists were able to operate in accordance with these competencies. A further consideration is that, in a service with many patients and many therapists, there may be some scope for matching patients to therapists on individual characteristics, such as attachment style.
It may be the case that therapist effects and therapeutic alliance are of relatively limited importance in determining outcomes after treatment for chronic fatigue syndrome. There is growing evidence that the factors which mediate change after CBT and GET are changes in cognitive and behavioural factors such as symptom focusing, catastrophizing, and fear driven avoidance of activit. In the FINE Trial decreases in catastrophizing and self-reported activity limitation mediated change in fatigue following PR . It is possible that these factors will change whenever treatments such as CBT, GET and PR are delivered competently. Supportive listening was not an effective treatment in the FINE Trial.
A key feature of this research was the random allocation of patients to therapists, thus excluding confounding factors such as location, or tendency to work with a particular subgroup of clients, in the analysis of therapist effects. This is a highly unusual feature of these data and a major strength. The sample size is large. Modern and statistically valid methods of dealing with missing data were used, including regression imputation for missing baseline data, multiple imputation for missing post-randomization variables, and weighting for missing outcome data. Our confidence in our findings is increased by the fact that different statistical models all indicate the same results. The standard deviation for the number of sessions attended is small (most individuals had close to the full treatment). In the SL arm, the mean number of sessions was 9.5 (S.D. 0.8), and in the PR arm, the mean number of sessions was 9.6 (S.D. 0.9) . This reduces the effect of noncompliance from the randomized protocol in this analysis.
A limitation of the study is that the conclusion is potentially only valid for the range of recorded alliance levels, and that alliance was measured at the end of the first therapy session, which may have been too early for the therapeutic relationship to have formed. A small sample of only three therapists were used, which limits our ability to detect therapist effects, but is less important for the effect of therapeutic alliance on outcomes. While PR was effective in reducing fatigue in the FINE Trial, when compared with GP treatment as usual, neither PR nor SL significantly improved physical functioning, and there was little change in this outcome variable. This may reduce the likelihood of finding therapist effects or an effect of therapeutic alliance.

No comments:

Post a Comment