Günter Schiepek
Wolfgang Aichhorn1,2
Guido Strunk
Benjamin Aas- 1Institute of Synergetics and Psychotherapy Research, Paracelsus Medical University, Salzburg, Austria
- 2Department of Psychosomatics and Inpatient Psychotherapy, Christian Doppler University Hospital, Paracelsus Medical University, Salzburg, Austria
- 3Faculty of Psychology and Educational Sciences, Ludwig Maximilians University, Munich, Germany
- 4Institute of Psychoanalysis and Family Therapy, Salzburg, Austria
- 5Complexity Research, Vienna, Austria
Objective: The feasibility of a high-frequency real-time monitoring approach to psychotherapy is outlined and tested for patients' compliance to evaluate its integration to everyday practice. Criteria concern the ecological momentary assessment, the assessment of therapy-related cognitions and emotions, equidistant time sampling, real-time nonlinear time series analysis, continuous participative process control by client and therapist, and the application of idiographic (person-specific) surveys.
Methods: The process-outcome monitoring is technically realized by an internet-based device for data collection and data analysis, the Synergetic Navigation System. Its feasibility is documented by a compliance study on 151 clients treated in an inpatient and a day-treatment clinic.
Results: We found high compliance rates (mean: 78.3%, median: 89.4%) amongst the respondents, independent of the severity of symptoms or the degree of impairment. Compared to other diagnoses, the compliance rate was lower in the group diagnosed with personality disorders.
Conclusion: The results support the feasibility of high-frequency monitoring in routine psychotherapy settings. Daily collection of psychological surveys allows for the assessment of highly resolved, equidistant time series data which gives insight into the nonlinear qualities of therapeutic change processes (e.g., pattern transitions, critical instabilities).
Introduction
Concept and Criteria of High-Frequency Real-Time Monitoring
Outcome monitoring and feedback on therapeutic progress has become popular and has been adopted by many mental health providers all over the world (e.g., Howard et al., 1996; Evans et al., 2002; Kraus et al., 2005; Miller et al., 2005; Trauer, 2010; Schiepek and Aichhorn, 2013). Lambert (2007) or Newnham and Page (2010) describe it as an important feature of good clinical practice and ask for an integration of monitoring procedures into routines of mental health care (Lambert, 2010). This article supports the demand for a feedback-informed practice but also illustrates that its potentials are not yet exhausted. Some criteria are listed which can be combined to powerful synergies establishing a feedback-driven therapy approach. The feasibility of fulfilling these criteria will be demonstrated by reporting on compliance data from the application of an internet-based feedback technology (Synergetic Navigation System) to inpatient and day treatment settings.
In Session vs. Ecological momentary assessment
Integrating feedback systems into psychotherapy remains an exception in today's clinical practice. The majority of those who do use feedback routines ask clients for outcome ratings during the actual therapy sessions (e.g., Lambert et al., 2002a; de Jong et al., 2014). Often, the administration of feedback questionnaires in inpatient or day treatment settings occurs infrequently and on a non-regular basis before or after a therapy session (Newnham et al., 2010a,b). Therapy feedback then loses the advantages of ecological momentary assessment, because experiences of every-day life aren't reported in close timely proximity to their actual occurrence. In contrast, daily assessment can reduce memory biases, distortions by state-dependent memory effects in distal settings, and the urge for implicit averaging over many events or days, resulting in enhanced ecological validity of the data (Fahrenberg et al., 2007; Ebner-Priemer and Trull, 2009; Wenze and Miller, 2010). For data collection in everyday settings, modern web-based devices such as smartphones, tablets, or laptops yield easy access to questionnaires whenever and wherever needed.
Outcome vs. Common Factors Monitoring
Feedback procedures focus almost exclusively on outcome measures. One widely used survey is the Outcome Questionnaire (OQ-45) developed by Lambert and colleagues (Lambert et al., 2004), which combines subscales of “symptom distress,” “interpersonal relations,” and “social role.” Other examples of feedback procedures using outcome measures are the WHO Wellbeing Index (WHO-5; Bech et al., 1996), the Mental Health subscales of the Medical Outcomes Questionnaire (SF-36; Ware et al., 1993), the Health of the Nation Outcome Scales (HoNOS; Wing et al., 1998), the Depression Anxiety Stress Scales (short version: DASS 21; Lovibond and Lovibond, 1995), and many more (see Evans et al., 2002; Howard et al., 1996; Trauer, 2010; Newnham et al., 2010a,b). Focusing entirely on—albeit important—outcome excludes process-mediating aspects and general therapeutic ingredients. In order to grasp these aspects of therapy, the monitoring should also cover client factors (resources, motivation to change, engagement), working alliance, emotions, self-relatedness, expectancies, self-esteem, self-efficacy, or ward atmosphere (Duncan et al., 2010; Norcross and Lambert, 2011). Thus, besides outcome, therapy feedback should also cover process-mediating factors and be sensitive to important features of change processes like early rapid responses, sudden gains or losses (Stiles et al., 2003; Lutz et al., 2013), or rupture-repair sequences in the working alliance (Stiles et al., 2004; Gumz et al., 2012a). Combining the common factors approach with therapy monitoring could result in a real-time assessment of common factor dynamics—with great importance to further research on this topic.
Irregular vs. Frequent and Equidistant Time Sampling
Frequent and regular assessment of psychological states and processes throughout therapy is not common in everyday practice. Often it is the sequence of therapy sessions that defines when patients give survey-based feedback. de Jong et al. (2014) report on a feedback study in outpatient settings with about 50% OQ administrations out of 32.3 (SD: 41.4) therapy sessions. de Beurs et al. (2011) administered the Brief Symptom Inventory four times during a sequence of more than 50 sessions. Such sampling rates represent outcome states at a certain time, but do not allow for the identification of dynamic patterns and pattern transitions. Figure 1 illustrates how the dynamics of a time series (daily ratings of self-esteem from a patient with Borderline Personality Disorder) is distorted and the information on the dynamic pattern is lost if measurement points are successively omitted. The rapid cycling of self-esteem (as well as emotions like grief, anger, or joy, not shown in this figure) characterizing the first weeks of a treatment, vanishes if ratings are only made on every fourth day (Figure 1C), weekly (Figure 1D), or at mixed weekly and fortnightly intervals, the most common periodicity of therapy sessions (Figures 1E,F). Corresponding to the loss of information, the dynamics of the presented time series appear more and more linear with the shape of the curve depending on the chosen measurement points.
Figure 1. Distortion of the dynamics of a time series by omitting measurement points. Depicted is a self-esteem time series of a single client (with borderline personality disorder diagnosis). (A) Shows the original time series with daily responses (opaque in B–F). In (B) only every second day is omitted as missing day. Fluctuations of the first weeks of the time series vanish, if ratings are only made on every fourth day (C) or weekly with some variation (D). A major loss of information and possible source of therapeutic misjudgment occurs with the common practice of occasional weekly and fortnightly measurement intervals (E,F).
In order to get deeper insight into human change processes, it is important to perform frequent, continuous, and equidistant measurements (regular time sampling). Only regular and frequent assessments through (process-) questionnaires allow for meaningful application of time series analysis methods in the frequency domain (e.g., Fast Fourier Transformations, Time-Frequency Distributions, Cohen, 1989) and particularly in the domain of nonlinear dynamics (Kantz and Schreiber, 1997; Heath, 2000; Haken and Schiepek, 2010).
The following thought experiment illustrates how crucial the relation is between the momentum of a phenomenon of interest (Eigendynamics) and the frequency of the measurement (sampling rate): Imagine a completely dark room, with a disk at the center, spinning continuously at one speed. The disk has a dot painted on it and the only source of light to determine the dot's position is a stroboscopic light. Depending on how frequently the light flickers, the dot's position, and thus the rotational speed of the disk, appears to be very different. If the light matches the disk's rotation frequency exactly, the disk appears to be static; however, depending on the frequency of the flickering light, the disk and dot can just as well appear to be moving quickly, slowly, forwards, backwards, or completely erratically. So even for a regularly and continuously spinning dot, a non-standardized and infrequent detection method can only yield invalid results. Going one step further, imagine we tried to estimate the behavior of a dot painted on a chaotically moving double pendulum. In that case, not only the measurement frequency is irregular, but also the dynamic of the phenomenon under investigation is unknown/chaotically. The only way to give a rough estimate of the true behavior of the double pendulum in that imagined dark room would be to install a very rapidly flickering stroboscope and it needs to do so very regularly. In analogy to this phenomenon, if a psychological process is in any form nonlinear or susceptible to sudden changes, the only way to detect—and feedback—theses changes is via frequent and regular measurement. Only then intra-personal identification of processes can be achieved and put to direct use in psychotherapy. In consequence, there should be just as much emphasis placed on standardizing the frequency of measurement as there is currently on standardizing the instruments used for measurement (e.g., questionnaires).
When aiming at (a) a complete recording of therapies (not only as an irregular event sampling), (b) frequent and (c) continuous measurements, and (d) considering practicalities of data collection, daily measurements appear to be a good and achievable way. The present paper therefore reports on results from daily administration of a process questionnaire.
Linear vs. Nonlinear Dynamics
Most therapy feedback applications utilize linear models of psychological change. However, there are accumulating findings supporting nonlinearity and chaoticity of psychotherapy and change dynamics (e.g., Kowalik et al., 1997; Schiepek et al., 1997, 2014a,b; Tschacher et al., 1998; Hayes et al., 2007a,b; Granic et al., 2007; Haken and Schiepek, 2010; Gumz et al., 2012b; Heinzel et al., 2014). Chaos implies different degrees of irregularity and complexity of the dynamics, including its sensitive dependency on initial conditions, on minimal input onto the system, or on micro-fluctuations (Schuster, 1989; Strunk and Schiepek, 1996). This so called “butterfly effect” restricts the predictability of systems' behavior dramatically.
Another well-known feature of human change processes is phase-transition-like behavior as modeled by theories of self-organization (especially Synergetics, Haken, 2004; Haken and Schiepek, 2010; Schiepek et al., 2014a,b, in press). Sudden changes (gains or losses) during psychotherapies may directly correspond to such phase transitions. It should be mentioned that pattern transitions can be found at the mean data level of a time series, but also in their variability, rhythms, frequency distribution, complexity, or other dynamic features (see Figure 1A). Synergetics, e.g., predicts the occurrence of critical fluctuations and the increase of data-variability just before transitions from one pattern to another take place (Kelso, 1995; Haken, 2004; Haken and Schiepek, 2010; Schiepek et al., 2014a,b, in press).
Both, critical fluctuations at instability points of the system dynamics and the deterministic chaos of the process—confounded with stochasticity in real-world systems—result in high complexity and inter-individual diversity of dynamics. From the point of view of complex dynamic systems, standard tracks (expected change trajectories) are more likely to be an artifact of infrequent/irregular data collection and widely used linear assumptions, than of the actual linearity of the researched phenomena. In other words, daily measurements using an appropriate survey (e.g., the Therapy Process Questionnaire, Schiepek et al., 2012), yield time series of psychotherapies that allow to capture and identify diversity and complexity of cases, as well as critical instabilities and nonstationarities (pattern transitions), as Figure 2 exemplifies for two patients.
Figure 2. Time series of seven TPQ factors of three patients with non-linear tracks. Depicted are the seven z-transformed factors of the daily administered Therapy Process Questionnaire of three patients. Only through high resolution administration of questionnaires it becomes evident, that patient A (F33.2, recurrent depressive disorder, current episode severe without psychotic symptoms), patient B (F42, obsessive-compulsive disorder), and patient C (F60.3, emotionally instable personality disorder) not only differ in terms of pre- and post-values of the factors, but also the shape, range, fluctuation, and time points of order transitions differ.
Unpredictability and complexity of change processes thus make close monitoring important. If all therapies of a certain type (e.g., the same diagnosis) followed the same expected trajectory and the dynamics could be controlled by the input (i.e., the interventions), it would be a safe bet to recommend invariant manuals. However, the more the courses of psychopathology and recovery deviate from linear input-output mechanisms and from planned routes, the more we need immediate support by feedback systems that provide information at short time delays to the ongoing process. Time series analysis tools offer just that, by reporting on nonlinear features of processes such as varying complexity, critical fluctuations, time-dependent synchronization of signals, and other precursors of pattern transitions (Scheffer et al., 2009; Molenaar, 2010).
Focus on Cases at Risk of Deterioration vs. Participative Process Control by Applying Decision Rules to All Cases
There is increasing evidence that feedback not only supports therapy in cases of threatening deterioration (Lambert et al., 2002b) but also in prosperous therapies (Lambert et al., 2005; Anker et al., 2009; de Jong et al., 2014). It appears to be especially beneficial if both, client(s) and therapist exploit feedback (Hawkins et al., 2004; de Jong et al., 2014). In consequence, feedback tools should become part of everyday routine practice in different psychotherapeutic settings (outpatient, inpatient, day treatment centers, home-based treatment, counseling) and the information produced should be shared by clients and therapists. Feedback-based therapy sessions not only focus on potentially poor outcome or the application of clinical support tools to prevent deterioration (Lambert et al., 2005); also a diversity of dynamic features shift into focus, and, as predicted by the theory of self-organization, critical instabilities, and crises are utilized as common and necessary transients on the way to therapy effects. Therapists should be able to read these markers of self-organizing processes and encourage the client to communicate his/her experiences corresponding to the feedback results. In consequence, clients will be accompanied toward further therapeutic steps and strengthened for (micro-)decisions on the way to therapeutic success. Herein the therapist continuously realizes a threefold reference: (i) to the information given by the client, (ii) to the theory (e.g., the theory of self-organization), and (iii) to the process data and analysis results (Schiepek et al., 2015).
To summarize, the need for ecological momentary assessment that takes into account common factors of psychotherapy asks for frequent and equidistant time sampling. Nonlinear dynamics can be detected and via feedback integrated into the cooperative work of client and therapist. Besides underlining the conceptual framework, we specifically aim at reporting on the possibility and difficulties of administering questionnaires on a daily basis. It is of particular interest, how many days patients miss to fill in throughout a therapy cycle of 50 and 90 days. In addition, the representative sample of the year 2013 at the University Hospital Salzburg allows to report on the distribution of missing days and their relationship with specific diagnoses, severity of symptoms and differences between in- and outpatient treatment. The results will allow to draw conclusions about the possibility of conducting nonlinear time series analyses to psychological data in future research and mathematical modeling (Bornas et al., 2014; Schiepek et al., in press).
Materials and Methods
The Synergetic Navigation System (SNS)—An Internet-Based Feedback Technology
Data collection and real-time monitoring was realized by the Synergetic Navigation System (SNS). SNS is a web-based generic system that allows for the implementation of various questionnaires at any chosen interval. The response options to the items combine Likert-type scales and visual analog scales. Data can be entered using web-compatible devices including PCs, notebooks, tablets, or smartphones, which permits maximal spatial and temporal flexibility for entering data. Data privacy protection and data security are guaranteed by https-pages, anonymized usernames, passwords, and security technology at the level of online banking transactions. Alongside an administrative mode and client documentation, a range of outcome and process questionnaires can be selected. The raw data results can be visualized by time series graphs. These time series can be submitted to several analyses, e.g., Dynamic Complexity (Schiepek and Strunk, 2010), Recurrence Plots (Eckmann et al., 1987; Webber and Zbilut, 1994), Permutation Entropy (Bandt and Pompe, 2002), or the visualization of synchronization patterns by item-to-item intercorrelations calculated in a running window. All types of analysis are open to be used by therapists and can be integrated into feedback and used for individualizing therapeutic decisions.
Questionnaires
As daily process monitoring, patients filled in the Therapy Process Questionnaire (TPQ, Haken and Schiepek, 2010; Schiepek et al., 2012; see Appendix in Supplementary Material for an English translation of the TPQ). The 42 items of the inpatient version are given on seven-point Likert scales or visual analog scales, and the continuous ratings are transformed into time series of the clinical course. All items request an answer, so the clients are not able to skip questions. A factor analysis resulted in a 7 factor resolution: I Therapy progress, confidence in treatment effects, self-efficacy; II Ward atmosphere, social relationship to fellow patients; III Working alliance and trust in therapists; IV Dysphoric emotions; V Opening of perspectives, insight, personal innovations; VI Intensity of therapeutic work, motivation to change; VII Impairment by symptoms and problems (see Figure 2 and Appendix in Supplementary Materials). The application of the feedback system started in 2007 and continues. A second explorative factor analysis combined with a confirmatory factor analysis of the items revealed a 5 factor structure (Schiepek et al., 2012).
For an assessment of pre-post differences and follow-ups, the ICD-10 Symptom Rating is used (ICD-10-SR; Tritt et al., 2007). Clients reported weekly on the respective scales of the Depression Anxiety Stress Scales (short form: DASS 21; Lovibond and Lovibond, 1995; Antony et al., 1998; Newnham et al., 2010b). In addition, several questionnaires are restricted to specific diagnoses (e.g., Borderline Symptom List [BSL]; Bohus et al., 2009; Yale-Brown Obsessive Compulsive Scale [Y-BOCS]; Goodman et al., 1989) or are used in specific projects only (e.g., the German version of the Outcome Questionnaire [OQ]; Lambert et al., 2002b, 2004).
Participants
This feasibility study was realized at the Department of Inpatient Psychotherapy and at the Department of Psychosomatics/Day-Treatment Center, Christian Doppler University Clinic, Salzburg, Austria. The sample includes the cohort of 159 clients which were released after treatment in 2013 [7 clients were not included in the SNS routine, 1 was excluded for inconsistencies in the data set; see Table 1 for a characterization of the sample (N = 151)]. The Therapy Process Questionnaire is filled in daily, normally in the evening hours. Its welcoming text specifically asks to report on all aspects covered in the TPQ as experienced at the current day. Clients were free to access the questionnaires via internet through private devices or make use of the clinic's infrastructure. The introduction to the TPQ items and the use of SNS is made by the responsible psychotherapist at the very beginning of the hospital stay. All clients sign an informed consent, introducing real-time monitoring as a routine part of the clinics practice as well as the willingness for allowing the data to be used for empirical purposes. Application of the SNS to patients and the usage of the retrieved data has been approved by the ethical committee of the Paracelsus Medical University.
Table 1. Descriptives, comorbidity and baseline DASS-21 and ISR-Total scores.
Compliance, Completeness, and Missing Data
Compliance for filling out the process questionnaire (TPQ) once per day was defined by the percentage of days a client answered the questionnaire related to the days of his/her hospital stay. Delayed starting, early termination, or missing data within the monitoring period all reduce the compliance rate. The maximum number of treatment days is defined by the regular treatment period of 8 weeks in the day-treatment unit of the Department of Psychosomatics and 12 weeks in the Department of Inpatient Psychotherapy (hereof some patients sleep at home and can therefore be understood as day-treatment patients of that department). All—but one—patients, that started to fill the TPQ at a respective day, also finished all items of that day's questionnaire. There are no further questionnaires with single missing items. Therefore, missing data can be understood as missed days, expressed as percentage of missed days in relation to all days of SNS-activation. Completeness relates to the percentage of days patients actually fulfilled the planned treatment stay. 100% completeness corresponds to a treatment cycle of 50 days in the Department of Psychosomatics and of 90 days in the Department of Inpatient Psychotherapy. If the client stayed longer—a procedure occasionally chosen when clinically indicated—he/she is defined as a 100% completer, too. Less than 100% completeness may have various reasons, e.g., aversion to the treatment concept, acute suicidality, discharge for disciplinary reasons, exacerbation of psychotic symptoms, or drop out by a client's decision to finish the treatment.
To answer the research question of a possible relationship between symptom severity and compliance rate, the correlation between the subscales of the DASS and the ISR total score and the compliance rate were calculated. The dependency of the compliance rate on the superordinate ICD-10 diagnosis categories F30, F40, and F60 was tested by a univariate ANOVA with diagnosis categories as the independent and the compliance rate as the dependent variable.
Results
Compliance and Completeness
The mean compliance of the sample was 78.3% (SD 26.0; median 89.4%). 66.4% of all clients realized a compliance rate of 80% or more, 49.3% realized a compliance rate of 90% or more, and 25 clients (16.4%) had a compliance rate of 100%. Figure 3 illustrates the distribution of the clients in a compliance-completeness scatter plot. 37.5% of all patients made use of at least 90% of the available treatment period (completers) and had a compliance of at least 90% to the daily real-time monitoring. Of all clients with a treatment completeness of ≥ 90% (N = 107), only 21 (13.8%) had a compliance rate of less than 60%, and only 32 (21.1%) filled in the daily questionnaire less than 80% of the treatment days. Treatment completers thus realized a high rate of monitoring compliance. Clients with inpatient treatment (n = 58) had significantly less compliance as compared to patients in day treatment (n = 87), with t(143) = −1.98, p = 0.049, [95% CI: −16.9 – −0.02].
Figure 3. Distribution of response compliance and treatment completeness. The scatterplot depicts for each patient (+) the individual compliance and completeness score. Compliance denotes the percentage of days a client answered the questionnaire per number of days of his/her actual hospital stay. Completeness is defined as the percentage of days a client fulfilled the planned treatment stay (50 or 90 days, respectively).
Distribution of Missing Data
The mean time series length of the 115 clients of the Department of Inpatient Psychotherapy was 73.4 measurement points (= days) (SD 31.5), the mean time series length of the 37 clients of the psychosomatic day-treatment center was 47.9 (SD 10.0). The complete sample had on average 10.1% missing values within the time series (SD 18.0; median 1.3%) (inpatient psychotherapy: 10.3%, SD 19.3, median 0.0%; day-treatment center: 9.4%, SD 13.2, median 3.9%). 81.6% of all clients had less than 20% missing data, 73.7% of all clients had less than 10% missing data, and 74 clients (48.7%) had no missing data (0%). Figure 4 shows the distribution of missing days in relation to the number of patients in treatment, corrected for the total number of missing days in the sample. The decreasing trend of this parameter exemplifies that patients that started SNS become less likely to miss a day, the longer they stay in treatment. With other words, the data suggests that patients do not get tired to fill in a questionnaire on daily basis. Consequently, there is a positive relationship between length of hospital stay and monitoring compliance, expressed by a correlation of 0.231 (p < 0.004).
Figure 4. Distribution of missed days. Depicted is per day the squared number of missed days, divided by the product of total possible number of clients missing a day X the total number of missed days in the sample; one can interpret the figure as the distribution of missed days, corrected for the fact that the sample thins out toward increasing number of therapy days.
Compliance and Its Relationship to Symptom Severity
Symptom or problem severity was defined by the DASS subscales (depression, anxiety, and stress) and the ISR total score at admission to psychotherapy. The Pearson correlation coefficients of the compliance rate with these scales are as follows: DASS depression scale: r = −0.081 (p = 0.325), DASS anxiety scale: r = −0.035 (p = 0.668), DASS stress scale: r = −0.069 (p = 0.403), ISR total score: r = −0.073 (p = 0.380). This corresponds to a real null correlation between symptom/problem intensity or burden of disease with the monitoring compliance.
Compliance and Its Relationship to Type of Diagnosis
For testing the differences between the compliance rates of the frequent diagnosis categories of this sample [F30: mood (affective) disorders; F40: neurotic, stress-related, and somatoform disorders; F60: disorders of adult personality and behavior; see Tables 1, 2] a univariate ANOVA was calculated (F = 5.37, df = 2, p = 0.006). Multiple comparisons (Scheffé Test) indicate significant differences between the compliance rates of F30 (83.2%) and F60 (66.1%) (p = 0.010), F40 (81.1%) to F60 (66.1%) (p = 0.027), but not between F30 and F40 (p = 0.920). Evidently, the compliance rate of the clients diagnosed with personality disorders (F60) was significantly lower than the compliance rate of the other categories (F30, F40). A comparison of the diagnosis categories with % missing data (Table 2; univariate ANOVA) produced similar but less pronounced results (F = 3.26, df = 2, p = 0.041). Multiple comparisons (Scheffé Test) indicate that the difference between the percentage of missing data of F30 (6.9%) and F60 (16.3%) scarcely misses the 5%-significance level (p = 0.051), differences between F40 (8.6%) and F60 (16.3%) (p = 0.136), or between F30 to F40 (p = 0.882) are far from being significant.
Table 2. Diagnoses of the sample and their prevalence, percentage in sample, percentage compliance and percentage missing data.
Discussion
The results illustrate the feasibility of a highly resolved real-time monitoring procedure on psychotherapy processes in an inpatient and a day-treatment setting. A large proportion of the clients revealed high compliance rates and low rates of missing data, resulting in time series of high frequency, low missing rates, and equidistant measurements. Application of the questionnaires was accomplished using an internet-based device (SNS) with a process questionnaire of 42 items (Therapy Process Questionnaire, Haken and Schiepek, 2010) during the complete period of psychotherapy of at least three respectively 2 months. Problem or symptom severity had no impact on the compliance rate, which implicates that more impaired patients can also make use of the monitoring procedure. Clients with personality disorder diagnosis [F60, most of them (31 out of 36) emotionally instable personality disorder, F60.3] revealed lower rates of monitoring compliance and slightly higher rates of missing data (difference scarcely over the significance threshold) than others. The positive correlation between completeness (days of treatment) and compliance (r = + 0.231) indicates that there is no fatigue, resistance, or reactance effect with increasing duration of the monitoring (as a negative correlation would have suggested).
The study replicates the promising compliance rates found in other studies on ambulatory assessement (e.g., Voelkl and Mathieu, 1993; Axelson et al., 2003; Tennen et al., 2006; Knowles et al., 2007; Putnam and McSweeney, 2008; for a review see Wenze and Miller, 2010) and contradicts low compliance or acceptability rates reported especially for mood disordered clients (Barge-Schaapveld et al., 1999; Myin-Germeys et al., 2003). In a suicide prevention program high-freqeuncy monitoring was possible even with persons at high risk for suicide (Schiepek et al., 2011; Fartacek et al., 2016). In accordance with other studies, we found no reduced compliance at higher levels of symptomatology (Voelkl and Mathieu, 1993; Stetler et al., 2004; Peeters et al., 2006; Havermans et al., 2007). Further investigation is needed on the impact of repeated self-ratings on daily moods (Barge-Schaapveld et al., 1995). In comparison to the context of research studies on ambulatory assessment, real-time monitoring was used here in a therapeutic context for reasons of progress feedback and reflection on change dynamics. Using a monitoring questionnaire for therapy that reflects factors contributing to therapeutic progress activates personal resources, enhances motivation, supports re-moralization, and inspires confidence. A randomized controlled trial on the add-on effects of high-frequency monitoring and feedback (compared to treatment as usual without feedback) in chronic alcohol-dependent men showed effects in emotion perception and emotion regulation, but not in depression and other psychopathological symptoms (Patzig and Schiepek, 2015).
A limitation is the restriction of the data to inpatient and day-treatment settings. In consequence, an important future challenge will be the application to outpatient psychotherapy and to establish a feedback-driven dynamic systems approach in the routine practice of different settings and mental health services. Another challenge is the integration of the feedback-driven dynamic systems approach into the training of psychotherapists. An understanding of complex nonlinear systems will be of importance, since high-frequency monitoring and related tools for data analysis (like the SNS) make evidence for nonlinear processes and self-organization in every single case (Schiepek et al., 2015). A further component of training in psychotherapy monitoring is the practice of feedback-based interviewing and process reflection. The dynamics have to be reflected on regularly and implications for the next steps of the psychotherapeutic process have to be considered. Many years of practice and an actual interview study (unpublished data) gave evidence for the importance of the frequency and quality of feedback-referred interview sessions and its impact on the compliance and commitment to the monitoring.
The consequences for psychotherapy research are manifold: highly resolved real-time monitoring can define a standard for the investigation of dynamic phenomena like drop-outs and its precursors, sudden changes or sudden losses, crisis-repair sequences, phase-transition-like phenomena, dosis-to-effect shapes, or sustainable and long-term outcomes. Even the outcome may be evaluated not only by pre-post differences in outcome measures, but by changing dynamic patterns of cognitions and emotions [e.g., changes in the rapid cycling of mood or affective instability in Borderline Personality Disorders (compare Figure 1) or Bipolar Disorders, see Marwaha et al., 2014]. Here, the use of equidistant time-sampling is crucial. Studies on non-stationarities in neural networks during psychotherapy use the identification of critical instabilities by high-frequency monitoring to correlate neural and mental (cognitive/affective) pattern transitions (Schiepek et al., 2009, 2013). In the future, nonlinearity and nonstationarity of change processes can be assessed in ongoing psychotherapies, which should take more attention to sampling rates and the quality of monitoring based feedback to the clients.
One additional future application and improvement of feedback procedures are idiographic approaches to individual item selection and case formulation (Schiepek, 2003). Integrating personal topics, problems, and goals of a client to a questionnaire can improve the items' specificity and sensitiveness and thereby add to the validity of the information produced by the measurement instrument (Mumma, 2004; Barlow and Nock, 2009; Molenaar, 2013). Furthermore, clients will not only experience personal involvement; after editing an individual questionnaire together with a therapist, the professional relationship between therapist and client will also improve (unpublished data from an interview study, publication in preparation). This enhances the autocatalytic effects produced by continuous self-ratings and the compliance for filling out the questionnaires in short intervals. One approach to individualized monitoring is a systemic case formulation by idiographic systems modeling (Schiepek et al., 2015) which results in a graphic network of recursively interconnected variables constituting the most important cognitive, emotional, and social components of the client's problem system. This modeling work is done in close cooperation of client and therapist. The variables of the model are used to define the items of a personal questionnaire which can be designed by the questionnaire editor of the Synergetic Navigation System. Monitoring the results of a daily administered individualized questionnaire allows for the continuous assessment of a patient's idiosyncratic dynamics of therapy and for feedback to therapist and patient in time, thereby creating a powerful, feasible tool on basis of a feedback-driven dynamic systems approach.
Author Contributions
GSch and BA contributed to data gathering, text, study design, and data analysis. GSt contributed significant to data analysis and study design. EB, MG, and WA contributed significantly to data gathering and study design. All authors added corrections and proofread the paper.
Funding
Paracelsus Medical University, Salzburg, Austria. Award number: R-14/02/058-AAS.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
This research was funded by the Paracelsus Medical University (grant R-14/02/058-AAS). Special thanks go to Kate Liesel Hach for helping with the translation of the TPQ and her valuable suggestions to style and language of this article.
Supplementary Material
The Supplementary Material for this article can be found online at: http://journal.frontiersin.org/article/10.3389/fpsyg.2016.00604
References
Anker, M., Duncan, B., and Sparks, J. (2009). Using client feedback to improve couples therapy outcomes: a randomized clinical trial in a naturalistic setting. J. Consult. Clin. Psychol. 77, 693–704. doi: 10.1037/a0016062
Antony, M. M., Bieling, P. J., Cox, B. J., Enns, M. W., and Swinson, R. P. (1998). Psychometric properties of the 42-item and 21-item versions of the Depression Anxiety Stress Scales in clinical groups and a community sample. Psychol. Assess. 10, 176–181.
Axelson, D. A., Bertocci, M. A., Lewin, D. S., Trubnick, L. S., Birmaher, B., Williamson, D. E., et al. (2003). Measuring mood and complex behavior in natural environments: use of ecological momentary assessment in pediatric affective disorders. J. Child Adolesc. Psychopharmacol. 13, 253–266. doi: 10.1089/104454603322572589
Bandt, C., and Pompe, B. (2002). Permutation Entropy: a natural complexity measure for time series. Phys. Rev. Lett. 88:174102. doi: 10.1103/PhysRevLett.88.174102
Barge-Schaapveld, D. Q. C. M., Nicolson, N. A., Berkof, J., and deVries, M. W. (1999). Quality of life in depression: daily life determinants and variability. Psychiatric Res. 88, 173–189. doi: 10.1016/S0165-1781(99)00081-5
Barge-Schaapveld, D. Q. C. M., Nicolson, N. A., van der Hoop, R. G., and deVries, M. W. (1995). Changes in daily life experience associated with clinical improvement in depression. J. Affect. Disord. 34, 139–154. doi: 10.1016/0165-0327(95)00012-C
Barlow, D. H., and Nock, M. K. (2009). Why can't we be more idiographic in our research? Perspect. Psychol. Sci. 4, 19–21. doi: 10.1111/j.1745-6924.2009.01088.x
Bech, P., Gudex, C., and Johansen, K. S. (1996). The WHO Well-being Index: validation in diabetes. Psychother. Psychosom. 65, 183–190. doi: 10.1159/000289073
Bohus, M., Kleindienst, N., Limberger, M. F., Stieglitz, R. D., Domsalla, M., Chapman, A., et al. (2009). The short-version of the Borderline Symptom List (BSL-23): development and initial data on psychometric properties. Psychopathology 42, 32–39. doi: 10.1159/000173701
Bornas, X., Noguera, M., Pincus, D., and Buela-Casal, G. (2014). Emotional inertia: a key to understanding psychotherapy process and outcome. Int. J. Clin. Health Psychol. 14, 232–239. doi: 10.1016/j.ijchp.2014.03.001
Cohen, L. (1989). Time-frequency distributions – a review. Proc IEEE 77, 941–981. doi: 10.1109/5.30749
de Beurs, E., den Hollander-Gijsman, M. E., van Rood, Y. R., van der Wee, N. J. A., Giltay, E. J., van Noorden, M. S., et al. (2011). Routine outcome monitoring in the Netherlands: practical experiences with a web-based strategy for the assessment of treatment outcome in clinical practice. Clin. Psychol. Psychother. 18, 1–12. doi: 10.1002/cpp.696
de Jong, K., Timman, R., Hakkaart-van Roijen, L., Vermeulen, P., Kooiman, K., Passchier, J., et al. (2014). The effect of outcome monitoring feedback to clinicians and patients in short and long-term psychotherapy: a randomized controlled trial. Psychother. Res. 24, 629–639. doi: 10.1080/10503307.2013.871079
Duncan, B., Miller, S., Wampold, B., and Hubble, M. (2010). The Heart and Soul of Change. 2nd Edn. Washington, DC: APA.
Ebner-Priemer, U., and Trull, T. (2009). Ecological momentary assessment of mood disorders and mood dysregulation. Psychol. Assess. 21, 463–475. doi: 10.1037/a0017075
Eckmann, J. P., Oliffson Kamphorst, S., and Ruelle, D. (1987). Recurrence plots of dynamical systems. Europhys. Lett. 4, 973–977. doi: 10.1209/0295-5075/4/9/004
Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., and Mellor-Clark, J. (2002). Towards a standardized brief outcome measure: psychometric properties and utility of the CORE-OM. Br. J. Psychiatry 180, 51–60. doi: 10.1192/bjp.180.1.51
Fahrenberg, J., Myrtek, M., Pawlik, K., and Perrez, M. (2007). Ambulatory assessment – monitoring behavior in daily life settings. Eur. J. Psychol. Assess. 23, 206–213. doi: 10.1027/1015-5759.23.4.206
Fartacek, C., Schiepek, G., Kunrath, S., Fartacek, R., and Plöderl, M. (2016). Real-time monitoring of nonlinear suicidal dynamics: methodology and a demonstrative case report. Front. Psychol. 7:130. doi: 10.3389/fpsyg.2016.00130
Goodman, W. K., Price, L. H., Rasmussen, S. A., Mazure, C., Fleischmann, R. L., Hill, C. L., et al. (1989). The Yale-Brown obsessive compulsive scale. I. Development, use, and reliability. Archives Gen. Psychiatry 46, 1006–1011. doi: 10.1001/archpsyc.1989.01810110048007
Granic, I., O'Hara, A., Pepler, D., and Lewis, M. (2007). A dynamic systems analysis of parent child changes associated with successful real-world interventions for aggressive children. J. Abnorm. Child Psychol. 35, 845–857. doi: 10.1007/s10802-007-9133-4
Gumz, A., Bauer, K., and Brähler, E. (2012b). Corresponding instability of patient and therapist process ratings in psychodynamic psychotherapies. Psychother. Res. 22, 26–39. doi: 10.1080/10503307.2011.622313
Gumz, A., Brähler, E., Geyer, M., and Erices, R. (2012a). Crisis-repair-sequences - considerations on the assessment and classification of breaches in the therapeutic relationship. BMC Med. Res. Methodol. 12:10. doi: 10.1186/1471-2288-12-10
Haken, H., and Schiepek, G. (2010). Synergetik in der Psychologie [Synergetics in Psychology], 2nd Edn. Göttingen: Hogrefe.
Havermans, R., Nicolson, N. A., and deVries, M. W. (2007). Daily hassles, uplifts, and time use in individuals with bipolar disorder in remission. J. Nervous Mental Dis. 195, 745–751. doi: 10.1097/NMD.0b013e318142cbf0
Hawkins, E. J., Lambert, M. J., Vermeersch, D. A., Slade, K. L., and Tuttle, K. C. (2004). The therapeutic effects of providing patient progress information to therapists and patients. Psychother. Res. 14, 308–327. doi: 10.1093/ptr/kph027
Hayes, A. M., Feldman, G. C., Beevers, C. G., Laurenceau, J. P., Cardaciotto, L. A., and Lewis-Smith, J. (2007a). Discontinuities and cognitive changes in an exposure-based cognitive therapy for depression. J. Consult. Clin. Psychol. 75, 409–421. doi: 10.1037/0022-006X.75.3.409
Hayes, A. M., Laurenceau, J. P., Feldman, G. C., Strauss, J. L., and Cardaciotto, L. A. (2007b). Change is not always linear: the study of nonlinear and discontinuous patterns of change in psychotherapy. Clin. Psychol. Rev. 27, 715–723. doi: 10.1016/j.cpr.2007.01.008
Heath, R. A. (2000). Nonlinear Dynamics: Techniques and Applications in Psychology. Mahwah, NJ: Lawrence Earlbaum Associates.
Heinzel, S., Tominschek, I., and Schiepek, G. (2014). Dynamic patterns in psychotherapy - discontinuous changes and critical instabilities during the treatment of obsessive compulsive disorder. Nonlinear Dyn. Psychol. Life Sci. 18, 155–176. doi: 10.339/fpsyg.2014.01089
Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., and Lutz, W. (1996). Evaluation of psychotherapy: efficacy, effectiveness, and patient progress. Am. Psychologist 51, 1059–1064. doi: 10.1037/0003-066X.51.10.1059
Kantz, H., and Schreiber, T. (1997). Nonlinear Time Series Analysis. Cambridge, UK: Cambridge University Press.
Kelso, J. A. S. (1995). Dynamic Patterns. The Self-Organization of Brain and Behavior. Cambridge, MA: MIT Press.
Knowles, R., Tai, S., Jones, S. H., Highfield, J., Morriss, R., and Bentall, R. P. (2007). Stability of self-esteem in bipolar disorder: comparisons among remitted bipolar patients, remitted unipolar patients, and healthy controls. Bipolar Disord. 9, 490–495. doi: 10.1111/j.1399-5618.2007.00457.x
Kowalik, Z. J., Schiepek, G., Kumpf, K., Roberts, L. E., and Elbert, T. (1997). Psychotherapy as a chaotic process II: the application of nonlinear analysis methods on quasi time series of the client-therapist-interaction: a nonstationary approach. Psychother. Res. 7, 197–218. doi: 10.1080/10503309712331331973
Kraus, D. R., Seligman, D. A., and Jordan, J. R. (2005). Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings: the treatment outcome package. J. Clin. Psychol. 61, 285–314. doi: 10.1002/jclp.20084
Lambert, M. J. (2007). Presidential address: what we have learned from a decade of research aimed at improving psychotherapy outcome in routine care. Psychother. Res. 17, 1–14. doi: 10.1080/10503300601032506
Lambert, M. J. (2010). “Yes, it is time for clinicians to routinely monitor treatment outcome,” in The Heart and Soul of Change, 2nd Edn., eds B. Duncan, S. Miller, B. Wampold, and M. Hubble (Washington, DC: American Psychological Association), 237–266.
Lambert, M. J., Hannöver, W., Nisslmüller, K., Richard, M., and Kordy, H. (2002b). Fragebogen zum Ergebnis von Psychotherapy: Reliabilität und Validität der Deutschen Übersetzung des Outcome Questionnaire 45-2 (OQ 45.2) [Questionnaire on the outcome of psychotherapy: reliability and validity of the German translation of the Outcome Questionnaire 45-2 [OQ 45.2]). Zeitschrift für Klinische Psychologie und Psychotherapie (Journal of Clinical Psychology and Psychotherapy). 31, 40–47. doi: 10.1026/0084-5345.31.1.40
Lambert, M. J., Harmon, C., Slade, K., Whipple, J. L., and Hawkins, E. J. (2005). Providing feedback to psychotherapists on their patient's progress: clinical results and practice suggestions. J. Clin. Psychol. 61, 165–174. doi: 10.1002/jclp.20113
Lambert, M. J., Morton, J. J., Hatfield, D. R., Harmon, C., Hamilton, S., and Shimokawa, K. (2004). Administration and Scoring Manual for the OQ-45.2 (Outcome Questionnaire), 3rd Edn. Wilmington, DE: American Professional Credentialling Services.
Lambert, M. J., Whipple, J. L., Vermeersch, D. A., Smart, D. W., Hawkins, E. J., Nielsen, S. L., et al. (2002a). Enhancing psychotherapy outcomes via providing feedback on client progress: a replication. Clin. Psychol. Psychother. 9, 91–103. doi: 10.1002/cpp.324
Lovibond, S. H., and Lovibond, P. F. (1995). Manual for the Depression Anxiety Stress Scales. Sydney, NSW: Psychology Foundation.
Lutz, W., Ehrlich, T., Rubel, J., Hallwachs, N., Röttger, M. A., Jorasz, C., et al. (2013). The ups and downs of psychotherapy: sudden gains and sudden losses identified with session reports. Psychother. Res. 23, 14–24. doi: 10.1080/10503307.2012.693837
Marwaha, S., He, Z., Broome, M., Singh, S. P., Scott, J., Eyden, J., et al. (2014). How is affective instability defined and measured? A systematic review. Psychol. Med. 44, 1793–1808. doi: 10.1017/S0033291713002407
Miller, S. D., Duncan, B. L., Sorrell, R., and Brown, G. S. (2005). The partners for change outcome management system. J. Clin. Psychol. 61, 199–208. doi: 10.1002/jclp.20111
Molenaar, P. C. M. (2010). Note on optimization of individual psychotherapeutic processes. J. Math. Psychol. 54, 208–213. doi: 10.1016/j.jmp.2009.04.003
Molenaar, P. C. M. (2013). On the necessity to use person-specific data analysis approaches in psychology. Eur. J. Dev. Psychol. 10, 29–39. doi: 10.1080/17405629.2012.747435
Mumma, G. H. (2004). Validation of idiosyncratic cognitive schema in cognitive case formulations: an intraindividual idiographic approach. Psychol. Assess. 16, 211–230. doi: 10.1037/1040-3590.16.3.211
Myin-Germeys, I., Peeters, F., Havermans, R., Nicolson, N. A., deVries, M. W., Delespaul, P., et al. (2003). Emotional reactivity to daily life stress in psychosis and affective disorder: an experience sampling study. Acta Psychiatr. Scand. 107, 124–131. doi: 10.1034/j.1600-0447.2003.02025.x
Newnham, E. A., Hooke, G. R., and Page, A. C. (2010a). Monitoring treatment response and outcomes using the World Health Organization's Wellbeing Index in psychiatric care. J. Affect. Disord. 122, 133–138. doi: 10.1016/j.jad.2009.06.005
Newnham, E. A., Hooke, G. R., and Page, A. C. (2010b). Progress monitoring and feedback in psychiatric care reduces depressive symptoms. J. Affect. Disord. 127, 139–146. doi: 10.1016/j.jad.2010.05.003
Newnham, E. A., and Page, A. C. (2010). Bridgig the gap between best evidence and best practice in mental health. Clin. Psychol. Rev. 30, 127–142. doi: 10.1016/j.cpr.2009.10.004
Norcross, J. C., and Lambert, M. J. (Eds.). (2011). Psychotherapy relationships that work II. Psychotherapy 48. doi: 10.1037/a0022180
Patzig, J., and Schiepek, G. (2015). “Emotionsregulation und emotionsfokussiertes Prozessmonitoring in der Suchttherapie [Emotion regulation and emotion-focused process monitoring in the treatnment of addictions],” in Der psychotherapeutische Prozess [The psychotherapeutic process], eds I. Sammet, G. Dammann, and G. Schiepek (Stuttgart: Kohlhammer), 124–139.
Peeters, F., Berkhof, J., Delespaul, P., Rottenberg, J., and Nicolson, N. A. (2006). Diurnal mood variation in major depressive disorder. Emotion 6, 383–391. doi: 10.1037/1528-3542.6.3.383
Putnam, K. M., and McSweeney, L. B. (2008). Depressive symptoms and baseline prefrontal EEG alpha activity: a study utilizing ecological momentary assessment. Biol. Psychol. 77, 237–240. doi: 10.1016/j.biopsycho.2007.10.010
Scheffer, M., Bascompte, J., Brock, W. A., Brovkin, V., Carpenter, S. R., Dakos, V., et al. (2009). Early-warning signals for critical transitions. Nat. Rev. 461, 53–59. doi: 10.1038/nature08227
Schiepek, G. (2003). A dynamic systems approach to clinical case formulation. Eur. J. Psychol. Assess. 19, 175–184. doi: 10.1027//1015-5759.19.3.175
Schiepek, G., Aas, B., and Viol, K. (in press). The mathematics of psychotherapy – a nonlinear model of change dynamics. Nonlinear Dyn. Psychol. Life Sci. 20.
Schiepek, G., and Aichhorn, W. (2013). Real-time monitoring in der psychotherapie (Real-time monitoring in psychotherapy). Psychother. Psychosom. Med. Psychol. 63, 39–47. doi: 10.1055/s-0032-1327593
Schiepek, G., Aichhorn, W., and Strunk, G. (2012). Der Therapie-Prozessbogen (TPB). Faktorenstruktur und psychometrische Daten [The Therapy Process Questionnaire [TPQ]. Factor structure and psychometric data]. Zeitschrift für Psychosomatische Medizin und Psychotherapie (Journal of Psychosomatic Medicine and Psychotherapy). 58, 257–266. doi: 10.13109/zptm.2012.58.3.257
Schiepek, G., Eckert, H., Aas, B., Wallot, S., and Wallot, A. (2015). Integrative Psychotherapy. A Feedback-Driven Dynamic Systems Approach. Boston, MA: Hogrefe International Publishers.
Schiepek, G., Fartacek, C., Sturm, J., Kralovec, K., Fartacek, R., and Pöderl, M. (2011). Nonlinear dynamics: theoretical perspectives and application to suicidology. Suicide Life Threat. Behav. 41, 661–675. doi: 10.1111/j.1943-278X.2011.00062.x
Schiepek, G., Heinzel, S., Karch, S., Aas, B., and Strunk, G. (2014a). Chaos and self-organization in psychotherapy. Chaos and Complexity Lett. 8, 231–256.
Schiepek, G., Kowalik, Z. J., Schütz, A., Köhler, M., Richter, K., Strunk, G., et al. (1997). Psychotherapy as a chaotic process I. Coding the client-therapist-interaction by means of sequential plan analysis and the search for chaos: a stationary approach. Psychother. Res. 7, 173–194. doi: 10.1080/10503309712331331953
Schiepek, G., and Strunk, G. (2010). The identification of critical fluctuations and phase transitions in short term and coarse-grained time series – a method for the real-time monitoring of human change processes. Biol. Cybern. 102, 197–207. doi: 10.1007/s00422-009-0362-1
Schiepek, G., Tominschek, I., and Heinzel, S. (2014b). Self-organization in psychotherapy - testing the synergetic model of change processes. Front. Psychol. 5:1089. doi: 10.3389/fpsyg.2014.01089
Schiepek, G., Tominschek, I., Heinzel, S., Aigner, M., Dold, M., Unger, A., et al. (2013). Discontinuous patterns of brain activation in the psychotherapy process of obsessive compulsive disorder: converging results from repeated fMRI and daily self-reports. PLoS ONE 8:e71863 doi: 10.1371/journal.pone.0071863
Schiepek, G., Tominschek, I., Karch, S., Lutz, J., Mulert, C., Meindl, T., et al. (2009). A controlled single case study with repeated fMRI measures during the treatment of a patient with obsessive-compulsive disorder: testing the nonlinear dynamics approach to psychotherapy. World J. Biol. Psychiatry 10, 658–668. doi: 10.1080/15622970802311829
Stetler, C., Dickerson, S. S., and Miller, G. E. (2004). Uncoupling of social zeitgebers and diurnal cortisol secretion in clinical depression. Psychoneuroendocrinology 29, 1250–1259. doi: 10.1016/j.psyneuen.2004.03.003
Stiles, W. B., Glick, M. J., Osatuke, K., Hardy, G. E., Shapiro, D. A., Agnew-Davies, R., et al. (2004). Patterns of alliance development and the rupture-repair hypothesis: are productive relationships U-shaped or V-shaped? J. Couns. Psychol. 51, 81–91. doi: 10.1037/0022-0167.51.1.81
Stiles, W., Leach, C., Barkham, M., Lucock, M., Iveson, S., Shapiro, D., et al. (2003). Early sudden gains in psychotherapy under routine clinic conditions: practice-based evidence. J. Consult. Clin. Psychol. 71, 14–21. doi: 10.1037/0022-006X.71.1.14
Strunk, G., and Schiepek, G. (1996). Systemische Psychologie. Einführung in die komplexen Grundlagen menschlichen Verhaltens. [Systemic Psychology. An Introduction to Complexity in Human Behavior and Cognition]. München: Elsevier.
Tennen, H., Affleck, G., and Zautra, A. (2006). Depression history and coping with chronic pain: a daily process analysis. Health Psychol. 25, 370–379. doi: 10.1037/0278-6133.25.3.370
Trauer, T. (Ed.). (2010). Outcome Measurement in Mental Health. Theory and Practice. Cambridge: Cambridge University Press.
Tritt, K., von Heymann, F., Zaudig, M., Zacharias, I., Söllner, W., and Löw, T. (2007). Die Entwicklung des Fragebogens ICD-10-Symptom-Rating (ISR) – Kurzbeschreibung der Pilotversion 1.0 und der Version 2.0 [The development of the Questionnaire ICD-10-Symptom-Rating (ISR) – A short description of the pilot version 1.0 and version 2.0]. Regensburg: Institut für Qualitätsentwicklung in der Psychotherapie und Psychosomatik.
Tschacher, W., Scheier, C., and Grawe, K. (1998). Order and pattern formation in psychotherapy. Nonlinear Dyn. Psychol. Life Sci. 2, 195–215. doi: 10.1023/A:1022324018097
Voelkl, J. E., and Mathieu, M. A. (1993). Differences between depressed and non-depressed residents of nursing homes on measures of daily activity involvement and affect. Ther. Recreation J. 3, 144–155.
Ware, J. E., Snow, K. K., Kosinski, M., and Gandek, B. (1993). SF-36 Health Survey: Manual and Interpretation Guide. Boston, MA: The Health Institute, New England Medical Centre.
Webber, C. L., and Zbilut, J. P. (1994). Dynamical assessment of physiological systems and states using recurrence plot strategies. J. Appl. Physiol. 76, 965–973.
Wenze, S. J., and Miller, I. W. (2010). Use of ecological momentary assessemnt in mood disorders research. Clin. Psychol. Rev. 30, 794–804. doi: 10.1016/j.cpr.2010.06.007
Keywords: real-time monitoring, momentary ecological assessment, nonlinear dynamics, compliance, process-outcome research
Citation: Schiepek G, Aichhorn W, Gruber M, Strunk G, Bachler E and Aas B (2016) Real-Time Monitoring of Psychotherapeutic Processes: Concept and Compliance. Front. Psychol. 7:604. doi: 10.3389/fpsyg.2016.00604
Received: 03 December 2015; Accepted: 11 April 2016;
Published: 03 May 2016.
Edited by:
Osmano Oasi, Catholic University of the Sacred Heart, ItalyReviewed by:
Xavier Bornas, University of the Balearic Islands, SpainPaula Dagnino, Universidad Gabriela Mistral, Chile
Copyright © 2016 Schiepek, Aichhorn, Gruber, Strunk, Bachler and Aas. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Günter Schiepek, guenter.schiepek@ccsys.de