Home | About | Journals | Submit | Contact Us | Français |

**|**BMC Psychiatry**|**v.11; 2011**|**PMC3155483

Formats

Article sections

- Abstract
- Background
- Methods
- Results
- Discussion
- Conclusions
- Competing interests
- Authors' contributions
- Appendix One. Context Free Grammar Complexity
- Appendix Two. Lempel-Ziv Complexity
- Appendix Three: Specification of Model System
- Pre-publication history
- References

Authors

Related links

BMC Psychiatry. 2011; 11: 119.

Published online 2011 July 27. doi: 10.1186/1471-244X-11-119

PMCID: PMC3155483

Paul E Rapp,^{}^{1} Christopher J Cellucci,^{2} Adele MK Gilpin,^{3,}^{4} Miguel A Jiménez-Montaño,^{5} and Kathryn E Korslund^{6}

Paul E Rapp: lim.shusu@pparp; Christopher J Cellucci: moc.liamg@iccullec; Adele MK Gilpin: moc.notnuh@nipliga; Miguel A Jiménez-Montaño: xm.vu@zenemija; Kathryn E Korslund: ude.notgnihsaw.u@dnulsroK

Received 2010 July 27; Accepted 2011 July 27.

Copyright ©2011 Rapp et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

This article has been cited by other articles in PMC.

The role of psychotherapy in the treatment of traumatic brain injury is receiving increased attention. The evaluation of psychotherapy with these patients has been conducted largely in the absence of quantitative data concerning the therapy itself. Quantitative methods for characterizing the sequence-sensitive structure of patient-therapist communication are now being developed with the objective of improving the effectiveness of psychotherapy following traumatic brain injury.

The content of three therapy session transcripts (sessions were separated by four months) obtained from a patient with a history of several motor vehicle accidents who was receiving dialectical behavior therapy was scored and analyzed using methods derived from the mathematical theory of symbolic dynamics.

The analysis of symbol frequencies was largely uninformative. When repeated triples were examined a marked pattern of change in content was observed over the three sessions. The context free grammar complexity and the Lempel-Ziv complexity were calculated for each therapy session. For both measures, the rate of complexity generation, expressed as bits per minute, increased longitudinally during the course of therapy. The between-session increases in complexity generation rates are consistent with calculations of mutual information. Taken together these results indicate that there was a quantifiable increase in the variability of patient-therapist verbal behavior during the course of therapy. Comparison of complexity values against values obtained from equiprobable random surrogates established the presence of a nonrandom structure in patient-therapist dialog (P = .002).

While recognizing that only limited conclusions can be based on a case history, it can be noted that these quantitative observations are consistent with qualitative clinical observations of increases in the flexibility of discourse during therapy. These procedures can be of particular value in the examination of therapies following traumatic brain injury because, in some presentations, these therapies are complicated by deficits that result in subtle distortions of language that produce significant post-injury social impairment. Independently of the mathematical analysis applied to the investigation of therapy-generated symbol sequences, our experience suggests that the procedures presented here are of value in training therapists.

Traumatic brain injury is a significant cause of acute and long-term disability. Neurobehavioral sequelae encompass cognitive, social and psychiatric domains. Major depressive disorder is the most prevalent psychiatric disorder following traumatic brain injury regardless of the severity of the injury [1-9]. Estimates of prevalence are highly varied. Iverson, et al. [10] reviewed six studies of depression following traumatic brain injury and found reports of prevalence ranging from 12% to 44%. While prevalence rates are uncertain, a critical conclusion can be made. The treatment of neuropsychiatric disorders following traumatic brain injury is a significant clinical need that presents unique clinical challenges.

As commonly conceptualized, the clinical response to traumatic brain injury has four components: neuroprotection (preserve injured neurons), plastic modification (reconstruct neural networks with surviving neurons by promoting dendritic arborization and synaptogenesis), neurogenesis (stimulate the maturation of new neurons from stem cell populations), and neurointegration (facilitate the integration of newly formed neurons into the central nervous system). It is increasingly recognized, however, that psychotherapy is an important complement to this neurological response. Cope [11] has argued that "the majority of recovering survivors of TBI are now seen as potentially benefiting from some form of psychotherapeutic/rehabilitation treatment." Nonetheless, most individuals experiencing a head injury do not receive psychotherapy. In a review of the early history of psychotherapy following TBI, Prigatano [12] addressed the question, "Why has the role of psychotherapeutic interventions in the rehabilitation care of TBI patients gone unrecognized?" He suggests that "the answer seems to lie in the assumption that TBI patients could not benefit from psychotherapy because of their permanent cognitive, linguistic and affective disturbances." While this argument might be advanced when considering severe TBI, it does not seem plausible in cases of mild TBI. But is it even applicable in the case of severe TBI? Results reported by Ben-Yishay et al. [13] and by Ezrachi, et al. [14] indicate that psychotherapy following moderate or severe TBI has a positive effect on post-injury employment.

While psychotherapy is the preferred approach to the treatment of mood disorders following traumatic brain injury [1,2,15-17] there is limited research to help guide the selection of the specific therapeutic method [18,19]. The heterogeneity of this population demands a varied response. In part, the appropriate therapy will be determined by the physical injury, particularly the residual neurological and cognitive deficits. Individuals with TBI may benefit from treatments that take post-injury cognitive distortions into account [20-22]. The choice of therapy should also be responsive to pre-injury psychopathology [23,24]. There is an emerging literature detailing the benefits of cognitive behavior therapy across a variety of medical patients with acquired brain injuries of various severities comorbid with mood disorders [15-18,25,26]. Psychodynamic psychotherapy has also been considered. While cognitive deficits following head injury can limit the individual's ability to profit from psychodynamic psychotherapy, this is not invariably the case. As Lewis and Rosenberg [27] observed in a paper describing psychoanalytic psychotherapy following brain injury, "the overriding principle that guides such psychotherapeutic work is that acquired brain lesions do not ablate the patient's psyche or unconscious." These authors have identified five criteria that can help identify candidates for psychoanalytic psychotherapy following brain injury. (1.) The patient must be motivated to enter and remain in therapy. (2.) Patients who have had at least one positive significant relationship in the past are better able to form a therapeutic alliance. (3.) Patients who have had previous successes resulting from active effort are more likely to benefit from individual therapy. (4.) Patients in extreme psychological distress may require a more supportive intervention, including hospitalization, before initiating psychoanalytic therapy. (5.) The degree and form of brain injury can affect the appropriateness of analytic treatment. Patients with significant expressive or receptive language deficits are not appropriate candidates. In addition to outlining the potential benefits of a psychodynamically oriented therapy for appropriately selected patients, Lewis and Rosenberg make two points that are generically applicable to the consideration of psychotherapy following traumatic brain injury. First, unaddressed psychological problems can be an impediment to meaningful participation in physical, cognitive and occupational rehabilitation, thus providing an additional argument for including psychotherapy in the treatment of some presentations of traumatic brain injury. Second, the patient's altered experience of self should not be viewed as an entirely neurological symptom. Brain injuries have psychological meaning.

"Although such disruptions (brain injury) can significantly affect the patient's self-esteem, and often represent a major focus for family work, they may represent a more basic and profound disturbance in the patients' sense of self. That is, beyond their difficulties in performing social roles, patients also struggle with the more fundamental question of who they are; the brain injury appears to disrupt severely their previously acquired self-image and sense of self [28]. Thus, a primary task of psychotherapy is to help the patient consolidate a new sense of self that successfully incorporates a realistic appraisal of strengths and weaknesses" [27].

In presentations where this alteration of sense of self is a significant element of the clinical presentation and the patient has sufficient ego development to tolerate an insight directed therapy, a psychodynamically informed therapy is indicated.

On reviewing psychotherapies appropriate for TBI patients, Folzer [29] made the following observation, "If 'immature' defenses and coping patterns are removed too early, the therapist may precipitate a catastrophe. Instead of directly confronting the patient, the therapist can introduce the focus on reality gradually." This would argue for a supportive therapy [30] instead of insight-oriented therapy. There is not, however, a strict division between these forms of therapy. As Werman [30] observed, "Although in the following pages these two forms of treatment (supportive therapy and insight-oriented therapy) are compared as if they were not only different from each other but virtually dichotomous in their aims and techniques, in reality they rarely exist in pure forms. Typically, over a period of time, most patients in supportive psychotherapy gain some insight into their behavior; similarly it is difficult to conceive of a course of insight-oriented psychotherapy in which some supportive measures are not utilized."

Psychotherapy following traumatic brain injury should not necessarily be limited to individual therapy. Several authors have emphasized the value of group therapy with TBI patients [29,31,32], and family involvement in therapy can be particularly important [12,23].

The discussion of psychotherapy with TBI patients and indeed psychotherapy in general has been conducted largely in the absence of quantitative data concerning the therapy itself. While standardized instruments for assessing baseline symptoms and treatment outcomes are increasingly being used in clinical research [33], these instruments do not quantify the fine structure of the therapeutic interaction. This contribution continues the development of quantitative methods for the characterization of patient-therapist communication with the long term objective of improving the effectiveness of psychotherapy following traumatic brain injury. Communication between patients and therapist during psychotherapy has many components including posture, eye contact, verbal tone, verbal production (the number of words exchanged irrespective of their meaning) and the manifest content of the communication. All of these interactions can be examined quantitatively [34,35]. For example non-verbal communication in the therapist-patient interaction has been analyzed by Yaynal-Reymond, et al. [36] and by Merten and Schwab [37] using a form of quantification developed by Magnusson [38,39]. While all components of patient-therapist communication are important, this paper focuses on content analysis. Using methods of symbolic dynamics this investigation extends previous analyses of the frequency of content by quantifying the temporally dependent, sequence-sensitive structure of the dialog. As long-term goals, the questions addressed in this research program follow those enumerated in Rapp, et al. [40].

1. Are there nonrandom patterns in the sequential structure of patient-therapist communication?

2. Do these patterns, should they exist, change during the course of therapy?

3. Do changes in the patterns of patient-therapist communication correlate with the clinically perceived success or failure of the therapy?

4. Can this type of analysis identify more effective forms of therapist intervention?

This case study is limited to an examination of the first three questions in three therapy sessions recorded from one patient. Generalized conclusions cannot therefore be made. The limited results do, however, indicate that there is a nonrandom structure in patient-therapist communication in these protocols. Additionally, quantifiable structures changed during the course of therapy in a manner that correlated with the clinically perceived success of the therapy.

A first approach to quantitative content analysis is the determination of word frequency. An early effort was Electronic Verbal Analysis [41] measuring the frequency of anxiety related words. In a subsequent study, Pennebaker, et al. [42,43] recorded the frequency of 2800 words that were placed into seven categories, and Hart [44] analyzed political texts with a library of 10,000 words in five classes with approximately seven categories in each class. The limitations of these analyses are clear. Word frequency is insensitive to context. A randomly shuffled text will produced the same word counts. As Fast and Funder [45] observe, for example, the phrase "I am not happy" may be scored as positive emotional content.

Several investigators have developed methods that move beyond word frequency to examine meaning. A pioneer in this effort was Hartvig Dahl whose investigation of the case of Mrs. C analyzed 1,114 psychoanalytic sessions with the same patient [46-48]. In the 1974 study [48], entries in a three thousand word dictionary were assigned to one denotative category and to one or more connotative categories. A factor analysis was used to identify groups of related words, and it was shown that these groups were related to themes present in the transcript. In 1978 Dahl, et al. [49] published an application of linguistic analysis in psychotherapy that is intermediate to analysis of word count and the analysis of sequential structure based on symbolic dynamics presented in the next section. In this study, the analysis was limited to an examination of the therapist's interventions. This provides an instructive and valuable alternative to the practice of considering only the patient's speech. Each intervention by the therapist was classified by type and rated on scales designed to assess countertransference manifestations, including hostility, seductiveness, approval, disapproval and assertion of authority. A qualitative linguistic analysis based on Chomsky's model of transformational grammar [50,51] was also implemented. Dahl and his colleagues hypothesized that "a speaker has available a variety of syntactic options, and the particular syntactic structure which he chooses reflects, among other things, the inventory of wishes that he is motivated both to conceal and to express." The analysis of examples presented in this paper shows occasions of extraposition, pseudocleft construction, syntactic ambiguity and lexical ambiguity consistent with this hypothesis.

In the Gottschalk-Gleser analysis procedure [52,53], the grammatical clause is the unit of analysis. Content is scored on seven scales. In addition to the study of psychotherapy, Gottschalk-Gleser constant analysis has been applied in medical psychology [54-58]. GB Software markets a software product, PCAD2000, that applies a Gottschalk-Gleser content analysis to machine readable text. In addition to deriving scores on seven scales, the program offers a neuropsychiatric classification based on the DSM-IV.

Langs and colleagues [40,59] analyzed each element of therapy transcripts on fourteen dimensions. The result is a content matrix of fourteen columns. The analysis included calculations of the frequency of each entry, Shannon information of each column and the context free grammar complexity (Jiménez-Montaño, [60] described in the next section of this paper and in Appendix One). In the 1991 study [40], two one-hour protocols obtained from the same patient with different therapist were analyzed by this procedure. One therapist was a classically trained psychoanalyst. The other therapist used a communicative approach developed by Langs [61]. The most notable differences between the two protocols were the frequency of scores for the variable characterizing the sphere of reference (1 = therapy related, 2 = situations outside of therapy, 3 = reference to therapy and situations outside of therapy, 4 = unclear). In the case of the analyst, 90% of the material referred to situations outside of therapy and less than 1% referred to therapy related issues. In the case of the communicative therapist, 20% of the material focused on the therapeutic situation. Given the focus on the patient-therapist relationship in communicative psychotherapy, this observation is consistent with therapist expectations.

Stiles Verbal Mode Analysis [62-64] could be described as a statement classification method. The unit analyzed is an "utterance" (defined presently). Each unit is coded in to one of eight classes by a sequence of three forced-choice questions. Eight verbal response modes result. The analysis continues with a calculation of the frequency of each class. Verbal Mode Analysis is considered at greater length in the Discussion section of this paper.

Investigators have also examined the narrative speech of clinical populations using symbolic dynamics. In contrast with the research described above, these studies do not examine patient therapist communication. Rather they examine the sequence-sensitive structure of continuous narratives elicited by the question, "Can you tell me the story of your life?" [65,66] or a narrative produced by a participant in response to a request to recall the content of a story that they have just read [67].

The Leroy, et al. [67] study investigated the sequence-sensitive structure of a recall narrative presented by schizophrenic patients. Following Kintsch and Van Dijk [68,69], the participant's narrative was treated as a sequence of propositions. The Kintsch and Van Dijk definition of a proposition is the minimal semantic unit that can be either true or false. Propositions were classified as macro-propositions that specify the topic of discourse or micro-propositions that provide details. Macro-propositions were assigned the symbol "M," and micro-propositions were assigned the symbol "m." the narrative sample was thus recast as an ordered sequence of M's and m's. Entropy, Lempel-Ziv complexity and the first order transition matrix were calculated. Comparisons with surrogate data established the presence of a sequence-sensitive non-random structure in the data. The global complexity of recall did not differ for control and schizophrenic participants. There was, however, a difference in the transition structure. There were more micro-propositions to micro-proposition transitions in schizophrenic narratives.

In Doba, et al. [65] autobiographical speech of anorexics was parsed into 5 second epochs. Each epoch was assigned one of four symbols corresponding to negative emotion, positive emotion, neutral emotion and silence. In addition to distribution-determined measures, the Lempel-Ziv complexity and the first order transition matrix were examined. Complexity calculations with surrogate data established the presence of a non-random sequential structure in the narratives. In anorexics, dynamical measures identified recurrent cycles between expressions of negative emotion and silence that were less prominent in the control population. In a subsequent study [66], the same transcripts were analyzed with a different scoring system. Five symbols were used (family relations, social relations, love relations, self-reference and silence). Calculation of mutual information with the original symbol sequences and surrogate data sets again established the presence of a non-random dynamical structure in the narrative. The examination of the summed probability currents, a measure derived from the first order transition matrix, demonstrated that the narratives of anorexics are closer to statistical equilibrium than the narratives of controls.

In this study, we describe the analysis of three therapy sessions (each separated by four months) conducted with the same patient (female, 32 years of age) by the same therapist (female). The patient had experienced several traumatic brain injures in a sequence of motor vehicle accidents two years prior to the initiation of therapy. The patient was referred by her psychiatrist for targeted psychotherapy treatment of pre-existing, non-suicidal self-injury and severe emotional dysregulation. Neurological examination established the absence of residual neurological deficits prior to the initiation of therapy. The accident history was, however, deemed to be psychologically significant and had a continuing negative impact on the patient's relationship with her partner. The patient received weekly individual outpatient therapy and group delivered training in behavioral skills. The analyzed sessions were from the individual therapy component. Each session was sixty minutes long. At the time of initiation of treatment the patient met DSM-IV diagnostic criteria for borderline personality disorder. This diagnosis was confirmed with a SCID-II (Structured Clinical Interview for Diagnosis) assessment. The patient was in dialectical behavior therapy following the methods developed by Linehan [70,71]. Treatment was ongoing between the sessions coded. Institutional Review Board and the participant's informed consent were obtained prior to initiation of the study. Therapy sessions were videotaped for subsequent analysis.

An assessment based on the DSM-IV was repeated at the end of treatment at which time the patient no longer met clinical criteria for a diagnosis of borderline personality disorder. Self report ratings of misery, depressed mood and anxiety were improved. Indices that brought the patient to treatment, frequent suicidal ideation and repeated self-injury, were no longer present and were not present at post-treatment follow-up six months after the termination of therapy.

There are several possible procedures for parsing a therapy protocol prior to restatement as a symbol sequence. One possibility is to set a fixed time interval and code the content of that interval. This was the procedure followed by Doba, et al. [65,66] who used 5 second intervals in their analysis of autobiographical speech. While having the advantage of explicit specification, this procedure has the disadvantage of being nonresponsive to the varying pace of natural dialog. We implemented here the more common practice, following Stiles [62-64,72] of parsing the protocol into natural speech elements. These elements are called utterances in the technical literature. As defined by Stiles, et al. [72] "The coding unit for both forms and intent is the utterance, defined as an independent clause, nonrestrictive dependent clause, multiple predicate, or term of acknowledgment, evaluation or address." A detailed presentation of the definition of an utterance which includes examples is given in Chapter 8 of Stiles' book "Describing Talk" [62].

Each unit of the protocol was assigned one or more symbols using the scoring system shown in Table Table1.1. The protocol was thus reduced to a sequence of symbols drawn form a twenty-two symbol alphabet (Therapist: A, B, C, ... K, Patient: a, b, c, ...k) as shown in Table Table1.1. This symbol set was chosen to emphasize elements that are prominent in a psychotherapy of borderline personality disorder based on dialectical behavior therapy [70,71]. Patient and therapist content was scored for all three sessions. In this preliminary case study parsing into utterances and symbol assignment was accomplished by the collective decision of three investigators. It is recognized that a more systematic investigation will require independent assessment and a quantitative test of inter-rater reliability. The following gives an example of each content type.

Acknowledging: "Thank you for reminding me of that."

Information (requesting/providing): "I've had that car for two years."

Request for Validation: "Was I wrong to think that way?"

Validating: "Everyone feels that way from time to time."

Emotional Discharge "Never! Never! Never!"

Complaint: "My children never listen to me."

Transitional/Elicitation: "I wanted to remember to tell you about last Saturday."

Problem Presentation: "My husband lost his job."

Behavioral Analysis/Educational: "Do you think he would respond differently if you telephoned first?"

Reflective: "You seem to be saying that you wouldn't like that."

Irreverent "Well he certainly failed that time!"

Table Table2.2. shows the distribution frequency of each symbol in the alphabet for all three sessions. The distribution computed using all sessions is unremarkable. The therapist's contributions consist primarily of acknowledgments, elicitations and problem presentations. The high frequency of patient complaints and emotional discharges is consistent with a diagnosis of borderline personality disorder.

The symbol frequency distribution was also calculated for each session with a view to determining if longitudinal changes in symbol frequencies could offer insights into the patient-therapist interaction. We define a consistent change as one in which the frequency of appearance of a symbol either increases or decreases over all three sessions. In the case of the patient, only one variable showed a consistent pattern; the frequency of patient acknowledgments decreased. The decrease from Session 1 to Session 2 was, however, minimal. Otherwise, the only consistent patterns were seen in therapist behavior. The frequency of educational interventions decreased, and the frequency of reflective interventions increased. The frequency of validating interventions from the therapist decreased over the three sessions. This possibly reflects the growing confidence that both participants had in the therapeutic relationship.

Aside from describing predictable changes in therapist behavior, the analysis of symbol frequencies was largely uninformative. This is significant to the present investigation because it suggests the need for measures that quantify sequential behavior.

The most elementary form of sequential analysis is the analysis of repeated pairs. The results from this analysis after combining all three therapy sessions are shown in Table Table3.3. The expectation frequency of a repeated pair is p = .0021. Nine repeated pairs appear with a frequency that is at least one order of magnitude greater than the expectation frequency. Most of the repeated pairs are associated with what might be described as the mechanics of therapy: requesting, presenting and acknowledging information. As in the case of single symbol frequencies, patient complaints and emotional discharges appear frequently as elements in repeated pairs.

When repeated triples are examined a marked pattern of change in content is seen over the three sessions. In a message of length L_{M }there are L_{M}-2 triples. Nonetheless there, are very few repeated triples in the clinical data. During Visit One nine triples appear more than 1% of the time. During Visit Two only two triples appear in more than 1% of the sample, and in Visit Three, four triples appear at a frequency exceeding 1% (Table (Table44).

There is a change in the content of repeated triples over the three sessions. In the first session the most frequently observed triple is a request for validation by the patient followed by an emotional discharge followed by a complaint. These three coding elements appear prominently in the other repeated triples observed during the first session. By the second session, which occurred four months after the first session, behavioral analysis by the therapist and acknowledgment of these communications by the patient are the most frequently observed triples. This pattern is consistent with clinical expectations. In the early sessions, the patient-therapist relationship is constructed by the therapist's nonjudgmental acceptance of the patient's complaints, emotional discharges and need for validation. This is particularly true in the course of borderline personality disorder. The work of therapy, implemented by behavioral analysis and education, begins after the construction of the therapeutic alliance.

While several methods can be used to characterize a symbol sequence, we consider first measures of complexity. Quantitative measures of complexity can be most readily introduced by considering an explicit example. Consider two messages, that is two symbol sequences, M_{1 }and M_{2}.

It should be noted that both messages have the same symbol frequency, eight appearances of each symbol. They are indistinguishable with distribution-determined measures, for example Shannon information, but M_{2 }is more complex than M_{1 }in our conventional understanding of the term. There are several methods for quantifying the complexity of symbol sequences. A taxonomy of complexity measures has been published [73]. In the first instance, we consider the context free grammar complexity introduced by Jiménez-Montaño [60] (a description is given in Appendix One). Consistent with our qualitative expectations, it is found that that grammar complexity of M_{1 }is 20 bits and the complexity of M_{2 }is 27 bits.

The complexity of an observed symbol sequence is often expressed in bits/unit time by dividing the complexity of the message by the period of observation [74]. The results from the three therapy sessions are shown in Figure Figure1.1. Complexity generation is seen to increase across the three sessions. (The procedure used to estimate the uncertainties of these complexity values is outlined in Appendix One).

This result is consistent with the increase in the number of symbols generated in the three sessions (N_{DATA }= 317, 549, 713 respectively). While any observation based on a single case history must be stated circumspectly, the increase in the frequency of subject transition which is reflected in the increase in N_{DATA }over the three sessions is consistent with qualitative clinical observations with borderline patients. As patients progress in therapy one can, in some instances, observe a decreased perseveration in topic and a greater flexibility of discourse. This result is consistent with the quantitative results of McDaniel, et al. [75] who found correlations between rate of improvement and an estimate of the number of patient utterances. The result seen here is also consistent with the Winefield, et al. [76] quantitative characterization of a psychodynamically oriented psychotherapy which showed decreasing asymmetry in patient/therapist verbal behavior during the course of treatment. This decrease in asymmetry was evidenced by increased therapist speech activity. Increased participation by the therapist would result in an increase in patient-to-therapist transitions in the symbol transcript, an increase in N_{DATA}, and an increase in complexity generation.

It is also a matter of interest to determine the stability of complexity within a session. This was done by determining complexity generation for each quarter session. A visual inspection of Figure Figure22 suggests that there is a somewhat greater within-session variation in the third session. This is consistent with our understanding of an increase in complexity generation during the course of a successful therapy.

It is important to make a distinction between the complexity of a message and the intrinsic dynamical complexity of the system that generated the message. The intrinsic complexity of the generator can be estimated by comparing the complexity of the message against the complexity of random messages of equal length generated with the same symbol set. The result is the normalized complexity. Mathematical procedures for constructing this normalization are outlined in Appendix One. The normalized complexity is dimensionless and varies between a value close to zero for a constant symbol sequence (one symbol repeated throughout the entire message) and a value of one for a random sequence. Examples giving intermediate values of normalized complexity are shown in the appendix. The normalized grammar complexity of the three therapy sessions is .765 ± .033, .758 ± .015 and .763 ± .017. There is no significant change in the normalized grammar complexity which suggests that, at least in this therapy, grammar complexity did not detect changes in the underlying dynamical process. The contrast between the consistency of normalized complexity and the increase in complexity per unit time is considered in the Discussion section of this paper.

An examination of the normalized complexity for each quarter of a session allows an examination of the stationarity of the underlying dynamical process (Figure (Figure3).3). The results are displayed on [0,1], the defined range of normalized complexity. There are no significant within-session or between-session differences when quarter sessions are analyzed.

A comparison of the complexity values obtained with the original therapy symbol sequence and complexity values obtained from random messages of the same length makes it possible to address the following null hypothesis:

As assessed by this complexity measure, the sequential structure of the original message is indistinguishable from the sequential structure of an equi-probable, random sequence of the same length constructed from the same symbol alphabet.

Several statistical tests of the null hypothesis have been considered (Appendix One). We use here the Monte Carlo probability of the null hypothesis.

N_{SURR }is the number of comparison random messages (called surrogates) computed. The number of complexity values tested in the numerator includes the complexity of the original symbol sequence as well as the complexity values obtained with surrogates, ensuring that the numerator has a value of at least one. In the calculations in Figures Figures22 and and3,3, N_{SURR }= 499 and C_{Surrogate }> C_{ORIG }in all cases. The null hypothesis is rejected with P_{NULL }= .002; that is, the sequential structure of patient-therapist communication in these sessions as scored by this procedure and assessed by this metric is nonrandom.

The results obtained with grammar complexity were confirmed by calculations of Lempel-Ziv complexity ([77] described in Appendix Two). Lempel-Ziv complexity and grammar complexity are in the same taxonomic group of complexity measures (randomness finding, nonprobabilistic, model based). The values obtained with Lempel-Ziv complexity are not the same as those obtained with the grammar complexity, but the two measures show the same sensitivity to randomness in a symbol sequence. The Lempel-Ziv results analogous to those obtained with grammar complexity are shown in Figure Figure4.4. As in the case of grammar complexity there is an increase in complexity generation over the three sessions.

The within-session variability of Lempel-Ziv complexity (Figure (Figure5)5) shows the same pattern that was observed with grammar complexity. The within-session variability is greater in Session Three.

Lempel-Ziv complexity can also be normalized by comparisons with random surrogate symbol strings provided that the complexity of the surrogate is also determined with the Lempel-Ziv algorithm. The normalized Lempel-Ziv complexity for the three sessions is .765 ± .033, .758 ± .015 and .763 ± .017 respectively. In common with grammar complexity, no change in the generating dynamical process was detected with Lempel-Ziv complexity. These results should not be generalized inappropriately. It remains possible that significant change might be detected if a different measure was applied to the same data. It can only be said that normalized grammar complexity and normalized Lempel-Ziv complexity failed to detect any between-session changes while changes were seen in complexity generation rates with both measures. As previously noted, the between session consistency of normalized complexity and the increase in complexity per unit time is considered in the Discussion section. The within-session normalized complexity was also computed with the Lempel-Ziv algorithm (Figure (Figure6).6). As in the case of grammar complexity, no significant within-session changes were seen in the normalized complexity.

As before, the surrogate null hypothesis of random structure was rejected by Lempel-Ziv complexity with P_{NULL }= .002 (N_{SURR }= 499) in all cases. It can again be concluded that patient-therapist communication has nonrandom structure.

Consider two simultaneously observed symbol sets Message A = (A_{1}, A_{2}, .....A_{N}) and Message B = (B_{1}, B_{2}, .....B_{N}) constructed from the same alphabet of N_{α }elements. P_{A}(I) is the probability of the appearance of Symbol I in Message A P_{B}(J) is the probability of the appearance of Symbol J in Message B. P_{AB}(I,J) is the probability that Symbol I appears in Message A and Symbol J appears in Message B at the same time. The average mutual information of Messages A and B is the average number of bits of Message B that can be predicted by measuring Message A. It is denoted by I(A,B). It can be shown [78] that

Mutual information is symmetrical I(A,B) = I(B,A). Also, if two processes are statistically independent then P_{AB}(I,J) = P_{A}(I)P_{B}(J), and I(A,B) = 0. The special case where Message A and Message B are the same, I(A,A), is called self-information.

In this application, we examine the ability of a message to predict its own future. We define I(A_{I},A_{I + 1}) as the mutual information observed when Message A = (A_{1},A_{2},.....A_{N-1}) and Message B = (A_{2},A_{3},.....A_{N}). This can be generalized to consider larger temporal displacements. I(A_{I},A_{I + K}) is calculated by setting Message A = (A_{1},A_{2},.....A_{N-K}) and Message B = (A_{K},A_{K + 1},.....A_{N}). The time shifted self-information is a nonlinear measure of temporal decorrelation. Explanatory examples are given in Cellucci, et al [79]. If a message has strong temporal predictability then I(A_{I},A_{I + K}) remains high as K is increased. If the process generating a message is dynamically disordered, then I(A_{I},A_{I + K}) decreases rapidly as K increases.

Mutual information for the case K = 1 has been applied to the examination of the sequence-sensitive structure of narrative components in the autobiographical speech of anorexic adolescents and controls [66]. These investigators found that I(A_{I},A_{I + 1}) is significantly lower in patients. They also compared I(A_{I},A_{I + 1}) values obtained with their data against the values obtained with random shuffle surrogates and found that surrogates decorrelate faster than the original symbol sequence indicating the presence of non-random structure in the original symbol sequence.

Figure Figure77 shows mutual information I(A_{I},A_{I + K}) as a function of the temporal shift parameter K for the three therapy sessions. The mutual information measured in the first session decorrelates more slowly than mutual information obtained with Session Two and Three indicating a higher degree of predictability in Session One. This is consistent with the previous observation of a lower complexity generation rate in Session One. The separation of mutual information functions between the first and second session and the first and third session is significant (P < 10^{-7}). This significance is computed by comparing twenty five values of mutual information (shift parameter K = 0 to 24) in a paired t-test. The mutual information values obtained in Sessions Two and Three are indistinguishable. This indicates that the process detected by longitudinal measurement of mutual information has stabilized by Session Two or that this measure is insufficiently sensitive to detect a continuing process altering patient-therapist communication.

The mutual information results obtained with higher values of the shift parameter K must be viewed with caution. A calculation of the mutual information of two symbol sequences tests their statistical independence. If the variables are independent, then P_{AB}(i,j) = P_{A}(i)P_{B}(j) and I(A,B) = 0. It is possible to compute the probability of the null hypothesis of statistical independence. Let E_{AB}(i,j) be the expected number of (i,j) symbol pairs given the assumption of statistical independence.

Let O_{AB}(i,j) be the observed number of (i,j) symbol pairs. The corresponding value of χ^{2 }is

Where N_{α }is the number of symbols in the alphabet. The number of degrees of freedom is ν = (N_{α }- 1)^{2}. The probability of the null hypothesis is

where Q is the incomplete gamma function.

When this analysis is applied to the symbol sequences generated by the three therapy sessions, the null hypothesis is rejected by construction for K = 0 but also for K = 1 for the three sessions. This result indicates the absence of predictive structures beyond the first symbol iteration, which is consistent with the results obtained with first order Markov surrogates in a later section of this paper.

The quantification of structure in symbol sequences with information theory begins with Shannon and the foundation of the subject [80]. Shannon subsequently developed procedures for investigating prediction and entropy in printed English ([81], extended by Burton and Lickliter [82], and by Cover and King [83]). Kolmogorov [84] considered the entropy of Russian texts in his seminal "Three approaches to the quantitative definition of information.". In this contribution we follow the development and notation of Ebeling and his colleagues [85,86]. Let be the probability of the appearance of the i-th symbol in the alphabet in the symbol sequence being analyzed. We generalize this to consider the probability of each substring of length n, . We will use the term n-word to denote a substring of length n. The entropy of substrings of length n, denoted by H_{n}, is given by

where N_{max }is the number of possible n-words. N_{max }will be a function of the size of the alphabet N_{α}. In the absence of a priori rules restricting allowable n-words N_{max }= (N_{α})^{n}. The sum takes place over all substrings where . H_{n }quantifies the average amount of information contained in a substring of length n, and therefore is monotone increasing in n. The related conditional entropies, h_{n}, are given by

h_{n }is the average amount of information needed to predict the next symbol in a substring if the first n symbols are known, giving h_{n }≥ h_{n + 1}.

The values of H_{n }and h_{n }as a function of order n for the three therapy sessions are shown in Figure Figure8.8. At each order, the values of H_{n }obtained in the third session are greater than the values obtained in the second session which are greater than the values obtained in the first session. This result is consistent with the previously presented rate of complexity generation (Session 3 > Session 2 > Session 1) and with the observation that mutual information, which is related to entropy, decorrelates faster in the later sessions. The between-session separation of conditional entropy is less marked, but the conditional entropy of Session 3 is greater than that of Session 1 at all orders of n.

As in the case of mutual information, the results of these entropy calculations must be viewed with care. A simple analysis indicates that length effects will cause a significant deterioration in an estimate of H_{n }as n increases, if one uses the equation for H_{n }given above. A message of N symbols contains N-(n-1) n-words. As previously noted the number of possible n-words in the absence of restrictive rules is (N_{α})^{n}. Thus the number of possible n-words increases exponentially with order n, while the number of words actually present is limited by N. Let be the expectation value of the number of appearances of the i-th n-word for the case of an equiprobable distribution.

The calculation of H_{n }using the previous equation is warranted in the case of good statistics which is obtained when is on the order of ten [87]. In the present analysis N_{α }= 22, and the smallest value of N is obtained in Session 1 where N = 317. The criterion is satisfied for n = 1 where H_{n }for Session 1 < Session 2 < Session 3, but fails for n ≥ 2.

A further analysis shows that H_{n }quickly approaches its limiting N-determined value as n increases. For a symbol sequence generated by the logistic equation near the Feigenbaum point, H_{n }≈ log_{2 }N, for large n where N is the length of the symbol sequence [88,89]. The same relationship is obtained with the computationally generated rabbit sequence [90]. These are highly disordered symbol sequences generated by deterministic processes. This argument can be generalized [87]. Recall that the number of possible words increases exponentially with n and is limited by N. To an approximation of the limiting case for large n, any given word is either absent or appears only once. In this case, there are N - (n - 1) ≈ N words with probability , and all others have . A series expansion can be used to show that . Therefore the limiting case of H_{n }for large n is

In the case of the three therapy sessions, N = 317, 549 and 713 giving value of log_{2 }N of 8.308, 9.101 and 9.478. The corresponding values of H_{5 }are 8.225, 9.057 and 9.421. This suggests that the between-session differences in entropy as computed here simply reflects the increase in N over the three sessions.

Recognition of these issues has motivated the search for improved procedures for estimating H_{n }when n is large and N is small. Several investigators have addressed this problem [88,91-97]. We have implemented on of these procedures [88] and applied it to the therapy data. As expected by the failure to satisfy the criterion, no between-session separation was observed for higher values of n. These results are consistent with the conclusions of Lesne, et al. [97] who recommended using Lempel-Ziv complexity as the more reliable measure of structure when short symbol sequences are analyzed.

Let P_{IJ }be the probability that Symbol I is followed by Symbol J. These probabilities are summarized in the first order transition matrix [P_{IJ}]. A first order Markov surrogate is a symbol sequence constructed by a constrained randomization that has the same length and same [P_{IJ}] as the original symbol sequence. A comparison of complexity values obtained with Markov surrogates and the complexity of the original symbol sequence can be used to address the following null hypothesis:

As assessed by this measure, the sequential structure of the original message is indistinguishable from the sequential structure of a random process that has the same length and first order transition matrix as the original message.

Calculations with Markov surrogates follow the same pattern as calculations with equi-probable surrogates. C_{ORIG }is determined, surrogates are constructed (in this case first order Markov surrogates), and values of C_{Surrogate }are calculated. The probability of the null hypothesis is calculated using the previous formula and these values of C_{ORIG }and C_{Surrogate}. With these data and these complexity measures, there is a failure to reject the null hypothesis for all three sessions. The average value of P_{NULL}obtained with the context free grammar complexity and 499 equi-probable surrogates was .935 and the average value obtained with Lempel-Ziv complexity was .617. This means that with these data and these measures of complexity, a therapy session's symbol sequence is indistinguishable from a random process with the same first order transition matrix. This does not mean that a higher order structure is not present in the sequence. Rather, the results show that these measures failed to find evidence for that structure. Theoretically, the null hypothesis could be rejected with these data and a different measure.

This is a case study, and therefore any results must be regarded as inconclusive until confirmed by a more systematic investigation. In this therapy the rate of complexity generation increased across the three sessions investigated. This increase in variability is consistent with the statistically significant faster decorrelation time observed in the K = 1 mutual information calculation and in the increase in n-th order entropy and conditional entropy for n = 1. It is also consistent with the clinically observed changes in the flexibility of patient communication during the course of treatment. Additionally, using two measures of complexity we have demonstrated that the sequential structure of patient-therapist dialog in these sessions has a nonrandom structure (P_{NULL }= .002). These results are consistent with results of previous investigations summarized by Leroy, et al. [57]:

"(1) temporal organization is a significant feature of speech,

(2) counting (by which they mean the sequence-independent, distribution-determined frequencies of content elements) is not sufficient for an adequate characterization of language, and

(3) symbolic dynamical methods are needed for the sake of completeness"

As previously noted, the contrast between the consistency of normalized complexity (both Lempel-Ziv and context free grammar complexity) over the three sessions and the increase in complexity generation (complexity per unit time) requires examination. Possible insights into this question can be gained by examining the quantitative literature investigating hierarchical structures in language [98-101]. Based on this research we wish to suggest that the normalized complexity quantifies an invariant structure intrinsic to language when characterized by this form of symbolic restatement, while complexity per unit time quantifies pragmatic language use. Some measure of support for this hypothesis can be obtained by consideration of work by Montemurro and Zanette [102]. Montemurro and Zanette examined the sequential structure of word ordering in 7,097 texts drawn from eight languages (English, French, German, Finnish, Tagalog, Summarian, Old Egyptian and Chinese). They computed a measure of entropy based on Lempel-Ziv complexity and a normalized relative entropy based on comparisons with randomly shuffled sequences of equal length. They found that "while a direct estimation of the overall entropy of language yielded values that varied for the different families considered, the relative entropy quantifying word ordering presented an almost constant value for all these families. ... Therefore our evidence suggests that quantitative effects of word order correlations on the entropy of language emerges as a universal statistical feature." The Montemurro and Zanette study examined the sequential structure of word ordering. It is recognized that word ordering is not identical to the concept sequencing uncovered by the symbolic coding process used in our study, but the presence of near constant normalized complexity in the presence of a highly variable complexity offers support, albeit indirect support, for our hypothesis of a dissociation between pragmatic complexity (bits/minute) and intrinsic structure (normalized complexity). This is a case study of a single patient. Any further speculation must be deferred until additional data are available.

A systematic research effort will be required to address the other questions raised in the introduction to this paper. In addition to acquisition of longitudinal data obtained from a large, clinically homogeneous population, the introduction of additional measures of sequential structure can be considered. The inverted-U measures of complexity [103] are theoretically important but have received little application with observational data (as distinct from computationally generated symbol sequences). These measures of complexity give low values for both highly regular sequences and for random sequences but high values for chaotic sequences (where the word chaos is being used here in the technical sense). This is an interesting possibility since it has been suggested that patient-therapist communication can be chaotic [104-109]. More general reviews of dynamical metaphors in psychopathology and psychotherapy are given in [110-113].

An analysis of the computational results identified the limitations of the approach taken in this paper. The large number of symbols in the alphabet and the comparatively short message lengths severely limit the kinds of analyses that can be applied. An alternative approach can be implemented using Stiles' Verbal Mode Analysis. In this analysis, each utterance is scored by three forced choice questions called principles of classification (source of experience, frame of reference, and presumption). These three binary scores are used to specify one of eight mutually exclusive categories. The eight celled classification process is applied to each utterance twice. The first classification is determined by grammatical form. The second is based on pragmatic intent. Several analysis options are thus available. The sequential structure of the form (grammatical) coding and the intent (pragmatic) coding can be analyzed separately. In these cases, N_{α }= 8. At a finer scale, the three principles of classification each generate a binary sequence, N_{α }= 2 that can be examined. These scoring methodologies make it possible to perform mathematical analyses that are not feasible for large N_{α}. The analyses of ordered triples reported here does, however, indicate that the rich content introduced by a large N_{α }can reveal important insights into the evolving dynamic of patient-therapist communication. In the ideal case, protocols can be scored by more than one procedure and analyses performed with the widest possible collection of mathematical methods.

Psychotherapy, even when the treatment is concretized in treatment manuals is, by nature, transactional, flexible and often highly individualized. As such, the field of psychotherapy research standardly employs a 'technology model' [114] in conducting treatment development and evaluation research. Psychotherapy process researchers also employ a methodology for measuring complex, deterministic, and dynamic processes within the therapy experience. Core to both models is the application of highly specified behavioral coding systems to recoded samples of therapy sessions. A discussion of this literature is beyond the scope of the current article. Also, it should be noted that our experience suggests that the procedures presented here are not only generically applicable to the field of psychotherapy research but are also of value in training therapists. The discipline of examining each verbal exchange at this level of detail and the process of identifying recurring patterns of communication (the words change, but the symbol sequence recurs) helps trainees to identify maladaptive communication strategies and encourages them to view a therapy not as separated exchanges but as a larger scale dynamical process. Independently of the subsequent mathematical analysis, the process of sequential symbolic transcription is a valuable exercise. Additionally, these methods may be of particular value in the examination of therapies following traumatic brain injury. These therapies can, in some instances, be complicated by cognitive deficits that result in distortions of language. As noted by Granacher [115] a distinction is to be made in the language deficits following traumatic brain injury between deficits of speech (the mechanical articulation of language) and deficits in the use of language (generation and comprehension of syntactic and semantic structure) which can be investigated using the methods tested here. In the case of injuries, frank aphasias can result. Their identification does not require sophisticated mathematical analysis. These aphasias typically resolve spontaneously into mild residual anomia [116,117]. In other cases, however, subtle distortions of language can occur after traumatic brain injury. "The basic structural components of language may be intact but the ability to use language to engage socially is impaired." [117] Deficits in the effective use of language following traumatic brain injury have been reviewed by Coelho [118] and by Coelho and Youse [119]. In addition to complicating therapy, these deficits can have a significant negative impact on post-injury quality of life. These deficiencies in language are commonly described as deficits in pragmatic competence where, as used here, the word pragmatics is defined as the subfield of linguistics which investigates the way in which context contributes to meaning [120,121]. These deficits are not typically expressed as failures to comprehend single sentences but are observed as failures to understand sequence-dependent, multi-sentence discourse [122]. Sohlberg and Mateer [117] have provided the following summary:

"Pragmatics constitute a comprehensive set of skills required for competence in naturalistic, functional use of language. The term can be broadly defined as the use of language for communication in specific contexts [123]. Pragmatics behaviors transcend isolated word and grammatical structures; they make up the system of rules clarifying the use of language in terms of situational or social contexts. People with brain injury often demonstrate normal basic linguistic skills, but have difficult adapting their communication to specific contexts; for example they may exhibit tangential speech, poor verbal organization, or inadequate turn taking [124]."

Pragmatic deficits are not limited to traumatic brain injury but are also observed in autism [125,126], attention deficit hyperactivity disorder [127] and schizophrenia [128,129]. In contrast with these disorders, the presentation of deficits in pragmatic competence following traumatic brain injury is complicated by acute onset followed by a complicated post-injury time course that can result from progressive cognitive loss or improvement due to spontaneous resolution. Highly variable day to day changes in competence can also sometimes be observed.

As reviewed by Martin and McDonald [121], three theories presenting explanations for deficits in pragmatic competence following traumatic brain injury are now under consideration: Social Inference Theory, Weak Central Coherence and Executive Dysfunction. Social Inference Theory argues that pragmatic failures follow from failures of the patient's Theory of Mind. An individual's Theory of Mind is "the capacity to infer mental states of others ... a person's ability to form representations of other people's mental states and to use the representations to understand, predict and judge utterances and behaviors" [130]. Following initial work by Santoro and Spiers [131], a rapidly growing literature has documented Theory of Mind deficits following traumatic brain injury [132-136]. Weak Central Coherence results in an individual's focus on components and a failure to integrate components into larger scale coherent structures. In addition to being a possible cause of post-injury pragmatic deficits, weak central coherence may be present in autistic patients [137-139]. The Executive Function system controls and regulates other processes and is particularly important in responding to novel situations requiring planning and decision making. Executive functions are localized in the prefrontal cortex [140,141], and injury to the prefrontal cortex can cause executive dysfunction which in turn results in deficits in language. Significant correlations between executive function and pragmatic communication difficulties following traumatic brain injury have been reported [142].

While arguments can be made that deficits in any of these capabilities (Theory of Mind, Central Coherence, and Executive Function) can result in pragmatic language deficits, there is no present evidence indicating which of the three is predominant in pragmatic deficits following traumatic brain injury. Indeed, several investigators have results indicating that it is very difficult to ascribe observed deficits to any given cause [143-146]. Given the heterogeneity of the traumatic brain injury population, it seems probable that pragmatic failures will have different causes in different patients.

Irrespective of the cause, psychotherapists of traumatic brain injury patients must be sensitive to the possible impact of erratically varying language competence in patient-therapist communication. As outlined in Sohlberg and Mateer [117] none of the currently available procedures for assessing pragmatics following brain injury are completely satisfactory. The methods closest to the procedures developed here are conversational analysis studies of language following traumatic brain injury [147-151]. The analysis employed by Snow, et al. [147] was modified from Damico's Clinical Discourse Method [152,153]. Seventeen parameters were organized into four groups (Quantity, Quality, Relation, and Manner). A similar study published by Friedland and Miller [149] scored natural conversations in four areas (Repair, Silences, Minimal Turns, Topic). In a study of conversational structure, Coelho, et al. [151] found differences in the flow of conversation of traumatic brain injury patients when compared to healthy controls. They found that patients were more dependent on the investigator to maintain the interaction. Individuals with traumatic brain injury did not initiate and appeared to function primarily as responders. The sequential structure of discourse is not, however, quantified by these methods. It can be noted, however, that it may be possible to apply the sequence sensitive measures presented here to these previous analyses. For example, in the Coelho, et al. [151], study two categories of analysis were applied, Appropriateness and Topic Initiation. The Appropriateness of an utterance was assigned to one of four categories (Obliges, Comments, Adequate Responses, Adequate Plus Responses). The results were reported as between-group means and standard deviations. Significant differences were seen in two of the four categories. This analysis can be viewed as a restatement of the conversation as an eight-symbol alphabet (four Appropriateness categories crossed against Investigator or Patient). The sequential structure of this symbol sequence can be quantified.

How might deficits in pragmatic competence following traumatic brain injury be reflected in complexity and entropy measurements of patient-therapist communication? Deficits in pragmatics are reflected in sequential structures including poor organization, tangential speech and loss of coherence. As documented by Chapman [154,155] some patients will present a loss, possibly a subtle loss, of coherence in verbal production. This loss of coherent structure would be reflected in an increase in complexity and entropy, a more uniform symbol frequency distribution and a broader spectrum of repeated pairs. Conversely, perseverations of discourse and topic repetitiveness, which can also be observed following brain injury [156], would result in a decrease in complexity and entropy. Pragmatics deficits would therefore be expected to produce bimodally distributed values of sequence sensitive measures. Further research may show that a high degree of variability in complexity within sessions and between sessions is diagnostic of failures of pragmatic competence in traumatic brain injury patients.

The present results suggest that dynamical measures can be used longitudinally to follow the course of treatment. To a degree, it is possible to consider two distinct processes occurring during the course of psychotherapy following a brain injury: psychological change reflecting emotional development and cognitive change having an impact on language due to organic changes in the central nervous system (recovery or continuing deterioration). The longitudinal application of the measures developed here may provide a means of separating and observing these processes quantitatively. Psychological change may be reflected in changes in subject content while cognitive changes may result in changes of linguistic structures that can be captured by complexity measures.

We join with Morris and Bleiberg [157] in arguing that psychotherapy should be integrated with cognitive rehabilitation in the treatment of brain injury patients. We also agree with Judd and Wilson [158] in concluding that modifications of psychotherapy will often be required when working with these patients. The diversity of the traumatic brain injury population makes it impossible to construct a single, generic therapy for these patients. Any conclusions based on the quantitative analyses of protocols from a single patient are clearly provisional. It is suggested, however, that with further development and larger studies, the methods developed here for the quantitative analysis of dynamical structures in patient-therapist communication may become useful on a patient-by-patient basis to inform these clinical decisions.

The authors declare that they have no competing interests.

PER wrote the software to compute Lempel-Ziv complexity, software to confirm calculations of context free complexity, performed the complexity calculations and was the primary author of the manuscript. AMKG supervised the statistical analysis of the results. MAJM wrote the software for grammar complexity calculations and computed the repeated pairs analysis. CJC contributed calculations of mutual information, n-th order entropies and conditional entropies. KEK was the treating psychotherapist and led the process of restating the therapy protocols as symbol sequences. All authors have read and approved the final manuscript.

Classically complexity is defined as the amount of information required to specify the contents of a message [84,159,160]. An historical review is given in Li and Vitányi [[161] Section 1.6]. This definition can be operationalized by building an instruction set that can generate the message. The complexity of the message is defined to be the length of the instruction set. This operationalization is implemented in the context free grammar complexity [60,162]. A systematic procedure (outlined below) is used to construct an algorithm that can reconstruct the original message. The size of the algorithm (also defined below) is the complexity of the message. It is understood that this gives an upper bound to complexity. It is always possible that an alternative construction will give a smaller instruction set. This is true of all complexity measures in this category (randomness finding, nonprobabilistic, model based, [73]). Because the procedure used to construct the algorithm is systematic, complexity is valid as a comparative measure. This consideration also indicates why it is useful to have the results of a complexity analysis confirmed by the application of a second measure. "There is no single value of complexity. These calculations provide a systematic procedure for obtaining an empirical measure of dynamical behavior that can be compared across conditions." [163].

The procedure for determining the context free grammar complexity is best introduced by considering a specific example. Consider the previously introduced message M_{2}.

The procedure begins with a search for repeated pairs. In this message, the pair AD is the most repeated pair. It is replaced by the new symbol α = AD.

BC is the next most frequently repeated pair. It is replaced by symbol β = BC.

BB is repeated twice, but as will be seen replacing a pair of symbols with a new symbol does not result in a decrease in the size of the instruction set if the pair is only repeated twice. The search for repeated pairs therefore ends, and the search for repeated triples begins. The triple BBD is repeated twice. In the case of triples, replacing a repeated triple does decrease the size of the instruction set even if it is only repeated twice. BBD is replaced by γ

There are no other repeated triples. In the general case, the search for repeated triples is following by a sequential search for repeated n-tuples, n = 4, 5, 6.... until the search is exhausted. In the case of this message there are no higher order repeats. The compression has converged.

In the next step product terms are replaced by exponentials. Thus AA is replaced by A^{2}. CCC is replaced by C^{3 }and BB is replaced by B^{2}. The instruction set to reconstruct the original message is:

Complexity is determined by calculating the size of this instruction set. Under the definition used here [60] each symbol adds one to the complexity and exponents contribute logarithmically (base 2).

The total is 27.585. Again under this definition, the integer part of the final sum is reported in bits. The context free grammar complexity of M_{2 }is 27 bits.

Estimating the uncertainty in the complexity of a specific message is problematic when the message is considered in isolation and a large population of messages generated by the identical dynamical process is not available. In Rapp, et al. [164] the uncertainty in C_{ORIG }is approximated by finding the difference in complexity values obtained in the first half and the second half of the message and expressing this difference as a fraction of their average value. Let C_{A }be the complexity of the first half of the message. Let C_{B }be the complexity of the second half of the message. Under this approximation, the uncertainty in C_{ORIG }is given by

where we use the property C_{A }and C_{B }are positive.

This procedure can give an aberrant value of zero when C_{A }= C_{B}. An alternative procedure for estimating ΔC_{ORIG }can be constructed by calculating <C_{1/2}>, the mean value of complexity calculated from all possible substrings of length L_{M}/2, and σ_{1/2 }the standard deviation of that mean. Expressed as a fraction, uncertainty is σ_{1/2}/<C_{1/2}>, and ΔC_{ORIG }is given by

This procedure is, however, computationally insupportable for longer messages. Suppose L_{M }= 8000. This procedure for estimating <C_{1/2}> would require averaging 4000 values of complexity calculated from strings of length L_{M}/2 = 4000. We have adopted the procedure of calculating <C_{1/2}> from 100 strings of length L_{M}/2. They are selected randomly from the set of all possible L_{M}/2 substrings. In cases where L_{M }< 200, <C_{1/2}> is calculated from all possible substrings of length L_{M}/2.

A qualitative understanding of the complexity of a symbols sequence can be obtained by applying these measures to symbol sequences generated by standard systems that are commonly examined in dynamical systems theory. Five examples are considered here: a constant sequence (the same symbol is repeated), sequences generated by the Rössler and Lorenz systems (both three dimensional ordinary differential equations), the Hénon system (a two dimensional difference equation) and a random number generator. The technical specifications of the systems are given in Appendix Three. The Rössler, Lorenz, Hénon and random data are expressed as real variables. In order to apply a symbolic dynamics-based measure of complexity, it is necessary to project these data sets to a discrete symbol set. There are several possible procedures for doing this. Radhakrishnan, et al. [165] used K-means clustering. While conceptually attractive, the results of K-means clustering can be very sensitive to initial conditions. Bradley and Fayyad [166] addressed this sensitivity by constructing a K-means algorithm that produces a refined initial condition that improved performance. Insofar as we know, this method has not been applied to the problem of converting real data to symbolic data. An alternative approach has been published by Hirata, et al. [167] who approximate a generating partition from a time series using tessellations. This is a computationally demanding procedure and there are practical issues concerning the sensitivity of the partition on the initialization. Steuer, et al [86] recommend using the partition that maximizes entropy. In the present examples, the continuous variable time series is partitioned about the median. In this process, the median is computed from the original time series. A real variable is replaced by symbol '0' if it is less than the median and by symbol '1' if it is greater than or equal to the median. The choice of the median rather than the mean is critical to this process. False-positive indications of deterministic structure in random data can result if the mean is used [168]. The partitioning process is depicted in Figure Figure9.9. (It should be noted that in the present paper, the consideration of partitioning protocol only applies to the didactic examples presented in the appendices. The psychotherapy data are symbolic and partitioning is not required).

The grammar complexity values computed from one thousand element symbol sequences generated by these model systems are shown in Figure Figure10.10. The results are seen to be consistent with our qualitative understanding of complexity. The constant sequence gives the lowest value, and the random number generator produces the largest value. The ordering Rössler less than Lorenz, less than Hénon is also consistent with expectations based on a visual examination of the time series in the left column of Figure Figure99.

A critical distinction must be made between the complexity of a message, C_{ORIG }and the intrinsic complexity of the process that generated the message. The value of grammar complexity will depend on two factors, the complexity of the dynamical process generating the symbol sequence and the length of the symbol sequence. This is seen in the upper panel of Figure Figure1111 where grammar complexity is plotted as a function of the length of the data set. The ordering of complexity values seen with 1000 element sequences in Figure Figure22 is preserved (random > Hénon > Lorenz > Rössler > constant) and the values increase with the size of the data set. It is therefore necessary to find an effective normalization of complexity values that allows comparison of intrinsic complexities without the complication of data set size.

It might be supposed that dividing C_{ORIG }by the length of the message is an acceptable solution. It has been shown that this is not the case [169]. An effective normalization of C_{ORIG }can be achieved by comparing it against the values of complexity obtained from random equiprobable messages of the same length. Let N_{α }be the size of the symbol alphabet (the number of distinct symbols available for message construction, in these examples N_{α }= 2). N_{α }is not message length L_{M}. An equiprobable surrogate is one where each symbol appears with probability 1/N_{α}. Let <C_{S}> denote the average value of complexity obtained from random equiprobable surrogates of length L_{M }(the subscript s denotes a surrogate). The normalized complexity is defined by

C_{N }ranges from close to zero for messages containing a single repeated symbol to close to one for messages generated by random processes.

As outlined in Rapp [170], C_{N }cannot be formed by normalizing against random shuffle surrogates. Consider the case of a message that consists of a single repeated symbol selected from an alphabet of size N_{α }> 1. (Sequences in a message space of N_{α }= 1 consist of a single symbol and only differ by length. Trivially, their complexity is the number of bits required to encode length L_{M}.) An effective normalization should give a low value of C_{N }to a repeated symbol message. Suppose surrogates were formed by a random shuffle. Since the message contains only one symbol, they all have the same value of complexity. In this case, C_{ORIG }= <C_{S}> and hence C_{N }= 1, which is the complexity of a random message. If instead surrogates are equiprobable on N_{α}, N_{α }> 1, then <C_{S}> is greater than C_{ORIG }and C_{N }has a low value. A low value of complexity is expected for a constant sequence.

The uncertainty in C_{N}, ΔC_{N}, can be estimated by the following argument

The estimation of ΔC_{ORIG }has been discussed. <C_{S}> is the mean complexity computed from a distribution of equiprobable surrogates. Δ<C_{S}> is the standard deviation of that distribution.

Comparison of C_{ORIG }and the complexity values obtained with surrogates makes it possible to address the following surrogate null hypothesis:

As assessed by this complexity measure, the sequential structure of the original message is indistinguishable from the sequential structure of an equi-probable, random sequence of the same length constructed from the same symbol alphabet.

Several statistical tests of the null hypothesis have been considered [168]. We use here the Monte Carlo probability of the null hypothesis.

N_{SURR }is the number of surrogates computed. The number of complexity values tested in the numerator includes the complexity of the original symbol sequence as well as the complexity values obtained with surrogates, ensuring that the numerator has a value of at least one. This statistical test was chosen because it is a distribution-agnostic test, that is, it makes no assumptions about the structure of the C_{Surrogate }distribution. Surrogates have a random structure, and the grammar complexity gives the highest value to random sequences. We therefore expect the values of C_{Surrogate }to be greater than the value of C_{ORIG }if a nonrandom structure is present in the original sequence. The smallest value of P_{NULL }will be obtained when all values of C_{Surrogate }are greater than C_{ORIG}. That minimum value is therefore 1/(1 + N_{SURR}). In the calculations in Figures Figures1010 and and11,11, N_{SURR }= 499 and C_{Surrogate }> C_{ORIG }in all cases for the constant sequence, Rössler, Lorenz and Hénon data. The null hypothesis is therefore rejected with P_{NULL }= .002. As expected, the null hypothesis is not rejected by symbol sequences produced by a random number generator. For the ten cases in Figure Figure1111 corresponding to L_{M }= 1000, 2000, ... 10,000, the average value of P_{NULL }obtained with random data is P_{NULL }= .562

Barnard [171] and Hope [172] have proposed a nonparametric test for rejecting the null hypothesis. Under their criterion the null hypothesis is rejected if C_{ORIG }< C_{Surrogate }for all of the surrogates. If this criterion is met, as it is in these calculations, the probability of the null hypothesis is again P_{NULL }= 1/(1 + N_{SURR}).

As outlined in Watanabe, et al. [163] reported values of complexity obtained with real variable data requires the specification of:

1. the complexity measure used,

2. the number of symbols in the alphabet,

3. the procedure used to partition values onto the symbol set,

4. the procedure used to generate the surrogates used to calculate C_{N},

5. the number of surrogates used, and

6. the statistical procedure used to calculate the probability of the surrogate null hypothesis.

As before let message M be a finite symbol sequence of length L_{M}. The vocabulary of a symbol sequence, denoted by v{M}, is the set of distinct subsequences that can be found in the message. By definition, a message is an element of its own vocabulary. If, for example, M = 00101, then:

A message can be expressed as a concatenation of substrings. Thus M = 000110100 is equivalent to M = X_{1}X_{2}X_{3}X_{4}, where X_{1 }= 0, X_{2 }= 001, X_{3 }= 10, and X_{4 }= 100. An additional element of notation is required. For any message M, the message MM_{π }is the identical message following deletion of the last symbol. M_{π }therefore has length L_{M}-1. This deletion operation can be combined with concatenation. If X_{1 }= 001 and X_{2 }= 011, then (X_{1}X_{2})_{π }= 00101.

For any symbol sequence of length L_{M }≥ 3, more than one decomposition into substrings is possible. The Lempel-Ziv algorithm [77] prescribes a procedure for decomposing a message into a concatenation of substrings. Only one decomposition is consistent with the algorithm. The Lempel-Ziv complexity is defined as the number of subsequences produced by this decomposition. In a Lempel-Ziv decomposition, the first subsequence consists of the first symbol only. Subsequence X_{2 }begins at the second symbol. Symbols are added to this subsequence until X_{2 }is no longer an element of the vocabulary v{(X_{1}X_{2})_{π}}. When this occurs, X_{2 }is complete, and the construction of X_{3 }begins. Consecutive symbols are added to X_{3 }until X_{3 } v{(X_{1}X_{2}X_{3})_{π}}. The construction of X_{4 }then begins. This procedure continues until the entire message is expressed as a concatenation of N subsequences, M = X_{1}X_{2 }......X_{N}. The Lempel-Ziv complexity is the integer N, C_{LZ }= N.

This process can be illustrated by a specific example. Suppose M = 000110100.

M = X_{1}X_{2}X_{3}X_{4 }and C_{LZ }= 4. On reflection it can be seen that this decomposition will provide a mechanism for compressing messages. For any J, by construction subsequence (X_{J})_{π }appears somewhere earlier in the message. X_{J }can therefore be completely specified by three quantities:

1. the index of the position earlier in the message where (X_{J})_{π }begins,

2. the length of X_{J}, and

3. the identity of the last symbol of X_{J}.

When very large messages are analyzed, X_{J }can be very long, perhaps thousands of symbols. This very long substring can now be replaced by these three quantities. Additional examples and pseudo-code for calculating the Lempel-Ziv complexity are given in Appendix A of Watanabe, et al. [163].

The grammar complexity calculations with data generated by model systems reported in Appendix One were repeated with Lempel-Ziv complexity. The same relative ordering was observed random > Hénon > Lorenz > Rössler > constant (Figure (Figure1212).

As shown in Figure Figure13,13, Lempel-Ziv complexity shows the same dependence on message length that was observed with grammar complexity. The normalization with equi-probable random surrogates was also implemented with Lempel-Ziv complexity. As before, the normalized complexity is independent of L_{M}. In these calculations, 499 surrogates were computed and the null hypothesis was rejected with probability P_{NIULL }= .002 in all cases with the exception of random data where the average value of P_{NIULL }was .450.

As previously reported [169] grammar complexity and Lempel-Ziv complexity are highly correlated. The complexity values computed with Rössler, Lorenz, Hénon and random data for L_{M }= 1000, 2000, .... 10,000 element data sets were compared. The Pearson linear correlation coefficient was found to be r = .998 (the same value that was obtained with different data in [169]). The probability of the null hypothesis of no correlation was less than 10^{-8}.

Five model systems are investigated in the calculations presented in Appendices One and Two. The constant symbol sequence is constructed by repeating one symbol for the entire length of the data set. The Rössler system [173] is a three dimensional system of autonomous ordinary differential equations.

The differential equations were integrated with a step length of h = .1 using a sixth order Runge-Kutta-Hutta algorithm [174]. The Lorenz system [175,176] is specified by

As in the case of the Rössler equations, a Runge-Kutta-Hutta calculation was performed with h = .1. The Hénon system [177,178] is a two dimensional difference equation.

The random number generator [179] produced uniformly distributed random numbers on [0,1]. It is based on L'Ecuyer's two-sequence generator [180] and incorporates a Bays-Durham shuffle [181].

The pre-publication history for this paper can be accessed here:

PER would like to acknowledge training received at the Philadelphia School of Psychoanalysis and the Philadelphia Consultation Center and specifically Dr. Stephen Day Ellis, President, and Dr. Angela Sandone-Barr, Director of Clinical Services. Discussions with Dr. Arnold Feldman and with the members of the Entwurf Gruppe are acknowledged with gratitude. The opinions and assertions contained herein are the private opinions of the authors and are not to be construed as official or reflecting the views of the United States Department of Defense. MAJM acknowledges partial support from: Sistema Nacional de Investigadores; PROMEP, Project: UV-CA-197 MEXICO, and Universidad Veracruzana. PER would like to acknowledge support from the Traumatic Injury Research Program of the Uniformed Services University of the Health Sciences and from the Defense Medical Research and Development Program.

- Hibbard MR, Uysal S, Kepler K, Bogdany J, Silver J. Axis I. psychopathology in individuals with traumatic brain injury. Journal of Head Trauma Rehabilitation. 1998;13:24–39. doi: 10.1097/00001199-199808000-00003. [PubMed] [Cross Ref]
- Hibbard MR, Gordon WA, Othera LM. In: Cognitive-Behavioral Strategies in Crisis Intervention. Dattilo FM, Freedman A, editor. New York: Guilford Press; 2000. Traumatic brain injury; pp. 219–242.
- National Institutes of Health. Rehabilitation of persons with traumatic brain injury. NIH Consensus Statement. 1998;16(1):26–28. October. [PubMed]
- Zaloshnja E, Miller T, Langlois J, Selassie A. Prevalence of long-term disability from traumatic brain injury in the civilian population of the United States, 2005. Journal of Head Trauma Rehabilitation. 2008;23(6):394–400. doi: 10.1097/01.HTR.0000341435.52004.ac. [PubMed] [Cross Ref]
- Fann JR, Katon WJ, Uomoto JM, Esselman PC. Psychiatric disorders and functional disability in out-patients with traumatic brain injuries. American Journal of Psychiatry. 1995;152(10):1493–1499. [PubMed]
- Van Reekum R, Bolago I, Finlayson MS, Garner A, Links PS. Psychiatric disorders after traumatic brain injury. Brain Injury. 1996;10:319–327. doi: 10.1080/026990596124340. [PubMed] [Cross Ref]
- Ashman TA, Spielman SA, Hibbard MR, Silver JM, Chandna T, Gordon WA. Psychiatric challenges in the first 6 years after traumatic brain injury: cross-sequential analyses of Axis I disorders. Archives of Physical Medicine and Rehabilitation. 2004;85(Supplement 2):S36–S42. [PubMed]
- Deb S, Lyons I, Koutzouskis C, Ali K, McCarthy G. Rate of psychiatric illness 1 year after traumatic brain injury. American Journal of Psychiatry. 1999;156:374–378. [PubMed]
- Rosenthal M, Christensen BK, Ross TP. Depression following traumatic brain injury. Archives of Physical Medicine and Rehabilitation. 1998;79:90–103. doi: 10.1016/S0003-9993(98)90215-5. [PubMed] [Cross Ref]
- Iverson GL. Misdiagnosis of persistent postconcussion syndrome in patients with depression. Archives of Clinical Neuropsychology. 2006;21:303–310. doi: 10.1016/j.acn.2005.12.008. [PubMed] [Cross Ref]
- Cope DN. An integration of psychopharmacological and rehabilitation approaches to traumatic brain injury rehabilitation. Journal of Head Trauma Rehabilitation. 1994;9:1–18.
- Prigatano GP. Disordered mind, wounded soul: the emerging role of psychotherapy in rehabilitation after brain injury. Journal of Head Trauma Rehabilitation. 1991;6(4):1–10. doi: 10.1097/00001199-199112000-00004. [Cross Ref]
- Ben-Yishay Y, Rattok J, Lakin P, Piasetsky EB, Ross B, Silver S, Zide E, Ezrachi O. Neuropsychologic rehabilitation: Quest for a holistic approach. Seminars in Neurology. 1985;5(3):252–258. doi: 10.1055/s-2008-1041522. [Cross Ref]
- Ezrachi O, Ben-Yishay Y, Kay T, DiUer L, Rattok J. Predicting employment in traumatic brain injury following neuropsychological rehabilitation. Journal of Head Trauma Rehabilitation. 1991;6(3):71–84. doi: 10.1097/00001199-199109000-00010. [Cross Ref]
- Teri L, Logsdon RG, Uomoto J, McCurry SM. Behavioral treatment of depression in dementia patients: a controlled clinical trial. Journal of Gerontology B. Psychological Sciences. 1997;52B:159–166. doi: 10.1093/geronb/52B.4.P159. [PubMed] [Cross Ref]
- Goranson TE, Grave RE, Allison D, La Frenieres R. Community integration following multidisciplinary rehabilitation for traumatic brain injury. Brain Injury. 2003;17:759–774. doi: 10.1080/0269905031000088513. [PubMed] [Cross Ref]
- Williams WH, Evans JJ, Wilson BA. Neurorehabilitaton for two cases of post-traumatic stress disorder following brain injury. Cognitive Neuropsychiatry. 2003;8:1–18. doi: 10.1080/713752238. [PubMed] [Cross Ref]
- Tiersky LA, Anselmi V, Johnston MV, Kurtyka J, Rosen E, Schwartz T, DeLuca J. A trial of neuropsychologic rehabilitation in mild-spectrum traumatic brain injury. Archives of Physical Medicine and Rehabilitation. 2005;86(8):1565–1574. doi: 10.1016/j.apmr.2005.03.013. [PubMed] [Cross Ref]
- Beutler LE, Moleiro C, Talebi H. How practitioners can systematically use empirical evidence in treatment selection. Journal of Clinical Psychology. 2002;58:1199–1212. doi: 10.1002/jclp.10106. [PubMed] [Cross Ref]
- Payne HC. Traumatic brain injury, depression and cannabis use-assessing their effects on cognitive performance. Brain Injury. 2000;15:479–489. [PubMed]
- Medd J, Tate RL. Evaluation of an anger management programme following acquired brain injury: a preliminary study. Neuropsychological Rehabilitation. 2000;10(2):185–201. doi: 10.1080/096020100389246. [Cross Ref]
- Sohlberg MM. In: Neuropsychological Management of Mild Traumatic Brain Injury. Raskin SA, Mateer CA, editor. New York: Oxford University Press; 2000. Psychotherapy approaches; pp. 137–156.
- Cicerone K. Psychotherapeutic interventions with traumatically brain-injured patients. Rehabilitation Psychology. 1989;34:105–114.
- Ruff RM, Camenzuli L, Mueller J. Miserable minority: emotional risk factors that influence the outcome of a mild traumatic brain injury. Brain Injury. 1996;10(8):551–566. doi: 10.1080/026990596124124. [PubMed] [Cross Ref]
- Anson K, Ponsford J. Evaluation of a coping skills group following traumatic brain injury. Brain Injury. 2006;20:167–178. doi: 10.1080/02699050500442956. [PubMed] [Cross Ref]
- Mateer CA, Sira CS. Cognitive and emotional consequences of TBI: intervention strategies for vocational rehabilitation. Neurorehabilitation. 2006;21:315–326. [PubMed]
- Lewis L, Rosenberg SJ. Psychoanalytic psychotherapy with brain-injured adult psychiatric patients. Journal of Nervous and Mental Disease. 1990;178(2):69–77. doi: 10.1097/00005053-199002000-00001. [PubMed] [Cross Ref]
- Goldstein K. The effects of brain damage on the personality. Psychiatry. 1952;15:245–260. [PubMed]
- Folzer SM. Psychotherapy with "mild" brain-injured patients. American Journal of Orthopsychiatry. 2001;71(2):245–251. [PubMed]
- Werman DS. The Practice of Supportive Psychotherapy. New York: Brunner/Mazel; 1988.
- Prigatano GP, Klonoff PS. Psychotherapy and neuropsychological assessment after brain injury. Journal of Head Trauma Rehabilitation. 1988;3:45–68.
- Delmonico RL, Hanley-Peterson P, Englander JC. Group psychotherapy for persons with traumatic brain injury: Management of frustration and substance abuse. Journal of Head Trauma Rehabilitation. 1998;13(6):10–22. doi: 10.1097/00001199-199812000-00004. [PubMed] [Cross Ref]
- Rush AJ, First MB, Blacker D. Handbook of Psychiatric Measures. Second. Washington, DC: American Psychiatric Publishers; 2008.
- Blanchet A, Batt M, Trognon A, Masse L. In: The Hidden Structure of Interaction. Anolli L Duncan S, Magnusson MS Riva G, editor. Amsterdam: IOS Press; 2005. Language and behaviour patterns in a therapeutic interaction sequence; pp. 123–139. Amsterdam: IOS Press.
- Magnusson MS. In: The Hidden Structure of Interaction. Anolli L Duncan S, Magnusson MS Riva G, editor. Amsterdam: IOS Press; 2005. Understanding social interaction: discovering hidden structure with model and algorithms. Amsterdam: IOS Press.
- Haynal-Reymond V, Jonsson GK, Magnussion MS. In: The Hidden Structure of Interaction. Anolli L Duncan S, Magnusson MS Riva G, editor. Amsterdam: IOS Press; 2005. Nonverbal communication in doctor-suicidal patient interview; pp. 141–148. Amsterdam: IOS Press.
- Merten J, Schwab F. In: The Hidden Structure of Interaction. Anolli L Duncan S, Magnusson MS Riva G, editor. Amsterdam: IOS Press; 2005. Facial expression patterns in common psychotherapeutic situations; pp. 149–158. Amsterdam: IOS Press.
- Magnusson MS. Hidden real-time patterns in intra- and inter-individual behavior: description and detection. European Journal of Psychological Assessment. 1996;12:112–123. doi: 10.1027/1015-5759.12.2.112. [Cross Ref]
- Magnusson MS. Discovering hidden time patterns in behavior: T-patterns and their detection. Behavior Research Methods, Instruments and Computers. 2000;32(1):93–110. doi: 10.3758/BF03200792. [PubMed] [Cross Ref]
- Rapp PE, Jiménez-Montaño MA, Langs RJ, Thomson L. Quantitative characterization of patient-therapist communication. Mathematical Biosciences. 1991;105:207–227. doi: 10.1016/0025-5564(91)90082-T. [PubMed] [Cross Ref]
- Grünzig HJ, Holzscheck K, Kachele H. Programmsystem zur maschinellen Inhaltsanalyse von Psychotherapieprotokollen. Medizinische Psychologie. 1976;2:208–217.
- Pennebaker JW, Francis ME, Booth RJ. Linguistic Inquiry and Word Count (LIWC): LIWC2001. Mahwah, NJ: Erlbaum; 2001.
- Pennebaker J, Mehl M, Niederhoffer K. Psychological aspects of natural language use: Our words, ourselves. Annual Review of Psychology. 2003;54:547–577. doi: 10.1146/annurev.psych.54.101601.145041. [PubMed] [Cross Ref]
- Hart RP. In: Theory, Method and Practice in Computer Analysis. West MD, editor. New York: Ablex; 2001. Redeveloping DICTION: theoretical considerations; pp. 43–60.
- Fast LA, Funder DC. Personality as manifest in word use: correlations with self-report, acquaintance report, and behavior. Journal of Personality and Social Psychology. 2008;94:334–346. [PubMed]
- Holt RR. In: Journal of the American Psychoanalytic Association. 3. Wilma Bucci, Norbert Freedman, editor. Vol. 56. London: International Psychoanalytic Association; 2008. Book review: In Search of Psychoanalytic Truth from Impression to Inquiry: A Tribute to the Work of Robert Wallerstein; pp. 997–1009. [Cross Ref]
- Dahl H. In: Psychoanalysis and Contemporary Science. Holt RR, Peterfreund E, editor. New York: Macmillan; 1972. A quantitative study of a psychoanalysis; pp. 237–257.
- Dahl H. The measurement of meaning in psychoanalysis by computer analysis of verbal contexts. Journal of the American Psychoanalytic Association. 1974;22:37–57. doi: 10.1177/000306517402200103. [PubMed] [Cross Ref]
- Dahl H, Teller V, Moss D, Trujillo M. Countertransference examples of the syntactic expression of warded off contents. Psychoanalytic Quarterly. 1978;47:339–363. [PubMed]
- Chomsky N. Reflections on Language. New York: Pantheon; 1975.
- Chomsky N. Conditions on rules of grammar. Linguistic Analysis. 1976;2(4):303–351.
- Gottschalk LA, Gleser GC. The Measurement of Psychological States Through the Content of Verbal Behavior. University of California Press, Berkeley, CA; 1969.
- Gottschalk LA, Fox RA, Bates DE. A study of prediction and outcome in a mental health crisis clinic. American Journal of Psychiatry. 1973;130:1107–1111. [PubMed]
- Gottschalk LA, Kunkel RL, Wohl T, Saenger E, Winget CN. Total and half body irradiation: effect on cognitive and emotional processes. Archives of General Psychiatry. 1969;21:574–580. [PubMed]
- Perley J, Winget CN, Placci C. Hope and discomfort as factors influencing treatment continuance. Comprehensive Psychiatry. 1971;12:557–563. doi: 10.1016/0010-440X(71)90038-1. [PubMed] [Cross Ref]
- Lebovits AH, Holland JC. Use of the Gottschalk-Gleser verbal content analysis scales with medically ill patients. Psychosomatic Medicine. 1983;45:305–320. [PubMed]
- Gottschalk LA, Hoigaard-Martin J. Emotional impact of mastectomy. Psychiatry Research. 1986;17:153–167. doi: 10.1016/0165-1781(86)90070-3. [PubMed] [Cross Ref]
- Viney LL, Westbrook MT. In: Content Analysis of Verbal Behavior. L. A. Gottschalk LA, Lolas F, Viney LL, editor. Berlin: Springer Verlag; 1986. Psychological states in patients with diabetes mellitus; pp. 157–169.
- Langs R, Rapp PE, Pinto A, Cramer G, Badalamenti A. Three quantitative studies of gender and identity in psychotherapy consultations. American Journal of Psychotherapy. 1992;46:183–206. [PubMed]
- Jiménez-Montaño MA. On the syntactic structure of protein sequences and the concept of complexity. Bulletin of Mathematical Biology. 1984;46:641–659.
- Langs RJ. A Primer of Psychotherapy. New York: Gardner; 1988.
- Stiles WB. Describing Talk: A Taxonomy of Verbal Response Modes. Newbury, CA: Sage Publications; 1992.
- Stiles WB, Sultan FE. Verbal response mode used by clients in psychotherapy. Journal of Consulting and Clinical Psychology. 1979;47(3):611–613. [PubMed]
- Stiles WB, McDaniel SH, McGaughey K. Verbal response mode correlates of experiencing. Journal of Consulting and Clinical Psychology. 1979;47(4):795–797. [PubMed]
- Doba K, Pezard L, Lesne A, Vignau J, Christophe V, Nandrino JL. Dynamics of emotional expression in autobiographic speech of patients with anorexia nervosa. Psychological Reports. 2007;101:237–249. [PubMed]
- Doba K, Nandrino JL, Lesne A, Humez C, Pezard L. Organization of narrative components in autobiographical speech of anorexic adolescents: A statistical and nonlinear dynamical analysis. New Ideas in Psychology. 2008;26:295–308. doi: 10.1016/j.newideapsych.2007.07.004. [Cross Ref]
- Leroy F, Pezard L, Nandrino JL, Beaune D. Dynamical quantification of schizophrenic speech. Psychiatry Research. 2005;133(2-3):159–171. doi: 10.1016/j.psychres.2004.07.009. [PubMed] [Cross Ref]
- Kintsch W, van Dijk TA. Toward a model of text comprehension and production. Psychological Review. 1978;85(5):363–394.
- Van Dijk TA, Kintsch W. Strategies of Discourse Comprehension. New York: Academic Press; 1983.
- Linehan M. Cognitive and Behavioral Treatment of Borderline Personality Disorder. The Guildford Press, NY; 1993.
- Linehan MM. Skills Training Manual for Treating Borderline Personality Disorder. New York: Guilford Press; 1993.
- Stiles WB, Shapiro DA, Firth-Cozens JA. Therapist differences in the use of verbal response mode forms and intents. Psychotherapy. 1989;26:314–322.
- Rapp PE, Schmah TI. In: Chaos in Brain? Lehnertz K, Arnhold J Grassberger P, Elger CD, editor. World Scientific, Singapore; 2000. Dynamical analysis in clinical practice; pp. 52–65.
- Rapp PE, Zimmerman ID, Vining EP, Cohen N, Albano AM, Jiménez-Montaño MA. The algorithmic complexity of neural spike trains increases during focal seizures. Journal of Neuroscience. 1994;14:4731–4739. [PubMed]
- McDaniel SH, Stiles WB, McGaughey KJ. Correlations of male college student's verbal response mode use in psychotherapy with measures of psychological disturbance and psychotherapy outcome. Journal of Consulting and Clinical Psychology. 1981;49(4):571–582. [PubMed]
- Winefield HR, Basset DL, Chandler MA, Proske I. Process in psychotherapy as decreasing asymmetry between patient and therapist: evidence from verbal interaction. American Journal of Psychotherapy. 1987;41(1):117–126. [PubMed]
- Lempel A, Ziv J. On the complexity of finite sequences. IEEE Transactions on Information Theory. 1976;IT-22:75–81.
- Gallager RG. Information Theory and Reliable Communication. New York: John Wiley and Sons; 1968.
- Cellucci CJ, Albano AM, Rapp PE. Statistical validation of mutual information calculations: comparisons of alternative numerical algorithms. Physical Review E. 2005;71 066208-1 to 066208-14. [PubMed]
- Shannon CE. A mathematical theory of communication. Bell System Technical Journal. 1948;27:379–423.
- Shannon CE. Prediction and entropy of printed English. Bell System Technical Journal. 1951;30:50–64.
- Burton NG, Licklider JCR. Long-range constraints in the statistical structure of printed English. American Journal of Psychology. 1955;68(4):650–653. doi: 10.2307/1418794. [PubMed] [Cross Ref]
- Cover T, King R. A convergent gambling estimate of the entropy of English. IEEE Transactions on Information Theory. 1978;24(4):413–421. doi: 10.1109/TIT.1978.1055912. [Cross Ref]
- Kolmogorov AN. Three approaches to the quantitative definition of information. Problems of Information Processing. 1965;1:3–11. Translated from the Russian Edition.
- Ebeling W. Prediction and entropy of nonlinear dynamical systems and symbolic sequences with LRO. Physica D. 1997;109(1-2):42–52. doi: 10.1016/S0167-2789(97)00157-7. [Cross Ref]
- Steuer R, Molgedey L, Ebeling W, Jiménez-Montaño M-A. Entropy and optimal partition for data analysis. European Physical Journal Series B. 2001;19:265–269.
- Schmitt AO, Herzel H, Ebeling W. A new method to calculate higher-order entropies from finite samples. Europhysics Letters. pp. 303–309.
- Grassberger P. Toward a quantitative theory of self-generated complexity. International Journal of Theoretical Physics. 1986;25(9):907–938. doi: 10.1007/BF00668821. [Cross Ref]
- Ebeling W, Muschik W, eds. Statistical Physics and Thermodynamics of Nonlinear Nonequilbrium Systems. Singapore: World Scientific; 1992.
- Gramss T. Entropy of the symbolic sequence for critical circle maps. Physical Review E. 1994;50(4):2616–2620. doi: 10.1103/PhysRevE.50.2616. [PubMed] [Cross Ref]
- Ebeling W, Feistel R, Herzel H. Dynamics and complexities of biomolecules. Physica Scripta. 1987;35:761–768. doi: 10.1088/0031-8949/35/5/033. [Cross Ref]
- Herzel H. Complexity of symbol sequences. Systems Analysis, Modeling, Simulation. 1988;5(5):435–444.
- Herzel H, Schmitt AO, Ebeling W. Finite sample effects in sequence analysis. Chaos, Solitons and Fractals. 1994;4(1):97–113. doi: 10.1016/0960-0779(94)90020-5. [Cross Ref]
- Schmitt A. Ph.D. thesis. Humboldt-Universität, Berlin, Mathematisch-Naturwissenschaftliche Fakultät I; 1995. Structural analysis of DNA sequences.
- Schürmann T, Grassberger P. Entropy estimation of symbol sequences. Chaos. 1996;6:414–427. doi: 10.1063/1.166191. [PubMed] [Cross Ref]
- Dudok de Wit T. When do finite sample sizes significantly affect entropy estimates? European Physical Journal B. 1999;11:513–516. doi: 10.1007/s100510050963. [Cross Ref]
- Lesne A, Blanc JL, Pezard L. Entropy estimation of very short symbol sequences. Physical Review E. 2009;79:046208. [PubMed]
- Alvarez-Lacalle E, Dorow B, Eckmann JP, Moses E. Hierarchical structures induces long-range dynamical correlations in written texts. Proceedings of the National Academy of Sciences, USA. 2006;103:7956–7961. doi: 10.1073/pnas.0510673103. [PubMed] [Cross Ref]
- Manning CD, Schütze H. Foundations of Statistical Natural language Processing. Cambridge, MA: MIT Press; 1999.
- Beeferman D, Berger A, Lafferty JD. Statistical models for text segmentation. Machine Learning. 1999;34:177–210. doi: 10.1023/A:1007506220214. [Cross Ref]
- Nowak MA, Komarova N, Niyogi P. Computational and evolutionary aspects of language. Nature. 2002;417:611–617. doi: 10.1038/nature00771. [PubMed] [Cross Ref]
- Montemurro MA, Zanette DH. Universal entropy of word ordering across linguistic families. PLoS One. 2001;6(5):e19875. [PMC free article] [PubMed]
- Xu J, Liu ZR, Liu R. The measure of sequence complexity for EEG studies. Chaos, Solitons and Fractals. 1994;4:2111–2119. doi: 10.1016/0960-0779(94)90125-2. [Cross Ref]
- Redington DJ, Reidbord SP. Chaotic dynamics in autonomic nervous-system activity of a patient during a psychotherapy session. Biological Psychiatry. 1992;31:993–1007. doi: 10.1016/0006-3223(92)90093-F. [PubMed] [Cross Ref]
- Bütz MR. Practical applications from chaos theory to the psychotherapeutic process. Psychological Reports. 1993;73:543–554. [PubMed]
- Schiepek G, Kowalik ZJ, Schütz A, Köhler M, Richter K, Strunk G, Mühlnickel W, Elbert T. Psychotherapy as a chaotic process. I. Coding the client-therapist interaction by means of sequential plan analysis and the search for chaos: a stationary approach. Psychotherapy Research. 1997;7(2):173–194. doi: 10.1080/10503309712331331953. [Cross Ref]
- Kowalik ZJ, Schiepek G, Kumpf K, Roberts LE, Elbert T. Psychotherapy as a chaotic process. II. The applications of nonlinear analysis methods on quasi-time series of the client-therapist interaction: a nonstationary approach. Psychotherapy Research. 1997;7(3):197–218. doi: 10.1080/10503309712331331973. [Cross Ref]
- Chamberlain L, Bütz MR, eds. Clinical Chaos: A Therapist's Guide to Nonlinear Dynamics and Therapeutic Change. Philadelphia: Taylor and Francis; 1998. [PubMed]
- Schiepek G. Complexity and nonlinear dynamics in psychotherapy. European Review. 2009;17(2):331–356. doi: 10.1017/S1062798709000763. [Cross Ref]
- Priel B, Schreiber G. On psychoanalysis and non-linear dynamics. The paradigm of bifurcation. British Journal of Medical Psychology. 1994;67:209–218. doi: 10.1111/j.2044-8341.1994.tb01788.x. [PubMed] [Cross Ref]
- Tschacher W, Scheier C, Grawe K. Order and pattern formation in psychotherapy. Nonlinear Dynamics, Psychology and Life Sciences. 1998;2:195–215. doi: 10.1023/A:1022324018097. [Cross Ref]
- Tschacher W, Baur N, Grawe K. Temporal interaction of process variables in psychotherapy. Psychotherapy Research. 2000;10:296–309. doi: 10.1093/ptr/10.3.296. [Cross Ref]
- Nandrino JL, Leroy F, Pezard L. Dynamics as a heuristic framework for psychopathology. Chaos and Complexity Letters. 2005;1(2):145–177.
- Waskow IE. In: Psychotherapy Research: Where are We and Where Should We Go? Williams JBW, Spitzer RL, editor. New York: Guilford Press; 1984. Specification of the technique variable in the NIMH treatment of depression collaborative research program; pp. 150–159. 1984.
- Granacher RP. Traumatic Brain Injury. Methods for Clinical and Forensic Neuropsychological Assessment. Second. Boca Raton, FL: CRC Press; 2008.
- Penn C, Cleary J. Compensatory strategies in the language of closed head injured patients. Brain Injury. 1988;2(1):3–19. doi: 10.3109/02699058809150928. [PubMed] [Cross Ref]
- Sohlberg MM, Mateer C. Cognitive Rehabilitation. An Integrative Neuropsychological Approach. New York: Guilford Press; 2001.
- Coelho CA. Discourse production deficits following traumatic brain injury: a critical review of the recent literature. Aphasiology. 1995;9:409–429. doi: 10.1080/02687039508248707. [Cross Ref]
- Coelho C, Youse KM. In: Medical Speech-Language Pathology. A Practitioner's Guide. Second. A. F. Johnson B. H. Jacobson, editor. New York: Thieme Medical Publishers; 2007. Cognitive-communicaton rehabilitation following traumatic brain injury; pp. 71–93. [PubMed]
- Blakemore D. Understanding Utterances: The Pragmatics of Natural Language. Oxford: Blackwell; 1990.
- Martin I, McDonald S. Weak coherence, no theory of mind or executive dysfunction? Solving the problem of pragmatic language disorders. Brain and Language. 2003;85:451–466. doi: 10.1016/S0093-934X(03)00070-1. [PubMed] [Cross Ref]
- Nicholas LE, Brookshire RH. Comprehension of spoken narrative discourse by adults with aphasia, right-hemisphere damage, or traumatic brain injury. American Journal of Speech-Language Pathology. 1995;4:69–81.
- Friedland D, Miller N. Conversation analysis of communication breakdown after closed head injury. Brain Injury. 1998;12(1):1–14. doi: 10.1080/026990598122818. [PubMed] [Cross Ref]
- McDonald S. Pragmatic language skills after closed head injury: Ability to meet the informational needs of the listener. Brain and Language. 1993;44(1):28–46. doi: 10.1006/brln.1993.1003. [PubMed] [Cross Ref]
- Baltaxe CAM. Pragmatic deficits in the language of autistic adolescents. Journal of Pediatric Psychology. 1977;2(4):176–180. doi: 10.1093/jpepsy/2.4.176. [Cross Ref]
- Loveland KA, Landry SH, Hughes SO, Hall SK, McEvoy RE. Speech acts and the pragmatic deficits of autism. Journal of Speech and Hearing Research. 1988;31:593–604. [PubMed]
- Camarata SM, Gibson T. Pragmatic language deficits in attention-deficit hyperactivity disorder. Mental Retardation and Developmental Disabilities Research Reviews. 1999;5(3):207–214. doi: 10.1002/(SICI)1098-2779(1999)5:3<207::AID-MRDD7>3.0.CO;2-O. [Cross Ref]
- Mitchell RLC, Crow TJ. Right hemisphere language functions and schizophrenia: the forgotten hemisphere. Brain. 2005;128(5):963–978. doi: 10.1093/brain/awh466. [PubMed] [Cross Ref]
- Champagne-Lavau M, Stip E, Joanette Y. Language functions in right-hemisphere damage and schizophrenia: apparently similar pragmatic deficits may hide profound differences. Brain. 2007;130(2):e67. doi: 10.1093/brain/awl311. [PubMed] [Cross Ref]
- Brownell H, Martino G. In: Right Hemisphere Language Comprehension: Perspectives from Cognitive Neuroscience. Beeman M, Chiarello C, editor. Mahwah, NJ: Lawrence Erlbaum Associates; 1998. Deficits in inference and social cognition: the effects of right hemisphere damage on discourse; pp. 309–328.
- Santoro J, Spiers M. Social cognitive factors in brain injury-associated personality change. Brain Injury. 1994;8(3):265–276. doi: 10.3109/02699059409150978. [PubMed] [Cross Ref]
- Turkstra LS, Dixon TM, Baker KK. Theory of Mind and social beliefs in adolescents with traumatic brain injury. Neurorehabilitation. 2004;19(3):245–256. [PubMed]
- Bibby H, McDonald S. Theory of mind after traumatic brain injury. Neuropsychologia. 2005;43:99–114. doi: 10.1016/j.neuropsychologia.2004.04.027. [PubMed] [Cross Ref]
- Havet-Thomassin V, Allain P, Etcharry-Bouyx F, Le Gall D. What about theory of mind after severe brain injury? Brain Injury. 2006;20(1):83–91. doi: 10.1080/02699050500340655. [PubMed] [Cross Ref]
- Henry JD, Phillips LH, Crawford JR, Ietswaart M, Summers F. Theory of mind following traumatic brain injury: the role of emotion recognition and executive dysfunction. Neuropsychologia. 2006;44(10):1623–1628. doi: 10.1016/j.neuropsychologia.2006.03.020. [PubMed] [Cross Ref]
- Martin-Rodriquez JF, Leon-Carrion J. Theory of mind deficits in patients with acquired brain injury: A quantitative review. Neuropsychologia. 2010;48(5):1181–1191. doi: 10.1016/j.neuropsychologia.2010.02.009. [PubMed] [Cross Ref]
- Frith U. Autism: Explaining the Enigma. Oxford: Blackwell; 1989.
- Jolliffe T, Baron-Cohen S. A test of central coherence theory: can adults with high-functioning autism or Asperger syndrome integrate fragments of an object? Cognitive Neuropsychiatry. 2001;6(3):193–216. doi: 10.1080/13546800042000124. [PubMed] [Cross Ref]
- Happé F, Frith U. The weak coherence account: Detailed focused cognitive style in autism and spectrum disorders. Journal of Autism and Developmental Disorders. 2006;36:5–25. doi: 10.1007/s10803-005-0039-0. [PubMed] [Cross Ref]
- Goldberg E. The Executive Brain: Frontal Lobes and the Civilized Mind. Oxford: Oxford University Press; 2001.
- Miller EK, Cohen JD. An integrative theory of prefrontal cortex function. Annual Reviews of Neuroscience. 2001;24:167–202. doi: 10.1146/annurev.neuro.24.1.167. [PubMed] [Cross Ref]
- Douglas JM. Relation of executive functioning to pragmatic outcome following severe traumatic brain injury. Journal of Speech, Language and Hearing Research. 2010;53:365–382. doi: 10.1044/1092-4388(2009/08-0205). [PubMed] [Cross Ref]
- McDonald S. Exploring the process of inference generation in sarcasm: A review of normal and clinical studies. Brain and Language. 1999;68(3):486–506. doi: 10.1006/brln.1999.2124. [PubMed] [Cross Ref]
- Booth R, Charlton R, Hughes C, Happé F. Disentangling weak coherence and executive dysfunction: planning drawing in autism and attention-deficit/hyperactivity disorder. Philosophical Transactions of the Royal Society. Series B. Biological Sciences. 2003;358(1430):387–392. doi: 10.1098/rstb.2002.1204. [PMC free article] [PubMed] [Cross Ref]
- Burnette CP, Mundy PC, Meyer JA, Sutton SK, Vaughan AE, Charak D. Weak central coherence and its relations to theory of mind and anxiety in autism. Journal of Autism and Developmental Disorders. 2005;35(1):63–73. doi: 10.1007/s10803-004-1035-5. [PubMed] [Cross Ref]
- Pellicano E, Maybery M, Maley A. Multiple cognitive capabilities/deficits in children with an autism spectrum disorder: "weak" central coherence and its relation to theory of mind and executive control. Developmental Psychopathology. 2006;18(1):77–98. [PubMed]
- Snow P, Douglas J, Ponsford J. Conversational assessment following traumatic brain injury: a comparison across two control groups. Brain Injury. 1997;11(6):409–429. doi: 10.1080/026990597123403. [PubMed] [Cross Ref]
- Pellicano E, Maybery M, Maley A. Multiple cognitive capabilities/deficits in children with an autism spectrum disorder: "weak" central coherence and its relation to theory of mind and executive control. Developmental Psychopathology. 2006;18(1):77–98. [PubMed]
- Friedland D, Miller N. Conversation analysis of communication breakdown after closed head injury. Brain Injury. 1998;12(1):1–14. doi: 10.1080/026990598122818. [PubMed] [Cross Ref]
- Coelho CA, Liles BZ, Duffy RL, Clarkson YV. Conversational patterns of aphasic, closed-head-injured and normal speakers. Clinical Aphasiology. 1993;21:183–192.
- Coelho CA, Youse KM, Le K. Conversational discourse in closed-head-injury and non-brain-injured adults. Aphasiology. 2002;16(4-6):659–672.
- Damico JS. In: Communication Skills and Classroom Success. Simon CS, editor. London: Taylor and Francis; 1985. Clinical discourse analysis: A functional approach to language assessment; pp. 165–203.
- Damico JS. Communication Skills and Classroom Success. Eau Claire, WI: Thinking Publications; 1991. Clinical discourse analysis: A functional approach to language assessment. assessment and therapy methodologies for language and learning disabled students; pp. 125–150.
- Chapman SB. Cognitive-communication abilities in children with closed head injury. American Journal of Speech-Language Pathology. 1997;6(2):50–58.
- Chapman SB, Watkins R, Gustafson C, Moore S, Levin HS, Kufera JA. Narrative discourse in children with closed head injury, children with language impairment and typically developing children. American Journal of Speech-Language Pathology. 1997;6(2):66–75.
- Body R, Parker M. Topic repetitiveness after traumatic brain injury: An emergent jointly managed behaviour. Clinical Linguistics and Phonetics. 2005;19(5):379–392. doi: 10.1080/02699200400027189. [PubMed] [Cross Ref]
- Morris J, Bleiberg J. Neuropsychological rehabilitation and traditional psychotherapy. International Journal of Clinical Neuropsychology. 1986;8:133–135.
- Judd D, Wilson SL. Psychotherapy with brain injury survivors: an investigation of the challenges encountered by clinicians and their modifications to therapeutic practice. Brain Injury. 2005;19(6):437–449. doi: 10.1080/02699050400010994. [PubMed] [Cross Ref]
- Chaitin GJ. Information theoretical computational complexity. IEEE Transactions on Information Theory. 1974;IT20:10–15.
- Zvonkin AK, Levin LA. The complexity of finite-objects and the development of the concepts of information and randomness by means of the theory of algorithms. Russian Mathemathical Surveys. 1970;25:83–124. doi: 10.1070/RM1970v025n06ABEH001269. [Cross Ref]
- Li M, Vitányi P. An Introduction to Kolmogorov Complexity and Its Applications. New York: Springer-Verlag; 1993.
- Ebeling W, Jiménez-Montaño MA. On grammars, complexity and information measures of biological macromolecules. Mathematical Biosciences. 1980;52:53–71. doi: 10.1016/0025-5564(80)90004-8. [Cross Ref]
- Watanabe TAA, Cellucci CJ, Kohegyi E, Bashore TR, Josiassen RC, Greenbaun NN, Rapp PE. The algorithmic complexity of multichannel EEGs is sensitive to changes in behavior. Psychophysiology. 2003;40:77–97. doi: 10.1111/1469-8986.00009. [PubMed] [Cross Ref]
- Rapp PE. Quantitative characterization of animal behavior following blast exposure. Cognitive Neurodynamics. 2007;1:287–293. doi: 10.1007/s11571-007-9027-8. [PMC free article] [PubMed] [Cross Ref]
- Radhakrishnan N, Wilson D, Loizou PC. An alternative partitioning technique to quantify the regularity of complex time series. International Journal of Bifurcation and Chaos. pp. 1773–1779.
- Bradley PS, Fayyad UM. In: Proceedings of the Fifteenth Conference on Machine Learning. I Brasko S. Dzeroski, editor. New York: Morgan Kaufman; 1998. Refining initial points for k-means clustering.
- Hirata Y, Judd K, Kilminster D. Estimating a generating partition from observed time series: symbolic shadowing. Physical Review E. 2004;70:016215. [PubMed]
- Rapp PE, Albano AM, Zimmerman ID, Jiménez-Montaño MA. Phase-randomized surrogates can produce spurious identifications of non-random structure. Physics Letters. 1994;192A:27–33.
- Rapp PE, Cellucci CJ, Korslund KE, Watanabe TAA, Jiménez-Montaño MA. An effective normalization of complexity measurements for epoch length and sampling frequency. Physical Review. 2001;64E:016209-1–016209-9. [PubMed]
- Rapp PE, Cellucci CJ, Watanabe TAA, Albano AM. Quantitative characterization of the complexity of multichannel human EEGs. International Journal of Bifurcation and Chaos. 2005;15:1737–1744. doi: 10.1142/S0218127405012764. [Cross Ref]
- Barnard GA. Discussion on the spectral analysis of point processes by M. S. Bartlett. Journal of the Royal Statistical Society. 1963;25B:294.
- Hope ACA. A simplified Monte Carlo significance test procedure. Journal of the Royal Statistical Society. 1968;30B:582–598.
- Rössler OE. An equation for continuous chaos. Physics Letters. 1976;57A:397–398.
- Lambert JD. Computational Methods in Ordinary Differential Equations. New York, Wiley, NY; 1976.
- Lorenz EN. Deterministic non-periodic flow. Journal of Atmospheric Science. 1963;20:130–141. doi: 10.1175/1520-0469(1963)020<0130:DNF>2.0.CO;2. [Cross Ref]
- Sparrow CT. The Lorenz Equations. Berlin: Springer-Verlag; 1982.
- Hénon M. A two dimensional mapping with a strange attactor. Communications in Mathematical Physics. 1976;50:69–77. doi: 10.1007/BF01608556. [Cross Ref]
- Hitzl DH, Zele F. An exploration of the Hénon quadratic map. Physica D. 1985;14:305–326. doi: 10.1016/0167-2789(85)90092-2. [Cross Ref]
- Press WH, Flannery BP, Teukolsky SA, Vetterling WT. Numerical Recipes. The Art of Scientific Computing. Cambridge: Cambridge University Press; 1986.
- L'Ecuyer P. Efficient portable combined random number generators. Communicaitons of the ACM. 1988;31(6):742–750. doi: 10.1145/62959.62969. [Cross Ref]
- Bays C, Carter SD. Improving a poor random number generator. ACM Transactions on Mathematical Software. 1976;2(1):59–64. doi: 10.1145/355666.355670. [Cross Ref]

Articles from BMC Psychiatry are provided here courtesy of **BioMed Central**

PubMed Central Canada is a service of the Canadian Institutes of Health Research (CIHR) working in partnership with the National Research Council's national science library in cooperation with the National Center for Biotechnology Information at the U.S. National Library of Medicine(NCBI/NLM). It includes content provided to the PubMed Central International archive by participating publishers. |