Relationship between Self-Administered Cues and Rehabilitation Outcomes in Individuals with Aphasia: Understanding Individual Responsiveness to a Technology-Based Rehabilitation Program

Abstract

An advantage of rehabilitation administered on computers or tablets is that the tasks can be self-administered and the cueing required to complete the tasks can be monitored. Though there are many types of cueing, few studies have examined how participants’ response to rehabilitation is influenced by self-administered cueing, which is cueing that is always available but the individual decides when and which cue to administer. In this study, participants received a tablet-based rehabilitation where the tasks were selfpaced and remotely monitored by a clinician. The results of the effectiveness of this study were published previously (Des Roches et al., 2015). The current study looks at the effect of cues on accuracy and rehabilitation outcomes. Fifty-one individuals with aphasia completed a 10-week program using Constant Therapy on an iPad targeted at improving language and cognitive deficits. Three questions were examined. The first examined the effect of cues on accuracy collapsed across time. Results showed a trend where the greater the cue use, the lower the accuracy, although some participants showed the opposite effect. This analysis divided participants into profiles based on cue use and accuracy. The second question examined how each profile differed in percent cue use and on standardized measures at baseline. Results showed that the four profiles were significantly different in frequency of cues and scores on WAB-R, CLQT, BNT, and ASHA-FACS, indicating that participants with lower scores on the standardized tests used a higher percentage of cues, which were not beneficial, while participants with higher scores on the standardized tests used a lower frequency of cues, which were beneficial. The third question examined how the relationship between cues and accuracy was affected by the course of treatment. Results showed that both more and less severe participants showed a decrease in cue use and an increase in accuracy over time, though more severe participants continued to used a greater number of cues. It is possible that self-administered cues help some individuals to access information that is otherwise inaccessible, even if there is not an immediate effect. Ultimately, the results demonstrate the need for individually modifying the levels of assistance during rehabilitation. time, though more severe participants continued to used a greater number of cues. It is possible that self-administered cues help some individuals to access information that is otherwise inaccessible, even if there is not an immediate effect. Ultimately, the results demonstrate the need for individually modifying the levels of assistance during rehabilitation.

Introduction

Each year nearly 800,000 individuals suffer a stroke (Winstein et al., 2016) and roughly 1.3 million individuals suffer from brain injury (Corrigan et al., 2010). The language and cognitive deficits that result from these injuries can manifest as a chronic disability for these individuals and require long-term rehabilitation. Recent technological advances make tablet-based rehabilitation a feasible option for these individuals (Holland, 2014; Hoover and Carney, 2014; Kiran et al., 2014; Kurland, 2014; Kurland et al., 2014; Ramsberger and Messamer, 2014; Szabo and Dittelman, 2014; Des Roches et al., 2015; White et al., 2015; Lee and Cherney, 2016; Routhier et al., 2016; Zheng et al., 2016). However, despite significant advances in aphasia rehabilitation approaches, it is still difficult to predict and explain which individuals benefit from treatment and which individuals do not due to the vast differences in the way rehabilitation is provided to patients (Best and Nickels, 2000; Carlomagno et al., 2001; Lazar et al., 2008). Another important factor contributing to our lack of complete understanding of who benefits from treatment and who does not is the inherent heterogeneity of individual patients in terms of their profile (e.g., age, months post stroke, severity of language impairment, levels of motivation, etc.) that can impact performance (Goodglass et al., 1966; Hanson et al., 1989; Schwartz and Brecher, 2000; Hilari et al., 2003; Pedersen et al., 2003; Murray, 2012; Hachioui et al., 2014).

A third and equally important factor that might affect performance or improvement in rehabilitation is the level and type of cueing (or prompts) that an individual may require to complete a given task. Depending on the tools available to them, clinicians have to make a decision about what type of cueing to provide to their patients. The amount of assistance provided by the clinician, the level of independence and the structure that the cue types provide can range widely on a continuum, with most assistance to least assistance, as shown in the schematic in Figure 1. At the left end of the continuum is a hierarchical type of cueing, where the clinician sets up and administers a predetermined hierarchy of differing cues (i.e., phonemic cues, orthographic cues, etc.); there is minimal patient independence. Next on the continuum is clinician-administered type of cueing, where the clinician determines what cues to provide and when to provide them but also takes participant input. Next, self-administered cues are cues that are always available to participants (e.g., through a software program), but they need to determine what cues they would use and when to use them with or without clinician assistance. Almost to the far right of the continuum are self-generated types of cues, where participants are trained to generate cues for themselves that can be implemented independently. Finally, at the right end of the continuum is no cueing, which is when the participant can perform tasks independent of any cues.

FIGURE 1

These different cues have been examined in several studies in terms of their impact on treatment outcomes. Following Figure 1, hierarchical cueing structure has been well studied as a treatment method and has been shown to be effective (Wambaugh et al., 2001; Linebaugh et al., 2005; Cameron et al., 2006; Choe and Stanton, 2011; Conroy and Scowcroft, 2012). For example, Cameron et al. (2006) examined a treatment with five individuals with aphasia using a combined semantic and phonological cueing hierarchy applied to information units that were missing from story retelling and found that four of the five participants showed improvements on retrieval of trained items, while the remaining participant showed an improvement on another discourse measure. Next, several treatment studies involve clinician-administered cues, which have been also been found to be effective. One study examined semantic cueing as part of a naming therapy (Lowell et al., 1995), where cueing was structured and administered by a clinician with the help of a semantic feature analysis diagram. The authors found the therapy to be effective for two of three patients. Another study examined a clinician-administered cueing treatment which worked on cueing verbs to elicit sentence production, where verbs were presented along with six hierarchical levels of wh-cues (questions introduced by a wh-word such as who, where, why, etc.) that patients could progress through (Loverso et al., 1987). This type of verb-cueing was found to be effective. Self-administered cueing has previously been studied in several studies. One such study examined the effectiveness of a computer-delivered self-administered cueing program, MossTalk in either a clinician-guided or a partially self guided condition (Fink et al., 2002) and the authors found that both treatment conditions were effective. Another study examined the effectiveness of self-administered cues using MossTalk at home in four individuals, and found it to be effective for acquisition and maintenance of trained items (Ramsberger and Messamer, 2014). Yet another study examined the effectiveness of a computer-based therapy program, called Multicue, which allowed patients to select which cue(s) they wanted to use to help them name a picture (Doesborgh et al., 2004). The authors found that patients who used Multicue improved on confrontation naming but did not improve in other measures of verbal communication. Finally, one study examined the use of personalized, self-generated cues to work on naming in a single patient (Freed et al., 2004), which was based on several other studies examining personalized cueing for learning either word-symbol associations or dog breeds (as cited in Marshall and Freed, 2006). Freed et al. (2004) found improvements in naming in both the personalized cueing method and in a typical phonemic cueing method of treatment.

To summarize, the findings of these previous studies show that different types of cueing can be effective for improving word retrieval skills for different types of patients, but these gains are constrained by the individual severity of the patients. The current study focuses only on self-administered cues delivered through a software program. Self-administered cues provide an important insight into patients’ awareness of their inability to complete a language task independently. It can be surmised that there are several important internal steps involved when one self-administers cues. First, the individual needs to realize they do not know or cannot produce the correct answer and then recognize that they need help in order to produce the correct answer. Next, the individual self-administers the cue and finally uses the cue to help them produce the correct answer. However, the internal processing mechanisms of self-administered cues are not completely understood (see Tompkins et al., 2006 for a similar discussion) and begs systematic examination.

The current paper focuses on three aspects of self-administered cue use; the effect of cue use on performance, individual variability, and the effect of cue use over time on performance. A recent study (Cherney et al., 2014) examined individual patient variability and degree of cue use in a different context, cues for scripts (AphasiaScripts). Cherney et al. (2014) found no significant differences by severity, whether the cues were provided more or less frequently. However, there was a greater amount of change in the higher cueing condition than the lower cueing condition for more severe individuals with aphasia. Taken together with the studies discussed above, this study provides converging evidence that individuals with severe aphasia utilize cues differently than individuals with less severe aphasia, and this difference may also be impacted by the degree of cue use. Another study has examined the effect of cue use over time, in the context of a hierarchical cueing protocol (Boyle and Coelho, 1995). Results showed that when the clinician directed the hierarchical cues, the participant was able to internalize the structure of the cues and self-generate the cues over the course of the therapy, needing fewer cues later in therapy. This study hints at the potentially important influence that cues initiated by the individual may have in shaping the language behavior over the course of treatment.

Importantly, computer-delivered self-administered cues provide a unique yet untested opportunity to ascertain the benefit of self-administered cues as they can be systematically logged and analyzed. The present study, thus, examined the influence of such computer-delivered self-administered cues on improving language performance and how cue use changed as a function of treatment. In a previous study, 51 individuals with aphasia of varied severity profiles were studied while utilizing the Constant Therapy software application (Constant Therapy, Inc., Newton, MA, USA) over a 10 week treatment program (Des Roches et al., 2015), where a range of tasks were assigned to participants based on participants’ language and cognitive severity. Results from accuracy and latency in the treatment, as well as on standardized outcome measures, demonstrated that the treatment was effective. Many of the treatment tasks in Constant Therapy have a cue feature (described in greater detail below) allowing a closer examination of the way participants interact with self-administered cues and how utilization of cues may influence treatment outcome. Based on the evidence discussed from previous studies, it is not clear how cue use varies with individual patient severity, how cue use changes over time, or how both of these affect performance.

Therefore, the aim of the current study was to investigate the relationship between self-administered cues, participant severity and corresponding accuracy on the treatment tasks in these 51 participants. The following questions were examined in this study:

• 1

  (a) What is the relationship between accuracy and cue use for individual participants, and (b) are there certain profiles of cue use that are common across participants? It was predicted that most participants would demonstrate a relationship where increased cue use would result in higher accuracy as they use cues to aid their performance.

• 2

  What is the relationship between participants’ severity profiles and self-administered cue use? It was hypothesized that participants would show one of four possible outcomes: (1) cue use that is beneficial to their performance, (2) cue use that is not beneficial to their performance, (3) a lack of cue use but poor performance, or (4) a lack of cue use and good performance. It was expected that more and less severe participants would show different outcomes.

• 3

  How does self-administered cue use influence improvement in accuracy as a function of treatment? It was hypothesized that the more and less severe participants would show one of four possible outcomes: (1) cue use that is beneficial to their performance in the treatment, (2) cue use that is not beneficial to their performance in the treatment, (3) a lack of cue use but poor performance in the treatment, or (4) a lack of cue use and good performance in the treatment. It was again expected that more and less severe participants would show different outcomes.

Materials and Methods

Participants

Fifty-one individuals (20 female) were recruited and completed the 10 weeks treatment program described in the previous study (Des Roches et al., 2015). Written informed consent was obtained for all participants, in accordance with policies set forth by the Boston University Institutional Review Board. All participants suffered either a stroke or a traumatic brain injury, ranging in months post onset (MPO) from one to 359 months (M = 59.6, SD = 69.5). Participants ranged in age from 38 to 87 years (M = 64.2, SD = 10.7). Refer to Table 1 for all participants’ age and MPO.

Before beginning the treatment program, participants were administered the Revised – Western Aphasia Battery (WAB-R, Kertesz, 2007), which was used to determine the type and level of aphasia severity, the Cognitive Linguistic Quick Test (CLQT, Helm-Estabrooks, 2001), which was used to determine the relative contribution of cognitive deficits to language deficits, the Boston Naming Test (BNT, Goodglass et al., 1983), which was used to determine confrontation naming ability, the Pyramids and Palm Trees (PAPT, Howard and Patterson, 1992), which was used to test the participants’ semantic access, and the American Speech-Language Hearing Association-Functional Assessment of Communication Skills for Adults (ASHA-FACS, Frattali et al., 1995), which was used to determine the communication skills of the participants. Participants’ scores on the Aphasia Quotient (AQ) subtest from the WAB-R ranged from 11.5 to 99.9 (M = 68.9, SD = 26.6) and scores on the Composite Severity (CS) subtest from the CLQT ranged from 25 to 100% (M = 67.9, SD = 22.3). Participants’ scores on the BNT ranged from 0 to 98.3% (M = 47.7, SD = 37.4), scores on the PAPT ranged from 21.2 to 98.1% (M = 84.7, SD = 14.9), and scores on the Communication Independence (CI) mean score on the ASHA-FACS ranged from 3.2 to 6.98 out of 7 (M = 5.6, SD = 1.1) and the Qualitative Dimensions (QD) mean score ranged from 2.2 to 4.9 out of 5 (M = 3.8, SD = 0.8). Refer to Table 1 for all participants’ standardized test scores.

Stimuli

Thirty seven cognitive and linguistic treatment tasks, detailed in a Supplementary Table in the Des Roches et al. (2015) study, were implemented on an iPad using the Constant Therapy iOS platform. The tasks used a simple visual setup and similar methods of response were used across different tasks. For every task, instructions were provided in both a visual and auditory modality. Participants had the option of answering the item or skipping the item if they were unsure of the answer. Upon completion of each item, the application provided the correct answer and feedback on how the participants performed.

Twenty-eight tasks included buttons that revealed a cue to answering the item. There were three types of auditory cues; the first repeated the instructions for completing the task (Repeat Instructions which repeated the instructions for completing the task), the second was the target stimulus presented auditorily (Repeat Audio Stimulus) (e.g., repeating the audio stimulus which was often necessary to complete the task), and the third was presentation of a phonemic cue or of a word (Play Count) (e.g., repeating additional audio stimuli provided within the task), which differed depending on the task. Refer to Table 2 for a list of what self-administered cues were available by task. For example, in the Picture Spelling task participants were asked to determine the name of a picture and spell it from a bank of possible letters. In this particular task, all three types of cues were available to the participant (Figure 2): they can repeat the instructions (e.g., “Please spell out the word associated with the image below”); play the audio stimulus, which in this task, plays the name of the picture (e.g., fire); and play count, which plays the phonetic sound of the letters if pressed. Cues were self-administered so participants could use cues as often as they wanted. The software tracked every time a cue was utilized. It should be noted that these types of cues are typical in traditional speech-language therapy. While repetition of the stimulus upon request is often provided as a part of the treatment protocol, other types of cues mentioned above (e.g., initial phoneme, spoken word) have often been used in examinations of self-administered cues in treatment (Golper and Rau, 1983; Howard and Harding, 1998; Doesborgh et al., 2004; Tompkins et al., 2006).

FIGURE 2

Design and Procedures

The general design of the experiment is described in Kiran et al. (2014) and Des Roches et al. (2015). Briefly, participants’ language and cognitive profiles were assessed based on the standardized testing mentioned above. Each individual was then assigned several treatment tasks aimed at the targeted impairments indicated from the standardized assessments. Participants then practiced the assigned tasks during sessions in the clinic and at home for the 10 weeks treatment program, which was constantly monitored by clinicians to determine whether or not the participant’s schedule should be altered based on their performance. For example, if a participant were working on level three of Picture Spelling (which consists of seven or eight letter words) and achieved 97.5% accuracy one day and 99% accuracy on another day, the clinician would then change the level of difficulty for Picture Spelling to level four (which consists of eight or nine letter words). Therefore, real time monitoring and alteration of participants’ schedules resulted in an individualized treatment program for each participant that changed dynamically based on that participant’s performance over time [for more specific criteria, refer to Des Roches et al. (2015)]. The treatment design described in Des Roches et al. (2015) includes an experimental group and a control group, who were not different on their WAB-R AQ scores. The control group received 1 h of treatment once a week in the clinic, while the experimental group (N = 42) received the same clinic treatment but was also provided an iPad to take home and were encouraged to practice once each day for an hour. For the purposes of this study, these two groups are collapsed, as the effect of cue use on performance on the treatment tasks is not expected to differ based on the intensity of the treatment.

Data Analysis

The Constant Therapy software generated reports for each participant, which included averaged accuracy for every session and a total count of all cue use in each session, specific to each level of all treatment tasks the participant completed. Any treatment tasks that did not provide any cues or that lacked enough data (see Table 2) were excluded, as well as any sessions where participants completed fewer than three items of a certain task.

To examine the relationship between self-administered cue use and accuracy (the first question), a K-means cluster analysis was completed for each participant (collapsing across time). A sum of squared error scree plot and the “pamk” function within the “fpc” package (Hennig, 2014) in “R” was run to determine how many clusters were appropriate for this dataset. Then, the cluster analysis was run for each participant to determine more closely what profile of relationship each individual showed between self-administered cue use and accuracy (cluster profile). To answer the second question, frequency of self-administered cue use was calculated for each participant by dividing the number of sessions in which the participant used one or more cue(s) by the total number of sessions the participant completed. Then, frequency of self-administered cues was correlated with scores on standardized tests and to determine how self-administered cue use and standardized test scores differed by these cluster profile, a MANOVA was performed. The above analyses collapsed trials across time, the different tasks, and across different types of cues; thus, these analyses examined the overall relationship of how self-administered cue use affected performance. To answer the third question, regressions were run to examine how self-administered cue use and time (treatment) affected accuracy for all participants and by participant. All analyses were completed in Statistical Package for the Social Sciences (SPSS Inc., Chicago, IL), Statistica software (StataCorp, College Station, TX, USA), and the statistical software package “R” (R Foundation for Statistical Computing, Vienna, Austria; R Core Team, 2014).

Results

When examining the data collapsed over all participants and sessions, accuracy ranged from zero to 100% (M = 79.4, SD = 18.4) and total cue use ranged from zero to 199 cues (M = 8.6, SD = 18.9). Refer to Table 1 for all participants’ percent cue use. Refer to the Supplementary Tables 1 and 2 for details about the specific tasks that each participant completed.

To determine how many clusters would be appropriate for a K-means cluster analysis, a sum of squared error scree plot of all participants’ data showed that either four or five clusters should be applied. Thus, the “pamk” function within the “fpc” package (Hennig, 2014) in “R” was run, which determined that five clusters was appropriate for the cluster analysis. If the initial result from the cluster analysis included one or more clusters with only one case, those cases were considered outliers, were deleted from the analysis, and the cluster analysis was run again until all clusters contained more than one case.

Results from the cluster analyses indicated four different relationships or cluster profiles: (a) an increase in accuracy with greater self-administered cue use (upward, N = 13 participants), (b) a curvilinear trend with an initial increase in accuracy with greater self-administered cue use (curvilinear, initial upward, N = 9 participants), (c) a decrease in accuracy with greater self-administered cue use (downward, N = 11 participants), and (d) a curvilinear trend with an initial decrease in accuracy with greater self-administered cue use (curvilinear, initial downward, N = 14 participants) (see Figure 3 for an example of cue use and accuracy cluster centers for each profile). All but four participants fit into these cluster profiles; the four participants who did not fit used little to no cues.

FIGURE 3

Next, to examine the potential relationship between self-administered cue use and severity of impairment based on standardized measures, a bivariate correlation was run to see how frequency of self-administered cue use (see Table 1 for frequency of self-administered cue use by participant) correlated with pre-treatment scores on all of the standardized measures for all participants. Results showed that all measures negatively correlated with frequency of cue use where the greater the self-administered cue use, the lower the initial score on the standardized measure [WAB-R AQ: r(49) = -0.475, p < 0.01, CLQT CS: r(49) = -0.524, p < 0.001, BNT: r(49) = -0.517, p < 0.001, PAPT: r(48) = -0.500, p < 0.001, ASHA-FACS CI: r(44) = -0.641, p < 0.001, ASHA-FACS QD: r(44) = -0.603, p < 0.001]. All of these results survived a Bonferroni correction for multiple comparisons of p < 0.008.

To further examine this relationship and to determine whether the greater self-administered cue use in more severe participants was beneficial to their performance, a one-way MANOVA was performed. The MANOVA examined if cluster profile (independent variable) had an effect on the different dependent variables (average overall accuracy throughout the treatment, frequency of self-administered cue use, and standardized measure scores at pre-treatment testing) (refer to Figure 4 for the average scores of each dependent variable for each cluster profile). The MANOVA revealed that there was a significant difference in the dependent variables based on cluster profile, F(32,115.9) = 2.1, p = 0.003; Wilks’ Λ = 0.189, = 0.363. The main effect of cluster profile was significant for frequency of cue use [F(4,38) = 5.0, p = 0.002], WAB-R AQ scores [F(4,38) = 4.9, p = 0.003], CLQT CS scores [F(4,38) = 3.0, p = 0.03], BNT score [F(4,38) = 6.4, p < 0.001] and ASHA-FACS CI scores [F(4,38) = 4.8, p = 0.003], but not for average overall accuracy [F(4,38) = 1.3, p = 0.30], PAPT scores [F(4,38) = 1.4, p = 0.257], and ASHA-FACS QD scores [F(4,38) = 2.4, p = 0.06].

FIGURE 4

Post hoc Tukey honest significant difference (HSD) tests revealed differences between cluster profiles in several of the dependent measures. Frequency of cue use was significantly different across the cluster profiles; downward cluster profile participants (Figure 3C) use a significantly higher frequency of cues than participants in the upward cluster profile (Figure 3A, p = 0.01) and the little to no cue use profile (p = 0.04) and the curvilinear with initial upward trend cluster profile participants (Figure 3B) use a significantly higher frequency of cues (p = 0.03) than participants in the upward cluster profile. These results suggest that participants who used cues most frequently were also the ones that did not benefit from these cues, since they fell into the downward cluster profile. Conversely, participants who used a lower frequency of cues were also the ones that did benefit from these cues, since they fell into the upward or little to no use cluster profiles. WAB-R AQ scores were significantly different across cluster profiles; downward cluster profile participants had significantly lower AQ scores than the participants in the upward cluster profile (p = 0.005), participants in the curvilinear with initial upward trend cluster profile participants (p = 0.04), and participants in the little to no cue use cluster profile (p = 0.04) indicating that the participants who were most severe were also the ones who did not seem to benefit from self-administered cueing, and yet they used the most cues. The Tukey HSD post hoc analysis for CLQT CS scores showed no significant differences between the specific cluster profiles. BNT scores were significantly different across cluster profiles; downward cluster profile participants had significantly lower BNT scores than the participants in the upward cluster profile (p < 0.001) and the curvilinear with initial upward trend cluster profile participants (p = 0.03). Also, the curvilinear with initial downward trend cluster profile participants (Figure 3D) had significantly lower BNT scores than the participants in the upward cluster profile (p = 0.04), again indicating that the participants who were most severe were also the ones who did not seem to benefit from self-administered cueing. ASHA-FACS CI scores were significantly different across cluster profiles; downward cluster profile participants had significantly lower CI scores than the participants in the upward cluster profile (p = 0.01) and the little to no cue use cluster profile (p = 0.05).

To examine the third question, which looked at the relationship between cues and accuracy as a function of treatment, a regression was run collapsing across all participants. However, since the MANOVA showed differences in the relationship between accuracy and cue use by severity, participants were separated into two groups based on their initial severity (see Table 1). A WAB-R AQ score of 75 was the median score of this group, so participants who scored below 75 were included in the more severe bin (25 participants), while participants who scored 75 or above on the AQ were included in the less severe bin (26 participants). The two participants who could not complete the WAB-R were considered to fall in the more severe group determined by their performance in the treatment program and the remaining test scores.

Because this analysis included different levels of difficulty within each task over time, accuracy for each participant was normalized for levels within each task that comprised multiple levels (i.e., Word Spelling has five levels of the task). Therefore, if a participant achieved a raw accuracy score of 100% on Word Spelling level 1, they would receive a normalized accuracy score of 20%, while a raw accuracy score of 100% on Word Spelling level 5, they would receive a normalized accuracy score of 100%. In order to do this, each level within a task was assigned a progression order value in accordance with its difficulty. These values were used to calculate the normalized accuracy score for each session, using the following formula:

Next, a regression was completed for the data of all 51 participants, which included a categorical variable (severity bin of more and less severe based on the AQ score) and two continuous variables (total cues and time, the latter was based on the number of times a participant completed a particular task) with normalized accuracy as the dependent measure. For the purpose of this paper, only the three-way interaction will be discussed because the effect of interest is how severity influences the effect of cue use on accuracy over the course of treatment. The three way interaction was significant [β = -0.03, t(13658) = 2.8, p = 0.006] and explained a significant proportion of variance in normalized accuracy scores [R² = 0.02, F(7,13658) = 40.0, p < 0.01]. Results showed more severe participants used more cues than less severe participants, and while cue use decreased over time, the number of cues used per session was high (>50 cues) relative to the less severe participants as treatment sessions progressed. Additionally, these participants showed an increase in normalized accuracy over time (refer to panel A of Figure 5). The less severe participants (WAB-R AQ score above 75) showed heavy cue use initially, which decreased over time and participants eventually stopped using cues. Additionally, these participants show an increase in normalized accuracy over (refer to panel B of Figure 5). Once the dataset was graphed (see panels A and B of Figure 5), it was clear that the preponderance of sessions where participants used zero cues may have diluted the effects of using fewer cues vs. using many cues. To examine this issue, sessions with zero cues were excluded and the full regression was examined again. This time, the three-way interaction was not significant [β = -0.03, t(6033) = -0.48, p = 0.63, f² = 0.06], however, as can be seen in panels C and D in Figure 5, the above mentioned pattern was more apparent. Specifically, more severe participants used more cues than less severe participants over time, and the number of cues used per session was high (>50 cues) relative to the less severe participants as treatment sessions progressed. Less severe participants used many cues initially in treatment but reduced their cue use over time. Both groups showed an increase in normalized accuracy over time.

FIGURE 5

In addition to the group level analysis, individual participant analyses reflected similar trends using the data where zero cues were excluded. Two-way interactions (cue use and time on normalized accuracy) are reported for each participant in Table 3. Briefly, of the 51 participants, 14 (27.5%) showed a significant two-way interaction; four participants showed a positive interaction effect while ten participants showed a negative interaction effect. In general, participants who showed positive effects tended to be less severe and participants who showed negative effects tended to be more severe. Notably, even though only 14 participants showed a significant effect, all but one of the participants showed at least a small effect size based on Cohen’s f² (Cohen, 1988).

Discussion

There are several important observations in this study. First, a variety of self-administered cue cluster profiles were found across a 51 participant sample, thus, not all participants used cues the same way. Four cluster profiles of relationships between cue use and accuracy were found from the cluster analyses, (a) higher accuracy with greater cue use, (b) curvilinear with initial high accuracy with greater cue use, (c) lower accuracy with greater cue use, and (d) curvilinear with an initial lower accuracy with greater cue use, with some additional participants showing little to no cue use throughout the treatment. Importantly, participants who fit the two curvilinear cluster profiles may have a threshold or pivot point at which cues became useful or not (Figure 3).

Second, a correlation that examined the overall relationship between severity of impairment based on standardized tests and frequency of cue use showed that more severe participants had a higher frequency of cue use. MANOVAs confirmed these findings indicating that participants who had a higher frequency of cue use, which was associated with lower accuracy, were the more severe participants in this sample. Conversely, participants who had a lower frequency of cue use, which was associated with higher accuracy, were the less severe participants in this sample.

Third, with regards to treatment, it was hypothesized that there would be several possible outcomes when considering the relationship between cue use and accuracy as a function of treatment. First, both groups of participants showed improved normalized accuracy over time. Interestingly, more severe participants used more cues than less severe participants over time, and the number of cues used per session was higher compared to the less severe participants as treatment sessions progressed. Less severe participants used many cues initially in treatment but reduced their cue use over time. These effects remained even after the data was culled to eliminate sessions where participants used zero cues. Also, though the two-way interaction may not have shown a significant effect for the majority of the participants, the variables included, time and cues used, significantly predicted normalized accuracy for almost all participants to differing levels.

These complex but important findings confirm the individual variability in the levels of assistance that participants need in shaping their behavior over the course of treatment. Each of these results will be discussed in some detail below.

When examining the cluster profiles of the relationship between accuracy and cue use for individual participants, results showed a general trend where the greater the cue use, the lower the participant’s accuracy, although some participants showed trends of higher accuracy with increased cue use. When examining the relationship between participants’ severity and self-administered cue use by cluster profile, participants in the upward cluster profile, who showed higher accuracy when using a higher number of cues in a session, scored significantly higher on standardized tests and had a significantly lower frequency of cue use. Therefore, the less severe participants tended to use a lower frequency of cues, but when cues were used, accuracy was higher. Additionally, participants in the downward cluster profile, who showed lower accuracy when using a higher number of cues in a session, scored significantly lower on standardized tests and had a significantly higher frequency of cue use. Therefore, the more severe participants tended to use a higher frequency of cues, which can be expected. However, contrary to the hypothesis, this greater use of cues was not beneficial to accuracy. Participants in the curvilinear cluster profiles tended to fall between the upward and downward cluster profile participants on both frequency of cue use and severity measures. Participants who used little to no cues scored significantly higher on many of the standardized test scores than more severe participants, demonstrating that participants who were the least impaired did not use cues very frequently.

As discussed in the introduction, it can be surmised that there are several important internal steps involved when one self-administers cues: the individual first needs to realize they do not know or cannot produce the correct answer, recognize that they need help in order to produce the correct answer, then self-administer the cue, and use the cue to help them produce the correct answer. To frame the current results in this context, in the case of less severe individuals, it may be possible that these individuals understand that they need the cue, self-administer the cue, and are able to more efficiently utilize the information provided by the cue. In contrast, in the case of severe individuals, these individuals understand that they need the cue and they self-administer the cue, however, the cues do not necessarily help them retrieve the correct answer. More severe individuals may also be reliant on cues as a compensatory or habitual routine which likely does not facilitate success. While the current study sheds some light on the first three steps entailed in self-administering a cue (as evidenced by the number and frequency of cue use), more work needs to be done to understand the fourth step, in terms of why some patients produce the correct answer and others do not. Nonetheless, information about an individual’s severity profile might help clinicians tailor treatment initially to provide the adequate number of cues for an individual. Importantly, a more severe individual might not benefit from further cueing initially, but might benefit from continued self-administered cue use as treatment continues.

To summarize, results addressing the first two research questions showed that increased use of cues was not always beneficial, particularly, the more severe individuals used the most cues and also tended to not benefit from these cues. While these results provided a cross-sectional snapshot of the data, the third research question examined the effect of cue-use over the course of treatment. The significant three way interaction of cues, time, and severity on normalized accuracy showed that more severe participants used more cues than less severe participants over time, and the number of cues used per session was higher compared to the less severe participants as treatment sessions progressed. Less severe participants used many cues initially in treatment but reduced their cue use over time. Both groups of participants showed improved normalized accuracy over time. Individual participant analyses completed as a follow up supported the group result. This effect might provide insight into tailoring the amount of cues provided throughout treatment. For instance, a less severe individual might not be likely to use cues, but should be encouraged to, since the use of cues is beneficial to them. Further, as the treatment progressed, these individuals may have learned to successfully perform the task without any cues. Conversely, a more severe individual might be more likely to use a lot of cues, and even though using more cues may not have an immediate beneficial effect on performance, cue use does indeed appear to support progression throughout treatment.

With additional research, it may be possible to structure a self-administered cue program, where cues are restricted based on severity profiles but are progressively altered throughout the treatment. One study (Ramsberger and Messamer, 2014) has used such a strategy of altering available cues but they did not systematically examine whether it was effective in contrast to all cues being available at all times. Previous research has also examined the effect of systematically decreasing vs. increasing cues throughout treatment. Results have shown similar findings for both decreasing and increasing cues (Conroy et al., 2009), although one study showed an effect only for increasing cues and also found that patients who were more severe showed a greater overall gain in treatment than patients who were less severe (Abel et al., 2005). Therefore, additional research is required to understand whether or not tailoring the cues available according to individual’s performance could be an effective treatment approach.

There are several factors to consider when understanding the implications of these findings. First, all levels of all tasks were collapsed for some analyses, which might lessen the effect of the results; not all tasks within each participant showed the same relationship between cue use and accuracy. Additionally, all cue types were collapsed; it is possible that not all cues would show similar relationships between cue use and accuracy across participants or even across tasks. For example, the repeat instructions cue in the Picture Spelling task provides information about what is expected of them in the task (“Please spell out the word associated with the image below”), whereas the same cue in the Rhyming task provides information that is necessary to answering the question (“Does [the word associated with the image below, e.g., “cherry”] rhyme with merry?). This differential effect of cue type with task might explain more about the relationship between cue use and accuracy. However, due to the individualized manner in which the treatment was administered, this type of analysis is beyond the scope of this study. Future research would be required to understand how the task might affect cue use and the resulting accuracies.

Conclusion

To summarize, the results of the present study demonstrate that knowledge of an individual’s self-administered cue use is crucial for assessing and treating individuals with aphasia. It is possible that the use of self-administered cues helps some individuals to access information that is otherwise inaccessible. However, other individuals, who tended to be more severe, were not able to access the information with or without self-administered cues. Finally, as treatment progressed and accuracy increased, more severe participants used more cues than less severe participants over time, and the number of cues used per session was higher compared to the less severe participants as treatment sessions progressed. Less severe participants used many cues initially in treatment but reduced their cue use over time. Ultimately, the results demonstrate the need to monitor and individualize the levels of assistance available to individuals during rehabilitation.

References

• 1

  AbelS.SchultzA.RadermacherI.WillmesK.HuberW. (2005). Decreasing and increasing cues in naming therapy for Aphasia.Aphasiology19831–848. 10.1080/02687030500268902

  • CrossRef
  • Google Scholar

• 2

  BestW.NickelsL. (2000). From theory to therapy in Aphasia: where are we now and where to next?Neuropsychol. Rehabil.10231–247. 10.1080/096020100389147

  • CrossRef
  • Google Scholar

• 3

  BoyleM.CoelhoC. A. (1995). Application of semantic feature analysis as a treatment for aphasic dysnomia.Am. J. Speech Lang. Pathol.494–98. 10.1044/1058-0360.0404.94

  • CrossRef
  • Google Scholar

• 4

  CameronR. M.WambaughJ. L.WrightS. M.NesslerC. L. (2006). Effects of a combined semantic/phonologic cueing treatment on word retrieval in discourse.Aphasiology20269–285. 10.1080/02687030500473387

  • CrossRef
  • Google Scholar

• 5

  CarlomagnoS.PandolfiM.LabrunaL.ColomboA.RazzanoC. (2001). Recovery from moderate Aphasia in the first year poststroke: effect of type of therapy.Arch. Phys. Med. Rehabil.821073–1080. 10.1053/apmr.2001.25155

  • CrossRef
  • Google Scholar

• 6

  CherneyL. R.KayeR. C.van VuurenS. (2014). Acquisition and maintenance of scripts in aphasia: a comparison of two cuing conditions.Am. J. Speech Lang. Pathol.23S343–S360. 10.1044/2014_AJSLP-13-0097

  • CrossRef
  • Google Scholar

• 7

  ChoeY.StantonK. (2011). The effect of visual cues provided by computerised aphasia treatment.Aphasiology25983–997. 10.1080/02687038.2011.569893

  • CrossRef
  • Google Scholar

• 8

  CohenJ. (1988). Statistical Power Analysis for the Behavior Science.Abingdon: Routledge.

  • Google Scholar

• 9

  ConroyP.SageK.Lambon RalphM. A. (2009). The effects of decreasing and increasing cue therapy on improving naming speed and accuracy for verbs and nouns in Aphasia.Aphasiology23707–730. 10.1080/02687030802165574

  • CrossRef
  • Google Scholar

• 10

  ConroyP.ScowcroftJ. (2012). Decreasing cues for a dynamic list of noun and verb naming targets: a case-series aphasia therapy study.Neuropsychol. Rehabil.22295–318. 10.1080/09602011.2011.641434

  • CrossRef
  • Google Scholar

• 11

  CorriganJ. D.SelassieA. W.OrmanJ. A. (2010). The epidemiology of traumatic brain injury.J. Head Trauma Rehabil.2572–80. 10.1097/HTR.0b013e3181ccc8b4

  • CrossRef
  • Google Scholar

• 12

  Des RochesC. A.BalachandranI.AscensoE. M.TripodisY.KiranS. (2015). Effectiveness of an impairment-based individualized rehabilitation program using an iPad-based software platform.Front. Hum. Neurosci.8:1015. 10.3389/fnhum.2014.01015

  • CrossRef
  • Google Scholar

• 13

  DoesborghS.van de Sandt-KoendermanW. M. E.DippelD.van HarskampF.KoudstaalP.Visch-BrinkE. (2004). Cues on Request: the efficacy of multicue, a computer program for wordfinding therapy.Aphasiology18213–222. 10.1080/02687030344000580

  • CrossRef
  • Google Scholar

• 14

  FinkR. B.BrecherA.SchwartzM. F.RobeyR. R. (2002). A computer-implemented protocol for treatment of naming disorders: evaluation of clinician-guided and partially self-guided instruction.Aphasiology161061–1086. 10.1080/02687030244000400

  • CrossRef
  • Google Scholar

• 15

  FrattaliC. M.ThompsonC. K.HollandA. L.WohlC. B.FerketicM. M. (1995). American Speech-Language-Hearing Association Functional Assessment of Communication Skills for Adults.Rockville, MD: American Speech-Language-Hearing Association.

  • Google Scholar

• 16

  FreedD.CeleryK.MarshallR. (2004). CASE STUDY effectiveness of personalised and phonological cueing on long-term naming performance by Aphasic subjects: a clinical investigation.Aphasiology18743–757. 10.1080/02687030444000246

  • CrossRef
  • Google Scholar

• 17

  GolperL. A. C.RauM. T. (1983). “Systematic analysis of cuing strategies in aphasia: Taking your ‘cue’ from the patient,” inClinical AphasiologyVol. 13ed.BrookshireR. H. (Minneapolis, MN: BRK Publishers), 52–61.

  • Google Scholar

• 18

  GoodglassH.KaplanE.WeintraubS. (1983). The Revised Boston Naming Test.Philadelphia, PA: Lea & Febiger.

  • Google Scholar

• 19

  GoodglassH.KleinB.CareyP.JonesK. (1966). Specific semantic word categories in Aphasia.Cortex274–89. 10.1016/S0010-9452(66)80029-1

  • CrossRef
  • Google Scholar

• 20

  HachiouiH.Visch-BrinkE. G.LingsmaH. F.van de Sandt-KoendermanW. M. E.DippelD.KoudstaalP. J.et al (2014). Nonlinguistic cognitive impairment in poststroke Aphasia a prospective study.Neurorehabil. Neural Repair28273–281. 10.1177/1545968313508467

  • CrossRef
  • Google Scholar

• 21

  HansonW. R.MetterE. J.RiegeW. H. (1989). The course of chronic Aphasia.Aphasiology319–29. 10.1080/02687038908248973

  • CrossRef
  • Google Scholar

• 22

  Helm-EstabrooksN. (2001). Cognitive Linguistic Quick Test: Examiner’s Manual.San Antonio, TX: Psychological Corporation.

  • Google Scholar

• 23

  HennigC. (2014). Fpc: Flexible Procedures for Clustering. R Package Version 2.1-9. Available at: http://CRAN.R-project.org/package=fpc

  • Google Scholar

• 24

  HilariK.ByngS.LampingD. L.SmithS. C. (2003). Stroke and Aphasia quality of life scale-39 (SAQOL-39) evaluation of acceptability, reliability, and validity.Stroke341944–1950. 10.1161/01.STR.0000081987.46660.ED

  • CrossRef
  • Google Scholar

• 25

  HollandA. L. (2014). iRehab: incorporating iPads and other tablets in Aphasia treatment.Semin. Speech Lang.351–2. 10.1055/S-0033-1362994

  • CrossRef
  • Google Scholar

• 26

  HooverE.CarneyA. (2014). Integrating the iPad into an Intensive, comprehensive Aphasia program.Semin. Speech Lang.3525–37. 10.1055/s-0033-1362990

  • CrossRef
  • Google Scholar

• 27

  HowardD.HardingD. (1998). Self-cueing of word retrieval by a woman with Aphasia: why a letter board works.Aphasiology12399–420. 10.1080/02687039808249540

  • CrossRef
  • Google Scholar

• 28

  HowardD.PattersonK. E. (1992). The Pyramids and Palm Trees Test: A Test of Semantic Access from Words and Pictures.Bury St Edmunds: Thames Valley Test Company.

  • Google Scholar

• 29

  KerteszA. (2007). Western Aphasia Battery (Revised).San Antonio, TX: Psychological Corporation.

  • Google Scholar

• 30

  KiranS.Des RochesC. A.BalachandranI.AscensoE. M. (2014). Development of an impairment-based individualized treatment workflow using an iPad-based software platform.Semin. Speech Lang.35038–050. 10.1055/s-0033-1362995

  • CrossRef
  • Google Scholar

• 31

  KurlandJ. (2014). iRehab in Aphasia treatment.Semin. Speech Lang.353–4. 10.1055/s-0033-1362989

  • CrossRef
  • Google Scholar

• 32

  KurlandJ.WilkinsA. R.StokesP. (2014). iPractice: piloting the effectiveness of a tablet-based home practice program in Aphasia treatment.Semin. Speech Lang.3551–64. 10.1055/s-0033-1362991

  • CrossRef
  • Google Scholar

• 33

  LazarR. M.SpeizerA. E.FestaJ. R.KrakauerJ. W.MarshallR. S. (2008). Variability in language recovery after first-time stroke.J. Neurol. Neurosurg. Psychiatry79530–534. 10.1136/jnnp.2007.122457

  • CrossRef
  • Google Scholar

• 34

  LeeJ. B.CherneyL. R. (2016). Computer-based treatments for Aphasia: advancing clinical practice and research.Perspect. ASHA Special Interest Groups15–17. 10.1044/persp1.SIG2.5

  • CrossRef
  • Google Scholar

• 35

  LinebaughC. W.ShislerR. J.LehnerL. (2005). CAC classics: cueing hierarchies and word retrieval: a therapy program.Aphasiology1977–92. 10.1080/02687030444000363

  • CrossRef
  • Google Scholar

• 36

  LoversoF. L.PrescottT. E.SelingerM. (1987). Cueing verbs: a treatment strategy for Aphasic adults (CVT).J. Rehabil. Res. Dev.2547–60.

  • Google Scholar

• 37

  LowellS.BeesonP. M.HollandA. L. (1995). The efficacy of a semantic cueing procedure on naming performance of adults with Aphasia.Am. J. Speech Lang. Pathol.4109–114. 10.1016/j.jcomdis.2015.01.003

  • CrossRef
  • Google Scholar

• 38

  MarshallR. C.FreedD. B. (2006). The personalized cueing method: from the laboratory to the clinic.Am. J. Speech Lang. Pathol.15103. 10.1044/1058-0360(2006/011)

  • CrossRef
  • Google Scholar

• 39

  MurrayL. L. (2012). Attention and other cognitive deficits in Aphasia: presence and relation to language and communication measures.Am. J. Speech Lang. Pathol.21S51–S64. 10.1044/1058-0360(2012/11-0067)

  • CrossRef
  • Google Scholar

• 40

  PedersenP. M.VinterK.OlsenT. S. (2003). Aphasia after stroke: type, severity and prognosis. The copenhagen Aphasia study.Cerebrovasc. Dis.1735–43. 10.1159/000073896

  • CrossRef
  • Google Scholar

• 41

  R Core Team (2014). R: A Language and Environment for Statistical Computing.Vienna: R Foundation for Statistical Computing. Available at: http://www.R-project.org/

  • Google Scholar

• 42

  RamsbergerG.MessamerP. (2014). Best practices for incorporating non-aphasia-specific apps into therapy.Semin. Speech Lang.35017–024. 10.1055/s-0033-1362992

  • CrossRef
  • Google Scholar

• 43

  RouthierS.BierN.MacoirJ. (2016). Smart tablet for smart self-administered treatment of verb anomia: two single-case studies in Aphasia.Aphasiology30269–289. 10.1080/02687038.2014.973361

  • CrossRef
  • Google Scholar

• 44

  SchwartzM. F.BrecherA. (2000). A model-driven analysis of severity, response characteristics, and partial recovery in Aphasics’ picture naming.Brain Lang.7362–91. 10.1006/brln.2000.2310

  • CrossRef
  • Google Scholar

• 45

  SzaboG.DittelmanJ. (2014). Using mobile technology with individuals with aphasia: native ipad features and everyday apps.Semin. Speech Lang.355–16. 10.1055/s-0033-1362993

  • CrossRef
  • Google Scholar

• 46

  TompkinsC. A.ScharpV. L.MarshallR. C. (2006). Communicative value of self cues in Aphasia: a re-evaluation.Aphasiology20684–704. 10.1080/02687030500334076

  • CrossRef
  • Google Scholar

• 47

  WambaughJ. L.LinebaughC. W.DoyleP. J.MartinezA. L.Kalinyak-FliszarM.SpencerK. A. (2001). Effects of two cueing treatments on lexical retrieval in aphasic speakers with different levels of deficit.Aphasiology15933–950. 10.1080/02687040143000320

  • CrossRef
  • Google Scholar

• 48

  WhiteJ.JanssenH.JordanL.PollackM. (2015). Tablet technology during stroke recovery: a survivor’s perspective.Disabil. Rehabil.371186–1192. 10.3109/09638288.2014.958620

  • CrossRef
  • Google Scholar

• 49

  WinsteinC. J.SteinJ.ArenaR.BatesB.CherneyL. R.CramerS. C.et al (2016). Guidelines for adult stroke rehabilitation and recovery a guideline for healthcare professionals from the american heart association/american stroke association.Stroke47e98–e169. 10.1161/STR.0000000000000098

  • CrossRef
  • Google Scholar

• 50

  ZhengC.LynchL.TaylorN. (2016). Effect of computer therapy in aphasia: a systematic review.Aphasiology30211–244. 10.1080/02687038.2014.996521

  • CrossRef
  • Google Scholar