Abstract
Looking at a pair of objects is easy when automatic grouping mechanisms bind these objects together, but visual exploration can also be more flexible. It is possible to mentally “re-group” two objects that are not only separate but belong to different pairs of objects. “Re-grouping” is in conflict with automatic grouping, since it entails a separation of each item from the set it belongs to. This ability appears to be impaired in patients with schizophrenia. Here we check if this impairment is selective, which would suggest a dissociation between grouping and “re-grouping,” or if it impacts on usual, automatic grouping, which would call for a better understanding of the interactions between automatic grouping and “re-grouping.” Sixteen outpatients with schizophrenia and healthy controls had to identify two identical and contiguous target figures within a display of circles and squares alternating around a fixation point. Eye-tracking was used to check central fixation. The target pair could be located in the same or separate hemifields. Identical figures were grouped by a connector (grouped automatically) or not (to be re-grouped). Attention modulation of automatic grouping was tested by manipulating the proportion of connected and unconnected targets, thus prompting subjects to focalize on either connected or unconnected pairs. Both groups were sensitive to automatic grouping in most conditions, but patients were unusually slowed down for connected targets while focalizing on unconnected pairs. In addition, this unusual effect occurred only when targets were presented within the same hemifield. Patients and controls differed on this asymmetry between within- and across-hemifield presentation, suggesting that patients with schizophrenia do not re-group figures in the same way as controls do. We discuss possible implications on how “re-grouping” ties in with ongoing, automatic perception in healthy volunteers.
Introduction
We are able to explore and select information in the environment in a flexible way and usually do not experience any limits or difficulty when doing so. In a cluttered visual scene, we can mentally select and extract visual information and even relate objects that have nothing in common. This ability appears to be impaired in patients with schizophrenia, and may impact on how they adapt to the visual environment. It has been related to a more general difficulty at organizing information that is expressed at a clinical level (Silverstein and Keane, 2011). However, the mechanisms of these impairments are still debated, and especially the relative contribution of automatic grouping mechanisms vs. high-level, top-down mechanisms. Our aim is twofold. Understanding how patients with schizophrenia explore the visual environment should help us to understand the mechanisms underlying their difficulties when attempting to adapt to an ever changing environment. More generally it might contribute to objectify and better define the difficulties of patients at organizing information. Second, patients’ results lead to questions regarding the mechanisms of the mental selection of objects in healthy volunteers and how these mechanisms tie in with automatic grouping. This question is not fully resolved in healthy controls. For this reason we went back and forth from fundamental knowledge to clinically related issues. We explored the ability to mentally relate objects in healthy volunteers, and we use this same paradigm here in patients with schizophrenia. The results will be used to discuss first their significance for patients and second what they reveal about mental selection and visual organization in healthy volunteers.
There is already considerable knowledge regarding visual processing in healthy volunteers. Form processing is known to involve a number of steps, from the extraction of primitives (local orientation, color, luminance, etc.), to the integration of the form contour and surface filling-in that sub-tend object recognition (Boucart et al., ; Humphreys, ; Grossberg et al., ). The integration of contour information involves Gestalt rules like grouping by collinearity, proximity, similarity or common fate, and the use of segmentation cues in order to correctly separate object parts, objects from the background, and objects from one another (Boucart et al., ; Kovács, ; Beck and Palmer, ; Spillmann, 2006). Similar rules apply when considering the relationship between distinct objects, even though the pathways sub-tending the coding of relations between objects are distinct from those sub-tending the coding of the relations within objects (Humphreys, ; Davis, ). Grouping between individual items allows to identify global forms that emerge from the way local elements are organized (Kimchi, ; Kimchi et al., ). Information at the global and local levels are processed by specialized neural pathways, and structure the visual environment in a hierarchical manner (Delis et al., ; van Kleeck, 1989; Hübner and Volberg, ). A number of studies suggest that grouping mechanisms can occur automatically under conditions of inattention (Driver et al., ; Müller et al., 2010). It has been shown also, however, that attention can interact with grouping (Driver et al., ), and can be directed either toward the local or the global level (Robertson et al., 1993; Humphreys, ).
Here, we question what happens when attention is directed toward object pairs that are unrelated and do not form a global shape. We argue this question is not resolved by usual mechanisms of grouping, and we suspect it might be crucial to understand the impairments in patients with schizophrenia (van Assche and Giersch, 2011). We explore it by using a paradigm designed by Beck and Palmer (). Beck and Palmer (), see also Palmer and Beck (2007) built visual search tasks with a setting which can be considered as a simplified version of a visual scene. Squares and circles represent simple objects and are displayed on a horizontal row. Squares and circles alternate on the row, except for two shapes sharing the same form and displayed one beside the other (Figures 1A–C). The task of the subjects is to spot these two identical and adjacent shapes, which represent the targets, and to discriminate their form, i.e., to decide whether they are two circles or two squares. An additional manipulation allows us to evaluate the effect of grouping. The objects on the row are grouped by pairs on the basis of classical rules like proximity, or the presence of connectors linking the shapes. As a consequence of this grouping manipulation, the two identical shapes are either part of the same pair of related figures (i.e., grouped by proximity or connecters), or part of different pairs (i.e., unrelated). As can be expected, it is easier for subjects to find the targets if they are part of a pair of related shapes (i.e., grouped), than if they are unrelated and part of different pairs. This effect reflects the advantage provided by grouping. Interestingly, this advantage is modulated by contextual information, i.e., the percentage of related vs. unrelated targets within an experimental block. Beck and Palmer () used three experimental blocks, one with 75% unrelated and 25% related targets, one with equal proportions of unrelated and related targets, and one with 25% unrelated and 75% related targets. The advantage for related targets increases when related targets are the majority, and decreases when they are the minority. This modulation could not be explained by repetition effects, i.e., facilitated search for a target pair when it follows a trial with a pair in the same condition (e.g., related targets following related targets or unrelated targets following unrelated targets). Indeed, Beck and Palmer () observed probability effects for both repeated and non-repeated trials. The performance modulation rather reflects the prioritization of one type of pairs (related or unrelated) according to the contextual information provided by the frequency of these pairs within a given experimental block. On each trial subjects must process visual information in order to locate the related pairs, and then can direct their attention to the prioritized pairs. Since the prioritization relies on the estimation of a frequency across different trials and is not provided by information in a single trial, it can thus be considered as a top-down effect. This does not mean that subjects provide a conscious effort to prioritize related or unrelated pairs. When subjects are not informed about the proportion modulation and cannot report it after the tasks, the effect is nonetheless identical to the prioritization obtained when subjects are informed (data obtained in unpublished pilot studies). All in all the modulation is considered top-down because it results from a global and automatic probability estimation rather than from a local priming effect.
Figure 1
A top-down modulation of grouping does not imply that unrelated targets can be prioritized, and as a matter of fact, the possibility to prioritize unrelated targets is not straightforward. In the results of Beck and Palmer (
We will call “re-grouping” the ability to attend selectively to figures that are not only separate but also part of different sets of objects. We obtained some evidence of “re-grouping” by deriving new paradigms from the one elaborated by Beck and Palmer (
Figure 2

Example of the stimuli used with an arrangement of figures around a central fixation point. Subjects had to fixate the central point throughout the trials, and this was checked with continuous eye-tracking (Cambridge Research System, 50 Hz). Connecters were introduced to link elements in pairs. Consequently, the target pair could be either connected across-hemifields (A), connected within the same hemifield (B), unconnected across-hemifields (C), or unconnected within the same hemifield (D). There was always a diamond (
) on the horizontal meridian, which remained in the same location during a block of trials, either in the right or the left hemifield. Subjects were informed about the position of the diamond before the experimental block. The diamond ensured that (1) only two adjacent figures were identical, and (2) the target pair was located in equal proportion in the across-hemifield and within-hemifield conditions.
All in all, the results suggest that unrelated stimuli can be isolated and “re-grouped” efficiently, even if they belong to different objects groups. This mechanism bypasses object-centered attention and cannot be accounted for by global/local processing. Local and global information correspond to individual shapes and pairs of related figures, respectively, but the pairs of unrelated figures correspond to neither, and may require higher-level cognitive operations. A late mechanism would be dissociated from usual mechanisms of visual grouping and would rather involve attentional selection mechanisms. It should be noted that our data does not allow us to distinguish between a simultaneous selection of two stimuli and the possibility that each figure is attended to in turn very fast, i.e., that items are selected sequentially rather than simultaneously (Hogendoorn et al.,
Even if the mechanisms underlying this ability are clearly different to the ones underlying classical grouping, one might wonder whether they have comparable end-products.
We used the cost of across-hemifield presentation as a tool to contrast the impact of automatic grouping and “re-grouping.”
We observed that connecters between targets, or physical arrangement leading to automatic grouping, erased the cost of across-hemifield presentation (van Assche et al., 2012). The benefit provided by connecters is akin to what had been described in patients with parietal lesions, who display a difficulty to perceive stimuli in the contra-lesional hemifield (Driver,
The literature and our own results suggest that understanding the role of “re-grouping” and how it ties in with automatic grouping might be crucial in patients with schizophrenia. Conversely, the results in patients might shed light on this question. A number of studies has shown that patients with schizophrenia have a difficulty to organize visual information (review in Silverstein and Keane, 2011), and our own initial studies suggested a selective difficulty to “re-group” unconnected items (Giersch and Rhein,
The results to date were obtained in a memory task, however, and the competition between representations of related and unrelated figures might have been specific to this memory task. To test this possibility, we checked whether similar results could be obtained in a perception task.
In order to test the possibility of a competition between grouping and re-grouping in patients with schizophrenia, we used again figures arranged in a circle around a central fixation point, as already described. We chose this arrangement because it had been particularly efficient in showing the effect of a prioritization of unrelated figures in healthy subjects (van Assche et al., 2012). If patients are unable to re-group items, then we should see no effect of prioritization in patients, i.e., less variation in performance than in controls when the proportion of related and unrelated figures is manipulated. These results would then be similar to those observed in our first study (Giersch and Rhein,
In addition, we contrasted within- and across-hemifield presentations, and this was expected to further our understanding of the mechanisms at work, and especially to what extent automatic grouping and “re-grouping” are dissociated. Our previous work has shown that our configuration leads to a large RT cost in case of unconnected targets displayed across-hemifields. Interhemispheric transfer is believed to be impaired in patients (Schwartz et al., 1984; Mohr et al., 2008, but see David,
Materials and Methods
Participants
Sixteen outpatients responding to the DSM IV criteria for schizophrenia took part in this study. The diagnosis was based on a semi-structured interview (the Mini International Neuropsychiatric Interview) and established by a senior psychiatrist of the University Psychiatry Department. Symptoms were assessed by means of the Positive and Negative Syndrome Scale (PANSS, Kay et al.,
Table 1
| Patients (N = 16) mean ± SD | Controls (N = 15) mean ± SD | Group comparison | |
|---|---|---|---|
| Gender (M/F) | 12/4 | 11/4 | |
| Age | 31.8 ± 6 | 31.3 ± 6.3 | t(29) < 1, ns |
| Years of education | 12.5 ± 2.6 | 12.8 ± 1.9 | t(29) < 1, ns |
| Age at onset | 23.5 ± 4.8 | ||
| Disease duration | 8.5 ± 5.5 | ||
| Mean number of hospitalizations | 1.7 ± 1.7 | ||
| Medication (typical/atypical/+antiparkinsonian/no medication) | 3/11/1/1 | ||
| Dose of medication in chlorpromazine equivalent | 259 ± 164 | ||
| PANSS total | 76.2 ± 21 | ||
| PANSS positive sub-scale | 17.4 ± 4.9 | ||
| PANSS negative sub-scale | 20.3 ± 6.4 | ||
| PANSS general sub-scale | 38.4 ± 12.2 |
Demographic and clinical data of the participants.
Subjects had normal or corrected-to-normal visual acuity, and were right-handed according to the Edinburgh inventory (Oldfield, 1971). They had no history of neurological disorder, generalized anesthesia within the past 3 months, drug abuse or benzodiazepines medication. All participants gave written informed consent prior the beginning of the study, consistently with the recommendations of the Declaration of Helsinki. This project was approved by the local ethics committee.
Stimuli
Each display contained six figures (0.5° × 0.5° of visual angle each). Circles and squares were positioned along a virtual circle (diameter = 6.8°) centered on a central fixation point. Circles and squares were displayed in spatial alternation except for two figures, the target pair, which were identical, and a single diamond. Unlike the circles and squares, the diamond was always in the same location on the horizontal meridian during a block of trials, either in the right or the left hemifield. Subjects were informed about the position of the diamond before the experimental block. This display configuration, and especially the diamond, ensured that (1) only two adjacent figures were identical, and (2) the target pair was located in equal proportion in the across-hemifield and within-hemifield conditions. There were two possible target locations for the across-hemifield location, and two possible target locations for the within-hemifield location, one above and one below the fixation point.
Three solid connectors linked figures by pairs (Figure 2). The targets could thus be within the same perceptual group (connected targets) or between two perceptual groups (unconnected targets). In each connected and unconnected condition, targets were displayed equally often in the same hemifield or across different hemifields.
Procedure
Subjects were instructed that they had to look for two target shapes that were identical and displayed one beside the other. Their task was to identify whether the two targets were two circles or two squares and to answer by pressing on a right (two circles) or left (two squares) response key, respectively. The onset of the display activated the computer clock, which was stopped when the subject pressed a key. Subjects were shown several examples on paper to illustrate the different target locations, and to ensure that they did not ignore unrelated targets. The distinction between related and unrelated targets was not made explicit, however.
Subjects were further told to continuously gaze at the central fixation point throughout the experiment. This ensured that our targets were effectively displayed in the same or different hemifields, and thus processed in the same or in different brain hemispheres, respectively. In addition, central fixation impeded subjects from visually sweeping across the stimulus, forcing them to covertly attend to the figures pairs instead (Moore et al., 2003; Herrington and Assad,
Eye-tracker
Eye position was recorded throughout the experiment to check constant fixation of the central point (ASL monocular infrared eye-tracker; sampling rate: 50 Hz).
Experimental design
The experiment was part of a protocol in fMRI; here we focus on two experimental blocks realized inside the scanner and designed to bias subjects toward connected or unconnected targets. For the sake of simplicity we do not present the results of the experimental blocks used to measure brain activation as a function of the target type. In each of the two blocks analyzed here, the proportion of the target types was manipulated. One block biased subjects toward unconnected targets (75% unconnected +25% connected targets) whereas the other block biased subjects toward connected targets (75% connected +25% unconnected targets).
All subjects were first trained extensively outside the scanner to ensure that they would be able to fixate the central fixation point throughout the scanner session, and thus that they would search for the targets covertly and not overtly. Our main aim was to examine the impact of the bias toward unconnected targets, and all subjects started with the experimental block with a majority of unconnected targets. The sequence of the two experimental blocks was repeated twice in the same order. The first and second run were identical, except that the location of the diamond differed (in the right vs. left hemifield, the order of the two runs being randomized across participants). Subjects were not told about the manipulation of the proportion of each target type. We checked the impact of the instructions in a preliminary experiment in healthy volunteers, and showed that performance was identical when subjects were told or not about the proportion manipulation. We preferred not to give information about the manipulation in order to avoid a possible difference in the use of this knowledge between groups. As emphasized above, it should be noted that subjects are unable to report the manipulation when asked at the end of the experiment, suggesting that the prioritization does not require a conscious effort. After the fMRI setup up, instructions were displayed on the screen, followed by an eye-tracking calibration. The validity of this calibration was checked before the beginning of the second run. Each trial began with the presentation of a central fixation point for 500 ms. The six figures appeared around this fixation point for 5000 ms, with only two adjacent figures being identical and representing the targets. Inter-trial duration was 500 ms. There were a total of 224 trials. Here we will report only the behavioral data.
Behavioral data analysis
Median RTs were derived from individual performance. ANOVAs were conducted on RTs and error rates. Trials with error were removed from RTs analysis.
Within-subject factors were the target type (connected vs. unconnected), hemifield presentation (across- vs. within-hemifield) and target type proportion (block with a bias toward unconnected vs. toward connected targets). The group (patients vs. controls) was the between-subjects factor. Data were pooled across the two runs (all interactions between runs – 1st vs. 2nd – and other factors – target type, hemifield presentation, target type proportion and groups: Fs < 1; there was no effect of right vs. left presentation).
Results
There was no main effect of group: patients were only slightly slower and less accurate than controls [by 155 ms, F(1, 29) = 1.030, p = 0.318, partial η2 = 0.034, and 3.3%, F(1, 29) = 2.364, p = 0.135, partial η2 = 0.075]. There was however a significant group × target type × target type proportion × hemifield presentation interaction on RTs [F(1, 29) = 4.459, p = 0.043, partial η2 = 0.133], and a target type × target type proportion × group interaction on percent errors [F(1, 29) = 8.555, p = 0.006, partial η2 = 0.228]. We first detail RTs (illustrated in Figure 3). We then estimate the cost of across-hemifield presentation and summarize data on error rates (Figure 4).
Figure 3

Mean RTs in the induction blocks, in patients (upper panel) and controls (lower panel; vertical bars: error bars). Results are illustrated according to the experimental blocks (with a bias toward unconnected vs. connected figures), type of target pair (unconnected vs. connected), and presentation of target pair (in the same or in different hemifields).
Figure 4

Mean percent errors in patients (upper panel) and controls (lower panel; vertical bars: error bars). Results are illustrated according to the experimental blocks (with a bias toward unconnected vs. connected figures), type of target pair (unconnected vs. connected), and presentation of target pair (in the same or in different hemifields).
Patients and controls differed when targets were in the same hemifield [target type × target type proportion × group interaction: F(1, 29) = 6.353, p = 0.017, partial η2 = 0.179]. The interaction between target type and target type proportion was significant in patients [F(1, 15) = 17.160, p = 0.0009, partial η2 = 0.533] but not in controls [F(1, 14) = 2.518, p = 0.135, partial η2 = 0.152]. Patients showed an unusual advantage for unconnected relative to connected targets in the block with a bias toward unconnected figures [by 224 ms, F(1, 15) = 5.376, p = 0.035, partial η2 = 0.264, Figure 3 rightward upper panel]. This was not the case in controls, who were equally fast for connected and unconnected targets in the block with a bias toward unconnected figures [F(1, 14) = 0.009, p = 0.926, partial η2 = 0.0006]. In contrast in the block with a bias toward connected targets, the advantage for connected over unconnected targets was significant in both patients [390 ms, F(1, 15) = 10.621, p = 0.005, partial η2 = 0.414] and controls [165 ms, F(1, 14) = 6.649, p = 0.022, partial η2 = 0.322; these effects do not differ significantly, F(1, 29) = 1.525, p = 0.227, partial η2 = 0.050]. To summarize, patients showed a significant advantage for unconnected over connected targets when the former were the majority, and vice versa. On the other hand, controls performed equally for both target types when unconnected targets were the majority, showing that despite the priority toward unconnected targets, they were still efficient in occasional trials with connected targets.
When targets were displayed in different hemifields, there was no interaction with group [target type × target type proportion × group interaction: F(1, 29) = 0.032, p = 0.859, partial η2 = 0.001]. Both patients and controls showed the typical advantage for connected over unconnected targets (controls: 184 ms [F(1, 14) = 22.168, p = 0.0003, partial η2 = 0.613], patients: 190 ms [F(1, 15) = 12.581, p = 0.003, partial η2 = 0.456]. This replicates results obtained with another sample of healthy subjects, and shows that connectors linking targets across-hemifields allows to facilitate the comparison of targets that are initially processed in different brain hemispheres (van Assche et al., 2012).
As a result of the performance differences in case of within- and across-hemifield presentation in patients, there was a significant interaction between target type (connected vs. unconnected), hemifield presentation (across- vs. within-hemifield), and target type proportion (with a bias toward unconnected vs. toward connected targets) in the patients’ group: F(1, 15) = 11.752, p = 0.004, partial η2 = 0.439. In controls, there was a global effect of hemifield presentation [with an advantage of 96 ms for within- vs. across-hemifield presentation, F(1, 14) = 5.453, p = 0.035, partial η2 = 0.280] but no interaction with other effects: especially, there was no interaction between target type, target type proportion, and hemifield presentation [F(1, 14) = 0.119, p = 0.734 partial η2 = 0.008].
It should be noted also that the difficulties displayed by patients with schizophrenia in case of a within-hemifield presentation make it difficult to estimate the cost of across-hemifield presentation. Patients with schizophrenia were rather faster in case of across-rather than within-hemifield presentation, by 72 ms, when all results are averaged. This effect was not significant [F(1, 15) = 1.409, p = 0.254, partial η2 = 0.086] but differed significantly from the opposite effect observed in controls [F(1, 29) = 5.097, p = 0.032, partial η2 = 0.149]. To evaluate the cost of across-hemifield presentation more closely, we additionally checked the effect of hemifield presentation for the two conditions yielding the fastest responses in patients when the targets were in the same hemifield. For connected targets in the block with a bias toward connected pairs, there was no significant effect in either group, and no interaction between group and hemifield presentation [F(1, 29) = 0.110, p = 0.732 partial η2 = 0.004]. For unconnected targets, there was a cost of across-hemifield presentation in both groups (209 ms in controls and 133 ms in patients with schizophrenia) and this cost did not differ across groups [F(1, 29) = 0.489, p = 0.490 partial η2 = 0.017]. No effect involving the hemifield presentation was found significant in the analysis on error rates.
In the analysis on error rates, we decomposed the already mentioned interaction target type × target type proportion × group [F(1, 29) = 8.555, p = 0.006, partial η2 = 0.228]. A significant interaction between target type and target type proportion was found in patients [F(1, 15) = 6.212, p = 0.025, partial η2 = 0.293]. Further decompositions did not yield significant effects however. Nor was there any significant effect in controls. The effect could thus be attributed to opposite trends of grouping across experimental blocks in patients (Figure 4). The graph suggests it is present mainly when targets are displayed within the same hemifield, but this is not supported by statistical analyses. The lack of randomization across blocks and the lack of significant effects after decomposition of the results mean these results should be taken with caution. They do not contradict the results on RTs, however.
Discussion
The results show that patients can re-group two items which belong to different perceptual groups when incited to do so. Patients improve performance for unconnected targets when those are more frequent, unlike in our previous studies (Giersch and Rhein,
It is as if controls have access to connected targets whatever the attention conditions. In contrast, re-grouping unconnected targets leads patients to temporarily lose the perceptual organization derived from automatic grouping. Several limitations should be discussed first, however.
There is one methodological limitation to this work related to the fact that all subjects started with a block driving them to prioritize unconnected figures. This was done for imaging reasons and prevented us from directly comparing performance variations across blocks. It is to be noted, however, that the opposite effects for connected and unconnected targets across blocks (in case of within-hemifield presentation in patients) cannot be explained by effects of order: for connected targets, performance improves from one block to the other, whereas the opposite is observed for unconnected targets. Most importantly, we base our analysis on performance differences observed within a single experimental block rather than across experimental blocks: the crucial result is the advantage for unconnected over connected targets, and this result was observed within one experimental block. Such an effect has never been observed in trained subjects, whatever the blocks order. Nor was it observed in controls in the present experiment. It can thus be reasonably estimated as being independent of this methodological limitation, especially as it replicates a similar result observed with a different paradigm (Giersch et al.,
It might also be questioned if the loss of perceptual organization observed in patients is specifically related to the need to re-group unconnected items, or whether it reflects a more general weakness in grouping by connectors.
The amplitude of the reversed advantage for unconnected targets in patients shows that the experiment is sensitive enough to reveal a general weakness in automatic grouping. Weakened automatic grouping should have reduced the performance advantage provided by the connecters across all experimental blocks. However, when patients did not prioritize unconnected pairs, they displayed a preserved benefit for connected over unconnected targets. In the present results, this advantage was rather larger in patients than in controls when the prioritization concerned connected pairs. In addition the advantage for connected pairs was preserved in case of across-hemifield presentation. In sum, weakened grouping by connectors appears to result from prior attention focus on unconnected pairs rather than a genuine impairment in automatic grouping, consistent with previous results (Giersch and Rhein,
Contrary to controls, however, patients showed significantly different effects in case of within- vs. across-hemifield presentation. Such an effect of hemifield presentation has not been observed in healthy subjects, neither in the present study, nor in our previous study (van Assche et al., 2012). Even when probability effects led to clear performance improvements for unconnected figures in healthy subjects (van Assche et al., 2012), this improvement was similar whatever the position of the targets (within- or across-hemifields). Importantly this coexisted with a high cost of across-hemifield presentation for unconnected figures, showing that the paradigm was sensitive to the cost of across-hemifield presentation. This pattern of results is in marked contrast with the results of patients in the present study. These results suggest that even if patients “re-group” information, they do not do it in the same way as healthy subjects do. The fact that patients “re-group” efficiently only in case of within-hemifield, and not across-hemifield presentation, might be explained by an involvement of the connectivity between hemispheres. This difference between patients and controls can hardly be explained by a difference in the cost of interhemispheric transfer. There was no evidence of a higher cost of across-hemifield presentation in patients than in controls, and the main difference between the two groups occurred in case of intra-hemifield presentation. The results rather suggest that controls mobilize lateralized mechanisms when prioritizing unconnected figures (Kosslyn,
Integrating grouping and “re-grouping”: Our proposal
We argue that the results observed in patients with schizophrenia shed light on the difficulties encountered when exploring the visual environment in a flexible way while maintaining a sensation of stability of the outer world. The results in patients emphasize the difficulty arising when relating unconnected items in the environment. Our results show that being able to re-group items is not enough to explore visual information in an optimal way, i.e., without loosing access to automatically grouped figures. First, the way re-grouping is performed matters. It is important that grouping and re-grouping are based on distinct mechanisms. Our previous study had already suggested that the two types of grouping are not only based on different pathways, but also lead to different outputs (van Assche et al., 2012). This then raises other questions, however: what is the output of re-grouping, and how prioritizing re-grouping coexists with easy access to automatically grouped items. If the outputs of grouping and re-grouping are distinct and accessed in parallel, there should be some innate priority given to automatic grouping. This way access to items issued from automatic grouping would be preserved even when the subject prioritizes re-grouped items. This might not be enough, however. Additional ties might be necessary between the two types of groupings. Even if “re-grouping” mainly involves high-level cognitive mechanisms, these mechanisms allow us to play with information that is continuously processed by our visual system. For example, when we mentally select two tangerines from different piles and thus mentally separate them from their piles, we still see these tangerines as belonging to their piles. When having compared the tangerines and made a choice, we need to know from which piles they are issued to take the chosen tangerines. It might thus be proposed that the “re-grouping” of items integrates the links these items have with connected objects. This would mean strong ties between re-grouped items and automatically grouped ones. The literature suggests the possibility of a more integrated representation. As emphasized above, several studies suggest the existence of specialized areas sub-tending the coding of spatial and conceptual relationships between objects (Kosslyn,
Such a representation goes beyond the hierarchical representations involving local and global information. As we have seen, there are pathways specialized in the processing of local and global information and both types of information are first processed through bottom-up, automatic mechanisms. In fact they can be considered as part of the automatic grouping processes. This is not the case for “re-grouping,” however. As already emphasized, “re-grouped” pairs correspond neither to local elements nor to global information. In contrast with local/global processing, the creation of a link between two shapes that belong to different groups thus primarily originates from attention mechanisms, and creating such links is costly. It might be considered as an extension of the coding of independent elements as described by Humphreys (
Limits and perspectives
Our proposal regarding how “re-grouping” is tied in with automatic grouping clearly requires confirmation. It remains also to be understood how a complex representation integrating outputs of “re-grouping” and automatic grouping fits in with hierarchical representations issued from local and global information. It might be possible that links issued from “re-grouping” represent an additional level of complexity that would be integrated with hierarchical representations through learning, thus leading to the building of the complex representations we propose here. This question is important in order to understand how “re-grouping” impacts on the exploration of visual scenes. It might be possible to study this question by checking to which amount the impairments described here in patients with schizophrenia are at the origin of their reduced span of exploration when spontaneously looking at visual objects or scenes (Gaebel et al.,
It will be especially of interest to understand how complex representations are used to guide visual exploration. It is known that eye movements are not only automatic responses to retinal inputs but are regulated by a process of target selection involving a variety of complex processes, including attention, perception, memory, and expectation (Henderson and Hollingworth,
Conclusion
Results in patients with schizophrenia and in healthy volunteers suggest that it is possible to mentally re-group items from different sets of objects. This re-grouping conflicts with usual grouping issued from automatic grouping, and requires a cognitive processing that differs from usual grouping and from local vs. global processing. The conflict between the two types of groupings is evidenced in patients with schizophrenia. Trained healthy volunteers, however, appear to process re-grouped objects while preserving easy access to automatically grouped objects. We propose that easy access to both types of grouping is enabled by the building of a complex representation integrating the relationships between “re-grouped” and grouped objects.
Statements
Acknowledgments
This research has been supported by INSERM, the University Hospital of Strasbourg, the Medicine Faculty of Strasbourg, and by a grant from Region Alsace, and a grant for hospital clinical research (PHRC 2004 no. 3456) to Anne Giersch and Daniel Gounot.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AlvarezG. A. (2011). Representing multiple objects as an ensemble enhances visual cognition. Trends Cogn. Sci. (Regul. Ed.)15, 122–131.10.1016/j.tics.2011.01.003
2
BeckD. M.PalmerS. E. (2002). Top-down influences on perceptual grouping. J. Exp. Psychol. Hum. Percept. Perform.28, 1071–1084.10.1037/0096-1523.28.5.1071
3
BoucartM.DelordS.GierschA. (1994). The computation of contour information in complex objects. Perception23, 399–409.10.1068/p230399
4
BoutsenL.HumphreysG. W. (2000). Axis-based grouping reduces visual extinction. Neuropsychologia38, 896–905.10.1016/S0028-3932(99)00127-X
5
BrooksJ. L.WongY.RobertsonL. C. (2005). Crossing the midline: reducing attentional deficits via interhemispheric interactions. Neuropsychologia43, 572–582.10.1016/j.neuropsychologia.2004.07.009
6
BullierJ. (2001). Integrated model of visual processing. Brain Res. Rev.36, 96–107.10.1016/S0165-0173(01)00085-6
7
CavanaghP.AlvarezG. A. (2005). Tracking multiple targets with multifocal attention. Trends Cogn. Sci. (Regul. Ed.)9, 349–354.10.1016/j.tics.2005.05.009
8
ChapmanJ. (1966). The early symptoms of schizophrenia. Br. J. Psychiatry112, 225–251.10.1192/bjp.112.484.225
9
DavidA. S. (1993). Callosal transfer in schizophrenia: too much or too little?J. Abnorm. Psychol.102, 573–579.10.1037/0021-843X.102.4.573
10
DavisG. (2001). Between-object binding and visual attention. Vis. Cogn.8, 411–430.10.1080/13506280143000205
11
DelerueC.BoucartM. (2012). The relationship between visual object exploration and action processing in schizophrenia. Cogn. Neuropsychiatry17, 334–350.10.1080/13546805.2011.646886
12
DelerueC.LaprévoteV.VerfaillieK.BoucartM. (2010). Gaze control during face exploration in schizophrenia. Neurosci. Lett.482, 245–249.10.1016/j.neulet.2010.07.048
13
DelisD. C.RobertsonL. C.EfronR. (1986). Hemispheric specialization of memory for visual hierarchical stimuli. Neuropsychologia24, 205–214.10.1016/0028-3932(86)90053-9
14
DriverJ. (1995). Object segmentation and visual neglect. Behav. Brain Res.71, 135–146.10.1016/0166-4328(95)00044-5
15
DriverJ.DavisG.RussellC.TurattoM.FreemanE. (2001). Segmentation, attention and phenomenal visual objects. Cognition80, 61–95.10.1016/S0010-0277(00)00151-7
16
DuncanJ. (1984). Selective attention and the organization of visual information. J. Exp. Psychol. Gen.113, 501–517.10.1037/0096-3445.113.4.501
17
EglyR.DriverJ.RafalR. D. (1994). Shifting visual attention between objects and locations: evidence from normal and parietal lesion subjects. J. Exp. Psychol. Gen.123, 161–177.10.1037/0096-3445.123.2.161
18
FenskeM. J.AminoffE.GronauN.BarM. (2006). Top-down facilitation of visual object recognition: object-based and context-based contributions. Prog. Brain Res.155, 3–21.10.1016/S0079-6123(06)55001-0
19
GaebelW.UlrichG.FrickK. (1987). Visuomotor performance of schizophrenic patients and normal controls in a picture viewing task. Biol. Psychiatry22, 1227–1237.10.1016/0006-3223(87)90030-8
20
GierschA.RheinV. (2008). Lack of flexibility in visual grouping in patients with schizophrenia. J. Abnorm. Psychol.117, 132–142.10.1037/0021-843X.117.1.132
21
GierschA.van AsscheM.HuronC.LuckD. (2011). Visuo-perceptual organization and working memory in patients with schizophrenia. Neuropsychologia49, 435–443.10.1016/j.neuropsychologia.2010.12.016
22
GilchristI. D.HumphreysG. W.RiddochM. J. (1996). Grouping and extinction: evidence for low-level modulation of visual selection. Cogn. Neuropsychol.13, 1223–1249.10.1080/026432996381737
23
GordonE.CoyleS.AndersonJ.HealeyP.CordaroJ.LatimerC.MearesR. (1992). Eye movement response to a facial stimulus schizophrenia. Biol. Psychiatry31, 626–629.10.1016/0006-3223(92)90251-T
24
GrossbergS.KuhlmannL.MingollaE. (2007). A neural model of 3D shape-from-texture multiple-scale filtering, boundary grouping, and surface filling-in. Vision Res.47, 634–672.10.1016/j.visres.2006.10.024
25
HendersonJ. M.HollingworthA. (2003). Global transsaccadic change blindness during scene perception. Psychol. Sci.14, 493–497.10.1111/1467-9280.02459
26
HerringtonT. M.AssadJ. A. (2010). Temporal sequence of attentional modulation in the lateral intraparietal area and middle temporal area during rapid covert shifts of attention. J. Neurosci.30, 3287–3296.10.1523/JNEUROSCI.6025-09.2010
27
HogendoornH.CarlsonT. A.VanRullenR.VerstratenF. A. J. (2010). Timing divided attention. Atten. Percept. Psychophys.72, 2059–2068.10.3758/APP.72.8.2059
28
HoppJ. J.FuchsA. F. (2004). The characteristics and neuronal substrate of saccadic eye movement plasticity. Prog. Neurobiol.72, 27–53.10.1016/j.pneurobio.2003.12.002
29
HuangT. R.GrossbergS. (2010). Cortical dynamics of contextually cued attentive visual learning and search: spatial and object evidence accumulation. Psychol. Rev.117, 1080–1112.10.1037/a0020664
30
HübnerR.VolbergG. (2005). The integration of object levels and their content: a theory of global/local processing and related hemispheric differences. J. Exp. Psychol. Hum. Percept. Perform.31, 520–541.10.1037/0096-1523.31.3.520
31
HumphreysG. W. (1998). Neural representation of objects in space: a dual coding account. Philos. Trans. R. Soc. Lond. B Biol. Sci.353, 1341–1351.10.1098/rstb.1998.0288
32
HumphreysG. W. (2003). Conscious visual representations built from multiple binding processes: evidence from neuropsychology. Prog. Brain Res.142, 243–255.10.1016/S0079-6123(03)42017-7
33
IwamotoY.KakuY. (2010). Saccade adaptation as a model of learning in voluntary movements. Exp. Brain Res.204, 145–162.10.1007/s00221-010-2314-3
34
KayS. R.FiszbeinA.OplerL. A. (1987). The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr. Bull.13, 261–276.
35
KimchiR. (2000). The perceptual organization of visual objects: a microgenetic analysis. Vision Res.40, 1333–1347.10.1016/S0042-6989(00)00027-4
36
KimchiR.HadadB.BehrmannM.PalmerS. E. (2005). Microgenesis and ontogenesis of perceptual organization: evidence from global and local processing of hierarchical patterns. Psychol. Sci.16, 282–290.10.1111/j.0956-7976.2005.01529.x
37
KojimaT.MatsushimaE.NakajimaK.ShiraishiH.AndoK.AndoH.ShimazonoY. (1990). Eye movements in acute, chronic, and remitted schizophrenics. Biol. Psychiatry27, 975–989.10.1016/0006-3223(90)90035-Z
38
KosslynS. M. (1987). Seeing and imagining in the cerebral hemispheres: a computational approach. Psychol. Rev.94, 148–175.10.1037/0033-295X.94.2.148
39
KovácsI. (1996). Gestalten of today: early processing of visual contours and surfaces. Behav. Brain Res.82, 1–11.10.1016/S0166-4328(97)81103-5
40
KrauzlisR. J. (2005). The control of voluntary eye movements: new perspectives. Neuroscientist11, 124–137.10.1177/1073858404271196
41
LoughlandC. M.WilliamsL. M.GordonE. (2002). Schizophrenia and affective disorder show different visual scanning behaviour for faces: a trait versus state-based distinction?Biol. Psychiatry52, 335–348.10.1016/S0006-3223(02)01356-2
42
MatsukuraM.VeceraS. (2006). The return of object-based attention: selection of multiple-region objects. Percept. Psychophys.68, 1163–1175.10.3758/BF03193718
43
MinassianA.GranholmE.VerneyS.PerryW. (2005). Visual scanning deficits in schizophrenia and their relationship to executive functioning impairment. Schizophr. Res.74, 69–79.10.1016/j.schres.2004.07.008
44
MohrB.PulvermüllerF.RockstrohB.EndrassT. (2008). Hemispheric cooperation-a crucial factor in schizophrenia? Neurophysiological evidence. Neuroimage41, 1102–1110.10.1016/j.neuroimage.2007.12.032
45
MooreT.ArmstrongK. M.FallahM. (2003). Visuomotor origins of covert spatial attention. Neuron40, 671–683.10.1016/S0896-6273(03)00716-5
46
MüllerD.WinklerI.RoeberU.SchafferS.CziglerI.SchrögerE. (2010). Visual object representations can be formed outside the focus of voluntary attention: evidence from event-related brain potentials. J. Cogn. Neurosci.22, 1179–1188.10.1162/jocn.2009.21271
47
ObayashiS.MatsushimaE.AndoH.AndoK.KojimaT. (2003). Exploratory eye movements during the Benton Visual Retention Test: characteristics of visual behavior in schizophrenia. Psychiatry Clin. Neurosci.57, 409–415.10.1046/j.1440-1819.2003.01140.x
48
OldfieldR. (1971). The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia9, 97–113.10.1016/0028-3932(71)90067-4
49
PalmerS. E.BeckD. M. (2007). The repetition discrimination task: an objective method for studying perceptual grouping. Percept. Psychophys.69, 68–78.10.3758/BF03194454
50
PavlovskayaM.SagiD.SorokerN.RingH. (1997). Visual extinction and cortical connectivity in human vision. Brain Res. Cogn. Brain Res.6, 159–162.10.1016/S0926-6410(97)00028-1
51
PélissonD.AlahyaneN.PanouillèresM.TiliketeC. (2010). Sensorimotor adaptation of saccadic eye movements. Neurosci. Biobehav. Rev.34, 1103–1120.10.1016/j.neubiorev.2009.12.010
52
PeyrinC.MichelC. M.SchwartzS.ThutG.SeghierM.LandisT.MarendazC.VuilleumierP. (2010). The neural substrates and timing of top-down processes during coarse-to-fine categorization of visual scenes: a combined fMRI and ERP study. J. Cogn. Neurosci.22, 2768–2780.10.1162/jocn.2010.21424
53
PhillipsM. L.DavidA. S. (1997). Visual scan paths are abnormal in deluded schizophrenics. Neuropsychologia35, 99–105.10.1016/S0028-3932(96)00061-9
54
PylyshynZ. W. (2001). Visual indexes, preconceptual objects, and situated vision. Cognition80, 127–158.10.1016/S0010-0277(00)00156-6
55
RobertsonL. C.EglyR.LambM. R.KerthL. (1993). Spatial attention and cuing to global and local levels of hierarchical structure. J. Exp. Psychol. Hum. Percept. Perform.19, 471–487.10.1037/0096-1523.19.3.471
56
SchollB. J.PylyshynZ. W.FeldmanJ. (2001). What is a visual object? Evidence from tracking merging in multiple object tracking. Cognition80, 159–177.10.1016/S0010-0277(00)00152-9
57
SchwartzB. D.WinsteadD. K.WalkerW. G. (1984). A corpus callosal deficit in sequential analysis by schizophrenics. Biol. Psychiatry19, 1667–1676.
58
SilversteinS. M.KeaneB. P. (2011). Perceptual organization impairment in schizophrenia and associated brain mechanisms: review of research from 2005 to 2010. Schizophr. Bull.37, 690–699.10.1093/schbul/sbr052
59
SpillmannL. (2006). From perceptive fields to Gestalt. Prog. Brain Res.155, 67–92.10.1016/S0079-6123(06)55005-8
60
StevensW. D.KahnI.WigG. S.SchacterD. L. (2012). Hemispheric asymmetry of visual scene processing in the human brain: evidence from repetition priming and intrinsic activity. Cereb. Cortex22, 1935–1949.10.1093/cercor/bhr273
61
SuganumaM.YokosawaK. (2006). Grouping and trajectory storage in multiple object tracking: impairments due to common item motions. Perception35, 483–495.10.1068/p5487
62
van AsscheM.GierschA. (2011). Visual organization processes in schizophrenia. Schizophr. Bull.37, 394–404.10.1093/schbul/sbp084
63
van AsscheM.GosP.GierschA. (2012). Does flexibility in perceptual organization compete with automatic grouping?J. Vision12, 6.
64
van der HamI. J. M.ZandvoortM. J. E.FrijnsC. J. M.KappelleL. J.PostmaA. (2011). Hemispheric differences in spatial relation processing in a scene perception task: a neuropsychological study. Neuropsychologia49, 999–1005.10.1016/j.neuropsychologia.2011.02.024
65
van KleeckM. H. (1989). Hemispheric differences in global versus local processing of hierarchical visual stimuli by normal subjects: new data and a meta-analysis of previous studies. Neuropsychologia27, 1165–1178.10.1016/0028-3932(89)90100-0
66
YantisS. (1992). Multielement visual tracking: attention and perceptual organization. Cogn. Psychol.24, 295–340.10.1016/0010-0285(92)90010-Y
Summary
Keywords
grouping, visual organization, schizophrenia, top-down grouping
Citation
Giersch A, van Assche M, Capa RL, Marrer C and Gounot D (2012) Patients with Schizophrenia Do Not Preserve Automatic Grouping When Mentally Re-Grouping Figures: Shedding Light on an Ignored Difficulty. Front. Psychology 3:274. doi: 10.3389/fpsyg.2012.00274
Received
15 April 2012
Accepted
17 July 2012
Published
17 August 2012
Volume
3 - 2012
Edited by
Snehlata Jaswal, Indian Institute of Technology, India
Reviewed by
Alexandra Bendixen, University of Leipzig, Germany; Wolfgang Tschacher, Universität Bern, Switzerland
Copyright
© 2012 Giersch, van Assche, Capa, Marrer and Gounot.
This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in other forums, provided the original authors and source are credited and subject to any copyright notices concerning any third-party graphics etc.
*Correspondence: Anne Giersch, INSERM U666, Department of Psychiatry I, Centre Hospitalier Régional de Strasbourg, Hôpital Civil, 1, pl de l’Hôpital, F-67091 Strasbourg Cedex, France. e-mail: giersch@unistra.fr
This article was submitted to Frontiers in Cognitive Science, a specialty of Frontiers in Psychology.
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.