Perceptual neuroscience has identified mechanisms of perceptual grouping which account for the ways in which visual sensitivity to ordered structure and regularities expresses itself, in behaviour and in the brain. The need to actively construct order, notably representations of objects in depth, is mandated as soon as visual signals reach the retina, given the occlusion of retinal signals by retinal veins and other retinal elements or blur. Multiple stages of neural processing transform fragmented signals into visual key representations of 3D scenes that can be used to control effective actions. Since our survival depends on our abilities to pick up order in the physical world, and since we conceive the physical world as an ordered one, our perception of it must somehow be sensitive to order. The articles from this collection illustrate how texture dissimilarity, boundary completion, surface filling-in, and figure-ground segregation generate perceptual order. Structural regularities are required for a visual texture to be discriminated from random noise by human observers, as shown in https://doi.org/10.3389/fpsyg.2015.00734 , where Katkov, Harris and Sagi compare the performance of human observers to those of an Ideal Observer and an Order Observer model. The Order Observer model, based on the capture of statistical regularities in textures, is shown to closely reflect the sensitivity of the human visual system. Spatiotemporal boundary formation is critical to the perception of shape boundaries and global motion https://doi.org/10.3389/fpsyg.2016.00910, as shown here by Erlikhman and Kellman, who demonstrate boundary integration from spatially and temporally sparse transformations of texture. The visual system uses positions and times of element transformations to extract local structural regularities such as edge fragments, which then connect by interpolation processes to produce larger shapes with a spatiotemporal integration constraint of ~80 ms between elements. Structural ambiguity and uncertainty pose a specific problem here. Perceptual grouping not only accounts for the ways in which physically defined order is processed by the visual system, but also how such order may be inferred in cases of uncertainty, and how this may give rise to the perception of "illusory" or “phantom” shapes. Roncato, Guidi, Parlangeli and Battaglini discuss a new phenomenon https://doi.org/10.3389/fpsyg.2016.00959 in which illusory streaks irradiate from the vertexes of angular contours, connecting pairs of figures and forming phantom net shapes that are only clearly visible in a specific figural context, as discussed here in the light of several theories of object contour detection. The real world conditions or configurative order to which perceptual grouping is sensitive also determine our aesthetic perception, as shown already elsewhere in a large body of previous work on aesthetic preferences for structural regularities. Here, Pinna, Porcheddu and Deiana https://doi.org/10.3389/fpsyg.2016.01051 discuss a novel variant of perceptual grouping called accentuation for perceptual coupling. New conditions for grouping that cannot be explained in terms of the classical Gestalt principles (similarity etc) are shown. This new work reveals the supremacy of dissimilarity as an important figural complement to similarity in the genesis of aesthetic structure, involving novel dynamics of perceptual grouping they call coupling. The visual system organizes incoming information early on and interprets a 2D image in terms of the real world, producing configurative order that provides perceptual continuity and enables object-based attention. In https://doi.org/10.3389/fpsyg.2015.02054 Grossberg reviews the Form-And-Color-And-DEpth (FACADE) model and its laminar cortical embodiment and extension by the 3D LAMINART models. These have explained, simulated, and predicted many perceptual and neurobiological data about how the visual cortex carries out 3D vision and figure-ground perception, and how these cortical mechanisms generate 3D percepts from 2D pictures of occluding and occluded objects. The models provide a unified explanation of neurophysiological data about cortical area V2 cells reported in a remarkable series of articles from the von der Heydt laboratory. Properties of border ownership, contrast preference, binocular stereoscopic information, selectivity to side-of-figure, Gestalt rules, strength of their modulation by attention and temporal properties are explained. The segregation of image parts into foreground and background requires border ownership assignment by the visual system and recordings from monkey visual cortex show that many neurons, especially in area V2, are selective to border ownership. These neurons are edge selective and have classical receptive fields (CRF). Their responses are modulated (enhanced or suppressed) depending on the location of a ‘figure’ relative to the edge in their receptive field. Each neuron has a fixed preference for location on one side or the other. This selectivity is derived from image context far beyond the CRF. In https://doi.org/10.3389/fpsyg.2015.01695 von der Heydt reviews evidence indicating that border ownership selectivity reflects the formation of early object representations, which he terms ‘proto-objects’. The evidence includes experiments showing (1) reversal of border ownership signals with change of perceived object structure, (2) border ownership specific enhancement of responses in object-based selective attention, (3) persistence of border ownership signals in accordance with continuity of object perception, and (4) remapping of border ownership signals across saccades and object movements. Grouping, persistence, and remapping are shown to be manifest in low-level visual areas, which challenges some of the traditional views and top-down-only models of perceptual grouping. To generate perceptual judgments relative to figure and ground, polarity-invariant and polarity-specific object properties are used by the visual brain. Dresp-Langley and Grossberg https://doi.org/10.3389/fpsyg.2016.01102 demonstrate conditions under which figure-ground is determined by the orientation of contrasts, not by their relative sign. Psychophysical data from human observers responding to structurally ambiguous, fragmented 2D shapes with varying local contrast signs reveal polarity-invariant perceptual grouping predicted by the earliest version of the FACADE theory and, more recently, by the 3D LAMINART models. Research into processes of perceptual grouping has important societal and technological aspects, for visual interface design and, in particular, image-guided surgery platforms and simulators. Such implications, brought forward here by Dresp-Langley in https://doi.org/10.3389/fpsyg.2015.01565 illustrate why boundary completion and figure-ground segregation are not only essential for realistic scene perception, but also for visually guided action planning and behaviour.
Editorial30 January 2017
Editorial: Perceptual Grouping—The State of The ArtORIGINAL RESEARCH
26 January 2016
The FACADE model, and its laminar cortical realization and extension in the 3D LAMINART model, have explained, simulated, and predicted many perceptual and neurobiological data about how the visual cortex carries out 3D vision and figure-ground perception, and how these cortical mechanisms enable 2D pictures to generate 3D percepts of occluding and occluded objects. In particular, these models have proposed how border ownership occurs, but have not yet explicitly explained the correlation between multiple properties of border ownership neurons in cortical area V2 that were reported in a remarkable series of neurophysiological experiments by von der Heydt and his colleagues; namely, border ownership, contrast preference, binocular stereoscopic information, selectivity for side-of-figure, Gestalt rules, and strength of attentional modulation, as well as the time course during which such properties arise. This article shows how, by combining 3D LAMINART properties that were discovered in two parallel streams of research, a unified explanation of these properties emerges. This explanation proposes, moreover, how these properties contribute to the generation of consciously seen 3D surfaces. The first research stream models how processes like 3D boundary grouping and surface filling-in interact in multiple stages within and between the V1 interblob – V2 interstripe – V4 cortical stream and the V1 blob – V2 thin stripe – V4 cortical stream, respectively. Of particular importance for understanding figure-ground separation is how these cortical interactions convert computationally complementary boundary and surface mechanisms into a consistent conscious percept, including the critical use of surface contour feedback signals from surface representations in V2 thin stripes to boundary representations in V2 interstripes. Remarkably, key figure-ground properties emerge from these feedback interactions. The second research stream shows how cells that compute absolute disparity in
A long history of studies of perception has shown that the visual system organizes the incoming information early on, interpreting the 2D image in terms of a 3D world and producing a structure that provides perceptual continuity and enables object-based attention. Recordings from monkey visual cortex show that many neurons, especially in area V2, are selective for border ownership. These neurons are edge selective and have ordinary classical receptive fields, but in addition their responses are modulated (enhanced or suppressed) depending on the location of a ‘figure’ relative to the edge in their receptive field. Each neuron has a fixed preference for location on one side or the other. This selectivity is derived from the image context far beyond the classical receptive field. This paper reviews evidence indicating that border ownership selectivity reflects the formation of early object representations (‘proto-objects’). The evidence includes experiments showing (1) reversal of border ownership signals with change of perceived object structure, (2) border ownership specific enhancement of responses in object-based selective attention, (3) persistence of border ownership signals in accordance with continuity of object perception, and (4) remapping of border ownership signals across saccades and object movements. Findings 1 and 2 can be explained by hypothetical grouping circuits that sum contour feature signals in search of objecthood, and, via recurrent projections, enhance the corresponding low-level feature signals. Findings 3 and 4 might be explained by assuming that the activity of grouping circuits persists and can be remapped. Grouping, persistence and remapping are fundamental operations of vision. Finding these operations manifest in low-level visual areas challenges traditional views of visual processing. New computational models need to be developed for a comprehensive understanding of the function of the visual cortex.


