Event Abstract

Back to Event

Foveation with optimized receptive fields

Daniela Pamplona1*, Cornelius Weber1 and Jochen Triesch1
  • 1 Frankfurt Institute for Advanced Studies, Germany

The sensors of today's artificial vision systems often have millions of pixels. It is a challenge to process this information efficiently and fast. Humans effortlessly handle information from 10**7 photoreceptors, and manage to interact quickly with the environment.To this end, ganglion cells in the retina encode the photoreceptors' responses efficiently by exploiting redundancies in their responses, before sending the information to the visual cortex. Furthermore,primates' ganglion cells develop space-variant properties: their density becomes much higher in the fovea than in the periphery, and the shape and size of the receptive fields vary with the radial distance [1], i.e. primate vision is foveated.

Some artificial systems have tried to mimic such foveation to preprocess the visual input [2]. However, these works are based on the photoreceptors' properties instead of those of the ganglion cells, which leads to serious aliasing problems [3]. We propose that artificial systems should implement a model of ganglion cells processing.Our foveation method is formalized as the product between a matrix representing the receptive fields of the ganglion cells and the input image. We combine the information that the distribution of the ganglion cells follows approximately a log-polar law [4] and that the receptive fields have a Difference-of-Gaussian shape [5].

Therefore, each row of the foveation matrix represents a receptive field that depends only on 4 parameters (these are the heights and variances of the two Gaussians: their centres are fixed according to the log-polar density function). We optimize these parameters to reduce the reconstruction error of a generative model using a gradient descent rule (for details see supplementary PDF). We verify that our method converges fast to space variant receptive fields with smaller heigths and size in the fovea than periphery (see supplementary figure 1). We compare the size and shape of the resulting receptive fields with the measures in humans, and discuss about reconstruction optimality in the human early visual system. These results lend themselves to extrapolation to larger image sizes, thereby allowing the implementation of large-scale foveated vision with optimized parameters.

References

1. Shatz et al, 1986, Annual Review of Neuroscience, 9, 171-207

2. Weber et al, 2009, Recent Patents on Computer Science, 2, 1, 75-85

3. Wallace et al, 1994, International Journal of Computer Vision, 13, 1, 71-90

4. Rovano et al, 1979, Experimental Brain Research, 37, 3, 495-510

5. Borghuis et al, 2008, The Journal of Neuroscience, 28, 12, 3178-3189

Conference: Bernstein Conference on Computational Neuroscience, Frankfurt am Main, Germany, 30 Sep - 2 Oct, 2009.

Presentation Type: Poster Presentation

Topic: Abstracts

Citation: Pamplona D, Weber C and Triesch J (2009). Foveation with optimized receptive fields. Front. Comput. Neurosci. Conference Abstract: Bernstein Conference on Computational Neuroscience. doi: 10.3389/conf.neuro.10.2009.14.016

Copyright: The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers. They are made available through the Frontiers publishing platform as a service to conference organizers and presenters.

The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated.

Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed.

For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions.

Received: 25 Aug 2009; Published Online: 25 Aug 2009.

* Correspondence: Daniela Pamplona, Frankfurt Institute for Advanced Studies, Frankfurt, Germany, daniela.pamplona@inria.fr