Reconstruction of Virtual Neural Circuits in an Insect Brain

The reconstruction of large-scale nervous systems represents a major scientific and engineering challenge in current neuroscience research that needs to be resolved in order to understand the emergent properties of such systems. We focus on insect nervous systems because they represent a good compromise between architectural simplicity and the ability to generate a rich behavioral repertoire. In insects, several sensory maps have been reconstructed so far. We provide an overview over this work including our reconstruction of population activity in the primary olfactory network, the antennal lobe. Our reconstruction approach, that also provides functional connectivity data, will be refined and extended to allow the building of larger scale neural circuits up to entire insect brains, from sensory input to motor output.


INTRODUCTION
The brain is the most important information processing and control system in more highly developed animal organisms. Because of the complexity of such systems, individual studies have normally focused on specifi c brain regions. For instance, we have reconstructed the neural population activity in the antennal lobe of the silkmoth in response to odorant stimuli (Namiki and Kanzaki, 2008). An important point in this work has been that it is possible to integrate the data from different experiments. This makes it possible to gradually build a database representing a neural system to some extent. However, can we reasonably hope to understand how nervous systems work without considering them as entities that can only be dissociated with some compromises? Are not the non-neural constituents of an animal's body and the environmental factors it is exposed to be included in our analyses? To work toward such an integrative approach, we have focused on insects, which have simple nervous systems compared to mammals, yet rich behavioral repertoires. Here we describe basic techniques for the reconstruction of sensory maps and future directions toward the modeling of entire behaviorally relevant neural circuits and whole insect brains.

INSECT NERVOUS SYSTEM
Experimental studies using mammalian brains are a predominant line of research in modern neuroscience. However, numerous studies using simpler invertebrate systems have contributed much to the very foundations of neuroscience (Hawkins et al., 1983;Hodgkin and Huxley, 1952;Reichardt, 1957). Some of the key reasons for using insects in brain research are: Insect brains are convenient model systems to understand complex nervous systems in general. Although insects are unlikely to possess cognitive functions anywhere near those of mammals, they display rich behavioral repertoires comprising for example mating behavior, collision avoid-neurons can be merged across individuals (Bjaalie et al., 2005). Other cases, in which a close correspondence between individuals can even be carried further are the decapod stomatogastric nervous system and the nervous system of Caenorhabditis elegans. In both, the number of neurons and their synaptic connectivity are nearly constant across individuals (Marder and Bucher, 2007;White et al., 1986).
From these two examples, the importance of identifi able neurons in invertebrate systems is evident. Identifi able neurons are cells that can be uniquely recognized in each individual of a species, allowing the accumulation of physiological, morphological, pharmacological, and genetic information from different experiments. The concept of identifi able neurons has given a strong impetus to the research in insect brains in the past (Comer and Robertson, 2001) and gives such preparations an advantage over vertebrate systems, although some identifi able neurons are also known in fi sh, notably the pair of Mauthner cells that are command neurons involved in escape behavior (Eaton et al., 2001).

RECONSTRUCTION OF INSECT SENSORY NETWORK
Due to the availability of identifi able neurons and identifi able structures and its small size, the analysis based on compilation of the physiological and morphological data has been common in a traditional insect brain research. The success probability of in vivo intracellular recording is low and experimenters are not always able to record from the neurons of interests. If all recorded neurons are registered on the database, a comprehensive analysis is possible by analyzing the data obtained from different experiments performed by different experimenters. This procedure can be facilitated by data compilation, administration, and visualization operated on the same platform, utilizing neuroinformatics. For example, we have developed a neuron database for male silkmoth brain and approximately 1,200 physiological and/or morphological data have been registered over the last 10 years . The amount of the contents is the largest among databases which focus on a single animal species. The compiled data registered by 18 different experimenters have achieved several important results. For example, 153 antennal lobe local interneurons have been registered in the database and classifi ed into fi ve types (Seki and Kanzaki, 2008). This classifi cation did correspond to the computational classifi cation by fractal dimension calculated using the box counting method (Urata et al., 2006). Anatomical identifi cation and classifi cation have also been ance, goal-oriented behaviors, and sophisticated spatial navigation capabilities. Insects are the most successful animal group in evolution with the largest number of species. The adaptations that have evolved to many ecological niches are extremely valuable as specialized solutions and are also likely to be refl ected in neural hardware. Nevertheless, the basic properties of neurons constituting insect brains are similar to those of their mammalian counterparts. Both show similar electrical properties (e.g., action potentials) and employ similar rules governing synaptic plasticity (Cassenaer and Laurent, 2007). At circuit level, extensive similarities in sensory systems have been revealed (Hildebrand and Shepherd, 1997). Thus, the investigation of these relatively simple insect brains contributes to the understanding of nervous systems in general.
Many experiments in insect nervous systems are carried out in behaving preparations. The relation between experimental treatments and behavioral outputs has traditionally placed insect neuroscience close to biologically motivated control engineering, i.e., cybernetics. The key advantage is the possibility to infer meaning though behavioral performance on a routine basis. A hypothesis based on neurophysiological results can easily be tested using behavioral experiments, simulations, and reimplementation in robotics (Delcomyn, 2004;Lindemann et al., 2008;Ritzmann and Büschges, 2007;Webb, 2002). A factor that should also always be considered is the economic importance of some insect species in sectors such as agriculture and public health.
Generally, only a limited amount of data can be obtained from a single experiment for various reasons, that are technical in nature. For instance, only a limited number of cells may be recorded simultaneously or the experimental paradigm, such as most anatomical and molecular investigations, may only allow the observation of one temporal snapshot. Under these conditions, pooling data from different individuals will be unavoidable. Whether this is reasonably possible depends critically on the amount of individual variability in the structure of interest or at least on the feasibility to exclude individual variability suffi ciently from infl uencing the pooling process and thus the fi nal outcome at the desired level of observation. In the mammalian neocortex, a very good correspondence between individuals can be observed in the barrel fi eld of the primary somatosensory cortex of rodents, in which a stereotyped pattern of granular zones (barrels), each of them a single cortical column, represent defi ned whiskers on the snout. Using this map, physiological and morphological data of single

Reconstruction
In this review, we use the term "reconstruction" in a broad sense for building a virtual counterpart of a real biological system. There are multiple levels for reconstruction, including cellular, local network, and whole brain levels. Different models require different experimental parameters. To build a single cell model, for example, membrane properties and the three-dimensional structure of the neuron are often required. To build a network model, the properties of synapses among neurons are required.

Identifi able neurons
Neurons or groups of neurons which exist reproducibly among different individuals of the same species. They generally have the same physiological, anatomical, and genetic properties so that we can compare and integrate the experimental data from different individuals. This feature is one of the major driving forces to focus on neural information processing in an insect brain.

Neuron database
Database for neuroscience research. Neuroscientifi c data are registered, shared, and analyzed systematically. The database facilitates data mining, communication among researchers and thus increases research effi ciency. We create and maintain the database for neurons of silkmoth named Bombyx Neuron Database (BoND), a part of which is already available via the Internet. done in neuronal populations in the mushroom body, the center of learning and memory, and the lateral accessory lobe, the premotor network in the insect brain, based on 109 and 120 registered neurons, respectively ). These studies made use of the data obtained by different experimenters.
In previous work, we have collected single-cell recording data obtained from different experiments under the same experimental conditions (Namiki and Kanzaki, 2008). We have obtained recordings from 38 identifi ed projection neurons and covered 32 of the total number of 60 ± 2 glomeruli. We have subsequently merged these data with reference to an anatomical map (Kazawa et al., 2009) and reconstructed stimulusinduced population activity. The reconstruction approach has been utilized to analyze several sensory representations in insects and is particularly suitable when the structure of interest has clear anatomical landmarks. For example, the antennal lobe and the central body are composed of anatomically defi ned subunits facilitating reconstruction (Heinze and Homberg, 2007;Namiki and Kanzaki, 2008). In contrast, the reconstruction of seemingly relatively unstructured neuropils such as the lateral protocerebrum requires more involved image processing techniques (Jefferis et al., 2007;Tanaka et al., 2004;Troyer et al., 1994). For example, in the study of a mechanosensory representation in the terminal abdominal ganglion of crickets, the neuropil structures of interest are not defi ned by a clear anatomical delineation and maps have to be generated based on landmarks not related to the structure itself. This type of integration process for experimental data from different individuals to reconstruct a sensory map has fi rst been applied to the cricket cercal system. Crickets have a pair of appendages on the abdomen, the cerci, which bear sets of fi liform hairs with different preferences for wind direction and frequency. Primary sensory neurons of these hairs send axonal projections into the terminal abdominal ganglion. Notably, sensory neurons with similar response profi les have similar axonal projection patterns in the ganglion (Bacon and Murphey, 1984). The group digitized the neuronal morphology and pooled the data following a linear transformation with reference to the outer surface of each ganglion. Using these methods, it was possible to reveal the detailed topographic architecture of the system in which different types of information are processed in distinct subregions of the projection area of the fi liform hairs' mechanoreceptors Theunissen, 1996, 2000;Troyer et al., 1994). This case study has proven that landmarks not belonging to the structure under investigation can be employed to map data into a common geometry for pooling and reconstruction of a sensory representation.
The antennal lobe, the fi rst order olfactory processing center in insects, contains clearly anatomically segregated structures, called glomeruli. Each primary sensory neuron on the antennae expresses one of approximately 60 types of olfactory receptor proteins in the silkmoth. Notably, sensory neurons which express the same types of receptor proteins send axonal projections to the same glomeruli and make synapses with central neurons. As such, glomeruli are the functional units of olfactory processing (Vosshall and Stocker, 2007). Individual glomeruli have characteristic size, shape, and relative positions and are identifi able across different individuals (Rospars, 1983). Because of the constancy of glomerular organization, a digital atlas of the antennal lobe can be made (Galizia et al., 1999a;Kazawa et al., 2009). Utilizing such anatomical maps, for example, response profi les of sensory neurons have been reconstructed on the digital atlas in the fl y (Hallem and Carlson, 2006).
We have performed a reconstruction of odorevoked dynamics among projection neurons (Namiki and Kanzaki, 2008), which are the second order neurons in the insect olfactory system and functional equivalents of mitral/tufted cells in the mammalian brain. At fi rst, we have examined the morphological characteristics of this neuronal population and revealed that most of them innervated to only a single glomerulus. This indicates that by sampling this neuronal population, we are able to measure the output information of the antennal lobe with single glomerular resolution. Projection neurons innervating the same glomeruli show similar olfactory response profi les as shown in other insect species (Reisenman et al., 2005;Wilson et al., 2004). Due to this observation, the reconstruction approach, i.e., integrating data from different individuals to assemble a virtual neural circuit, is feasible in the moth antennal lobe. Utilizing the digital atlas of this system (Kazawa et al., 2009), we identifi ed the glomeruli innervated by stained projection neurons. By mapping the dynamics of fi ring rate onto the glomeruli, we reconstructed the olfactory representation based on a population of projection neurons (Figure 1). In the reconstructed map, odor-evoked fi ring rate changes are represented as color in each glomerulus. Temporal aspects of network dynamics in the virtual projection neuron population can be analyzed. For example, this population may discriminate given olfactory stimulations at each time (Figure 2). From the reconstructed map, it tion neurons (Laurent, 2002) can apparently only be studied on a per-trial basis using multi-unit recordings.
The variability may partially originate from the internal state of the network (Shu et al., 2003;Stopfer and Laurent, 1999). In such case, variability may be decreased by monitoring physiological parameters of the animal. For example, local fi eld potentials may help for the experimenter to quantify the state of the network. A classifi cation of the responses based on the state of the animal may enable us to perform more precise reconstructions of neural circuits.

TOWARD THE RECONSTRUCTION OF WHOLE INSECT BRAIN
Our goal lies in between two approaches: From the reconstruction of the sensory map in the antennal lobe and the analysis of its connectivity, we intend to proceed to model circuitry in the brain of the silkmoth that spans from the sensory input to the output of the brain. The ultimate goal will be the emulation of the complete silkmoth brain in software like blue brain project (Markram, 2006). The size of this nervous system is close to the size of a single neocortical column. The model can be evaluated by comparison of behavioral output with real insects by use of insect-robot hybrid systems (Emoto et al., 2007). The key advantages of the silkmoth for this endeavor are access to transgenic and physi-could be deduced that different odors elicited distinct dynamics and that the functional connectivity among glomeruli was independent of physical distance (Figure 3), suggesting distance independent lateral inhibition among glomeruli as shown in other species (Olsen et al., 2007;Reisenman et al., 2009). As such, we are able to analyze not only a temporal aspect of sensory representation but also the spatial organization with high resolution. Similar reconstruction approaches incorporating temporal information have been applied in other species as well (Krofczik et al., 2009;Staudacher et al., 2009).
The reconstruction method has several disadvantages. First, the experimental cost is high in comparison with optical imaging methods (Galizia et al., 1999b). Although signal-to-noise ratio of individual recordings is very high, a large number of experiments is required. This could be improved by automation techniques in future (Dunlop et al., 2008). Second, even if we use the same experimental conditions, response variability is present even among the same identifi able neurons in different samples. Individual variability leads to limitations in the temporal resolution at which meaningful information can be extracted. From our results, the fi ring rate is comparable between different neurons of the same glomerulus at a bin size of approximately 50-100 ms. Faster phenomena such as an odorevoked synchronization among different projec- Each node represents a glomerulus. Only strong connectivity is shown, blue and red lines represent positive (>0.5) and negative (less than −0.5) correlations, respectively. There are many functional connections among glomeruli in the superfi cial part of the antennal lobe. Although sampling was somewhat sparse, there is a tendency that strong functional connections are rare among deep glomeruli in response to the tested set of plant odors. been a long-standing diffi culty in any modeling of neural circuits. We employ the insect nervous system in which individual neurons are identifi able and comparable from one individual to another. It therefore becomes possible to integrate data from different experiments in a cumulative way with less conceptual problems. Capitalizing on this property, we will apply multiple techniques to probe synaptic connections including dual electrophysiological recording, optical synaptic probing and transsynaptic tracers. Complementary to this, connectivity for single-neuron data can be estimated through our mapped data base approach merging data in standard brain coordinates. We map the neurons into a standard brain (Brandt et al., 2005;Kurylas et al., 2008) to use this unifi ed structure as a basis to infer potential synaptic contacts (Jacobs and Theunissen, 2000;Stepanyants and Chklovskii, 2005;Tanaka et al., 2004). This will allow the use of realistic multi-compartment biophysical modeling of a large number of neurons in the order of the actual number of neurons in the silkmoth brain.

ACKNOWLEDGMENTS
This research was supported by a grant from a Grant-in-Aid for Scientifi c Research (B) from the Ministry of Education, Culture, Sports, Science and Technology. ological approaches and a well-defi ned behavior, pheromone orientation, whose neural substrates have been studied in detail . This organism is suitable for building a large-scale model due to its good accessibility to the electrophysiology of individual neurons and its nervous system is of the adequate scale to allow simulation of the entire system in real time using currently available supercomputer technology. In addition, neural circuits from sensory to motor neurons via higher order centers in the brain have been investigated in detail by single-cell electrophysiology. The reconstruction approach is well suited to primary sensory neuropils because the stimulus onset provides a clear time reference, but it gradually looses temporal resolution in higher order areas because response variability will increase. However, it is likely that reconstruction techniques as outlined above can be applied to motor systems in which motor output can serve as time reference. Motor areas of the silkmoth have been intensively investigated (Mishima and Kanzaki, 1999;Wada and Kanzaki, 2005) and now we are collecting single-cell recording data from the neurons connecting sensory and motor areas.
For the precise reconstruction of the brain, determining synaptic connectivity is a key problem. Due to the tangled structure of neurons and the huge number of contacts they make, this point has Standard brain A digital atlas of all structures in the brain. There are several methods to create a standard brain, they generally minimize the individual difference among samples. This is important for estimating synaptic connectivity from neuronal morphology data.