Consciousness and the Invention of Morel
- 1Department of Psychiatry, Division of Neuropsychiatry, University Hospitals of Geneva, Geneva, Switzerland
- 2Department of Neuroscience, University of Geneva, Geneva, Switzerland
A scientific study of consciousness should take into consideration both objective and subjective measures of conscious experiences. To this date, very few studies have tried to integrate third-person data, or data about the neurophysiological correlates of conscious states, with first-person data, or data about subjective experience. Inspired by Morel's invention (Casares, 1940), a literary machine capable of reproducing sensory-dependent external reality, this article suggests that combination of virtual reality techniques and brain reading technologies, that is, decoding of conscious states by brain activity alone, can offer this integration. It is also proposed that the multimodal, simulating, and integrative capacities of the dreaming brain render it an “endogenous” Morel's machine, which can potentially be used in studying consciousness, but not always in a reliable way. Both the literary machine and dreaming could contribute to a better understanding of conscious states.
Introduction
The Science of Subjective Consciousness
Conscious states are inner states and processes of awareness, with undeniable neurobiological underpinnings (Searle, 2000). These states are by definition subjective; every scientific investigation of consciousness should deal with this subjectivity (Searle, 2000; Chalmers, 2004). In addition, most theories of consciousness assert that all conscious experiences have specific qualitative attributes that differentiate them from each other (qualitativeness), and a unified nature (unity), which cannot be reduced to independent components (Tononi, 2008).
It has been proposed that a science of consciousness should systematically integrate third-person data, or data about the neurophysiological correlates of conscious states, with first-person data, or data about the distinctive qualities of subjective experience (Chalmers, 2004). Indeed, neurophysiology alone is not sufficient to describe a conscious state without taking into account the first-person's point of view, and vice versa. Very few studies have tried to integrate both kinds of data together (Lutz et al., 2002; Dehaene et al., 2003). Moreover, while great progress has been done regarding our methods for gathering third-person data (e.g., neuroimaging methods or single-cell recording with electrode implantation), to this date there is no sufficient scientific description of subjective conscious experience, apart from verbal report. However, verbal report represents for the scientist only an indirect observation of a person's subjective experiences and is prone to certain limitations: language may misdescribe or may be unable to describe a subjective experience or the person may voluntarily hide or lie about his/her experience (Hospers, 1997, p. 93).
Therefore, the relatively new science of subjective consciousness is in urgent need of novel methods for gathering first-person data and, in parallel, of ways to integrate this data with their neurophysiological correlates. Here, we will see that such an integrative model of consciousness may find its inspiration from an unlikely source: literature.
Morel's Invention as Inspiration for an Integrative Description of Consciousness
Adolfo Bioy Casares (1914–1999) was an Argentinian author, who was born and lived in Buenos Aires. He is most famous for his early fantasy novel “The Invention of Morel,” which was first published in 1940 (Figure 1) and which blends elements of science fiction, romance, and philosophy. Most of the story describes a criminal's thoughts, fears, reactions, and puzzlement over discovering the inhabitants of an isolated island of the Pacific, on which he arrives as a fugitive. During the day, these persons act in a stereotyped manner, repeating the same behaviors and having the same discussions. During the night, they seem to disappear from the island. The protagonist, who is constantly afraid they will discover him and turn him in to the authorities, decides to approach a woman (Faustine), to whom he feels attracted. It turns out that this woman, as well as other inhabitants, totally ignore his presence. Other strange observations include the presence of two suns in the sky and the discovery of identical copies of dead fish he found on his day of arrival. Slowly he starts to question himself as to whether his perception is reliable and if he actually dreams or hallucinates (Casares, 1940, p. 44, 52). While the readers of this novel may also come up with all sort of theories about what is happening on the island, we finally find out the truth: Morel, who is the scientist on this island, invented a machine, which could capture and store “waves” and “vibrations” of all human senses (visual, auditory, olfactory, somatosensory, and gustatory). Images and frames of a human being could also be captured, recorded, and projected by motion picture and mirror technology (in the absence of relevant scientific evidence, Casares gives little rational explanation for a technique which would be later referred to as holography). When the sensory waves were synchronized with the images projected in space, the person and his surroundings in their totality were reproduced exactly as they were in their initial form. These projections had weight, depth, height, and appeared as real persons, engaging all five senses. The machine projected on to the whole island motion images, which had been recorded during the period of 1 week, and did this in a looping mode that would last forever. Thus, the protagonist learns that he is surrounded by reproduced three-dimensional images of persons who existed only in the past. After a short period of repulsion about this “fake reality,” the protagonist accepts its existence as something better than his own. The novel ends when the fugitive learns how to operate the machine and inserts himself into the recording so it looks as if he and Faustine are in love.
Figure 1. The first Spanish edition of “The Invention of Morel”, depicting the map of the island where the scientist Morel would have created and used his innovating machine. Copyright: Editorial Losada S. A., Buenos Aires, 1940, Cover by: Norah Borges.
In “The Invention of Morel,” Casares examines the fundamental philosophical problems of perception and consciousness. Influenced by George Berkeley's subjective idealism (Berkeley, 1713), a doctrine that supports the theory that only mind and mental experiences exist and that physical objects do not exist except as perceptual phenomena, the author questions whether reality is an exclusive creation of the mind and if human is able to perceive the world accurately through his senses. According to Casares, human perception will always be subjective; he symbolically represents this claim with a machine, which reproduced perceptual reality and modulated the subject's (fugitive) perceptual experience, emotions, and thoughts. For Morel, the ultimate use of his machine would be the “eternity of consciousness”: by repeating consecutively the moments of 1 day or 1 week, “we are powerless to escape from the consciousness we had in each one of those moments and we shall have no memories other than those we had in the corresponding moment of the eternal record. The future, left behind many times, will thus maintain its attributes forever” (Casares, 1940, p. 76).
The scientist considered that “we have no valid reason to deny consciousness to the persons created by his machinery” (Casares, 1940, p. 71). The protagonist of “Invention of Morel,” becoming aware of the forces that this machine can have, proposes that it should be enhanced with the capacity to describe the thoughts, emotions, and other brain states of a subject any distance away from him/her (Casares, 1940, p. 82). This enhanced machine would offer the ability to describe consciousness, as “one's thoughts and feelings during life will be like an alphabet with which the image will continue to comprehend all experience” (Casares, 1940, p. 82). Although Morel's machine was not such a brain reading machine, and Casares' idea may have seemed naive and totally fictive until some years ago, astonishing progress in several facets of cognitive neuroscience, functional neuroimaging, and computational neuroscience, now permit us to wonder if decoding perceptual reality and mental states from brain activity is possible.
So, according to Casares' novel, a “consciousness device” should satisfy two simultaneous conditions:
- Multimodal perception binding [“when all senses are synchronized, the soul emerges” (Casares, 1940, p. 71)]. This condition is in accordance with many philosophers and neuroscientists, who consider that consciousness is characterized by the apparent unity of perceptual experience despite multiple sense modalities (Llinas et al., 1998; Searle, 2000; Llinas, 2008). We will here see that virtual reality technologies can enhance or alter aspects of unity and subjectivity (e.g., self-processing, bodily self-consciousness) and thus inform us about these aspects of consciousness (Blanke, 2012; Tajadura-Jimenez et al., 2012).
- Brain reading of qualitative conscious experiences. Brain reading is now considered as a very promising novel approach to the study of specific conscious states (Weil and Rees, 2010). Apart from its utility in non-communicating subjects (e.g., locked-in patients), this method may be also capable of offering a more objective measure of conscious states than traditional fMRI or behavioral methods, by bypassing biases of the subject-examiner interaction (e.g., suggestibility).
The departure point of this article is to draw analogies between a literary device (Morel's invention) and current progress in virtual reality (chapter “Reinventing Morel's Machine I: Virtual Reality Component”) and brain reading (chapter “Reinventing Morel's Machine II: Brain Reading Component”). These technologies will be described briefly, and will be proposed as necessary and complementary tools to simultaneously gather first-person (virtual reality) and third-person (brain reading) data (chapter “Combining Virtual Reality and Brain Reading Technologies in Order to Describe Consciousness”). Bioy Casares proposes such an integrated model of consciousness, even if only in the form of philosophical idea and not of scientific expertise. Later in the article, we will wonder if the multimodal, simulating, and integrative capacities of the dreaming brain can reliably inform us about consciousness (chapter “The Dreaming Brain as an ‘Endogenous’ Morel's Machine and its Relation to Consciousness”). Both the literary and dreaming machines, and their integrative characteristics, could inspire cognitive scientists to create new experiments and similar combined (virtual reality/decoding) devices.
Reinventing Morel's Machine I: Virtual Reality Component
Although Morel's invention lacks scientific value per se, the idea was innovating. Current virtual reality technologies can create, modulate, and alter perceptual and physical reality, similarly to Morel's machine (Lenggenhager et al., 2007; Suzuki et al., 2012). Substitutional reality (SR) refers to reproducing, modulating, or substituting live reality without noticing the change. This is possible with the aid of virtual and mixed reality techniques (VR/MR), like a head-mounted display (HMD), a control computer, and a panoramic video camera (SR system) (Suzuki et al., 2012). The SR system can ensure natural visuo-motor coupling of real-time scenes and previously recorded scenes, so that participants wearing the HMD can experience both kind of scenes within a continuum, without noticing a reality gap. These experiences can be inconsistent, like for example encountering themselves (Doppelgänger scene). They can even experience identical episodes repeatedly (e.g., conversations, movements) in an eternal déjà-vu situation. Very interestingly, these experiences share an astonishing resemblance to Casares' world. Pre-recorded scenes by a panoramic camera have been used in both SR system and Morel's machine, making Casares' novel both prophetic and scientifically innovative, considering the year of its first publication (1940). Other methods used for SR are mixed reality (MR) system (Costanza et al., 2009) and diminished reality (DR) system (Herling and Broll, 2010), which allow interactions of a person with a fictive environment, using more than one sense in an integrative way. Other scientists, using virtual reality and multisensory conflict, succeeded in creating an illusion where healthy participants experienced a virtual body (avatar) as if it were their own (Lenggenhager et al., 2007). Furthermore, the participants said that the sensorimotor experiences of the avatars felt like their own. Importantly, most of the subjects using the aforementioned virtual technologies do not doubt their false perception (Lenggenhager et al., 2007; Slater, 2009; Suzuki et al., 2012), a reaction similar to the dreaming state (chapter “The Dreaming Brain as an ‘Endogenous’ Morel's Machine and its Relation to Consciousness”).
According to Damasio “consciousness occurs when we can generate, automatically, the sense that a given stimulus is being perceived in a personal perspective; the sense that the stimulus is ‘owned’ by the organism involved in the perceiving; and, last but not least, the sense that the organism can act on the stimulus (or fail to do so)” (Damasio, 1998). These criteria can be fulfilled in a virtual environment (Sanchez-Vives and Slater, 2005), where many aspects of subjective states (self-identification, interoceptive sensitivity, bodily, and emotional experiences) and self-perception (multisensory binding) can be controlled experimentally. More specifically, by manipulating several parameters, such as graphics frame-rate, sound, haptics, virtual body representation, and movement, we can modulate the qualitative and subjective attributes of a virtual experience. Inside such an environment, enhanced verbal reports (Witmer and Singer, 1998), or behavioral measures, such as the postural sway (Freeman et al., 2000) and the resolution of conflicting multi-sensory cues (Maravita et al., 2003), or physiological measures, such as the autonomic bodily responses (e.g., heart rate, skin conductance), can be used to measure subjective experiences (Insko, 2003). Therefore, and in accordance with others (Lenggenhager et al., 2007; Slater et al., 2010; Tajadura-Jimenez et al., 2012), I propose that virtual reality technologies or similar techniques (e.g., mirrors, illusions) can be useful in the description of first-person data. Their use may bring us a step closer to studying the question of qualia, that is, our subjective, conscious experience of things, which has specific properties and neural underpinnings (Llinas, 2002), and which has been largely neglected by experimental studies. As Antti Revonsuo stated, “The virtual reality-community has done a valuable service to consciousness research, because what they have come up with are terms that capture the realization of subjective phenomenal organization from the first-person's point of view” (Revonsuo, 1999, p. 92).
Reinventing Morel's Machine II: Brain Reading Component
By modulating subjective experiences, virtual reality can offer promising scientific investigation of the ontological subjectivity. However, an objective measure of this experience will be only possible by studying its neurophysiological correlates. This can be accurately achieved by brain reading. Brain reading refers to the decoding of perceptual or mental conscious states by brain activity alone. The modern methods of “brain reading” are essentially two: invasive techniques, which include electrode implantation in the brain (Kennedy and Bakay, 1998), and non-invasive techniques, which refer to conventional and multivariate neuroimaging approaches (Haynes and Rees, 2006). They permit decoding of mental states with high accuracy and reasonable temporal resolution. Multivariate pattern analysis (MVPA) is the most common technique used in brain reading studies (Weil and Rees, 2010).
In this article I will only briefly describe the most recent and important findings on brain reading of conscious states, as a more exhaustive analysis is not the objective of this article, and it has been already done elsewhere (Haynes and Rees, 2006; Tong and Pratte, 2012).
Decoding Perceptual Reality from Brain Activity
Morel's visual “waves and vibrations” would correspond to visual experiences reconstructed from brain activity (BOLD signals or EEG). Such a reconstruction was recently described by several groups (Kamitani and Tong, 2006; Kay et al., 2008; Miyawaki et al., 2008; Nishimoto et al., 2011). Tellingly, Miyawaki et al. reconstructed visual images from fMRI signals of the human visual cortex on a single trial basis. A large variety of images (2100 possible images) were accurately reconstructed without any prior information about the image. On the other hand, the Gallant group (Naselaris et al., 2009; Nishimoto et al., 2011) presented a motion-energy model of visual reconstruction. They described a Bayesian decoder using fMRI signals from early and anterior visual areas in order to reconstruct complex natural images. They extended this decoder so that it could model brain activity elicited by dynamic stimuli such as natural movies in the occipitotemporal visual cortex of human subjects (Figure 2). Based on these models, future studies could further improve reconstructed image quality by increasing the number of video images shown during the encoding and by integrating new knowledge about the neural representation of visual images.
Figure 2. On the left: visual experience from natural movies. On the right: reconstruction of these images by decoding brain activity. Adapted from movie S1 published in Current Biology, 21, Nishimoto, S., Vu, A. T., Naselaris, T., Benjamini, Y., Yu, B., and Gallant, J. L. “Reconstructing visual experiences from brain activity evoked by natural movies.” Supplementary Information. Copyright: Elsevier 2011. Figure approved by corresponding author Jack Gallant.
Reconstructing auditory attributes, like hearing spoken language was also described (Formisano et al., 2008; Raizada et al., 2010; Abrams et al., 2011). Most recently, Pasley et al. (2012) used intracranial recordings from the auditory cortex of patients while they listened to a sequence of different words. By recording the neural responses from the superior temporal gyrus using spectrogram and modulation-based auditory representations, they succeeded in accurately reconstructing syllable rate, syllable onsets, and offsets, and individual words, directly from brain activity.
Patterns of activity in the human posterior piriform cortex were found to predict accurately the perceptual ratings of odor quality (Howard et al., 2009). In the future, similar (pattern-based) techniques could be used to predict distinct olfactive experiences by recording odor-evoked response potentials from olfactory receptor neurons in response to distinct olfactory stimuli with an electro-olfactogram (Lapid and Hummel, 2013).
Decoding and Predicting Mental States from Brain Activity
Decoding mental imagery and memory
An important question that confronts current research in neuroscience is whether we can predict mental states, like emotions, memories, and thoughts based on the measurement of brain activity alone (a question that the protagonist of “The Invention of Morel” also had). Indeed, individual introspective mental events, like imagination of a face or a house, can be tracked from brain activity in highly specialized regions of the ventral visual pathway, like the fusiform face area or the parahippocampal place area (O'Craven and Kanwisher, 2000). Decoding of object representation (e.g., chairs, shoes, animals) from response patterns in object-selective regions of the temporal lobe is also possible due to pattern-based analysis or support vector machines (Haxby et al., 2001; Cox and Savoy, 2003). The orientation, direction of motion, and perceived color of a visual stimulus can also be predicted by decoding patterns of signals from the early visual cortex (Kamitani and Tong, 2005).
Recently, decoding long-term episodic memories while they are being recalled by the participants was also achieved. After training pattern classifiers to discriminate between certain categories (famous places, persons, or common objects), that were shown to participants under fMRI, a correct prediction of category was achieved upon subsequent retrievals (Polyn et al., 2005). A similar prediction of other complex episodic memories (e.g., movie recall or spatial memories) was also achieved by activity in the hippocampus (Chadwick et al., 2010; Morgan et al., 2011). Other fMRI studies decoded semantic memory (Naselaris et al., 2009) or predicted brain responses to novel nouns associated with verbs of known semantic attributes (e.g., see, hear, eat, or touch) (Mitchell et al., 2008).
Predicting emotional states and decision choices
Emotions such as happiness, sadness, fear, and anger activate networks of several cortical and subcortical brain regions such as insula, amygdala, hippocampus, thalamus, medial and lateral prefrontal cortex, orbitofrontal cortex, and anterior cingulate cortex (Phan et al., 2002). Could we accurately predict these emotional states only from brain activity (fMRI signals)? Strong responses in an extended limbic circuit (amygdala, insula, transverse temporal gyrus, temporal operculum, planum temporale, and inferior frontal gyrus) after an emotional stimulus (mother's voice) were found in the Minimally Conscious State (Bekinschtein et al., 2004). More recently, an online support vector machine was able to reliably predict and decode three discrete emotional states (happiness, disgust, and sadness) from brain activity while individuals performed emotion imagery (Sitaram et al., 2011). Involvement of the frontal cortex, anterior cingulate cortex, and insula in emotion imagery was also revealed. In another study, resting brain metabolism in the amygdala, the dorsal anterior cingulate cortex, and the ventromedial prefrontal cortex predicted responses during fear extinction and extinction recall (Linnman et al., 2012). Future experiments should address predictability of other emotional states too, as well as construction of subject-independent brain state classifiers, as the aforementioned studies require collection of initial data for classifier training.
Similarly, using classifier learning from a simple reward-based decision-making task and a multivariate analysis approach, an accurate prediction of subsequent behavioral choices was achieved (Hampton and O'Doherty, 2007). Activation of three regions of interest out of nine (anterior cingulate cortex, medial prefrontal cortex, and ventral striatum) was sufficient for the prediction. A similar study design for purchasing decisions has shown that activity of the nucleus accumbens and medial prefrontal cortex can correctly predict subsequent purchases (Knutson et al., 2007).
Combining Virtual Reality and Brain Reading Technologies in Order to Describe Conscious States
Bringing to mind Casares hypothesis, I propose here that virtual reality and brain reading can inform us conjointly about consciousness. Virtual reality will provide scientists with the ability to experimentally examine the component of subjectivity and unity of a subject's conscious state, whereas brain reading will provide us with the objective measure of the same state.
Theoretically, an on-line decoding “consciousness device,” could consist of a virtual environment system, easy to use for daily operation, such as the SR system [as described in Suzuki et al. (2012)] combined with an fMRI decoder, according to what conscious state we want to examine (e.g., visual experiences, mental imagery, emotional experience). By means of the SR system, the examiner could induce specific and targeted subjective conscious states in the subject and use the measures of subjective experience exposed previously (enhanced verbal report, behavioral, physiological measures) (see chapter “Reinventing Morel's Machine I: Virtual Reality Component”); the fMRI decoder could then provide an objective measure of this conscious state. Importantly, the subject can be informed about the objective measure of his/her experience (brain processes), what could further improve the reliability of his/her verbal reports (metacognitive properties). Future experiments could be based on this model, although improvement in temporal and spatial resolution of current neuroimaging techniques is certainly needed.
It should also be noted that, to this date, decoding information from several simultaneously occurring modalities (e.g., vision and attention, audition and memory) is not possible, as current methodologies cannot overcome the potential spatial and neurobiological superposition of these states. Therefore, improvement of statistical pattern recognition algorithms is required.
The Dreaming Brain as an “Endogenous” Morel's Machine and its Relation to Consciousness
Based on neuroscientific, philosophical, and artificial intelligence models, we have until now assumed that a better description and representation of consciousness should include multimodal binding and flexible access to subjectivity and to qualitativeness of conscious states. Virtual reality and brain reading could offer us such integration. A “consciousness” device being still inapplicable due to restrictions of current techniques, studying internal states with similar multimodal perceptual integration and simulation of subjective, qualitative experiences, such as dreaming, could further elucidate our understanding of conscious states. The question that is then posed is: can dreaming reliably inform us about consciousness?
Dreaming can Inform us About Consciousness
Studying dream states can potentially contribute to the investigation of some of the neurobiological, representational, and functional aspects of self-consciousness.
At first glance, the dreaming brain could be considered as an ideal “endogenous” Morel's machine. It integrates successfully (Hong et al., 2009) the sensorimotor plus cognitive and emotional modalities described previously in the article, into a subjective experience. The most prevalent sensory modality in dreams is vision (100%) and audition (40–60%), while movements and tactile sensations (15–30%) or smell and taste (less than 1%) are less frequent (Strauch et al., 1996). Thalamocortical signaling during sleep lowers the thresholds of associative areas so that they produce perceptual and cognitive experience, even in the absence of external sensory input. More specifically, activation of the visual association cortex and parieto-temporo-occipital (PTO) junction appear to be responsible for visual imagery and spatial cognition during dreaming (Braun et al., 1997; Nofzinger et al., 2002). Activation in auditory temporal cortices and motor circuits (including the cerebellum and basal ganglia) (Braun et al., 1997) is consistent with auditory elements and fictive motor actions respectively. Moreover, activation of motivational, memory, and emotional circuits (Perogamvros and Schwartz, 2012) may reflect active reward processing, memory consolidation, and emotion regulation processes during sleep. Interestingly, memory processing seems to initially precede and initiate visual imagery in dreaming (Ji and Wilson, 2007), in agreement with theories proposing that sleep-dependent memory-reward processing is responsible for dream generation (Freud, 1900; Solms, 2000; Wamsley and Stickgold, 2010; Perogamvros and Schwartz, 2012). We should note that the synchronous activity in the thalamocortical system, considered as the core of consciousness (Llinas and Ribary, 2001), is present in both wakefulness and sleep (Llinas and Ribary, 1993). Therefore, intrinsic activity in this system during dreaming could inform us about waking conscious states.
Dreams also share common features with virtual reality, as they are characterized by misinterpretation of the perceptual input (the dreamer considers the sensory stimuli as incoming), and by perceptual distortions, such as alterations in spatio-temporal integration, bizarreness, and out-of-body experiences (heautoscopy). Most of these features may relate to changes in regional brain activity and in functional connectivity between brain regions (Maquet et al., 2005; Massimini et al., 2010). The ability of the brain to accept a fictional reality it creates as an actual one (adhesion), and thus alter the state of its own perception, is related to activations of the left ventral inferior frontal gyrus and left posterior superior temporal sulcus (Metz-Lutz et al., 2010). Interestingly enough, both regions display increased activity during sleep compared to wakefulness (Braun et al., 1997; Dehaene-Lambertz et al., 2002; Kaufmann et al., 2006). Perceptual experience in dreams, contrary to waking experience, is a genuine representation of subjective idealism (see chapter “Morel's Invention as Inspiration of an Integrative Description of Consciousness”), because all sensory stimuli exist solely as perceptual brain products. Therefore, by studying perceptual and cognitive subjectivity as represented in dreams, dream research could contribute to the theoretical understanding of first-person data.
Finally, it has been proposed that off-line emotional maturation takes place during Rapid eye movement (REM) sleep since as early as the 13th week of gestation (Kurjak et al., 2005; Dondi et al., 2007) and that quiet sleep of human neonates contributes to the formation of cortical connections required for sensorimotor coordination and body representation (Milh et al., 2007). Overall, sleep seems necessary for the genesis of consciousness and self-awareness via the interaction of genetic instructions with off-line sleep-dependent perceptual experiences (Hobson, 2009; Perogamvros, 2012). In addition, dream consciousness seems important for the development and maintenance of waking consciousness and cognition, by contributing to sensorimotor integration, virtual reality simulation, and performance improvement in an off-line mode (Revonsuo, 1995; Perogamvros and Schwartz, 2012).
Dreaming is Not Always Reliable for Studying Consciousness
Dreaming offers a unique condition of internal information processing, which is functionally isolated from the external world. Indeed, dream consciousness, which may arise as ascending activation of attractor networks of visual and multimodal association areas, is, at least partially (Arzi et al., 2012), disconnected from the external environment. This is due to domination of internally oriented cortical networks, like the brain default network (Domhoff, 2011), over externally oriented cortical networks. This disconnection of the internal dreaming state from the external environment explains why, up until now, the sole way of studying dreams is to base the examination on subjective parameters: what the subject remembers of his/her dream after being awakened. Consequently, decoding a dream state with lack of objective information about the encoded state, reduces significantly the accurate assessment of the examined state.
Indeed, reconstructing dream reality with a dream decoder and thus being able to visualize dreaming experience remains a staple of science fiction stories. Theoretically, internally generated signals from the PTO junction could be reconstructed similarly to the reproduction of external static or dynamic visual stimuli (as described in “Decoding Perceptual Reality from Brain Activity”). However, considering that the dreaming experience is multimodal, an ideal dream decoder should be based not only on sensory decoding models (Nishimoto et al., 2011; Pasley et al., 2012) (see section “Decoding Perceptual Reality from Brain Activity”), but also on semantic (Schwartz, 2004; Mitchell et al., 2008; Andrews et al., 2009), episodic (Polyn et al., 2005), emotional (Sitaram et al., 2011), and motor (Dehaene et al., 1998) models. Importantly, this multimodal decoder would need sophisticated pattern-classification algorithms, due to increased novelty in dreamed representations (Perogamvros and Schwartz, 2012). Interestingly, the image reconstructions of natural movies of Nishimoto et al.'s decoder (Nishimoto et al., 2011) (Figure 2) share a striking similarity to the dream images reproduced by a visual dream decoder in the Wim Wenders' film “Until the End of the World” (1991) (Figure 3).
Figure 3. Image reconstructions from dreams using a dream decoder in the Wim Wenders film “Until the end of the world” (1991). “Dog and cat,” “Woman running,” and “Paris,” Wim Wenders 1991, Electronic Paintings from “Until the end of the World” by Wim Wenders, 1994 (Director's Cut). Copyright: Wim Wenders Foundation, Düsseldorf.
Apart from technical difficulties in the evaluation of decoding accuracy of dreaming, there are several phenomenological reasons for which dreaming cannot always offer a reliable description of consciousness. These are described in the dream argument and the functional dissociation argument.
The dream argument (Zhuàngzi, 369 BCE; Plato, 360 BCE; Aristotle, 350 BCE; Descartes, 1641) postulates that dreaming and waking life experiences are not easily distinguishable, because they are both based on a potentially faulty perceptual system. This skeptical hypothesis claims that the sleeping mind is not a reliable mechanism for attempting to differentiate reality from illusion. What may actually separate waking from dream consciousness is their different degree of coherence (waking experience > dreaming experience) and the assumption that we can more easily explain dream content by means of waking-life experiences than the reverse. However, the distinction between the two states can only be approximate, as recent experiments are in support of the dream argument (Mazzoni and Loftus, 1996).
The functional dissociation argument described here considers that dream consciousness and waking consciousness may not be functionally related. Although there is evidence that past and current waking concerns influence dream content (Cartwright et al., 2006), dream consciousness is largely characterized by novelty and creativity. Indeed, while a large proportion of dream elements comes from recent memory (Schwartz, 2003), integrated life episodes are incorporated in no more than 1–2% of dreams reports (Fosse et al., 2003). Dreams are usually novel constructions and rarely reproductions of past events (Meier, 1993). This leads inevitably to the question: is the dreaming life deterministically secondary to our waking life? In other words, is sleep the “servant” of waking life and do the activations of brain networks during dreaming reflect a function sleep serves for waking life or for itself? Could it be that the awakened avatar in our dreams has an independent Self and leads a “second life,” which is independent of our wakefulness? Current neuroimaging studies compare and interpret the activation/deactivation patterns in sleep in relation to wakefulness, assuming that the latter defines a principal state of reference. However, activated emotional and reward networks as well as deactivated reality-monitoring structures in sleep could define a protoconscious state (Hobson, 2009), whose existence and roles may be completely independent of and distinct from the waking conscious state. This statement may be partially supported by evidence that congenitally blind people can have visual dreams (Lopes Da Silva, 2003). Similar findings have been demonstrated for congenitally paraplegic and deaf-mute persons, who have dreams with modalities not experienced during waking life (Voss et al., 2011). Therefore, a possible functional dissociation between the waking Self and the dreaming Self [protoself according to Hobson (2009)], should be addressed in future studies. As J. L. Borges imagined in 1940 in his story “Tlon, Uqbar, Orbis Tertius” (Borges, 1944):
“while we are asleep here, we are awake somewhere else, and every man is thus two men.”
Conclusions
In this article, a literary source (The Invention of Morel) has been the inspiration for an integrative model of consciousness. The combined binding/brain reading approach of Casares would sufficiently describe the main attributes of consciousness: unity, subjectivity, and qualitativeness (Searle, 2000). With current technologies, this approach would correspond to a combined virtual reality/multimodal decoder, which could manipulate subjective conscious states (virtual reality component) and decode them (brain reading component). This approach could simultaneously gather first-person data with third-person data.
The association of virtual reality technologies and decoders seems necessary, as brain reading techniques alone offer insufficient description of consciousness. Indeed, brain reading informs us accurately and with reasonable temporal resolution about the neurophysiological correlates of conscious states, but not about subjectivity. On the other hand, virtual reality technologies, already used to explore self-consciousness (Sanchez-Vives and Slater, 2005; Lenggenhager et al., 2007), offer a promising and sophisticated methodology for investigation of subjective experience.
Although some preliminary results demonstrate that integration of first-person data and third-person data may be possible with current methodologies (Ijsselsteijn et al., 2001; Lutz et al., 2002; Dehaene et al., 2003), restrictions in temporal and spatial resolution of neuroimaging techniques render studies investigating associations between subjective states and objective measures, difficult to perform. Future experiments should address these issues.
Faced with these difficulties, studying an internal state incorporating multimodal integration and reality simulation, such as dreaming, could further elucidate the nature of conscious states. Although technical difficulties (to date, verbal reports are the only method of studying dreams) and questions about phenomenology (the dream argument and the functional dissociation argument), render dreaming a not always reliable model for consciousness, it may still answer some crucial questions of neurobiological, representational, and functional aspects of self-consciousness, such as perceptual binding, sensorimotor integration, and self-identification.
Conflict of Interest Statement
The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
I would like to thank Stephen Perrig, MD and Ms Charlaine Wetwood for their useful suggestions.
Abbreviations
BOLD, Blood-Oxygen-Level-Dependent; DR, Diminished Reality; EEG, Electroencephalography; fMRI, functional Magnetic Resonance Imaging; HMD, Head-Mounted Display; MVPA, Multivariate Pattern Analysis; PTO, Parieto-Temporo-Occipital; REM sleep, Rapid Eye Movement sleep; SR; Substitutional Reality; VM/MR, Virtual and Mixed Reality.
References
Abrams, D. A., Bhatara, A., Ryali, S., Balaban, E., Levitin, D. J., and Menon, V. (2011). Decoding temporal structure in music and speech relies on shared brain resources but elicits different fine-scale spatial patterns. Cereb. Cortex 21, 1507–1518.
Andrews, M., Vigliocco, G., and Vinson, D. (2009). Integrating experiential and distributional data to learn semantic representations. Psychol. Rev. 116, 463–498.
Arzi, A., Shedlesky, L., Ben-Shaul, M., Nasser, K., Oksenberg, A., Hairston, I. S., et al. (2012). Humans can learn new information during sleep. Nat. Neurosci. 15, 1460–1465.
Bekinschtein, T., Leiguarda, R., Armony, J., Owen, A., Carpintiero, S., Niklison, J., et al. (2004). Emotion processing in the minimally conscious state. J. Neurol. Neurosurg. Psychiatry 75, 788.
Berkeley, G. (1713). Three Dialogues Between Hylas and Philonous. Oxford: Oxford University Press (1998).
Blanke, O. (2012). Multisensory brain mechanisms of bodily self-consciousness. Nat. Rev. Neurosci. 13, 556–571.
Braun, A. R., Balkin, T. J., Wesenten, N. J., Carson, R. E., Varga, M., Baldwin, P., et al. (1997). Regional cerebral blood flow throughout the sleep-wake cycle. An H2O PET study. Brain 120(Pt 7), 1173–1197.
Cartwright, R., Agargun, M. Y., Kirkby, J., and Friedman, J. K. (2006). Relation of dreams to waking concerns. Psychiatry Res. 141, 261–270.
Chadwick, M. J., Hassabis, D., Weiskopf, N., and Maguire, E. A. (2010). Decoding individual episodic memory traces in the human hippocampus. Curr. Biol. 20, 544–547.
Chalmers, D. (2004). “How can we construct a science of consciousness?” in The Cognitive Neurosciences III, ed M. S. Gazzaniga (Cambridge, MA: MIT Press), 1111–1119.
Costanza, E., Kunz, A., and Fjeld, M. (2009). Lecture Notes in Computer Science. Heidelberg: Springer.
Cox, D. D., and Savoy, R. L. (2003). Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex. Neuroimage 19, 261–270.
Damasio, A. R. (1998). Investigating the biology of consciousness. Philos. Trans. R. Soc. Lond. B Biol. Sci. 353, 1879–1882.
Dehaene, S., Le Clec, H. G., Cohen, L., Poline, J. B., Van De Moortele, P. F., and Le Bihan, D. (1998). Inferring behavior from functional brain images. Nat. Neurosci. 1, 549–550.
Dehaene, S., Sergent, C., and Changeux, J. P. (2003). A neuronal network model linking subjective reports and objective physiological data during conscious perception. Proc. Natl. Acad. Sci. U.S.A. 100, 8520–8525.
Dehaene-Lambertz, G., Dehaene, S., and Hertz-Pannier, L. (2002). Functional neuroimaging of speech perception in infants. Science 298, 2013–2015.
Descartes, R. (1641). Meditations on First Philosophy. Cambridge: Cambridge University Press (1996).
Domhoff, W. G. (2011). The neural substrate for dreaming: is it a subsystem of the default network? Conscious. Cogn. 20, 1163–1174.
Dondi, M., Messinger, D., Colle, M., Tabasso, A., Simion, F., Barba, B. D., et al. (2007). A new perspective on neonatal smiling: differences between the judgments of expert coders and naive observers. Infancy 12, 235–255.
Formisano, E., De Martino, F., Bonte, M., and Goebel, R. (2008). “Who” is saying “what”? Brain-based decoding of human voice and speech. Science 322, 970–973.
Fosse, M. J., Fosse, R., Hobson, J. A., and Stickgold, R. J. (2003). Dreaming and episodic memory: a functional dissociation? J. Cogn. Neurosci. 15, 1–9.
Freeman, J., Avons, S., Meddis, R., Pearson, D., and Ijsselsteijn, W. (2000). Using behavioral realism to estimate presence: a study of the utility of postural responses to motion stimuli. Presence 9, 149–164.
Hampton, A. N., and O'Doherty, J. P. (2007). Decoding the neural substrates of reward-related decision making with functional MRI. Proc. Natl. Acad. Sci. U.S.A. 104, 1377–1382.
Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., and Pietrini, P. (2001). Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293, 2425–2430.
Haynes, J. D., and Rees, G. (2006). Decoding mental states from brain activity in humans. Nat. Rev. Neurosci. 7, 523–534.
Herling, J., and Broll, W. (2010). “Advanced self-contained object removal for realizing real-time diminished reality in unconstrained environments,” in International Symposium on Mixed and Augmented Reality (Seoul, Korea), 207–212.
Hobson, J. A. (2009). REM sleep and dreaming: towards a theory of protoconsciousness. Nat. Rev. Neurosci. 10, 803–813.
Hong, C. C., Harris, J. C., Pearlson, G. D., Kim, J. S., Calhoun, V. D., Fallon, J. H., et al. (2009). fMRI evidence for multisensory recruitment associated with rapid eye movements during sleep. Hum. Brain Mapp. 30, 1705–1722.
Howard, J. D., Plailly, J., Grueschow, M., Haynes, J. D., and Gottfried, J. A. (2009). Odor quality coding and categorization in human posterior piriform cortex. Nat. Neurosci. 12, 932–938.
Ijsselsteijn, W., De Ridder, H., Freeman, J., Avons, S., and Bouwhuis, D. (2001). Effects of stereoscopic presentation, image motion, and screen size on subjective and objective corroborative measures of presence. Presence 10, 298–311.
Insko, B. E. (2003). “Measuring presence: subjective, behavioral and physiological methods,” in Being There: Concepts, Effects and Measurement of User Presence in Synthetic Environments. eds G. Riva, F. Davide, and W. A. Ijsselsteijn (Amsterdam: Ios Press), 110–119.
Ji, D., and Wilson, M. A. (2007). Coordinated memory replay in the visual cortex and hippocampus during sleep. Nat. Neurosci. 10, 100–107.
Kamitani, Y., and Tong, F. (2005). Decoding the visual and subjective contents of the human brain. Nat. Neurosci. 8, 679–685.
Kamitani, Y., and Tong, F. (2006). Decoding seen and attended motion directions from activity in the human visual cortex. Curr. Biol. 16, 1096–1102.
Kaufmann, C., Wehrle, R., Wetter, T. C., Holsboer, F., Auer, D. P., Pollmacher, T., et al. (2006). Brain activation and hypothalamic functional connectivity during human non-rapid eye movement sleep: an EEG/fMRI study. Brain 129, 655–667.
Kay, K. N., Naselaris, T., Prenger, R. J., and Gallant, J. L. (2008). Identifying natural images from human brain activity. Nature 452, 352–355.
Kennedy, P. R., and Bakay, R. A. (1998). Restoration of neural output from a paralyzed patient by a direct brain connection. Neuroreport 9, 1707–1711.
Knutson, B., Rick, S., Wimmer, G. E., Prelec, D., and Loewenstein, G. (2007). Neural predictors of purchases. Neuron 53, 147–156.
Kurjak, A., Stanojevic, M., Andonotopo, W., Scazzocchio-Duenas, E., Azumendi, G., and Carrera, J. M. (2005). Fetal behavior assessed in all three trimesters of normal pregnancy by four-dimensional ultrasonography. Croat. Med. J. 46, 772–780.
Lapid, H., and Hummel, T. (2013). Recording odor-evoked response potentials at the human olfactory epithelium. Chem. Senses 38, 3–17.
Lenggenhager, B., Tadi, T., Metzinger, T., and Blanke, O. (2007). Video ergo sum: manipulating bodily self-consciousness. Science 317, 1096–1099.
Linnman, C., Zeidan, M. A., Furtak, S. C., Pitman, R. K., Quirk, G. J., and Milad, M. R. (2012). Resting amygdala and medial prefrontal metabolism predicts functional activation of the fear extinction circuit. Am. J. Psychiatry 169, 415–423.
Llinas, R. (2008). Of self and self awareness: the basic neuronal circuit in human consciousness and the generation of self. J. Conscious. Stud. 15, 64–74.
Llinas, R., and Ribary, U. (1993). Coherent 40-Hz oscillation characterizes dream state in humans. Proc. Natl. Acad. Sci. U.S.A. 90, 2078–2081.
Llinas, R., and Ribary, U. (2001). Consciousness and the brain. The thalamocortical dialogue in health and disease. Ann. N.Y. Acad. Sci. 929, 166–175.
Llinas, R., Ribary, U., Contreras, D., and Pedroarena, C. (1998). The neuronal basis for consciousness. Philos. Trans. R. Soc. Lond. B Biol. Sci. 353, 1841–1849.
Lopes Da Silva, F. H. (2003). Visual dreams in the congenitally blind? Trends Cogn. Sci. 7, 328–330.
Lutz, A., Lachaux, J. P., Martinerie, J., and Varela, F. J. (2002). Guiding the study of brain dynamics by using first-person data: synchrony patterns correlate with ongoing conscious states during a simple visual task. Proc. Natl. Acad. Sci. U.S.A. 99, 1586–1591.
Maquet, P., Ruby, P., Maudoux, A., Albouy, G., Sterpenich, V., Dang-Vu, T., et al. (2005). Human cognition during REM sleep and the activity profile within frontal and parietal cortices: a reappraisal of functional neuroimaging data. Prog. Brain Res. 150, 219–227.
Maravita, A., Spence, C., and Driver, J. (2003). Multisensory integration and the body schema: close to hand and within reach. Curr. Biol. 13, R531–R539.
Massimini, M., Ferrarelli, F., Murphy, M., Huber, R., Riedner, B., Casarotto, S., et al. (2010). Cortical reactivity and effective connectivity during REM sleep in humans. Cogn. Neurosci. 1, 176–183.
Metz-Lutz, M. N., Bressan, Y., Heider, N., and Otzenberger, H. (2010). What physiological changes and cerebral traces tell us about adhesion to fiction during theater-watching? Front. Hum. Neurosci. 4:59. doi: 10.3389/fnhum.2010.00059
Milh, M., Kaminska, A., Huon, C., Lapillonne, A., Ben-Ari, Y., and Khazipov, R. (2007). Rapid cortical oscillations and early motor activity in premature human neonate. Cereb. Cortex 17, 1582–1594.
Mitchell, T. M., Shinkareva, S. V., Carlson, A., Chang, K. M., Malave, V. L., Mason, R. A., et al. (2008). Predicting human brain activity associated with the meanings of nouns. Science 320, 1191–1195.
Miyawaki, Y., Uchida, H., Yamashita, O., Sato, M. A., Morito, Y., Tanabe, H. C., et al. (2008). Visual image reconstruction from human brain activity using a combination of multiscale local image decoders. Neuron 60, 915–929.
Morgan, L. K., Macevoy, S. P., Aguirre, G. K., and Epstein, R. A. (2011). Distances between real-world locations are represented in the human hippocampus. J. Neurosci. 31, 1238–1245.
Naselaris, T., Prenger, R. J., Kay, K. N., Oliver, M., and Gallant, J. L. (2009). Bayesian reconstruction of natural images from human brain activity. Neuron 63, 902–915.
Nishimoto, S., Vu, A. T., Naselaris, T., Benjamini, Y., Yu, B., and Gallant, J. L. (2011). Reconstructing visual experiences from brain activity evoked by natural movies. Curr. Biol. 21, 1641–1646.
Nofzinger, E. A., Buysse, D. J., Miewald, J. M., Meltzer, C. C., Price, J. C., Sembrat, R. C., et al. (2002). Human regional cerebral glucose metabolism during non-rapid eye movement sleep in relation to waking. Brain 125, 1105–1115.
O'Craven, K. M., and Kanwisher, N. (2000). Mental imagery of faces and places activates corresponding stiimulus-specific brain regions. J. Cogn. Neurosci. 12, 1013–1023.
Pasley, B. N., David, S. V., Mesgarani, N., Flinker, A., Shamma, S. A., Crone, N. E., et al. (2012). Reconstructing speech from human auditory cortex. PLoS Biol. 10:e1001251. doi: 10.1371/journal.pbio.1001251
Perogamvros, L. (2012). Does primary narcissism exist in newborn babies? Evidence from sleep science. Front. Psychology 3:330. doi: 10.3389/fpsyg.2012.00330
Perogamvros, L., and Schwartz, S. (2012). The roles of the reward system in sleep and dreaming. Neurosci. Biobehav. Rev. 36, 1934–1951.
Phan, K. L., Wager, T., Taylor, S. F., and Liberzon, I. (2002). Functional neuroanatomy of emotion: a meta-analysis of emotion activation studies in PET and fMRI. Neuroimage 16, 331–348.
Polyn, S. M., Natu, V. S., Cohen, J. D., and Norman, K. A. (2005). Category-specific cortical activity precedes retrieval during memory search. Science 310, 1963–1966.
Raizada, R. D., Tsao, F. M., Liu, H. M., and Kuhl, P. K. (2010). Quantifying the adequacy of neural representations for a cross-language phonetic discrimination task: prediction of individual differences. Cereb. Cortex 20, 1–12.
Revonsuo, A. (1999). “Toward a cognitive neuroscience of consciousness,” in Towards a Science of Consciousness III, eds S. R. Hameroff, A. W. Kaszniak, and D. J. Chalmers (Cambridge, MA: MIT Press), 87–97.
Sanchez-Vives, M. V., and Slater, M. (2005). From presence to consciousness through virtual reality. Nat. Rev. Neurosci. 6, 332–339.
Schwartz, S. (2004). What dreaming can reveal about cognitive and brain functions during sleep: a lexico-statistical analysis of dream reports. Psychol. Belg. 44, 5–42.
Sitaram, R., Lee, S., Ruiz, S., Rana, M., Veit, R., and Birbaumer, N. (2011). Real-time support vector classification and feedback of multiple emotional brain states. Neuroimage 56, 753–765.
Slater, M. (2009). Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos. Trans. R. Soc. Lond. B Biol. Sci. 364, 3549–3557.
Slater, M., Spanlang, B., Sanchez-Vives, M. V., and Blanke, O. (2010). First person experience of body transfer in virtual reality. PLoS ONE 5:e10564. doi: 10.1371/journal.pone.0010564
Solms, M. (2000). Dreaming and REM sleep are controlled by different brain mechanisms. Behav. Brain Sci. 23, 843–850. discussion: 904–1121.
Strauch, I., Meier, B., and Foulkes, D. (1996). In Search of Dreams: Results of Experimental Dream Research. Albany, NY: State University of New York Press.
Suzuki, K., Wakisaka, S., and Fujii, N. (2012). Substitutional reality system: a novel experimental platform for experiencing alternative reality. Sci. Rep. 2:459. doi: 10.1038/srep00459
Tajadura-Jimenez, A., Longo, M. R., Coleman, R., and Tsakiris, M. (2012). The person in the mirror: using the enfacement illusion to investigate the experiential structure of self-identification. Conscious. Cogn. 21, 1725–1738.
Tong, F., and Pratte, M. S. (2012). Decoding patterns of human brain activity. Annu. Rev. Psychol. 63, 483–509.
Tononi, G. (2008). Consciousness as integrated information: a provisional manifesto. Biol. Bull. 215, 216–242.
Voss, U., Tuin, I., Schermelleh-Engel, K., and Hobson, A. (2011). Waking and dreaming: related but structurally independent. Dream reports of congenitally paraplegic and deaf-mute persons. Conscious. Cogn. 20, 673–687.
Wamsley, E. J., and Stickgold, R. (2010). Dreaming and offline memory processing. Curr. Biol. 20, R1010–R1013.
Weil, R. S., and Rees, G. (2010). Decoding the neural correlates of consciousness. Curr. Opin. Neurol. 23, 649–655.
Keywords: consciousness, virtual reality, brain reading, Adolfo Bioy Casares, Morel, dreaming
Citation: Perogamvros L (2013) Consciousness and the Invention of Morel. Front. Hum. Neurosci. 7:61. doi: 10.3389/fnhum.2013.00061
Received: 16 December 2012; Accepted: 15 February 2013;
Published online: 05 March 2013.
Edited by:
Francesco Di Russo, University of Rome “Foro Italico”, ItalyCopyright © 2013 Perogamvros. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in other forums, provided the original authors and source are credited and subject to any copyright notices concerning any third-party graphics etc.
*Correspondence: Lampros Perogamvros, Department of Psychiatry, Division of Neuropsychiatry, University Hospitals of Geneva, Chemin du Petit-Bel-Air 2, Geneva 1225, Switzerland. e-mail: lampros.perogamvros@hcuge.ch