Lawrence E. Marks1,2* Catherine M. Mulvenna3- 1John B. Pierce Laboratory, Department of Environmental Health Sciences, Yale School of Public Health, New Haven, CT, USA
- 2Department of Psychology, Yale University, New Haven, CT, USA
- 3Child Study Center, Yale University School of Medicine, New Haven, CT, USA
Introduction
In synesthesia, experiences in one domain evoke additional experiences in another, as when musical notes or letters of the alphabet evoke colors. Both the domains and their pairings are diverse. Indeed, Day's (2013) recently tabulated 60 types of synesthesia, each referring to a different combination of inducing and induced domains. The domains conjoined through synesthesia may belong to different sense modalities, as in music-color synesthesia, but may also belong to the same modality: In grapheme-color synesthesia, seeing printed letters or numbers evokes color experiences.
In music-color and grapheme-color synesthesia, the inducing stimuli are perceptual, reflecting culture-specific categories (notes of the Western musical scale, letters of the alphabet) learned by synesthetes and non-synesthetes alike. Synesthesia may be triggered not only by sounds, tastes, smells, and pains, but also by more complex signals: words(e.g., Simner, 2007), emotional states (e.g., Ward, 2004), and even personalities (e.g., Novich et al., 2011). Analogously, the domains of synesthetic responses too can range widely. The composer Rimsky-Korsakoff “saw” the key of D-major as golden (Myers, 1914), while a grapheme-personification synesthete reported, “Ts are generally crabbed, ungenerous creatures” (Calkins, 1893; p. 454). Other phenomena, however, such as cross-modally evoked images or memories, are not typically considered examples of synesthesia.
In this article, we briefly describe half a dozen illustrative cases that border on traditional forms of synesthesia: cross-modal correspondence, cross-modal imagery, sensory (cross-modal) autobiographical memory, empathic perception, hallucination, and the Doppler illusion. Do any or all of the six constitute forms of synesthesia? The answer depends, we suggest, on the framework for characterizing synesthesia. Consequently, after describing the six phenomena, we sketch three frameworks that differ in how they characterize these phenomena relative to prototypical forms of synesthesia. Several investigators, taking different perspectives and coming to different conclusions, have already considered possible relations to synesthesia in three of the six: cross-modal correspondence (Martino and Marks, 2001; Deroy and Spence, 2013); cross-modal imagery (Craver-Lemley and Reeves, 2013; Spence and Deroy, 2013); and empathic perception (Fitzgibbon et al., 2010; Rothen and Meier, 2013).
Six at the Borders: Synesthesia's Far and Near Kin?
Cross-Modal Correspondence
Cross-modal correspondences pervade not only several forms of traditional synesthesia but also, importantly, the experiences of individuals typically deemed non-synesthetic (Marks, 1975, 1978; Spence, 2011). Even non-synesthetes perceive high-pitched vs. low-pitched sounds to resemble bright vs. dark colors—the resemblances evident in various tasks of cross-modal comparison (Marks, 1975; Ward et al., 2006). Where music-color synesthetes see brighter colors in high-pitched notes (e.g., “gold, yellow and white moving … like a rippling stream”: Mulvenna and Walsh, 2005; p. 399), people lacking the induced qualia of synesthesia nevertheless recognize cross-modal similarities.
Cross-modal correspondences often reflect alignments between bipolar dimensions, such as higher pitch being associated with greater lightness, greater brightness, higher vertical location, and smaller size (e.g., Karwoski et al., 1942; Wicker, 1968; Marks, 1974, 1989; Ward et al., 2006). Several auditory-visual correspondences reveal themselves in young children (Marks et al., 1987; Mondloch and Maurer, 2004) and infants (Lewkowicz and Turkewitz, 1980; Walker et al., 2010; Haryu and Kajikawa, 2012), as well as in denizens of disparate cultures: Members of a remote, semi-nomadic, preliterate desert-tribe in southern Africa, having virtually no contact with Western culture, nevertheless overwhelmingly matched lighter gray colors to higher-pitched tones—thereby revealing pitch-lightness correspondence (Mulvenna, 2012).
The tendency for non-synesthetes to perceive similarities between experiences in different domains, despite the absence of secondary qualia, has been called “synesthetic thinking” (Karwoski et al., 1942) and “weak synesthesia” (Martino and Marks, 2001), consistent with the notion that cross-modal correspondence reflects general perceptual and cognitive processes. Further, by capitalizing on cross-modal correspondences, synesthesia too presumably capitalizes on these general processes of perception and cognition (e.g., Karwoski et al., 1942; Marks, 1978; Ward et al., 2006).
Cross-Modal Imagery
Compared to cross-modal correspondence, which can lack induced qualia, cross-modal imagery is nearer, phenomenologicaly, to prototypical synesthesia. In cross-modal imagery, as in synesthesia, stimulation in one modality may arouse mental images in another, although cross-modal imagery exhibits greater voluntary control (e.g., Karwoski and Odbert, 1938). Synesthetic responses commonly arise automatically, without requiring effort and being under relatively little control (e.g., Mattingley et al., 2001). By comparison, some non-synesthetes can voluntarily conjure up images, for example, imagining colors while listening to music (Karwoski et al., 1942). In some instances, there may be an especially intimate connection between visual imagery and prototypical sound-color synesthesia. Karwoski and Odbert (1938) inferred that a small subset of their subjects experienced visual imagery that could be modulated by music—a phenomenon that seems more automatic (less voluntary) than typical visual imagery, albeit less automatic (more voluntary) than synesthesia. Perhaps music-modulated imagery bears an especially close connection to traditional music-color synesthesia.
Sensory Autobiographical Memory (Proust Phenomenon)
(Marcel Proust 1922) famously described the floods of detailed, sensory memories from childhood evoked by tasting a tea-soaked madeleine. Sensory, autobiographical memory of this sort has been dubbed the “Proust phenomenon” in honor of the eponymous author. In the Proust phenomenon, odors or flavors in particular evoke strong sensory-based memories of associated events experienced in childhood (Chu and Downes, 2000). Proustian memory resembles traditional synesthesia, but also differs from it—resembling synesthesia in the automatic manner in which sensory experiences evoke memory images, but differing in the episodic character of the memories. In this regard, the sensory qualia of traditional synesthesia seem more “semantic” than “episodic.”
Empathic Perception: Pain, Touch, Couvade Syndrome
In several respects, empathetic perception strongly resembles synesthesia. In empathic pain, seeing or hearing evidence of another person's pain or discomfort produces analogous pain or discomfort (e.g., Jackson et al., 2005). Similarly, seeing another person being touched may produce an analogous tactile sensation—often called “mirror touch” (e.g., Banissy and Ward, 2007). Although the inducing stimuli come from another modality—typically, vision or hearing—the mechanisms underlying empathic perception presumably rely on an underlying within-domain equivalence: where implicitly-recognized sensations evoke sensory experiences of the same or similar kind, perhaps through merging constructs of “self” and “other.”
Possibly related to empathic pain is the couvade syndrome, which refers to a set of empathic symptoms (such as nausea, vomiting, and abdominal pain) reported by the partners of pregnant women. The couvade syndrome appears to be fairly common, having a reported prevalence of about 22% (Lipkin and Lamb, 1982), roughly five times that of traditional synesthesia (Simner et al., 2006).
A feature that distinguishes empathic perception from traditional forms of synesthesia is the very characteristic that makes empathy empathic—the intrinsic equivalence between the emotional qualities of the inducing and induced experiences. In traditional forms of synesthesia, however, as when sound evokes visual color or shape, the inducing and induced sensations not only reflect different domains but are also usually related more abstractly, even “metaphorically” (Rothen and Meier, 2013).
Hallucination
A hallucination is a “percept-like experience which (a) occurs in the absence of appropriate stimulus, (b) has the full force or impact of the corresponding (real) perception, and (c) is not amenable to direct and voluntary control by the experiencer” (Slade and Bentall, 1988; p. 23). Several of these attributes also characterize synesthesia. Hallucinations may involve any of the senses (Ohayon, 2000) and are easily distinguished as “perceptions not confirmed by others” (Ohayon, 2000; p. 154). Some types of hallucinations, though not all, may fall near the borders of synesthesia. Thus, synesthetic experiences commonly include colors and shapes (Day, 2013). Analogously, “simple hallucinations,” often triggered by migraines or hallucinogens (Ermentrout and Cowan, 1979), commonly include simple recurring shapes and patterns, or ‘form constants (Klüver, 1966), which apparently reflect patterns of neural activation in visual cortex (Ermentrout and Cowan, 1979).
No longer considered explicitly pathological, hallucinations are now generally treated as independent perceptual phenomena (Romme and Escher, 1989; see Strauss, 1969). Auditory verbal hallucinations (hearing voices), for instance, occur in about 13% of adults in the general population (Beavan et al., 2011), and their presence does not correlate significantly with psychopathology (Johns et al., 2002; Sommer et al., 2010). Although the strongest predictor of psychopathology in hallucinations is distress over their content or possible basis (Romme and Escher, 1989; Chadwick and Birchwood, 1994; Beavan et al., 2011), distress is rarely associated with synesthetic experience.
The Doppler Illusion
Day's (2013) table listing 60 types of synesthesia includes only one type that is explicitly intra-modal, namely, grapheme-color synesthesia. We note here another phenomenon in which sensory experiences in one domain induce experiences in the same modality, the “Doppler illusion,” reported by Neuhoff and McBeath (1996): When a tone increases continuously in intensity over time (as though a sound-emitting source were approaching at constant velocity) but maintains a constant sound frequency, observers nevertheless report hearing the tone's pitch to increase as loudness increases. Neuhoff and McBeath dubbed the illusory increase in pitch the “Doppler illusion” because a sound source approaching at constant velocity will produce, at the observer's location, an elevated, albeit constant, sound frequency (the physical Doppler effect). But might we not also call the Doppler illusion a case of intra-modal (loudness-pitch) synesthesia?
Synesthesia: Continuous, Discrete, Pluralistic?
If, as the term implies, synesthesia is first and foremost a “conjoining of experiences,” then one might construe several or perhaps all six of our cases as examples of synesthesia. If, on the other hand, synesthesia is defined more narrowly, for example, by requiring it to include qualia and to arise automatically and consistently, then fewer cases would make the cut. Recently, the first author outlined three theoretical frameworks—monism, dualism, and pluralism—that, in different ways, characterize how synesthesia could relate to borderline perceptual and conceptual phenomena like the six just described (Marks, 2011, 2012).
Synesthetic monism refers to the notion that synesthesia may appropriately be considered a spectrum or continuum. Using this framework, traditional forms of synesthesia, such as music-color and grapheme-color, serve as prototypes, residing at the high end of the continuum, with weaker forms, such as cross-modal correspondence, residing toward the low end. In the present examples, music-modulated imagery, hallucinations, empathic perceptions, Proustian evoked memories, and the Doppler illusion might lie at various loci between the ends of the synesthetic spectrum—although the differences amongst them suggest that the hypothesized spectrum is multidimensional.
The other two frameworks both distinguish sharply between synesthesia and non-synesthetic forms of perception and conception. Dualism posits a simple dichotomy between the two categories, with synesthesia incorporating both traditional forms (e.g., sound-color, grapheme-color, word-flavor, taste-shape) and others (e.g., grapheme-personification, ordinal sequence-spatial sequence), and non-synesthesia incorporating cross-modal correspondence, cross-modal imagery, and hallucination. How to categorize other borderline examples, such as empathic perception, Proustian memory, and the Doppler illusion, however, is less clear.
Like dualism, the third framework, pluralism, explicitly distinguishes synesthetic from non-synesthetic experiences, but rests on the additional assumption that synesthesia is well characterized as (appropriating James's, 1890; p. 224, expression) “a teeming multiplicity.” Like monism, synesthetic pluralism recognizes that some forms of synesthesia, such as music-color, are better exemplars than are others, such as empathic perception and the Doppler illusion. In the pluralistic view, however, the broad category of synesthesia itself contains a cornucopia of distinct sub-categories, lacking common denominators but perhaps linked one to another along the lines suggested by (Wittgenstein's 1953) notion of family resemblance.
Critical, in our view, to choosing amongst frameworks is characterizing the role of phenomenal experience in defining synesthesia; many investigators judge this role to be significant (see, e.g., the exchange among Cohen Kadosh and Terhune, 2012; Eagleman, 2012; Simner, 2012a, b). Monism in particular relies substantially on the notion that phenomenal experience plays a central, and ineluctable, role in characterizing synesthesia. Alternatively, jettisoning phenomenology may be conducive to pluralistic frameworks that rely on mechanism-based distinctions amongst multiple forms of synesthesia. And jettisoning phenomenology may be especially conducive to dualistic frameworks that rely on a mechanism-based distinction between synesthesia and borderline phenomena—perhaps akin to distinguishing mechanistically between rhinovirus-induced sniffles and pollen-induced seasonal nasal allergies.
But we ask, Are phenomenal experiences (qualia) analogous to sneezes?
References
Banissy, M. J., and Ward, J. (2007). Mirror-touch synesthesia is linked with empathy. Nat. Neurosci. 10, 815–817. doi: 10.1038/nn1926
Beavan, V., Read, J., and Cartwright, C. (2011). The prevalence of voice-hearers in the general population: a literature review. J. Ment. Health 20, 281–292. doi: 10.3109/09638237.2011.562262
Calkins, M. W. (1893). A statistical study of pseudo-chromesthesia and mental-forms. Am. J. Psychol. 5, 439–464. doi: 10.2307/1411912
Chadwick, P., and Birchwood, M. (1994). The omnipotence of voices. A cognitive approach to auditory hallucinations. Br. J. Psychiatry 164, 190–201. doi: 10.1192/bjp.164.2.190
Chu, S., and Downes, J. J. (2000). Long live Proust: the odour-cued autobiographical memory bump. Cognition 75, B41–B50. doi: 10.1016/S0010-0277(00)00065-2
Cohen Kadosh, R., and Terhune, D. B. (2012). Redefining synaesthesia. Br. J. Psychol. 103, 20–23. doi: 10.1111/j.2044-8295.2010.02003.x
Craver-Lemley, C., and Reeves, A. (2013). “Is synesthesia a form of mental Imagery?” in Multisensory Imagery: Theory and Applications, ed Lacey, S., Lawson, R. (New York, NY: Springer), 185–206.
Day, S. (2013). Synesthesia: demographic aspects of synesthesia. Available online at: www.daysyn.com/types-of-syn.html (Accesed May 17, 2013).
Deroy, O., and Spence, C. (2013). Why we are not all synesthetes (not even weakly so). Psychon. Bull. Rev. 20, 643–664. doi: 10.3758/s13423-013-0387-2
Eagleman, D. M. (2012). Synaesthesia in its protean guises. Br. J. Psychol. 103, 16–19. doi: 10.1111/j.2044-8295.2011.02020.x
Ermentrout, G. B., and Cowan, J. D. (1979). A mathematical theory of visual hallucination patterns. Biol. Cybern. 34, 137–150. doi: 10.1007/BF00336965
Fitzgibbon, B. M., Giummarra, M. J., Georgiou-Karistianis, N., Enticott, P. G., and Bradshaw, J. L. (2010). Shared pain: from empathy to synaesthesia. Neurosci. Biobehav. Rev. 34, 500–512. doi: 10.1016/j.neubiorev.2009.10.007
Haryu, E., and Kajikawa, S. (2012). Are higher-frequency sounds brighter in color and smaller in size. Auditory-visual correspondences in 10-month-old infants. Infant Behav. Dev. 35, 727–732. doi: 10.1016/j.infbeh.2012.07.015
Jackson, P. L., Meltzoff, A. N., and Decety, J. (2005). How do we perceive the pain of others. A window into the neural processes involved in empathy. Neuroimage 24, 771–779. doi: 10.1016/j.neuroimage.2004.09.006
James, W. (1890). The Principles of Psychology. Vol. 1. New York, NY: Henry Holt. doi: 10.1037/10538-000
Johns, L. C., Hemsley, D., and Kuipers, E. (2002). A comparison of auditory hallucinations in a psychiatric and non−psychiatric group. Br. J. Clin. Psychol. 41, 81–86. doi: 10.1348/014466502163813
Karwoski, T. F., and Odbert, H. S. (1938). Color-music. Psychol. Monogr. 50, 1–60. doi: 10.1037/h0093458
Karwoski, T. F., Odbert, H. S., and Osgood, C. E. (1942). Studies in synesthetic thinking. II. The role of form in visual responses to music. J. Gen. Psychol. 26, 199–222. doi: 10.1080/00221309.1942.10545166
Klüver, H. (1966). Mescal, and Mechanisms of Hallucinations. Chicago, IL: University of Chicago Press.
Lewkowicz, D. J., and Turkewitz, G. (1980). Cross-modal equivalence in early infancy: auditory-visual intensity matching. Dev. Psychol. 16, 597–607. doi: 10.1037/0012-1649.16.6.597
Lipkin, M. Jr., and Lamb, G. S. (1982). The couvade syndrome: an epidemiologic study. Ann. Intern. Med. 96, 509–511. doi: 10.7326/0003-4819-96-4-509
Marks, L. E. (1974). On associations of light and sound: the mediation of brightness, pitch, and loudness. Am. J. Psychol. 87, 173–188. doi: 10.2307/1422011
Marks, L. E. (1975). On colored-hearing synesthesia: cross-modal translations of sensory dimensions. Psychol. Bull. 82, 303–331. doi: 10.1037/0033-2909.82.3.303
Marks, L. E. (1978). The Unity of the Senses: Interrelations among the Modalities. New York, NY: Academic Press.
Marks, L. E. (1989). On cross-modal similarity: the perceptual structure of pitch, loudness, and brightness. J. Exp. Psychol. Hum. Percept. Perform. 15, 586–602. doi: 10.1037/0096-1523.15.3.586
Marks, L. E. (2012). “La sinestesia en el espectro [Synesthesia across the spectrum],” in Sinestesia: Los Fundamentos Teóricos, Artisticos y Cientificos, eds de Córdoba, M. J., Riccò, D. (Granada: Ediciones Fundación Internacional Artecittà), 23–38.
Marks, L. E., Hammeal, R. J., and Bornstein, M. H. (1987). Perceiving similarity and comprehending metaphor. Monogr. Soc. Res. Child Dev. 52, 1–93. doi: 10.2307/1166084
Martino, G., and Marks, L. E. (2001). Synesthesia: strong and weak. Curr. Dir. Psychol. Sci. 10, 61–65. doi: 10.1111/1467-8721.00116
Mattingley, J. B., Rich, A. N., Yelland, G., and Bradshaw, J. L. (2001). Unconscious priming eliminates automatic binding of colour and alphanumeric form in synaesthesia. Nature 410, 580–582. doi: 10.1038/35069062
Mondloch, C. J., and Maurer, D. (2004). Do white balls squeak. Pitch-object correspondences in young children. Cogn. Affect. Behav. Neurosci. 4, 133–136. doi: 10.3758/CABN.4.2.133
Mulvenna, C. M. (2012). On Creativity in Synaesthetes: Roles of Neural Connectivity, Cognitive Control, and Perceptual Correspondence. Doctoral thesis, University College London.
Mulvenna, C. M., and Walsh, V. (2005). Synaesthesia. Curr. Biol. 15, 399–400. doi: 10.1016/j.cub.2005.05.039
Neuhoff, J. G., and McBeath, M. K. (1996). The Doppler illusion: the influence of dynamic intensity change on perceived pitch. J. Exp. Psychol. Hum. Percept. Perform. 22, 970–985. doi: 10.1037/0096-1523.22.4.970
Novich, S., Cheng, S., and Eagleman, D. M. (2011). Is synaesthesia one condition or many. A large-scale analysis reveals subgroups. J. Neurosychol. 5, 353–371. doi: 10.1111/j.1748-6653.2011.02015.x
Ohayon, M. M. (2000). Prevalence of hallucinations and their pathological associations in the general population. Psychiatry Res. 97, 153–164. doi: 10.1016/S0165-1781(00)00227-4
Proust, M. (1922). Swann's Way: Remembrance of Things Past. Vol. 1, Transl. C. K. Scott Moncrieff. New York, NY: Henry Holt.
Romme, M. A., and Escher, A. D. (1989). Hearing voices. Schizophr. Bull. 15, 209. doi: 10.1093/schbul/15.2.209
Rothen, N., and Meier, B. (2013). Why vicarious experience is not an instance of synesthesia. Front. Hum. Neurosci. 7:128. doi: 10.3389/fnhum.2013.00128
Simner, J. (2007). Beyond perception: synaesthesia as a psycholinguistic phenomenon. Trends Cogn. Sci. 11, 23–29. doi: 10.1016/j.tics.2006.10.010
Simner, J. (2012b). Defining synaesthesia: a response to two excellent commentaries. Br. J. Psychol. 103, 24–37. doi: 10.1111/j.2044-8295.2011.02059.x
Simner, J., Mulvenna, C., Sagiv, N., Tsakanikos, E., Withery, S. A., Fraser, C., et al. (2006). Synaesthesia: the prevalence of atypical cross-modal experiences. Perception 35, 1024–1033. doi: 10.1068/p5469
Slade, P. D., and Bentall, R. P. (1988). Sensory Deception: a Scientific Analysis of Hallucination. London: Croom Helm.
Sommer, I. E., Daalman, K., Rietkerk, T., Diederen, K. M., Bakker, S., Wijkstra, J., et al. (2010). Healthy individuals with auditory verbal hallucinations; who are they. Psychiatric assessments of a selected sample of 103 subjects. Schizophr. Bull. 36, 633–641. doi: 10.1093/schbul/sbn130
Spence, C. (2011). Crossmodal correspondences: a tutorial review. Atten. Percept. Psychophys. 73, 971–995. doi: 10.3758/s13414-010-0073-7
Spence, C., and Deroy, O. (2013). “Crossmodal mental imagery,” in Multisensory Imagery: Theory and Applications, eds Lacey, S., Lawson, R. (New York, NY: Springer), 157–183.
Strauss, J. S. (1969). Hallucinations and delusions as points on continua function: rating scale evidence. Arch. Gen. Psychiatry 21, 581–586. doi: 10.1001/archpsyc.1969.01740230069010
Walker, P., Bremner, J. G., Mason, U., Spring, J., Mattok, K., Slater, A., et al. (2010). Preverbal infants' sensitivity to synaesthetic cross-modality correspondences. Psychol. Sci. 21, 21–25. doi: 10.1177/0956797609354734
Ward, J. (2004). Emotionally mediated synaesthesia. Cogn. Neuropsychol. 21, 761–772. doi: 10.1080/02643290342000393
Ward, J., Huckstep, B., and Tsakanikos, E. (2006). Sound-colour synaesthesia: to what extent does it use cross-modal mechanisms common to us all. Cognition 42, 264–280. doi: 10.1016/S0010-9452(08)70352-6
Keywords: synesthesia, cross-modal correspondence, cross-modal imagery, cross-modal memory, empathic perception, hallucination, Doppler illusion
Citation: Marks LE and Mulvenna CM (2013) Synesthesia, at and near its borders. Front. Psychol. 4:651. doi: 10.3389/fpsyg.2013.00651
Received: 13 July 2013; Accepted: 02 September 2013;
Published online: 26 September 2013.
Edited by:
Michael Banissy, Goldsmiths University of London, UKReviewed by:
O. Deroy, University of London, UKCopyright © 2013 Marks and Mulvenna. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: marks@jbpierce.org