Mechanisms Underlying the Risk to Develop Drug Addiction, Insights From Studies in Drosophila melanogaster
- The Mina & Everard Goodman Faculty of Life Sciences and The Leslie and Susan Gonda Multidisciplinary Brain Research Center, Bar-Ilan University, Ramat Gan, Israel
The ability to adapt to environmental changes is an essential feature of biological systems, achieved in animals by a coordinated crosstalk between neuronal and hormonal programs that allow rapid and integrated organismal responses. Reward systems play a key role in mediating this adaptation by reinforcing behaviors that enhance immediate survival, such as eating or drinking, or those that ensure long-term survival, such as sexual behavior or caring for offspring. Drugs of abuse co-opt neuronal and molecular pathways that mediate natural rewards, which under certain circumstances can lead to addiction. Many factors can contribute to the transition from drug use to drug addiction, highlighting the need to discover mechanisms underlying the progression from initial drug use to drug addiction. Since similar responses to natural and drug rewards are present in very different animals, it is likely that the central systems that process reward stimuli originated early in evolution, and that common ancient biological principles and genes are involved in these processes. Thus, the neurobiology of natural and drug rewards can be studied using simpler model organisms that have their systems stripped of some of the immense complexity that exists in mammalian brains. In this paper we review studies in Drosophila melanogaster that model different aspects of natural and drug rewards, with an emphasis on how motivational states shape the value of the rewarding experience, as an entry point to understanding the mechanisms that contribute to the vulnerability of drug addiction.
From insects to humans, organisms living in complex environments need to respond quickly and appropriately to different stimuli by choosing one action over another to increase their chances of survival and reproduction. Reward systems play a key role in promoting this aim by motivating animals to repeat behaviors that increase their fitness, such as eating, drinking, sexual interaction, and parental behaviors. Drugs of abuse affect the same brain regions used for the processing of natural rewards, creating the pleasurable feeling indicative of a fitness benefit, and with repeated use can lead to compulsive drug abuse and addiction (Nesse and Berridge, 1997; Koob, 2009).
The American Psychiatric Association defines addiction as “maladaptive pattern of substance use manifested by recurrent and significant adverse consequences related to the repeated use of substances” (American Psychatric Association, 2013). This is characterized by a sequence of stages: (1) initial voluntary consumption of the drug, accompanied by an acute hedonic drug response, (2) repeated use, leading to compulsive and uncontrolled drug use, and finally, (3) physical and mental dependence (Koob and Bloom, 1988; Wolffgramm and Heyne, 1995; Koob, 1997, 2009; Nesse and Berridge, 1997).
Understanding the complex nature of human addiction is one of the greatest challenges in contemporary neuroscience, requiring parallel efforts of many scientific disciplines. One important approach is the use of animal systems to model certain features of the process, such as the reinforcing properties of drug rewards. Early studies by Karl von Frisch demonstrated the ability of sugar reward to reinforce preference for certain colors in honey bees (von Frisch, 1914). Subsequent studies by Olds and Milner demonstrated that rodents can learn to press a lever to receive intracranial self-stimulation (ICSS), facilitating the discovery of brain areas that encode reward (Olds and Milner, 1954). These seminal studies paved the path for the development of complex behavioral paradigms that measure the rewarding effects of drugs. Examples include self-administration paradigms, in which voluntary lever pressing results in delivery of a drug dose (Weeks, 1962; Thompson and Schuster, 1964), and conditioned place preference, where animals learn to associate a certain environment with receiving a drug, and the preference for this environment is tested afterwards in the absence of the drug (Rossi and Reid, 1976). Although the existing models do not entirely recapitulate the complexity of human addiction, they model important features of drug addiction (Koob, 2009; Lynch et al., 2010). For example, the positive reinforcing actions of binge intoxication is captured using self-administration paradigms in rodents and monkeys (Johanson and Balster, 1978; Collins et al., 1984), while the negative reinforcing properties of the withdrawal phase are measured by increased anxiety-like responses (Sanchis-Segura and Spanagel, 2006). The craving stage can be modeled by “cue-induced reinstatement,” in which the reinstatement of drug seeking is tested after the induction of drug cues following drug self-administration training (Sanchis-Segura and Spanagel, 2006; Liu et al., 2008; Mantsch et al., 2016).
Although it is more common to use mammals to study addiction, insect behavior is no less organized and driven by reward. Many studies over the years have established the fruit fly Drosophila melanogaster as a non-conventional but very relevant model to explore molecular mechanisms underlying drug response. These have mostly focused on ethanol, modeling early stages of ethanol exposure, including its immediate locomotor effects (reviewed extensively in Rodan and Rothenfluh, 2010; Kaun et al., 2012; Devineni and Heberlein, 2013; Ghezzi et al., 2013a), its hedonic value, as reflected by voluntary consumption (Devineni and Heberlein, 2009), and the formation of long-lasting memories for the rewarding experience (Kaun et al., 2011; Figure 1). This review will present recent progress in which fruit flies were used to uncover genetic and environmental elements that influence the likelihood of progressing from initial exposure to repeated drug use. It will focus on drug-oriented studies and those that are not drug oriented but share mutual mechanisms and principles with addiction, such as learning and memory, and neuronal mechanisms that encode and process natural rewards. Together, the cellular pathways, neuronal circuits and newly discovered principles that govern reward processing can serve as a conceptual framework for understanding the mechanisms that underlie the risk to develop addiction.
Figure 1. Schematic illustration of the behavioral paradigms that are used to model different features of drug addiction in Drosophila.
Methods of Studying Ethanol Related Behaviors in Fruit Flies
Flies encounter ethanol in their natural habitat, and as such, acquired many adaptations that enable them to survive and thrive in ethanol-rich environments (Gibson et al., 1981). Flies exhibit natural preference for ethanol: the smell of ethanol was shown to be an attractive cue using olfactory trap (Reed, 1938; Dudley, 2002; Devineni and Heberlein, 2009), and females show preference to lay eggs on ethanol containing substrates (Siegal and Hartl, 1999; Azanchi et al., 2013; Kacsoh et al., 2013). Flies develop preference to consume ethanol-containing food in a two-choice consumption paradigm. The kinetics of their preference and its extent depend on genetic background (Merçot et al., 1994; Devineni and Heberlein, 2009), prior exposure to ethanol (Peru y Colón de Portugal et al., 2014), sampling time (Devineni and Heberlein, 2009), and prior sexual experience (Shohat-Ophir et al., 2012). Importantly, flies display similar behavioral responses to acute exposure to ethanol as mammals: increased motor response when exposed to a low dose of ethanol, and sedation when reaching higher doses (Singh and Heberlein, 2000). Repeated exposure to ethanol results in functional tolerance and increases the time and dose needed to induce sedation. This reflects neuronal plasticity that corresponds to tolerance (Figure 1), but can also be caused by changes in ethanol metabolism (Scholz et al., 2000).
Over the years there have been several experimental systems to study the locomotor response to ethanol intoxication, the first of which was the inebriometer system (Cohan and Graf, 1985; Cohan and Hoffmann, 1986; Weber, 1988), in which flies lose their postural control when exposed to ethanol vapor. The system was later adapted for high throughput functional genetic screens by the Heberelin lab (Moore et al., 1998), and was subsequently replaced by video tracking systems that measure changes in fly velocity during acute intoxication, and assays that measure loss of righting response when reaching sedating levels (Wolf et al., 2002; Maples and Rothenfluh, 2011). Many genes and cellular pathways in neurons and glia cells have been shown to modulate the sensitivity of flies to both the positive and negative motor responses upon exposure to ethanol vapor, and the development of tolerance (Moore et al., 1998; Scholz et al., 2000, 2005; Berger et al., 2004; Ghezzi et al., 2004, 2013b; Corl et al., 2005; Cowmeadow et al., 2006; Kong et al., 2010; King et al., 2011, 2014; Kapfhamer et al., 2012; Krishnan et al., 2012, 2016; Devineni et al., 2013; Li et al., 2013; McClure and Heberlein, 2013; Pohl et al., 2013; Troutwine et al., 2016). Some of the identified fly genes, pathways and principles paved the way for parallel studies in mammals (Corl et al., 2009; Lasek et al., 2011a,b,c; Maiya et al., 2012, 2015; Kapfhamer et al., 2013).
A breakthrough in modeling aspects of drug reward in flies was the introduction of two paradigms: a conditioned response to ethanol vapor (Kaun et al., 2011), and a two-choice assay to measure voluntary ethanol consumption (Ja et al., 2007; Devineni and Heberlein, 2009). In the first paradigm, flies learn to associate cues with ethanol intoxication and develop long-lasting attraction for an ethanol-paired cue (Kaun et al., 2011). A demonstration for the relevance of this model as a system to study aspects of drug reward was the finding that flies are willing to tolerate electric shock in order to approach an odor cue predicting ethanol reward (Kaun et al., 2011). The two-choice ethanol consumption paradigm measures motivation to obtain drug rewards, where flies can choose to feed from ethanol or non-ethanol containing food in a capillary feeder system (CAFE) (Devineni and Heberlein, 2009; Pohl et al., 2012; Shohat-Ophir et al., 2012; Xu et al., 2012; Ojelade et al., 2015; Zer et al., 2016). Another two-choice ethanol consumption paradigm is the FRAPPE (Fluorometric Reading Assay of Preference Primed by Ethanol), a novel assay based on the CAFE system, which allows precise and high throughput measurement of consumption in individual flies (Peru y Colón de Portugal et al., 2014; Figure 1). Lastly, a recent study by Shao, et al. established a new reward self-administration paradigm that is based on optogenetic stimulation of neurons that encode positive valence (Shao et al., 2017). In this assay, flies harboring the red shifted channel rhodopsin CsChrimson (Inagaki et al., 2014a) in NPF neurons prefer to be in a zone that triggers optogenetic stimulation of their NPF expressing neurons (Shao et al., 2017; Figure 1). Although this assay does not measure drug related responses, it facilitates the identification of neurons that induce immediate pleasure, and conceptually resembles the rodent intracranial self-stimulation (ICSS) paradigm (Olds and Milner, 1954).
Drug-Unrelated Studies and their Contribution to Understanding the Molecular Basis of Addiction: The Case of Learning and Memory
Addiction is frequently referred to as pathological usurpation of learning and memory mechanisms that are normally used to predict the occurrence of natural rewards (Nestler, 2002; Hyman, 2005; Hyman et al., 2006; Kalivas and O'Brien, 2008; Duan et al., 2016; Patrono et al., 2016). This part of the review will explore the contribution of the field of learning and memory in flies to understanding drug related behaviors and possibly addiction, by covering two major directions in the field: traditional forward genetic screens, and more recent circuitry-oriented studies.
Genes and Cellular Pathways That Constitute the Basic Machinery Encoding Learning and Reward
Seymour Benzer and colleagues were the first to demonstrate that one can use a genetic scalpel to identify genes and pathways that are necessary for the formation of memory (Quinn et al., 1974). Learning and memory can be studied in flies using both reward or avoidance of punishment based assays, by pairing a neutral cue to the presence of sucrose (positive reinforcement) or electric shock (punishment) (Quinn et al., 1974; Tempel et al., 1983). The memory for the experience is measured by testing the avoidance or attraction of the flies to the odor that was previously paired (conditioned stimulus) with the experience (unconditioned stimulus). Many studies over the years identified mutants in different stages of the process, some of which showed virtually no learning during shock training, like the mutant turnip (Quinn et al., 1979), dunce (Dudai et al., 1976), and rutabaga (Aceves-Piña and Quinn, 1979), while others learned normally but forgot the task of shock and sucrose training faster than wild type flies, like amnesiac (Quinn et al., 1979; Tempel et al., 1983). The elucidation of the molecular functions of the affected genes shed light on the biochemical mechanisms mediating learning and memory, and indicated a pivotal function for the cAMP pathway; rutabaga (rut) encodes for the Ca2+/CaM-sensitive adenylyl cyclase (Livingstone et al., 1982), and Dunce has cAMP phosphodiesterase activity (Byers et al., 1981). In addition to the cAMP pathways, other studies identified additional players that regulate memory related plasticity events, such as Ca2+/CaM Kinase II (Joiner and Griffith, 1997) and Orb2, a CPEB protein that functions in synaptic plasticity-required protein synthesis (Keleman et al., 2007).
Studying Neuronal Circuits That Encode Associative Learning; The Mushroom Bodies as an Association Center
Recent technological advances in neurogenetics led to the emergence of powerful genetic tools such as optogenetics, in vivo Ca2+ imaging, and the ability to manipulate single neurons in behaving animals. This resulted in an explosion of studies on mechanisms that encode associative learning and the processing of natural rewards (reviewed by Owald et al., 2015). A central player in integrating the conditioned and unconditioned stimuli of a given experience into an associative memory is the Mushroom Body (MB), a brain region extensively studied with classical conditioning assays and genetic manipulations (Heisenberg et al., 1985; Connolly et al., 1996; Wolf et al., 1998; Waddell et al., 2000; McGuire et al., 2001; Liu et al., 2007; Thum et al., 2007; Aso et al., 2009) (reviewed by Kaun and Rothenfluh, 2017; Cognigni et al., 2018). Below we introduce some basic principles that govern the function of the MB, as an introduction to the neuronal machinery that processes positive reinforcement, which is required for reward learning. As such, this is not intended to be a comprehensive review of the MB [for detailed up to date reviews on the wiring and function of the MB see (Scaplen and Kaun, 2016; Felsenberg et al., 2017; Kaun and Rothenfluh, 2017; Cognigni et al., 2018)].
The MB is a brain area where visual (Vogt et al., 2014), gustatory (Kirkhart and Scott, 2015), thermal (Yagi et al., 2016), and olfactory (Stocker et al., 1990; Wong et al., 2002; Tanaka et al., 2004; Liu et al., 2008, 2012; Caron et al., 2013) information (conditioned stimuli) reaches a set of intrinsic neurons called Kenyon Cells (KC). KC axons run in parallel through MB lobes and synapse with different subsets of Mushroom Body Output Neurons (MBON) (Takemura et al., 2017), forming functionally segregated compartments. MBONs integrate sensory information with the valence of the experience (Hige et al., 2015), generating an association between the conditioned and unconditioned stimuli, and leading to associative memory formation. For this to happen, specific sub-populations of Dopaminergic Neurons (DAN) that innervate each compartment deliver information about the valence of the experience (unconditioned stimulus) (Thum et al., 2007; Aso et al., 2010, 2014a,b; Liu et al., 2012; Caron et al., 2013; Clowney et al., 2015) (reviewed by Das et al., 2016).
Activation of different populations of DANs is sufficient for aversive or appetitive memory formation when paired with a CS (reviewed by Waddell, 2013). Further functional dissections revealed that different subpopulations of DANs and MBONs encode information regarding the sweet vs. caloric value of the ingested food (Das et al., 2014), water reward (Shyu et al., 2017), aversive taste (Masek et al., 2015), electric shock memory (Unoki et al., 2005; Aso et al., 2010), and even specific short and long-term memory formation (Aso et al., 2014b). Memory formation, consolidation, retrieval, reconsolidation and/or extinction have been shown to occur via neuronal activities in specific parts of the MBONs and specific subsets of reinforcing DANs (Berry et al., 2012, 2015; Shuai et al., 2015; Aso and Rubin, 2016; Ichinose and Tanimoto, 2016) reviewed by Cognigni et al. (2018). Intriguingly, re-evaluation of previously learned appetitive memory was shown to be conveyed by the activity of a subset of MBONs that is anatomically connected to both aversive and appetitive DANs, and that extinction or re-consolidation of appetitive memories requires activity of both during re-evaluation (Felsenberg et al., 2017). Finally, a recent comprehensive connectome map of the entire MB alpha lobe that was generated by electron microscopy imaging, demonstrated that the interconnectivity between KCs, DANs and MBONs is even more intricate than previously thought, paving the path for further delineation of the underlying neurobiological principles of this brain region (Takemura et al., 2017).
Shared Molecular Machinery of Memory, Reward, and Drug-Related Behaviors in Model Organisms
Drug rewards converge on molecular and neural pathways that encode memory for natural rewards, and induce similar neuroplastic changes as natural rewards (reviewed by Hyman et al., 2006; Kauer and Malenka, 2007; Kalivas and O'Brien, 2008; Koob and Volkow, 2010). The cAMP, CREB dependent and ΔFosB pathways play a prominent role in mediating these long-term adaptive changes in neuronal function (Nestler, 2002; Mameli and Lüscher, 2011). An example of the crosstalk between natural reward, drug reward and neuroplasticity is demonstrated in studies where periods of abstinence from sexual experience increase the sensitization of rats to amphetamine reward (Bradley and Meisel, 2001; Pitchers et al., 2010). This sex experience-induced plasticity, which in turn causes enhanced drug reward, was shown to be mediated by dopamine 1 receptor (D1R)-dependent induction of ΔFosB in the nucleus accumbens (NAc) (Pitchers et al., 2013). A similar phenomenon was also documented in Drosophila, in which sexual deprivation increased the motivation to consume ethanol as a drug reward, by regulating the brain levels of neuropeptide F (NPF) (Shohat-Ophir et al., 2012).
As stated previously, the dopaminergic system plays a central role in processing natural rewards, and represents one way by which drugs of abuse induce changes in memory-related mechanisms (Di Chiara, 1999). In mammals, dopaminergic neurons show characteristic burst-firing activity during mating and food consumption (Dackis and O'Brien, 2001). Cocaine increases dopaminergic neurotransmission by blocking dopamine transport, preventing its removal from the synaptic cleft (Dackis and O'Brien, 2001). Reducing dopamine levels in fruit flies, using a competitive agonist to tyrosine hydroxylase (which converts tyrosine to L-Dopa), diminishes their sensitivity to cocaine and nicotine (Bainton et al., 2000). Dopamine release is also required for the expression of ethanol reward in fruit flies, as temporal block of neurotransmission in dopaminergic neurons prevented conditioned preference for ethanol-associated cues (Kaun et al., 2011). In addition, artificial activation of a certain dopamine neurons such as the protocerebral anterior medial (PAM neurons) is rewarding per se, as it induces robust appetitive odor memory in the absence of natural or drug reward (Liu et al., 2012).
Shared Mechanisms for Ethanol-Related Behaviors and Learning and Memory in Flies
Examining the connection between neuroplasticity and drug response, several studies tested whether established learning and memory mutants also depict aberrant behavioral phenotypes in acute ethanol response. The mutant cheapdate, which is an allele of the memory mutant amnesiac, caused increased sensitivity to the sedating effects of ethanol (Moore et al., 1998; Wolf and Heberlein, 2003). Another mutant, rut, exhibited increased ethanol hyperactivity and sensitivity (Wolf et al., 2002; Heberlein et al., 2004). In addition to acute responses to ethanol, learning and memory mutants revealed altered rapid and chronic tolerance responses to ethanol (for detailed list of genes see (Berger et al., 2008). For instance, the long-term memory mutant john displayed enhanced chronic tolerance in response to prolonged exposure (20–28 h) to low concentration of ethanol vapor (Berger et al., 2008).
Krasavietz (or exba), which encodes a translation initiation factor, is an example of a gene involved in learning and memory whose mutation affects both acute ethanol response and the motivation to consume ethanol. Krasavietz mutant flies exhibit decreased sensitivity to ethanol sedation (Berger et al., 2008), defects in the development of ethanol tolerance (Berger et al., 2008), and reduced voluntary consumption of ethanol (Devineni and Heberlein, 2009). Moreover, the expression of the memory gene rut in mushroom body (MB) neurons is necessary for robust ethanol consumption (Xu et al., 2012).
Recent studies identified new players that connect neuroplasticity and the formation of memories to the rewarding effects of ethanol intoxication. scabrous, which encodes a fibrinogen-related peptide that regulates Notch signaling, was shown to be necessary for the rewarding effects of ethanol intoxication (Kaun et al., 2011). Another study discovered that the sirtuin gene Sir2 (Sirt1), which deacetylates histones and transcription factors, is regulated by exposure to ethanol vapor, and is required for normal ethanol sensitivity, tolerance, and for ethanol preference and reward (Engel et al., 2016).
Lastly, although this review focuses on ethanol related behaviors, it is important to mention a study that tested the role of memory mutants in nicotine-induced motor sensitivity (Hou et al., 2004). Using a startle-induced climbing assay, measuring the effect of nicotine vapor on climbing ability, Hou et al. demonstrated that dunce mutant flies, which harbor higher basal levels of cAMP, exhibited increased sensitivity to the depressing effects of nicotine. In contrast, DCOH2 (Pka-C1H2) and DCOB3 (Pka-C1B3) mutants that are defective in PKA showed low sensitivity to nicotine (Hou et al., 2004).
Motivational States as an Orginizing Principle that Shapes Reward Processing
Animals continuously integrate their internal physiological state with environmental signals, and subsequently choose one action over another to increase their chances of survival and reproduction. As such, the state of the organism defines which stimuli are positively reinforced, negatively reinforced or considered negligible. A classic example of this is that fruit flies have to be hungry to express appetitive memory for sugar (Krashes and Waddell, 2008; Krashes et al., 2009; Gruber et al., 2013), highlighting the ability of internal signals such as hunger to modulate learned responses of cues associated with food.
An example of the interplay between states and reward processing can also be seen in aversive conditioning in fruit flies. Pairing a neutral odor with electric shock forms an association that predicts the arrival of pain. Conversely, presenting the odor following electric shock promotes appetitive behavior, and predicts the relief of pain, implying that the end of an aversive state can also be rewarding (Tanimoto et al., 2004). This indicates that even in flies, reward is not an absolute experience, but is relative to the state in which it is perceived. Repeated stressful experiences, such as repeated exposure to heat or electric shocks, where the fly cannot evade punishment by walking away, can induce a depression-like state, leading to decline in walking activity, similar to learned helplessness paradigms in rodents (Yang et al., 2013). Uncontrollable repeated mechanical stress in flies can induce long-lasting changes in motivational states, exhibited by reduced motivation to seek rewards and reduced 5HT (serotonin) levels (Ries et al., 2017). This depression-like state can be relieved by lithium treatment or artificial activation of serotonergic neurons that project to the MB (Ries et al., 2017).
Another aspect of the interplay between motivational states and reward is the concept that different motivational states are associated with particular drives (reward seeking behavior) and specific sensory sensitivity. For instance, food deprivation and satiety affect the extent of foraging behavior and food consumption, and modulate sensory perception of food related sensory stimuli (Lee and Park, 2004; Yu et al., 2004; Wu et al., 2005; Root et al., 2011; Inagaki et al., 2012, 2014b; Marella et al., 2012; Beshel and Zhong, 2013; Wang et al., 2013; Ko et al., 2015; Jourjine et al., 2016). This is achieved by coordinated regulation of several different neuropeptide and hormonal systems that integrate nutrient signals and metabolic inputs into regulation of homeostatic drives and modulation of sensory systems (Lee and Park, 2004; Yu et al., 2004; Wu et al., 2005; Inagaki et al., 2012, 2014b; Marella et al., 2012; Gruber et al., 2013; Wang et al., 2013; Jourjine et al., 2016) (reviewed by Landayan and Wolf, 2016). This presumably occurs via the activation of specific DAN innervating the MB. For example, it was recently shown that insulin triggers the opposing functions of two neuropeptide systems: short neuropeptide F (sNPF) and tachykinin, and this in turn regulates the sensitivity toward appetitive and aversive odors (Ko et al., 2015). Serotonergic neurons were also shown to modulate motivational states that regulate feeding behavior and sugar associated reward (Burke et al., 2012; Sitaraman et al., 2012). Recently, a set of 15 serotonergic neurons was identified, that when activated, induces a fed fly to eat as if it was food deprived, and promotes the formation of appetitive memory (Albin et al., 2015). These findings imply that specific sub-populations of neurons act to shift motivational states, and thus control the way by which sensory stimuli that is associated with the experience is processed and affects behavior.
NPF System as a Molecular Signature for Reward States
The NPF/NPF-receptor system is emerging as a central player in modulating and encoding motivational states associated with sugar reward, sexual, and drug reward, and the homeostatic regulation of motivational responses. The activity of NPF-expressing neurons mimics a state of food deprivation, and promotes rewarding memories in satiated flies, via a subset of downstream NPF receptor expressing dopaminergic neurons that innervate the MB (Krashes et al., 2009). Additional studies revealed NPF's role in encoding other motivational aspects of feeding, such as promoting feeding (Wu et al., 2005), encoding the valence/attractiveness of food related odors (Beshel and Zhong, 2013; Beshel et al., 2017), and enhancing sugar sensitivity in sugar-sensing sensory neurons (Inagaki et al., 2014b). In addition, NPF serves as a homeostatic integration point of two interconnected systems: sleep and feeding. NPF regulates starvation, which induces sleep suppression, suggesting that the NPF system acts to encode a hunger signal that promotes an arousal state associated with high motivation to seek food (Keene et al., 2010; He et al., 2013; Chung et al., 2017).
Another example that demonstrates the interplay between motivational states and ways by which reward stimuli are perceived, is the role of NPF in integrating sexual deprivation and drug related rewards. Male flies perceive both mating interactions and ethanol intoxication as rewarding (Kaun et al., 2011; Shohat-Ophir et al., 2012). Mated male flies exhibited reduced motivation to consume ethanol containing food and have had high levels of NPF transcript, while sexually deprived male flies exhibited higher motivation to consume ethanol containing food and lower NPF transcript levels. Furthermore, activation of NPF neurons is rewarding in itself, reduces ethanol consumption, and prevents the formation of appetitive memory toward ethanol. This implies that experiences that modulate motivational states, can affect the reinforcing value of other rewarding stimuli.
The causal link between environmental stimuli, NPF levels and modulation of motivational behaviors has been documented in several studies. Reduction in NPF transcription and the activity of NPF-positive neurons was observed in response to negative environmental inputs, such as the presence of parasitic wasps and sexual deprivation, while NPF induction occurred in response to mating and ethanol intoxication (Shohat-Ophir et al., 2012; Kacsoh et al., 2013; Gao et al., 2015). Altogether, this suggests that NPF neuronal systems are central to the interplay between states and reward processing. Still, further studies are required to uncover the mechanism that connect NPF neuronal activity to activity of all specific DANs that project to the MB, and the neuronal and cellular mechanisms that allow this system to represent and affect a general reward state in the brain.
The different roles of NPF/R system in regulating motivational and homeostatic features of behavior are conserved between flies and mammals. A large number of studies demonstrate the central role of NPY (the mammalian homolog of NPF) in regulating feeding and the motivation to feed (Tatemoto et al., 1982; Clark et al., 1984; Flood and Morley, 1991; Kalra et al., 1997; Bannon et al., 2000; Day et al., 2005; Keen-Rhinehart and Bartness, 2007). A recent study uncovered a functional link between firing activities of NPY/AgRP neurons and energy homeostasis, wherein starvation induces an increase in NPY/AgRP firing rate, which in turn promotes re-feeding (He et al., 2016). The NPY system also functions in regulating sleep and wake homeostasis (Szentirmai and Krueger, 2006; Wiater et al., 2011; He et al., 2013). A study performed in zebrafish (Danio rerio) identified NPY signaling and NPY expressing neurons as regulators of zebrafish sleep, promoting sleep by inhibiting noradrenergic signaling, thus linking NPY signaling to an established arousal promoting system (Singh et al., 2017). In addition to its role in regulating natural physiological response, NPY has long been implicated in regulating drug addiction (for review on its role in ethanol addiction see (Thorsell and Mathé, 2017). NPY administration relieves the negative affective states of drug withdrawal and depression (Stogner and Holmes, 2000; Redrobe et al., 2002). Recently, a neuronal mechanism for the interplay between stress and reward systems on ethanol binge drinking was dissected in mice and monkeys, providing the first evidence for NPY and CRF functional interaction within neurons of the BNST (a limbic brain structure that is enriched with NPY and CRF neurons) (Pleil et al., 2015). Activation of the NPY Y1 receptor in the BNST led to enhanced inhibitory synaptic transmission in CRF neurons, which reduced binge alcohol drinking (Pleil et al., 2015). Their findings propose CRF neuronal function as a target for future therapies aimed to prevent and treat alcohol abuse.
The risk of developing addiction is determined by molecular and neuronal mechanisms that influence the likelihood of progressing from initial drug exposure to repeated use. These mechanisms can shape the experience of initial consumption, the amount consumed, and the relative value of its reinforcing properties (Figure 2). For instance, genetic variations in bitter taste receptor and ethanol metabolism pathway influence the risk to develop addiction (Hinrichs et al., 2006; Yu and McClellan, 2016). Enhanced sensitivity to bitter taste is associated with reduced risk, and variations in ethanol metabolism lead to enhanced negative side effects and reduce the likelihood of repeated use, and therefore the risk to develop addiction (Figure 2). Studies in Drosophila demonstrated the functional link between ethanol metabolism and sensitivity to acute ethanol exposure (Ogueta et al., 2010). Other genetic components that control sensitivity to the hedonic and sedating effects of ethanol play a role in determining the extent of initial consumption and likelihood of repeated use. Upon repeated use, genetic factors that determine the extent of tolerance to ethanol-mediated responses can also shape the amount that is needed to reach the euphoric state (Figure 2).
Figure 2. Schematic model illustrating the genetic and motivational elements that influence the likelihood of progressing from initial exposure to repeated use. Red spiral depicts the multistage progression from initial drug exposure to drug dependence and addiction and the behavioral features that are shaped by molecular and neuronal mechanisms. Blue arc depicts the way by which internal state can modulate different features in reward processing via molecular and neuronal mechanisms affecting sensory sensitivity to reward related cues, the motivation to seek and obtain rewards, and the reinforcing value of the consumed reward.
An analogy for reward states can be proposed in which high reward state is illustrated by a full “reservoir” and low state by an empty “reservoir.” One can speculate that vulnerability to addiction is related to the size of “reservoir” to be filled (Bar, 2012). According to this model, bigger reservoir will require greater amounts of rewarding experiences in order to be filled. In addition, individuals can possess different sensitivity to fluctuations in the levels of reward within the reservoir, where sensitive individuals have increased motivation to fill up the reservoir with any type of reward, while others will be less affected by fluctuations, corresponding to reduced reward-seeking behavior.
Lastly, prior experience/motivational states can also enter into this equation, modulating different aspects of drug response. For instance, social isolation affects sensitivity to ethanol sedation (Eddison et al., 2011), pain can modulate the perception of reward-related cues (Tanimoto et al., 2004), while sexual deprivation and stress modulate the motivation to seek and obtain rewards (Shohat-Ophir et al., 2012; Ries et al., 2017; Figure 2). It is postulated that these different conditions shape the repertoire and function of proteins within neurons that mediate reward processing. As a consequence, the reward baseline is shifted, which presumably modulates the motivation to obtain rewards, the value of the consumed reward, and the likelihood to continue consuming drug rewards (Figure 2). Still, the means by which different conditions and prior experiences are encoded in the reward system and lead to changes in motivational states are largely unknown.
Recent advances in the ability to purify RNA from genetically tagged neuronal populations (Henry et al., 2012; Abruzzi et al., 2015), coupled with improvement in RNAseq technologies, make it now possible to bridge the gap between the specific transcriptomic repertoire and specific experiences/states. In this respect, it is now possible to profile the repertoire of coding mRNA, non-coding RNAs, and RNA modifications such as RNA editing, as well as the metabolome and proteome of specific neurons in every state. This can facilitate studies exploring the contributions of co-transcriptional mechanisms such as RNA editing, post-transcriptional mechanisms such as RNA methylation, and post-translational mechanisms in shaping the vulnerability to drug addiction. Further in-depth mechanistic studies will be required to connect specific regulation events to their functional relevance in shaping the transition from initial drug use to addiction.
All authors listed have made a substantial, direct and intellectual contribution to the work, and approved it for publication.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
We thank the GS-O lab members for fruitful discussions. This work was supported by the Israel Science Foundation (384/14).
Albin, S. D., Kaun, K. R., Knapp, J. M., Chung, P., Heberlein, U., and Simpson, J. H. (2015). A subset of serotonergic neurons evokes hunger in adult Drosophila. Curr. Biol. 25, 2435–2440. doi: 10.1016/j.cub.2015.08.005
Aso, Y., Grübel, K., Busch, S., Friedrich, A. B., Siwanowicz, I., and Tanimoto, H. (2009). The mushroom body of adult Drosophila characterized by GAL4 drivers. J. Neurogenet. 23, 156–172. doi: 10.1080/01677060802471718
Aso, Y., Hattori, D., Yu, Y., Johnston, R. M., Iyer, N. A., Ngo, T. T. B., et al. (2014a). The neuronal architecture of the mushroom body provides a logic for associative learning. Elife 3:e04577. doi: 10.7554/eLife.04577
Aso, Y., Sitaraman, D., Ichinose, T., Kaun, K. R., Vogt, K., Belliart-Guérin, G., et al. (2014b). Mushroom body output neurons encode valence and guide memory-based action selection in Drosophila. Elife 3:e04580. doi: 10.7554/eLife.04580
Aso, Y., Siwanowicz, I., Bräcker, L., Ito, K., Kitamoto, T., and Tanimoto, H. (2010). Specific dopaminergic neurons for the formation of labile aversive memory. Curr. Biol. 20, 1445–1451. doi: 10.1016/j.cub.2010.06.048
Azanchi, R., Kaun, K. R., and Heberlein, U. (2013). Competing dopamine neurons drive oviposition choice for ethanol in Drosophila. Proc. Natl. Acad. Sci. U.S.A. 110, 21153–21158. doi: 10.1073/pnas.1320208110
Bainton, R. J., Tsai, L. T., Singh, C. M., Moore, M. S., Neckameyer, W. S., and Heberlein, U. (2000). Dopamine modulates acute responses to cocaine, nicotine and ethanol in Drosophila. Curr. Biol. 10, 187–194. doi: 10.1016/S0960-9822(00)00336-5
Bannon, A., Seda, J., Carmouche, M., Francis, J., Norman, M., Karbon, B., et al. (2000). Behavioral characterization of neuropeptide Y knockout mice. Brain Res. 868, 79–87. doi: 10.1016/S0006-8993(00)02285-X
Berger, K. H., Heberlein, U., and Moore, M. S. (2004). Rapid and chronic: two distinct forms of ethanol tolerance in Drosophila. Alcohol. Clin. Exp. Res. 28, 1469–1480. doi: 10.1097/01.ALC.0000141817.15993.98
Berger, K. H., Kong, E. C., Dubnau, J., Tully, T., Moore, M. S., and Heberlein, U. (2008). Ethanol sensitivity and tolerance in long-term memory mutants of Drosophila melanogaster. Alcohol. Clin. Exp. Res. 32, 895–908. doi: 10.1111/j.1530-0277.2008.00659.x
Berry, J. A., Cervantes-sandoval, I., Chakraborty, M., and Davis, R. L. (2015). Sleep facilitates memory by blocking dopamine neuron mediated forgetting. Cell 161, 1656–1667. doi: 10.1016/j.cell.2015.05.027
Beshel, J., Dubnau, J., and Zhong, Y. (2017). A leptin analog locally produced in the brain acts via a conserved neural circuit to modulate obesity-linked behaviors in Drosophila. Cell Metab. 25, 208–217. doi: 10.1016/j.cmet.2016.12.013
Bradley, K. C., and Meisel, R. L. (2001). Sexual behavior induction of c-Fos in the nucleus accumbens and amphetamine-stimulated locomotor activity are sensitized by previous sexual experience in female Syrian hamsters. J. Neurosci. 21, 2123–2130.
Burke, C. J., Huetteroth, W., Owald, D., Perisse, E., Krashes, M. J., Das, G., et al. (2012). Layered reward signalling through octopamine and dopamine in Drosophila. Nature 492, 433–437. doi: 10.1038/nature11614
Chung, B. Y., Ro, J., Hutter, S. A., Miller, K. M., Guduguntla, L. S., Kondo, S., et al. (2017). Drosophila neuropeptide F signaling independently regulates feeding and sleep-wake behavior. Cell Rep. 19, 2441–2450. doi: 10.1016/j.celrep.2017.05.085
Clark, J. T., Kalra, P. S., Crowley, W. R., and Kalra, S. P. (1984). Neuropeptide Y and human pancreatic polypeptide stimulate feeding behavior in rats. Endocrinology 115, 427–429. doi: 10.1210/endo-115-1-427
Clowney, E. J., Iguchi, S., Bussell, J. J., Scheer, E., and Ruta, V. (2015). Multimodal chemosensory circuits controlling male courtship in Drosophila. Neuron 87, 1036–1049. doi: 10.1016/j.neuron.2015.07.025
Cognigni, P., Felsenberg, J., and Waddell, S. (2018). Do the right thing: neural network mechanisms of memory formation, expression and update in Drosophila. Curr. Opin. Neurobiol. 49, 51–58. doi: 10.1016/j.conb.2017.12.002
Cohan, F. M., and Graf, J. D. (1985). Latitudinal cline in Drosophila melanogaster for knockdown resistance to ethanol fumes and for rates of response to selection for further resistance. Evolution 39, 278–293.
Cohan, F. M., and Hoffmann, A. A. (1986). Genetic divergence under uniform selection. II. Different responses to selection for knockdown resistance to ethanol among Drosophila melanogaster populations and their replicate lines. Genetics 114, 145–164.
Collins, R. J., Weeks, J. R., Cooper, M. M., Good, P. I., and Russell, R. R. (1984). Prediction of abuse liability of drugs using IV self-administration by rats. Psychopharmacology 82, 6–13. doi: 10.1007/BF00426372
Connolly, J. B., Roberts, I. J. H., Armstrong, J. D., Kaiser, K., Forte, M., Tully, T., et al. (1996). Associative learning disrupted by impaired Gs signaling in Drosophila mushroom bodies. Science 274, 2104–2107.
Corl, A. B., Berger, K. H., Ophir-Shohat, G., Gesch, J., Simms, J. A., Bartlett, S. E., et al. (2009). Happyhour, a Ste20 family kinase, implicates EGFR signaling in ethanol-induced behaviors. Cell 137, 949–960. doi: 10.1016/j.cell.2009.03.020
Cowmeadow, R. B., Krishnan, H. R., Ghezzi, A., Al'Hasan, Y. M., Wang, Y. Z., and Atkinson, N. S. (2006). Ethanol tolerance caused by slowpoke induction in Drosophila. Alcohol. Clin. Exp. Res. 30, 745–753. doi: 10.1111/j.1530-0277.2006.00087.x
Das, G., Klappenbach, M., Vrontou, E., Perisse, E., Clark, C. M., Burke, C. J., et al. (2014). Drosophila learn opposing components of a compound food stimulus. Curr. Biol. 24, 1723–1730. doi: 10.1016/j.cub.2014.05.078
Day, D. E., Keen-Rhinehart, E., and Bartness, T. J. (2005). Role of NPY and its receptor subtypes in foraging, food hoarding, and food intake by Siberian hamsters. Am. J. Physiol. Integr. Comp. Physiol. 289, R29–R36. doi: 10.1152/ajpregu.00853.2004
Devineni, A. V., Eddison, M., and Heberlein, U. (2013). The novel gene tank, a tumor suppressor homolog, regulates ethanol sensitivity in Drosophila. J. Neurosci. 33, 8134–8143. doi: 10.1523/JNEUROSCI.3695-12.2013
Duan, Y., Shen, F., Gu, T., and Sui, N. (2016). Addiction: from context-induced hedonia to appetite, based on transition of micro-behaviors in morphine abstinent tree shrews. Front. Psychol. 7:816. doi: 10.3389/fpsyg.2016.00816
Dudley, R. (2002). Fermenting fruit and the historical ecology of ethanol ingestion: is alcoholism in modern humans an evolutionary hangover? Addiction 97, 381–388. doi: 10.1046/j.1360-0443.2002.00002.x
Eddison, M., Guarnieri, D. J., Cheng, L., Liu, C.-H., Moffat, K. G., Davis, G., et al. (2011). Arouser reveals a role for synapse number in the regulation of ethanol sensitivity. Neuron 70, 979–990. doi: 10.1016/j.neuron.2011.03.030
Engel, G. L., Marella, S., Kaun, K. R., Wu, J., Adhikari, P., Kong, E. C., et al. (2016). Sir2/Sirt1 links acute inebriation to presynaptic changes and the development of alcohol tolerance, preference, and reward. J. Neurosci. 36, 5241–5251. doi: 10.1523/JNEUROSCI.0499-16.2016
Ghezzi, A., Al-Hasan, Y. M., Krishnan, H. R., Wang, Y., and Atkinson, N. S. (2013a). Functional mapping of the neuronal substrates for drug tolerance in Drosophila. Behav. Genet. 43, 227–240. doi: 10.1007/s10519-013-9583-0
Ghezzi, A., Al-Hasan, Y. M., Larios, L. E., Bohm, R. A., and Atkinson, N. S. (2004). slo K(+) channel gene regulation mediates rapid drug tolerance. Proc. Natl. Acad. Sci. U.S.A. 101, 17276–17281. doi: 10.1073/pnas.0405584101
Ghezzi, A., Krishnan, H. R., Lew, L., Prado, F. J., Ong, D. S., and Atkinson, N. S. (2013b). Alcohol-induced histone acetylation reveals a gene network involved in alcohol tolerance. PLoS Genet. 9:e1003986. doi: 10.1371/journal.pgen.1003986
Gibson, J. B., May, T. W., and Wilks, A. V. (1981). Genetic variation at the alcohol dehydrogenase locus in Drosophila Melanogaster in relation to environmental variation: ethanol levels in breeding sites and allozyme frequencies. Oecologia 51, 191–198. doi: 10.1007/BF00540600
Gruber, F., Knapek, S., Fujita, M., Matsuo, K., Bräcker, L., Shinzato, N., et al. (2013). Suppression of conditioned odor approach by feeding is independent of taste and nutritional value in drosophila. Curr. Biol. 23, 507–514. doi: 10.1016/j.cub.2013.02.010
He, C., Cong, X., Zhang, R., Wu, D., An, C., and Zhao, Z. (2013). Regulation of circadian locomotor rhythm by neuropeptide Y-like system in Drosophila melanogaster. Insect Mol. Biol. 22, 376–388. doi: 10.1111/imb.12027
He, Y., Shu, G., Yang, Y., Xu, P., Xia, Y., Wang, C., et al. (2016). A small potassium current in AgRP/NPY neurons regulates feeding behavior and energy metabolism. Cell Rep. 17, 1807–1818. doi: 10.1016/j.celrep.2016.10.044
Heberlein, U., Wolf, F. W., Rothenfluh, A., and Guarnieri, D. J. (2004). Molecular genetic analysis of ethanol intoxication in Drosophila melanogaster. Integr. Comp. Biol. 44, 269–274. doi: 10.1093/icb/44.4.269
Hinrichs, A. L., Wang, J. C., Bufe, B., Kwon, J. M., Budde, J., Allen, R., et al. (2006). Functional variant in a bitter-taste receptor (hTAS2R16) influences risk of alcohol dependence. Am. J. Hum. Genet. 78, 103–111. doi: 10.1086/499253
Hou, J., Kuromi, H., Fukasawa, Y., Ueno, K., Sakai, T., and Kidokoro, Y. (2004). Repetitive exposures to nicotine induce a hyper-responsiveness via the cAMP/PKA/CREB signal pathway in Drosophila. J. Neurobiol. 60, 249–261. doi: 10.1002/neu.20021
Hyman, S. E., Malenka, R. C., and Nestler, E. J. (2006). Neural mechanisms of addiction: the role of reward-related learning and memory. Annu. Rev. Neurosci. 29, 565–598. doi: 10.1146/annurev.neuro.29.051605.113009
Inagaki, H. K., Ben-Tabou de-Leon, S., Wong, A. M., Jagadish, S., Ishimoto, H., Barnea, G., et al. (2012). Visualizing neuromodulation in vivo: TANGO-mapping of dopamine signaling reveals appetite control of sugar sensing. Cell 148, 583–595. doi: 10.1016/j.cell.2011.12.022
Inagaki, H. K., Jung, Y., Hoopfer, E. D., Wong, A. M., Mishra, N., Lin, J. Y., et al. (2014a). Optogenetic control of Drosophila using a red-shifted channelrhodopsin reveals experience-dependent influences on courtship. Nat. Methods 11, 325–332. doi: 10.1038/nmeth.2765
Inagaki, H. K., Panse, K. M., and Anderson, D. J. (2014b). Independent, reciprocal neuromodulatory control of sweet and bitter taste sensitivity during starvation in Drosophila. Neuron 84, 806–820. doi: 10.1016/j.neuron.2014.09.032
Ja, W. W., Carvalho, G. B., Mak, E. M., de la Rosa, N. N., Fang, A. Y., Liong, J. C., et al. (2007). Prandiology of Drosophila and the CAFE assay. Proc. Natl. Acad. Sci. U.S.A. 104, 8253–8256. doi: 10.1073/pnas.0702726104
Kalra, P. S., Dube, M. G., Xu, B., and Kalra, S. P. (1997). Increased receptor sensitivity to neuropeptide Y in the hypothalamus may underlie transient hyperphagia and body weight gain. Regul. Pept. 72, 121–130. doi: 10.1016/S0167-0115(97)01045-8
Kapfhamer, D., King, I., Zou, M. E., Lim, J. P., Heberlein, U., and Wolf, F. W. (2012). JNK pathway activation is controlled by Tao/TAOK3 to modulate ethanol sensitivity. PLoS ONE 7:e50594. doi: 10.1371/journal.pone.0050594
Kapfhamer, D., Taylor, S., Zou, M. E., Lim, J. P., Kharazia, V., and Heberlein, U. (2013). Taok2 controls behavioral response to ethanol in mice. Genes. Brain. Behav. 12, 87–97. doi: 10.1111/j.1601-183X.2012.00834.x
Keene, A. C., Duboué, E. R., McDonald, D. M., Dus, M., Suh, G. S., Waddell, S., et al. (2010). Clock and cycle limit starvation-induced sleep loss in drosophila. Curr. Biol. 20, 1209–1215. doi: 10.1016/j.cub.2010.05.029
Keen-Rhinehart, E., and Bartness, T. J. (2007). MTII attenuates ghrelin- and food deprivation-induced increases in food hoarding and food intake. Horm. Behav. 52, 612–620. doi: 10.1016/j.yhbeh.2007.07.014
King, I. F., Eddison, M., Kaun, K. R., and Heberlein, U. (2014). EGFR and FGFR pathways have distinct roles in Drosophila mushroom body development and ethanol-induced behavior. PLoS ONE 9:e87714. doi: 10.1371/journal.pone.0087714
King, I., Tsai, L. T., Pflanz, R., Voigt, A., Lee, S., Jäckle, H., et al. (2011). Drosophila tao controls mushroom body development and ethanol-stimulated behavior through par-1. J. Neurosci. 31, 1139–1148. doi: 10.1523/JNEUROSCI.4416-10.2011
Ko, K. I., Root, C. M., Lindsay, S. A., Zaninovich, O. A., Shepherd, A. K., Wasserman, S. A., et al. (2015). Starvation promotes concerted modulation of appetitive olfactory behavior via parallel neuromodulatory circuits. Elife 4:e08298. doi: 10.7554/eLife.08298
Kong, E. C., Allouche, L., Chapot, P. A., Vranizan, K., Moore, M. S., Heberlein, U., et al. (2010). Ethanol-regulated genes that contribute to ethanol sensitivity and rapid tolerance in Drosophila. Alcohol. Clin. Exp. Res. 34, 302–316. doi: 10.1111/j.1530-0277.2009.01093.x
Krashes, M. J., DasGupta, S., Vreede, A., White, B., Armstrong, J. D., and Waddell, S. (2009). A neural circuit mechanism integrating motivational state with memory expression in Drosophila. Cell 139, 416–427. doi: 10.1016/j.cell.2009.08.035
Krashes, M. J., and Waddell, S. (2008). Rapid consolidation to a radish and protein synthesis-dependent long-term memory after single-session appetitive olfactory conditioning in Drosophila. J. Neurosci. 28, 3103–3113. doi: 10.1523/JNEUROSCI.5333-07.2008
Krishnan, H. R., Al-Hasan, Y. M., Pohl, J. B., Ghezzi, A., and Atkinson, N. S. (2012). A role for dynamin in triggering ethanol tolerance. Alcohol. Clin. Exp. Res. 36, 24–34. doi: 10.1111/j.1530-0277.2011.01587.x
Lasek, A. W., Gesch, J., Giorgetti, F., Kharazia, V., and Heberlein, U. (2011a). Alk is a transcriptional target of LMO4 and ERα that promotes cocaine sensitization and reward. J. Neurosci. 31, 14134–14141. doi: 10.1523/JNEUROSCI.3415-11.2011
Lasek, A. W., Giorgetti, F., Berger, K. H., Tayor, S., and Heberlein, U. (2011b). Lmo genes regulate behavioral responses to ethanol in Drosophila melanogaster and the mouse. Alcohol. Clin. Exp. Res. 35, 1600–1606. doi: 10.1111/j.1530-0277.2011.01506.x
Lasek, A. W., Lim, J., Kliethermes, C. L., Berger, K. H., Joslyn, G., Brush, G., et al. (2011c). An evolutionary conserved role for anaplastic lymphoma kinase in behavioral responses to ethanol. PLoS ONE 6:e22636. doi: 10.1371/journal.pone.0022636
Lee, G., and Park, J. H. (2004). Hemolymph sugar homeostasis and starvation-induced hyperactivity affected by genetic manipulations of the adipokinetic hormone-encoding gene in Drosophila melanogaster. Genetics 167, 311–323. doi: 10.1534/genetics.167.1.311
Liu, C., Plaçais, P.-Y., Yamagata, N., Pfeiffer, B. D., Aso, Y., Friedrich, A. B., et al. (2012). A subset of dopamine neurons signals reward for odour memory in Drosophila. Nature 488, 512–516. doi: 10.1038/nature11304
Liu, X., Caggiula, A. R., Palmatier, M. I., Donny, E. C., and Sved, A. F. (2008). Cue-induced reinstatement of nicotine-seeking behavior in rats: effect of bupropion, persistence over repeated tests, and its dependence on training dose. Psychopharmacology 196, 365–375. doi: 10.1007/s00213-007-0967-9
Lynch, W. J., Nicholson, K. L., Dance, M. E., Morgan, R. W., and Foley, P. L. (2010). Animal models of substance abuse and addiction: implications for science, animal welfare, and society. Comp. Med. 60, 177–188.
Maiya, R., Mangieri, R. A., Morrisett, R. A., Heberlein, U., and Messing, R. O. (2015). A selective role for Lmo4 in cue-reward learning. J. Neurosci. 35, 9638–9647. doi: 10.1523/JNEUROSCI.1740-15.2015
Mantsch, J. R., Baker, D. A., Funk, D., Lê, A. D., and Shaham, Y. (2016). Stress-induced reinstatement of drug seeking: 20 years of progress. Neuropsychopharmacology 41, 335–356. doi: 10.1038/npp.2015.142
Masek, P., Worden, K., Aso, Y., Rubin, G. M., and Keene, A. C. (2015). A dopamine-modulated neural circuit regulating aversive taste memory in drosophila. Curr. Biol. 25, 1535–1541. doi: 10.1016/j.cub.2015.04.027
McClure, K. D., and Heberlein, U. (2013). A small group of neurosecretory cells expressing the transcriptional regulator apontic and the neuropeptide corazonin mediate ethanol sedation in Drosophila. J. Neurosci. 33, 4044–4054. doi: 10.1523/JNEUROSCI.3413-12.2013
Moore, M. S., DeZazzo, J., Luk, A. Y., Tully, T., Singh, C. M., and Heberlein, U. (1998). Ethanol intoxication in Drosophila: genetic and pharmacological evidence for regulation by the cAMP signaling pathway. Cell 93, 997–1007. doi: 10.1016/S0092-8674(00)81205-2
Ogueta, M., Cibik, O., Eltrop, R., Schneider, A., and Scholz, H. (2010). The influence of Adh function on ethanol preference and tolerance in adult Dsrosophila melanogaster. Chem. Senses 35, 813–822. doi: 10.1093/chemse/bjq084
Ojelade, S. A., Jia, T., Rodan, A. R., Chenyang, T., Kadrmas, J. L., Cattrell, A., et al. (2015). Rsu1 regulates ethanol consumption in Drosophila and humans. Proc. Natl. Acad. Sci. U.S.A. 112, E4085–E4093. doi: 10.1073/pnas.1417222112
Patrono, E., Gasbarri, A., Tomaz, C., and Nishijo, H. (2016). Transitionality in addiction: a “temporal continuum” hypotheses involving the aberrant motivation, the hedonic dysregulation, and the aberrant learning. Med. Hypotheses 93, 62–70. doi: 10.1016/j.mehy.2016.05.015
Peru y Colón de Portugal, R. L., Ojelade, S. A., Penninti, P. S., Dove, R. J., Nye, M. J., Acevedo, S. F., et al. (2014). Long-lasting, experience-dependent alcohol preference in Drosophila. Addict. Biol. 19, 392–401. doi: 10.1111/adb.12105
Pitchers, K. K., Balfour, M. E., Lehman, M. N., Richtand, N. M., Yu, L., and Coolen, L. M. (2010). Neuroplasticity in the mesolimbic system induced by natural reward and subsequent reward abstinence. Biol. Psychiatry 67, 872–879. doi: 10.1016/j.biopsych.2009.09.036
Pitchers, K. K., Vialou, V., Nestler, E. J., Laviolette, S. R., Lehman, M. N., and Coolen, L. M. (2013). Natural and drug rewards act on common neural plasticity mechanisms with ΔFosB as a key mediator. J. Neurosci. 33, 3434–3442. doi: 10.1523/JNEUROSCI.4881-12.2013
Pleil, K. E., Rinker, J. A., Lowery-gionta, E. G., Mazzone, C. M., Mccall, N. M., Kendra, A. M., et al. (2015). NPY signaling inhibits extended amygdala CRF neurons to suppress binge alcohol drinking. Nat. Neurosci. 18, 545–552. doi: 10.1038/nn.3972
Pohl, J. B., Baldwin, B. A., Dinh, B. L., Rahman, P., Smerek, D., Prado, F. J., et al. (2012). Ethanol preference in Drosophila melanogaster is driven by its caloric value. Alcohol. Clin. Exp. Res. 36, 1903–1912. doi: 10.1111/j.1530-0277.2012.01817.x
Pohl, J. B., Ghezzi, A., Lew, L. K., Robles, R. B., Cormack, L., and Atkinson, N. S. (2013). Circadian genes differentially affect tolerance to ethanol in Drosophila. Alcohol. Clin. Exp. Res. 37, 1862–1871. doi: 10.1111/acer.12173
Redrobe, J., Dumont, Y., Fournier, A., and Quirion, R. (2002). The neuropeptide Y (NPY) Y1 receptor subtype mediates NPY-induced antidepressant-like activity in the mouse forced swimming test. Neuropsychopharmacology 26, 615–624. doi: 10.1016/S0893-133X(01)00403-1
Scaplen, K. M., and Kaun, K. R. (2016). Reward from bugs to bipeds: a comparative approach to understanding how reward circuits function. J. Neurogenet. 30, 133–148. doi: 10.1080/01677063.2016.1180385
Shao, L., Saver, M., Chung, P., Ren, Q., Lee, T., Kent, C. F., et al. (2017). Dissection of the Drosophila neuropeptide F circuit using a high-throughput two-choice assay. Proc. Natl. Acad. Sci. U.S.A. 114, E8091–E8099. doi: 10.1073/pnas.1710552114
Shuai, Y., Hirokawa, A., Ai, Y., Zhang, M., Li, W., and Zhong, Y. (2015). Dissecting neural pathways for forgetting in Drosophila olfactory aversive memory. Proc. Natl. Acad. Sci. U.S.A. 112, E6663–E6672. doi: 10.1073/pnas.1512792112
Shyu, W., Chiu, T., Chiang, M., Cheng, Y., Tsai, Y.-L., Fu, T.-F., et al. (2017). Neural circuits for long-term water-reward memory processing in thirsty Drosophila. Nat. Commun. 8:15230. doi: 10.1038/ncomms15230
Siegal, M. L., and Hartl, D. L. (1999). Oviposition-site preference in Drosophila following interspecific gene transfer of the alcohol dehydrogenase locus. Behav. Genet. 29, 199–204. doi: 10.1023/A:1021648103496
Sitaraman, D., LaFerriere, H., Birman, S., and Zars, T. (2012). Serotonin is critical for rewarded olfactory short-term memory in Drosophila. J. Neurogenet. 26, 238–244. doi: 10.3109/01677063.2012.666298
Tanaka, N. K., Awasaki, T., Shimada, T., and Ito, K. (2004). Integration of chemosensory pathways in the drosophila second-order olfactory centers. Curr. Biol. 14, 449–457. doi: 10.1016/j.cub.2004.03.006
Tatemoto, K., Carlquist, M., and Mutt, V. (1982). Neuropeptide Y–a novel brain peptide with structural similarities to peptide YY and pancreatic polypeptide. Nature 296, 659–660. doi: 10.1038/296659a0
Thum, A. S., Jenett, A., Ito, K., Heisenberg, M., and Tanimoto, H. (2007). Multiple memory traces for olfactory reward learning in Drosophila. J. Neurosci. 27, 11132–11138. doi: 10.1523/JNEUROSCI.2712-07.2007
Troutwine, B. R., Ghezzi, A., Pietrzykowski, A. Z., and Atkinson, N. S. (2016). Alcohol resistance in Drosophila is modulated by the Toll innate immune pathway. Genes. Brain. Behav. 15, 382–394. doi: 10.1111/gbb.12288
Unoki, S., Matsumoto, Y., and Mizunami, M. (2005). Participation of octopaminergic reward system and dopaminergic punishment system in insect olfactory learning revealed by pharmacological study. Eur. J. Neurosci. 22, 1409–1416. doi: 10.1111/j.1460-9568.2005.04318.x
Vogt, K., Schnaitmann, C., Dylla, K. V., Knapek, S., Aso, Y., Rubin, G. M., et al. (2014). Shared mushroom body circuits underlie visual and olfactory memories in Drosophila. Elife 3:e02395. doi: 10.7554/eLife.02395
Waddell, S., Armstrong, J. D., Kitamoto, T., Kaiser, K., and Quinn, W. G. (2000). The amnesiac gene product is expressed in two neurons in the Drosophila brain that are critical for memory. Cell 103, 805–813. doi: 10.1016/S0092-8674(00)00183-5
Wiater, M. F., Mukherjee, S., Li, A.-J., Dinh, T. T., Rooney, E. M., Simasko, S. M., et al. (2011). Circadian integration of sleep-wake and feeding requires NPY receptor-expressing neurons in the mediobasal hypothalamus. Am. J. Physiol. Integr. Comp. Physiol. 301, R1569–R1583. doi: 10.1152/ajpregu.00168.2011
Wolffgramm, J., and Heyne, A. (1995). From controlled drug intake to loss of control: the irreversible development of drug addiction in the rat. Behav. Brain Res. 70, 77–94. doi: 10.1016/0166-4328(95)00131-C
Xu, S., Chan, T., Shah, V., Zhang, S., Pletcher, S. D., Roman, G., et al. (2012). The propensity for consuming ethanol in Drosophila requires rutabaga adenylyl cyclase expression within mushroom body neurons. Genes. Brain. Behav. 11, 727–739. doi: 10.1111/j.1601-183X.2012.00810.x
Yagi, R., Mabuchi, Y., Mizunami, M., and Tanaka, N. K. (2016). Convergence of multimodal sensory pathways to the mushroom body calyx in Drosophila melanogaster. Sci. Rep. 6:29481. doi: 10.1038/srep29481
Yu, D., Ponomarev, A., and Davis, R. L. (2004). Altered representation of the spatial code for odors after olfactory classical conditioning: memory trace formation by synaptic recruitment. Neuron 42, 437–449. doi: 10.1016/S0896-6273(04)00217-X
Keywords: Drosophila melanogaster, reward, ethanol, addiction, learning and memory, natural reward, drug reward, animal models
Citation: Ryvkin J, Bentzur A, Zer-Krispil S and Shohat-Ophir G (2018) Mechanisms Underlying the Risk to Develop Drug Addiction, Insights From Studies in Drosophila melanogaster. Front. Physiol. 9:327. doi: 10.3389/fphys.2018.00327
Received: 30 December 2017; Accepted: 15 March 2018;
Published: 24 April 2018.
Edited by:Robert Huber, Bowling Green State University, United States
Reviewed by:Karla Kaun, Brown University, United States
Astrid Rohwedder, Leipzig University, Germany
Adrian Rothenfluh, University of Utah, United States
Copyright © 2018 Ryvkin, Bentzur, Zer-Krispil and Shohat-Ophir. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Galit Shohat-Ophir, email@example.com
†These authors have contributed equally to this work.