Professional Documents
Culture Documents
Research Highlight
Do Substantia Nigra Dopaminergic Neurons
Differentiate Between Reward and Punishment?
Michael J. Frank1 and D. James Surmeier2,*
1 Departments of Cognitive & Linguistic Sciences, Psychology, and Psychiatry, Brown University, 190 Thayer Street, Providence, RI 02912-1978, USA
2 Department of Physiology, Northwestern University, 303 E. Chicago Ave., Chicago, IL 60611, USA
* Correspondence to: D. James Surmeier, E-mail: j-surmeier@northwestern.edu
The activity of dopaminergic neurons are thought to be increased by stimuli that predict reward and decreased by stimuli that predict
aversive outcomes. Recent work by Matsumoto and Hikosaka challenges this model by asserting that stimuli associated with either
A wealth of evidence over the past two It is widely assumed that all midbrain unexpected. Thus, these cells appear to
decades has implicated the dopaminergic dopaminergic cells, from the ventral teg- encode something akin to salience,
system in encoding ‘reward prediction mental area (VTA) to the substantia nigra perhaps reflecting the absolute value of
errors’ (RPEs). That is, when animals and pars compacta (SNc), convey a common, RPE.
humans experience a reward or an event global RPE signal. In a recent Nature One limitation of the Matsumoto and
that is better than expected, midbrain article, Matsumoto and Hikosaka (2009) Hikosaka study is that the neurons
dopaminergic neurons exhibit phasic have challenged this assumption. They recorded were not histochemically ident-
burst firing, with the magnitude of the trained monkeys with a classical condition- ified. As in most in vivo studies, neurons
firing-rate increase correlated with the ing procedure in which some stimuli were were identified using electrophysiological
degree to which the outcome is better strongly or weakly predictive of a liquid criteria and their phasic excitation to free
than expected. Conversely, events that reward, whereas other stimuli were reward. Although this strategy has been
are worse than expected are accompanied strongly predictive of an aversive airpuff used widely, there are reasons to question
by pauses of dopaminergic firing, with the to the face. They found that one class of whether it is water-tight. For example,
duration of pause correlating with the neurons, located more ventromedially in Ungless et al. (2004) found mesencephalic
degree to which events are worse than the region of the VTA, responded just as neurons excited by aversive stimuli that
expected. These findings, originally predicted by the RPE hypothesis: phasic were non-dopaminergic interneurons, in
reported by Schultz and colleagues firing increases were elicited by the spite of having electrophysiological fea-
(1997) have now been demonstrated reward-predictive stimuli, and phasic tures like dopaminergic neurons. The
across multiple labs and species, including depressions were elicited by the airpuff- problem with this interpretation is that
monkeys, rats and humans. This biphasic predictive stimuli. When the outcomes Matsumoto and Hikosaka did not find a
modulation of dopamine cell activity is themselves were experienced, phasic population of neurons with a ‘normal’
thought to act as a ‘teaching signal’ by spiking was only observed when the (RPE) pattern of response intermingled
modifying synaptic connections in the outcome was more rewarding or less aver- with this novel group of neurons in the
striatum to promote the selection of sive than expected, whereas transient SNc, as would be expected from sampling
actions that produce positive outcomes pauses were seen only when expected of dopaminergic and non-dopaminergic
and to diminish the selection of those rewards were withheld. neurons. A more recent study in rats by
that do not (Wickens et al., 2003; Cohen However, in contrast to the current Brishcoux et al. (2009) using a combi-
and Frank, 2009). Indeed, recent optoge- model, Matsumoto and Hikosaka (2009) nation of identification strategies, has cor-
netic studies have confirmed that phasic, identified presumptive dopaminergic roborated the Matsumoto and Hikosaka
but not tonic, stimulation of dopaminergic neurons in the SNc region that were phasi- finding that there are mesencephalic dopa-
cells induces behavioral conditioning: cally activated by conditioned stimuli minergic neurons activated by aversive
animals spend more time in locations in associated with both rewarding and aver- stimuli, but they are rare, possibly
which they had received such stimulation sive outcomes. This unidirectionality was because of the use of anesthetic. Another
compared with those in which they had also observed during the outcome itself, issue is location. Brischoux et al. provided
not (Tsai et al., 2009). particularly if its presentation was strong evidence that there are neurons
# The Author (2009). Published by Oxford University Press on behalf of Journal of Molecular Cell Biology, IBCB, SIBS, CAS. All rights reserved.
16 j Journal of Molecular Cell Biology Frank and Surmeier
(even if rare) excited by aversive stimuli the conditioned stimulus allowed the might be—thalamostriatal signals, inter-
within the VTA, whereas Matsumoto and monkey to blink and reduce the unplea- neurons—remains to be defined, but
Hikosaka contend based upon less santness of the airpuff. This interpretation the intriguing work by Matsumoto and
precise recording depth measurements helps explain the partial dissociation Hikosaka forces us to ask the question.
that these neurons are largely within the between the responses of dopaminergic
SNc. This could be a species-related neurons to the conditioned and uncondi-
difference. tioned aversive stimuli: there was a much References
If true, this finding necessitates a para- smaller percentage (11%) of neurons Beninger, R.J., Mason, S.T., Phillips, A.G., and
digm shift in thinking how experience excited by unconditioned aversive stimuli Fibiger, H.C. (1980). The use of conditioned sup-
pression to evaluate the nature of neuroleptic-
engages dopaminergic neurons to reshape than by conditioned aversive stimuli
induced avoidance deficits. J. Pharmacol. Exp.
neural circuitry. In the striatal regions regu- (37%) (and a far greater proportion— Ther. 213, 623 –627.
lated by the VTA (ventromedial striatum), 47%—were inhibited by the unconditioned Brischoux, F., Chakraborty, S., Brierley, D.I., and
phasic dopamine release in response to aversive stimuli). Moreover, avoidance of Ungless, M.A. (2009). Phasic excitation of dopa-
positive RPE should preferentially activate an expected negative outcome, or termin- mine neurons in ventral VTA by noxious stimuli.
Proc. Natl. Acad. Sci. U.S.A. 106, 4894 –4899.
low affinity D1 dopamine receptors, promot- ation of an experienced one, is associated
Cohen, M.X., and Frank, M.J. (2009).
ing the response of striatonigral medium with increases in dopamine and activates