Professional Documents
Culture Documents
Nonconsequentialist decisions
Jonathan Baron
Department of Psychology, University of Pennsylvania, Philadelphia, PA
19104-6196
Electronic mail: baron@cattell.psych.upenn.edu
Abstract: According to a simple form of consequentialism, we should base decisions on our judgments about their consequences for
achieving our goals. Our goals give us reason to endorse consequentialism as a standard of decision making. Alternative standards
invariably lead to consequences that are less good in this sense. Yet some people knowingly follow decision rules that violate
consequentialism. For example, they prefer harmful omissions to less harmful acts, they favor the status quo over alternatives they
would otherwise judge to be belter, they provide third-party compensation on the basis of the cause of an injury rather than the
benefit from the compensation, they ignore deterrent effects in decisions about punishment, and they resist coercive reforms they
judge to be beneficial. I suggest that nonconsequentialist principles arise from overgeneralizing rules that are consistent with
consequentialism in a limited set of cases. Commitment to such rules is detached from their original purposes. The existence of such
nonconsequentialist decision biases has implications for philosophical and experimental methodology, the relation between
psychology and public policy, and education.
Keywords: bias; consequentialism; decision; goals; intuition; irrationality; judgment; normative models; norms; omission; over-
generalization; utility
that help us achieve our goals (collectively, because our helps her achieve her goal of living. We would each want
reasons are both altruistic and selfish). Other things are one another to act in this way, so we all have reason to
equal, I suggest, because we have no other reasons for endorse this norm. Following Hare (1963), I shall call this
endorsing norms. Goals are, by definition, the motives kind of argument a Golden Rule argument.
we have for doing anything. We need not decide here on If you have a goal of not putting others at risk through
the appropriate balance of goals of self versus others. This acts in particular and if this inhibits you from vaccinating
issue does not arise in the examples I shall discuss. the girl, she is hurt. She has reason to discourage you from
For example, consider two possible norms concerning holding such a goal. It is in her interest for your goals
acts and omissions that affect others. One norm opposes about your decisions to be concerned only with their
harmful acts. Another opposes both harmful acts and consequences. Of course, altruistically, she might be
omissions, without regard to the distinction. The second concerned with your own goals about your decisions, so
norm requires people to help other people when the she might conclude that it is on the whole better for you
judged total harm from not helping exceeds that from not to vaccinate her. But she has no general reason - apart
helping. Harm includes everything relevant to goal from what she knows about you in particular - to endorse
achievement, including effort and potential regret. a norm for you that prescribes nonvaccination. The norms
Which norm should I want others to follow? If others we have selfish reason to endorse are those concerned
follow the first, more limited, norm, my goals will not be only with consequences, because those are what affect us.
achieved as well, because I would lose the benefit of Even when we endorse norms out of altruism, we have
people helping me when the total benefits exceed the no general reason to endorse a norm treating acts and
costs. I therefore have reason to endorse a norm that does omissions differently. You might have a goal of not Causing
not distinguish acts and omissions, and I have no reason to harm to yourself through acts, so you might not vaccinate
distinguish acts and omissions as such in the norms I yourself. Such a goal would make it more harmful for me
endorse. Once I endorse this norm, those who accept it to force you to vaccinate yourself, for I would go against
will want me to follow it, too, but if I hold back my that goal. But I have no reason, altruistic or selfish, to
endorsement for this reason, I will lose credibility (Baron endorse a norm that leads you to have such a goal if you do
1993b). not already have it, for it will not help you achieve your
Suppose 1 have a goal opposing harmful action but not other goals, or mine.
opposing harmful omission. This goal is not derived from This kind of argument concerning the act-omission
my moral intuitions or commitments, which we have put distinction differs from other approaches to this issue (see
aside. In this case, I would have reason to endorse the Kuhse 1987, for an enlightening review). Most of these
limited norm. The more people who have such a (non- are based on intuitions about cases as data to be accounted
moral) goal, the more reason we all have to endorse this for (e.g., the articles in Fischer & Ravizza 1992). Yet, it is
norm (out of altruism, at least). But consequentialism just these intuitions that are at issue. I suggest that many
would not be violated, for adherence to the norm would in of them arise from overgeneralizations, to which people -
fact achieve people's nonmoral goals. Although this argu- even those who become moral philosophers — become
ment leads to a consequentialist justification for a norm committed in the course of their development. In this
distinguishing acts and omissions, the argument is contin- case, for example, harmful acts are usually more inten-
gent on a (dubious) assumption about human desires. tional than harmful omissions, and hence, more blame-
Consider the case of active versus passive euthanasia. worthy. But intention is not different in the cases just
Suppose we believe that there are conditions under discussed. People continue to distinguish acts and omis-
which most people would want life-sustaining treatment sions, however, even when the feature that typically
withheld but would not want to be actively killed. Then, if makes them different is absent.
we do not know what a patient wants, this belief would This same argument will apply to the other kinds of
justify a distinction. However, if we know that the patient norms I shall discuss. In general, the function of norma-
has no goals concerning the distinction, we have no reason tive models for decision making (as described earlier) is
to make it on the patient's behalf. (Likewise, the slippery- not served by any norms other than those that specify
slope argument that active euthanasia will lead to reduced attaining the best consequences, in terms of goal achieve-
respect for life depends on a contingent fact that could be ment. And those norms should not encourage people to
taken into account if it were true. The slippery slope could have any goals for decision making other than achieving
also go the other way: refraining from active euthanasia the best consequences. We might be able to go farther
could lead to errors of misallocation of resources and the than this, specifying norms for the analysis of decisions
consequent neglect of suffering.) Our decision would into utilities and probabilities, for example, but the exam-
depend on whether death itself was to be preferred, not ples discussed do not require such analysis. (Although the
on the way in which death comes about (assuming that the vaccination case involved probabilities, I simply assumed
means of death have no other relevant consequences of that anyone would judge a lower risk of death to be a
their own for people's goals). In sum, we do not neces- better state of affairs: no trading off of probability and
sarily have any reason to want each other to honor a utility was required.)
principle distinguishing acts and omissions. The upshot of this argument is that we have reason to be
Consider another example. Suppose a girl has a 10 in disturbed, prima facie, when we find others making
10,000 chance of death from a disease. A vaccine will decisions that violate consequentialism. On further inves-
prevent that disease, but there is a 5 in 10,000 chance of tigation, we might find that no better prescriptive norms
death from its side effects. The girl should endorse a norm are possible. But, unless this is true, these norms will lead
that tells you to give her the vaccine, assuming that this to decisions that prevent us from achieving our goals as
well as other decisions might. Our goals themselves, toward the status-quo/omission option. People require
including our altruistic goals, therefore, give us reason to more money to give up a good than they are willing to pay
be concerned about nonconsequentialist decisions. What for the same good (Knetsch & Sinden 1984; Samuelson &
we do about this disturbance is another question, to which Zeckhauser 1988; and, for public goods, Mitchell & Car-
we might apply consequentialist norms. son 1989). Kahneman et al. (1990) showed that these
effects were not the result of wealth effects or other
artifacts. They are, at least in part, true biases. Although
3. Departures from consequentialism
Ritov and Baron (1992) found that this status-quo bias was
I shall now present a few examples of possible violations of largely a consequence of omission bias, Schweitzer (in
consequentialism. I hope these examples make it plausi- press) found both omission bias without a status-quo
ble that nonconsequentialist thinking exists and matters, option, and status-quo bias without an omission option.
even if each example is subject to one quibble or another. Baron (1992) and Kahneman et al. (1990) also found a pure
status-quo bias. Status-quo bias, like omission bias, can
3.1. Omission and status-quo bias. Kitov and Baron result from overgeneralization of rules that are often
(1990) examined a set of hypothetical vaccination deci- useful, such as, "If it ain't broke, don't fix it."
sions like the one just described. We compared omission It is clear that omission and status-quo bias can cause
and commission as options within the same choice. In one failures to achieve the best consequences, as we would
experiment, subjects were told to imagine that their child judge them in the absence of a decision. Possible exam-
had a 10 out of 10,000 chance of death from a flu epidemic, ples in real life are the pain and waste of resources
that a vaccine could prevent the flu, but the vaccine itself resulting from the prohibition of active euthanasia (when
could kill some number of children. Subjects were asked passive euthanasia is welcomed), the failure to consider
to indicate the maximum overall death rate for vaccinated aiding the world's poor as an obligation on a par with not
children for which they would be willing to vaccinate their hurting them (Singer 1979), and the lives of leisure (or
child. Most subjects answered well below 9 per 10,000. withdrawal from worldly pursuits) led by some who are
Of the subjects who showed this kind of reluctance, the capable of contributing to the good of others.
mean tolerable risk was about 5 out of 10,000, half the risk
of the illness itself. The findings were the same when 3.2. Compensation. Compensation for misfortunes is of-
subjects were asked to adopt the position of a policy ten provided by insurance (including social insurance) or
maker deciding for large numbers of children. When by the tort system. The consequentialist justification of
subjects were asked for justification, some said they compensation is complex (Calabresi 1970; Calfee &
would be responsible for any deaths caused by the vac- Rubin, in press; Friedman 1982), but, in the cases consid-
cine, but they would not be (as) responsible for deaths ered here, compensation should depend on the nature of
caused by failure to vaccinate. When a Golden Rule the injury (including psychological aspects) and not other-
argument was presented (Baron 1992), the bias was wise on its cause or on counterfactual alternatives to it.
largely eliminated. Asch et al. (1993) and Meszaros et al. (The compensation in these cases can help the victim, but
(1992) have found that the existence of this bias correlates it cannot punish the injurer or provide incentive for the
with mothers' resistance toward pertussis vaccination victim to complain.) Any departure from this consequen-
(which may produce death or permanent damage in a very tialist standard implies that some victims will be overcom-
few children). pensated or others undercompensated, or both.
Other studies (Ritov & Baron 1992; Spranca et al. 1991) Miller and McFarland (1986) asked subjects to make
indicate a general bias toward omissions over acts that judgments of compensation. When a misfortune was
produce the same outcome. In one case used by Spranca almost avoided, more compensation was provided than
et al. (1991), for example, subjects were told about John, a when it was hard to imagine how it could have been
tennis player who thought he could beat Ivan Lendl only avoided. A possible justification for this difference is that
if Lendl were ill. John knew that Ivan was allergic to victims were more emotionally upset in the former case
cayenne pepper, so, when John and Ivan went out to the than in the latter. Ritov and Baron (in press), however,
customary dinner before their match, John planned to found the same sort of result when subjects understood
recommend to Ivan the house salad dressing, which that the victim did not know the cause of the injury or the
contained cayenne pepper. Subjects were asked to com- alternatives to it. In all cases a train accident occurred
pare John's morality in different endings to the story. In when a fallen tree was blocking the tracks. Subjects
one ending, John recommended the dressing. In another judged that more compensation should be provided (by a
ending, John was about to recommend the dressing when special fund) when the train's unexpected failure to stop
Ivan chose it for himself, and John, of course, said noth- caused the injury than when the suddenness of the stop
ing. Of the 33 subjects tested, 10 thought that John's was the cause. The results were the same whether the
behavior was worse in the commission ending; no subject failure was that of an automatic stopping device or of a
thought the omission was worse. Other studies (Baron & human engineer.
Ritov, in press; Ritov & Baron 1992; Spranca et al. 1991, These results can be partially explained in terms of
Experiment 4) show that the bias toward omissions is not norm theory (Kahneman & Miller 1986), which holds that
limited to cases in which harm (or risk) is the result, we evaluate outcomes by comparing them to easily imag-
although the effect is greater when the decision leads to ined counterfactual alternatives. When it is easy to imag-
the worse of two possible outcomes (Baron & Ritov, in ine how things could have turned out better, we regard
press). the outcome as worse. When subjects were told that the
Inaction is often confounded with maintaining the sta- outcome would have been worse if the train had stopped
tus quo; and several studies have shown an apparent bias (when it did not stop), or if the train had not stopped
(when it did), they provided less compensation, as norm (in cases involving no clear negligence). In one case,
theory predicts. Likewise, they provided more compen- subjects were told that a higher penalty would make the
sation if the counterfactual outcome would have been company and others like it try harder to make safer
better. But this information about counterfactuals did not products. In an adjacent case, a higher penalty would
eliminate the effect of the cause of the outcome. Hence, make the company more likely to stop making the prod-
norm theory, while supported, is not sufficient to explain uct, leaving only less safe products on the market. Most
all the results. Another source could be overgeneraliza- subjects, including a group of judges, assigned the same
tion of principles that would be applied to cases in which penalties in both of these cases. In another test of the
an injurer must pay the victim. The injurer is more likely same principle, subjects assigned penalties to the com-
to be at fault when a device fails or when the engineer fails pany even when the penalty was secret, the company was
to stop. insured, and the company was going out of business, so
A similar sort of overgeneralization might be at work in that (subjects were told) the amount of the penalty would
another phenomenon, the person-causation bias. Here, have no effect on anyone's future behavior. Baron et al.
subjects judge that more compensation should be pro- (1993) likewise found that subjects, including judges and
vided by a third party when an injury is caused by human legislators, typically did not penalize companies differ-
beings than when it is caused by nature (Baron 1992; ently for dumping hazardous waste, whether the penalty
Ritov & Baron, in press). This result is found, again, when would make companies try harder to avoid waste or
both the injurer (if any) and the victim are unaware of the induce them to cease making a beneficial product. It has
cause of the injury or of the amount of compensation been suggested (e.g., Inglehart 1987) that companies
(Baron 1993b), so that even psychological punishment is have in fact stopped making beneficial products, such as
impossible. For example, subjects provided more com- vaccines, exactly because of such penalties.
pensation to a person who lost a job from unfair and illegal Such a tendency toward retribution could result from
practices of another business than to one who lost a job overgeneralization of a deterrence rule. It may be easier
from normal business competition (neither victim knew for people - in the course of development - to understand
the cause). The same result was found for blindness punishment in terms of rules of retribution than in terms
caused by a restaurant's violation of sanitary rules versus of deterrence. Those who do understand the deterrence
blindness caused by a mosquito. rationale generally make the same judgments - because
This effect might be an overgeneralization of the desire deterrence and retribution principles usually agree - so
to punish someone. Ordinarily, punishment and compen- opportunities for social learning are limited. Other possi-
sation are correlated, because the injurer is punished by ble sources of a retribution rule may be a perception of
having to compensate the victim (or possibly even by the balance or equity (Walster et al. 1978) and a generalization
shame of seeing that others must compensate the victim). from the emotional response of anger, which may operate
But when this correlation is broken, subjects seem to in terms of retribution (although it may also be subject to
continue to use the same heuristic rule. This sort of modulation by moral beliefs; see Baron 1992).
reasoning might account in part for the general lack of A second bias in judgments of punishment is that
concern about the discrepancy between victims of natural people seem to want to make injurers undo the harm they
disease, who are rarely compensated (beyond their medi- did, even when some other penalty would benefit others
cal expenses), and victims of human activity, who are often more. Baron and Ritov (1993) found that both compen-
Compensated a great deal, even when little specific deter- sation and penalties tended to be greater when the
rence results because the compensation is paid by liability pharmaceutical company paid the victim directly than
insurance. when penalties were paid to the government and com-
pensation was paid by the government (in the secret-
3.3. Punishment. Notoriously, consequentialist views of settlement case described earlier). Baron et al. (1993)
punishment hold that two wrongs do not make a right, so found (unsurprisingly) that subjects preferred to have
punishment is justified largely on the grounds of deter- companies clean up their own waste, even if the waste
rence. Deterrence can be defined generally to include threatened no one, rather than spend the same amount of
education, support for social norms, and so on, but pun- money cleaning up the much more dangerous waste of a
ishment must ultimately prevent more harm than it defunct company. Ordinarily, it is easiest for people
inflicts. Again, I leave aside the question of how to add up to undo their own harm, but this principle may be
harms across people and time. The simple consequential- overgeneralized.
ist model put forward here implies that, normatively, our Both of these biases can lead to worse consequences in
judgment of whether a punishment should be inflicted some cases, although much of the time the heuristics that
should depend entirely on our judgment of whether lead to them probably generate the best consequences.
doing so will bring about net benefit (compared to the best These results, then, might also be the result of over-
alternative), whether or not the judgment of benefit is generalization of otherwise useful heuristics.
made by adding up benefits and costs in some way. (We
might want to include here the benefits of emotional 3.4. Resistance to coerced reform. Reforms are social
satisfaction to those who desire to see punishment inflic- rules that improve matters on the whole. Some reforms
ted. But we would certainly want to include deterrent require coercion. In a social dilemma, each person is
effects as well.) faced with a conflict between options: one choice is better
People often ignore deterrence in making decisions for the individual and the other is better for all members
about punishment or penalties. Baron and Ritov (in press of the group in question. Social dilemmas can be, and
a) asked subjects to assess penalties and compensation have been, solved by agreements to penalize defectors
separately for victims of birth-control pills and vaccines (Hardin 1968). Coercion may also be required to resolve
ious forms of altruism as well as various moral emotions cultures as they are to fundamental moral rules that seem
such as anger (Frank 1985), I know of no such accounts of to be universal (Haidt et al., in press).
the specific norms I have cited. (I could imagine such an Why would anyone invent or modify a rule and teach it
account for the norm of retribution, however, which to someone else? One reason is that the teachers benefit
might arise from a tendency to counterattack.) Any ac- directly from the "students" following the rule, as when
count that favors altruism would also seem to favor conse- parents teach their children to tell the truth, help with the
quentialist behavior, and this would be inconsistent with housework, or control their tempers. In some cases, these
nonconsequentialist norms. Even an account of anger as a rules are expressed in a general form ("don't bother
way of making threats credible (Frank 1985) need not people," "pitch in and do your share"), perhaps because
distinguish between anger at acts and omissions. Indeed, parents understand that children will be liked by others if
we are often angry with people for what they have failed they follow those rules. So parents teach their children to
to do. be good in part out of a natural concern with the children's
Even if norms have an evolutionary basis, we still do not long-run interests. Parents may also take advantage of
need to endorse them. As Singer (1981) points out in other certain opportunities for such instruction: a moral lesson
terms, evolution is trying to solve a problem other than may be more likely after a harmful act than after a failure
that of determining the best morality to endorse. A rule to help (unless the help was specifically requested).
might engender its own survival without meeting the Often, such rules are made up to deal with specific
above criteria for being worthy of endorsement. For cases, for example, "don't hurt people," in response to
example, chauvinism might lead to its own perpetuation beating up a little brother. We can think of such rules as
by causing nations that encourage it to triumph over those hypotheses, as attempts to capture what is wrong with the
that do not, the victors then spreading their norms to the case in question. It is useful to express the rules in a more
vanquished. Likewise, ideologies that encourage open- general form rather than referring to the specific case
mindedness might suffer defections at higher rates than alone ("don't twist your brother's arm"). But such general
those that do not, leading to the perpetuation of a doctrine rules are not crafted after deep thought. They are spur-of-
that closed-minded thinking is good (Baron 1991). Such the-moment inventions, although they do help control
mechanisms of evolution do not give us reason to endorse behavior for the better.
the rules they promote. As Singer points out, an evolu- If the rule is badly stated, one corrective mechanism is
tionary explanation of a norm can even undercut our critical thought about the rule itself (Singer 1981). To
attachment to it, because we then have an alternative to criticize a rule, we need to have a standard, a goal, such as
the hypothesis that we endorsed it because it was right. the test suggested earlier: is this a member of the set of
Some have compared decision biases to optical illu- rules that we benefit most from endorsing? We also need
sions, which are a necessary side effect of an efficient to have arguments about why the rule fails to achieve that
design or adaptation (Funder 1987). Without a plausible standard as well as it could, such as examples (like those I
account of how this adaptation works, however, accep- gave earlier) where the rule leads to general harm. And
tance of this argument would require blind faith in the we need alternative rules, although these can eome after
status quo. More can be said, however. Unlike optical the criticism rather than before it.
illusions (I assume), nonconsequentialist decision rules In the absence of such critical thought, rules may attain
are not always used. In all the research I described, many a life of their own. They become overgeneralized (or the
or most subjects did not show the biases in question. rules that might replace them in specific cases are under-
Moreover, Larrick et al. (in press) found that those who do generalized, even if they are used elsewhere). Because of
not display such biases are at least no worse oft in terms of our docility, perhaps, and the social importance of moral
success'or wealth than those who do. (Whether they are rules, our commitments to these rules are especially
morally worse was not examined.) Nonconsequential de- tenacious. The retributive rule of punishment, "an eye for
cision making is not a fixed characteristic of our condition. an eye," was originally a reform (Hommers, 1986), an
To understand where nonconsequentialist rules (norms) improvement over the kind of moral system that led to
come from, we need to understand where any decision escalating feuds. But when applied intuitively by a court
rules come from. I know of no deep theory about this. Some to the cases of a child killed by a vaccine, with but
rules may result from observation of our biological behav- negligence, it is overgeneralized to a case where the rule
ioral tendencies, through the naturalistic fallacy. We ob- itself probably does harm (Baron & Ritov 1993; Oswald
serve, for example, that men are stronger than women and 1989 makes a similar suggestion).
sometimes push women around, so we conclude that men Critical thought about moral rules undoubtedly occurs.
ought to be dominant. Rules are also discovered by It may be what Piaget and his followers take to be the
individuals (as Piagetian theorists have emphasized); they major mechanism of moral development. The sorts of
are explicitly taught (as social-learning theorists have experience that promote such thought may work because
emphasized) by parents, teachers, and the clergy; and they they provide counterexamples to rules that have been
are maintained through gossip and other kinds of social used so far. But critical thought is not universal. A princi-
interaction (Sabini & Silver 1981). ple such as "do no harm" may be developed as an admoni-
If people evolved to be docile, as proposed by Simon tion in cases of harm through actions. This principle may
(1990), then we become attached to the rules that we are then be applied to cases in which harm to some is
taught by others. These rules need have no justification outweighed by much .greater good to others, such as
for this attachment mechanism to work. Arbitrary rules compulsory vaccination laws, fuel taxes, or free-trade
can acquire just as much loyalty as well-adjusted rules. agreements. The application may be unreflective. The
And, indeed, people sometimes seem just as attached to principle has become a fundamental intuition, beyond
rules of dress or custom that vary extensively across question.
Such overgeneralization is well known in the study of ing counterarguments (e.g., Baron & Ritov 1993). In
learning. For example, Wertheimer (1959) noted that some cases it might be best not to replace the nonconse-
students who learn the base-times-height rule for the area quentialist rules with more carefully crafted ones but,
of a parallelogram often apply the same rule inap- rather, to be less confident about them and more willing
propriately to roughly similar figures and fail to apply the to examine the situation from scratch. The carefully
rule when it should be applied, for example, to a long crafted rules might be too difficult to learn. In such cases
parallelogram turned on its side. Wertheimer attributed we might say that overgeneralization is a matter of exces-
such over- and undergeneralization to learning without sive rigidity in the application of good general rules rather
understanding. I have suggested (Baron 1988a) that the than in the use of excessively general rules.
crucial element in understanding is keeping the justifica- In this section, I have tried to give a plausible account of
tion of the formula in mind, in terms of the purpose how erroneous intuitions arise in the development of
served and the arguments for why the formula serves that individuals and cultures. Direct evidence on such devel-
purpose. In the case of the base-times-height rule, the opment is needed. In the rest of this article, I explore
justification involves the goal of making the parallelogram some implications of my view for research and applica-
into a rectangle, which cannot be done in the same way tion. These implications depend in different ways on the
with, for example, a trapezoid. probability that this view is correct. Some require only
Overgeneralization in mathematics is easily corrected. that it is possible.
In morality and decision making, however, the rules that
people learn arise from important social interactions.
People become committed to these rules in ways that do 5. Intuition as a philosophical method
not usually happen in schoolchildren learning mathemat-
If intuitions about decision rules result from overgeneral-
ics. In this respect, overgeneralization also differs from
ization, then (as also argued by Hare 1981 and Singer
mechanisms that have been proposed as causes of types of
1981) these intuitions are suspect as the basic data for
biases other than those discussed here, mechanisms such
philosophical inquiry. Philosophers who argue that the
as the costs of more complex strategies, associative struc-
act-omission distinction is relevant (e.g., Kamm 1986;
tures, and basic psychophysical principles (Arkes 1991).
Malm 1989) typically appeal directly to their own intu-
A defense of overgeneralization is that preventing it is
costly. Crude rules might be good enough, given the time itions about cases. Unless it can be shown that intuitions
and effort it would take to improve them. Moreover, the are trustworthy, these philosophers are simply begging
effort to improve them might go awry. People who reflect the question.
on their decision rules might simply dig themselves Rawls (1971) admits that single intuitions can be sus-
deeper into whatever hole they are in, rather than im- pect, but he argues for a reflective equilibrium based on
proving those rules. We might also be subject to self- an attempt to systematize intuitions into a coherent the-
serving biases when we ask whether a given case is an ory. Such systematization need not solve the problem,
exception to a generally good rule (Hare 1981), such as in however. For example, it might (although it does not do so
deciding whether an extramarital affair is really for the for Rawls) lead to a moral system in which the act-
best (despite a belief that most are not). omission distinction is central, a system in which morality
consists mainly of prohibitions and positive duties play a
These defenses should be taken seriously, but their
limited role, if any (as suggested by Baron 1986).
implications are limited. They imply that we should be
wary of trying to teach everyone to be a moral philoso- Rawls's argument depends to some extent on an anal-
pher. They also suggest that prescriptive systems of rules ogy between moral inquiry and fields such as modern
might differ from normative systems (although they do linguistics, where systematization of intuition has been a
not prove this - see Baron 1990). But they do not imply powerful and successful method. The same method ar-
that simpler rules are more adequate as normative stan- guably underlies logic and mathematics (Popper 1962,
dards than full consequentialist analyses. Ch. 9). I cannot refute fully this analogical argument, but
it is not decisive, only suggestive. I have suggested (along
Moreover, some decisions are so important that the
with Singer 1981) that morality and decision rules have an
cost of thorough thinking and discussion pales by compar-
external purpose through which they may be understood,
ison to the cost of erroneous choices. I have in mind issues
and that this criterion, rather than intuition, can be used
such as global environmental policy, fairness toward the
as the basis of justification. Perhaps this idea can be
world's poor, trade policy, and medical policy. In these
matters, the thinking is often done by groups of people extended by analogy to language, logic, and mathematics,
engaged in serious debate, not by individuals. Thus, but that is not my task here.
there is more protection from error, and the effort is more
likely to pay off. Many have suggested that utilitarianism
6. Experimental methodology
and consequentialism are fully consistent with common
sense or everyday moral intuition (e.g., Sidgwick 1907), Experiments on decision biases often use between-
but this may be more true in interpersonal relations than subject designs (each condition given to different sub-
in thinking about major social decisions.
jects) or other means to make sure that subjects do not
Finally, the cost of thinking (or the cost of learning) may compare directly the cases the experimenter will com-
be a good reason for learning a more adequate rule, but pare (such as separating the cases within a long series).
not a good reason for having high confidence in the The assumption behind such between-subject designs is
inadequate rules that are used instead. Yet many exam- that subjects would not show a bias if they knew what
ples of the use of nonconsequentialist rules are charac- cases were being compared. All of the biases I have
terized by exactly such confidence, to the point of resist- described above are within-subject. Subjects show the
omission bias knowingly, for example, even when the act might as well fold up our tents and move on to more useful
and omission versions are adjacent. activities. How should we draw the line between making
In between-subject designs, subjects may display bi- too many claims and too few?
ases that they would themselves judge to be biases. Such I do not propose to answer this question fully, but part
inconsistency seems to dispense with the need for a of an answer concerns the way we make claims concerning
normative theory such as the consequentialist theory I public policy debates. I suggest that claims of biased
have proposed, or expected utility theory. But without an reasoning be directed at particular arguments made by
independent check, we do not know that subjects would one side or the other, not at positions, and certainly not at
consider their responses to be inconsistent. Frisch (1993) individuals.
took the trouble to ask subjects whether they regarded For example, one of the arguments against free-trade
the two critical situations as equivalent - such as buying agreements is that it is wrong to hurt some people (e.g.,
versus selling as ways of evaluating a good - and she found those on both sides who will lose their jobs to foreign
that they often did not. In other words, between-subject competition) to help others (e.g., those who will be
designs are not necessary to find many of the classic biases prevented from losing their jobs because their products
(including the status-quo effect described earlier), and will be exported). This could be an example of omission
subjects often disagree with experimenters regarding bias, or the do-no-harm heuristic, which operates in
which situations are equivalent. much clearer cases and which, I have argued, is indeed an
When we use within-subject designs, however, we error in these clear cases. Now real trade negotiations are
cannot simply claim that subjects are making mistakes extremely complex, and they involve other issues charac-
because they are violating the rules they endorse. When teristic of any negotiations, such as trying to get the best
asked for justifications for their judgments, subjects in all deal for everyone. So at most we could conclude that a
the experiments I described earlier endorsed a variety of particular part of the argument against free trade is a
rules that are consistent with their responses. We there- fallacy that has been found elsewhere in the laboratory.
fore need a normative theory, such as the consequentialist This does not imply that the other arguments opposing
theory I have outlined, if we are to evaluate subjects' free trade are wrong or not decisive, or that the people
responses. who oppose free trade are any more subject to error than
Much the same normative theory seems to be implicit those who favor it.
in most of the literature on framing effects and inconsis- With this kind of caution at least, the general program
tencies. Whether or not a factor is relevant to making a of research can be extended more broadly to other mat-
decision is a normative question, to which alternative ters of policy that I have not discussed here, such as
answers can be given. For example, Schick (1991) argues fairness in testing and selection for academic and employ-
that the way decision makers describe situations to them- ment opportunities, abortion, euthanasia, nationalism,
selves is normatively relevant to the decision they ought the morality of sex, and so on. In all these kinds of cases,
to make (even, presumably, if these descriptions do not arguments for two (or more) sides are complex, but some
affect consequences), because descriptions affect their of the arguments are probably erroneous. Psychology has
"understanding" of the situation, and understandings a role to play in discovering fallacious arguments and
are necessarily part of any account of decision making. pointing them out.
Hence, framing effects do not imply error. If consequen- One discipline has concerned itself with exactly this
tialism is correct, though, Schick is wrong: consequential- kind of inquiry, the study of informal logic (e.g., Arnauld
ism implies that understandings themselves can be erro- 1964; Johnson & Blair 19983; Walton 1989). This field,
neous (we might say). The attempt to bring in a however, has not incorporated many of the advances in
consequentialist standard through the back door while normative theory that have occurred since the time of
ostensibly talking about inconsistency (Davves 1988) and Aristotle, and it has paid no attention to psychological
framing effects will not work. The standard should be evidence - sparse as it is - about which fallacies actually
brought in explicitly, as I have tried to do. occur in rea.1 life.
In sum, although between-subject designs are useful
for studying heuristics, we may also use within-subject
designs to evaluate subjects' rules against a normative 8. Educational implications
standard such as consequentialism.
If discoveries about nonconsequentialist decision making
are themselves to have any consequences, they must
7. Policy implications influence the thinking that people do. As I suggested at
the outset, norms for thinking are enforced throughout
The examples I used to illustrate my argument are of society, so new research can influence these norms in
some relevance to issues of public concern, as noted. I am many ways. One may argue that psychological research
tempted to offer evidence of psychological biases as am- on racial and ethnic stereotyping (and authoritarianism,
munition in various battles over public policy. Tetlock and ethnocentrism, dogmatism, etc.) has influenced Western
Mitchell (1993), however, correctly warn us against using cultures in a great variety of ways. The claim that an
psychological research as a club for beating down our argument is prejudiced now refers to a well-established
political opponents. It is too easy, and it can usually be body of psychological literature familiar to most people in
done by both sides. On the other hand, a major reason for these societies. (In using this as an example, I am not
studying biases is to discover where decisions need im- assuming that the research in question is flawless. In-
provement, and if we researchers are going to reject all deed, Tetlock and Mitchell point out that much of this
application to public or personal decision making, we research is itself politically biased, and the example may
Baron may object that my three reservations about the conse- results than a car driver having a heart attack is to blame for the
quentialist norm represent tiny chinks in what is otherwise a ensuing crash.
solid structure. The participants in his ingenious experiments Shafir and Tversky (1992) showed that people will use norma-
did not cite the wisdom of John Stuart Mill when they objected tive principles when they are salient or "transparent" in prob-
to coercion. Similarly, my reservations might represent prob- lems, but when they are not, people are more likely to reason
lems with the consequentialist norm that most people are not nonconsequentially. Shafir and Tversky point out that although
going to mention. Many people will countenance the deaths of most subjects make the wrong choices of cards to turn in Wason's
10 children who are not vaccinated to avoid the deaths of 5 (1966) selection task, they can easily appreciate the relevance of
children who are allergic to the vaccine, but in so doing they will the possible outcomes of their choices. In our experience,
not say that they have rejected the consequentialist norm subjects who are wrong often stridently insist that they are right
because of the problems I have enumerated. They are more for reasons that plainly satisfy them, yet these subjects will
likely to reject it for the inadequate reason Baron suggests, that (more quietly) appreciate the correct argument.
is, overgeneralization of other rules. Mistakes occur when people have an inappropriate objective
In fact, I have witnessed plenty of nonconsequentialist behav- for meeting their goal, however that inappropriate objective is
ior that does not seem to be related to the three issues I have met. They have done what they wanted to do but, in terms of
raised. For example, some of the supporters of the immensely achieving their goal, they have done the wrong thing. Perhaps
expensive space station have said recently that no matter how these are the subjects who rejected the notion that punishment
questionable its scientific merit, we ought to continue funding is justified by deterrence rather than retribution and perhaps
it, because we have already spent so much on it. they are suffering from an "educational gap." Given their more
I conclude that whatever the deficiencies of the consequen- intentional nature, moral mistakes appear more blameworthy
tialist norm may be, it is less deficient than the thinking than moral slips, though some would claim that ignorance or
exhibited by people, both in and out of Baron's experiments. lack of intelligence is not evidence for irrationality (e.g., Cohen
1981). To this extent, ignorance of the law is an excuse.
People may also behave in a way that they know will not meet
their objectives. They may do so to explore the relationship
between objectives and goals. In such cases short-term viola-
Inappropriate judgements: Slips, mistakes or tions may lead to improved performance in the long run because
violations? of the extra knowledge revealed. It is difficult to interpret this
rather existentialist approach to moral judgement as blamewor-
Peter Aytona and Nigel Harvey" thy. Self-conscious violations can be found in Baron's (1992)
"Psychology Department, City University, London EC1VOHB, United evidence of dissociations between "should" and "would" in
Kingdom and "Department of Psychology, University College London, people's reactions to hypothetical scenarios. A proportion of
London WC1E6BT, United Kingdom subjects recognised that they should shoot 1 innocent person in
Electronic mail: p.ayton@city.ac.uk
order to save 38 but conceded that they would not do so.
Because it is cognitively taxing to make judgements by applying We agree that people probably do not always reason critically
strictly rational methods, people may use decision rules akin to in order to make moral judgements. Indeed, we wonder
Keynes's (1936) judgement conventions or Tversky and Kahne- whether it is universally recognised that moral reasoning should
man's (1974) heuristics. The cause of nonconsequential reason- inform moral choices. We suspect that people will commonly
ing, Baron argues, is overgeneralising such heuristics. This appeal to authority rather than reason. Political and religious
argument is at once rather curious; heuristics are simple rules of ideology may often serve as decision support systems for a range
thumb that inevitably generalise to some degree or other. of judgements concerning morality. This seems exemplified by
Overgeneralisation suggests that there is some more reasonable the recent rather startling advice offered by the British prime
level of generalisation that people are exceeding. Simple heuris- minister that, with respect to criminal behaviour, "society needs
tics that never made errors would be very valuable, but are they to condemn a little more and understand a little less." When
possible? We suspect that relatively simple rules will only be considering the interpretation of the merits of the choices made
perfectly effective in relatively simple environments. by subjects in experimental tests of moral decision making,
To estimate the efficiency of the heuristics we may use to however, it may be appropriate to be cautious with condemna-
perform judgements we need to know something of the natural tion until we understand a little more.
ecology of the environment in which the heuristics are applied.
How often will the heuristics work? How often will they fail?
How bad will the (consequences of) failures be? What are the
costs and benefits of alternative strategies? These questions are Do, or should, all human decisions conform
not answered by the research cited in the target article. Indeed,
given the ingenuity required to devise problems that demon-
to the norms of a consumer-oriented
strate nonconsequential reasoning, it could be argued that such culture?
heuristics may actually be rather good at their job.
L. Jonathan Cohen
Following Reason et al. (1991), incorrect behaviour can be
attributed to slips, mistakes, and violations. Slips occur when The Queen's College, Oxford University, Oxford 0X1 4AW, England
Electronic mail: ljcohen@vax.oxford.ac.uk
people have the right objectives but fail to reach them because of
the intrusion of some strong habits over which they have no Baron's hypothesis in the earlier part of his target article is that
control. When people receive feedback about the outcomes of we should make decisions according to our judgements of their
their judgements, they know they were inappropriate. Al- consequences for the achievement of our goals, and that when
though Baron claims that his within-subjects experiments pre- nonconsequentialist principles of decision making are used,
clude the possibility that his subjects are inadvertently breaking they are biases and arise from the overgeneralisation of rules
rules they actually endorse, he also finds that subjects presented that are consistent with the requirements of consequentialism
with a Golden Rule argument will revise their judgements, when applied only to a limited set of cases. At heart, therefore,
thereby eliminating bias. They therefore seem to be making holds Baron, we are all consequentialists. There are, however,
slips; their attempts to reach their objectives have been dis- three major difficulties with this argument.
rupted by a strong habitual form of reasoning. Given their lack of The first is that it does not exclude the feasibility of exploiting
control over their reasoning, they are no more to blame for its overgeneralisation in another direction. Consider, for example,
possible that by acting in accordance with normatively correct Why care where moral intuitions come from?
rules we might bring about consequences that are suboptimal,
or even disastrous. Susan Dwyer
An example: suppose I follow a set of decision rules I believe Department of Philosophy, McGill University, Montreal, Quebec, Canada
to be normatively correct in the nonconsequentialist or deon- H3A2T7
Electronic mail: sue@philo.mcgill.ca
tological sense. Surely a Cartesian evil demon could ensure
that my following these rules would have bad consequences, and We all have strong, nonconsequentialist moral intuitions (here-
we would not view him as transferring the normative correct- after, NCMIs), which Baron suggests we would be better off
ness of one set of rules to another. Our original rules would without. Here I want to take up the issue of the alleged
remain normatively correct in spite of their bad consequences. problematicity, not just of NCMIs, but of moral intuitions in
Our acting upon rules that are normatively incorrect will in this general, for ethical theory. This focus will, I think, also show that
case yield the best consequences; but this, the nonconsequen- Baron's project is self-defeating. His argument for the epis-
tialist will insist, is at least within the realm of logical possi- temologically suspect nature of NCMIs generalizes to any type
bility. of moral intuition. Thus, if he is successful, Baron has given us
Baron might argue that there is something objectionable reason to reject his oiun view, because it is clearly driven by
about the nonconsequentialist's use of this example. Perhaps consequentialist intuitions.
there is; nevertheless it makes nonconsequentialism appear far About moral intuitions we might ask two questions. One is
more plausible than Baron's target article does. Baron does not psychological or sociological: Where do they come from? The
paint a clear picture of his opposition. other is epistemological: What role, if any, should they play in
Furthermore, if my characterization of nonconsequentialists moral theory? These questions are related, but Baron is not
is correct, they could easily accommodate the fact that subjects sensitive enough to the ways in which they are actually con-
who take themselves to be conforming to normatively correct nected in contemporary moral philosophy. Answers to the first
decision rules make decisions that are inconsistent and erro- question might constrain what count as correct answers to the
neous in various ways. Nonconsequentialists would simply second. Thus, imagine that our moral intuitions are beliefs
stress that it is very hard to show that the decision rules isolated implanted by evil Martians. If we took moral intuitions as
in these experiments are erroneous in the consequentialist epistemological bedrock, we would be wrong to set much store
sense, it being so difficult to assess their long-term conse-
by any moral theory constructed on the basis of such implanted
quences. And should they be erroneous in this sense, nonconse-
intuitions. Yet it is clear that no (living) moral philosopher who
quentialists are then perfectly free to endorse or condemn those
invokes intuitions with any degree of seriousness takes them to
decision rules on the basis of their consequences; their bad
have this foundational status (cf. Moore 1903; Rawls 1971;
consequences will simply not be believed to constitute their
Thomson 1986; 1990). My point is this: insofar as moral philoso-
incorrectness.
Why should the nonconsequentialist believe that good deci- phers appeal to moral intuitions in assessing moral principles,
sions will generally yield good consequences if this is not a and insofar as the enterprise of theory construction in ethics is
necessary truth? Well, it is hard to see how any decision (in part) one of systematizing our moral intuitions, it is certainly
procedure people actually use on a large scale can fail to be of interest where moral intuitions come from. But the degree to
justified from a consequentialist point of view. Otherwise, we which the source of moral intuitions matters will depend on
would have perished long ago. This point is emphasized by those one's answer to the epistemological question. If one holds, as
who hold that the rules we currently follow might confer some Rawls and many others do, that moral intuitions and moral
selective advantage, but Baron finds this claim suspect. He theory are mutually revisable, that theory ought never be held
points out that a rule might "engender its own survival" without wholly hostage to intuitions, then one will not be put off by
having a consequentialist justification. Barons assertion that some moral intuitions have a less than
respectable etiology. Indeed, the very point of the strategy of
However, we cannot say that a rule has an evolutionary basis,
or that it confers a selective advantage, simply because it reflective equilibrium is to provide the theorist with a principled
engenders its own survival. It will have an evolutionary basis means of rejecting some intuitions. Moral intuitions are not
only if it engenders our survival, and it will accomplish this only sacrosanct to anyone except the moral dogmatist. It does not
if it has a consequentialist justification (or perhaps its engender- follow from this that philosophers who invest moral intuitions
ing our survival would then be its consequentialist justification). with substantially less weight, that is, those who use them as
We might not be able to say what kind of selective advantage starting points in the process of reflective equilibrium, can
these rules confer; but we have been given no reason to believe afford to ignore the question of their origin. And perhaps Baron
they confer none. has shown that the etiology of NCMIs in particular is so undis-
tinguished that moral philosophers should set no store by them
Finally, a point about methodology. Baron argues that a
at all.
nonconsequentialist theory of decision making will depend too
So far as I can see, Baron's conclusion that NCMIs are nothing
strongly on our normative intuitions, when "intuitions about
decision rules . . . are suspect as the basic data for philosophical more than irrational biases is not warranted on the basis of
inquiry." That may be, but then Baron is just as badly off as the the empirical evidence alone. What Baron's experiments con-
nonconsequentialist. Consequentialism relies just as heavily on firm is what most of us knew all along, namely, that human
our intuitions about the goodness of various consequences as beings use consequentialist and nonconsequentialist decision
deontology relies on our intuitions about the Tightness of various rules. Rather, whatever plausibility his claim has derives from
rules. It does not offer us an Archimedean point from which to his speculation that NCMIs are the result of unreflective adher-
theorize about reasoning and decision making. The good news is ence to childhood admonitions (which were themselves hastily
that we do not need one. given by our caretakers), or are perverted overgeneralizations of
consequentialist considerations. Hence, the problematicity of
NCMIs depends on their having this sort of etiology. But Baron
gives us no reason to think that such intuitions are unique in this
respect. If the social and psychological processes responsible for
the formation of NCMIs are as robust as Baron seems to think, it
is equally plausible to argue that we arrive at some of our
consequentialist intuitions in the same way. Baron would appear
to face a dilemma: either all moral intuitions have the same
(problematic) source, in which case his own consequentialist
think questions of how people come to have their moral sensi- reasons one might have relevant to P or not P, and now what
bilities are interesting in themselves, but Baron's project only reason could there be for ~P? Clearly none; therefore P.
has implications for education and for policy if there is a moral Assuming I am not anomalous, the structure of morality does
parallel to part (2), and there is only such a parallel if there is a not much look like rule utilitarianism or any heuristic version of
normative standard in ethics comparable to that used in studies utilitarianism. I would be amazed if the way children learn
of empirical decision making. So is there? morality is to mislearn utilitarian rules, which is what Baron's
One thought is that Bayesian decision theory - which seems line of inquiry conjectures. I am not even sure that I understand
to be the common cognitive norm assumed in psychological what Baron means when he suggests that we learn some un-
studies of human judgment - is also a moral norm. But then utilitarian ethical preferences by "overgeneralizing.' Does he
nothing substantive follows from the norm without a specifica- mean, for example, that children mischaracterize what their
tion or elicitation of probabilities and utilities. In particular, moral instructors would say in other circumstances? Does he
nothing follows for or against distinction between omission and mean that children have some internal, inarticulate, utilitarian
commission, which is what seems particularly to concern Baron. standard natively, which in learning moral dispositions they
Another proposal is utilitarianism: various outcomes have speci- mischaracterize? What fact is it about the world that children
fiable values to persons according to objective features of the "overgeneralize'? I think the answer must be none of the above;
people (e.g., how much stuff they already have), and right children who form moral dispositions Baron disapproves of have
actions are those that maximize the expected utility (averaged not made any sort of inferential error at all.
over all persons). There are lots of reasons to think utilitarianism I found Baron's suggestions about practical implications of his
is an incoherent norm: there is no empirical basis for compari- project very strange, sort of like falling off a cliff with someone
sons of utility across persons - vaguely egalitarian principles are and on the way down he complains about your bad breath and
a common substitute for evidence; there is no way to aggregate offers a stick of chewing gum. Consider one of his examples: free
probabilities and utilities from different people and satisfy trade. Baron says utilitarian education might remove the argu-
simple rational principles; it is doubtful that people even have ment that it is wrong to cause wealth to be redistributed, or
relevant probability judgments concerning remote outcomes; something like that. The concern that some not be harmed to
depending on how utilities are distributed and compared, maxi- benefit others appears easily defeated by compensation prom-
mizing the average can require us to reduce the number of ises. Witness Mr. Clinton. Some of the serious arguments
people in the world to one, the utility monster. Utilitarianism against free-trade policies show what is wrong with utilitari-
always was and remains a piece of social pseudoscience. anism as it is now found in public policy, that is, as cost-benefit
The structure of actual norms is not just nonutilitarian around analysis. One serious argument is that what is lost when an
the edges. I do not suppose I am morally abnormal in most industry collapses is not just money; it is community. People lose
respects, and I could not work less like an egalitarian utilitarian. their friends, their neighbors, their traditions, the company of
Many of my goals concern fulfilling a set of responsibilities that their adult children. Things fall apart. We have no scale to
have a kind of ordering of importance, with responsibilities to measure those sorrows. Welfare economists image one, the way
children outweighing responsibilities to parents and spouse, you might imagine a diamond as big as the Ritz.
outweighing responsibilities to work, outweighing respon- Psychological inquiry is relevant to free-trade disputes, and so
sibilities acquired through promises to others, outweighing a are ethical considerations, but not, I think, in Baron's way. The
general responsibility to do good where it is easy and to do no most obvious connection is an issue' in social psychology: how
harm unless it is justified. I have an elaborate if inarticulate does a discipline, economics, that claims to be scientific, come
collection of sensibilities about when harm is justified. Other- to enshrine and advocate a doctrine - the advantage to any and
wise, I want personally to prosper, to be esteemed by others, all parties of unrestricted free trade - without a shred of
and to be able to esteem myself; I want the same for almost empirical evidence for the proposition? The arguments for the
everyone, but I am prepared to make costly efforts to those ends mutual advantages of free trade are almost entirely theoretical,
only for those I care about. I do not at all think I am obliged to based on analysis of interactions of two nations under circum-
treat others who are remote from me as moral equals of loved stances that do not apply even approximately to any country in
ones and friends; I have never put a Somali through college. I do the world. The ethical considerations are equally obvious: ac-
not seriously entertain the general proposition that actively cess to the U. S. market is a still a prize that some other nations,
doing good should excuse predictable harmful consequences; such as Mexico, are willing to pay a price to obtain; should we
and I do not want other people to do so either; otherwise, not make decent economic treatment of Mexican citizens - a
checking into a hospital would be dangerous. I have an elabo- decent minimum wage, worker safety, enforced laws against
rate, and again inarticulate, system of views about deference and externalizing costs, a judicial system that is not corrupt - part of
autonomy; I defer to others in acknowledging their rights to act that price? You don't have to be any kind of utilitarian to answer
in all kinds of ways without interference from me, and I expect that question.
others to defer to me. One of my principal goals is to keep my
realm of autonomy. In certain contexts (probably too few) I defer
to others' opinions about what is right, wrong, or prudent. Only
in very special contexts - for example, when I was a department
head and had to make policy decisions - have I deliberately tried
to figure out what action would be best on average over all Consequences of consequentialism
concerned, all things considered.
Rick Grush
I think the structure of ethical judgment is similar in many Departments of Philosophy and Cognitive Science, University of California,
people. Looking over this structure, I am inclined to endorse it. San Diego, La Jolla, CA 92093-0302
Electronic mail: rgrush@sdcc3.ucsd.edu
Maybe that is wrong. Maybe it would be better if we were more
like egalitarian utilitarians, but I do not see any rational demon- I would like to begin by dissociating two strands of Baron's target
stration of that proposition. (I suppose there are some moral article, the moral and the epistemological. I will argue that his
sentiments I have that I could be persuaded not to act on, ethical claims are interesting, but not beyond question, and that
because they are irrational; for example, I vote out of a vague the epistemological issues he raises (as well as some he does not)
sense of civic duty.) The argument Baron gives in the first part of are of central importance.
his target article to establish some such thing is so much First, even if one is a "consequentialist," two different phases
philosophical argle-bargle. The structure of the argument seems of the reasoning process can be distinguished. The first concerns
to be this: In considering whether or not P, we must set aside any the prediction of the consequences of various actions and the
estimation of their "utility.' The second concerns the ethical When normative models take the form of formalized systems,
question: "What should I do?" - that is, even given total such as inductive logic or expected utility calculus, it is natural to
knowledge of all consequences of candidate actions, the ethical think of deviations from the standard as the imperfect applica-
question of what to do remains. That they are in principle tion of those very standards. Thus we are led to a view of human
distinct follows from their dissociability - one can be "good" at performance that posits some sort of normatively adequate
either while being "bad" at the other. competence embodied (somehow) in our cognitive apparatus, a
I first want to point out that bare consequentialism qua competence of which we are unable to take full advantage
normative moral theory is not obviously adequate. The seed of because of biases and the suboptimal functioning of related
the problem is that it justifies "unfair" treatment, specifically, cognitive "modules" (such as short-term memory).
the benefit of some through the harm of others. I say it is the Normatively, this may be acceptable. And perhaps for de-
seed of the problem because unfairness itself may not always be scriptive purposes one can get by by positing a rational "lan-
viewed as a problem. In fact, the examples Baron gives of guage of thought" and adding epicycles to account for deviations
relative farmer incomes and of harm inflicted unfairly upon from the standard, even if our cognitive architecture is not really
people dependent on gasoline by increasing the gasoline tax a "language of thought." But the prescriptive enterprise, to be
seem to support his point that unfairness may not always be fully effective, should have an accurate picture of human cogni-
wrong. But these are relatively innocuous examples of unfair- tive architecture and representational capacities. It is not
ness. The seed grows when greater numbers of people are taken enough to compile lists of biases. Johnson-Laird (1983) takes a
into consideration because it will always be possible to justify step in this direction, as do Johnson (1987) and Lakoff (1987). In
arbitrarily unfair hardships to a few when it results in a benefit the philosophical literature, criticism of normative models as
to enough others. characterizations of unpolluted cognitive competence has been
To see the force of the last point, consider the following. provided by Churchland (1979; 1989) and Stich (1990).
Utility calculations must take into account the benefits and My point, which is not necessarily at odds with anything
harms experienced by all people (and perhaps animals and Baron says, is simply that prescriptive epistemology should look
plants as well). But surely "all people" must include not just to psychology not only for lists of biases, and so forth, but also for
those currently living, but future generations as well (presum- theories of cognitive architecture that account for deviations and
ably, this is part of the motivation for environmentalists). No that suggest useful improvements because they are actually true
doubt this number is tremendous, perhaps in the trillions or of the brain.
more. Now suppose that some small benefit could be bestowed
on all these people, such as a fast painless treatment for the
elimination of all warts. Suppose further that such a treatment
could be developed, but it would require painful, drawn out
experimentation and vivisection of a hundred or so people Truth or consequences
(determined at random). In principle, such a practice could be
justified. A consequentialist ethic will have to provide some John Heil
means for assigning utility to things like wart elimination and Department of Philosophy, Davidson College, Davidson, NC 28036
Electronic mail: joheil@apollo.davidson.edu
painful death in order to get off the ground, and without some
sort of provision for "fairness" or basic human rights or dignities How are we to evaluate claims to the effect that consequential-
it will be possible to justify the most heinous atrocities commit- ism provides a correct normative or descriptive account of
ted on a few, provided sufficient benefit accrues to the many (and rational decision? On the one hand, such claims might be
provided that the same benefits cannot be obtained by less harsh interpreted as pertaining to the character of principles govern-
methods). I chose a medical example because in these cases the ing or ideally governing agents' decisions. On the other hand,
gains are likely to affect many future generations and because they might be taken to concern, not principles deployed by
the nature of medical research is sometimes unpleasant (as actual or ideal agents, but the character of the justification or
"animal rights" literature makes clear). [See also Dawkins: explanation of those principles. The cases come apart because it
"From an Animal's Point of View" BBS 13(1) 1990.] could easily turn out that nonconsequentialist principles em-
Two final points on this issue. First, the argument above does braced by agents like us yield better outcomes - judged conse-
not rely on the actual occurrence of situations such as the one quentially -than do consequentialist principles (e. g, see Railton
sketched. Though I think that many unfairnesses most of us 1984). Owing to contingent biological, psychological, and envi-
would find morally unacceptable could probably be justified on ronmental factors, it might be true of us that we fare better by
consequentialist grounds, the point is that bare consequential- instilling nonconsequentialist principles and encouraging their
ism provides no principled way to rule such possibilities out, and development in others. If Mother Nature is a consequentialist,
this should worry us. then undoubtedly she has a hand in this process. Consequential-
Second, it will be possible to sneak such considerations in the ism might, in this way, succeed by concealing itself. Under the
back door, as it were, by factoring the horror, and other emo- circumstances, we should expect our intuitions about cases
tions we (should) feel at the violation of such basic rights into the occasionally to yield judgments different from those mandated
utility calculation. But if this horror at human rights violations is by explicitly consequentialist principles.
going to be a constant in all utility calculations then we might be Imagine that our everyday assessments of the merit of options
better advised to factor it out of the consequentialist ethic and open to us were based on estimates of the probability and
treat it (basic human dignities, etc.) as a separate ethical con- relative desirability of potential outcomes. Outcomes depend on
straint or constraints on a par with, rather than subordinate to, endless factors about which we may be partly or entirely igno-
expected utility (especially when education policy is being rant, however, and their relative desirability may be difficult to
discussed). gauge. I am faced with a choice of telling the truth or lying to my
That said, I would like to turn to epistemological concerns. I boss. The truth may hurt, but lying could have repercussions I
can agree with Baron that the ability to reason clearly about am at a loss to evaluate. Under the circumstances, my ends
consequences is in general to be desired, even if one does not might be better served by my inculcation of a nonconsequential-
always, for whatever reason, choose courses of action that have ist, deontological principle that forbids lying per se. Having
the greatest bare utility. This improvement of reasoning is, as embraced such a principle, I might blunder in various ways on
Baron correctly notes, the task of prescriptive (and derivatively, particular occasions. I might find myself compelled to tell the
descriptive) epistemology; I would like to close by offering some truth when the consequences of my so doing would be disas-
methodological cautions. trous. Suppose, in contrast, I were endowed with finer-grained
might initially teach overgeneralized rules, because more de- Consequentialism in haste
tailed ones are hard for the young to learn. Usually, however,
parents will ultimately teach all requisite complexities. And
Roger A. McCain
they do this not only because they wish a well-liked child, but
Department of Economics, Drexel University, Philadelphia, PA 19104
because they wish an upright child.
Electronic mail: mccainra@dunx1.ocs.drexel.edu
Rena might want Sanford both liked and upright. But even
here, she need not have overgeneralized. She may be aware that Because I tend to agree with Baron that consequentialism is a
relative to the goal of well-liked children, the rule is too general, valid frame for the evaluation of actions and policies and that
nevertheless she may believe that it should be taught for the people often act on confused consequentialist rationales (Mc-
sake of having an upright child. She might view the admittedly Cain 1991a; 1991b; 1992), I would very much like to agree with
partial coincidence between being upright and being liked as his reasoning. However, it seems to me that he is too hasty, and,
just an added, though not unambiguous, reason for teaching the indeed - so far as I understand his argument - has made one
general rule. fallacy offset another.
Thus, it is possible, and probably common, for parents to The fundamental fallacy is the modal1 fallacy of attempting to
teach deontological rules without overgeneralizing with respect deduce "ought" from "is." (I take it that a "prescriptive" theory is
to their goals. If overgeneralization is to be a general explanation one that tells people what they "ought" to do.) Baron's argument
for how deontological beliefs arise, the overgeneralization must here is intuitively persuasive: he says that we should endorse
come elsewhere. One possibility is that, if it is not the parent norms that help us attain our goals, simply because our goals are
who overgeneralizes, it is the child. But again, though children our goals. Therefore, because Adolph Hitler had the goal of
can overgeneralize relative to their goals, this is not a plausible exterminating the Jews, the norm "kill Jews" should be en-
general account of how they come to have deontological dorsed, at least by Hitler. Two things are wrong with this. First,
intuitions. it takes the goals as given, and second (to be valid as a basis for
To see this, assume that Rena believes one should never lie, normative thinking or prescription) it attributes moral propriety
and has the goal of an upright child, and hence has not herself to them. Instead, we should ask ourselves what the proper goals
overgeneralized when she teaches "Never lie." Sanford over- are, and, if our goals are not proper, we should adopt others that
generalizes in learning "Never lie" if he adopts the rule only are. Hitler should not endorse the norm "kill Jews" and should
because he believes it will make him liked. But Sanford can also change his goals.
learn this rule without any overgeneralization. Like Rena, he Here is another difficulty Baron overlooks: there are a num-
might have other goals relative to which "Never lie" is not an ber of well-known cases in which behavior according to a
overgeneralization. For example, he may wish to learn what nonconsequentialist rule gives rise to better consequences than
Rena is trying to teach and to be the sort of person of whom she any explicitly consequentialist rule can. The best known of these
will approve. Relative to these goals, "Never lie" is not an cases is the repeated prisoners' dilemma (e.g. Axelrod 1984;
overgeneralization. Indeed, given these goals, if Sanford McCain 1992, p. 211) but perhaps the most provocative example
learned anything else, he would be in error! is the chain store paradox2 (McCain 1992,pp. 211-12; Selten
Might overgeneralization occurred anywhere else? Perhaps 1978). In these cases, a simple consequentialism is reduced to
even if Rena is not currently overgeneralizing, she may have absurdity.
done so in the past when she first learned the rule "Never lie." Baron states that our only reason for endorsing norms is that
But though errors could have occurred in her past life, her they advance our goals. However, there is a whole family of
situation when she acquired her moral belief was much like that deontological norms to which some people genuinely subscribe
of her own child. Because Sanford can acquire this rule without (McCain 1991a). According to a deontological norm, the right-
overgeneralization, Rena as a child could have done so as well. ness or wrongness of an act is inherent in the act, independent of
Seeking people who could have made the error still earlier the consequences. Thus, contraception is seen as being wrong,
simply sets up a regress where, at each stage, similar points can regardless of the fact that contraception has no bad conse-
be made. If one goes back far enough, it is certain someone quences and may well have good ones. One might disagree with
made the error Baron describes. But as we work back, all sorts of this way of thinking about moral questions, but simply to assert
errors were made, and there is no reason to give priority to that they do not exist is hardly satisfactory (on the rationality of
overgeneralization in our account of how deontological intu- such rules, see McCain 1991a). In particular, it seems likely that
itions arise. many of those who make a moral distinction between active and
In sum, though some people undoubtedly overgeneralize in passive euthanasia do so on the basis of a deontological rule: "It is
the adoption of deontological moral beliefs, this is not a plausible wrong to kill."
general account of how deontological intuitions arise. This does Baron then claims that rules that are deontological in form
not mean these intuitions are not errors - any consequentialist occur because of a fallacy of overgeneralization. Without deny-
such as Baron or me must believe they are. But I do not believe ing that this sort of thing can occur, one might suggest that
they can be reduced to a single kind of reasoning error, such as Baron has committed his own fallacy here: he has over-
overgeneralization. generalized a common, but by no means universal, occurrence.
On the other hand, there is value in seeing our deontological Nevertheless, I would think that Baron's diagnosis is right as
intuitions as overgeneralized versions of consequentialist princi- often as it is wrong. Many rules that appear deontological
ples. For even if no one ever made the error of overgeneraliza- probably do arise by confusion from consequentialist reasoning.
tion Baron describes, it is possible to find a common theme in I have argued that (to be modally sound) a "rationale" must have
the moral principles one accepts and to view this as being what a three-part structure, arguing from a value premise via an
the principles are, in some sense, really trying to get at, though assertion of fact to an imperative conclusion. The assertion of fact
not with perfect accuracy. This Kantian extraction of general is or entails that valued consequences follow from the action (see
moral principles from what Kant calls "the ordinary knowledge Hare [1952/1972] for the roots of this idea in moral philosophy).
of morality" may be a valuable addition to Baron's other argu- Then an action is rational insofar as it is undertaken on the basis
ments for consequentialism. of a valid rationale; in addition, it is moral if the value premise is
a morally valid one. But rationales can fail in various ways, some
worse than others. For example, a deduction of consequences
from an action may not be formally valid but may nevertheless
capture a correlation that is common enough that the deduction
establishes a "defeasible" prima facie case for the conclusion
(Pollock 1986). Thus, rationality is relative, not absolute. Some one that is best on some measure. Ignore problems about the
rationales (for the same decision) may be better than others, measure. Can one think of all persons for all future times?
whereas those may in turn be better than still others. Obviously not. But however many persons and however far into
Moreover, there is good reason to think that people are the future one has considered, one can always think a little
usually imperfectly rational — that is, that the rationales on farther. Is expending the effort to think a little farther always
which they act are inferior (on some tests) to some other sensible? Obviously not. The conclusion, then, is that conse-
rationales on which they might act. For example, people may quentialism makes heuristics inevitable in moral decision-
use rules based on rough correlations when more complex rules, making. One heuristic that obviously emerges is something like
which yield better correlations, are available. The more com- Simon's satisficing (Simon 1982; Slote 1985). But there are surely
plex rules would give rise to actions better suited to the specific many others (Morton 1991). Which ones will pay off on average
cases but they are not known to the decision makers who use the will depend on the temporal range of our averaging, the popula-
simpler rule. All the same, they are "irrational" in a normative tion we average over, their way of life, and their physical
sense. Their actions are inconsistent with their own values, as situation.
their values are expressed in the value premises of the rationales The social contract point of view isolates one objective core to
on which they act. This inconsistency justifies the characteriza- morality: the mutual advantage we gain by cooperating with one
tion of the actions as "irrational." another. But there are limits to this objectivity. If we want to talk
Accordingly - as Baron contends - a normative model can be of mistakes in moral reasoning, we have to think carefully.
supplied to evaluate decisions, and we may hope that with Mistakes for whom faced with what range of situations under
systematic research and education it might be possible to what restrictions on their powers of deliberation?
improve the decisions on which both public policy and private
action are based. But if this research and teaching is based on
Baron's narrow consequentialism, it will fail. However confused
some deontological-like reasoning may be, some of it reflects
clear thought and the deepest value commitments of the people Side effects: Limitations of human rationality
who express it. Teaching that runs contrary to these deep value
commitments will be rejected. The consequences of such teach- Keith Oatley
ing would be regrettable. I conclude that a consistent conse- Centre for Applied Cognitive Science, Ontario Institute for Studies in
quentialism must respect the deontological commitments of Education, Toronto, Ontario, Canada M5S 1V6
some of our neighbors (although, so far as I know, there is no Electronic mail: oatley@oise.on.ca
reciprocal duty for deontologists to respect the value commit- By making explicit the idea that we should think in terms of
ments of consequentialists). In this, Baron has failed; and the goals, I believe Baron casts the theory of reasoning into the most
failure is dangerous. productive framework possible. Yet I also believe the analysis
lacks something essential. Consequentialism as stated here is a
NOTES
1. For an introductory discussion of modal logic, see Chellas (1980); doctrine for gods who are omniscient (with perfect mental
note also Elster (1978). models) and omnipotent (without limitations of resources). Gods
2. Counterterrorism expresses the chain store paradox in a practical are perfectly rational planners of the kind that programmers
context, as does entry deterrence in oligopoly. would like artificial intelligence planners to be in the limited
domains in which they operate.
The shortcomings of perfect rationality as a model of human
cognition were pointed out by Neisser (1963) and Simon (1967). I
deal first with Simon's point. Human mental models are imper-
Does consequentialism pay? fect - we cannot foresee all consequences of actions. Resources
such as time and materials are limited - we cannot control the
Adam Morton
world. Simon argued that the design of any intelligent system
Department of Philosophy, University of Bristol, Bristol BS8 1TB, United
therefore needs to include priority management, for example,
Kingdom
using interrupts to stop computing toward a goal when some-
Electronic mall: adam.morton@bristol.ac.uk
thing important occurs that was unforeseen.
To study errors in moral reasoning one has to know what is not an Baron does allow for uncertainty. He says that in deciding
error. Baron takes it that a moral norm is correct if it would be in between two political programs we should choose that which is
everyone's interest for it to be universally adhered to. And he best on the whole; it is irrelevant that the other might turn out
takes it that consequentialism passes this test. But it is not better by luck. The implication is that such choices will be
obvious that it does. For example, if you are cleverer than most possible in general and that uncertainty can be consigned to a
people, you might be better off if you were not obliged to tell the residual category, luck. Garfinkel (1967) had a better name, "the
truth, even if it made you less confident that others were not et cetera category," to contain everything we could not think of.
lying. And if you are richer than most, you may be better off if Though I accept the argument of consequentialism as correct
you are not obliged to help others. So you might want to make a in principle, it may not help if the et cetera category is large:
difference between acts and omissions. Baron's picture of ethics consider that in Baron's arguments there are biases toward
is, in effect, that it is what would result from a contract between omission and the status quo. In Baron's experiments on deciding
perfectly rational agents. But recent discussions (for example, whether or not to vaccinate, the problem is presented in terms
Danielson 1991) make it clear that social contracts depend on of a perfect mental model: the only consequences of vaccination
the initial situations of the contractors and the constraints are protection of a child against a 10 in 10,000 chance of dying if
determining which aspects of their situation may affect the vaccination were omitted and a lesser risk of dying from the
contract. It is in fact pretty unlikely that we can talk of the unique vaccine. But this model is not perfect. One unmentioned factor
social contract that would represent a fair and mutually advan- is that as more children in a population are vaccinated the
tageous bargain among an actual group of people. incidence of the disease in other children (including those of
One might suppose that consequentialism was at any rate friends and relatives) decreases because unvaccinated people
sometimes the optimal norm, which would be to everyone's are less likely to be infected. Thus, the vaccination problem
benefit. But there are serious doubts here. Full consequential- described by Baron is oversimplified. More generally, if I were a
ism requires that one consider the consequences over all time subject deciding about vaccination I might think that I did not
and for all people of all the options open to one, and choose the know enough about disablement potentially caused by the
given the generalization, "Other things being equal, if A then B, sought to accommodate central elements of commonsense mo-
"B should (in this sense) occur ifA does. I suspect that something rality - rights, deserts, personal prerogatives, and so on - to
like this grounds (legitimate) talk of competence/performance increase their theory's intuitive acceptability (notable excep-
distinctions, and "mistaken inferences" in cases of visual il- tions are Kagan 1989; Singer 1972).
lusion. Baron enters into this dialectic with an important though still
So perhaps Baron is offering a competence model, according developing point: at least some of the distinctively nonconse-
to which agents reason consequentially, other things being quentialist features of commonsense morality may be attribut-
equal. If I can preserve one life or five, other things being equal, able to cognitive heuristics and biases that are familiar from a
I will indeed preserve five. And some nonconsequentialist wide range of nonmoral judgments where few would be pre-
commitments (e.g., caring about act/omission distinctions) may pared systematically to defend them. This opens up the possi-
well result from overgeneralization. But Baron provides no bility of questioning on principled grounds whether consequen-
evidence for holding that our decision-making competence is tialism is to be criticized or congratulated for failing to capture
monoprincipled. It seems that, other things being equal, I will certain aspects of moral common sense. We might adapt this
not knowingly violate another person's rights. Saying how point for somewhat wider purposes by saying that recent work in
agents balance such commitments is hard. To take a much cognitive psychology bears on ethics in a number of ways.
discussed example, it seems (1) permissible to divert a runaway Heuristics, framing effects, and so forth lead not only to noncon-
trolley from a track occupied by five people onto a track occu- sequentialist reasoning but also to poor consequentialist reason-
pied by one, but (2) impermissible to remove someone's organs ing. "Accommodationist' consequentialist defenses of a failing-
to save five needy patients (for discussion see Thomson 1990). to-help/actively harming distinction, for example, often place
The latter belief is "nonideal" given the consequentialist gener- much greater weight on (salient) "out of pocket" costs than on
alization; and given the rights generalization, the former belief (less salient) opportunity costs.
is "distorted." A model that rejected all consequentialist reason- To what extent is commonplace morality nonconsequential-
ing as overgeneralization would be implausible: caring about ist? Baron seems to conclude that nonconsequentialist thinking
consequences seems to be a deep part of our decision-making is involved when his subjects appeal to considerations of fairness
competence. But just as physicists allow for mass and change, or rights to explain why they would, for example, vote against a
psychologists can go beyond "rabid-rights" and "rabid- particular law that they also admit would do more good than
consequentialist" models. (In Pietroski [1993], I discuss ideali- harm. He notes that few, if any, attempt to give any distinctively
zation and its relevance for moral reasoning at length.) consequentialist arguments at this point, such as appeals to
We might reject the beliefs delivered - even under ideal precedent effects. Yet my experience as a teacher of introduc-
conditions - by a given competence. Our "snap judgments" tory ethics suggests that even theoretically naive individuals
about probabilities may provide examples; although I do not see often appeal to (broadly) consequentialist considerations when
how such "external" standards could be justified without appeals asked what rights there are, how to set a standard of fairness, or
to reflective equilibrium. Of course, given Baron's model, non- why fairness and rights matter. Thus, students who express firm
consequentialist arguments are "fallacious" (in his nontechnical support for Locke's doctrine of natural property rights also
sense). But given an alternative model - such as Rawls (1971) - typically seize on "invisible hand" arguments that purport to
according to which decisions should maximize (rational) desire show the system of private property and exchange to have the
satisfaction subject to various constraints, some utilitarian argu- best consequences overall. One picture this suggests: common
ments are unsound. So we want (1) evidence for particular sense embraces certain "meta-rules " — "Do not accept rules that
competence models, and (2) justifications for any "competence- violate rights," "Require rules to be fair," and so on - and then
external" standards. But if these are goals, Baron does not offer uses these to assess more specific rules. Thus, a high tax on
an advance over Mill (1861). Moreover, Rawls has a detailed gasoline might be rejected as unfair - despite doing more good
theory, not just a "suggestive" analogy. than harm "by itself." This could simply reflect a higher-order
Finally, it is of practical importance that some decisions application of indirect consequentialist thinking: a polity in
should be made in the idealization, but not pragmatic sense (or which unfair individual rules would be accepted whenever they
vice versa). But the only other sense of "should" relevant to would yield a net benefit might as a polity realize less overall
public policy that I can think of is moral. And again, we do not good in the long run than one in which there was strong
want Baron's consequentialism for our moral theory. It would, resistance to unfair rules. It would perhaps be interesting to test
for example, justify keeping some ignorant and coercing others experimentally whether such consequentialist justifications of
into consequentialism, if that would satisfy our collective goals meta-rules would be widely embraced. (Such a justification is
better than (our current practice of) offering courses that merely distinct from - though it often occurs in the company of- claims
require students to apply consequentialist reasoning; and con- about precedent, for precedent arguments attribute remoter
siderations ofjustice or individual rights would be irrelevant. So effects to particular rules, purportedly showing that a particular
I am left wondering what Baron takes the point of his normative rule is not, on balance, beneficial after all.)
model to be, and what kind of norm he has in mind. As someone of consequentialist leanings, I welcome Baron's
research. I would urge, however, that he see his contribution to
moral theory as depending on less controversial assumptions.
Three examples follow.
First, he might want to reconsider his objections to Rawlsian
Broadening the base for bringing cognitive methods. It is customary to distinguish wide and narrow Rawls-
psychology to bear on ethics ian reflective equilibrium, as in Daniels (1979). Baron properly
views narrow reflective equilibrium - "systematizing] intu-
Peter Railton itions into a coherent theory" - as incomplete. But in wide
Department of Philosophy, University of Michigan, Ann Arbor, Ml 48109 reflective equilibrium we expose our moral judgments not only
Electronic mail: peter— railton(3mm.cc.umich.edu to other moral judgments and principles but to broader coher-
Consequentialism has always had a somewhat uneasy relation ence tests in which we invoke other norms (e.g., epistemic
with commonsense morality. Impressed with the role of igno- norms), going empirical theories (e.g., psychology), and what-
rance, prejudice, power, and privilege in shaping actual social ever insights philosophical investigation might afford us (e.g.,
norms and institutions, the first consequentialists - utilitarians - into the nature of persons). It seems to me that one could recast
were led to advocate significant reform of commonsense theory Baron's argument as being for a potentially very plausible piece
and practice. By contrast, modern consequentialists have often of wide reflective equilibrium: given what we can now see about
the psychological mechanisms (according to our going empirical between two bets? Rational economic theory would dictate
theory) underlying certain judgments, we are less inclined maximizing the subjective utility of wealth as the only relevant
(given prevailing epistemic norms) to take these judgments at goal. Thus, the gamble that will yield higher expected gain
face value, and more inclined to subject them, and moral should be preferred. Nevertheless, one can conceive of other
opinions that depend more or less directly upon them, to critical goals, such as psychological "well-being" that may also pertain to
(philosophical) scrutiny. this choice. If goals such as "increasing satisfaction" or "minimiz-
Second, Baron may wish to build from a broader normative ing regret" are allowed, the best consequences may be achieved
base because it is doubtful whether his claim that "our goals give by choosing the "safer" alternative rather than the one with the
us reason to endorse consequentialism as a standard of decision "higher expected gain." Indeed, research shows that subjects
making" can be fully sustained. Early on, he claims to restrict his often prefer the safer bet over the one with higher expected
discussion to examples where the "appropriate balance of goals value. This preference may reverse when the bets are evaluated
of self versus others . . . does not arise," but this leaves a reduced separately in a pricing task or even compared to each other in a
domain for ethics, and within a few pages he is discussing matching task (Slovic & Lichtenstein 1983; Tversky et al. 1988).
"omission and status-quo bias," which, given the uneven state of Preference reversals of this kind are a paramount example of the
the status quo, may reflect strong conflicts of self versus others. distinction between evaluating consequences as judged in mak-
Baron himself mentions as examples "failure to consider aiding ing a decision and in the absence of a decision. However, they
the world's poor" and leading "lives of leisure" when we are could also raise the question whether the very goals one con-
capable of doing more for others. siders, or should consider, depend on whether a decision has to
be made.
Third, Baron advances a very strong thesis, one roughly to the
effect that all legitimate critical reflection on norms must be If people's emotions are weighed in evaluating consequences
consequentialist: "we should endorse norms that help us achieve then it becomes relevant to compare their feelings as they
our goals . . . because we have no other reasons for endorsing experience the consequences of each alternative. In direct
norms." But a long philosophical tradition, associated with but judgment of emotions following resolution of uncertainty, we
hardly limited to Kantians, suggests that there might be reasons found that acts leading to the worse outcome produced bad
for endorsing norms that are prior to, or that stand on different feelings more than omissions leading to the worse outcome,
ground from, goal achievement. Baron's work remains relevant, regardless of whether the two outcomes were gains or losses,
however, because almost every moral theory - indeed, almost relative to the status quo (Baron & Ritov, in press). Expectations
every theory of practical reasons - gives a crucial role to goals concerning such ex post facto feelings may be taken into account
and their achievement. in evaluating the consequences of acts versus omissions with
respect to the goal of "minimizing regret. " The finding that
judgments about emotion and the advisability of the options
reveal the same pattern of omission bias is compatible with this
hypothesis.
Can goals be uniquely defined?
In the examples I have mentioned so far, the decisions
liana Rltov concerned only the decision maker's self-interest. Thus, the
simple golden rule of choosing the option that is most likely to
Department of Industrial Engineering and Management, Ben-Gurion
University, 84105 Be'er Sheva, Israel
achieve the goals of the person whom the decision concerns does
Electronic mail: ritov@vms.bgu.ac.il not solve the problem for those decisions. In fact, the same
argument may be raised with respect to decisions concerning
A coherent comprehensive model serves both to organize exist- others. Even if the decision maker has in mind the best interest
ing knowledge and to spur new research. In behavioral decision of the person the decision concerns, he can still have a complex
making, expected utility theory, a normative model, serves as a idea of what this person's goals are. In the vaccination case
yardstick for actual decisions. Although the validity of expected discussed in the target article it is natural to assume that from
utility as a descriptive model has been largely discredited, the child's perspective, reduced risk of death, no matter how it is
behavioral decision-making research could not have advanced as achieved, will serve the goal of living. Presumably, in comparing
it has without this model. the state, "the child died from the flu" to the state, "the child
Consequentialism, as presented in the target article, is a died from the vaccine," the emotions of the child cannot be
wider, more general principle than expected utility. According taken as a differentiating factor. However, if the disease and the
to this principle, decisions should be based on evaluating ex- vaccine involved risks of some disablement rather than death
pected consequences with respect to goal achievement. For the child might care whether she became disabled from the
example, the goal of "living" would best be served by reducing disease or the vaccine.
the overall risk of death, even if this aim could only be achieved Even the goal of "living" is not as simple as it may appear. In
by introducing some new risk (such as the one associated with the "Asian disease" problem of Tversky and Kahneman (1981),
vaccines). This general normative principle provides an impor- the framing of the goal affected subjects' preference between
tant basis for testing people's decisions on different problems, two given options. When the options were described in terms of
such as the provision of compensation and punishment, and the saving lives, the certainty alternative was preferred. When the
acceptance of social reforms. same options were described in terms of the number of expected
The simple form of consequentialism does not specify con- deaths, the riskier alternative was preferred. A similar framing
straints concerning goals or people's preference ordering among manipulation affected subjects' preference between risk-
states of the world, as reflected in their judgment of conse- reduction options in situations with multiple life-threatening
quences. The general nature of the model, as presented by risks (Ritov et al. 1993). When the options were described using
Baron, has the advantage of providing a single principle applica- the "lives saved" frame, the majority of subjects preferred equal
ble to a wide range of decisions. As a prescriptive model, reduction of all risks over a reduction in a single risk, achieving
however, the version of consequentialism presented in the the same overall reduction. In the "expected deaths" frame,
target article may encounter some difficulties involving the most subjects showed no preference for either of the two
underlying assumption that goals can be unambiguously defined options. Thus, the framing of the goal as "saving lives" or
and that consequences have some absolute and objective value "reducing deaths" affects people's judgment as to which course
vis-a-vis those goals. I will argue that this assumption is not of action yields the best consequences.
straightforward and can be called into question. I do not want to imply that framing effects of the kind
What is the relevant goal one should consider when choosing described here are normatively justifiable. Indeed, changes of
preference caused solely by the difference in description of the pursue the prevention of harm and the promotion of benefits,
very same options are clear manifestations of nonnormative however these are distributed (and whatever rights are overrid-
behavior. However, these findings raise some questions as to the den, etc.); or perhaps to pursue instead some trade-off of benefit
prescriptive value of a simple form of consequentialism. It may and fairness, and so forth, a trade-off that sometimes might call
be necessary to develop a more constrained version of the model for resisting that which promotes the most benefit. Preventing
if it is to fulfill its prescriptive purpose. harm and promoting benefit is the old utilitarian goal, and we
can not appeal to that here. Whether a norm would advance that
goal can not be made decisive for us, for that would beg the
question of what goals we should have - what norms we should
follow.
Goals, values and benefits This leads to a final comment. The studies Baron cites do not
Frederic Schick prove what they claim. They show that people's norms and
decisions are often not utilitarian, that people often govern
Department of Philosophy, Rutgers University, New Brunswick, NJ 08903
themselves by nonutilitarian norms. They do not establish that
Baron reports studies of decision making that testify to a neglect people's choices are ever nonconsequentialist. Utilitarianism
of the consequences, and he proposes an explanation. He holds calls for choosing whatever results in the biggest aggregate
that decisions are "nonconsequentialist" when people misapply benefit. Consequentialism calls for choosing so that we get the
goal-seeking norms. The goals being sought are believed by best results - best in our own valuation, whatever that may be -
these people to promote some more basic goals, but that and this allows for many choices a utilitarian has to reject. (I
connection then fails. I think too much can be made of this. The expand on the open-endedness of consequentialism in Schick
goals people have are rarely connected in this purposive way, 1991, pp. 121-45.) Utilitarianism is not a logic. It is a theory of
and 1 doubt they are so connected in all the cases to which Baron value, a special additive ethic: it tells us to go by benefit sums.
refers. Why should people with different ethics be said to be thinking
Take his discussion of resistance to a coerced, uneven reform: carelessly? Or rather, why should anyone who is not a utilitarian
people sometimes resist because they care about fairness or fault how these people think?
because they take the coercion to be a violation of rights. Baron
considers this "nonconsequential" because, by assumption, it
opposes reform: people would be better off, though some better
off than others. But on whose evaluation? Those who have a goal
of fairness may rate an outcome of unfairness low, and those who What goals are to count?
care about rights may set a low value on an outcome of a rights
violation. Coals, after all, according to Baron, are "criteria by Mark D. Spranca
which people evaluate states of affairs." Department of Psychology, University of California at Berkeley, Berkeley,
CA 94720
Baron assumes that the goals of fairness and rights are purpos-
Electronic mail: spranca@garnet.berkeley.edu
ive only, that people care about fairness and rights because they
think (in the present case, falsely) that they serve the general Jonathan Baron addresses a set of issues of immense importance
welfare, this being the ultimate goal here. He holds that none to philosophers, psychologists, economists, educators, parents,
but ultimate goals function as standards of value. Still, he offers and policy makers. How should people make decisions? How do
no grounds for supposing that fairness and rights are purposive people make decisions? And what should be done about depar-
only. Judging informally, by what people say, fairness and rights tures from normativity? Having read Baron's two books on these
goals are often ultimate, and philosophers who consider them topics, which I highly recommend to the reader wanting a more
ultimate find a large, approving public. (On fairness as ultimate, complete treatment, I think he presents a strong case for the
see Rawls 1971; on rights as ultimate, see Dworkin 1977; Nozick appropriateness of consequentialism as a normative benchmark
1974.) and the occurrence of nonconsequentialist decisions (Baron
This is also true of the other issues addressed. On punish- 1988a; 1993a). I would, however, like to raise a few concerns
ment: Why suppose that retribution is meant to be serving about his normative theory and point out a few of its understated
deterrence, that, for most people, a goal of retribution is strengths.
purposive rather than ultimate? Baron says only that it could be Does consequentialism have anything to say about what goals
purposive, but this alone does not warrant the judgment that, one should have? This is a difficult but crucial issue for Baron's
when it is not deterrent, retribution is foolish. On active eutha- theory to address. If consequentialism respects individual dif-
nasia: Why suppose that opposing this is a misguided harm- ferences in goals, it would seem to prescribe and laud actions as
prevention, that people oppose it because they believe that different as Hitler's and Mother Theresa's. If, on the other hand,
killing causes harm? Why assume that preventing harm is their it allows only certain goals, it would seem to change the focus of
ultimate goal here? Most people have more specific values. the theory from rationality to morality. (Perhaps Baron can
They are opposed to mercy killing because it is a killing. discuss whether he is offering a theory of morality or rationality
Baron goes beyond the point about some goals being purpos- [or both] in the course of answering this question.) Whichever
ive only and not connecting with their purposes. He suggests, claim Baron is making seems to be unsatisfactory. The first trou-
more broadly, that goals and norms sometimes fail to be rational. bles anyone for obvious reasons. The second seems to require
What norms we should follow - what goals we should have - Baron to specify what goals people should and should not have, a
must go by the consequences. Baron notes that this can be liberty most people would be unwilling to relinquish.
tricky. We cannot judge the norms we might follow by whether There is a possible way out of this dilemma. Trying to achieve
our following them would advance our goals; that would be a goal affects the achievement both of one's own other goals and
begging the question. Our goals (and norms) must be set aside, of other people's goals. Goals can be analyzed and evaluated in
and we must reason in terms of what is left. But with our goals set terms of their consequences for the achievement of these other
aside, how could we reason at all? On what basis could we then goals. Goals are disallowed (by consequentialism) to the extent
say how good or bad the consequences are? that they prevent more than they promote individual and
There is no neutral ground. Baron refers to preventing acci- collective goal achievement. Compared to moral goals, immoral
dents, lowering the death rate, diminishing costs - to ways of goals probably fare poorly because they interfere with the goals
preventing harm and of promoting benefits. But this still begs of other people and often lead to negative outcomes for the actor
the question. We are asking what norms to follow; whether to (e.g., guilt, embarrassment, punishment).
alternatives to human experimentation are probably be best, in the long run, to punish certain desires, but
available. As suggested by Baron (1993b), sacrificing a probably simple neglect is a good prescriptive rule. Like
person for organs would make everyone else afraid, and other defenses of intuitive principles, however, both of
the cost of fear and protective activity might be too great. these arguments are contingent on the facts.
In the case of the girl in the well, spending the money on
more "efficient" lifesaving might not be a real option, and R1.4. Ecological validity. Following up this point, Ayton &
spending it on the girl might be the best use of it (Baron Harvey and Oatley make the important observation that
1993a, p. 147), especially taking into account the second- the rules we should follow depend on the facts of our
ary effects of a decision to let the girl die on the general situation. This is how the normative-prescriptive distinc-
level of cynicism about government. (Moreover, the real tion allows for cultural differences: these differences are
question is not whether to try to save the girl, but when to prescriptive, not normative.
give up trying. Decisions about giving up are made in real Arguably, intuitive moral systems work best in inter-
life, and resources are a consideration.) personal relationships, next best in organizations, and
Second, the intuitions involved might be good pre- worst in mass political systems. Thus, ecologically, the
scriptive rules that ought to be followed in real cases like proportion of cases in which normative theory disagrees
those described, even when the cases are true exceptions. with intuitive rules is smallest in cases of interpersonal
As argued before, we may be unable to recognize excep- interaction, greatest in the judgments that people make
tions with sufficient reliability. as citizens. For example, the act-omission distinction
Third, our intuitions might be wrong, even when they works well in an organization with clear lines of respon-
are strong. The abortion debate, the history of slavery, sibility, where going out of one's way to be helpful often
and religious conflicts all attest to the fact that opposing amounts to stepping on the toes of the person who was
intuitions can be held strongly. Strength is no guarantee supposed to do the job. But it does not work well when it
of correctness (Fischhoff et al. 1977). leads to support for laws assuming that people are unwill-
These intuitive examples differ from those used in the ing to donate their organs after death unless they explic-
studies I report because little effort has been made in itly state that they are willing. But surely the question of
stating them to ensure that the true utilitarian answer is ecological validity is a matter for empirical research (de-
clear, taking all consequences into account. From a utili- spite the formidable sampling problems).
tarian perspective, the cases are insufficiently described. A related issue is Teigen's point about correlations
among properties of options: his example is that omissions
R1.3. Evil desires and nonconsequentialist goals. It is are spread out over time but acts are not. High correla-
pointed out by McCain and Spranca (and possibly Phil- tions of this sort can affect the value of prescriptive rules.
lips) that consequentialism forces us to honor evil desires The high correlation between retribution and deterrence
or goals, such as those of the Nazis. Arkes would exclude would make retribution a good prescriptive rule to follow,
the satisfaction of jealousy and pettiness from his utilitar- if it were any easier. In hypothetical situations, and some
ian calculus. This is a general problem for consequential- real situations (such as penalties for vaccine injuries),
ism. Even hedonistic consequentialism must deal with these correlations are broken, and we can ask which of the
people who take pleasure in others' pain. Attempts to correlated factors people take to be the basis for their
restrict consequentialism to acceptable desires may be judgments.
difficult to square with any deeper justification of the
theory. My own justification, for example, stems from the R1.5. Intuitions as method. Following Hare (1981), I have
idea that we have reason to endorse principles that help criticized the use of intuitions as a normative theoretical
achieve our goals. These reasons apply regardless of our tool. Adler, Cohen, Dwyer, and Daniel either say or
goals, so any exclusion at the normative level would be imply that I use intuitions myself, so I cannot criticize
arbitrary, merely a way of tinkering with the theory to get others in this way. I have used no intuitions about cases or
it to fit our intuitions. moral principles to defend consequentialism. When I
Two main answers to this sort of objection have been have used examples, they are mostly difficult ones, where
given (Baron 1993a, p. 37; Hare 1981, pp. 140-46, 177- intuitions conflict. The argument against me must there-
82). First, the principle of neglecting evil desires is a good fore be that I have sought arguments to justify consequen-
prescriptive one. Only rarely, outside of fantastic hypo- tialism because my intuitions agreed with it at the outset,
thetical cases, does this principle go against utility maxi- and that if I had believed something else, I would have
mization, and we ought to lack confidence in our ability to chosen some other normative theory as the basis for
recognize these cases. (In this regard, I believe that this research. For what it is worth, this is incorrect, too, but I
principle is like the one forbidding adultery but unlike the will spare the reader the autobiographical details. I shall
principle of considering harmful omissions to be morally keep my intuitions to myself (unlike many writers, who
neutral.) Such cases are rare, in part because the satisfac- display them as primary data), except to say that I regard
tion of evil desires is often not the only alternative to them more as signposts about where to look (not always
doing nothing. As Hare (1981) suggests, the ancient successfully) for consequentialist arguments than any sort
Romans might have been just as satisfied with chariot of final criteria.
races as with the torture of Christians. Cohen points out that psychologists who endorse differ-
Second, taking a desire into account affects its strength ent normative theories will find different biases. The
in those who have it now and in those who might develop enterprise I have presented is indeed dependent on a
it in the future. People have some control over the desires conjunction of at least two claims: that a particular norma-
they and others develop. When we ignore a desire, we tive theory is correct and that judgments violate it. The
discourage its development. Normatively it might even fact that others might not endorse consequentialism is not
in itself an argument against this enterprise or its conclu- scribed, such as fear in the public at large. When the case
sions. Likewise, the fact that subjects do not endorse the is modified so that these extra consequences are removed,
theory by which their judgments are evaluated (Evans, intuition may become less clear, or it may not. The case is
Fuller) is not an argument against the theory or the surely even more fantastic.
enterprise. Finally, intuitions can play a large role in arguments
A deeper form of the argument is that the whole about prescriptive theory. Consequentialists differ among
development of consequentialism involves intuitions themselves, for example, about the role of government
about what morality is. I shall deal with this later. Here, protection versus individual responsibility, the role of the
my concern is with intuitions about cases or moral princi- military in foreign policy, affirmative action, and so on.
ples. Similarly, Daniel and Frisch suggest that intuitions One could say that these matters hinge on facts, but
about consequences are required for applications of con- decisions must be made before all the facts are in.
sequentialism. I would agree, in the sense that the mean- Perhaps I am still being too hard-nosed about intu-
ing of "intuition" can shade into that of "judgment" (e.g., itions. Surely there is more to be said here.
about trade-offs of goals). But these are not direct judg-
ments about what is right in a given case or in general. R1.6. The nature of consequences. Consequentialism can
And the consequentialist theory does not require intu- be a slippery doctrine if anything counts as part of a
ition to judge what counts as a consequence; it can, for consequence. Here I discuss the standard issues in defin-
example, specify goal achievement as a criterion of what ing what is relevant to judgments of consequences and
counts. how competing considerations are weighed against each
Adler argues that a theory can be testable against other. Later, I shall discuss the special features of my own
intuitions as data. I agree, but I suggest that moral approach.
theories derived from intuition are psychological, de- Arkes asks about the role of distribution. Utilitarianism
scriptive theories rather than normative ones. Even when justifies equality of distribution according to the principle
conflicts among intuitions are removed by modifying the of declining marginal utility (when other factors are con-
theory, as Adler suggests, the theory becomes a kind of stant or unknown); this principle competes with others
deep-structure model, in which it is assumed that con- derived from utilitarianism, such as incentive and differ-
flicts arise from translation into surface structure. We can ences in desire for the good being distributed. People
still ask where the normative status of this theory comes have developed heuristics for distribution, most of which
from, that is, why we should endorse it as an evaluation are compatible with utilitarianism in some cases (Baron
standard. Different deep-structure models may hold for 1993b; 1993c). People's willingness to sacrifice to ensure
different individuals, cultures, or historical periods. It is equal division of a monetary reward in experiments is a
true, as Adler argues, that giving up intuition as a crite- reasonable prescriptive application of one of these heuris-
rion requires that some other kind of argument be made tics, not clearly nonnormative given how little is spe-
in its place. The norm-endorsement argument (Baron cified. So, to answer Arkes's question, such people may be
1930, pp. 17-31) is intended for this purpose, and other following the consequentialist norm, prescriptively if not
arguments (usually very similar ones, such as contractual- normatively.
ist arguments) have been used for the same purpose. Arkes, Evans, Frisch, and Ritov ask about the rele-
Dwyer and Railton ask for a more sympathetic account vance of emotion. I (Baron 1985, pp. 62-63) and many
of the possible role of intuitions in "broad reflective others have argued that emotional responses to decisions
equilibrium." I admit that I am opposed primarily to the are real consequences, not to be excluded from the
narrower view that normative moral theory is analogous utilitarian calculus simply because they are not fungible.
to linguistic theory and that the way to the best theory is But emotional responses to a decision always indicate the
to go back and forth between our intuitions and the theory availability of an option to try to control the emotions.
that accounts for them - putting wayward intuitions aside Sometimes the cost of control may be low enough to make
or modifying the theory to account for them - until we this option attractive.
reach equilibrium. I am also unsure that equilibrium is Evans points out that conflicts can arise between the
necessary for correct theories. Possibly some of our intu- goals of the decision maker and the goals of those affected
itions are so ingrained that even accepting a theory will by the decision, especially in cases of action versus inac-
not remove them. It makes logical sense to say, as some tion. This is why it is important to ask subjects what they
subjects in Baron (1992) essentially did, "I think that it is "should" do and to emphasize their fiduciary role in
wrong not to shoot one prisoner to save three others, but I hypothetical cases. Evans correctly points out that, in one
would not shoot." These subjects had accepted the conse- way, it is more difficult to show violations of consequen-
quentialist'prescription for this case, but they would tialism for purely personal decisions than for decisions
violate it, possibly because of their strong intuition on the that affect others. In the former case, we may have to rely
other side. more heavily on demonstrations of inconsistency.
Intuitions can have a role, however, as prima facie Frisch points out that even apparent inconsistency may
arguments about theory and as signposts in the analysis of not be enough to show nonconsequentialism if the way a
cases (Baron 1933a, pp. 6-7). Intuitions surely have led problem is presented affects the emotional consequences
Hare, Mill, and others to look hard for consequentialist anticipated by the subject. I have argued (Baron 1993a,
arguments concerning evil desires and violations of pp. 59-60) that experiments testing expected-utility the-
rights. Few would look so hard for a consequentialist ory should be fiduciary decisions that affect others who
defense of ethnic cleansing. In analyzing fantastic cases experience the consequences without knowing what deci-
such as Foot's (Thomson 1990) organ donor, intuition sions led to them.
leads to a search for consequences beyond those de- Irwin points to the difficulty of determining the overall
best consequence when goals conflict. Although goals distinguish harmful acts and omissions, because a norm
may appear to be "incommensurable," it is reasonable to against harmful omissions will require them to sacrifice
assume that this is a problem in (prescriptive) practice for the benefit of the poor (Baron 1993a, pp. 24-25). I do
rather than (normative) theory (Baron 1986; 1988b). But not feel I have fully answered this question, but I have not
this is a problem. The difficulty of trading off conflicting found any other answers either. 4 (Why should I endorse
goals is a source of potential disagreement among people. what an ideal observer would endorse? Or, what I would
Reconciliation is difficult so long as the difficulty of mak- endorse if I were behind a veil of ignorance?) One possi-
ing trade-offs goes unrecognized. In sum, I agree with ble answer (Baron 1993a, pp. 29-31) is that agreement is
Irwin's comment. more difficult if endorsements are perceived as tailored to
self-interest. If people think I am endorsing a norm just
because it suits me and my ilk, they will do the same, and
R2. Peculiarities of my approach we will not agree. There is no necessary reason they
should behave this way; it is a fact of human psychology.
Several commentaries deal with the particular form of In sum, I have not set aside - as Glymour and Schick
consequentialism that was sketched in the target article. suggest I have - all reasons for endorsing norms, only
Many of my arguments do not hinge on the peculiarities of those that stem from ideals and from peculiarities of one's
this approach, but it is worth discussing. position. Without these stipulations, movement toward
agreement would be much more difficult.
R2.1. The argument for consequentialism. My basic argu- Schick also suggests that fairness and rights should be
ment is called "argle bargle" by Glymour, who lays bare considered as consequences in the Baron and Jurney
what he thinks is its logic. Pietroski thinks I might be (1933) study. (I note that the subjects of interest were
talking about a competence theory and does not under- asked to judge the consequences, so the definition of best
stand how an argument for consequentialism can avoid an consequences was based on whatever they wanted to
appeal to intuition. The target article does indeed provide include. Their voting decision was thus more influenced
only a rough sketch. Here is a little more. by fairness considerations than was their overall judgment
The argument begins by focusing on a certain type of of consequences.) Several others have also argued for
decision, that of endorsing moral principles or norms such a view, and Broome (1991) has shown that consider-
(through gossip and shunning as well as more direct ations of fairness are consistent with a form of utilitari-
means). Arguably, this is primarily what normative moral anism. I oppose this because it goes beyond the limita-
theory is about (Baron 1993a, pp. 17-24). This sort of tions I have suggested. Fairness involves comparisons of
claim is based on a decision to carve up the world in a goal achievement across people, so it does not stem from
certain way by abstracting a set of situations and consider- the goals themselves but, rather, from an ideal. Rights -
ing them as a separate class, namely, those involving in most senses of the term - are something to be pro-
endorsement of norms. tected regardless of the goals of those affected, so for the
The next step is to ask what reasons we have for most part these, too, are ideals. Like other ideals, these
endorsing such norms. Clearly, our reasons must come can arise from commitments to prescriptive rules, which,
from goals we already have. But I argue (following Hare in turn, may have consequentialist justifications.
1981, p. 40) that some of these goals must be ignored lest Railton is right that I failed to bypass the issue of self-
the enterprise become contaminated by intuitions of other conflict. Although the vaccination examples are
uncertain status, which make up many of our current largely free of this conflict (especially from the policy-
moral goals. This is probably the part that bothers Railton maker's perspective), I do claim that failing to help others
(and Schick) the most. at a small cost is wrong. The question of the proper
This argument depends on a distinction among types of balance of self-other interests is a difficult one that I
goals (Baron 1993a, pp. 35-36): other-regarding goals, hoped to avoid here. My view (Baron 1993a, pp. 89-99) is
self-regarding goals, and ideals. 3 Other-regarding goals that whereas we should adopt equal treatment of self and
are contingent on the goals of others; altruism is the prime others as a normative ideal, we must apply this standard
example, insofar as it means desiring what others desire to decisions about actual endorsement. This requires
because they desire it. Ideals concern standards for deci- taking into account the costs and benefits of moral exhor-
sion making by self and others, independently of people's tation. The best we can hope for in practice is a kind of
goals, and they include standards of physical beauty or "weighted utilitarianism" in which self-interest is typ-
religious piety as well as more clearly moral standards. ically weighed more than the interests of others, with the
Ideals are the kinds of goals we endorse when we endorse weight depending on the relationship.
norms. (This is what I mean by norms.) If we are trying to
decide what norms to endorse, we must therefore put R2.2. The nature and creation of goals. I am not sure that
aside our ideals lest they influence our decision. We need Katz is right in saying that I define well-being in terms of
not do this, but if we do, we stand a better chance of unrestricted desire satisfaction, although it is true that my
coming to some sort of agreement. Again, this is a defini- view is closer to this than to hedonism, and I may also
tion of an enterprise. We could, if we wanted, allow our have oversimplified this issue in the target article. In
existing ideals to influence our decisions about norm Baron (1993a, Ch. 3), I defend a view that is closer to what
endorsement, but this will not help to allay doubts about Scanlon (1993) calls informed desire-satisfaction.5 The
the validity of those ideals. question of what sort of well-being counts in a consequen-
The final step is an argument about why we might want tialist moral theory is answered, I argue, by the norm-
to ignore our particular position. As Morton points out, endorsement approach: if we are to endorse norms that
for example, the rich have more reason than the poor to tell others to look out for our well-being, what sort of
concerns about well-being give us reason to endorse such good to say it was not intended or desired, or not the
norms? The relevant concerns are "informed" because we function of the option chosen. Better to have chosen
would not want people to help us achieve goals that are another option.
derived from deeper goals on the basis of incorrect beliefs
(Baron 1993a, pp. 37-38). It is the deeper goals that give
us our real reasons for endorsing norms. On the other R3. Psychological and prescriptive questions
hand, we would endorse norms that tell others to look out
for our goals even if we did not experience the effects. The The remaining issues concern the experimental demon-
question of whether we would endorse a norm concerning strations of nonconsequentialist judgments and their im-
some aspect of consequences (experienced, past, future, plications for policy. These issues are intertwined with the
etc.) thus provides a standard for assessing whether that normative questions.
aspect is relevant to our well-being in the sense needed
(Baron 1993a, Ch. 3). Many of the critics of desire theories R3.1. Experimental difficulties. The "et cetera heuristic" is
(cited by Katz) lack such a standard. cited by Oatley, the possibility that subjects consider
One of the many questions that can be raised about factors not included in the experimenter's scenario, such
goals is found in Arkes's case of making a promise to a as the role of "herd immunity" in vaccination decisions.
dying friend. Arkes seems to think that the friend's goals Tetlock makes similar arguments, for example, about the
no longer count after death. Yet, arguably, we would possibility of value expression in compensation judg-
endorse a norm of keeping such promises because some of ments. It is, of course, impossible to rule out such conse-
our goals concern states that occur after death, and we quentialist factors completely. However, in most of the
would want others to honor these goals, just as we want studies reported, subjects were asked for justifications of
them to honor other goals. So I argue (Baron 1993a, their answers, and questions were modified if more than a
pp. 42-45; opposing Parfit 1984) that past goals should be couple of subjects responded in this way. Moreover, in
honored in some cases. The norm of honoring deathbed reading subjects' justifications, we look not only for the
promises may be seen as a fully consequentialist one. absence of extraneous arguments but also for the presence
Katz raises an interesting case of helping an adolescent of nonconsequentialist justifications, and we find these in
commit suicide. It is true that this dilemma would be abundance (putting aside the question raised earlier about
solved if we did not put aside the norms we already have, the possible consequentialist benefits of applying appar-
as I have said we should. But that is not the only solution. ently nonconsequentialist rules - the point being that
We can act to save such adolescents out of concern for the subjects do not recognize these benefits, if they exist).
achievement of their future goals, those they will have if Finally, in most studies we have explicitly attempted to
they live (Baron 1993a, pp. 41-42; Hare 1981, p. 101). In eliminate alternative consequentialist interpretations; for
the typical case, we must also consider the goals of others, example, in our studies of compensation decisions, we
such as parents, regarding the life of the person, and goals explicitly told subjects that liability insurance rates would
stemming from our own attachment. And we can ignore not increase, and, in some cases, that the amount of the
the adolescent's goals to the extent to which we think that award would be secret (to limit the expressive effect). The
they are subgoals based on false beliefs, for example, a empirical papers cited provide more detailed (albeit not
belief that life is completely hopeless. necessarily complete) answers to this line of criticism.
An important question raised by Katz, Spranca, and Tetlock also asks about the role of blame avoidance and
Tetlock concerns when we should create or destroy goals. anticipatory regret in apparently nonconsequentialist de-
Katz suggests we should give new goals to encourage the cisions. These are consequences that should indeed be
adolescent to live. One possible answer (Baron 1993a, considered, so it is possible in principle that these factors
pp. 45-50, also suggested by Spranca) is that we should provide a consequentialist account of our results or that
view decisions that create or destroy goals as no different subjects simply overweigh them. In the policy-maker
from other decisions, to be made with reference to the role, however, it seems implausible that people weigh
achievement of goals in general. These goals can include their own feelings as much as the lives of untold numbers
goals for the existence of other goals. This approach does of others. Moreover, subjects' justifications in most
not tell us what goals everyone should have, but it does studies indicate that they accept the norms that lead to
tell us how to take the next step from wherever we are. (In blame or regret. Subjects seem to see their emotional
this regard this is analogous to the Bayesian theory of responses to decisions as resulting from their own norma-
belief formation.) By this account, whether, to give such tive judgments (Baron 1992). They thus think of their
adolescents new goals has no necessary answer, but we normative judgments as controlling both their decisions
would probably want to see them have certain goals and and their emotions. When subjects are convinced to
we would try to provide them. This is analogous to change their normative judgments, both their decisions
creating goals in ourselves, and it is relevant to decisions and their anticipated emotions change in response.
about bringing new beings into the world. This theory (or The question of avoiding blame from others is slightly
any alternative to it) is therefore relevant to both morality more complex. Nonconsequentialist biases may be exag-
and rationality. gerated because some subjects know that others have
I am unsure about the value of Teigen's interesting these biases and will want them to decide accordingly,
suggestion to distinguish functions, goals, and effects. even if these subjects do not share the bias in question.
The idea of making decisions in terms of functions is For example, some of the opposition to active euthanasia
reminiscent of the doctrine of the double effect, with all could result from people's feelings that other people
its problems (Kuhse 1987; Schick 1991). If a decision leads oppose it. Less likely is the possibility that all people are
to a bad but avoidable and foreseeable situation, it does no wrong in their expectations about others. The experi-
Bond, E. C. (1983) Reason and value. Cambridge University Press. [LDK] Gibbard, A. (1988) Hare's analysis of "ought" and its implications. In: Hare
Brandt, R. B. (1979) A theory of the good and the right. Oxford University and critics: Essays on moral thinking, ed. D. Seanor & N. Fotion.
Press. [LDK] Clarendon Press. [rJB]
Brink, D. (1989) Moral realism and the foundations of ethics. Cambridge (1990) Wise choices, apt feelings. Harvard University Press. [aJB]
University Press. [PMP] Gigerenzer, G. (1993) Cognitive illusions illusory? Rethinking judgement
Broome, ]. (1991) Weighing goods: Equality, uncertainty and time. Basil under uncertainty. In: Rationality, ed. K. I. Manktelow & D. E. Over.
Blackwell. [rJB] Routledge. [LJC]
Brown, T. C. (1984) The concept of value in resource allocation. Land Gigerenzer, G. & Hug, K. (1992) Domain-specific reasoning: Social contracts,
Economics 60:231-46. [JRI] cheating and perspective change. Cognition 43:127-71. [JStBTE]
Calabresi, G. (1970) The costs of accidents: A legal and economic analysis. Gouran, D. S., Hirokawa, R. Y., Julian, K. M. & Leatham, G. B. (1993) The
Yale University Press. [aJB] evolution and current status of the functional perspective on
Calfee, J. E. & Rubin, P. H. (in press) Some implications of damage payments communication in decision-making and problem-solving groups. In:
for nonpecuniary losses. Journal of Legal Studies. [aJB] Communication yearbook 16, ed. S. A. Deetz. Sage Publishing. [GMP]
Camerer, C. & Loewenstein, G. (1993) Information, fairness, and efficiency in Gregory, R. (1986) Interpreting measures of economic loss: Evidence from
bargaining. In: Psychological perspectives on justice: Theory and contingent valuation and experimental studies. Journal of Environmental
applications, ed. B. A. Mellers & J. Baron. Cambridge University Economics and Management 13:325-37. [JRI]
Press. [aJB] Gregory, R., Liehtenstein, S. & Slovic, P. (1993) Valuing environmental
Campbell, D. (1974) Evolutionary epistemology. In: The philosophy of Karl resources: A constructive approach. Journal of Risk and Uncertainty
Popper, vol. 1, ed. P. A. Schilpp. Open Court Press. [JH] 7:177-97. [JRI]
Chellas, B. (1980) Modal logic: An introduction. Cambridge University Griffin, J. (1986) Well-being: Its meaning, measurement, and importance.
Press. [RAM] Oxford University Press. [LDK]
Churchland, P. (1979) Scientific realism and the plasticity of mind. Cambridge Haidt, J., Koller, S. H. & Dias, M. G. (in press) Affect, culture, and morality,
University Press. [RC] or. Is it wrong to eat your dog? Journal of Personality and Social
(1989) A neurocomputational perspective: The nature of mind and the Psychology. [aJB]
structure of science. MIT Press. [RG] Hammond, P. H. (1988) Consequentialist foundations for expected utility.
Cohen, L. J. (1981) Can human irrationality be experimentally demonstrated? Theory and Decision 25:25-78. [aJB]
Behavioral and Brain Sciences 4:317-70. [PA, JStBTE] Hardin, G. R. (1968) The tragedy of the commons. Science 162:1243-
(1986) The dialogue of reason. Oxford University Press. [LJC] 48. [aJB]
Collett, P., ed. (1977) Social rules and social behavior. Rowman & Hare, R. M. (1952) The language of morals (reprinted in 1972). Clarendon
Littlefield. [SF] Press. [rJB, RAM]
Daniels, N. (1979) Wide reflective equilibrium and theory acceptance in (1963) Freedom and reason. Clarendon Press. [arJB]
ethics. Journal of Philosophy 76:256-82. [PR] (1981) Moral thinking: Its levels, method and point. Clarendon
Danielson, P. (1991) The Lockean proviso. In: Contractarianism and rational Press. [arJB, JEA]
choice, ed. P. Vallentyne. Cambridge University Press. [AM] Heil, J. (1992) Believing reasonably. Nous 26:47-62. [JH]
Dawes, R. M. (1988) Rational choice in an uncertain world. Harcourt Brace Hommers, W. (1986) 1st "Voller Ersatz" immer "Adaquater Ersatz"? Zu einer
Jovanovich. [aJB] Diskrepanz Regelungen des Gesetzbuches im EXODUS und der
Deber, R. B. & Goel, V. (1990) Using explicit decision rules to manage issues Adaquatheits-These der Equity-Theorie. Psychologische Beitrdge 28:164—
of justice, risk, and ethics in decision analysis: When is it not rational to 79. [aJB]
maximize expected utility? Medical Decision Making 10:181-94. [rJB] Hurst, J. W. (1990) The heart: Arteries and veins. McGraw-Hill. [GMP]
De Sousa, R. (1987) The rationality of emotions. MIT Press. [KO] Inglehart, J. K. (1987) Compensating children with vaccine-related injuries.
Dewey, J. (1910) How we think. D. C. Heath. [CMP] New England Journal of Medicine 316:1283-88. [aJB]
Dworkin, R. (1977) Taking rights seriously. Harvard University Press. [FS] Irwin, J. R. (in press) Buying/selling price preference reversals: Preference for
Ellsberg, D. (1961) Risk, ambiguity, and the Savage axioms. Quarterly Journal environmental changes in buying versus selling modes. Organizational
of Economics 75:643-99. [aJB, rJB] Behavior and Human Decision Processes. [JRI]
Elster, J. (1978) Logic and society. Wiley. [RAM] Irwin, J. R., Slovic, P., Liehtenstein, S. & McClelland, G. H. (1993)
(1984) Explaining technical change. Cambridge University Press. [SF] Preference reversals and the measurement of environmental values.
(1985) Weakness of will and the free-rider problem. Economics and Journal of Risk and Uncertainty 6:5-18. [JRI]
Philosophy 1:231-65. [rJB] Johnson, A. (1943) An experimental study in the analysis and measurement of
(1989) The cement of society. Cambridge University Press. [aJB] reflective thinking. Speech Monographs 10(l):83-96. [GMP]
Evahs, J. St. B. T. (1989) Bias in human reasoning: Causes and consequences. Johnson, M. (1987) The body in the mind: The bodily basis of meaning,
f
Erlbaum. [aJB, JStBTE] imagination, and reason. University of Chicago Press. [RG]
(1993) Bias and rationality. In: Rationality, ed. K. I. Manktelow & D. E. Johnson, R. H. & Blair, J. A. (1983) Logical self-defense (2nd ed.). McGraw-
Over. Routledge. [JStBTE] Hill Ryerson. [aJB]
Evans, J. St. B. T., Newstead, S. E. & Byrne, R. M. J. (1993) Human Johnson-Laird, P. (1983) Mental models: Towards a cognitive science of
reasoning: The psychology of deduction. Erlbaum. [JStBTE] language, inference and consciousness. Harvard University Press. [RG]
Federal Electric Company (1963) A programmed introduction to PERT. Kagan, S. (1989) The limits of morality. Oxford University Press. [PR]
Boiling Air Force Base. [GMP] Kahneman, D. & Knetsch, J. L. (1993) Valuing public goods: The purchase of
Fischer, J. M. & Ravizza, M. (1992) Ethics: Problems and principles. Holt, moral satisfaction. Journal of Environmental Economics and Management
Rinehart & Winston. [aJB] (in press). [PET]
Fischhoff, B., Slovic, P. & Liehtenstein, S. (1977) Knowing with certainty: Kahneman, D., Knetsch, J. L. & Thaler, R. H. (1986) Fairness and the
The appropriateness of extreme confidence. Journal of Experimental assumptions of economies. Journal of Business 59:S285-S300. [HRA]
Psychology: Human Perception and Performance 3:552-64. [rJB] (1990) Experimental tests of the endowment effect and the Coase theorem.
Frank, R. F. (1985) Passions within reason: The strategic role of the emotions. Journal of Political Economy 98:1325-48. [aJB]
Norton. [aJB] Kahneman, D. & Miller, D. T. (1986) Norm theory: Comparing reality to its
Freud, S. (1961) Beyond the pleasure principle, ed. J. Strachey. alternatives. Psychological Review 93:136-53. [aJB]
Liveright. [GMP] Kahneman, D., Slovic, P. & Tversky, A. (1982) Judgment under uncertainty:
Friedman, D. (1982) What is "fair compensation" for death or injury? Heuristics and biases. Cambridge University Press. [JStBTE]
International Review of Law and Economics 2:81-93. [aJB] Kahneman, D. & Snell, J. (1992) Predicting changing taste: Do people know
Frisch, D. (1993) Reasons for framing effects. Organizational Behavior and what they will like? Journal of Behavioral Decision Making 5:187-
Human Decision Processes 54:399-429. [arJB] 200. [rJB]
Frisch, D. & Jones, S. K. (1993) Assessing the accuracy of decisions. Theory Kahneman, D. & Tversky, A. (1972) Subjective probability: A judgment of
and Psychology 3:115-35. [DF] representativeness. Cognitive Psychology 3:430-54. [aJB]
Fuller, S. (1993) Philosophy of science and its discontents (2nd ed.). Guilford (1979) Prospect theory: An analysis of decisions under risk. Econometrica
Press. [SF] 47:263-91. [aJB, DF]
Funder, D. C. (1987) Errors and mistakes: Evaluating the accuracy of social (1984) Choices, values, and frames. American Psychologist 39:341-
judgment. Psychological Bulletin 101:75-90. [aJB] 50. [aJB, DF]
Garfinkel, H. (1967) Studies of the routine grounds of everyday activities. In: Kamm, F. M. (1986) Harming, not aiding, and positive rights. Philosophy and
Studies in ethnomethodology, ed. H. Garfinkel. Erlbaum. [KO] Public Affairs 15:3-32. [aJB]
(1990) A mechanism for social selection and successful altruism. Science Thomson, J. J. (1986) Rights, restitution, and risk: Essays in moral theory.
250:1665-68. [aJB] Harvard University Press. [SDw]
Singer, P. (1972) Famine, affluence, and morality. Philosophy and Public (1990) The realm of rights. Harvard University Press. [rJB, JEA, SDw,
Affairs 1:229-43. [PR] PMP]
(1977) Utility and the survival lottery. Philosophy 52:218-22. [rJB] Tversky, A. (1967) Additivity, utility, and subjective probability. Journal of
(1979) Practical ethics. Cambridge University Press. [aJB, JEA] Mathematical Psychology 4:175-202. [aJB]
(1981) The expanding circle: Ethics and sociobiology. Farrar, Straus & Tversky, A. & Kahneman, D. (1974) Judgment under uncertainty: Heuristics
Giroux. [aJB] and biases. Science 185:1124-31. [PA]
Slote, M. (1985) Common-sense morality and consequentialism. (1981) The framing of decisions and the psychology of choice. Science
Routledge. [AM] 211:453-58. [IR]
Slovic, P. & Lichtenstein, S. (1983) Preference reversals: A broader Tversky, A., Sattath, S. & Slovic, P. (1988) Contingent weighting in judgment
perspective. American Economic Review 73:596—605. [IR] and choice. Psychological Review 95:371-84. [IR]
Spranca, M. D. (1993) Raising standards in discussions of the rationality of Walster, E., Walster, G. W. & Berscheid, E. (1978) Equity: Theory and
human choice and judgment. Unpublished manuscript, Psychology research. Allyn & Bacon. [aJB]
Department, University of California, Berkeley. [MDS] Walton, D. N. (1989) Informal logic: A handbook for critical argumentation.
Spranca, M., Minsk, E. & Baron, J. (1991) Omission and commission in Cambridge University Press. [aJB]
judgment and choice. Journal of Experimental Social Psychology 27:76- Wason, P. C. (1966) Reasoning. In: New horizons in psychology (vol. 1), ed. B.
105. [aJB] M. Foss. Penguin. [PA]
Stich, S. (1990) The fragmentation of reason: Preface to a pragmatic theory of Weed, L. L. (1991) Knowledge coupling: New premises and new tools for
cognitive evaluation. MIT Press. [RG] medical care and education. Springer-Verlag. [GMP]
Tetlock, P. E. (1992) The impact of accountability on judgment and choice: Wertheimer, M. (1959) Productive thinking (rev. ed.; originally published in
Toward a social contingency model. In: Advances in experimental social 1945). Harper & Row. [aJB]
psychology (vol. 25), ed. M. Zanna. Academic Press. [PET] Williams, B. (1973) A critique of utilitarianism. In: Utilitarianism far and
Tetlock, P. E. & Boettger, R. (1993) Accountability amplifies the status quo against, J. C. C. Smart & B. Williams. Cambridge University
effect when change creates victims. Unpublished manuscript, University Press. [HRA]
of California, Berkeley. [PET] Woodworth, R. S. & Schlosberg, H. (1954) Experimental psychology.
Tetlock, P. E. & Mitchell, C. (1993) Liberal and conservative approaches to Holt. [aJBJ
justice: Conflicting psychological portraits. In: Psychological perspectives Young, K. S. (1993) The use of a procedural model of problem solving by
on justice: Theory and applications, ed. B. A. Mellers & J. Baron. students in a group discussion class. Unpublished Ph.D. dissertation,
Cambridge University Press. [aJB] Pennsylvania State University. [GMP]
Thaler, R. H. (1988) The ultimatum game. Journal of Economic Perspectives
2:195-206. [aJB]
BBS Associates
Please send BBS your electronic mail ('email') address
BBS is relying more and more on electronic mail to communicate with Associates
(especialjy for circulating abstracts of recently accepted target articles so
prospective commentators can nominate themselves).
If you have an email address, please inform BBS right away at:
harnad@clarity.princeton.edu
or
harnad@puccbitnet
(If you do not yet have an email address, we urge you to get one!)