Professional Documents
Culture Documents
and
This research was supported by a grant to the first author from the University of Arizona Small
Grants Program. We thank Lee Beach, Terry Connolly, Leamon Crooms, Barbara Mellers, Amnon
Rapoport, and two anonymous reviewers for comments on earlier drafts. In addition, we thank
Anup Kuzmiyil and Vaishali Ghiya for programming assistance.
Address reprint requests to Lisa Ordóñez, Management and Policy, School of Business and
Public Administration, University of Arizona, Tucson, AZ 85721. E-mail: lordonez@u.arizona.edu.
121 0749-5978/97 $25.00
Copyright q 1997 by Academic Press
All rights of reproduction in any form reserved.
122 ORDÓÑEZ AND BENSON
INTRODUCTION
Overview
Researchers have typically studied risky decision making in situations that
allow the decision maker an unlimited amount of time to perform the task.
However, many real world decisions are made under some form of time con-
straint. Air traffic controllers must make quick decisions when directing air
traffic to avoid an accident. Police officers must quickly decide whether situa-
tions warrant the use of force. A driver, upon seeing a yellow light, must decide
whether to speed up through the intersection or hit the brakes to stop before
the red light appears.
Do decision makers use the same strategies when making risky decisions
with and without time constraint? Are there individual differences in responses
to time constraint? How do decision makers react when a deadline has been
met or when a time constraint has been removed? This paper investigates
these issues.
Research suggests that decision makers tend to speed up execution of their
decision strategies or switch to simpler strategies when under time constraint
(Edland & Svenson, 1993; Johnson, Payne, & Bettman, 1993; Svenson & Ben-
son, 1993a, 1993b; Smith, Mitchell & Beach, 1982; Wright, 1974). Furthermore,
when faced with high levels of time constraint, decision makers tend to rely
most heavily upon negative information (Wright, 1974). Moreover, decision
makers under time constraint either filter information that is used or omit
certain information from consideration altogether (Miller, 1960).
Time Constraint
As noted in Benson and Beach (1996), many researchers select time con-
straint levels arbitrarily, with no rationale. In these studies, we first timed
subjects on the task of interest and then selected as our constraint the execution
time that was one standard deviation below the mean. If times are normally
distributed, this forces about 84% of the subjects to perform the task faster
than normal. However, setting a time constraint is not enough to ensure that
subjects feel time pressure (Svenson & Benson, 1993; Benson, 1993). Time
constraint exists whenever there is a time deadline, even if the person is
able to complete the task in less time. Time pressure indicates that the time
constraint induced some feeling of stress and created a need to cope with the
limited time. Thus, it is possible to have time constraint but no time pressure.
where PB(x, p; 0) is the buying price for gamble (x, p; 0) and JB is a monotonic
judgment function for buying prices, placing responses on a dollar scale.
Change-of-process theory assumes scale convergence (Birnbaum, 1974; Birn-
baum & Sutton, 1992): that is, the psychological perceptions of probability and
amount (i.e., subjective probabilities and utilities) remain constant across the
two tasks.
In the Mellers et al. (1992b) study, the decision strategies used by subjects
were investigated by having them judge both buying price and attractiveness
ratings for a set of gambles constructed from a factorial combination of amounts
to win ($3.00 to $56.70) and probability of winning (.05 to .94). Figure 1 presents
mean responses. Under certain assumptions about the judgment functions,
change-of-process theory predicts that the pattern of these plots should differ
124 ORDÓÑEZ AND BENSON
FIG. 1. Mean responses from Mellers et al. (1992a). Panel A presents mean attractiveness
ratings of simple gambles. Ratings plotted as a function of amount to win, with a separate curve
for each probability of winning. Panel B plots mean buying price responses by amount to win,
with a separate curve for probability of winning. Responses were from the “positive skew” context
in Mellers et al. (1992a).
Method
Stimuli and design. Subjects served in one of two conditions created by a
Time Constraint by Task by Task Order factorial design (2 3 2 3 2). The Task
Order was the only between subjects factor; it indicates whether subjects first
completed the attractiveness rating task or the buying price task.
Gambles were displayed as pie charts on a computer monitor. The circle was
said to represent a hypothetical spinner device in which the outcome depends
on where the spinner lands. The yellow section of the pie represented the
probability of winning, and the blue region indicated the probability of a zero
outcome. Amounts to win were indicated in a legend located near the pie.
Subjects were presented with 25 gambles created from a 5 (Probability) 3
5 (Amount) factorial design. Levels of probabilities were .09, .17, .29, .52, and
.94. Levels of amounts were $5.40, $9.70, $17.50, $31.50, and $56.70. These
levels were chosen to create several gambles with the same expected value,
but differing levels of probabilities and amount; these stimuli were a subset
of those used in Mellers et al. (1992a, 1992b).
Instructions and procedures. All instructions were presented on the com-
puter. The best and worst gambles were presented to indicate the range of
gambles before beginning the tasks. Gambles were presented one at a time
in random order. Before each task, subjects completed five practice trials to
familiarize themselves with the task and procedure. One half of the subjects
first rated the attractiveness of each of the 25 gambles on a scale from 0 to
100 (0 5 neither attractive nor unattractive, and 100 5 extremely attractive).
They then performed the buying price task in which they stated the maximum
amount they would be willing to pay to play each of the 25 gambles. The other
half of the subjects performed the two tasks in the opposite order.
In the first block of trials, all subjects performed rating and pricing tasks
on the 25 gambles, taking as much time per trial as they needed. This allowed
for baseline measures of the subject’s normal time to complete the trials. (Pilot
testing indicated that simply mentioning that there would be a time constraint
in later trials caused subjects to significantly reduce their response times in
126 ORDÓÑEZ AND BENSON
of time to think about their responses (4.5 on a scale from 0 5 little time to
10 5 a great deal of time).
Results
Buying prices. Mean buying prices are plotted in Fig. 2. (Individual level
plots showed that all subjects’ responses followed the same pattern as in Fig.
2.) The surprising result is that the pattern of means in the two time constraint
conditions appears virtually identical: both panels displaying bilinear fans
consistent with a multiplicative combination process. In fact, an Order (2) 3
Time Constraint (2) 3 Probability (5) 3 Amount (5) analysis of variance of
buying price responses revealed that there are no significant main effects or
interactions with the Time Constraint factor. That is, buying price judgments
were not affected by the imposed time constraint. Buying prices were also not
affected by the order in which the two tasks were performed: buying prices
followed by attractiveness ratings or the reverse order. As indicated in Fig. 2,
buying prices were affected by Amount (F4,192 5 176.2, p , .05), by Probability
(F4,192 5 130.0, p , .05), and by the Amount by Probability interaction
(F16,768 5 57.6, p , .05). Thus, the hypothesis that subjects would change
decision strategies under time constraint in buying prices is not supported. It
appears that, in the buying price task, subjects were able to accelerate the
processing of information to cope with the time pressure without changing
their decision strategies.
FIG. 2. Mean buying prices from Experiment 1. Mean buying prices averaging over all 50
subjects were plotted as in Fig. 1B. Panels A and B show responses from the no time constraint
and time constraint conditions, respectively.
128 ORDÓÑEZ AND BENSON
FIG. 3. Mean attractiveness ratings from “same process” subjects in Experiment 1. Mean
attractiveness ratings were plotted as in Fig. 1A. The upper panels show responses from the
parallel subjects, while the lower panels display the responses from the bilinear subject group.
The left and right panels show results for the no time constraint and time constraint condi-
tions, respectively.
FIG. 4. Mean attractiveness ratings from “different process” subjects in Experiment 1. Mean
attractiveness ratings are plotted as in Fig. 1A, separated by time constraint condition.
Discussion
Method
Stimuli and design. Subjects served in either the time-unconstrained (no
TC) or the time-constrained (TC) conditions. For the time-unconstrained condi-
tion, the order of the task blocks was AR no TC, BP no TC, AR no TC, and AR
no TC (where AR and BP represent the attractiveness rating and the buying
price tasks, respectively). The time-constrained condition differed only in that
the second rating task block was performed under time constraint: AR no TC,
BP no TC, AR TC, AR no TC. In each task block, subjects evaluated the same
25 gambles used in Experiment 1. Gambles were displayed as pie charts as in
Experiment 1.
Instructions and procedures. All instructions and procedures were the same
as in Experiment 1 except for the order of task blocks. The 25 gambles were
presented in four blocks, and gambles were presented one at a time in random
order within each block on a computer monitor.
Subjects reported their stress level at the beginning of the questionnaire,
after the second block of attractiveness rating trials, and at the end of the
experimental trials. Additionally, subjects responded to questions about the
quality of their responses after the second block of rating trials: how comfortable
they felt with their responses and how satisfied they were with their decisions.
The constrained subjects judged if they had sufficient time to think and if the
exposure time was too short. At the end of the experiment, they completed
the Need for Cognition (NFC) short form questionnaire and a few additional
demographic questions.
Participants. Fifty-one undergraduate business students at the University
of Arizona received course credit for their participation. Twenty-five of these
DECISIONS UNDER TIME PRESSURE 131
Results
FIG. 5. Mean responses from the time-unconstrained condition in Experiment 2. Mean re-
sponses are plotted as in Fig. 1. Panels A to D indicate the task and the order in which the task
was performed. AR denotes the attractiveness rating task and BP is the buying price task. No
time constraint (No TC) was imposed in any of the four blocks of trials.
6 displays the mean responses for these “different process” subjects of Experi-
ment 2. Again, without time constraint, we see parallel curves in ratings and
bilinear fan in prices. However, in the critical Block 3, when the time constraint
was imposed, curves form a bilinear fan similar to the buying prices in Panel
B. It appears that these subjects used a bilinear process under time constraint
instead of the parallel process they used without time constraint. The final
panel (D) suggests that once the time constraint was released, these “different
Process” subjects returned to an additive combination process. (One of these
11 subjects displayed bilinear curves similar to Panel C). The remaining four
subjects in the time-constrained group showed uninterpretable responses and
were placed in the “other” group.
As in Experiment 1, the “same process” and “different process” groups were
similar in many ways: they were not significantly different in GPA, gender,
rated stress levels (before and after time constraint), and judgment of the time
sufficiency, satisfaction, and comfortableness with the time-constrained task.
However, “different process” subjects were significantly lower on average NFC
score than “same process” subjects (6.5 vs 24.1, t20 5 22.56, p , .05).
DECISIONS UNDER TIME PRESSURE 133
FIG. 6. Mean responses from the “different process” group in the time constrained condition
in Experiment 2. Mean responses are plotted in a similar format as Fig. 6. The only difference is
that Panel C presents mean attractiveness ratings when a time constraint (TC) was imposed in
these trials.
FIG. 7. Mean individual preference reversals are presented separately for the time-uncon-
strained, “same process”, and “different process” groups (upper, middle, and lower boxes). Three
sets of preference reversals are computed for each group: buying price responses versus the first,
second, and third blocks of attractiveness ratings. In each set, preference reversals for the 30
equal expected value gamble pairs were obtained for each subject. The buying price vs. attrac-
tiveness rating 2 for the “same process” and “different process” groups are the only two boxes in
which time constraint was imposed for ratings (these are indicated by the asterisks). Percentages
of expected and unexpected preference reversals are presented in the upper-right and lower-left
of each box. The remaining two cells represent consistent preferences across tasks and are left
empty for simplicity.
x2 tests have p , .05).1 Since the “same process” subjects showed the same
pattern of strategies in the two tasks as the unconstrained subjects, the change-
of-process predictions are that there should be systematic preference reversals
across all three rating blocks. Figure 7B is consistent with this prediction,
showing a similar pattern to that of the unconstrained group rates (all x2 tests
have p , .05). The interesting change-of-process predictions emerge with the
“different process” group. This group used a bilinear process for the buying
prices and ratings under time constraint (attractiveness rating 2) but a parallel
process for the rating conditions without time constraint (attractiveness ratings
1 and 3). Thus, the prediction is that there should be preference reversals for
prices vs ratings 1 and 3 (when strategies are dissimilar) but not for prices vs
1
Since both reversals are errors in judgment and there is no way of a priori determining the
number of errors that should occur due to chance, previous studies compare the two reversal rates
for systematic differences as evidence that expected reversals exist at a significant rate. Chi-
square tests with 1 df were conducted comparing expected and unexpected reversal rates within
each box, where the expected frequency is the average of the two reversal frequencies.
DECISIONS UNDER TIME PRESSURE 135
Discussion
These results replicate and extend those found in Experiment 1. The main
result was that the subjects who used different processes in the rating tasks
did so under specific conditions: they used a bilinear process in ratings only
under time constraint and when they previously used bilinear process in prices.
These “different process” subjects had significantly lower NFC scores. Since
the general propensity to engage less in cognitive activities is related to which
subjects use different processes, we can speculate as to why these subjects use
a different process under time constraint. As suggested before, these subjects
may have been attempting to reduce their cognitive effort by continuing to use
the decision strategy they had been using in the previous task, assuming that
there is a “cognitive cost” to changing strategies. Thus, subjects may not always
switch to easier strategies (as indicated by previous research) if switching itself
takes too much effort. Many of us have had the experience of using a less
efficient method of data analysis (e.g., hand calculation) because we believe
that switching to an easier method requires effort (e.g., learning a new com-
puter program).
An interesting consequence is that the “different process” subjects showed
more consistent preferences under time constraint. Since they used the same
bilinear process in both ratings and prices, their preferences became more
consistent and earlier preference reversals were eliminated. Thus, one way to
136 ORDÓÑEZ AND BENSON
Method
Results
GENERAL DISCUSSION
from bilinear to a parallel process as they had previously done in the time-
unconstrained rating task. Of course this line of reasoning is post hoc since
we could not interrupt the subjects during the time-constrained trials to ask
them why they used their current decision strategy. (Also, they probably could
not have told us had we asked).
Why did the time constraints affect strategies in the rating task but not the
pricing task? Rating responses appear to more malleable than prices. Not only
is this evidenced in the current study by the effects of time constraint, but this
is also suggested by rating responses found in Mellers et al. (1992b). In this
study, subjects produced parallel rating curves to gamble stimuli similar to
the current study. However, when Mellers et al. presented subjects with gambles
that had zero winning payoffs or zero probabilities of winning, most produced
response curves with a bilinear pattern. Mellers et al. suggest that these un-
usual gambles made subjects aware of the problems with using an additive
model: varying one factor (amount to win or probability of winning) while the
other factor is zero would produce varying attractiveness ratings. A multiplica-
tive process leads to the more realistic conclusion that these gambles should
receive a zero rating. Although the current study finds similar results (i.e.,
contextual manipulations resulted in bilinear rating responses), we do not
suggest that our subjects were necessarily aware of the implications of their
decision strategies. Instead, the commonality appears to lie in the fact that
both studies showed the flexibility of rating responses. Note, however, that
Ordóñez, Mellers, Chang, and Roberts (1995) showed the preference orders for
both ratings and prices changed in response to an experimental treatment
which reduced preference reversals.
Finally, why do subjects appear to add subjective probabilities and utilities
in ratings but multiply this information in prices? Mellers, Weber, Ordóñez,
and Cooke (1995) summarize several studies showing the parallel pattern in
ratings and bilinear fan in prices. They suggest that decision makers treat
probability as a modifier in prices (thus, multiply it with amount) but as an
independent variable that contributes to overall attractiveness in ratings (thus,
it is added to amount). However, the inclination to use an additive process in
ratings appears to be quite robust since subjects who used a bilinear process
with time-constrained ratings, revealed ratings consistent with an additive
process as soon as the time restriction was lifted. This result seems to suggest
that an additive process is a more familiar or natural strategy to use with
rating responses.
These current results suggest that more complex models of preference under
time constraint need to be developed. Models that suggest that subjects simply
accelerate processing or switch to “easier” strategies (however defined) appear
to be incomplete. Previous research has indicated that decision makers appear
to tradeoff effort against accuracy when deciding which strategies to employ
(Johnson, Payne, & Bettman, 1993). The present data suggest that we also
tradeoff the immediate effort of switching strategies against using strategies
that are easier or more familiar.
DECISIONS UNDER TIME PRESSURE 139
REFERENCES
Benson, L. (1993). Studies in human decision making: On the effects of experimental instructions,
framing, and time constraints. Unpublished doctoral dissertation, Lund University, Lund Sweden
Benson, L., III, & Svenson, O. (1993). Post-decision consolidation following the debriefing of subjects
about experimental manipulations affecting their prior decisions. Psychological Research Bulle-
tin, 32, 1–13.
Benson, L., III & Beach, L. (1996). The effects of time constraints on the pre-choice screening of
decision options. Organizational Behavior and Human Decision Processes, 67, 222–228.
Birnbaum, M. H. (1974). The nonadditivity of personality impressions. Journal of Experimental
Psychology Monograph, 102, 543–561.
Birnbaum, M. H. (1982). Controversies in psychological measurement. In B. Wegener (Ed.), Social
attitudes and Psychophysical measurement. Hillsdale, NJ: Erlbaum.
Birnbaum, M. H., & Stegner, S. E. (1979). Source credibility in social judgment: Bias, expertise,
and the judge’s point of view. Journal of Personality and Social Psychology, 37, 48–74.
Birnbaum, M. H., & Sutton, S. E. (1992). Scale convergence and utility measurement. Organiza-
tional Behavior and Human Decision Processes, 52, 331–346.
Birnbaum, M. H., & Veit, C. T. (1974). Scale convergence as a criterion for rescaling: Information
integration with difference, ratio, and averaging tasks. Perception & Psychophysics, 15, 7–15.
Cacioppo, J. T., Petty, R. E., & Kao, C. F. (1984). The efficient assessment of need for cognition.
Journal of Personality Assessment, 48, 306–307.
Edland, A., & Svenson, O. (1993). Judgment and decision making under time pressure: Studies
and findings. In O. Svenson & A. J. Maule (Eds.), Time pressure and stress in human judgment
and decision making. New York: Plenum.
Goldstein, W. M., and Einhorn, H. J. (1987). Expression theory and the preference reversal phenom-
ena, Psychological Review, 94, 236–254.
Johnson, E. J., Payne, J. W., & Bettman, J. R. (1993). Adapting to time constraints. In O. Svenson
and A. J. Maule (Eds.), Time pressure and stress in human judgment and decision making. New
York: Plenum.
Lichtenstein, S. & Slovic, P. (1971). Reversals in preference between bids and choices in gambling
decisions, Journal of Experimental Psychology, 89, 46–55.
Lindman, H. R. (1971). Inconsistent preferences among gambles. Journal of Experimental 89, 390–
397.
Mellers, B. A., Chang, S., Birnbaum, M. H., & Ordóñez, L. D. (1992a). Preferences, prices, and
ratings in risky decision making. Journal of Experimental Psychology: Human Processes and
Performance, 18, 347–361.
Mellers, B. A., Ordóñez, L. D., & Birnbaum, M. H. (1992b). A change-of-process theory for contextual
effects and preference reversals in risky decision making. Organizational Behavior and Human
Decision Processes, 52, 319–330.
Mellers, B. A., Weber, E. U., Ordóñez, L. D., & Cooke, A. D. J. (1995). Utility invariance despite
labile preferences. In J. R. Busemeyer, R. Hastie, & D. L. Medin (Eds.), Psychology of learning
and motivation: Vol. 32. Decision making from the perspective of cognitive psychology.
Miller, J. G. (1960). Information input overload and psychopathology. American Journal of Psychia-
try, 116, 695–704.
Ordóñez, L. D., Mellers, B. A., Chang, S, & Roberts, J. (1995). Are preference reversals reduced
when made explicit? Journal of Behavioral Decision Making, 8, 265–278.
Smith, J. F., Mitchell, T. R. & Beach, L. R. (1982). A cost benefit mechanism for selecting problem-
solving strategies: Some extensions and empirical tests. Organizational Behavior and Human
Performance, 29, 370–396.
Svenson, O. & Benson, L., III (1993a). Framing and time pressure in decision making. In O.
140 ORDÓÑEZ AND BENSON
Svenson & A. J. Maule (Eds.), Time pressure and stress in human judgment and decision making.
New York: Plenum.
Tversky, A., Sattath, S., & Slovic, P. (1988). Contingent weighting in judgment and choice. Psycho-
logical Review, 80, 204–217.
Verplanken, B. (1993). Need for cognition and external information search: Responses to time
pressure during decision-making. Journal of Research in Personality, 27, 238–252.
Wright, P. (1974). The harassed decision maker: Time pressure, distraction and the use of evidence.
Journal of Applied Psychology, 59, 555–561.