Professional Documents
Culture Documents
N MORENO
Penn State University, USA
HUGO N
OPO
Inter-American Development Bank, USA
JAIME SAAVEDRA
World Bank, USA
and
MA
XIMO TORERO
*
IFPRI, USA
Summary. Inspired by audit studies methodology, we monitored a job intermediation service in Peru to detect gender and racial dis-
crimination in hiring. We capture individual racial information using the approach of N
opo et al.
(2007) for details). Each individual received an independent score of 010
from a pollster in each of four categories: Asian, White, Indigenous, and
Blackgroups that people readily recognize as distinct racial groupswith
zero indicating no physical characteristics that resembled a specic race and
10 indicating most features of that group. For example, an individual with
intensities 2 (White), 8 (Indigenous), 0 (Black), and 1 (Asian), would be
considered predominantly Indigenous. Thus, the horizontal axis captures the
proportion of individuals within each indigenous intensity that where
White collar.
316 WORLD DEVELOPMENT
Natural Field Experiment (NFE). It is a NFE and not a tradi-
tional Field Experiment (FE) in the sense that we did not have
the ability to exogenously randomize treatments across the
population under study, it just naturally happened from the
functioning of the market, as it will be shown next in this sec-
tion. Our approach to detect discrimination in hiring practices
was inspired by the audit studies literature.
5
The audit studies
try to verify the hypothesis of discriminatory behavior of a
decision-maker, simulating the interviews of a group of
observably similar applicants called auditors. The simulation
is repeated for many decision makers, and when the outcome
statistically favors, or hurts, individuals with a particular set of
characteristics the conclusion is that individuals who show
such characteristics are discriminated in favor, or against.
As mentioned earlier in this paper, the audit methodology
has received some criticisms.
6
Generally, the auditors are indi-
viduals hired for the purposes of the study; they are mostly
college students that view their participation as a source of in-
come. They arrive at job interviews with similar resumes that
are specically tailored for the study; therefore, auditors
applying for the same position present comparable informa-
tion to decision makers. They are trained to show up for inter-
views and pretend to be interested in getting a job. In addition,
they are required to act as if they have the education and expe-
rience that their resumes claim. In order to keep to a minimum
the possible dierences in observable characteristics, the occu-
pations examined in these studies typically require minimal
skills. Finally, the designers of the study nd the job openings
in newspapers.
These characteristics of the audit studies imply the following
problems:
(1) An auditor does not necessarily put in the same level of
eort to get a job as a real job-seeker would. Also, it is not
possible to ensure that the auditor will experience the same
pressure and anxiety that would be present in a real job
interview.
(2) The auditor knows the purpose of the study and, as it is
documented in experimental psychology literature, this
may generate incentivesconscious or notto skew the
results toward the desired outcome of the researchers
(Lindzey & Aronson, 1975; Rosenthal, 1976).
(3) Descriptions of job requirements that appear in news-
papers are rarely exhaustive. Therefore, the role of unob-
servable characteristics, that would be of interest to
employers during interviews, but that designers of audit
studies do not take into account when forming auditor
groups, can be important.
Hence, there are some reasons to be suspicious about the re-
sults that come from audit studies, as there are many sources
of statistical noise that could challenge the results. Some of the
problems mentioned above are addressed during the audit
with a slight modication of the approach: using the resumes
of ctitious job applicants instead of having face-to-face (or
telephone) interviews. The drawback of this strategy is the
inability to test for the nal hiring decisions. It only allows
us to test for hypothetical hiring decisions of the employers
(van Beek, Koopmans, & van Praag, 1997) or for a one-step
advancement of the applicants in the hiring process (Bertrand
& Mullainathan, 2004), although perhaps the most important
one (Zegers de Beijl, 2000).
This study overcame some of these critiques by designing a
NFE in which, instead of hiring auditors to go to the job inter-
views, we selected them from a pool of applicants at the job
intermediation service of the Ministry of Labor and Employ-
ment Promotion in Lima, Peru, the CIL-PROEMPLEO net-
work.
7
With more than 10 years of functioning, this
network is the biggest public job intermediation service in
Lima, Peru. It receives around 500 job seekers per day, inter-
mediating approximately 40,000 positions per year. It has a
well established reputation among rms for the speed and
quality of the services they provide. A brief description of its
functioning follows.
Every morning, the intermediation specialists interview job
applicants at the oces of CIL-PROEMPLEO. After each
interview the information of the applicant is entered into a
database and remains there for a time-window of up to
3 months. If at the moment of the interview there is a
vacancy for which the applicant is qualied, he/she is
immediately sent to the rm that posted the vacancy, with
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0.4
1 2 3 4 5 6 7 to 10
Intensities
D
u
n
c
a
n
I
n
d
e
x
Females Males
Figure 3. Duncan Index of occupational segregation by intensities in the
White dimension (base group = intensity 0). Note: The Duncan Index was
calculated for each race intensity for males and females within the White
dimension. Each individual received an independent score of 010 from a
interviewer in each of four categories: Asian, White, indigenous, and
blackgroups that people readily recognize as distinct racial groupswith
zero indicating no physical characteristics that resembled an specic race
and 10 indicating most features of that group. Thus, the horizontal axis
captures the Duncan Index for each level of intensity for the White
category. For example, a female with intensity 4 (White) will have a
Duncan Index of 0.24.
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0.4
1 2 3 4 5 6 7 to 10
Intensities
D
u
n
c
a
n
I
n
d
e
x
Females Males
Figure 2. Duncan Index of occupational segregation by intensities in the
indigenous dimension (base group = intensity 0). Note: The Duncan Index
was calculated for each race intensity for males and females within the
Indigenous dimension. Each individual received an independent score of 0 to
10 from a interviewer in each of four categories: Asian, White, indigenous,
and blackgroups that people readily recognize as distinct racial groups
with zero indicating no physical characteristics that resembled an specic
race and 10 indicating most features of that group. Thus, the horizontal axis
captures the Duncan Index for each level of intensity for the indigenous
category. For example, a female with intensity 4 (indigenous) will have a
Duncan Index of 0.27.
GENDER AND RACIAL DISCRIMINATION IN HIRING THROUGH MONITORING INTERMEDIATION SERVICES 317
a letter of recommendation from the intermediation service,
for a job interview at the rm. If there is no suitable vacancy
at the moment, the applicant is asked to go home and wait
until one appears. When such vacancy appears, the applicant
is called by phone and asked to show up at the CIL-PRO-
EMPLEO oces to receive the recommendation letter and
go to her/his job interview. The vacancies are received on a
continuous basis, online or by phone, by the same intermedi-
ation specialists and immediately entered into the database
(which is shared by all intermediation specialists). The dat-
abases of applicants and vacancies are linked using software
that helps the intermediation specialists in their matching
tasks. Such software also facilitates the monitoring of the
rms and applicants matching processes such that the inter-
mediation system always has up-to-date information about
open and closed vacancies, and active and inactive job seek-
ers. Note that one rm may post more than one vacancy on
the system at the same time. Additionally, one applicant can
apply to more than one posting, as long as s/he satises the
requirements of each posting.
With the permission from the Ministry of Labor, a pool of
monitors at the CIL-PROEMPLEO oces was installed for
the purposes of this study, so that before the applicants were
sent to the rms for their nal job interviews, they were inter-
viewed for this project. Such interviews made it possible to col-
lect complementary information about applicants, in addition
to what was already registered in the administrative databases
of the intermediation service. The applicants were asked about
additional labor and socio-demographic characteristics
(including their aimed wages at the job for which they were
applying), a picture of them was taken and their racial inten-
sities were registered in our database. Such racial intensities
were based on observable characteristics, such as the skin col-
or, hair color, and shape and color of eyes, among others (see
Torero, Saavedra, N
opo, Hugo
(2002). Working within connes: Occupational segregation by gender in
three Latin American countries (Inter-American Development Bank
Sustainable Development Department Technical Papers Series No. 126).
Washington DC: Inter-American Development Bank.
Fluckiger, Yves, & Silber, J. (1999). The measurement of segregation in the
labor force. Heidelberg, NY: Physica-Verlag.
Goldin, Claudia, & Rouse, Cecilia (2000). Orchestrating impartiality: The
impact of blind auditions on female musicians. American Economic
Review, 90(4), 715741.
Harrison, Glenn, & List, John A. (2004). Field experiments. Journal of
Economic Literature, 42(4), 10091055.
Heckman, James (1998). Detecting discrimination. The Journal of
Economic Perspectives, 12(2), 101116.
Heckman, James, & Siegelman, Peter (1993). The urban institute audit
studies: Their methods and ndings. In M. Fix, & R. Struyk (Eds.),
Clear and Convincing Evidence: Measure of Discrimination in America.
Washington DC: The Urban Institute Press.
Lindzey, G., & Aronson, E. (1975). The handbook of social psychology, Vol
2 (2nd ed.). Reading, MA: Addison-Wesley.
N
opo, Hugo, Saavedra, Jaime, & Torero, Maximo (2007). Ethnicity and
earnings in a mixed race labor market. Economic Development and
Cultural Change, 55(4).
Riach, Peter, & Rich, Judith (2002). Field experiments of discrimination in
the marketplace. The Economic Journal, 112, F480F518.
Rosenthal, R. (1976). Experimenter eects in behavioral research (2nd ed).
New York, NY: Irvington Publishers.
Torero, Maximo, Saavedra, Jaime, N