Professional Documents
Culture Documents
Lnluvirido
Lxonuido
Gulsulluso
Gomuzumub
ldursulluso
Luroniduso
Nuulizumub
Omulizumub
Pulilormin
Poqvisomun
Prumlinido
Pusburicuso
Pomilosim
Oimizod MMOA
subsoquonly
idoniod
C
6CTIGVDCUGFUETGGPKPI D
F $KQNQIKEU
Duomycin
Lzoimibo
Linozolid
Nuoqlinido
Pomirolus
Punumido
Scrooninq ol
rundom
comound
librury
Momunino
Sinocuocbins
Vorinosu
Azuciidino
Cusolunqin
Cilosuzol
Cinuculco
Docosunol
Lovoirucoum
Lubirosono
Miqlusu
Nolurubino
Niuzoxunido
Niisinono
Punoluzino
Pouumulin
Sirolimus
Ziconoido
Zonisumido
Scrooninq ol comound-socic librurios
busod on siqnicun rior lnovlodqo
ol comound roorios
Ariiruzolo
lulvosrun
Vuroniclino
Knovn urqo:
soolinq imrovod
MMOA
Goinib
lmuinib
Muruviroc
Puloqruvir
Sorulonib
Suniinib
Alisliron
Aroiun
8orozomib
8osonun
Conivuun
Llrombouq
Orlisu
Siuqliin
Zunumivir
Milorisono
Pumoloon
Modiod nuurul
urqo liqund
Acumrosuo
Aminolovulinic ucid
londuurinux
Suroorin
Voroorn
E 5[PVJGVKEPCVWTCN
UWDUVCPEGU
Sorondiious
discovorios
omalizumab, pegvisomant and natalizumab); and deliv-
ering other compounds or proteins (denileukin diftitox
and gemtuzumab). Thus, the majority of these biologics
function by interfering with a molecular activity and, as
mentioned above, all of these biologics can be considered
to have been discovered using a target-based approach.
Both first-in-class small molecule NMEs and bio-
logics were approved for two targets: EGFR kinase (the
small-molecule EGFR kinase inhibitor gefitinib and
the EGFR-specific monoclonal antibody cetuximab)
and TPO (the small-molecule TPO receptor agonist
eltrombopag and the peptibody TPO receptor agonist
romiplostim). Three first-in-class medicines also act by
inhibiting vascular endothelial growth factor (VEGF)
signalling: the VEGF-specific monoclonal antibody
bevacizumab, and the small-molecule VEGF receptor
kinase inhibitors sunitinib, which also inhibits KIT, and
sorafenib, which was originally discovered on the basis
of its inhibition of RAF kinase
44
.
Strategies according to disease area. Evaluation of the
discovery strategy by disease area showed that a pheno-
typic approach was the most successful for central nerv-
ous system disorders and infectious diseases, whereas
target-based approaches were most successful in can-
cer, infectious diseases and metabolic diseases (TABLE2).
Biologics accounted for most of the new medicines that
act by modulating the immune system and 50% of the
new medicines forcancer.
Discovery of follower drugs
There were 164 follower drugs, out of which 83 (51%)
were discovered via target-based approaches, 30 (18%)
via phenotypic assays and 31 (19%) were biologics (FIG.2)
(Supplementary information S1 (table)). Seven (4%) of
the follower drugs were prodrugs or combinations of
previously approved medicines. Considering NMEs
alone, target-based approaches accounted for 62% (83
out of 133) of the small-molecule NMEs. The ratio of
NMEs from target-based approaches to those from phe-
notypic screening increased during the final 4years of
the analysis (FIG.3b).
Molecular mechanism of action
The majority of small-molecule first-in-class NMEs had
MMOAs that involved inhibiting the activity of enzymes or
modulating receptors (FIG.4). This trend is consistent with
the findings of Imming and colleagues
4
in their analysis
of the nature and number of all drug targets. The phar-
macological responses were often achieved by binding to
the target protein to elicit a positive or negative response.
For the first-in-class NMEs and biologics, many
different biochemical mechanisms mediated the drug
response at the target (BOX1). These included revers-
ible, irreversible and slow binding kinetics; competi-
tive, uncompetitive and noncompetitive interactions
between physiological substrates/ligands and drugs; as
well as inhibition, activation, agonism, partial agonism,
allosteric activation and induced degradation.
Illustrative examples in which stimulation of a bio-
logical response was achieved included: exenatide,
which mimics a natural peptide (glucagon-like peptide1
(GLP1)) but is resistant to degradation by the protease
DPP4 (REF.45); sitagliptin, which prevents degradation
of endogenous GLP1 by inhibiting DPP4 (REF.33); and
cinacalcet, which is an allosteric activator of the calcium-
sensing receptor
29
.
Illustrative examples in which inhibition or antago-
nism of a biological response was achieved included:
aprepitant, which is a competitive antagonist of the
neurokinin-1 receptor
46
; orlistat, which is an irreversible
inhibitor of lipase enzymes
35
; fulvestrant, which induces
Figure 1 | Discovery strategies used to identify first-in-class medicines. The
strategies that were used were categorized as being based on phenotypic screening (a),
target-based strategies (b), synthetic versions of natural substances or very close
derivatives (c) and biologics (d). Phenotypic strategies were further subdivided into
intentional screening with random compound libraries or compound-specific libraries,
optimization for molecular mechanism of action (MMOA) and serendipitous discoveries.
Drugs that were identified through target-based screening that involved optimization of
a natural ligand or identification of the optimal MMOA are highlighted. *Drugs that are
derived from natural substances.
Although enfuvirtide and pegvisomant were approved as new molecular entities, for the
purpose of this analysis they have been treated as biologics, given that they are both much
larger than typical small-molecule drugs (see Supplementary information S2 (box)).
ANALYSI S
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | JULY 2011 | 513
nrd_3480_jul11.indd 513 22/06/2011 10:16
acamprosate (FIG. 1c). Additionally, in some cases,
natural substances provided starting points for small-
molecule phenotypic screening (10 NMEs (FIG. 1a)) and
target-based discovery (3 NMEs (FIG. 1b)). In total, 18
out of the 50 (36%) first-in-class small-molecule NMEs
originated from natural substances. These numbers are
consistent with those reported by Newman and Cragg
32
for the percentage of all medicines derived from natu-
ral products, and the supposition that libraries that are
derived from natural substances provide good chemi-
cal starting points for optimization. For example, two
NMEs that were discovered using a target-specific
strategy ramelteon, which targets melatonin recep-
tors, and mifepristone, which is a progesterone receptor
modulator were derived from the modification of
natural ligands.
Target-based approaches. Target-based approaches
led to the discovery of 17 of the 50 first-in-class small-
molecule NMEs. Various approaches contributed to
these discoveries, and they are illustrated by the fol-
lowing examples. Sitagliptin, an inhibitor of the pro-
tease dipeptidyl peptidase 4 (DPP4), was discovered
in an iterative discovery approach that was aimed at
optimizing metabolic properties while retaining effi-
cacy
33
. A computer-assisted drug design strategy that
was based on the crystal structure of the influenza viral
neuraminidase led to the identification of zanamivir
34
.
A target-directed screening of microbial broths from
soil organisms resulted in the discovery of a very potent,
selective and irreversible inhibitor of pancreatic lipases,
which was named lipstatin (orlistat)
35
. Eltrombopag was
identified by screening small-molecule libraries for the
ability to activate a reporter molecule in thrombopoietin
(TPO)-dependent cell lines. Lead compounds were ini-
tially identified and then optimized for their biological
effect and pharmaceutical properties
36
. In a programme
that was aimed at discovering non-peptide endothelin
receptor antagonists, a class of substituted arylsulphon-
amidopyrimidines was identified in a chemical com-
pound library, which led to the discovery of bosentan
37
.
However, knowledge of the targets did not necessarily
lead to an easy path to discovery. For example, although
renin had been a clear target for the treatment of hyper-
tension for decades, the development of orally active
renin inhibitors, which culminated in the discovery of
the NME aliskiren
38
, was a major challenge.
The development of six of the NMEs that were dis-
covered by target-based approaches involved subsequent
identification of their effective MMOA at the target that
was selected for the initial screening strategies. The
kinase inhibitors gefitinib, imatinib, sorafenib and suni-
tinib block kinase activation; the HIV integrase inhibi-
tor raltegravir traps an intermediate complex between
the enzyme and nucleic acid; and maraviroc is an allos-
teric antagonist of the the CC chemokine receptor type
5. These inhibitors represent successes of the target-
based strategy, but they also highlight that the optimal
MMOA at the target may not be apparent at the time of
initiating the discovery strategy. For example, the HIV1
integrase inhibitor raltegravir was only discovered after
several MMOAs had been investigated using different
assay formats
39,40
. The diketo acids that led to the dis-
covery of raltegravir were eventually found to block the
strand transfer reaction, and this MMOA provided good
invivo efficacy. The importance of the assay format in
the identification of compounds with effective MMOAs
at a chosen target is also illustrated by the discovery of
gefitinib, which is thought to act by sequestering the
EGFR and its ligand into inactive receptorligand com-
plexes
41
. Screening for activity in A431 vulval squamous
carcinoma cells was the assay format that led to the iden-
tification of gefitinib and its MMOA
42
.
The neurokinin-1 receptor antagonist aprepitant and
the proteasome inhibitor bortezomib were originally dis-
covered with a view to targeting different indications to
those that they were first approved for (Supplementary
information S2 (box)). Repositioning was also involved
for three of the NMEs that were discovered through
phenotypic assays: miglustat, azacitidine and nitisinone
(Supplementary information S2 (box)).
Biologics. Biologics that were approved under biolog-
ics license applications and large peptide molecules
that were approved as NMEs (for example, enfuvirtide
and pegvisomant) accounted for 25 (33%) out of the
75 first-in-class medicines (FIG. 1d). The biologics were
further categorized according to their pharmacological
action as described by Leader, Baca and Golan
43
. The
pharmacological actions of these biologics included
enzyme replacement (agalsidase-, alglucosidase alfa,
galsulfase, idursulfase and laronidase), augmenting
existing pathways (drotrecogin-, exenatide, palifermin,
pramlintide and romiplostim), providing a novel func-
tion (rasburicase), interfering with a molecular activity
(alemtuzumab, abatacept, anakinra, alefacept, bevaci-
zumab, cetuximab, eculizumab, efalizumab, enfuvirtide,
Box 2 | Biochemical efficiency
The dose of a drug required to achieve the desired physiological response depends on
its biochemical efficiency
10,11
. This is defined as binding affinity/functional response,
which is equivalent to K
i
/EC
50
(effector concentration for half-maximal response)
. Good
biochemical efficiency enables efficacy at lower drug concentrations and increases the
therapeutic index. It is a property of many approved medicines
10,11
.
There are many factors that can influence the shift in doseresponse curves between
binding and functional assays, including:
Pharmacokinetics and ADME (absorption, distribution, metabolism and excretion)
properties
Assay relevance (is the functional assay appropriate for the target? Are the assays
technically accurate?)
The involvement of the target in the functional readout and biology
The molecular mechanism of action (MMOA)
Although all of these factors can and do contribute to the relationship between
binding affinity and the functional response, the role of the MMOA is not always
considered. The concept of biochemical efficiency was introduced to quantify this
possibility
10,11
. When biochemical efficiency is used as a measure of an optimal MMOA,
it is important that the other mitigating factors are eliminated. For example, when
evaluating biochemical efficiency, the assays must be run in the absence of serum
(or plasma) to eliminate the shift in IC
50
(half-maximal inhibitory concentration) owing
to serum protein binding.
ANALYSI S
512 | JULY 2011 | VOLUME 10 www.nature.com/reviews/drugdisc
nrd_3480_jul11.indd 512 22/06/2011 10:16
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 29
0CVWTG4GXKGYU&TWI&KUEQXGT[
2JGPQV[RKE
UETGGPKPI
lnonionul urqoinq
ol socic bonoyo
Abuuco
Aqulsiduso-
Aloluco
Alomuzumub
Alqlucosiduso ullu
Anulinru
8ovucizumub
Couximub
Doniloulin
Drorocoqin-
Lculizumub
Llulizumub
Lnluvirido
Lxonuido
Gulsulluso
Gomuzumub
ldursulluso
Luroniduso
Nuulizumub
Omulizumub
Pulilormin
Poqvisomun
Prumlinido
Pusburicuso
Pomilosim
Oimizod MMOA
subsoquonly
idoniod
C
6CTIGVDCUGFUETGGPKPI D
F $KQNQIKEU
Duomycin
Lzoimibo
Linozolid
Nuoqlinido
Pomirolus
Punumido
Scrooninq ol
rundom
comound
librury
Momunino
Sinocuocbins
Vorinosu
Azuciidino
Cusolunqin
Cilosuzol
Cinuculco
Docosunol
Lovoirucoum
Lubirosono
Miqlusu
Nolurubino
Niuzoxunido
Niisinono
Punoluzino
Pouumulin
Sirolimus
Ziconoido
Zonisumido
Scrooninq ol comound-socic librurios
busod on siqnicun rior lnovlodqo
ol comound roorios
Ariiruzolo
lulvosrun
Vuroniclino
Knovn urqo:
soolinq imrovod
MMOA
Goinib
lmuinib
Muruviroc
Puloqruvir
Sorulonib
Suniinib
Alisliron
Aroiun
8orozomib
8osonun
Conivuun
Llrombouq
Orlisu
Siuqliin
Zunumivir
Milorisono
Pumoloon
Modiod nuurul
urqo liqund
Acumrosuo
Aminolovulinic ucid
londuurinux
Suroorin
Voroorn
E 5[PVJGVKEPCVWTCN
UWDUVCPEGU
Sorondiious
discovorios
omalizumab, pegvisomant and natalizumab); and deliv-
ering other compounds or proteins (denileukin diftitox
and gemtuzumab). Thus, the majority of these biologics
function by interfering with a molecular activity and, as
mentioned above, all of these biologics can be considered
to have been discovered using a target-based approach.
Both first-in-class small molecule NMEs and bio-
logics were approved for two targets: EGFR kinase (the
small-molecule EGFR kinase inhibitor gefitinib and
the EGFR-specific monoclonal antibody cetuximab)
and TPO (the small-molecule TPO receptor agonist
eltrombopag and the peptibody TPO receptor agonist
romiplostim). Three first-in-class medicines also act by
inhibiting vascular endothelial growth factor (VEGF)
signalling: the VEGF-specific monoclonal antibody
bevacizumab, and the small-molecule VEGF receptor
kinase inhibitors sunitinib, which also inhibits KIT, and
sorafenib, which was originally discovered on the basis
of its inhibition of RAF kinase
44
.
Strategies according to disease area. Evaluation of the
discovery strategy by disease area showed that a pheno-
typic approach was the most successful for central nerv-
ous system disorders and infectious diseases, whereas
target-based approaches were most successful in can-
cer, infectious diseases and metabolic diseases (TABLE2).
Biologics accounted for most of the new medicines that
act by modulating the immune system and 50% of the
new medicines forcancer.
Discovery of follower drugs
There were 164 follower drugs, out of which 83 (51%)
were discovered via target-based approaches, 30 (18%)
via phenotypic assays and 31 (19%) were biologics (FIG.2)
(Supplementary information S1 (table)). Seven (4%) of
the follower drugs were prodrugs or combinations of
previously approved medicines. Considering NMEs
alone, target-based approaches accounted for 62% (83
out of 133) of the small-molecule NMEs. The ratio of
NMEs from target-based approaches to those from phe-
notypic screening increased during the final 4years of
the analysis (FIG.3b).
Molecular mechanism of action
The majority of small-molecule first-in-class NMEs had
MMOAs that involved inhibiting the activity of enzymes or
modulating receptors (FIG.4). This trend is consistent with
the findings of Imming and colleagues
4
in their analysis
of the nature and number of all drug targets. The phar-
macological responses were often achieved by binding to
the target protein to elicit a positive or negative response.
For the first-in-class NMEs and biologics, many
different biochemical mechanisms mediated the drug
response at the target (BOX1). These included revers-
ible, irreversible and slow binding kinetics; competi-
tive, uncompetitive and noncompetitive interactions
between physiological substrates/ligands and drugs; as
well as inhibition, activation, agonism, partial agonism,
allosteric activation and induced degradation.
Illustrative examples in which stimulation of a bio-
logical response was achieved included: exenatide,
which mimics a natural peptide (glucagon-like peptide1
(GLP1)) but is resistant to degradation by the protease
DPP4 (REF.45); sitagliptin, which prevents degradation
of endogenous GLP1 by inhibiting DPP4 (REF.33); and
cinacalcet, which is an allosteric activator of the calcium-
sensing receptor
29
.
Illustrative examples in which inhibition or antago-
nism of a biological response was achieved included:
aprepitant, which is a competitive antagonist of the
neurokinin-1 receptor
46
; orlistat, which is an irreversible
inhibitor of lipase enzymes
35
; fulvestrant, which induces
Figure 1 | Discovery strategies used to identify first-in-class medicines. The
strategies that were used were categorized as being based on phenotypic screening (a),
target-based strategies (b), synthetic versions of natural substances or very close
derivatives (c) and biologics (d). Phenotypic strategies were further subdivided into
intentional screening with random compound libraries or compound-specific libraries,
optimization for molecular mechanism of action (MMOA) and serendipitous discoveries.
Drugs that were identified through target-based screening that involved optimization of
a natural ligand or identification of the optimal MMOA are highlighted. *Drugs that are
derived from natural substances.
Although enfuvirtide and pegvisomant were approved as new molecular entities, for the
purpose of this analysis they have been treated as biologics, given that they are both much
larger than typical small-molecule drugs (see Supplementary information S2 (box)).
ANALYSI S
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | JULY 2011 | 513
nrd_3480_jul11.indd 513 22/06/2011 10:16
acamprosate (FIG. 1c). Additionally, in some cases,
natural substances provided starting points for small-
molecule phenotypic screening (10 NMEs (FIG. 1a)) and
target-based discovery (3 NMEs (FIG. 1b)). In total, 18
out of the 50 (36%) first-in-class small-molecule NMEs
originated from natural substances. These numbers are
consistent with those reported by Newman and Cragg
32
for the percentage of all medicines derived from natu-
ral products, and the supposition that libraries that are
derived from natural substances provide good chemi-
cal starting points for optimization. For example, two
NMEs that were discovered using a target-specific
strategy ramelteon, which targets melatonin recep-
tors, and mifepristone, which is a progesterone receptor
modulator were derived from the modification of
natural ligands.
Target-based approaches. Target-based approaches
led to the discovery of 17 of the 50 first-in-class small-
molecule NMEs. Various approaches contributed to
these discoveries, and they are illustrated by the fol-
lowing examples. Sitagliptin, an inhibitor of the pro-
tease dipeptidyl peptidase 4 (DPP4), was discovered
in an iterative discovery approach that was aimed at
optimizing metabolic properties while retaining effi-
cacy
33
. A computer-assisted drug design strategy that
was based on the crystal structure of the influenza viral
neuraminidase led to the identification of zanamivir
34
.
A target-directed screening of microbial broths from
soil organisms resulted in the discovery of a very potent,
selective and irreversible inhibitor of pancreatic lipases,
which was named lipstatin (orlistat)
35
. Eltrombopag was
identified by screening small-molecule libraries for the
ability to activate a reporter molecule in thrombopoietin
(TPO)-dependent cell lines. Lead compounds were ini-
tially identified and then optimized for their biological
effect and pharmaceutical properties
36
. In a programme
that was aimed at discovering non-peptide endothelin
receptor antagonists, a class of substituted arylsulphon-
amidopyrimidines was identified in a chemical com-
pound library, which led to the discovery of bosentan
37
.
However, knowledge of the targets did not necessarily
lead to an easy path to discovery. For example, although
renin had been a clear target for the treatment of hyper-
tension for decades, the development of orally active
renin inhibitors, which culminated in the discovery of
the NME aliskiren
38
, was a major challenge.
The development of six of the NMEs that were dis-
covered by target-based approaches involved subsequent
identification of their effective MMOA at the target that
was selected for the initial screening strategies. The
kinase inhibitors gefitinib, imatinib, sorafenib and suni-
tinib block kinase activation; the HIV integrase inhibi-
tor raltegravir traps an intermediate complex between
the enzyme and nucleic acid; and maraviroc is an allos-
teric antagonist of the the CC chemokine receptor type
5. These inhibitors represent successes of the target-
based strategy, but they also highlight that the optimal
MMOA at the target may not be apparent at the time of
initiating the discovery strategy. For example, the HIV1
integrase inhibitor raltegravir was only discovered after
several MMOAs had been investigated using different
assay formats
39,40
. The diketo acids that led to the dis-
covery of raltegravir were eventually found to block the
strand transfer reaction, and this MMOA provided good
invivo efficacy. The importance of the assay format in
the identification of compounds with effective MMOAs
at a chosen target is also illustrated by the discovery of
gefitinib, which is thought to act by sequestering the
EGFR and its ligand into inactive receptorligand com-
plexes
41
. Screening for activity in A431 vulval squamous
carcinoma cells was the assay format that led to the iden-
tification of gefitinib and its MMOA
42
.
The neurokinin-1 receptor antagonist aprepitant and
the proteasome inhibitor bortezomib were originally dis-
covered with a view to targeting different indications to
those that they were first approved for (Supplementary
information S2 (box)). Repositioning was also involved
for three of the NMEs that were discovered through
phenotypic assays: miglustat, azacitidine and nitisinone
(Supplementary information S2 (box)).
Biologics. Biologics that were approved under biolog-
ics license applications and large peptide molecules
that were approved as NMEs (for example, enfuvirtide
and pegvisomant) accounted for 25 (33%) out of the
75 first-in-class medicines (FIG. 1d). The biologics were
further categorized according to their pharmacological
action as described by Leader, Baca and Golan
43
. The
pharmacological actions of these biologics included
enzyme replacement (agalsidase-, alglucosidase alfa,
galsulfase, idursulfase and laronidase), augmenting
existing pathways (drotrecogin-, exenatide, palifermin,
pramlintide and romiplostim), providing a novel func-
tion (rasburicase), interfering with a molecular activity
(alemtuzumab, abatacept, anakinra, alefacept, bevaci-
zumab, cetuximab, eculizumab, efalizumab, enfuvirtide,
Box 2 | Biochemical efficiency
The dose of a drug required to achieve the desired physiological response depends on
its biochemical efficiency
10,11
. This is defined as binding affinity/functional response,
which is equivalent to K
i
/EC
50
(effector concentration for half-maximal response)
. Good
biochemical efficiency enables efficacy at lower drug concentrations and increases the
therapeutic index. It is a property of many approved medicines
10,11
.
There are many factors that can influence the shift in doseresponse curves between
binding and functional assays, including:
Pharmacokinetics and ADME (absorption, distribution, metabolism and excretion)
properties
Assay relevance (is the functional assay appropriate for the target? Are the assays
technically accurate?)
The involvement of the target in the functional readout and biology
The molecular mechanism of action (MMOA)
Although all of these factors can and do contribute to the relationship between
binding affinity and the functional response, the role of the MMOA is not always
considered. The concept of biochemical efficiency was introduced to quantify this
possibility
10,11
. When biochemical efficiency is used as a measure of an optimal MMOA,
it is important that the other mitigating factors are eliminated. For example, when
evaluating biochemical efficiency, the assays must be run in the absence of serum
(or plasma) to eliminate the shift in IC
50
(half-maximal inhibitory concentration) owing
to serum protein binding.
ANALYSI S
512 | JULY 2011 | VOLUME 10 www.nature.com/reviews/drugdisc
nrd_3480_jul11.indd 512 22/06/2011 10:16
30 | OCTOBER 2011 | THE FUTURE OF DRUG INNOVATION | NATURE REPRINT COLLECTION www.nature.com/reprintcollections/lilly/drug-innovation
30
C D
2S
20
N
u
m
b
o
r
o
l
N
M
L
s
N
u
m
b
o
r
o
l
N
M
L
s
1S
10
S
0
00
80
10
60
S0
40
30
20
10
0
0CVWTG4GXKGYU&TWI&KUEQXGT[
Your
1000 2000 2001 2002 2003 2004 200S 2006 2001 2008
Your
1000 2000 2001 2002 2003 2004 200S 2006 2001 2008
Pbonoyic scrooninq
Turqo-busod scrooninq
8ioloqics
this proposal is that the MMOA is a key factor for the
success of all approaches, but is addressed in different
ways and at different points in the various approaches.
In the more common target-based approach, drug
discovery is generally hypothesis-driven, and there are
at least three hypotheses that must be correct to result
in a new drug. The first hypothesis, which also applies
to other discovery approaches, is that activity in the
preclinical screens that are used to select a drug candi-
date will translate effectively into clinically meaningful
activity in patients. The other two hypotheses are that
the target that is selected is important in human disease
and that the MMOA of drug candidates at the target in
question is one that is capable of achieving the desired
biological response. Successful target-based discov-
ery of first-in-class drugs with tolerable safety profiles
requires the time and resources to investigate all three
hypotheses. In particular, the importance of hypoth-
esis testing to identify an appropriate MMOA may be
an underappreciated challenge that if neglected
could contribute to increased attrition rates for such
approaches. In other words, it is clearly difficult to
rationally identify the specific molecular interactions
from all of the potential dynamic molecular interac-
tions that will contribute to an optimal MMOA. Thus,
the key biochemical nuances that are important for the
translation of the molecular interaction (between a drug
and the target) to an optimal pharmacological response
could be missed with target-based approaches.
By contrast, in the case of phenotypic-based screening
approaches, assuming that a screening assay that trans-
lates effectively to human disease is available or can be
identified, a potential key advantage of this approach over
target-based approaches is that there is no preconceived
idea of the MMOA and target hypothesis. This could
considerably aid the identification of molecules with
appropriate targets (and possibly multiple targets) and
MMOAs, which might be less likely to emerge rapidly, if
at all, from pursuing a focused target-based hypothesis.
However, two limitations of phenotypic-based screening
approaches should also be noted. First, it will often be
necessary to characterize the MMOA of active molecules
that are identified in phenotypic screens to aid the opti-
mization of a drug candidate, but substantial progress has
been made in approaches to achieve this for example,
approaches based on RNA interference
54,55
. Second, phe-
notypic assays are often lower in throughput than stand-
ard target-based assays, although considerable progress
has also been made in recent years to automate such
assays and increase their throughput
5658
.
Finally, as has often been noted in reviews of the role
of natural products in drug discovery
32,59
, discovery
strategies that are based on natural substances have an
inherent advantage: the biology, target and MMOA are
often likely to be have been optimized already through
evolution, and so modifying such substances can be a
fruitful approach. Similarly, some of the biologics that
have been approved are harnessing endogenous mecha-
nisms in a rational way for example, by providing a
natural protein that is reduced in a given disease state,
as is the case for enzyme replacement therapies for
lyosomal storage disorders. In other cases though, it is
apparent that the precise MMOA of biologics might also
be important in their biological effects, as illustrated by
the differences in the properties of two monoclonal
antibodies that target CD20 on Bcells
60
rituximab
and ofatumumab although neither of these were
approved in the 10-year period we studied. Telling et
al.
60
conclude that the recognition of a novel epitope
cooperates with a slow off-rate in determining the activ-
ity of CD20 monoclonal antibodies in the activation of
complement and the induction of tumour celllysis.
The importance of the MMOA is further supported
by the evolution of the MMOA within drug classes, from
the first-in-class molecule to the best-in-class molecule,
which is not widely appreciated. For example, in some
cases in which there is no mechanism-based toxicity, the
evolution of drugs in a given class towards the best-in-
class has been associated with slower dissociation rates
at the target. This has been observed with antihistamines
Figure 3 | Cumulative distribution of new drugs by discovery strategy. a | First-in-class drugs. A lag is not strongly
apparent in a comparison of the cumulative number of small-molecule new molecular entities (NMEs) that were
discovered from the different approaches during the period ana lysed. b | Follower drugs. For follower drugs, the ratio
of small-molecule NMEs discovered through target-based screening to those discovered through phenotypic screening
appears to increase in the second half of the time period.
ANALYSI S
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | JULY 2011 | 515
nrd_3480_jul11.indd 515 22/06/2011 10:16
degradation of the oestrogen receptor
47
; bevacizumab,
which binds to VEGF, thereby preventing its interaction
with its cell surface receptors
48
; and imatinib, which
inhibits the BCRABL kinase by stabilizing its inac-
tive conformation
49
(see Supplementary information S2
(box)) for further details on these and other MMOAs).
Importantly, simple equilibrium binding at the target
was rarely sufficient for the translation of drug binding
to the target into a therapeutically useful response a
subtle aspect of drug action that is underappreciated.
These results are consistent with the previous conclu-
sion
10
that two components are important to the MMOA.
The first component is the initial mass action-dependent
interaction. The second component requires a coupled
biochemical event to create a transition away from mass-
action equilibrium. It is also consistent with the opinions
expressed by Imming and colleagues
4
in their analysis
of drug targets, in which they emphasized the need to
consider the dynamics of the drugtarget interactions,
because in situations in which the dynamic actions of the
drug substance stimulate, or inhibit, a biological process, it
is necessary to move away from the descriptions of single
proteins, receptors and so on and to view the entire signal
chain as the target.
The diversity of the MMOAs of the new drugs ana-
lysed in this article is not surprising. Physiological and
drug mechanisms provide numerous examples of how
diversity and complexity in the MMOA can provide
robust, selective and timely functional responses. For
example, nuclear receptor ligands can induce ligand-
specific structural conformations that can be uniquely
coupled to the physiological system to provide func-
tionally selective responses
14
. Such conformational
changes might not be detectable by X-ray crystallogra-
phy studies; indeed, this was recently demonstrated for
the
2
-adrenergic receptor there was no discernable
difference in the conformation of the receptor when it
was bound to an inverse agonist or an antagonist
50
. The
functions of many enzymes are also regulated by specific
structural changes. For example, receptor tyrosine kinase
activation requires conformational changes that are
facilitated by ligand binding
51
, and many proteases have
inhibitory domains that must be proteolytically cleaved
for enzyme activation
52
. Both kinetics and conformation
contribute to the specificity of high-fidelity nucleotide
incorporation by DNA polymerases. Kinetic analysis has
shown that the nucleotide substrate-induced structural
change has a key role in discriminating between cor-
rect and incorrect base pairs, by governing whether a
nucleotide will be retained and incorporated or rapidly
released
53
.
Discussion
A principal observation from this analysis is that the
majority of small-molecule first-in-class NMEs that were
discovered between 1999 and 2008 were first discovered
using phenotypic assays (FIG.2): 28 of the first-in-class
NMEs came from phenotypic screening approaches,
compared with 17 from target-based approaches. This is
despite the current focus of small-molecule drug discov-
ery on target-based approaches. A possible contributing
factor to this trend could have been a lag time between
the introduction of new technologies and strategies, and
their impact in terms of the number of approved first-
in-class NMEs derived from these approaches. However,
such a lag is not strongly apparent in a comparison of the
cumulative number of NMEs from the two approaches
during the period analysed (FIG.3a).
This observation, along with further analysis of the
MMOA of the first-in-class NMEs, leads us to propose
that a focus on target-based drug discovery, without
accounting sufficiently for the MMOA of small-mole-
cule first-in-class medicines, could be a technical reason
contributing to high attrition rates. Our reasoning for
Table 2 | Discovery of first-in-class NMEs by therapeutic area
Disease area Target-based
screening
Phenotypic
screening
Biologics
Infectious diseases 3 7 1
Immune 1 0 6
Cancer 5 3 8
Central nervous system 1 7 1
Metabolic 3 2 2
Cardiovascular 2 3 0
Gastrointestinal 1 1 1
Others 1 3 1
Rare diseases 0 2 5
NME, new molecular entity.
0CVWTG4GXKGYU&TWI&KUEQXGT[
S0
40
30
P
o
r
c
o
n
u
q
o
o
l
N
M
L
s
28
Pbonoyic
scrooninq
11
2S
S
30
83
31
13
31
23
33
1
18
S1
10
8
20
10
0
lirs-in-cluss druq lollovor druq
Turqo-
busod
scrooninq
Modiod
nuurul
subsuncos
8ioloqics
Figure 2 | The distribution of new drugs discovered
between 1999 and 2008, according to the discovery
strategy. The graph illustrates the number of new molecular
entities (NMEs) in each category. Phenotypic screening was
the most successful approach for first-in-class drugs,
whereas target-based screening was the most successful for
follower drugs during the period of this analysis. The total
number of medicines that were discovered via phenotypic
assays was similar for first-in-class and follower drugs
28 and 30, respectively whereas the total number of
medicines that were discovered via target-based screening
was nearly five times higher for follower drugs versus
first-in-class drugs (83 to 17, respectively).
ANALYSI S
514 | JULY 2011 | VOLUME 10 www.nature.com/reviews/drugdisc
nrd_3480_jul11.indd 514 22/06/2011 10:16
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 31
30
C D
2S
20
N
u
m
b
o
r
o
l
N
M
L
s
N
u
m
b
o
r
o
l
N
M
L
s
1S
10
S
0
00
80
10
60
S0
40
30
20
10
0
0CVWTG4GXKGYU&TWI&KUEQXGT[
Your
1000 2000 2001 2002 2003 2004 200S 2006 2001 2008
Your
1000 2000 2001 2002 2003 2004 200S 2006 2001 2008
Pbonoyic scrooninq
Turqo-busod scrooninq
8ioloqics
this proposal is that the MMOA is a key factor for the
success of all approaches, but is addressed in different
ways and at different points in the various approaches.
In the more common target-based approach, drug
discovery is generally hypothesis-driven, and there are
at least three hypotheses that must be correct to result
in a new drug. The first hypothesis, which also applies
to other discovery approaches, is that activity in the
preclinical screens that are used to select a drug candi-
date will translate effectively into clinically meaningful
activity in patients. The other two hypotheses are that
the target that is selected is important in human disease
and that the MMOA of drug candidates at the target in
question is one that is capable of achieving the desired
biological response. Successful target-based discov-
ery of first-in-class drugs with tolerable safety profiles
requires the time and resources to investigate all three
hypotheses. In particular, the importance of hypoth-
esis testing to identify an appropriate MMOA may be
an underappreciated challenge that if neglected
could contribute to increased attrition rates for such
approaches. In other words, it is clearly difficult to
rationally identify the specific molecular interactions
from all of the potential dynamic molecular interac-
tions that will contribute to an optimal MMOA. Thus,
the key biochemical nuances that are important for the
translation of the molecular interaction (between a drug
and the target) to an optimal pharmacological response
could be missed with target-based approaches.
By contrast, in the case of phenotypic-based screening
approaches, assuming that a screening assay that trans-
lates effectively to human disease is available or can be
identified, a potential key advantage of this approach over
target-based approaches is that there is no preconceived
idea of the MMOA and target hypothesis. This could
considerably aid the identification of molecules with
appropriate targets (and possibly multiple targets) and
MMOAs, which might be less likely to emerge rapidly, if
at all, from pursuing a focused target-based hypothesis.
However, two limitations of phenotypic-based screening
approaches should also be noted. First, it will often be
necessary to characterize the MMOA of active molecules
that are identified in phenotypic screens to aid the opti-
mization of a drug candidate, but substantial progress has
been made in approaches to achieve this for example,
approaches based on RNA interference
54,55
. Second, phe-
notypic assays are often lower in throughput than stand-
ard target-based assays, although considerable progress
has also been made in recent years to automate such
assays and increase their throughput
5658
.
Finally, as has often been noted in reviews of the role
of natural products in drug discovery
32,59
, discovery
strategies that are based on natural substances have an
inherent advantage: the biology, target and MMOA are
often likely to be have been optimized already through
evolution, and so modifying such substances can be a
fruitful approach. Similarly, some of the biologics that
have been approved are harnessing endogenous mecha-
nisms in a rational way for example, by providing a
natural protein that is reduced in a given disease state,
as is the case for enzyme replacement therapies for
lyosomal storage disorders. In other cases though, it is
apparent that the precise MMOA of biologics might also
be important in their biological effects, as illustrated by
the differences in the properties of two monoclonal
antibodies that target CD20 on Bcells
60
rituximab
and ofatumumab although neither of these were
approved in the 10-year period we studied. Telling et
al.
60
conclude that the recognition of a novel epitope
cooperates with a slow off-rate in determining the activ-
ity of CD20 monoclonal antibodies in the activation of
complement and the induction of tumour celllysis.
The importance of the MMOA is further supported
by the evolution of the MMOA within drug classes, from
the first-in-class molecule to the best-in-class molecule,
which is not widely appreciated. For example, in some
cases in which there is no mechanism-based toxicity, the
evolution of drugs in a given class towards the best-in-
class has been associated with slower dissociation rates
at the target. This has been observed with antihistamines
Figure 3 | Cumulative distribution of new drugs by discovery strategy. a | First-in-class drugs. A lag is not strongly
apparent in a comparison of the cumulative number of small-molecule new molecular entities (NMEs) that were
discovered from the different approaches during the period ana lysed. b | Follower drugs. For follower drugs, the ratio
of small-molecule NMEs discovered through target-based screening to those discovered through phenotypic screening
appears to increase in the second half of the time period.
ANALYSI S
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | JULY 2011 | 515
nrd_3480_jul11.indd 515 22/06/2011 10:16
degradation of the oestrogen receptor
47
; bevacizumab,
which binds to VEGF, thereby preventing its interaction
with its cell surface receptors
48
; and imatinib, which
inhibits the BCRABL kinase by stabilizing its inac-
tive conformation
49
(see Supplementary information S2
(box)) for further details on these and other MMOAs).
Importantly, simple equilibrium binding at the target
was rarely sufficient for the translation of drug binding
to the target into a therapeutically useful response a
subtle aspect of drug action that is underappreciated.
These results are consistent with the previous conclu-
sion
10
that two components are important to the MMOA.
The first component is the initial mass action-dependent
interaction. The second component requires a coupled
biochemical event to create a transition away from mass-
action equilibrium. It is also consistent with the opinions
expressed by Imming and colleagues
4
in their analysis
of drug targets, in which they emphasized the need to
consider the dynamics of the drugtarget interactions,
because in situations in which the dynamic actions of the
drug substance stimulate, or inhibit, a biological process, it
is necessary to move away from the descriptions of single
proteins, receptors and so on and to view the entire signal
chain as the target.
The diversity of the MMOAs of the new drugs ana-
lysed in this article is not surprising. Physiological and
drug mechanisms provide numerous examples of how
diversity and complexity in the MMOA can provide
robust, selective and timely functional responses. For
example, nuclear receptor ligands can induce ligand-
specific structural conformations that can be uniquely
coupled to the physiological system to provide func-
tionally selective responses
14
. Such conformational
changes might not be detectable by X-ray crystallogra-
phy studies; indeed, this was recently demonstrated for
the
2
-adrenergic receptor there was no discernable
difference in the conformation of the receptor when it
was bound to an inverse agonist or an antagonist
50
. The
functions of many enzymes are also regulated by specific
structural changes. For example, receptor tyrosine kinase
activation requires conformational changes that are
facilitated by ligand binding
51
, and many proteases have
inhibitory domains that must be proteolytically cleaved
for enzyme activation
52
. Both kinetics and conformation
contribute to the specificity of high-fidelity nucleotide
incorporation by DNA polymerases. Kinetic analysis has
shown that the nucleotide substrate-induced structural
change has a key role in discriminating between cor-
rect and incorrect base pairs, by governing whether a
nucleotide will be retained and incorporated or rapidly
released
53
.
Discussion
A principal observation from this analysis is that the
majority of small-molecule first-in-class NMEs that were
discovered between 1999 and 2008 were first discovered
using phenotypic assays (FIG.2): 28 of the first-in-class
NMEs came from phenotypic screening approaches,
compared with 17 from target-based approaches. This is
despite the current focus of small-molecule drug discov-
ery on target-based approaches. A possible contributing
factor to this trend could have been a lag time between
the introduction of new technologies and strategies, and
their impact in terms of the number of approved first-
in-class NMEs derived from these approaches. However,
such a lag is not strongly apparent in a comparison of the
cumulative number of NMEs from the two approaches
during the period analysed (FIG.3a).
This observation, along with further analysis of the
MMOA of the first-in-class NMEs, leads us to propose
that a focus on target-based drug discovery, without
accounting sufficiently for the MMOA of small-mole-
cule first-in-class medicines, could be a technical reason
contributing to high attrition rates. Our reasoning for
Table 2 | Discovery of first-in-class NMEs by therapeutic area
Disease area Target-based
screening
Phenotypic
screening
Biologics
Infectious diseases 3 7 1
Immune 1 0 6
Cancer 5 3 8
Central nervous system 1 7 1
Metabolic 3 2 2
Cardiovascular 2 3 0
Gastrointestinal 1 1 1
Others 1 3 1
Rare diseases 0 2 5
NME, new molecular entity.
0CVWTG4GXKGYU&TWI&KUEQXGT[
S0
40
30
P
o
r
c
o
n
u
q
o
o
l
N
M
L
s
28
Pbonoyic
scrooninq
11
2S
S
30
83
31
13
31
23
33
1
18
S1
10
8
20
10
0
lirs-in-cluss druq lollovor druq
Turqo-
busod
scrooninq
Modiod
nuurul
subsuncos
8ioloqics
Figure 2 | The distribution of new drugs discovered
between 1999 and 2008, according to the discovery
strategy. The graph illustrates the number of new molecular
entities (NMEs) in each category. Phenotypic screening was
the most successful approach for first-in-class drugs,
whereas target-based screening was the most successful for
follower drugs during the period of this analysis. The total
number of medicines that were discovered via phenotypic
assays was similar for first-in-class and follower drugs
28 and 30, respectively whereas the total number of
medicines that were discovered via target-based screening
was nearly five times higher for follower drugs versus
first-in-class drugs (83 to 17, respectively).
ANALYSI S
514 | JULY 2011 | VOLUME 10 www.nature.com/reviews/drugdisc
nrd_3480_jul11.indd 514 22/06/2011 10:16
32 | OCTOBER 2011 | THE FUTURE OF DRUG INNOVATION | NATURE REPRINT COLLECTION www.nature.com/reprintcollections/lilly/drug-innovation
belief by some that every target can provide the basis
for a drug. As such, research across the pharmaceutical
industry as well as academic institutions has increas-
ingly focused on targets, arguably at the expense of the
development of preclinical assays that translate more
effectively into clinical effects in patients with a specific
disease. In our analysis, we found that there are numerous
diverse MMOAs for approved new first-in-class drugs,
but drug discovery at present appears to be dominated by
a one size fits all approach, in which drugs are optimized
for binding affinity with less consideration for binding
kinetics and conformation. For optimal application of
target-based approaches, it is important to consider how
efficiently binding is coupled to the response (BOX2).
However, the molecular descriptors for the coupling fac-
tors may not be accurately captured by only consider-
ing binding affinity. Furthermore, an excessive focus on
affinity at a given target could lead to compromises being
made in pharmacokinetic properties that are critical for
the success of drugs, which has also been postulated to
be an underlying factor for current attritionrates
67
.
Reducing the impact of technical uncertainty on the
later, more costly stages of drug development through a
quick win/fast fail strategy has been proposed as a solu-
tion to the current problems with R&D productivity
2
.
However, this strategy does not address the key issues
that contribute to the greater technical uncertainty
and associated risk of failure. Our analysis leads us to
conclude that the identification of an optimal MMOA
has been a key factor contributing to the success of
phenotypic screening in the discovery of the first-in-
class NMEs in the 10-year period we studied. Thus, we
consider that technical risk and, consequently, overall
attrition in drug development could be decreased for
first-in-class drugs through the development and greater
use of translational phenotypic assays, and by considering
diverse MMOAs when using a target-based, hypothesis-
driven strategy.
1. Munos, B. Lessons for 60years of pharmaceutical
innovation. Nature Rev. Drug Discov. 8, 959968
(2009).
2. Paul, S.M. etal. How to improve R.&D productivity:
the pharmaceutical industrys grand challenge. Nature
Rev. Drug Discov. 9, 203214 (2010).
3. Lindsay, M.A. Target discovery. Nature Rev. Drug
Discov. 2, 831838 (2003).
4. Imming, P., Sinning, C. & Meyer A. Drugs, their targets
and the nature and number of drug targets. Nature
Rev. Drug Discov. 5, 821834 (2006).
5. Overington, J.P., Al-Lazikani, B. & Hopkins, A.L. How
many drug targets are there? Nature Rev. Drug
Discov. 5, 993996(2006).
6. Williams, M. Systems and integrative biology as
alternative guises for pharmacology: prime time for an
iPharm concept? Biochem. Pharmacol. 70,
17071716 (2005).
7. Flordellis, C.S., Manolis, A.S., Paris, H. & Karabinis, A.
Rethinking target discovery in polygenic diseases.
Curr. Top. Med. Chem. 6, 17911798 (2006).
8. Urban, J.D. etal. Functional selectivity and classical
concepts of quantitative pharmacology J.Pharmacol.
Exp. Ther. 320, 113 (2007).
Formalizes the concept of functional selectivity,
whereby multiple unique ligands can bind to one
receptor to initiate different responses.
9. Kenakin, T. & Miller, L.J. Seven transmembrane
receptors as shapeshifting proteins: the impact of
allosteric modulation and functional selectivity on
drug discovery. Pharmacol. Rev. 62, 265304
(2010).
10. Swinney, D.C. Biochemical mechanisms of drug
action: what does it take for success? Nature Rev.
Drug Discov. 3, 801808 (2004).
Describes how the MMOA influences the
therapeutic index and utility of a medicine and
introduces biochemical efficiency as a metric to
quantify this influence.
11. Swinney, D.C. Biochemical mechanisms of new
molecular entities (NMEs) approved by United States
FDA during 20012004: mechanisms leading to
optimal efficacy and safety. Curr. Top. Med. Chem. 6,
461478 (2006).
12. Swinney, D.C. Applications of binding kinetics to drug
discovery: translation of binding mechanism to
clinically differentiated therapeutic responses. Pharm.
Med. 22, 2334 (2008).
13. Yun, C.H. etal. The T790M mutation in EGFR kinase
causes drug resistance by increasing the affinity for ATP.
Proc. Natl Acad. Sci. USA 105, 20702075 (2008).
Provides an illustration of how drug resistance
could be overcome through an understanding of
the MMOA.
14. Brzozowski, A.M. etal. Molecular basis of agonism
and antagonism in the oestrogen receptor. Nature
389, 753758 (1997).
Shows structurally how agonists and antagonists
bind at the same site but with different binding
modes that result in different responses.
15. Roth, G.J. & Majerus, P.W. The mechanism of the
effect of aspirin on human platelets. I. Acetylation of a
particulate fraction protein. J.Clin. Invest. 56,
624632 (1975).
16. Majerus, P.W., Broze, G.J. Jr, Miletich, J.P. & Tollefsen,
D.M. in Goodman & Gilmans The pharmacological
basis of therapeutics. (eds Hardman, J. G. & Limbird, L.
E.)1353 (McGraw-Hill, New York, 1996).
17. Copeland, R.A., Pompliano, D.L. & Meek, T.D.
Drug-target residence time and its implications for
lead optimization. Nature Rev. Drug Discov. 5,
730739 (2006).
18. Timmino, P.J. & Copeland, R.A. Residence time of
receptorligand complexes and its effect on biological
function. Biochemistry 47, 54815492 (2008).
19. Lu, H. & Tonge, P.J. Drug-target residence time:
critical information for lead optimization. Curr. Opin.
Chem. Biol. 14, 18 (2010).
20. Johnson, D.S., Weerapana, E. & Cravatt, B.F.
Strategies for discovering and derisking covalent,
irreversible enzyme inhibitors. Future Med. Chem. 2,
949964 (2010).
21. Ohlson, S. Designing transient binding drugs: a new
concept for drug discovery. Drug Discov. Today 13,
433439 (2008).
22. Lipton, S.A. Paradigm shift in neuroprotection by
NMDA receptor blockade: Memantine and beyond.
Nature Rev. Drug Discov. 5, 160170 (2006).
23. Lipton, S.A. Pathology activated therapeutics for
neuroprotection. Nature Rev. Neurosci. 8, 803808
(2007).
Describes the principle that drugs should be
activated by the pathological state that they are
intended to inhibit.
24. Changeux, J.P. Allosteric receptors: from electric
organ to cognition. Annu. Rev. Pharmacol. Toxicol. 50,
138 (2010).
25. Conn, J.P., Christopoulos, A. & Lindsley, C.W.
Allosteric modulators of GPCRs: a novel approach for
the treatment of CNS disorders. Nature Rev. Drug
Discov. 8, 4154 (2009).
26. Hanck, D.A. etal. Using lidocaine and benzocaine to
link sodium channel molecular conformations to state-
dependent antiarrhythic drug affinity. Circ. Res. 105,
492499 (2009).
27. Butterworth, J.F. & Strichartz, G.R. Molecular
mechanisms of local anesthesia: a review.
Anesthesiology 72, 711734 (1990).
28. Wilson, D.N. etal. The oxazolidinone antibiotics
perturb the ribosomal peptidyl-transferase center and
effect tRNA positioning. Proc. Natl Acad. Sci. USA
105, 1333913344 (2008).
29. Nemeth, E.F. Misconceptions about calcimimetics.
Ann. NYAcad. Sci. 1068, 471476 (2006).
Discusses lessons learned in the discovery of
cinacalcet, with emphasis on the importance of
using an understanding of physiology.
30. Salisbury, B.G. etal. Hypocholesterolemic activity of a
novel inhibitor of cholesterol absorption, SCH 48461.
Athlerosclerosis 115, 4563 (1995).
31. Valentino, D. etal. A selective N-type calcium channel
antagonist protects against neuronal loss after global
cerebral ischemia. Proc. Natl Acad. Sci. USA 90,
78947897 (1993).
32. Newman, D.J. & Cragg, G.M. Natural products as
sources of new drugs over the last 25years. J.Nat.
Prod. 70, 461477 (2007).
Describes the successes of natural products as a
source for new drugs.
33. Deacon, C.F. Therapeutic strategies based on
glucagon-like peptide-1. Diabetes 53, 21812189
(2004).
34. Von Itzstein, M. etal. Rational design of potent
sialidase-based inhibitors of influenza virus
replication. Nature 363, 418423 (1993).
35. Weibel, E.K., Hadvary, P., Hochuli, E., Kupfer, E. &
Lengsfeld, H. Lipstatin, an inhibitor of pancreatic
lipase produced by Streptomyces toxytricini.
1. Producing organism, fermentation, isolation and
biological activity. J.Antibiot. 40, 10811086
(1987).
36. Kluter, D.J. New thrombopoietic growth factors.
Blood 109, 46074616 (2007).
37. Remuzzi, G. etal. New therapeutics that antagonize
endothelin: promises and frustrations. Nature Rev.
Drug Discov. 1, 9861001 (2002).
38. Wood, J.M. etal. Structure-based design of aliskiren,
a novel orally effective renin inhibitor. Biochem.
Biophys. Res. Commun. 308, 698705 (2003).
39. Pommier, Y. etal. Integrase inhibitors to treat HIV/
AIDS. Nature Rev. Drug Discov. 4, 236248 (2005).
40. Espeseth, A.S. etal. HIV-1 integrase inhibitors that
compete with the target DNA substrate define a
unique strand transfer conformation for integrase.
Proc. Natl Acad. Sci. USA 97, 1124411249
(2000).
41. Lichtner, R. B. etal. Signaling-inactive epidermal
growth factor receptor/ligand complexes in intact
carcinoma cells by quinazoline kinase inhibitors.
Cancer Res. 61, 57905795 (2001).
42. Barker, A.J. etal. Studies leading to the identification
of ZD1830 (Iressa
TM
): an orally active, selective
epidermal growth factor receptor tyrosine kinase
inhibitor targeted to the treatment of cancer. Bioorg.
Med. Chem. Lett. 11, 19111914 (2001).
43. Leader, B., Baca, Q.J. & Golan, D.E. Protein
therapeutics: a summary and pharmacological
classification. Nature Rev. Drug Discov. 7, 2139
(2008).
44. Wilhelm, S. etal. Discovery and development of
sorafenib: a multikinase inhibitor for treating cancer.
Nature Rev. Drug Discov 5, 835844 (2006).
45. Goke, R. etal. Exendin-4 is a high potency agonist and
truncated exendin-(939)-amide an antagonist at the
glucagon-like peptide 1-(736)-amide receptor of
insulin-secreting -cells. J.Biol. Chem. 268,
1965019655 (1993).
46. Alvaro, G. & Di Fabio, R. Neurokinin 1 receptor
antagonists current prospects.
Curr. Opin. Drug Discov. Dev. 10, 613621 (2007).
ANALYSI S
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | JULY 2011 | 517
nrd_3480_jul11.indd 517 22/06/2011 10:16
7PMPQYPWPENGCT
VCTIGVOGEJCPKUO
H
Docosunol
Lovoirucoum
Lubirosono
Nuoqlinido
Pomirolus
Punoluzino
Punumido
Sinocuocbins
Zonisumido
0CVWTG4GXKGYU&TWI&KUEQXGT[
1VJGTU G
Aminolovulinic
ucid
Duomycin
Nolurubino
Voroorn
#GEVVTCPURQTVGT
CEVXKV[
F
Lzoimibo
#GEVTGEGRVQTCEVKXKV[ D
Moduluo
rosonso
Ariiruzolo
Acivuo
rosonso
Cinuculco
Llrombouq
Pumoloon
Aroiun
8osonun
Conivuun
Muruviroc
lnbibi
rosonso
Turqo nuclour
rocoors
lulvosrun
Milorisono
#GEVKQP
EJCPPGNCEVKXKV[
E
Acumrosuo
Momunino
Vuroniclino
Ziconoido
#GEVGP\[OGCEVKXKV[ C
Azuciidino
Cilosuzol
londuurinux
Miqlusu
Niuzoxunido
Niisinono
Orlisu
Vorinosu
Obor onzymo
inbibiors
Cusolunqin
Linozolid
Puloqruvir
Pouumulin
Zunumivir
Microbiul
onzymo inbibiors
Suroorin
Lnzymo
colucor
Proouso
inbibiors
Alisliron
Siuqliin
8orozomib
Kinuso
inbibiors
Goinib
lmuinib
Sorulonib
Suniinib
Sirolimus
(desloratadine)
61
, antimuscarinics (tiotropium)
62
and angiotensin receptor blockers (candesartan)
63,64
.
Conversely, in drug classes with mechanism-based tox-
icity, MMOAs that increase the therapeutic index have
been identified, as illustrated by SERMs such as ralox-
ifene
14,65
. A decrease in the number of iterations required
to identify an optimal MMOA for first-in-class drugs
could accelerate lead discovery and reduce late-stage
attrition, thereby increasing R&D productivity.
With regard to the discovery of follower drugs, the
opposite trend was seen compared to first-in-class
drugs, with target-based approaches accounting for 83
(51%) of these NMEs and phenotypic-based approaches
accounting for 30 (18%) NMEs. The reversal of the
trend is presumably the result of drug developers tak-
ing advantage of knowledge of a previously identified
MMOA to effectively use target-based tools. The tim-
ing of the use of these tools may also be important. A
recent report by DiMasi and Faden
66
on follower drugs
shows that research on a large percentage of follower
drugs was initiated before first-in-class approval. The
authors
66
concluded that drug development can often
be characterized as a race in which several firms pursue
investigational drugs with similar chemical structures
or with the same mechanism of action before any drug
in the class obtains regulatory marketing approval.
That is, it appears that once a mechanism of action or
a chemical class with the potential to be developed into
a drug is discovered, multiple organizations within the
pharmaceutical industry may pursue it vigorously. In
drug discovery, this race may contribute to the escalat-
ing costs, as there is only room for a few drugs in a class.
Additionally, the analysis by DiMasi and Faden
66
only
captures the drug classes that have been approved; if
the costs for organizations involved in a race around a
hypothesis that was later proven to be incorrect are also
considered, the total costs could be substantially higher.
The increased reliance on hypothesis-driven target-
based approaches in drug discovery has coincided with
the sequencing of the human genome and an apparent
Figure 4 | Activities of first-in-class small-molecule new molecular entities. Nearly half (22 out of 50) of the
first-in-class small-molecule drugs that were approved between 1999 and 2008 affected enzyme activity (a). The
molecular mechanisms of action (MMOAs) of these drugs included reversible, irreversible, competitive and
noncompetitive inhibition, blocking activation and stabilizing the substrate. The next largest group of targets (10 drugs)
were receptors (b), most of which were G protein-coupled receptors. Their MMOAs included agonism, partial agonism,
antagonism and allosteric modulation. Two drugs fulvestrant and mifepristone targeted nuclear receptors. Four of
the drugs targeted ion channel activity (c); their MMOAs included uncompetitive antagonism and partial agonism. One
drug, ezetimibe, targeted the activity of a transporter (d). The remaining drugs had other activities (e), or unclear targets
or MMOAs (f). Of the NMEs with other activities, two had a unique MMOA: verteporfin, a porphyrin that catalyses the
generation of reactive oxygen species and is used for photodynamic therapy; and daptomycin, which has an MMOA that
involves disruption of bacterial membranes. For details of the discovery and activities of each drug, see Supplementary
information S2 (box). *Sirolimus binds to the protein FKBP12 and the sirolimusFKBP12 complex inhibits the kinase
activity of mammalian target of rapamycin, whereas the other four kinase inhibitors target receptor tyrosine kinases.
Bortezomib inhibits the 26S proteasome a multiprotein complex by inhibiting the chymotryptic-like activity of the
proteasome.
Milorisono
#GEVKQP
EJCPPGNCEVKXKV[
E
Acumrosuo
Momunino
Vuroniclino
Ziconoido
#GEVGP\[OGCEVKXKV[ C
Azuciidino
Cilosuzol
londuurinux
Miqlusu
Niuzoxunido
Niisinono
Orlisu
Vorinosu
Obor onzymo
inbibiors
Cusolunqin
Linozolid
Puloqruvir
Pouumulin
Zunumivir
Microbiul
onzymo inbibiors
Suroorin
Lnzymo
colucor
Proouso
inbibiors
Alisliron
Siuqliin
8orozomib
Kinuso
inbibiors
Goinib
lmuinib
Sorulonib
Suniinib
Sirolimus
(desloratadine)
61
, antimuscarinics (tiotropium)
62
and angiotensin receptor blockers (candesartan)
63,64
.
Conversely, in drug classes with mechanism-based tox-
icity, MMOAs that increase the therapeutic index have
been identified, as illustrated by SERMs such as ralox-
ifene
14,65
. A decrease in the number of iterations required
to identify an optimal MMOA for first-in-class drugs
could accelerate lead discovery and reduce late-stage
attrition, thereby increasing R&D productivity.
With regard to the discovery of follower drugs, the
opposite trend was seen compared to first-in-class
drugs, with target-based approaches accounting for 83
(51%) of these NMEs and phenotypic-based approaches
accounting for 30 (18%) NMEs. The reversal of the
trend is presumably the result of drug developers tak-
ing advantage of knowledge of a previously identified
MMOA to effectively use target-based tools. The tim-
ing of the use of these tools may also be important. A
recent report by DiMasi and Faden
66
on follower drugs
shows that research on a large percentage of follower
drugs was initiated before first-in-class approval. The
authors
66
concluded that drug development can often
be characterized as a race in which several firms pursue
investigational drugs with similar chemical structures
or with the same mechanism of action before any drug
in the class obtains regulatory marketing approval.
That is, it appears that once a mechanism of action or
a chemical class with the potential to be developed into
a drug is discovered, multiple organizations within the
pharmaceutical industry may pursue it vigorously. In
drug discovery, this race may contribute to the escalat-
ing costs, as there is only room for a few drugs in a class.
Additionally, the analysis by DiMasi and Faden
66
only
captures the drug classes that have been approved; if
the costs for organizations involved in a race around a
hypothesis that was later proven to be incorrect are also
considered, the total costs could be substantially higher.
The increased reliance on hypothesis-driven target-
based approaches in drug discovery has coincided with
the sequencing of the human genome and an apparent
Figure 4 | Activities of first-in-class small-molecule new molecular entities. Nearly half (22 out of 50) of the
first-in-class small-molecule drugs that were approved between 1999 and 2008 affected enzyme activity (a). The
molecular mechanisms of action (MMOAs) of these drugs included reversible, irreversible, competitive and
noncompetitive inhibition, blocking activation and stabilizing the substrate. The next largest group of targets (10 drugs)
were receptors (b), most of which were G protein-coupled receptors. Their MMOAs included agonism, partial agonism,
antagonism and allosteric modulation. Two drugs fulvestrant and mifepristone targeted nuclear receptors. Four of
the drugs targeted ion channel activity (c); their MMOAs included uncompetitive antagonism and partial agonism. One
drug, ezetimibe, targeted the activity of a transporter (d). The remaining drugs had other activities (e), or unclear targets
or MMOAs (f). Of the NMEs with other activities, two had a unique MMOA: verteporfin, a porphyrin that catalyses the
generation of reactive oxygen species and is used for photodynamic therapy; and daptomycin, which has an MMOA that
involves disruption of bacterial membranes. For details of the discovery and activities of each drug, see Supplementary
information S2 (box). *Sirolimus binds to the protein FKBP12 and the sirolimusFKBP12 complex inhibits the kinase
activity of mammalian target of rapamycin, whereas the other four kinase inhibitors target receptor tyrosine kinases.
Bortezomib inhibits the 26S proteasome a multiprotein complex by inhibiting the chymotryptic-like activity of the
proteasome.
S 1 Jun 2010
(26 May 2010)
raxibacumab PA-specific,
IgG1
Inhalation anthrax P, FT, O Under review by
the FDA
Belimumab B lymphocyte
stimulator-
specific, IgG1
Systemic lupus
erythematosus
P, FT Under review by
the FDA and the
eMA
Ipilimumab cTLA4-specific,
IgG1
Metastatic
melanoma
P, FT, O Under review by
the FDA and the
eMA
AA, accelerated approval; cTLA, cytotoxic T lymphocyte-associated antigen; eGFr, epidermal growth
factor receptor; eMA, european Medicines Agency; eU, european Union; FDA, US Food and Drug
Administration; FT, FDA fast track drug; Ig, immunoglobulin; IL, interleukin; mAb, monoclonal antibody;
O, FDA orphan drug; P, priority review; PA, Bacillus anthracis protective antigen; rANKL, receptor for
activation of nuclear factor-B ligand; S, standard review; TNF, tumour necrosis factor. *As of June 2010.
Also approved in europe for the treatment of bone loss in patients with prostate cancer undergoing
hormone ablation therapy.
PersPecti ves
NATUrE rEVIEWS | Drug Discovery VOlUME 9 | OCTOBEr 2010 | 771
nrd_3229_oct10.indd 771 17/9/10 11:50:14
Nature Reviews | Drug Discovery
N
u
m
b
e
r
o
f
c
l
i
n
i
c
a
l
c
a
n
d
i
d
a
t
e
s
150
90
100
110
120
130
140
80
70
60
50
40
30
20
10
0
1985 1987 1989 1991 1993 1995 1997 1999 2001 2003 2005 2007
All human mAbs
Antineoplastic only
Immunomodulatory only
Anti-infective only
Other indications
sponsoring a series of Phase II studies of
belimumab in rheumatoid arthritis, Sjgrens
syndrome, Waldenstroms disease and
pre-transplantation desensitization.
Ipilimumab is an immunostimulatory
mAb that targets cytotoxic T lymphocyte
antigen 4 (CTlA4). The candidate was
derived from Medarexs UltiMab transgenic
mouse technology and is under clinical
development by Bristol-Myers Squibb.
A marketing application was submitted
to the FDA and the European Medicines
Agency in June 2010 for the use of ipilimu-
mab as a second-line treatment for metastatic
melanoma. recent Phase III study results
indicate that ipilimumab alone or in
combination with a gp100 peptide vaccine
improved the overall survival of patients
with metastatic melanoma who had received
previous treatment
30
. Ipilimumab has been
evaluated in Phase II studies of non-small
cell lung cancer, breast cancer and prostate
cancer, as well as brain metastases. Bristol-
Myers Squibb is planning Phase III studies
of ipilimumab in non-small cell lung cancer
and in prostate cancer.
Approval success rates
Probabilities of success (POS) values, such
as cumulative approval in the United States
and transition rates between clinical phases,
have inherent limitations when the calcula-
tions involve cohorts with high percentages
of candidates in clinical study, as is the case
for human mAbs. Calculated values will vary
until fates for all candidates are known.
POS values for human mAbs that entered
clinical study after 1996 are preliminary
estimates because fates of only 31% of the
131 candidates are known (7 approved,
33 terminated), and only 20 reached
Phase III trials. In addition, the values are
likely to be underestimates because clinical
development of therapeutic mAbs takes an
average of approximately 6 years, and so the
human mAb candidates that entered clinical
study during the past 6 years have not had
sufficient time for approval.
Nevertheless, POS values are crucial for
the decision-making process used by inves-
tors, as well as for strategic planning by
the biopharmaceutical industry, and even
preliminary estimates can be useful. Based
on the current data, the cumulative approval
rate for human mAbs is 17.5%, which will
increase to 23% if raxibacumab, belimumab
and ipilimumab are approved. Transition
rates between clinical phases (which include
data for candidates currently in studies) for
the human mAbs were 89% for transitions
between Phase I to II; 51% for transitions
between Phase II to III; and 73% for transi-
tions between Phase III to approval by the
FDA (FIG. 3).
The cumulative approval success rate
for human mAbs is slightly higher than
the 15% value that we have calculated for
humanized mAbs, which first entered com-
mercial clinical development in 1988 (BOX 2).
As economic conditions, regulatory climate
and competitive landscape can change over
time, we also compared POS values for
human and humanized mAbs that entered
clinical development in the same period
(19972008). The cumulative approval
success rate was 17.5% for the human mAb
cohort (7 approvals per 40 candidates with
known fates) and 9% for the humanized
mAb cohort (5 approvals per 53 candidates
with known fates). Transition rates for
Phase I to II and Phase II to III were higher
for the human mAbs, but the Phase III
to approval rate was lower (FIG. 3). Final
fates were known for 31% and 40% of the
human and humanized mAbs developed in
this period, respectively, and the rates may
change as the final fates for more candidates
are determined.
Clinical indications
Primary therapeutic indications were
identified for the 131 human mAbs that
entered clinical study after 1996. Overall, most
mAb therapeutics, regardless of sequence
source, are developed as treatments for cancer
or immunological disorders
13
. This is also the
case for human mAbs, with 59 (45%) studied
for cancer and 36 (28%) for immunological
disorders. These proportions have remained
fairly constant since 1997 (FIG. 2).
Of the 59 antineoplastic mAbs, fates are
known for only 13 (22%): 2 are approved
products (panitumumab and ofatumumab)
and 11 candidates were terminated. The
cumulative approval success rate is 15%
based on currently available data. Most of
the 46 human antineoplastic mAbs that are
in clinical studies are at the early stages of
the process, with 5 in Phase III trials and 1
(ipilimumab) in regulatory review in the
United States and in the European Union.
Immunomodulatory human mAbs have
a higher cumulative approval success rate
(33%) than either the antineoplastic or the
Figure 2 | cumulative number of human mAbs entering clinical study between 1985 and 2008.
The primary therapeutic category for the development of human monoclonal antibodies (mAbs) that
entered clinical study sponsored by commercial firms between 1985 and 2008 was determined.
The cumulative numbers of human mAbs that entered development for antineoplastic, immuno-
modulatory, anti-infective and all other indications were tabulated. These data demonstrate the
rapid growth in human mAbs in clinical research generally, and the particularly high rates of develop-
ment of antineo plastic and immunomodulatory human mAbs.
PersPecti ves
770 | OCTOBEr 2010 | VOlUME 9 www.nature.com/reviews/drugdisc
nrd_3229_oct10.indd 770 17/9/10 11:50:13
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 41
overall human mAb cohort. This calculation
was based on data for only 12 molecules for
which definite fates are known, including
adalimumab, golimumab, canakinumab,
ustekinumab and 8 terminated candidates.
Of the 24 human immunomodulatory mAb
candidates currently in clinical development,
8 are in Phase I, 13 are in Phase II, 2 are in
Phase III and belimumab is undergoing
regulatory review in the United States and
in the European Union.
An additional 36 human mAbs that
entered clinical study after 1996 were
studied for non-traditional indications
that is, disorders that are not cancer or
immunological in nature. Half of these were
treatments for infectious diseases, with a
focus on nosocomial, anthrax and chronic
viral infections
31
. The remaining 18 candi-
dates were studied for conditions such as
osteoporosis, respiratory disorders, muscular
dystrophy, Alzheimers disease and pain.
Of the 36 candidates, 1 (denosumab) has
been approved, 1 (raxibacumab) is under-
going review by the FDA (TABLE 1) and 14
were terminated. The current cumulative
success rate for mAbs studied as treatments
for these non-traditional indications is 6.6%,
which will rise to 12.5% if raxibacumab is
approved for inhalation anthrax. The 20
candidates in clinical development were all
in either Phase I or II studies.
Molecular targets
The target of a therapeutic antibody is a
major determinant of its efficacy and safety
profile. Antigenic targets were identified
for 125 of the 131 human mAbs (TABLE 2).
These mAbs targeted a total of 89 unique
antigens, and only 22 antigens were targeted
by two or more human mAbs. Seven antigens
CTlA4, EGFr, fibronectin, insulin-like
growth factor 1 receptor (IGF1r), trans-
forming growth factor- (TGF), TNF and
TNF-related apoptosis-inducing ligand
receptor 2 (TrAIlr2) were targeted by
more than two human mAbs. Of the 125
mAbs, 55 (44%) targeted antigens that are
relevant to antineoplastic diseases, 36 (29%)
targeted antigens relevant to immunological
diseases and 17 (14%) targeted antigens
relevant to infectious diseases.
Of the 55 anticancer candidates with
known targets, 19 mAbs (33%) were
specific for only 5 targets: IGF1r (6 mAbs),
TrAIlr2 (4 mAbs), EGFr (3 mAbs),
CTlA4 (3 mAbs) and fibronectin (3 mAbs).
Of these, only EGFr was among the ten
most frequently targeted antigens for all
anticancer mAbs studied in the clinic from
1980 to 2005 (REF. 32), suggesting that devel-
opers of human mAbs may be focusing on
novel therapeutic strategies. Nevertheless,
at least some human mAbs share oncology
targets with therapeutic mAbs approved by
the FDA, including EGFr (target of panitu-
mumab and cetuximab) and CD20 (target of
rituximab, ibritumomab tiuxetan (Zevalin;
Spectrum Pharmaceuticals), iodine-131
tositumomab (Bexxar; GlaxoSmithKline)
and ofatumumab). Most of the anti-
neoplastic human mAbs target cell-surface
molecules; only two were known to target
soluble factors (hepatocyte growth factor
and platelet-derived growth factor).
By contrast, 24 out of the 36 immuno-
modulatory mAbs with known targets were
raised against cytokines and serum factors.
Interleukins constitute the largest target
group; targeted antigens include Il-1, Il-6,
Il-8, Il-12, Il-13, Il-15, Il-18, Il-17A and
Il-20. Ten out of the 36 mAbs target markers
of leukocyte activity and differentiation,
and are in early-phase clinical trials. Two
immunomodulatory human mAbs with
targets that are unique compared with those
of marketed mAbs are currently in Phase II
studies: briakinumab (developed by Abbott),
which targets the p40 subunit common to
Il-12 and Il-23, and AIN457 (developed by
Novartis), which is an Il-17A-specific mAb.
The 18 human mAbs intended for the
treatment of infectious diseases are a highly
heterogeneous group. Ten are directed
against targets implicated in viral infections,
including HIV (six mAbs), viral hepatitis
(three mAbs) and rabies (one mAb); several
of these candidates are cocktails of more
than one human mAb. Six human mAbs
target bacterial antigens, of which four are
bacterial cytotoxins, such as Clostridium
difficile enterotoxins (MK-3415A; developed
by Merck and Co.) and anthrax protective
antigen (raxibacumab), and three target
cellular features of Pseudomonas aeruginosa
Table 1 | Human mAbs approved or under FDA review*
Human mAb
(trade name;
company name)
Description indication of first
us approval
FDA
designations
Date of first us
(eu) approval
Adalimumab
(Humira; Abbott)
TNF-specific,
IgG1
rheumatoid arthritis S 31 Dec 2002
(8 Sep 2003)
Panitumumab
(vectibix; Amgen)
eGFr-specific,
IgG2
colorectal cancer P, FT, AA 27 Sep 2006
(3 Dec 2007)
Golimumab
(Simponi;
centocor)
TNF-specific,
IgG1
rheumatoid
arthritis, psoriatic
arthritis, ankylosing
spondylitis
S 24 Apr 2009
(1 Oct 2009)
canakinumab
(Ilaris; Novartis)
IL-1-specific,
IgG1
cryopyrin-
associated periodic
syndromes
P, O 18 Jun 2009
(23 Oct 2009)
Ustekinumab
(Stelara; Johnson
& Johnson)
IL-12/IL-23
p40-specific,
IgG1
Plaque psoriasis S 25 Sep 2009
(16 Jan 2009)
Ofatumumab
(Arzerra;
Genmab)
cD20-specific,
IgG1
chronic lymphocytic
leukaemia
P, FT 26 Oct 2009
(19 Apr 2010)
Denosumab
(Prolia; Amgen)
rANKL-
specific, IgG2
Treatment of
postmenopausal
osteoporosis
S 1 Jun 2010
(26 May 2010)
raxibacumab PA-specific,
IgG1
Inhalation anthrax P, FT, O Under review by
the FDA
Belimumab B lymphocyte
stimulator-
specific, IgG1
Systemic lupus
erythematosus
P, FT Under review by
the FDA and the
eMA
Ipilimumab cTLA4-specific,
IgG1
Metastatic
melanoma
P, FT, O Under review by
the FDA and the
eMA
AA, accelerated approval; cTLA, cytotoxic T lymphocyte-associated antigen; eGFr, epidermal growth
factor receptor; eMA, european Medicines Agency; eU, european Union; FDA, US Food and Drug
Administration; FT, FDA fast track drug; Ig, immunoglobulin; IL, interleukin; mAb, monoclonal antibody;
O, FDA orphan drug; P, priority review; PA, Bacillus anthracis protective antigen; rANKL, receptor for
activation of nuclear factor-B ligand; S, standard review; TNF, tumour necrosis factor. *As of June 2010.
Also approved in europe for the treatment of bone loss in patients with prostate cancer undergoing
hormone ablation therapy.
PersPecti ves
NATUrE rEVIEWS | Drug Discovery VOlUME 9 | OCTOBEr 2010 | 771
nrd_3229_oct10.indd 771 17/9/10 11:50:14
Nature Reviews | Drug Discovery
N
u
m
b
e
r
o
f
c
l
i
n
i
c
a
l
c
a
n
d
i
d
a
t
e
s
150
90
100
110
120
130
140
80
70
60
50
40
30
20
10
0
1985 1987 1989 1991 1993 1995 1997 1999 2001 2003 2005 2007
All human mAbs
Antineoplastic only
Immunomodulatory only
Anti-infective only
Other indications
sponsoring a series of Phase II studies of
belimumab in rheumatoid arthritis, Sjgrens
syndrome, Waldenstroms disease and
pre-transplantation desensitization.
Ipilimumab is an immunostimulatory
mAb that targets cytotoxic T lymphocyte
antigen 4 (CTlA4). The candidate was
derived from Medarexs UltiMab transgenic
mouse technology and is under clinical
development by Bristol-Myers Squibb.
A marketing application was submitted
to the FDA and the European Medicines
Agency in June 2010 for the use of ipilimu-
mab as a second-line treatment for metastatic
melanoma. recent Phase III study results
indicate that ipilimumab alone or in
combination with a gp100 peptide vaccine
improved the overall survival of patients
with metastatic melanoma who had received
previous treatment
30
. Ipilimumab has been
evaluated in Phase II studies of non-small
cell lung cancer, breast cancer and prostate
cancer, as well as brain metastases. Bristol-
Myers Squibb is planning Phase III studies
of ipilimumab in non-small cell lung cancer
and in prostate cancer.
Approval success rates
Probabilities of success (POS) values, such
as cumulative approval in the United States
and transition rates between clinical phases,
have inherent limitations when the calcula-
tions involve cohorts with high percentages
of candidates in clinical study, as is the case
for human mAbs. Calculated values will vary
until fates for all candidates are known.
POS values for human mAbs that entered
clinical study after 1996 are preliminary
estimates because fates of only 31% of the
131 candidates are known (7 approved,
33 terminated), and only 20 reached
Phase III trials. In addition, the values are
likely to be underestimates because clinical
development of therapeutic mAbs takes an
average of approximately 6 years, and so the
human mAb candidates that entered clinical
study during the past 6 years have not had
sufficient time for approval.
Nevertheless, POS values are crucial for
the decision-making process used by inves-
tors, as well as for strategic planning by
the biopharmaceutical industry, and even
preliminary estimates can be useful. Based
on the current data, the cumulative approval
rate for human mAbs is 17.5%, which will
increase to 23% if raxibacumab, belimumab
and ipilimumab are approved. Transition
rates between clinical phases (which include
data for candidates currently in studies) for
the human mAbs were 89% for transitions
between Phase I to II; 51% for transitions
between Phase II to III; and 73% for transi-
tions between Phase III to approval by the
FDA (FIG. 3).
The cumulative approval success rate
for human mAbs is slightly higher than
the 15% value that we have calculated for
humanized mAbs, which first entered com-
mercial clinical development in 1988 (BOX 2).
As economic conditions, regulatory climate
and competitive landscape can change over
time, we also compared POS values for
human and humanized mAbs that entered
clinical development in the same period
(19972008). The cumulative approval
success rate was 17.5% for the human mAb
cohort (7 approvals per 40 candidates with
known fates) and 9% for the humanized
mAb cohort (5 approvals per 53 candidates
with known fates). Transition rates for
Phase I to II and Phase II to III were higher
for the human mAbs, but the Phase III
to approval rate was lower (FIG. 3). Final
fates were known for 31% and 40% of the
human and humanized mAbs developed in
this period, respectively, and the rates may
change as the final fates for more candidates
are determined.
Clinical indications
Primary therapeutic indications were
identified for the 131 human mAbs that
entered clinical study after 1996. Overall, most
mAb therapeutics, regardless of sequence
source, are developed as treatments for cancer
or immunological disorders
13
. This is also the
case for human mAbs, with 59 (45%) studied
for cancer and 36 (28%) for immunological
disorders. These proportions have remained
fairly constant since 1997 (FIG. 2).
Of the 59 antineoplastic mAbs, fates are
known for only 13 (22%): 2 are approved
products (panitumumab and ofatumumab)
and 11 candidates were terminated. The
cumulative approval success rate is 15%
based on currently available data. Most of
the 46 human antineoplastic mAbs that are
in clinical studies are at the early stages of
the process, with 5 in Phase III trials and 1
(ipilimumab) in regulatory review in the
United States and in the European Union.
Immunomodulatory human mAbs have
a higher cumulative approval success rate
(33%) than either the antineoplastic or the
Figure 2 | cumulative number of human mAbs entering clinical study between 1985 and 2008.
The primary therapeutic category for the development of human monoclonal antibodies (mAbs) that
entered clinical study sponsored by commercial firms between 1985 and 2008 was determined.
The cumulative numbers of human mAbs that entered development for antineoplastic, immuno-
modulatory, anti-infective and all other indications were tabulated. These data demonstrate the
rapid growth in human mAbs in clinical research generally, and the particularly high rates of develop-
ment of antineo plastic and immunomodulatory human mAbs.
PersPecti ves
770 | OCTOBEr 2010 | VOlUME 9 www.nature.com/reviews/drugdisc
nrd_3229_oct10.indd 770 17/9/10 11:50:13
42 | OCTOBER 2011 | THE FUTURE OF DRUG INNOVATION | NATURE REPRINT COLLECTION www.nature.com/reprintcollections/lilly/drug-innovation
based on results for a small number of
candidates. This rate is lower than that
observed for all human mAbs (17.5%) and for
the transgenic-mouse-derived human mAbs
(29%); however, if raxibacumab and belimu-
mab are approved, the cumulative approval
success rate will increase to 30%. Human
mAbs derived from phage-display technol-
ogy have high Phase I to II and Phase II to III
transition rates, but the Phase III to approval
rate is currently 50% (FIG. 3).
None of the 35 mAbs known to be
derived from phage display was identified
as IgG2, which is an interesting observa-
tion given the diversity of phage-display
platforms. Of those with known isotypes,
20 were IgG1 and 9 were IgG4. Cambridge
Antibody Technology was responsible for
15 phage-display-derived human mAbs,
including adalimumab and four terminated
candidates; these therefore have a cumula-
tive success rate of 20% so far, which is
comparable to that of Medarex platform-
derived mAbs. Cambridge Antibody
Technology has also produced a substantial
number of IgG4 molecules (7 out of 9
IgG4 mAbs are known to be derived from
phage-display technology).
Conclusions
The acquisition of mAb technology com-
panies, including Abgenix, Cambridge
Antibody Technology and Medarex, by
major drug companies is an indication of
the pharmaceutical industrys increasing
interest in human mAb therapeutics.
Our analyses indicate that human mAbs
are a rich source of new therapeutics, with
7 approved in the United States, 3 under
review by the FDA, 7 in late-stage develop-
ment and 81 in early-stage development.
Although limited data are available, the cur-
rent POS rates for human mAbs are similar
or superior to those for current humanized
mAb candidates. The cumulative approval
success rate for human mAbs is currently
17.5%, although this could change substan-
tially in the coming years depending on the
fate of the high percentage of candidates
that are still in clinical study.
We found that human mAbs are primarily
in development for the treatment of cancer
and immunological disorders. The cumula-
tive approval rate for immunomodulatory
human mAbs (33%) is higher than that for
the antineoplastic (15%) candidates. This
difference is also observed when chimeric
and humanized therapeutic mAbs are con-
sidered
1
. The majority of human mAbs were
derived from transgenic mouse technolo-
gies and from phage-display technologies,
although human hybridoma and
transformed cells have also been used
to produce human mAbs.
The two transgenic mouse technologies
have so far generated six mAbs that gained
approval (29% POS) and one candidate that
is under review by the FDA. The hetero-
geneous mix of phage-display technologies
collectively have generated one marketed
product (12.5% POS) and two candidates
that are under review by the FDA. The
earliest transgenic-mouse-derived and
phage-display-derived human mAbs entered
clinical development in the same year, so
timing cannot account for the differences.
However, if raxibacumab, belimumab and
ipilimumab are approved, phage-display-
derived human mAbs will have demonstrated
preliminary POS rates comparable to
mouse-derived human mAbs (30% versus
32%, respectively). A potential disincentive
to the use of the transgenic mouse platform
is that the intellectual property is controlled
by only a few companies, and so access may
be costly. Phage-display technologies are
particularly advantageous when target
antigens are shared by humans and mice.
With the current trend towards devel-
oping targeted therapeutics, the focus on
human mAbs is likely to intensify owing
to a perceived low level of immunogenicity
of these agents (BOX 1). The pharmaceutical
and biotechnology industry, regulatory
agencies, physicians and patients have now
gained sufficient experience with mAbs
to view them as little different from any
other therapeutic. The data so far indicate
that mAbs derived from human sequences
by various technologies are effective in
addressing novel therapeutic targets, and
Table 2 | Antigenic targets of human mAbs in development*
Antigen Therapeutic category No. of human mAbs
Bacillus anthracis PA Infectious disease 2
cD30 cancer 2
cD40 cancer 2
Clostridium difficile enterotoxin Infectious disease 2
cTLA4 cancer 3
eGFr cancer 3
ePcAM cancer 2
Fibronectin cancer 3
GM-cSF Immunological disease 2
Her3 cancer 2
HIv gp41 Infectious disease 2
IGF1r cancer 6
IL-6 Immunological disease 2
IL-8 Immunological disease 2
IL-12 Immunological disease 2
Integrins Immunological disease 2
PDGF cancer, immunological disease 2
PSMA cancer 2
Tenascin cancer 2
TGF
Immunological, ophthalmic
and fibrotic diseases
3
TNF Immunological disease 3
TrAILr2 cancer 4
Unknown cancer, immunological disease 6
cTLA4, cytotoxic T lymphocyte-associated antigen 4; eGFr, epidermal growth factor receptor;
ePcAM, epithelial cell adhesion molecule; GM-cSF, granulocytemacrophage colony-stimulating factor;
gp, glycoprotein; Her3, human epidermal growth factor receptor 3 (also known as erBB3); IGF1r,
insulin-like growth factor 1 receptor; IL, interleukin; mAb, monoclonal antibody; PA, protective antigen;
PDGF, platelet-derived growth factor; PSMA, prostate-specific membrane antigen (also known as FOLH1);
TGF, transforming growth factor; TNF, tumour necrosis factor; TrAILr2, tumour necrosis factor-related
apoptosis-inducing ligand receptor 2 (also known as TNFrSF10B). *This table lists molecules that were
targets for a minimum of two human mAbs that entered clinical study between 1997 and 2008.
PersPecti ves
NATUrE rEVIEWS | Drug Discovery VOlUME 9 | OCTOBEr 2010 | 773
nrd_3229_oct10.indd 773 17/9/10 11:50:15
Nature Reviews | Drug Discovery
T
r
a
n
s
i
t
i
o
n
r
a
t
e
(
%
)
100
90
80
70
60
50
40
30
20
10
0
Phase III
US approval
Phase IIIII Phase III
80
89
87
94
47
51
60
73
86
73
86
50
Humanized, 19972008 (n = 133)
Human, 19972008 (n = 131)
Transgenic mouse (n = 56)
Display technology (n = 35)
(KB001; developed by Kalobios/Sanofi
Pasteur, and panobacumab; developed by
Kenta Biotech) and methicillin-resistant
Staphylococcus aureus (Aurograb; devel-
oped by Novartis). Finally, one human mAb
(efungumab; developed by Novartis) targets
candidal heat shock protein 90, an intra-
cellular antigen released during infection.
Platform technologies
We were able to identify the platform
technologies that were used to develop
103 (79%) of the 131 mAbs analysed. Despite
the availability of innovative approaches to
sample natural human immune responses
for the creation of mAbs
10
, most therapeutic
human mAbs in clinical study were derived
from either immunization of transgenic
mice expressing human antibody genes
or phage-display recombinants. The first
candidate molecules from both technolo-
gies entered clinical development in the late
1990s, so performance differences cannot
be attributed to time-dependent variables.
Use of transgenic mice expressing
human immunoglobulins avoids human
anti-mouse antibody responses and main-
tains the technical advantages of mouse
hybridomas. Of the 103 candidates from
identified platforms, 56 were produced
in transgenic mice; 6 were approved for
marketing (panitumumab, golimumab,
canakinumab, ustekinumab, ofatumumab
and denosumab), and 15 were terminated.
The current cumulative approval success
rate is therefore 29%, a higher rate than that
currently calculated for human mAbs as
a whole (17.5%). In particular, candidates
derived from transgenic mouse platforms
have considerably higher Phase II to III and
Phase III to approval transition rates than
those of the entire cohort of human mAbs
(FIG. 3). Again, it is important to note that
these rates will change to some extent over
time as fates for more human mAb candi-
dates are determined in the future. The two
primary technologies for generating human
mAbs from transgenic mice were first
described in 1994 (REFs 33,34) and use
two different engineering approaches to
inactivate endogenous mouse genes and
to insert exogenous human immunoglobulin
genes
35,36
.
A total of 34 human mAbs were identified
as being derived from Medarexs HuMAb,
UltiMab, TC Mouse or KM Mouse platforms.
Four of these candidates have been approved
(golimumab, canakinumab, ustekinumab
and ofatumumab), 1 (ipilimumab) is under
regulatory review, 7 were terminated and
22 are now in clinical studies (7 at Phase I,
14 at Phase II and 1 at Phase III). Although
immunoglobulin isotype was not known for
all the candidates, the majority of Medarex
platform-derived molecules were IgG1
(at least 21 mAbs). Of the total 34 mAbs,
16 (47%) were intended for the treatment
of cancer, 13 (38%) for immunological
conditions and 3 (9%) were anti-infective
agents.
The XenoMouse platform developed by
Abgenix, which was acquired by Amgen
in 2005, was used for the development of
at least 18 human mAbs. Two (panitumu-
mab and denosumab) are approved, nine
are in clinical study (two at Phase II, five
at Phase II and two at Phase III) and seven
are discontinued. Most of the XenoMouse-
derived candidates were IgG2 (11 mAbs),
four were IgG1, one was IgG4 and two were
of unknown isotype. Two-thirds of the mAbs
were cancer treatments; only two (11%) were
for immunological conditions and one (6%)
was an anti-infective agent.
Other transgenic mouse-based platforms,
such as regenerons VelocImmune and XTl
Biopharmaceuticals Trimera, have each
yielded at least one early-stage candidate.
A second popular approach for producing
human mAbs is the recombinant expression
of human antigen-binding fragments in a
bacteriophage and subsequent selection is
based on desirable antigen-binding proper-
ties
3739
. This technology was used to create
at least 35 human mAbs that entered clinical
development. Unlike transgenic mouse
technologies, phage-display is used
by numerous companies, including
MedImmune Cambridge (formerly
Cambridge Antibody Technology), Dyax,
MorphoSys, BioInvent and NeuTec.
One phage-display-derived mAb
(adalimumab) has been approved, and two
(raxibacumab and belimumab) are under
review by the FDA. In addition, 3 phage-
display-derived mAb candidates are in
Phase I, 19 are in Phase II and 3 are in Phase
III. So far, development of seven mAbs has
been discontinued. The current cumulative
approval success rate for all phage-display-
based technologies is 12.5%, although this is
Figure 3 | Transition rates between clinical
phases for human mAbs. The historical rates
of transition from Phase I to II, Phase II to III and
Phase III to review by the US Food and Drug
Administration are depicted. The review to
approval rate was 100% for all human mono-
clonal antibodies (mAbs) in the categories
presented. Data for human mAbs derived from
transgenic mouse and display technologies
are shown separately and data for humanized
mAbs are included for comparison.
glossary
Allotype
Antibody allotypes are defined by their polymorphism
within the immunoglobulin heavy and light chains. Natural
allelic genetic variation in the constant region of genes
in humans may predispose a given patient to anti-drug
antibody responses if the drug is a foreign allotype.
Ankylosing spondylitis
A chronic condition of unknown aetiology that is
characterized by inflammation of the joints of the spine
and pelvis. Disease progression may result in fusion of
the joints.
Anti-idiotypic antibody
An antibody that targets the hypervariable antigen-binding
domain of an exogenous immunoglobulin, including
therapeutic monoclonal antibodies. As the constant regions
are fairly conserved, with the exception of allotypic
differences, many anti-immunoglobulin responses will be
directed against the highly variable, antigen-binding domain.
Cryopyrin-associated periodic syndromes
(CAPs). A group of rare, inherited autoimmune disorders
associated with over-secretion of interleukin-1 that may
cause inflammation of the skin, eyes, bones, joints and
meninges.
Phage-display technologies
A method involving the use of bacteriophages to select
desirable antibody variable domains based on their
binding properties.
Pre-transplant desensitization
In the recipient patient, reduction of antibody-
producing cells or the amount of circulating antibodies
that might target foreign tissue prior to transplantation
of an organ.
Systemic lupus erythematosus
A chronic, inflammatory autoimmune disease affecting
connective tissue throughout the body.
glossary
Glossary head
Glossary body
Glossary head
Glossary body
Glossary head
Glossary body
Glossary head
Glossary body
Glossary head
Glossary body
PersPecti ves
772 | OCTOBEr 2010 | VOlUME 9 www.nature.com/reviews/drugdisc
nrd_3229_oct10.indd 772 17/9/10 11:50:14
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 43
based on results for a small number of
candidates. This rate is lower than that
observed for all human mAbs (17.5%) and for
the transgenic-mouse-derived human mAbs
(29%); however, if raxibacumab and belimu-
mab are approved, the cumulative approval
success rate will increase to 30%. Human
mAbs derived from phage-display technol-
ogy have high Phase I to II and Phase II to III
transition rates, but the Phase III to approval
rate is currently 50% (FIG. 3).
None of the 35 mAbs known to be
derived from phage display was identified
as IgG2, which is an interesting observa-
tion given the diversity of phage-display
platforms. Of those with known isotypes,
20 were IgG1 and 9 were IgG4. Cambridge
Antibody Technology was responsible for
15 phage-display-derived human mAbs,
including adalimumab and four terminated
candidates; these therefore have a cumula-
tive success rate of 20% so far, which is
comparable to that of Medarex platform-
derived mAbs. Cambridge Antibody
Technology has also produced a substantial
number of IgG4 molecules (7 out of 9
IgG4 mAbs are known to be derived from
phage-display technology).
Conclusions
The acquisition of mAb technology com-
panies, including Abgenix, Cambridge
Antibody Technology and Medarex, by
major drug companies is an indication of
the pharmaceutical industrys increasing
interest in human mAb therapeutics.
Our analyses indicate that human mAbs
are a rich source of new therapeutics, with
7 approved in the United States, 3 under
review by the FDA, 7 in late-stage develop-
ment and 81 in early-stage development.
Although limited data are available, the cur-
rent POS rates for human mAbs are similar
or superior to those for current humanized
mAb candidates. The cumulative approval
success rate for human mAbs is currently
17.5%, although this could change substan-
tially in the coming years depending on the
fate of the high percentage of candidates
that are still in clinical study.
We found that human mAbs are primarily
in development for the treatment of cancer
and immunological disorders. The cumula-
tive approval rate for immunomodulatory
human mAbs (33%) is higher than that for
the antineoplastic (15%) candidates. This
difference is also observed when chimeric
and humanized therapeutic mAbs are con-
sidered
1
. The majority of human mAbs were
derived from transgenic mouse technolo-
gies and from phage-display technologies,
although human hybridoma and
transformed cells have also been used
to produce human mAbs.
The two transgenic mouse technologies
have so far generated six mAbs that gained
approval (29% POS) and one candidate that
is under review by the FDA. The hetero-
geneous mix of phage-display technologies
collectively have generated one marketed
product (12.5% POS) and two candidates
that are under review by the FDA. The
earliest transgenic-mouse-derived and
phage-display-derived human mAbs entered
clinical development in the same year, so
timing cannot account for the differences.
However, if raxibacumab, belimumab and
ipilimumab are approved, phage-display-
derived human mAbs will have demonstrated
preliminary POS rates comparable to
mouse-derived human mAbs (30% versus
32%, respectively). A potential disincentive
to the use of the transgenic mouse platform
is that the intellectual property is controlled
by only a few companies, and so access may
be costly. Phage-display technologies are
particularly advantageous when target
antigens are shared by humans and mice.
With the current trend towards devel-
oping targeted therapeutics, the focus on
human mAbs is likely to intensify owing
to a perceived low level of immunogenicity
of these agents (BOX 1). The pharmaceutical
and biotechnology industry, regulatory
agencies, physicians and patients have now
gained sufficient experience with mAbs
to view them as little different from any
other therapeutic. The data so far indicate
that mAbs derived from human sequences
by various technologies are effective in
addressing novel therapeutic targets, and
Table 2 | Antigenic targets of human mAbs in development*
Antigen Therapeutic category No. of human mAbs
Bacillus anthracis PA Infectious disease 2
cD30 cancer 2
cD40 cancer 2
Clostridium difficile enterotoxin Infectious disease 2
cTLA4 cancer 3
eGFr cancer 3
ePcAM cancer 2
Fibronectin cancer 3
GM-cSF Immunological disease 2
Her3 cancer 2
HIv gp41 Infectious disease 2
IGF1r cancer 6
IL-6 Immunological disease 2
IL-8 Immunological disease 2
IL-12 Immunological disease 2
Integrins Immunological disease 2
PDGF cancer, immunological disease 2
PSMA cancer 2
Tenascin cancer 2
TGF
Immunological, ophthalmic
and fibrotic diseases
3
TNF Immunological disease 3
TrAILr2 cancer 4
Unknown cancer, immunological disease 6
cTLA4, cytotoxic T lymphocyte-associated antigen 4; eGFr, epidermal growth factor receptor;
ePcAM, epithelial cell adhesion molecule; GM-cSF, granulocytemacrophage colony-stimulating factor;
gp, glycoprotein; Her3, human epidermal growth factor receptor 3 (also known as erBB3); IGF1r,
insulin-like growth factor 1 receptor; IL, interleukin; mAb, monoclonal antibody; PA, protective antigen;
PDGF, platelet-derived growth factor; PSMA, prostate-specific membrane antigen (also known as FOLH1);
TGF, transforming growth factor; TNF, tumour necrosis factor; TrAILr2, tumour necrosis factor-related
apoptosis-inducing ligand receptor 2 (also known as TNFrSF10B). *This table lists molecules that were
targets for a minimum of two human mAbs that entered clinical study between 1997 and 2008.
PersPecti ves
NATUrE rEVIEWS | Drug Discovery VOlUME 9 | OCTOBEr 2010 | 773
nrd_3229_oct10.indd 773 17/9/10 11:50:15
Nature Reviews | Drug Discovery
T
r
a
n
s
i
t
i
o
n
r
a
t
e
(
%
)
100
90
80
70
60
50
40
30
20
10
0
Phase III
US approval
Phase IIIII Phase III
80
89
87
94
47
51
60
73
86
73
86
50
Humanized, 19972008 (n = 133)
Human, 19972008 (n = 131)
Transgenic mouse (n = 56)
Display technology (n = 35)
(KB001; developed by Kalobios/Sanofi
Pasteur, and panobacumab; developed by
Kenta Biotech) and methicillin-resistant
Staphylococcus aureus (Aurograb; devel-
oped by Novartis). Finally, one human mAb
(efungumab; developed by Novartis) targets
candidal heat shock protein 90, an intra-
cellular antigen released during infection.
Platform technologies
We were able to identify the platform
technologies that were used to develop
103 (79%) of the 131 mAbs analysed. Despite
the availability of innovative approaches to
sample natural human immune responses
for the creation of mAbs
10
, most therapeutic
human mAbs in clinical study were derived
from either immunization of transgenic
mice expressing human antibody genes
or phage-display recombinants. The first
candidate molecules from both technolo-
gies entered clinical development in the late
1990s, so performance differences cannot
be attributed to time-dependent variables.
Use of transgenic mice expressing
human immunoglobulins avoids human
anti-mouse antibody responses and main-
tains the technical advantages of mouse
hybridomas. Of the 103 candidates from
identified platforms, 56 were produced
in transgenic mice; 6 were approved for
marketing (panitumumab, golimumab,
canakinumab, ustekinumab, ofatumumab
and denosumab), and 15 were terminated.
The current cumulative approval success
rate is therefore 29%, a higher rate than that
currently calculated for human mAbs as
a whole (17.5%). In particular, candidates
derived from transgenic mouse platforms
have considerably higher Phase II to III and
Phase III to approval transition rates than
those of the entire cohort of human mAbs
(FIG. 3). Again, it is important to note that
these rates will change to some extent over
time as fates for more human mAb candi-
dates are determined in the future. The two
primary technologies for generating human
mAbs from transgenic mice were first
described in 1994 (REFs 33,34) and use
two different engineering approaches to
inactivate endogenous mouse genes and
to insert exogenous human immunoglobulin
genes
35,36
.
A total of 34 human mAbs were identified
as being derived from Medarexs HuMAb,
UltiMab, TC Mouse or KM Mouse platforms.
Four of these candidates have been approved
(golimumab, canakinumab, ustekinumab
and ofatumumab), 1 (ipilimumab) is under
regulatory review, 7 were terminated and
22 are now in clinical studies (7 at Phase I,
14 at Phase II and 1 at Phase III). Although
immunoglobulin isotype was not known for
all the candidates, the majority of Medarex
platform-derived molecules were IgG1
(at least 21 mAbs). Of the total 34 mAbs,
16 (47%) were intended for the treatment
of cancer, 13 (38%) for immunological
conditions and 3 (9%) were anti-infective
agents.
The XenoMouse platform developed by
Abgenix, which was acquired by Amgen
in 2005, was used for the development of
at least 18 human mAbs. Two (panitumu-
mab and denosumab) are approved, nine
are in clinical study (two at Phase II, five
at Phase II and two at Phase III) and seven
are discontinued. Most of the XenoMouse-
derived candidates were IgG2 (11 mAbs),
four were IgG1, one was IgG4 and two were
of unknown isotype. Two-thirds of the mAbs
were cancer treatments; only two (11%) were
for immunological conditions and one (6%)
was an anti-infective agent.
Other transgenic mouse-based platforms,
such as regenerons VelocImmune and XTl
Biopharmaceuticals Trimera, have each
yielded at least one early-stage candidate.
A second popular approach for producing
human mAbs is the recombinant expression
of human antigen-binding fragments in a
bacteriophage and subsequent selection is
based on desirable antigen-binding proper-
ties
3739
. This technology was used to create
at least 35 human mAbs that entered clinical
development. Unlike transgenic mouse
technologies, phage-display is used
by numerous companies, including
MedImmune Cambridge (formerly
Cambridge Antibody Technology), Dyax,
MorphoSys, BioInvent and NeuTec.
One phage-display-derived mAb
(adalimumab) has been approved, and two
(raxibacumab and belimumab) are under
review by the FDA. In addition, 3 phage-
display-derived mAb candidates are in
Phase I, 19 are in Phase II and 3 are in Phase
III. So far, development of seven mAbs has
been discontinued. The current cumulative
approval success rate for all phage-display-
based technologies is 12.5%, although this is
Figure 3 | Transition rates between clinical
phases for human mAbs. The historical rates
of transition from Phase I to II, Phase II to III and
Phase III to review by the US Food and Drug
Administration are depicted. The review to
approval rate was 100% for all human mono-
clonal antibodies (mAbs) in the categories
presented. Data for human mAbs derived from
transgenic mouse and display technologies
are shown separately and data for humanized
mAbs are included for comparison.
glossary
Allotype
Antibody allotypes are defined by their polymorphism
within the immunoglobulin heavy and light chains. Natural
allelic genetic variation in the constant region of genes
in humans may predispose a given patient to anti-drug
antibody responses if the drug is a foreign allotype.
Ankylosing spondylitis
A chronic condition of unknown aetiology that is
characterized by inflammation of the joints of the spine
and pelvis. Disease progression may result in fusion of
the joints.
Anti-idiotypic antibody
An antibody that targets the hypervariable antigen-binding
domain of an exogenous immunoglobulin, including
therapeutic monoclonal antibodies. As the constant regions
are fairly conserved, with the exception of allotypic
differences, many anti-immunoglobulin responses will be
directed against the highly variable, antigen-binding domain.
Cryopyrin-associated periodic syndromes
(CAPs). A group of rare, inherited autoimmune disorders
associated with over-secretion of interleukin-1 that may
cause inflammation of the skin, eyes, bones, joints and
meninges.
Phage-display technologies
A method involving the use of bacteriophages to select
desirable antibody variable domains based on their
binding properties.
Pre-transplant desensitization
In the recipient patient, reduction of antibody-
producing cells or the amount of circulating antibodies
that might target foreign tissue prior to transplantation
of an organ.
Systemic lupus erythematosus
A chronic, inflammatory autoimmune disease affecting
connective tissue throughout the body.
glossary
Glossary head
Glossary body
Glossary head
Glossary body
Glossary head
Glossary body
Glossary head
Glossary body
Glossary head
Glossary body
PersPecti ves
772 | OCTOBEr 2010 | VOlUME 9 www.nature.com/reviews/drugdisc
nrd_3229_oct10.indd 772 17/9/10 11:50:14
44 | OCTOBER 2011 | THE FUTURE OF DRUG INNOVATION | NATURE REPRINT COLLECTION www.nature.com/reprintcollections/lilly/drug-innovation
If it were not for the great variability
among individuals, medicine might
as well be a science and not an art.
Sir William Osler, 1892
Patients and society expect that the benefits
of licensed drugs will outweigh their risks.
Drug regulations in all major jurisdictions
are aiming to ensure a positive benefitrisk
balance. However, regulatory decisions are
based on population-level information, with
an understanding that the benefitrisk will
not necessarily be positive for all treated
patients. Patients are not equally responsive
to beneficial effects, and not equally sus-
ceptible to adverse effects. Drug developers,
drug regulators and health-care profession-
als have been aware of patient heterogeneity
and that one size doesnt fit all. Regulators
attempt to direct prescribers to appropri-
ate patient subpopulations and treatment
scenarios, whereas health-care professionals
aim to tailor drug regimens to their indi-
vidual patients, often based on phenotypic
markers that are expected to influence a
drugs pharmacokinetics or pharmacody-
namics such as creatinine clearance, disease
stage or comorbidities. In some cases, pre-
scribers can tailor doses to individuals by
titrating to their response to thedrug.
In spite of such efforts, drugs often do
not perform as well in clinical practice as in
the clinical trials that provide the basis for
marketing authorization. This difference
in benefitrisk has been termed the effi-
cacyeffectiveness gap, in which efficacy is
defined as the extent to which an interven-
tion does more good than harm under ideal
circumstances (that is, under clinical trial
conditions), whereas effectiveness is the
extent to which an intervention does more
good than harm when provided under the
usual circumstances of health care practice
(REF.1). Others have referred to efficacy as
can it work? and effectiveness as does it
work? (REF.2).
There have been several instances in
which the quality of prescription drugs dif-
fered markedly between the clinical trial
medicine assessed by regulators and that
being marketed. For example, some marketed
heparin products became contaminated with
oversulphated chondroitin sulphate
3
, and the
benefitrisk of nelfinavir (Viracept; Pfizer)
came under intense scrutiny when batches
of the medicine became contaminated with a
known genotoxic substance
4
. However, cases
in which pharmaceutical quality issues give
rise to differences between efficacy and effec-
tiveness are rare and represent a distinct set
of regulatory problems; therefore they are not
further discussedhere.
Another reason for an apparent difference
between efficacy and effectiveness may be the
inadequate follow up of minor safety signals
that arise during pre-licensing develop-
ment. We re-emphasise the responsibility of
manufacturers and regulators to ensure thor-
ough post-licensing investigation of safety
signals; it is hoped that the introduction
of Risk Management Plans (RMPs) in the
European Union (EU) and Risk Evaluation
and Mitigation Strategies (REMSs) in the
United States a few years ago may success-
fully address this important issue
5
. However,
in this Opinion article we argue that the
efficacyeffectiveness gap is, in most cases, a
problem of variability in drug response. We
describe biological and behavioural sources
of variability. We then summarize current
attempts to bridge the efficacyeffectiveness
gap by reducing variability. Finally, we specu-
late on new opportunities and technologies
in this area and what regulators can do to
advance the best use ofdrugs.
Variability and treatment scenarios
We observe that over the past decade there
were few, if any, drugs that came under close
scrutiny for their benefitrisk profile or
that had to be withdrawn from the market
OPI NI ON
Bridging the efficacyeffectiveness
gap: a regulators perspective
on addressing variability of drug
response
Hans-Georg Eichler, Eric Abadie, Alasdair Breckenridge, Bruno Flamion,
Lars L.Gustafsson, Hubert Leufkens, Malcolm Rowland, Christian K.Schneider
and Brigitte Bloechl-Daum
Abstract | Drug regulatory agencies should ensure that the benefits of drugs
outweigh their risks, but licensed medicines sometimes do not perform as
expected in everyday clinical practice. Failure may relate to lower than anticipated
efficacy or a higher than anticipated incidence or severity of adverse effects. Here
we show that the problem of benefitrisk is to a considerable degree a problem of
variability in drug response. We describe biological and behavioural sources of
variability and how these contribute to the long-known efficacyeffectiveness gap.
In this context, efficacy describes how a drug performs under conditions of clinical
trials, whereas effectiveness describes how it performs under conditions of
everyday clinical practice. We argue that a broad range of pre- and post-licensing
technologies will need to be harnessed to bridge the efficacyeffectiveness gap.
Successful approaches will not be limited to the current notion of pharmaco-
genomics-based personalized medicines, but will also entail the wider use of
electronic health-care tools to improve drug prescribing and patient adherence.
PERSPECTIVES
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | JULY 2011 | 495
nrd_3501_jul11.indd 495 20/06/2011 16:34
are likely to be less immunogenic than those
with rodent-derived sequences. There is
considerable unmet medical need in the
three main areas of study for investigational
human mAbs cancer, immunological and
infectious diseases and these emerging
agents could therefore provide valuable new
treatment options.
Aaron L. Nelson was previously at the Tufts University
School of Medicine, Boston, Massachusetts 02118, USA.
Present address: Novartis Institutes for Biomedical
Research, Room 7226, 7th floor, 300 Technology
Square, Cambridge, Massachusetts 02139, USA.
Eugen Dhimolea is at the Tufts University
School of Medicine, 136 Harrison Avenue, Boston,
Massachusetts 02111, USA.
Janice M. Reichert is at the Tufts Center for the Study
of Drug Development, Suite 1100, 75 Kneeland Street,
Boston, Massachusetts 02111, USA.
Correspondence to J.M.R.
email: janice.reichert@tufts.edu
doi:10.1038/nrd3229
Published online 3 september 2010
1. Reichert, J. M. Monoclonal antibodies as innovative
therapeutics. Curr. Pharm. Biotechnol. 9, 423430
(2008).
2. Reichert, J. M., Rosensweig, C. J., Faden, L. B. &
Dewitz, M. C. Monoclonal antibody successes in the
clinic. Nature Biotech. 23, 10731078 (2005).
3. Reichert, J. M. Antibodies to watch in 2010. MAbs
2, 84100 (2010).
4. James, K. & Bell, G. T. Human monoclonal antibody
production. Current status and future prospects.
J. Immunol. Methods 100, 540 (1987).
5. Olsson, L. & Kaplan, H. S. Humanhuman hybridomas
producing monoclonal antibodies of predefined
antigenic specificity. Proc. Natl Acad. Sci. USA 77,
54295431 (1980).
6. Shoenfeld, Y. et al. Production of autoantibodies
by humanhuman hybridomas. J. Clin. Invest. 70,
205208 (1982).
7. Olsson, L. et al. Antibody producing humanhuman
hybridomas. II. Derivation and characterization
of an antibody specific for human leukemia cells.
J. Exp. Med. 159, 537550 (1984).
8. Kozbor, D. & Roder, J. C. Requirements for the
establishment of high-titered human monoclonal
antibodies against tetanus toxoid using the
EpsteinBarr virus technique. J. Immunol. 127,
12751280 (1981).
9. Kozbor, D., Lagarde, A. E. & Roder, J. C.
Human hybridomas constructed with antigen-specific
EpsteinBarr virus-transformed cell lines. Proc. Natl
Acad. Sci. USA 79, 66516655 (1982).
10. Beerli, R. R. & Rader, C. Mining human antibody
repertoires. MAbs 2, 361374 (2010).
11. Teng, N. N. et al. Protection against Gram-negative
bacteremia and endotoxemia with human
monoclonal IgM antibodies. Proc. Natl Acad. Sci.
USA 82, 17901794 (1985).
12. Ziegler, E. J. et al. Treatment of Gram-negative
bacteremia and septic shock with HA-1A human
monoclonal antibody against endotoxin. A
randomized, double-blind, placebo-controlled trial.
The HA-1A Sepsis Study Group. N. Engl. J. Med.
324, 429436 (1991).
13. Cross, A. S. Antiendotoxin antibodies: a dead end?
Ann. Intern. Med. 121, 5860 (1994).
14. Luce, J. M. Introduction of new technology into critical
care practice: a history of HA-1A human monoclonal
antibody against endotoxin. Crit. Care Med. 21,
12331241 (1993).
15. McCloskey, R. V., Straube, R. C., Sanders, C.,
Smith, S. M. & Smith, C. R. Treatment of septic shock
with human monoclonal antibody HA-1A. A
randomized, double-blind, placebo-controlled trial.
CHESS Trial Study Group. Ann. Intern. Med. 121, 15
(1994).
16. Abbott. Abbott Annual Report 2008. Abbott website
[online], http://www.abbott.com/static/content/microsite/
annual_report/2008/16_review1.html (2008).
17. US Food and Drug Administration. Vectibix
Panitumumab Injectable. Application No.: 125147.
Medical Review(s). FDA website [online],
http://www.accessdata.fda.gov/drugsatfda_docs/
nda/2006/125147s0000_MedR.pdf (2006).
18. Van Cutsem, E. et al. Open-label phase III trial of
panitumumab plus best supportive care compared
with best supportive care alone in patients with
chemotherapy-refractory metastatic colorectal cancer.
J. Clin. Oncol. 25, 16581664 (2007).
19. Mazumdar, S. & Greenwald, D. Golimumab. MAbs
1, 422431 (2009).
20. Lachmann, H. J. et al. Use of canakinumab in the
cryopyrin-associated periodic syndrome. N. Engl.
J. Med. 360, 24162425 (2009).
21. Dhimolea, E. Canakinumab. MAbs 2, 313 (2010).
22. Cingoz, O. Ustekinumab. MAbs 1, 216221 (2009).
23. Teeling, J. L. et al. The biological activity of human
CD20 monoclonal antibodies is linked to unique
epitopes on CD20. J. Immunol. 177, 362371 (2006).
24. Glennie, M. J., French, R. R., Cragg, M. S. & Taylor, R. P.
Mechanisms of killing by anti-CD20 monoclonal
antibodies. Mol. Immunol. 44, 38233837 (2007).
25. Zhang, B. Ofatumumab. MAbs 1, 326331 (2009).
26. Pageau, S. C. Denosumab. MAbs 1, 210215 (2009).
27. Mazumdar, S. Raxibacumab. MAbs 1, 531538
(2009).
28. DallEra, M. & Wofsy, D. Connective tissue diseases:
belimumab for systemic lupus erythematosus: breaking
through? Nature Rev. Rheumatol. 6, 124125 (2010).
29. Wallace, D. J. et al. A phase II, randomized, double-
blind, placebo-controlled, dose-ranging study of
belimumab in patients with active systemic lupus
erythematosus. Arthritis Rheum. 61, 11681178
(2009).
30. Hodi, F. S. et al. Improved survival with ipilimumab in
patients with metastatic melanoma. N. Engl. J. Med.
363, 711723 (2010).
31. Reichert, J. M. & Dewitz, M. C. Anti-infective
monoclonal antibodies: perils and promise of
development. Nature Rev. Drug Discov. 5, 191195
(2006).
32. Reichert, J. M. & Valge-Archer, V. E. Development
trends for monoclonal antibody cancer therapeutics.
Nature Rev. Drug Discov. 6, 349356 (2007).
33. Green, L. L. et al. Antigen-specific human monoclonal
antibodies from mice engineered with human Ig
heavy and light chain YACs. Nature Genet. 7, 1321
(1994).
34. Lonberg, N. et al. Antigen-specific human antibodies
from mice comprising four distinct genetic
modifications. Nature 368, 856859 (1994).
35. Green, L. L. Antibody engineering via genetic
engineering of the mouse: XenoMouse strains are a
vehicle for the facile generation of therapeutic human
monoclonal antibodies. J. Immunol. Methods 231,
1123 (1999).
36. Lonberg, N. Human antibodies from transgenic
animals. Nature Biotech. 23, 11171125 (2005).
37. McCafferty, J., Griffiths, A. D., Winter, G. & Chiswell,
D. J. Phage antibodies: filamentous phage displaying
antibody variable domains. Nature 348, 552554
(1990).
38. Vaughan, T. J. et al. Human antibodies with
sub-nanomolar affinities isolated from a large
non-immunized phage display library. Nature Biotech.
14, 309314 (1996).
39. Clackson, T., Hoogenboom, H. R., Griffiths, A. D. &
Winter, G. Making antibody fragments using phage
display libraries. Nature 352, 624628 (1991).
40. Chirino, A. J., Ary, M. L. & Marshall, S. A.
Minimizing the immunogenicity of protein
therapeutics. Drug Discov. Today 9, 8290 (2004).
41. Baert, F. et al. Influence of immunogenicity on the
long-term efficacy of infliximab in Crohns disease.
N. Engl. J. Med. 348, 601608 (2003).
42. De Groot, A. S. & Scott, D. W. Immunogenicity of
protein therapeutics. Trends Immunol. 28, 482490
(2007).
43. Bartelds, G. M. et al. Clinical response to
adalimumab: relationship to anti-adalimumab
antibodies and serum adalimumab concentrations in
rheumatoid arthritis. Ann. Rheum. Dis. 66, 921926
(2007).
44. Bender, N. K. et al. Immunogenicity, efficacy and
adverse events of adalimumab in RA patients.
Rheumatol. Int. 27, 269274 (2007).
45. Hwang, W. Y. & Foote, J. Immunogenicity of
engineered antibodies. Methods 36, 310 (2005).
46. Saif, M. W. & Cohenuram, M. Role of panitumumab
in the management of metastatic colorectal cancer.
Clin. Colorectal Cancer 6, 118124 (2006).
47. Saif, M. W., Peccerillo, J. & Potter, V. Successful
re-challenge with panitumumab in patients who
developed hypersensitivity reactions to cetuximab:
report of three cases and review of literature.
Cancer Chemother. Pharmacol. 63, 10171022
(2009).
48. Chung, C. H. et al. Cetuximab-induced anaphylaxis
and IgE specific for galactose--1,3-galactose. N. Engl.
J. Med. 358, 11091117 (2008).
49. Lecluse, L. L. A. et al. Extent and clinical consequences
of antibody formation against adalimumab in patients
with plaque psoriasis. Arch. Dermatol. 146, 127132
(2010).
50. Weinblatt, M. E. et al. Adalimumab, a fully human
anti-tumor necrosis factor monoclonal antibody,
for the treatment of rheumatoid arthritis in patients
taking concomitant methotrexate: the ARMADA trial.
Arthritis Rheum. 48, 3545 (2003).
51. Nechansky, A. HAHA nothing to laugh about.
Measuring the immunogenicity (human anti-human
antibody response) induced by humanized
monoclonal antibodies applying ELISA and SPR
technology. J. Pharm. Biomed. Anal. 51, 252254
(2009).
52. Lofgren, J. A. et al. Comparing ELISA and surface
plasmon resonance for assessing clinical
immunogenicity of panitumumab. J. Immunol.
178, 74677472 (2007).
53. Jefferis, R. & LeFranc, M.-P. Human immunoglobulin
allotypes possible implications for immunogenicity.
MAbs 1, 332338 (2009).
54. Gilles, J. G. et al. Natural autoantibodies and anti-
idiotypes. Semin. Thromb. Hemost. 26, 151155
(2000).
55. Emmi, L. The role of intravenous immunoglobulin
therapy in autoimmune and inflammatory disorders.
Neurol. Sci. 23 (Suppl. 1), 18 (2002).
56. Harding, F. A. et al. The immunogenicity of humanized
and fully human antibodies: residual immunogenicity
residues in the CDR regions. Mabs 2, 256265
(2010).
57. Shankar, G., Pendley, C. & Stein, K. E. A risk-based
bioanalytical strategy for the assessment of antibody
immune responses against biological drugs. Nature
Biotech. 25, 555561 (2007).
Competing interests statement
The authors declare no competing financial interests.
FURTHER INFORMATION
tufts center for the study of Drug Development:
http://csdd.tufts.edu
All liNks Are AcTive iN THe oNliNe PDF
PersPecti ves
774 | OCTOBEr 2010 | VOlUME 9 www.nature.com/reviews/drugdisc
nrd_3229_oct10.indd 774 17/9/10 11:50:15
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 45
If it were not for the great variability
among individuals, medicine might
as well be a science and not an art.
Sir William Osler, 1892
Patients and society expect that the benefits
of licensed drugs will outweigh their risks.
Drug regulations in all major jurisdictions
are aiming to ensure a positive benefitrisk
balance. However, regulatory decisions are
based on population-level information, with
an understanding that the benefitrisk will
not necessarily be positive for all treated
patients. Patients are not equally responsive
to beneficial effects, and not equally sus-
ceptible to adverse effects. Drug developers,
drug regulators and health-care profession-
als have been aware of patient heterogeneity
and that one size doesnt fit all. Regulators
attempt to direct prescribers to appropri-
ate patient subpopulations and treatment
scenarios, whereas health-care professionals
aim to tailor drug regimens to their indi-
vidual patients, often based on phenotypic
markers that are expected to influence a
drugs pharmacokinetics or pharmacody-
namics such as creatinine clearance, disease
stage or comorbidities. In some cases, pre-
scribers can tailor doses to individuals by
titrating to their response to thedrug.
In spite of such efforts, drugs often do
not perform as well in clinical practice as in
the clinical trials that provide the basis for
marketing authorization. This difference
in benefitrisk has been termed the effi-
cacyeffectiveness gap, in which efficacy is
defined as the extent to which an interven-
tion does more good than harm under ideal
circumstances (that is, under clinical trial
conditions), whereas effectiveness is the
extent to which an intervention does more
good than harm when provided under the
usual circumstances of health care practice
(REF.1). Others have referred to efficacy as
can it work? and effectiveness as does it
work? (REF.2).
There have been several instances in
which the quality of prescription drugs dif-
fered markedly between the clinical trial
medicine assessed by regulators and that
being marketed. For example, some marketed
heparin products became contaminated with
oversulphated chondroitin sulphate
3
, and the
benefitrisk of nelfinavir (Viracept; Pfizer)
came under intense scrutiny when batches
of the medicine became contaminated with a
known genotoxic substance
4
. However, cases
in which pharmaceutical quality issues give
rise to differences between efficacy and effec-
tiveness are rare and represent a distinct set
of regulatory problems; therefore they are not
further discussedhere.
Another reason for an apparent difference
between efficacy and effectiveness may be the
inadequate follow up of minor safety signals
that arise during pre-licensing develop-
ment. We re-emphasise the responsibility of
manufacturers and regulators to ensure thor-
ough post-licensing investigation of safety
signals; it is hoped that the introduction
of Risk Management Plans (RMPs) in the
European Union (EU) and Risk Evaluation
and Mitigation Strategies (REMSs) in the
United States a few years ago may success-
fully address this important issue
5
. However,
in this Opinion article we argue that the
efficacyeffectiveness gap is, in most cases, a
problem of variability in drug response. We
describe biological and behavioural sources
of variability. We then summarize current
attempts to bridge the efficacyeffectiveness
gap by reducing variability. Finally, we specu-
late on new opportunities and technologies
in this area and what regulators can do to
advance the best use ofdrugs.
Variability and treatment scenarios
We observe that over the past decade there
were few, if any, drugs that came under close
scrutiny for their benefitrisk profile or
that had to be withdrawn from the market
OPI NI ON
Bridging the efficacyeffectiveness
gap: a regulators perspective
on addressing variability of drug
response
Hans-Georg Eichler, Eric Abadie, Alasdair Breckenridge, Bruno Flamion,
Lars L.Gustafsson, Hubert Leufkens, Malcolm Rowland, Christian K.Schneider
and Brigitte Bloechl-Daum
Abstract | Drug regulatory agencies should ensure that the benefits of drugs
outweigh their risks, but licensed medicines sometimes do not perform as
expected in everyday clinical practice. Failure may relate to lower than anticipated
efficacy or a higher than anticipated incidence or severity of adverse effects. Here
we show that the problem of benefitrisk is to a considerable degree a problem of
variability in drug response. We describe biological and behavioural sources of
variability and how these contribute to the long-known efficacyeffectiveness gap.
In this context, efficacy describes how a drug performs under conditions of clinical
trials, whereas effectiveness describes how it performs under conditions of
everyday clinical practice. We argue that a broad range of pre- and post-licensing
technologies will need to be harnessed to bridge the efficacyeffectiveness gap.
Successful approaches will not be limited to the current notion of pharmaco-
genomics-based personalized medicines, but will also entail the wider use of
electronic health-care tools to improve drug prescribing and patient adherence.
PERSPECTIVES
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | JULY 2011 | 495
nrd_3501_jul11.indd 495 20/06/2011 16:34
are likely to be less immunogenic than those
with rodent-derived sequences. There is
considerable unmet medical need in the
three main areas of study for investigational
human mAbs cancer, immunological and
infectious diseases and these emerging
agents could therefore provide valuable new
treatment options.
Aaron L. Nelson was previously at the Tufts University
School of Medicine, Boston, Massachusetts 02118, USA.
Present address: Novartis Institutes for Biomedical
Research, Room 7226, 7th floor, 300 Technology
Square, Cambridge, Massachusetts 02139, USA.
Eugen Dhimolea is at the Tufts University
School of Medicine, 136 Harrison Avenue, Boston,
Massachusetts 02111, USA.
Janice M. Reichert is at the Tufts Center for the Study
of Drug Development, Suite 1100, 75 Kneeland Street,
Boston, Massachusetts 02111, USA.
Correspondence to J.M.R.
email: janice.reichert@tufts.edu
doi:10.1038/nrd3229
Published online 3 september 2010
1. Reichert, J. M. Monoclonal antibodies as innovative
therapeutics. Curr. Pharm. Biotechnol. 9, 423430
(2008).
2. Reichert, J. M., Rosensweig, C. J., Faden, L. B. &
Dewitz, M. C. Monoclonal antibody successes in the
clinic. Nature Biotech. 23, 10731078 (2005).
3. Reichert, J. M. Antibodies to watch in 2010. MAbs
2, 84100 (2010).
4. James, K. & Bell, G. T. Human monoclonal antibody
production. Current status and future prospects.
J. Immunol. Methods 100, 540 (1987).
5. Olsson, L. & Kaplan, H. S. Humanhuman hybridomas
producing monoclonal antibodies of predefined
antigenic specificity. Proc. Natl Acad. Sci. USA 77,
54295431 (1980).
6. Shoenfeld, Y. et al. Production of autoantibodies
by humanhuman hybridomas. J. Clin. Invest. 70,
205208 (1982).
7. Olsson, L. et al. Antibody producing humanhuman
hybridomas. II. Derivation and characterization
of an antibody specific for human leukemia cells.
J. Exp. Med. 159, 537550 (1984).
8. Kozbor, D. & Roder, J. C. Requirements for the
establishment of high-titered human monoclonal
antibodies against tetanus toxoid using the
EpsteinBarr virus technique. J. Immunol. 127,
12751280 (1981).
9. Kozbor, D., Lagarde, A. E. & Roder, J. C.
Human hybridomas constructed with antigen-specific
EpsteinBarr virus-transformed cell lines. Proc. Natl
Acad. Sci. USA 79, 66516655 (1982).
10. Beerli, R. R. & Rader, C. Mining human antibody
repertoires. MAbs 2, 361374 (2010).
11. Teng, N. N. et al. Protection against Gram-negative
bacteremia and endotoxemia with human
monoclonal IgM antibodies. Proc. Natl Acad. Sci.
USA 82, 17901794 (1985).
12. Ziegler, E. J. et al. Treatment of Gram-negative
bacteremia and septic shock with HA-1A human
monoclonal antibody against endotoxin. A
randomized, double-blind, placebo-controlled trial.
The HA-1A Sepsis Study Group. N. Engl. J. Med.
324, 429436 (1991).
13. Cross, A. S. Antiendotoxin antibodies: a dead end?
Ann. Intern. Med. 121, 5860 (1994).
14. Luce, J. M. Introduction of new technology into critical
care practice: a history of HA-1A human monoclonal
antibody against endotoxin. Crit. Care Med. 21,
12331241 (1993).
15. McCloskey, R. V., Straube, R. C., Sanders, C.,
Smith, S. M. & Smith, C. R. Treatment of septic shock
with human monoclonal antibody HA-1A. A
randomized, double-blind, placebo-controlled trial.
CHESS Trial Study Group. Ann. Intern. Med. 121, 15
(1994).
16. Abbott. Abbott Annual Report 2008. Abbott website
[online], http://www.abbott.com/static/content/microsite/
annual_report/2008/16_review1.html (2008).
17. US Food and Drug Administration. Vectibix
Panitumumab Injectable. Application No.: 125147.
Medical Review(s). FDA website [online],
http://www.accessdata.fda.gov/drugsatfda_docs/
nda/2006/125147s0000_MedR.pdf (2006).
18. Van Cutsem, E. et al. Open-label phase III trial of
panitumumab plus best supportive care compared
with best supportive care alone in patients with
chemotherapy-refractory metastatic colorectal cancer.
J. Clin. Oncol. 25, 16581664 (2007).
19. Mazumdar, S. & Greenwald, D. Golimumab. MAbs
1, 422431 (2009).
20. Lachmann, H. J. et al. Use of canakinumab in the
cryopyrin-associated periodic syndrome. N. Engl.
J. Med. 360, 24162425 (2009).
21. Dhimolea, E. Canakinumab. MAbs 2, 313 (2010).
22. Cingoz, O. Ustekinumab. MAbs 1, 216221 (2009).
23. Teeling, J. L. et al. The biological activity of human
CD20 monoclonal antibodies is linked to unique
epitopes on CD20. J. Immunol. 177, 362371 (2006).
24. Glennie, M. J., French, R. R., Cragg, M. S. & Taylor, R. P.
Mechanisms of killing by anti-CD20 monoclonal
antibodies. Mol. Immunol. 44, 38233837 (2007).
25. Zhang, B. Ofatumumab. MAbs 1, 326331 (2009).
26. Pageau, S. C. Denosumab. MAbs 1, 210215 (2009).
27. Mazumdar, S. Raxibacumab. MAbs 1, 531538
(2009).
28. DallEra, M. & Wofsy, D. Connective tissue diseases:
belimumab for systemic lupus erythematosus: breaking
through? Nature Rev. Rheumatol. 6, 124125 (2010).
29. Wallace, D. J. et al. A phase II, randomized, double-
blind, placebo-controlled, dose-ranging study of
belimumab in patients with active systemic lupus
erythematosus. Arthritis Rheum. 61, 11681178
(2009).
30. Hodi, F. S. et al. Improved survival with ipilimumab in
patients with metastatic melanoma. N. Engl. J. Med.
363, 711723 (2010).
31. Reichert, J. M. & Dewitz, M. C. Anti-infective
monoclonal antibodies: perils and promise of
development. Nature Rev. Drug Discov. 5, 191195
(2006).
32. Reichert, J. M. & Valge-Archer, V. E. Development
trends for monoclonal antibody cancer therapeutics.
Nature Rev. Drug Discov. 6, 349356 (2007).
33. Green, L. L. et al. Antigen-specific human monoclonal
antibodies from mice engineered with human Ig
heavy and light chain YACs. Nature Genet. 7, 1321
(1994).
34. Lonberg, N. et al. Antigen-specific human antibodies
from mice comprising four distinct genetic
modifications. Nature 368, 856859 (1994).
35. Green, L. L. Antibody engineering via genetic
engineering of the mouse: XenoMouse strains are a
vehicle for the facile generation of therapeutic human
monoclonal antibodies. J. Immunol. Methods 231,
1123 (1999).
36. Lonberg, N. Human antibodies from transgenic
animals. Nature Biotech. 23, 11171125 (2005).
37. McCafferty, J., Griffiths, A. D., Winter, G. & Chiswell,
D. J. Phage antibodies: filamentous phage displaying
antibody variable domains. Nature 348, 552554
(1990).
38. Vaughan, T. J. et al. Human antibodies with
sub-nanomolar affinities isolated from a large
non-immunized phage display library. Nature Biotech.
14, 309314 (1996).
39. Clackson, T., Hoogenboom, H. R., Griffiths, A. D. &
Winter, G. Making antibody fragments using phage
display libraries. Nature 352, 624628 (1991).
40. Chirino, A. J., Ary, M. L. & Marshall, S. A.
Minimizing the immunogenicity of protein
therapeutics. Drug Discov. Today 9, 8290 (2004).
41. Baert, F. et al. Influence of immunogenicity on the
long-term efficacy of infliximab in Crohns disease.
N. Engl. J. Med. 348, 601608 (2003).
42. De Groot, A. S. & Scott, D. W. Immunogenicity of
protein therapeutics. Trends Immunol. 28, 482490
(2007).
43. Bartelds, G. M. et al. Clinical response to
adalimumab: relationship to anti-adalimumab
antibodies and serum adalimumab concentrations in
rheumatoid arthritis. Ann. Rheum. Dis. 66, 921926
(2007).
44. Bender, N. K. et al. Immunogenicity, efficacy and
adverse events of adalimumab in RA patients.
Rheumatol. Int. 27, 269274 (2007).
45. Hwang, W. Y. & Foote, J. Immunogenicity of
engineered antibodies. Methods 36, 310 (2005).
46. Saif, M. W. & Cohenuram, M. Role of panitumumab
in the management of metastatic colorectal cancer.
Clin. Colorectal Cancer 6, 118124 (2006).
47. Saif, M. W., Peccerillo, J. & Potter, V. Successful
re-challenge with panitumumab in patients who
developed hypersensitivity reactions to cetuximab:
report of three cases and review of literature.
Cancer Chemother. Pharmacol. 63, 10171022
(2009).
48. Chung, C. H. et al. Cetuximab-induced anaphylaxis
and IgE specific for galactose--1,3-galactose. N. Engl.
J. Med. 358, 11091117 (2008).
49. Lecluse, L. L. A. et al. Extent and clinical consequences
of antibody formation against adalimumab in patients
with plaque psoriasis. Arch. Dermatol. 146, 127132
(2010).
50. Weinblatt, M. E. et al. Adalimumab, a fully human
anti-tumor necrosis factor monoclonal antibody,
for the treatment of rheumatoid arthritis in patients
taking concomitant methotrexate: the ARMADA trial.
Arthritis Rheum. 48, 3545 (2003).
51. Nechansky, A. HAHA nothing to laugh about.
Measuring the immunogenicity (human anti-human
antibody response) induced by humanized
monoclonal antibodies applying ELISA and SPR
technology. J. Pharm. Biomed. Anal. 51, 252254
(2009).
52. Lofgren, J. A. et al. Comparing ELISA and surface
plasmon resonance for assessing clinical
immunogenicity of panitumumab. J. Immunol.
178, 74677472 (2007).
53. Jefferis, R. & LeFranc, M.-P. Human immunoglobulin
allotypes possible implications for immunogenicity.
MAbs 1, 332338 (2009).
54. Gilles, J. G. et al. Natural autoantibodies and anti-
idiotypes. Semin. Thromb. Hemost. 26, 151155
(2000).
55. Emmi, L. The role of intravenous immunoglobulin
therapy in autoimmune and inflammatory disorders.
Neurol. Sci. 23 (Suppl. 1), 18 (2002).
56. Harding, F. A. et al. The immunogenicity of humanized
and fully human antibodies: residual immunogenicity
residues in the CDR regions. Mabs 2, 256265
(2010).
57. Shankar, G., Pendley, C. & Stein, K. E. A risk-based
bioanalytical strategy for the assessment of antibody
immune responses against biological drugs. Nature
Biotech. 25, 555561 (2007).
Competing interests statement
The authors declare no competing financial interests.
FURTHER INFORMATION
tufts center for the study of Drug Development:
http://csdd.tufts.edu
All liNks Are AcTive iN THe oNliNe PDF
PersPecti ves
774 | OCTOBEr 2010 | VOlUME 9 www.nature.com/reviews/drugdisc
nrd_3229_oct10.indd 774 17/9/10 11:50:15
First published in Nature Reviews Drug Discovery 10, 495-506 (July 2011); doi:10.1038/nrd3501
46 | OCTOBER 2011 | THE FUTURE OF DRUG INNOVATION | NATURE REPRINT COLLECTION www.nature.com/reprintcollections/lilly/drug-innovation
0CVWTG4GXKGYU&TWI&KUEQXGT[
'Cloun', oxlunuory or ocucy riul
'Noisy', ruqmuic or oocivonoss riul
C
D
in the EU as an adjunct to diet and exercise
for the treatment of obese patients or over-
weight patients with associated risk factors
[] (REF.16). At that time, EU regulators
concluded that in clinical studies in which
the patients were treated for more than a
year, the weight reducing effect was moder-
ate and of clinical relevance for 2030% of
the treated patients [] (REF.16). There
were also safety questions from early devel-
opment; clinical trials had shown increased
rates of depressive disorders and suicidal and
aggressive behaviour, but, based on the inci-
dences observed in the trials, these adverse
effects were considered not to outweigh the
benefits. After the drug was on the market,
however, new data indicated a shorter dura-
tion of treatment in real life and, conse-
quently, a reduced beneficial effect on body
weight. At the same time, safety also became
an issue. A prescription survey revealed
that adherence by prescribers to the warn-
ings and contraindications in the label was
less than perfect. It became apparent that
the risk of experiencing the known adverse
mental effects had increased since the time
of approval, with higher absolute risks in
patients with comorbidity. Based on these
data, rimonabant was taken off the market in
the EU in 2009 (REF.16).
The rimonabant case study is instructive
because it involved a combination of some of
the causes of the efficacyeffectiveness gap
(FIG.1; TABLE1): poor patient persistence on
treatment (which reduced the effect size),
outside-label prescribing by physicians and
increased susceptibility to adverse effects
in some patients as a result of a pre-existing
comorbidity
17
. Along similar lines, prescrip-
tion of varenicline (Champix/Chantix; Pfizer)
to a broader population of patients than was
enrolled in clinical trials gave rise to height-
ened safety concerns about suicidal ideation
18
.
Sponsors of drug development pro-
grammes will understandably seek to con-
trol the treatment scenario in pre-licensing
trials in order to optimize benefitrisk.
Nonetheless, the transition from the pre-
licensing to the post-licensing stage is not
always accompanied by a deterioration of
benefitrisk. There are some cases in which
variability was reduced and benefitrisk
improved after marketing. For example, the
subgroup of patients who are treatment-
responsive to gefitinib (Iressa; AstraZeneca/
Teva) was only identified after licensing in
the United States
19
. In this case, both licens-
ing status and utilization of the drug shifted
from a broader, high-variability population
to a smaller, more circumscribed subpopula-
tion that is, from right to left in the graph
shown in FIG.1. There are other instances
in which the benefitrisk profile improved
after market introduction, including a
large number of dose adaptations (gener-
ally reductions) in the label after the initial
licensing
20,21
. These cases may be indicative
of suboptimal pre-marketing development
strategies, such as incomplete dose-ranging
studies, and the improved benefitrisk is
a result of additional research, serendipity
and/or safety-motivated regulatory action;
they do not contradict the broader notion of
increasing variability of drug response dur-
ing the post-marketingphase.
Sources of variability in drug response
Awareness of the variability in drug response
has received a boost, under the head-
ing of personalized medicine, by growing
knowledge about the genomic basis of drug
response. For some drugs, a substantial frac-
tion of variability in efficacy or toxicity can
now be explained on the basis of a single
genomic marker. Although the notion of
genomic treatment stratification has already
proved useful and personalized medicine is
expected to make significant contributions
to improving the benefitrisk of drugs, it is
unrealistic to assume that even the best pre-
dictive biomarkers will eliminate variability
or eliminate the efficacyeffectiveness gap.
This is because genetics is merely one factor
driving variability, albeit an important one.
We take a broader view that encompasses
the full range of biological and behavioural
sources of variability, as depicted in TABLE1.
In the following section, we will briefly
describe and illustrate by examples indi-
vidual sources of variability.
Biology
Pharmacogenomics. It is reasonable to
assume that differences in individual
patients genetic make-up are a major source
of variability for many drugs. It is merely our
current lack of understanding that precludes
us from exploiting these differences to better
target drugs to appropriate patients in appro-
priate doses (for an overview of pharmaco-
genomics, please refer to REF.22).
Probably the best examples to illustrate
the power of genomic markers to reduce
variability and optimize a drugs ben-
efits or risks are trastuzumab (Herceptin;
Genentech) and abacavir (Ziagen;
GlaxoSmithKline).
Trastuzumb is a monoclonal antibody
authorized in the EU for the treatment
of patients with HER2 positive meta-
static breast cancer (REF.23). Trastuzumb
targets HER2 (also known as ERBB2), a
member of the epidermal growth factor
receptor (EGFR) family of tyrosine kinase
receptors that is overexpressed in about
2530% of invasive ductal breast cancers
(HER2-positive breast cancer). Identification
of the biomarker HER2 and the develop-
ment of sufficiently reliable laboratory tests
to distinguish between HER2-positive and
HER2-negative population strata have ena-
bled the developers of this drug to focus
on the high-responder subgroup, thereby
reducing the number of patients in pre-
marketing clinical trials, as well as clinical
development cost and time. It has been spec-
ulated that without pre-selection of patients
with HER2-positive breast cancer, too many
patients and too much follow-up time would
have been needed to demonstrate a statisti-
cally significant benefit with trastuzumab
19
;
the relatively high therapeutic success rate
in the HER2-positive stratum would have
been diluted by the larger number of non-
responders in an unselected high-variability
population. Moreover, the availability of a
biomarker assay that can be implemented
in most health-care settings was shown to
adequately guide clinical practice; there is a
Figure 2 | Signal-to-noise ratio in clinical trials.
Detecting a statistically significant difference in
outcome between treatment groups (for example,
between experimental drug groups and placebo
groups) can be conceptualized as a signal-to-
noise problem. The higher the signal-to-noise
ratio, the better the chances of detecting a true
difference of a given magnitude and with a prede-
fined sample size. a | The signal-to-noise ratio in a
clinical trial with narrow patient selection criteria
and a tightly controlled treatment scenario, such
as clear definition of allowable concomitant medi-
cation and monitoring of patient adherence. This
clean setting is called an explanatory or efficacy
trial, and the intergroup difference can be
detected with ease. b | The signal-to-noise ratio of
a pragmatic or effectiveness trial; in contrast to a,
the trial population is more heterogeneous and
the treatment scenario resembles everyday clini-
cal practice. The signal may now be lost in the
noise, even though the drug has not lost its phar-
macological activity in those patients who are
responsive and adherent; hence the signal is still
there (orange oval) but is too small to detect.
PERSPECTI VES
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | JULY 2011 | 497
nrd_3501_jul11.indd 497 20/06/2011 16:34
0CVWTG4GXKGYU&TWI&KUEQXGT[
C
u
m
u
l
u
i
v
o
o
l
r
o
u
o
d
i
o
n
s
o
x
o
r
i
o
n
c
i
n
q
b
o
n
o
s
u
n
d
r
i
s
l
s
Hiqb
Vuriubiliy
Lov
Clinicul riul
sconurio
8onos
100
0
Pisls
Auborizod lubol
sconurio
Lcucy-oocivonoss qu
Avoruqo rosonsivonoss o bonociul oocs
Hiqb Lov
Avoruqo suscoibiliy o udvorso oocs
Lov Hiqb
Ousido-lubol
sconurio
Posiivo
8ono-risl
Noquivo
8ono-risl
Vuriubiliy
C
D
but that also failed to be beneficial for at
least some patient subgroups. It has been
speculated that this assumption may even
be true for rofecoxib (Vioxx; Merck)
6
,
which has triggered much debate about
the adequacy of drug licensing. Failure of a
licensed drug across the entire treatment-
eligible population would be very surpris-
ing indeed, considering the ever tighter
and more sophisticated evidentiary and
analytical standards applied to drug licens-
ing decisions. Past experience shows that it
is usually only a small subgroup of treated
patients who experience debilitating or life-
threatening adverse effects, and, likewise,
only a small subgroup who do not respond
to treatment. However, it should be noted
that the fraction of non-responders may be
as high as 3060% in some cases
7,8
.
To make matters even more complex,
drug response and benefitrisk profile are
often not black and white but are shades
of grey. A useful example of the gradient
of benefitrisk across patient strata was
provided nearly 15years ago, based on pre-
and post-licensing data on statin treatment.
Pharoah and Hollingworth
9
identified more
than 40 different patient strata, constructed
from a combination of demographic and
phenotypic criteria including age, sex, previ-
ous myocardial infarction and cholesterol
level. Estimates of clinical efficacy and cost-
effectiveness of the lipid-lowering treatments
provided in their analysis varied 15-fold
between riskstrata.
Such findings are expected, as the benefits
and risks from drugs vary from one patient
to the next, and are dependent on the
treatment scenario (FIG.1). Regulatory deci-
sions are taken on the basis of results from
randomized controlled trials (RCTs) in
which patient enrolment is restricted by
long lists of inclusion and exclusion crite-
ria. In addition, dose regimens, including
concomitant medications, are specified in
the trial protocol; trial staff make a special
effort to convince patients to take the trial
medications according to the prescribed
dosing regimen, and safety is monitored
at pre-specified intervals. These measures
are taken in the hope of optimizing treat-
ment conditions and selecting homogenous
patient groups with a high responsiveness
for the desired pharmacologic effect and a
low susceptibility for toxicity (for example,
by eliminating patients with some pre-
existing comorbidities). Thereby, variability
is minimized and the signal-to-noise ratio
enhanced (FIG.2). This enables drug develop-
ers to demonstrate a positive benefitrisk
profile. If regulators license the drug, it will
often be for a less-well-described patient
population. The label normally lists fewer
constraints than the clinical trial protocols
for dose regimens, age-range, comorbid
conditions or concomitant drug treatments.
Thus, even if prescribers were to strictly
adhere to the label, variability is expected to
be higher in the label scenario than in the
RCT scenario, and the benefitrisk may be
reduced (FIG.1).
Studies of drug utilization in daily prac-
tice have shown that drugs will frequently
be prescribed or taken for non-approved
conditions or otherwise not in accordance
with the label
1012
, and real-life treatment
scenarios are characterized by even wider
variability than on-label.
To a large extent, the efficacyeffectiveness
gap may be considered a result of increas-
ing variability of drug response owing to
a combination of genetic, other biological
and behavioural factors, as summarized
in TABLE1 and described below. Increased
variability may make the benefitrisk of a
drug look less favourable, calling into ques-
tion the regulatory licensing decision and in
some cases necessitating regulatory action.
At least two drugs, cerivastatin (Lipobay;
Bayer) and mibefradil (Posicor; Roche), had
to be taken off the market, partly as a result
of inappropriate prescribing. Both drugs
appeared to have a favourable benefitrisk at
the time of licensing, but recommendations
and warnings in the label were ignored by
prescribers
1315
.
A recent example of the efficacy
effectiveness gap is rimonabant (Acomplia;
Sanofi-Aventis), which was licensed in 2006
Figure 1 | Average benefitrisk of drugs as a function of treatment scenario. a | In the context
of regulatory clinical trials (left-hand side), variability in drug response is deliberately kept to a mini-
mum by enforced treatment conditions and narrow selection criteria, which aim to restrict the patient
population to high-responders and good-toleraters. Criteria for treatment eligibility and treatment
scenarios are usually less constrained in the authorized drug label (middle), and even less so after the
drug comes to market and is partly prescribed and taken outside the label scenario (different popula-
tions, doses, patients with contraindications and comorbidities, poor adherence, and so on; right-hand
side). As variability in drug response increases from left to right (red line), average benefitrisk deterio-
rates (blue line), giving rise to the efficacyeffectiveness gap. b | The deterioration in average benefit
risk is a result of the diminishing responsiveness to the beneficial effects (red line) and the increasing
susceptibility to adverse drug effects (blue line), as more and different patient strata are added. Note
that responsiveness to beneficial drug effects or susceptibility to adverse drug effects are not merely
determined genetically but also by environmental and behavioural factors (for example, inappropriate
prescribing or poor patient adherence to treatment regimens).
PERSPECTI VES
496 | JULY 2011 | VOLUME 10 www.nature.com/reviews/drugdisc
nrd_3501_jul11.indd 496 20/06/2011 16:34
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 47
0CVWTG4GXKGYU&TWI&KUEQXGT[
'Cloun', oxlunuory or ocucy riul
'Noisy', ruqmuic or oocivonoss riul
C
D
in the EU as an adjunct to diet and exercise
for the treatment of obese patients or over-
weight patients with associated risk factors
[] (REF.16). At that time, EU regulators
concluded that in clinical studies in which
the patients were treated for more than a
year, the weight reducing effect was moder-
ate and of clinical relevance for 2030% of
the treated patients [] (REF.16). There
were also safety questions from early devel-
opment; clinical trials had shown increased
rates of depressive disorders and suicidal and
aggressive behaviour, but, based on the inci-
dences observed in the trials, these adverse
effects were considered not to outweigh the
benefits. After the drug was on the market,
however, new data indicated a shorter dura-
tion of treatment in real life and, conse-
quently, a reduced beneficial effect on body
weight. At the same time, safety also became
an issue. A prescription survey revealed
that adherence by prescribers to the warn-
ings and contraindications in the label was
less than perfect. It became apparent that
the risk of experiencing the known adverse
mental effects had increased since the time
of approval, with higher absolute risks in
patients with comorbidity. Based on these
data, rimonabant was taken off the market in
the EU in 2009 (REF.16).
The rimonabant case study is instructive
because it involved a combination of some of
the causes of the efficacyeffectiveness gap
(FIG.1; TABLE1): poor patient persistence on
treatment (which reduced the effect size),
outside-label prescribing by physicians and
increased susceptibility to adverse effects
in some patients as a result of a pre-existing
comorbidity
17
. Along similar lines, prescrip-
tion of varenicline (Champix/Chantix; Pfizer)
to a broader population of patients than was
enrolled in clinical trials gave rise to height-
ened safety concerns about suicidal ideation
18
.
Sponsors of drug development pro-
grammes will understandably seek to con-
trol the treatment scenario in pre-licensing
trials in order to optimize benefitrisk.
Nonetheless, the transition from the pre-
licensing to the post-licensing stage is not
always accompanied by a deterioration of
benefitrisk. There are some cases in which
variability was reduced and benefitrisk
improved after marketing. For example, the
subgroup of patients who are treatment-
responsive to gefitinib (Iressa; AstraZeneca/
Teva) was only identified after licensing in
the United States
19
. In this case, both licens-
ing status and utilization of the drug shifted
from a broader, high-variability population
to a smaller, more circumscribed subpopula-
tion that is, from right to left in the graph
shown in FIG.1. There are other instances
in which the benefitrisk profile improved
after market introduction, including a
large number of dose adaptations (gener-
ally reductions) in the label after the initial
licensing
20,21
. These cases may be indicative
of suboptimal pre-marketing development
strategies, such as incomplete dose-ranging
studies, and the improved benefitrisk is
a result of additional research, serendipity
and/or safety-motivated regulatory action;
they do not contradict the broader notion of
increasing variability of drug response dur-
ing the post-marketingphase.
Sources of variability in drug response
Awareness of the variability in drug response
has received a boost, under the head-
ing of personalized medicine, by growing
knowledge about the genomic basis of drug
response. For some drugs, a substantial frac-
tion of variability in efficacy or toxicity can
now be explained on the basis of a single
genomic marker. Although the notion of
genomic treatment stratification has already
proved useful and personalized medicine is
expected to make significant contributions
to improving the benefitrisk of drugs, it is
unrealistic to assume that even the best pre-
dictive biomarkers will eliminate variability
or eliminate the efficacyeffectiveness gap.
This is because genetics is merely one factor
driving variability, albeit an important one.
We take a broader view that encompasses
the full range of biological and behavioural
sources of variability, as depicted in TABLE1.
In the following section, we will briefly
describe and illustrate by examples indi-
vidual sources of variability.
Biology
Pharmacogenomics. It is reasonable to
assume that differences in individual
patients genetic make-up are a major source
of variability for many drugs. It is merely our
current lack of understanding that precludes
us from exploiting these differences to better
target drugs to appropriate patients in appro-
priate doses (for an overview of pharmaco-
genomics, please refer to REF.22).
Probably the best examples to illustrate
the power of genomic markers to reduce
variability and optimize a drugs ben-
efits or risks are trastuzumab (Herceptin;
Genentech) and abacavir (Ziagen;
GlaxoSmithKline).
Trastuzumb is a monoclonal antibody
authorized in the EU for the treatment
of patients with HER2 positive meta-
static breast cancer (REF.23). Trastuzumb
targets HER2 (also known as ERBB2), a
member of the epidermal growth factor
receptor (EGFR) family of tyrosine kinase
receptors that is overexpressed in about
2530% of invasive ductal breast cancers
(HER2-positive breast cancer). Identification
of the biomarker HER2 and the develop-
ment of sufficiently reliable laboratory tests
to distinguish between HER2-positive and
HER2-negative population strata have ena-
bled the developers of this drug to focus
on the high-responder subgroup, thereby
reducing the number of patients in pre-
marketing clinical trials, as well as clinical
development cost and time. It has been spec-
ulated that without pre-selection of patients
with HER2-positive breast cancer, too many
patients and too much follow-up time would
have been needed to demonstrate a statisti-
cally significant benefit with trastuzumab
19
;
the relatively high therapeutic success rate
in the HER2-positive stratum would have
been diluted by the larger number of non-
responders in an unselected high-variability
population. Moreover, the availability of a
biomarker assay that can be implemented
in most health-care settings was shown to
adequately guide clinical practice; there is a
Figure 2 | Signal-to-noise ratio in clinical trials.
Detecting a statistically significant difference in
outcome between treatment groups (for example,
between experimental drug groups and placebo
groups) can be conceptualized as a signal-to-
noise problem. The higher the signal-to-noise
ratio, the better the chances of detecting a true
difference of a given magnitude and with a prede-
fined sample size. a | The signal-to-noise ratio in a
clinical trial with narrow patient selection criteria
and a tightly controlled treatment scenario, such
as clear definition of allowable concomitant medi-
cation and monitoring of patient adherence. This
clean setting is called an explanatory or efficacy
trial, and the intergroup difference can be
detected with ease. b | The signal-to-noise ratio of
a pragmatic or effectiveness trial; in contrast to a,
the trial population is more heterogeneous and
the treatment scenario resembles everyday clini-
cal practice. The signal may now be lost in the
noise, even though the drug has not lost its phar-
macological activity in those patients who are
responsive and adherent; hence the signal is still
there (orange oval) but is too small to detect.
PERSPECTI VES
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | JULY 2011 | 497
nrd_3501_jul11.indd 497 20/06/2011 16:34
0CVWTG4GXKGYU&TWI&KUEQXGT[
C
u
m
u
l
u
i
v
o
o
l
r
o
u
o
d
i
o
n
s
o
x
o
r
i
o
n
c
i
n
q
b
o
n
o
s
u
n
d
r
i
s
l
s
Hiqb
Vuriubiliy
Lov
Clinicul riul
sconurio
8onos
100
0
Pisls
Auborizod lubol
sconurio
Lcucy-oocivonoss qu
Avoruqo rosonsivonoss o bonociul oocs
Hiqb Lov
Avoruqo suscoibiliy o udvorso oocs
Lov Hiqb
Ousido-lubol
sconurio
Posiivo
8ono-risl
Noquivo
8ono-risl
Vuriubiliy
C
D
but that also failed to be beneficial for at
least some patient subgroups. It has been
speculated that this assumption may even
be true for rofecoxib (Vioxx; Merck)
6
,
which has triggered much debate about
the adequacy of drug licensing. Failure of a
licensed drug across the entire treatment-
eligible population would be very surpris-
ing indeed, considering the ever tighter
and more sophisticated evidentiary and
analytical standards applied to drug licens-
ing decisions. Past experience shows that it
is usually only a small subgroup of treated
patients who experience debilitating or life-
threatening adverse effects, and, likewise,
only a small subgroup who do not respond
to treatment. However, it should be noted
that the fraction of non-responders may be
as high as 3060% in some cases
7,8
.
To make matters even more complex,
drug response and benefitrisk profile are
often not black and white but are shades
of grey. A useful example of the gradient
of benefitrisk across patient strata was
provided nearly 15years ago, based on pre-
and post-licensing data on statin treatment.
Pharoah and Hollingworth
9
identified more
than 40 different patient strata, constructed
from a combination of demographic and
phenotypic criteria including age, sex, previ-
ous myocardial infarction and cholesterol
level. Estimates of clinical efficacy and cost-
effectiveness of the lipid-lowering treatments
provided in their analysis varied 15-fold
between riskstrata.
Such findings are expected, as the benefits
and risks from drugs vary from one patient
to the next, and are dependent on the
treatment scenario (FIG.1). Regulatory deci-
sions are taken on the basis of results from
randomized controlled trials (RCTs) in
which patient enrolment is restricted by
long lists of inclusion and exclusion crite-
ria. In addition, dose regimens, including
concomitant medications, are specified in
the trial protocol; trial staff make a special
effort to convince patients to take the trial
medications according to the prescribed
dosing regimen, and safety is monitored
at pre-specified intervals. These measures
are taken in the hope of optimizing treat-
ment conditions and selecting homogenous
patient groups with a high responsiveness
for the desired pharmacologic effect and a
low susceptibility for toxicity (for example,
by eliminating patients with some pre-
existing comorbidities). Thereby, variability
is minimized and the signal-to-noise ratio
enhanced (FIG.2). This enables drug develop-
ers to demonstrate a positive benefitrisk
profile. If regulators license the drug, it will
often be for a less-well-described patient
population. The label normally lists fewer
constraints than the clinical trial protocols
for dose regimens, age-range, comorbid
conditions or concomitant drug treatments.
Thus, even if prescribers were to strictly
adhere to the label, variability is expected to
be higher in the label scenario than in the
RCT scenario, and the benefitrisk may be
reduced (FIG.1).
Studies of drug utilization in daily prac-
tice have shown that drugs will frequently
be prescribed or taken for non-approved
conditions or otherwise not in accordance
with the label
1012
, and real-life treatment
scenarios are characterized by even wider
variability than on-label.
To a large extent, the efficacyeffectiveness
gap may be considered a result of increas-
ing variability of drug response owing to
a combination of genetic, other biological
and behavioural factors, as summarized
in TABLE1 and described below. Increased
variability may make the benefitrisk of a
drug look less favourable, calling into ques-
tion the regulatory licensing decision and in
some cases necessitating regulatory action.
At least two drugs, cerivastatin (Lipobay;
Bayer) and mibefradil (Posicor; Roche), had
to be taken off the market, partly as a result
of inappropriate prescribing. Both drugs
appeared to have a favourable benefitrisk at
the time of licensing, but recommendations
and warnings in the label were ignored by
prescribers
1315
.
A recent example of the efficacy
effectiveness gap is rimonabant (Acomplia;
Sanofi-Aventis), which was licensed in 2006
Figure 1 | Average benefitrisk of drugs as a function of treatment scenario. a | In the context
of regulatory clinical trials (left-hand side), variability in drug response is deliberately kept to a mini-
mum by enforced treatment conditions and narrow selection criteria, which aim to restrict the patient
population to high-responders and good-toleraters. Criteria for treatment eligibility and treatment
scenarios are usually less constrained in the authorized drug label (middle), and even less so after the
drug comes to market and is partly prescribed and taken outside the label scenario (different popula-
tions, doses, patients with contraindications and comorbidities, poor adherence, and so on; right-hand
side). As variability in drug response increases from left to right (red line), average benefitrisk deterio-
rates (blue line), giving rise to the efficacyeffectiveness gap. b | The deterioration in average benefit
risk is a result of the diminishing responsiveness to the beneficial effects (red line) and the increasing
susceptibility to adverse drug effects (blue line), as more and different patient strata are added. Note
that responsiveness to beneficial drug effects or susceptibility to adverse drug effects are not merely
determined genetically but also by environmental and behavioural factors (for example, inappropriate
prescribing or poor patient adherence to treatment regimens).
PERSPECTI VES
496 | JULY 2011 | VOLUME 10 www.nature.com/reviews/drugdisc
nrd_3501_jul11.indd 496 20/06/2011 16:34
48 | OCTOBER 2011 | THE FUTURE OF DRUG INNOVATION | NATURE REPRINT COLLECTION www.nature.com/reprintcollections/lilly/drug-innovation
shown in many instances to contribute to the
efficacyeffectiveness gap owing to more fre-
quent adverse effects or reduced benefit
3638
.
Off-label prescribing is expected to increase
variability of drug response, for example
because new patients with pre-existing
morbidities are being added to the treat-
ment population, as occurred in the cases of
rimonabant and varenicline (see above).
Effectiveness may be further reduced by
inadvertent medication errors, including dis-
pensing of the wrong drug or dose strength,
inappropriate handling and storage of drugs,
and other more subtle examples of poor use
of medicines that may occur throughout the
medication use system. The impact on pub-
lic health is huge and studies have estimated
that medication errors, including inappro-
priate prescribing, cost tens of thousands of
lives each year in the United Statesalone
39
.
Patient adherence. Drugs dont work in
patients who dont take them. Also known
as Koops Law, that simple observation
by C. Everett Koop, former US surgeon
general
40
, was the subject of numerous stud-
ies and even of a dedicated World Health
Organization report
41
. Poor adherence (also
termed compliance) by patients to pre-
scribed drug regimens may come in many
forms, ranging from fluctuations in dose-
timing to omitting a single days dosing to
having repeat drug holidays (the sequential
omission of 3 or more days doses) and,
finally, to non-persistence (not taking drugs
prescribed for chronic conditions)
42
.
Patients adherence is not perfect even
in pre-licensing trials, and especially in
long-term outcome trials
43
. Nonetheless,
regulatory trials are usually geared towards
maintaining adherence at the highest
possible level, and adherence in real-life
populations is expected to be substantially
lower than in clinical trials
44
. It has been
suggested that poor adherence may be the
single largest source of variance in drug
responses in some settings
45
, and it is also
likely to be one of the principal sources of
the efficacyeffectivenessgap.
There is an abundance of reports docu-
menting that poor adherence or non-adher-
ence by patients is a cause of potentially
avoidable morbidity, mortality and lost pro-
ductivity. The one class of drugs for which
the importance of adherence is probably best
understood and for which lack of adher-
ence has been described as the Achilles heel
is oral contraceptives. Because of their
relatively low variability in pharmacokinetics
and pharmacodynamics, these drugs could
achieve a near-perfect therapeutic success
rate that is, near zero risk of conception
given punctual dosing
46
. However, based
on one estimate, in real-life conditions the
conception rate increases 50-fold, from 0.1%
per year under perfect use conditions to
5.0% under typical use (REF.47).
Studies in HIV-infected patients have
demonstrated a significant relation between
patient adherence and virologic response
48
and possibly also drug-resistance devel-
opment
49
. In a study of patients with
schizophrenia, approximately 7% of patients
become non-adherent to their prescribed
drug regimen each month after discharge
from the hospital, and non-adherence was
associated with an increased relapse rate
50
.
Vrijens etal. reported that about half of
the patients who were prescribed an anti-
hypertensive drug had stopped taking it
within 1year
51
; it is easy to see how lack
of drug exposure due to poor adherence
may, if it is not reported by the patient and
remains undetected by the prescriber, lead
to the interpretation of treatment-resistant
hypertension. Adherence is likely to become
a factor in driving the clinical outcome of
cancer treatments as more and more cancer
drugs are administered orally and need to
be taken over prolonged periods and in an
ambulatory setting. Poor tamoxifen adher-
ence was recently shown to be significantly
associated with an increased risk of breast
cancer events
52
.
In some treatment situations, adher-
ence may take on a broader meaning than
just taking a drug dose at a given time and
include, for example, dieting and exercising.
A lack of lifestyle changes may mitigate the
therapeutic success of drug treatment. This
was shown by recent findings that patients
with early rheumatoid arthritis who smoke
are less likely to respond to treatment with
methotrexate and TNF inhibitors
53
.
Variability sources in a real-life setting
We have briefly described the individual
influences that govern variability in any
given therapeutic scenario. In everyday clini-
cal practice, all of them will influence overall
variability and the extent of the efficacy
effectiveness gap. However, the interplay of
these biological and behavioural factors is
not straightforward.
In an early seminal paper, Harter and
Peck
54
discussed major sources of variability
in doseeffect relationships and, impor-
tantly, their highly nonlinear interactions.
They emphasized that total variability is
the square root of the sum of the squares
of the variabilities of each individual
source
54
. Urquhart
46
pointed out that: this
nonlinearity has the unhappy consequence
that a major reduction in the variability of
one component of the system has only a
minor effect on the overall variability.
Harter and Peck also attempted to quan-
tify for one model drug the relative contribu-
tion of individual sources of variability to the
cumulative variability of the overall thera-
peutic response. In their estimate, adherence
and pharmacokinetics are the most impor-
tant drivers of variability of the therapeutic
effect of theophylline, a drug that was widely
used at the time in patients with asthma
54
.
However, the relative contribution of indi-
vidual sources to overall variability is likely
to be different from one drug to the next and
is unknown, or at least not formally assessed,
for mostdrugs.
Bridging the efficacyeffectiveness gap
Whenever expectations (efficacy) do not
match reality (effectiveness), there are two
ways to bridge the gap: either lower the
expectations to the level of reality (in our
context this would mean regulators demand
pre-marketing studies that fully represent
clinical reality and then base licensing deci-
sions on effectiveness information) or bring
up reality to the level of expectations. This
second approach seeks to ensure that every-
day practice strictly follows the label and that
drug regimens are individualized to meet
patients needs. Both concepts are useful but
present serious challenges.
Lower the expectations to the level of reality.
Ideally, regulatory RCTs should be inter-
nally valid (that is, their design and conduct
must minimize the possibility of bias), but
to be clinically useful, the result must also
be relevant to a definable group of patients
in a particular clinical setting (that is, they
must be externally valid)
55
. A perceived lack
of external validity is a frequent criticism
of current pre-marketing RCTs, which are
often referred to as explanatory or efficacy
trials. There is a call for trials with higher
external validity, also known as pragmatic
clinical trials (PCTs) or effectiveness trials
55
.
For an in-depth discussion of the domains
that characterize explanatory versus prag-
matic trials, please refer to the PRECIS
framework (REF.56).
An argument can indeed be made in
favour of a shift in regulatory evidence
standards from efficacy towards effective-
ness. Such a shift would imply fewer and
broader patient selection criteria (with the
exception of validated biomarker-guided
selection criteria, see below) and less control
over patient management. Pre-licensing
PERSPECTI VES
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | JULY 2011 | 499
nrd_3501_jul11.indd 499 20/06/2011 16:34
documented high rate of adherence to HER2
testing and treatment recommendations
24
that may reduce the efficacyeffectiveness
gap for this drug.
Abacavir shows what pharmacogenomics
can do for drug safety. Abacavir is a nucleo-
side reverse transcriptase inhibitor of HIV-1
and HIV-2, and is indicated for antiretroviral
combination therapy of HIV infection. The
dominant toxicity of this drug is a risk of
hypersensitivity reactions. Propensity stud-
ies demonstrated that the incidence could
be dramatically reduced by pre-therapy
screening for the human leukocyte anti-
gen (HLA)B*5701 allele. It is currently
estimated that 4861% of patients with the
HLAB*5701 allele will develop a hyper-
sensitivity reaction to abacavir, compared
to only 04% of patients who do not have
the HLAB*5701 allele
25
. Detection of the
genetic marker has substantially improved
the benefitrisk of this compound by
de-selecting the majority of patients who
would experience a serious adverseeffect.
Pharmacogenomics also determines
pharmacokinetics, and the knowledge about
polymorphisms in genes regulating drug-
metabolizing enzymes or drug transporters
has been successfully exploited to adjust
drug dose regimens in an attempt to reduce
variability in drug plasma levels and, conse-
quently, in benefitrisk
26,27
.
Other intrinsic and extrinsic factors. These
sources of variability are a mixed bag of
sometimes poorly described factors that
co-determine pharmacokinetics and/or
pharmacodynamics. Non-genetic variabil-
ity factors are divided into intrinsic and
extrinsic factors. Intrinsic factors are often
referred to as different states of physiol-
ogy or pathology
28
, such as age, sex, body
weight
29
, comorbidities or baseline severity
of disease
30,31
. Extrinsic factors are environ-
mental influences
28
, such as pollution, sun-
light, co-medication or influences of food on
pharmacokinetics, such as consumption of
fruit juice
32,33
.
For instance, patients with rheumatoid
arthritis who had a high body mass index
were reported to respond less well than
patients with a low body mass index to
tumour necrosis factor (TNF) blockade
by infliximab, even when the results were
adjusted for baseline status of disease activity
and infliximab dosage was based on body
weight. As fat tissue may be modulating the
inflammatory disease process, this finding
supports the notion that a patients volume
of fat tissue could have implications for other
immune-mediated inflammatory conditions
treated with TNF antagonists
34
.
Some of the residual (or unexplained)
variability ascribed to intrinsic and extrinsic
factors might, in reality, be due to genetic or
behavioural factors but is presently not rec-
ognized as such. Hence, it will be impossible
to address these modifiers of benefitrisk,
and eliminating all biological variability of
drug response will remain an elusivegoal.
Behaviour
Prescribing and drug handling in the medi-
cation use system. Regulators approve drugs
for defined indications and conditions, but
the drugs everyday use in the medication
use system is a different matter. We refer to
the medication use system as the complex
collaboration among physicians, nurses,
pharmacists, hospital or nursing home
staff and other health-care professionals
who influence drug utilization in everyday
practice
5
.
A large fraction of all prescriptions are
written off-label, sometimes encouraged
by inappropriate drug company marketing
and promotions efforts
35
. Off-label implies
prescribing for an unapproved condition,
dose regimen, treatment duration, route of
administration or for patients who should
not be given the drug because of existing
contraindications or interacting concomitant
treatment. Some off-label uses may follow
evidence of the drugs efficacy in unapproved
conditions, or may simply happen ahead of
a regulatory label change, and as such may
benefit patients. However, off-label use was
Table 1 | Sources of variability in drug response that may cause toxicity or lack of efficacy
Source of variability Mechanism Drug therapy Description of problem
Biology
Genomics Individual patients genomic make-up
influences PK and PD, affecting drug
concentration profile at the target site and
the likelihood and magnitude of desired and
adverse effects
Trastuzumab PD: only effective in patients overexpressing HER2
receptor on tumour cells
Abacavir PD: High risk of severe hypersensitivity reaction in
patients with HLAB*5701 allele
Codeine PK: lack of analgesia in carriers of nonfunctional
CYP2D6 alleles, toxicity with multiple CYP2D6 gene
copies
Other intrinsic and
extrinsic factors
Comorbidity, baseline severity of disease,
other altered physiological states, or external
factors influencing PK and/or PD
Insulin PD: glucose control and risk of hypoglycaemia
affected by stress or physical activity
Several drugs PK: increased toxicity due to increased absorption
with concomitant consumption of grapefruit juice
Behaviour
Prescribing and drug
handling
Inappropriate or off-label prescribing,
co-prescribing with an interacting drug,
continued prescribing to non-responders or
medication errors
Cerivastatin Rhabdomyolysis due to too high starting doses
Gemfibrozil Interactions in drug label ignored
Mibefradil Toxicity due to drugdrug interactions, label often
ignored
Patient adherence Poor adherence to prescribed drug regimen,
discontinuation (non-persistence), drug
holidays or inadvertent overdosing
Anti-hypertensive
drugs
Non-adherence or non-persistence perceived as
treatment-resistant hypertension
Anti-infective
therapies
Drug holidays leading to the development of
resistance
The overall variability and the extent of the efficacyeffectiveness gap is driven by the interplay between biological and behavioural factors. CYP2D6, cytochrome
P450 2D6; HLA, human leukocyte antigen; PD, pharmacodynamics; PK, pharmacokinetics.
PERSPECTI VES
498 | JULY 2011 | VOLUME 10 www.nature.com/reviews/drugdisc
nrd_3501_jul11.indd 498 20/06/2011 16:34
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 49
shown in many instances to contribute to the
efficacyeffectiveness gap owing to more fre-
quent adverse effects or reduced benefit
3638
.
Off-label prescribing is expected to increase
variability of drug response, for example
because new patients with pre-existing
morbidities are being added to the treat-
ment population, as occurred in the cases of
rimonabant and varenicline (see above).
Effectiveness may be further reduced by
inadvertent medication errors, including dis-
pensing of the wrong drug or dose strength,
inappropriate handling and storage of drugs,
and other more subtle examples of poor use
of medicines that may occur throughout the
medication use system. The impact on pub-
lic health is huge and studies have estimated
that medication errors, including inappro-
priate prescribing, cost tens of thousands of
lives each year in the United Statesalone
39
.
Patient adherence. Drugs dont work in
patients who dont take them. Also known
as Koops Law, that simple observation
by C. Everett Koop, former US surgeon
general
40
, was the subject of numerous stud-
ies and even of a dedicated World Health
Organization report
41
. Poor adherence (also
termed compliance) by patients to pre-
scribed drug regimens may come in many
forms, ranging from fluctuations in dose-
timing to omitting a single days dosing to
having repeat drug holidays (the sequential
omission of 3 or more days doses) and,
finally, to non-persistence (not taking drugs
prescribed for chronic conditions)
42
.
Patients adherence is not perfect even
in pre-licensing trials, and especially in
long-term outcome trials
43
. Nonetheless,
regulatory trials are usually geared towards
maintaining adherence at the highest
possible level, and adherence in real-life
populations is expected to be substantially
lower than in clinical trials
44
. It has been
suggested that poor adherence may be the
single largest source of variance in drug
responses in some settings
45
, and it is also
likely to be one of the principal sources of
the efficacyeffectivenessgap.
There is an abundance of reports docu-
menting that poor adherence or non-adher-
ence by patients is a cause of potentially
avoidable morbidity, mortality and lost pro-
ductivity. The one class of drugs for which
the importance of adherence is probably best
understood and for which lack of adher-
ence has been described as the Achilles heel
is oral contraceptives. Because of their
relatively low variability in pharmacokinetics
and pharmacodynamics, these drugs could
achieve a near-perfect therapeutic success
rate that is, near zero risk of conception
given punctual dosing
46
. However, based
on one estimate, in real-life conditions the
conception rate increases 50-fold, from 0.1%
per year under perfect use conditions to
5.0% under typical use (REF.47).
Studies in HIV-infected patients have
demonstrated a significant relation between
patient adherence and virologic response
48
and possibly also drug-resistance devel-
opment
49
. In a study of patients with
schizophrenia, approximately 7% of patients
become non-adherent to their prescribed
drug regimen each month after discharge
from the hospital, and non-adherence was
associated with an increased relapse rate
50
.
Vrijens etal. reported that about half of
the patients who were prescribed an anti-
hypertensive drug had stopped taking it
within 1year
51
; it is easy to see how lack
of drug exposure due to poor adherence
may, if it is not reported by the patient and
remains undetected by the prescriber, lead
to the interpretation of treatment-resistant
hypertension. Adherence is likely to become
a factor in driving the clinical outcome of
cancer treatments as more and more cancer
drugs are administered orally and need to
be taken over prolonged periods and in an
ambulatory setting. Poor tamoxifen adher-
ence was recently shown to be significantly
associated with an increased risk of breast
cancer events
52
.
In some treatment situations, adher-
ence may take on a broader meaning than
just taking a drug dose at a given time and
include, for example, dieting and exercising.
A lack of lifestyle changes may mitigate the
therapeutic success of drug treatment. This
was shown by recent findings that patients
with early rheumatoid arthritis who smoke
are less likely to respond to treatment with
methotrexate and TNF inhibitors
53
.
Variability sources in a real-life setting
We have briefly described the individual
influences that govern variability in any
given therapeutic scenario. In everyday clini-
cal practice, all of them will influence overall
variability and the extent of the efficacy
effectiveness gap. However, the interplay of
these biological and behavioural factors is
not straightforward.
In an early seminal paper, Harter and
Peck
54
discussed major sources of variability
in doseeffect relationships and, impor-
tantly, their highly nonlinear interactions.
They emphasized that total variability is
the square root of the sum of the squares
of the variabilities of each individual
source
54
. Urquhart
46
pointed out that: this
nonlinearity has the unhappy consequence
that a major reduction in the variability of
one component of the system has only a
minor effect on the overall variability.
Harter and Peck also attempted to quan-
tify for one model drug the relative contribu-
tion of individual sources of variability to the
cumulative variability of the overall thera-
peutic response. In their estimate, adherence
and pharmacokinetics are the most impor-
tant drivers of variability of the therapeutic
effect of theophylline, a drug that was widely
used at the time in patients with asthma
54
.
However, the relative contribution of indi-
vidual sources to overall variability is likely
to be different from one drug to the next and
is unknown, or at least not formally assessed,
for mostdrugs.
Bridging the efficacyeffectiveness gap
Whenever expectations (efficacy) do not
match reality (effectiveness), there are two
ways to bridge the gap: either lower the
expectations to the level of reality (in our
context this would mean regulators demand
pre-marketing studies that fully represent
clinical reality and then base licensing deci-
sions on effectiveness information) or bring
up reality to the level of expectations. This
second approach seeks to ensure that every-
day practice strictly follows the label and that
drug regimens are individualized to meet
patients needs. Both concepts are useful but
present serious challenges.
Lower the expectations to the level of reality.
Ideally, regulatory RCTs should be inter-
nally valid (that is, their design and conduct
must minimize the possibility of bias), but
to be clinically useful, the result must also
be relevant to a definable group of patients
in a particular clinical setting (that is, they
must be externally valid)
55
. A perceived lack
of external validity is a frequent criticism
of current pre-marketing RCTs, which are
often referred to as explanatory or efficacy
trials. There is a call for trials with higher
external validity, also known as pragmatic
clinical trials (PCTs) or effectiveness trials
55
.
For an in-depth discussion of the domains
that characterize explanatory versus prag-
matic trials, please refer to the PRECIS
framework (REF.56).
An argument can indeed be made in
favour of a shift in regulatory evidence
standards from efficacy towards effective-
ness. Such a shift would imply fewer and
broader patient selection criteria (with the
exception of validated biomarker-guided
selection criteria, see below) and less control
over patient management. Pre-licensing
PERSPECTI VES
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | JULY 2011 | 499
nrd_3501_jul11.indd 499 20/06/2011 16:34
documented high rate of adherence to HER2
testing and treatment recommendations
24
that may reduce the efficacyeffectiveness
gap for this drug.
Abacavir shows what pharmacogenomics
can do for drug safety. Abacavir is a nucleo-
side reverse transcriptase inhibitor of HIV-1
and HIV-2, and is indicated for antiretroviral
combination therapy of HIV infection. The
dominant toxicity of this drug is a risk of
hypersensitivity reactions. Propensity stud-
ies demonstrated that the incidence could
be dramatically reduced by pre-therapy
screening for the human leukocyte anti-
gen (HLA)B*5701 allele. It is currently
estimated that 4861% of patients with the
HLAB*5701 allele will develop a hyper-
sensitivity reaction to abacavir, compared
to only 04% of patients who do not have
the HLAB*5701 allele
25
. Detection of the
genetic marker has substantially improved
the benefitrisk of this compound by
de-selecting the majority of patients who
would experience a serious adverseeffect.
Pharmacogenomics also determines
pharmacokinetics, and the knowledge about
polymorphisms in genes regulating drug-
metabolizing enzymes or drug transporters
has been successfully exploited to adjust
drug dose regimens in an attempt to reduce
variability in drug plasma levels and, conse-
quently, in benefitrisk
26,27
.
Other intrinsic and extrinsic factors. These
sources of variability are a mixed bag of
sometimes poorly described factors that
co-determine pharmacokinetics and/or
pharmacodynamics. Non-genetic variabil-
ity factors are divided into intrinsic and
extrinsic factors. Intrinsic factors are often
referred to as different states of physiol-
ogy or pathology
28
, such as age, sex, body
weight
29
, comorbidities or baseline severity
of disease
30,31
. Extrinsic factors are environ-
mental influences
28
, such as pollution, sun-
light, co-medication or influences of food on
pharmacokinetics, such as consumption of
fruit juice
32,33
.
For instance, patients with rheumatoid
arthritis who had a high body mass index
were reported to respond less well than
patients with a low body mass index to
tumour necrosis factor (TNF) blockade
by infliximab, even when the results were
adjusted for baseline status of disease activity
and infliximab dosage was based on body
weight. As fat tissue may be modulating the
inflammatory disease process, this finding
supports the notion that a patients volume
of fat tissue could have implications for other
immune-mediated inflammatory conditions
treated with TNF antagonists
34
.
Some of the residual (or unexplained)
variability ascribed to intrinsic and extrinsic
factors might, in reality, be due to genetic or
behavioural factors but is presently not rec-
ognized as such. Hence, it will be impossible
to address these modifiers of benefitrisk,
and eliminating all biological variability of
drug response will remain an elusivegoal.
Behaviour
Prescribing and drug handling in the medi-
cation use system. Regulators approve drugs
for defined indications and conditions, but
the drugs everyday use in the medication
use system is a different matter. We refer to
the medication use system as the complex
collaboration among physicians, nurses,
pharmacists, hospital or nursing home
staff and other health-care professionals
who influence drug utilization in everyday
practice
5
.
A large fraction of all prescriptions are
written off-label, sometimes encouraged
by inappropriate drug company marketing
and promotions efforts
35
. Off-label implies
prescribing for an unapproved condition,
dose regimen, treatment duration, route of
administration or for patients who should
not be given the drug because of existing
contraindications or interacting concomitant
treatment. Some off-label uses may follow
evidence of the drugs efficacy in unapproved
conditions, or may simply happen ahead of
a regulatory label change, and as such may
benefit patients. However, off-label use was
Table 1 | Sources of variability in drug response that may cause toxicity or lack of efficacy
Source of variability Mechanism Drug therapy Description of problem
Biology
Genomics Individual patients genomic make-up
influences PK and PD, affecting drug
concentration profile at the target site and
the likelihood and magnitude of desired and
adverse effects
Trastuzumab PD: only effective in patients overexpressing HER2
receptor on tumour cells
Abacavir PD: High risk of severe hypersensitivity reaction in
patients with HLAB*5701 allele
Codeine PK: lack of analgesia in carriers of nonfunctional
CYP2D6 alleles, toxicity with multiple CYP2D6 gene
copies
Other intrinsic and
extrinsic factors
Comorbidity, baseline severity of disease,
other altered physiological states, or external
factors influencing PK and/or PD
Insulin PD: glucose control and risk of hypoglycaemia
affected by stress or physical activity
Several drugs PK: increased toxicity due to increased absorption
with concomitant consumption of grapefruit juice
Behaviour
Prescribing and drug
handling
Inappropriate or off-label prescribing,
co-prescribing with an interacting drug,
continued prescribing to non-responders or
medication errors
Cerivastatin Rhabdomyolysis due to too high starting doses
Gemfibrozil Interactions in drug label ignored
Mibefradil Toxicity due to drugdrug interactions, label often
ignored
Patient adherence Poor adherence to prescribed drug regimen,
discontinuation (non-persistence), drug
holidays or inadvertent overdosing
Anti-hypertensive
drugs
Non-adherence or non-persistence perceived as
treatment-resistant hypertension
Anti-infective
therapies
Drug holidays leading to the development of
resistance
The overall variability and the extent of the efficacyeffectiveness gap is driven by the interplay between biological and behavioural factors. CYP2D6, cytochrome
P450 2D6; HLA, human leukocyte antigen; PD, pharmacodynamics; PK, pharmacokinetics.
PERSPECTI VES
498 | JULY 2011 | VOLUME 10 www.nature.com/reviews/drugdisc
nrd_3501_jul11.indd 498 20/06/2011 16:34
50 | OCTOBER 2011 | THE FUTURE OF DRUG INNOVATION | NATURE REPRINT COLLECTION www.nature.com/reprintcollections/lilly/drug-innovation
of health care; for the second question, the
key players will be developers of e-healthcare,
physicians and other health professionals,
patients, regulators and payers of healthcare.
In the following section we will discuss
how the issues framed by these two ques-
tions might successfully be addressed.
Which patient for this drug?
The starting point with this approach is the
knowledge base on a drug, and the goal is
to optimize the treatable patient popula-
tion in an attempt to minimize the number
needed to treat (NNT) and/or to maximize
the number needed to harm (NNH)
66
.
Pharmacogenomics has considerable poten-
tial to stratify patients with a given condition
into treatment-eligible versus non-eligible
groups. The examples of trastuzumab and
abacavir show the power of predictive
pharmacogenomic biomarkers, but experi-
ence with pharmacogenomic (and in some
instances also phenotypic) biomarkers has
also highlighted a number of challenges for
drug regulators.
In the past, many pharmacogenomic bio-
markers have been identified retrospectively
that is, during the course of the develop-
ment of the drug in question and much of
the data presented to regulatory authorities
in support of such biomarkers raised ques-
tions of methodological validity and clinical
utility
19,67
.
The difficulty of ensuring an adequate
predictive value of the biomarker test, also
known as the companion diagnostic test, is
shown by the pitfalls of using immunohisto-
chemistry (IHC), a test with less than perfect
predictive value to guide EGFR-targeted
therapy. Some real target patients will remain
unidentified and will be denied effective
treatment (false-negative patients), whereas
other patients are unnecessarily exposed to
a drug with no benefits but potential adverse
effects (false-positive patients)
19
.
A different challenge is represented by
the question: how big a difference between
the subpopulations identified by a com-
panion diagnostic justifies a label claim?
To illustrate this issue we return to the gefi-
tinib case study. At least one controlled trial
showed that in patients with mutant EGFR,
progression free survival (PFS) was clearly
superior in the gefitinib group compared to
chemotherapy control, but PFS was inferior
to control in mutation-negative patients
68
.
Here, the biomarker provides a clear deci-
sion rule, as it differentiates subpopulations
for which the benefitrisk is dramatically
different. By contrast, an example of a less
than clear-cut genomic biomarker was
reported by Donnelly etal.
69
, who stud-
ied the association of a single nucleotide
polymorphism in the 3-hydroxy-3-methyl-
glutaryl coenzyme A reductase (HMGCR)
gene with the lipid-lowering response to
statins. Retrospective analysis identified
two strata of patients, one of which reached
the total cholesterol target level in 71.9% of
the cases, versus 49.0% in the other group
69
.
Considering the relatively benign safety
profile of statins at appropriate doses, one
may conclude that the benefitrisk is posi-
tive for both populations, and restricting
the label to the higher response stratum
may be unjustified. This case is not unique,
and several potential biomarkers do not
identify clearly positive or negative ben-
efitrisk strata, but merely define different
patient subpopulations with marginally
different benefitrisk. For clinicians and
patients, such biomarkers may have no
added value, but payers of health care
might decide to limit coverage of that drug
to the biomarker-defined high responder
group because all else being equal
cost effectiveness will be superior in that
group. This may even have negative con-
sequences, as biomarker stratification may
come to be seen not as a means to optimize
benefitrisk but to exclude patients from
(expensive) treatment. There is at least
one reported precedent of a payer using a
pharmacogenomic biomarker that is not
on the label of the drug to increase the cost
effectiveness of a therapy
19
. The widely
publicised debate around the clinical added
value of cytochrome P450 2C9 (CYP2C9)
and vitamin K epoxide reductase complex
subunit 1 (VKORC1) genotyping for bet-
ter dosing of the anticoagulant warfarin is
another useful case study demonstrating
the regulators challenges with tests that
address only part of the expected variability
in drug response. (For reviews of the warfa-
rin case, please refer to REFS7072.)
The availability of less than clear-cut pre-
dictive markers raises the question of whether
marker-negative patients can or should be
excluded from pivotal clinical trials. The
conundrum here is that focusing on expected
high responder groups will make the clini-
cal development phase faster and cheaper,
support the drug development endeavour
and bring novel treatment options to (some)
patients earlier; however, it may be ethically
challenging to exclude patients who may
potentially benefit, as in the case of HMGCR
gene stratification describedabove.
Solutions to these issues are, however,
beginning to emerge. Industry and the regu-
latory community have learned from past
experience. The pharmaceutical industry
Table 2 | Restrictions in the wording of regulatory drug labels in 2009
Indication as shown on the label or SmPC No. of drugs in United States
(n=25)
No. of drugs in EU
(n=29)
Broad, unrestricted* (for example, benign prostate hyperplasia) 18 17
Restricted to second-line (for example, carcinoma after failure
of prior platinum-containing regimen)
5 6
Restricted to advanced stage of disease (for example, cartilage
defects of grade III or IV)
2 2
Restricted to combination therapy (for example, rheumatoid
arthritis in combination with methotrexate)
0 3
Restricted to a pharmacogenomic subset (for example,
cancer with activating mutations of EGFR-TK)
0 1
For all new drugs approved in 2009, we reviewed the official labels (for US drugs) or the summary of product characteristics (SmPC) (for European Union (EU) drugs).
(For the EU, we reviewed only drugs that were approved by centralized procedure.) The list of new biologics and new molecular entities approved by the US Food
and Drug Administration (FDA) was obtained from REF.108, and the list of new active substances for the EU was obtained from REF.109. Label/SmPC information
was obtained from the websites of the FDA and European Medicines Agency (EMA). Only wording under the headings of Indications and usage (FDA) or
Therapeutic indication (EMA) was considered. Note that contraindications and warnings, which may also restrict the treatment-eligible population, were not
considered for this analysis. EGFR-TK, epidermal growth factor receptor tyrosine kinase. *Restrictions to age groups are also included under this heading (for
example, not approved for use in pediatric patients).
PERSPECTI VES
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | JULY 2011 | 501
nrd_3501_jul11.indd 501 20/06/2011 16:34
effectiveness trials might allow post-reg-
ulatory decision makers, such as payers of
health care or clinicians, to better judge to
whom results can reasonably be applied
to in a realistic health-care setting. However,
that benefit would come at a high price.
To explain the downside of a regulatory
effectiveness paradigm, we recall that inter-
pretation of RCT results can be considered
as a signal-to-noise problem. The majority
of regulatory clinical trials are superiority
showing that is, they aim to demonstrate
a statistically significant positive differ-
ence in observed outcome between a group
of patients receiving the test drug and a
control group, who are most often given
placebo. The higher the variability in the
trial (noise), the less likely it is that a differ-
ence (signal) can be shown even where
it exists. For instance, according to Koops
Law, poor adherence to the experimental
drug regimen by some patients will increase
variability and diminish the average effect
size. Sponsors of clinical trials are very
much aware of that risk and frequently seek
to maximize patient adherence by way of
patient reminders, frequent office visits or
building an initial placebo run-in phase into
the trial protocol; in the run-in phase, all
eligible patients receive placebo, and those
who are poorly compliant are excluded
before randomization. Such measures, often
referred to as enrichment (REF.57), are
expected to increase the signal-to-noise ratio
and the chance of the trial to be successful,
but they reduce external validity. Threats
to the signal-to-noise ratio may also come
from overly broad patient selection criteria,
such as the inadvertent inclusion of patients
with a viral infection into a study of a novel
antibacterialagent.
Effectiveness trials, in which condi-
tions are less stringently controlled, have
higher noise levels and the signal may be
reduced or lost in the noise (FIG.2). At a
minimum, this would result in much larger,
more expensive trials to achieve statistical
significance. In the worst case, it poses the
danger of missing potentially useful sub-
stances: a drug might be deemed ineffective
in a noisy effectiveness trial, even though
it may be beneficial to some patients under
some conditions. Depriving these patients
of valuable treatment options would amount
to a false-negative regulatory decision. The
pitfalls of requesting effectiveness data as
a basis for marketing authorization or of
allowing unlimited variation in premarket-
ing RCTs are also recognized by proponents
of PCTs, some of whom advocate PCTs as
more appropriate vehicles for examining
variation in prescriber or patient adherence
(REF. 18). We support this notion and draw
attention to the fact that the demonstration
of a drugs potential for delivering benefits
is a very different question from assessing
whether that potential is achieved in real
life. We argue that, in a situation in which
the internal validity of pre-licensing RCTs is
not in doubt but where there is an apparent
large gap between efficacy and effectiveness,
one is not looking at a drug problem but
at a health-care delivery problem, and the
focus of remedial action should be shifted to
improving real-life performance.
Bring up reality to the level of expectations.
In an ideal world of evidence-based medi-
cine, the label would exactly reflect the evi-
dence base that is, the treatment scenario
of regulatory clinical trials (step 1) and
drug utilization would conform to the label
(step 2). Alas, both steps cannot be easily
realized.
With regards to the first step, defin-
ing an indication strictly in line with the
clinical trial conditions is not an option,
and wording the label is usually a balancing
act for regulators who need to refrain from
overextrapolating the evidence base while
being mindful of practical constraints faced
by prescribers. For instance, one external
commentator chided regulators for overly
narrow labels:
the FDA approves [cancer drugs]
for indications so narrow (an artifact
of their archaic statistical evaluation
approaches), that most cancer drugs
actually are approved for different uses.
A colon cancer drug isnt approved by
[the] FDA to treat any colon cancer
patient at any time, but rather to treat,
for example, only those patients who
have exhausted all other approved
options, because that is the population
it was statistically tested in for approval.
Also, oncologists dont use cancer drugs
strictly in accordance with the FDAs
narrow approvals because doing so
simply wouldnt work to keep their
patients alive. (REF.58)
We reviewed the wording of the treat-
ment indications in the labels of new active
substances authorized in the year 2009 in
the United States and the EU (centralized
procedure only) (TABLE2). Our findings sup-
port the notion that the label is frequently
restricted to what some may consider an
artificial subset because, in most cases, the
limited indication reflects the clinical trial
scenarios. It is indeed biologically plausible
that some of the more narrowly authorized
drugs might be equally safe and effica-
cious in extended settings, such as first-line
therapy or monotherapy. However, too much
extrapolation in the wording of the label
would violate the principles of evidence-
based drug licensing. Overly broad labels
could rightfully be criticized as further
increasing variability and widening the
efficacyeffectiveness gap when extrapola-
tion turns out to be unjustified
59
. The cur-
rent model of drug licensing leaves limited
room for regulators to address the dilemma
between too wide or too narrow labels. It is
hoped that innovative approaches to licens-
ing such as staggered approval (or progres-
sive authorization) may in future better
align the knowledge of a drug with the label
claim
6062
.
The second step in this process ensur-
ing that drug utilization conforms to the
label is even more difficult to achieve as it
requires behavioural changes from all actors
in the medication use system and from
patients. Past attempts at reducing variability
of drug utilization, which were largely based
on motivational and educational efforts,
were not always successful
63
.
These considerations highlight that both
avenues to address the efficacyeffective-
ness gap are fraught with difficulties and
neither is likely to achieve satisfactory results
on its own. The most useful approach will
be to simultaneously address expectations
andreality.
The problem may also be framed from a
different angle. Drug effects good or bad
are the result of a successful or bad match
between a drug and a given patient. Drugs
may be more or less forgiving (REF.64);
those with a steep doseresponse relation-
ship, narrow therapeutic window and rapid
elimination are often less forgiving. Also,
some patients are more unforgiving than
others; for example, some patients may have
genetic traits that predispose them to an
adverse event or they may be taking multiple
concomitant medications. Poor therapeutic
outcomes result when an unforgiving drug
meets an unforgiving patient
65
, and the key
to bridging the efficacyeffectiveness gap is
to avoid poor matches. We propose that suc-
cessful attempts to this end will have to be
centred on two questions: which patient for
this drug? and which drug regimen for this
patient? Novel technologies will have to be
harnessed both for the pre- and post-licens-
ing lifespan of drugs. The call for action to
address the first question is directed mostly
to developers of drugs, regulators and payers
PERSPECTI VES
500 | JULY 2011 | VOLUME 10 www.nature.com/reviews/drugdisc
nrd_3501_jul11.indd 500 20/06/2011 16:34
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 51
of health care; for the second question, the
key players will be developers of e-healthcare,
physicians and other health professionals,
patients, regulators and payers of healthcare.
In the following section we will discuss
how the issues framed by these two ques-
tions might successfully be addressed.
Which patient for this drug?
The starting point with this approach is the
knowledge base on a drug, and the goal is
to optimize the treatable patient popula-
tion in an attempt to minimize the number
needed to treat (NNT) and/or to maximize
the number needed to harm (NNH)
66
.
Pharmacogenomics has considerable poten-
tial to stratify patients with a given condition
into treatment-eligible versus non-eligible
groups. The examples of trastuzumab and
abacavir show the power of predictive
pharmacogenomic biomarkers, but experi-
ence with pharmacogenomic (and in some
instances also phenotypic) biomarkers has
also highlighted a number of challenges for
drug regulators.
In the past, many pharmacogenomic bio-
markers have been identified retrospectively
that is, during the course of the develop-
ment of the drug in question and much of
the data presented to regulatory authorities
in support of such biomarkers raised ques-
tions of methodological validity and clinical
utility
19,67
.
The difficulty of ensuring an adequate
predictive value of the biomarker test, also
known as the companion diagnostic test, is
shown by the pitfalls of using immunohisto-
chemistry (IHC), a test with less than perfect
predictive value to guide EGFR-targeted
therapy. Some real target patients will remain
unidentified and will be denied effective
treatment (false-negative patients), whereas
other patients are unnecessarily exposed to
a drug with no benefits but potential adverse
effects (false-positive patients)
19
.
A different challenge is represented by
the question: how big a difference between
the subpopulations identified by a com-
panion diagnostic justifies a label claim?
To illustrate this issue we return to the gefi-
tinib case study. At least one controlled trial
showed that in patients with mutant EGFR,
progression free survival (PFS) was clearly
superior in the gefitinib group compared to
chemotherapy control, but PFS was inferior
to control in mutation-negative patients
68
.
Here, the biomarker provides a clear deci-
sion rule, as it differentiates subpopulations
for which the benefitrisk is dramatically
different. By contrast, an example of a less
than clear-cut genomic biomarker was
reported by Donnelly etal.
69
, who stud-
ied the association of a single nucleotide
polymorphism in the 3-hydroxy-3-methyl-
glutaryl coenzyme A reductase (HMGCR)
gene with the lipid-lowering response to
statins. Retrospective analysis identified
two strata of patients, one of which reached
the total cholesterol target level in 71.9% of
the cases, versus 49.0% in the other group
69
.
Considering the relatively benign safety
profile of statins at appropriate doses, one
may conclude that the benefitrisk is posi-
tive for both populations, and restricting
the label to the higher response stratum
may be unjustified. This case is not unique,
and several potential biomarkers do not
identify clearly positive or negative ben-
efitrisk strata, but merely define different
patient subpopulations with marginally
different benefitrisk. For clinicians and
patients, such biomarkers may have no
added value, but payers of health care
might decide to limit coverage of that drug
to the biomarker-defined high responder
group because all else being equal
cost effectiveness will be superior in that
group. This may even have negative con-
sequences, as biomarker stratification may
come to be seen not as a means to optimize
benefitrisk but to exclude patients from
(expensive) treatment. There is at least
one reported precedent of a payer using a
pharmacogenomic biomarker that is not
on the label of the drug to increase the cost
effectiveness of a therapy
19
. The widely
publicised debate around the clinical added
value of cytochrome P450 2C9 (CYP2C9)
and vitamin K epoxide reductase complex
subunit 1 (VKORC1) genotyping for bet-
ter dosing of the anticoagulant warfarin is
another useful case study demonstrating
the regulators challenges with tests that
address only part of the expected variability
in drug response. (For reviews of the warfa-
rin case, please refer to REFS7072.)
The availability of less than clear-cut pre-
dictive markers raises the question of whether
marker-negative patients can or should be
excluded from pivotal clinical trials. The
conundrum here is that focusing on expected
high responder groups will make the clini-
cal development phase faster and cheaper,
support the drug development endeavour
and bring novel treatment options to (some)
patients earlier; however, it may be ethically
challenging to exclude patients who may
potentially benefit, as in the case of HMGCR
gene stratification describedabove.
Solutions to these issues are, however,
beginning to emerge. Industry and the regu-
latory community have learned from past
experience. The pharmaceutical industry
Table 2 | Restrictions in the wording of regulatory drug labels in 2009
Indication as shown on the label or SmPC No. of drugs in United States
(n=25)
No. of drugs in EU
(n=29)
Broad, unrestricted* (for example, benign prostate hyperplasia) 18 17
Restricted to second-line (for example, carcinoma after failure
of prior platinum-containing regimen)
5 6
Restricted to advanced stage of disease (for example, cartilage
defects of grade III or IV)
2 2
Restricted to combination therapy (for example, rheumatoid
arthritis in combination with methotrexate)
0 3
Restricted to a pharmacogenomic subset (for example,
cancer with activating mutations of EGFR-TK)
0 1
For all new drugs approved in 2009, we reviewed the official labels (for US drugs) or the summary of product characteristics (SmPC) (for European Union (EU) drugs).
(For the EU, we reviewed only drugs that were approved by centralized procedure.) The list of new biologics and new molecular entities approved by the US Food
and Drug Administration (FDA) was obtained from REF.108, and the list of new active substances for the EU was obtained from REF.109. Label/SmPC information
was obtained from the websites of the FDA and European Medicines Agency (EMA). Only wording under the headings of Indications and usage (FDA) or
Therapeutic indication (EMA) was considered. Note that contraindications and warnings, which may also restrict the treatment-eligible population, were not
considered for this analysis. EGFR-TK, epidermal growth factor receptor tyrosine kinase. *Restrictions to age groups are also included under this heading (for
example, not approved for use in pediatric patients).
PERSPECTI VES
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | JULY 2011 | 501
nrd_3501_jul11.indd 501 20/06/2011 16:34
effectiveness trials might allow post-reg-
ulatory decision makers, such as payers of
health care or clinicians, to better judge to
whom results can reasonably be applied
to in a realistic health-care setting. However,
that benefit would come at a high price.
To explain the downside of a regulatory
effectiveness paradigm, we recall that inter-
pretation of RCT results can be considered
as a signal-to-noise problem. The majority
of regulatory clinical trials are superiority
showing that is, they aim to demonstrate
a statistically significant positive differ-
ence in observed outcome between a group
of patients receiving the test drug and a
control group, who are most often given
placebo. The higher the variability in the
trial (noise), the less likely it is that a differ-
ence (signal) can be shown even where
it exists. For instance, according to Koops
Law, poor adherence to the experimental
drug regimen by some patients will increase
variability and diminish the average effect
size. Sponsors of clinical trials are very
much aware of that risk and frequently seek
to maximize patient adherence by way of
patient reminders, frequent office visits or
building an initial placebo run-in phase into
the trial protocol; in the run-in phase, all
eligible patients receive placebo, and those
who are poorly compliant are excluded
before randomization. Such measures, often
referred to as enrichment (REF.57), are
expected to increase the signal-to-noise ratio
and the chance of the trial to be successful,
but they reduce external validity. Threats
to the signal-to-noise ratio may also come
from overly broad patient selection criteria,
such as the inadvertent inclusion of patients
with a viral infection into a study of a novel
antibacterialagent.
Effectiveness trials, in which condi-
tions are less stringently controlled, have
higher noise levels and the signal may be
reduced or lost in the noise (FIG.2). At a
minimum, this would result in much larger,
more expensive trials to achieve statistical
significance. In the worst case, it poses the
danger of missing potentially useful sub-
stances: a drug might be deemed ineffective
in a noisy effectiveness trial, even though
it may be beneficial to some patients under
some conditions. Depriving these patients
of valuable treatment options would amount
to a false-negative regulatory decision. The
pitfalls of requesting effectiveness data as
a basis for marketing authorization or of
allowing unlimited variation in premarket-
ing RCTs are also recognized by proponents
of PCTs, some of whom advocate PCTs as
more appropriate vehicles for examining
variation in prescriber or patient adherence
(REF. 18). We support this notion and draw
attention to the fact that the demonstration
of a drugs potential for delivering benefits
is a very different question from assessing
whether that potential is achieved in real
life. We argue that, in a situation in which
the internal validity of pre-licensing RCTs is
not in doubt but where there is an apparent
large gap between efficacy and effectiveness,
one is not looking at a drug problem but
at a health-care delivery problem, and the
focus of remedial action should be shifted to
improving real-life performance.
Bring up reality to the level of expectations.
In an ideal world of evidence-based medi-
cine, the label would exactly reflect the evi-
dence base that is, the treatment scenario
of regulatory clinical trials (step 1) and
drug utilization would conform to the label
(step 2). Alas, both steps cannot be easily
realized.
With regards to the first step, defin-
ing an indication strictly in line with the
clinical trial conditions is not an option,
and wording the label is usually a balancing
act for regulators who need to refrain from
overextrapolating the evidence base while
being mindful of practical constraints faced
by prescribers. For instance, one external
commentator chided regulators for overly
narrow labels:
the FDA approves [cancer drugs]
for indications so narrow (an artifact
of their archaic statistical evaluation
approaches), that most cancer drugs
actually are approved for different uses.
A colon cancer drug isnt approved by
[the] FDA to treat any colon cancer
patient at any time, but rather to treat,
for example, only those patients who
have exhausted all other approved
options, because that is the population
it was statistically tested in for approval.
Also, oncologists dont use cancer drugs
strictly in accordance with the FDAs
narrow approvals because doing so
simply wouldnt work to keep their
patients alive. (REF.58)
We reviewed the wording of the treat-
ment indications in the labels of new active
substances authorized in the year 2009 in
the United States and the EU (centralized
procedure only) (TABLE2). Our findings sup-
port the notion that the label is frequently
restricted to what some may consider an
artificial subset because, in most cases, the
limited indication reflects the clinical trial
scenarios. It is indeed biologically plausible
that some of the more narrowly authorized
drugs might be equally safe and effica-
cious in extended settings, such as first-line
therapy or monotherapy. However, too much
extrapolation in the wording of the label
would violate the principles of evidence-
based drug licensing. Overly broad labels
could rightfully be criticized as further
increasing variability and widening the
efficacyeffectiveness gap when extrapola-
tion turns out to be unjustified
59
. The cur-
rent model of drug licensing leaves limited
room for regulators to address the dilemma
between too wide or too narrow labels. It is
hoped that innovative approaches to licens-
ing such as staggered approval (or progres-
sive authorization) may in future better
align the knowledge of a drug with the label
claim
6062
.
The second step in this process ensur-
ing that drug utilization conforms to the
label is even more difficult to achieve as it
requires behavioural changes from all actors
in the medication use system and from
patients. Past attempts at reducing variability
of drug utilization, which were largely based
on motivational and educational efforts,
were not always successful
63
.
These considerations highlight that both
avenues to address the efficacyeffective-
ness gap are fraught with difficulties and
neither is likely to achieve satisfactory results
on its own. The most useful approach will
be to simultaneously address expectations
andreality.
The problem may also be framed from a
different angle. Drug effects good or bad
are the result of a successful or bad match
between a drug and a given patient. Drugs
may be more or less forgiving (REF.64);
those with a steep doseresponse relation-
ship, narrow therapeutic window and rapid
elimination are often less forgiving. Also,
some patients are more unforgiving than
others; for example, some patients may have
genetic traits that predispose them to an
adverse event or they may be taking multiple
concomitant medications. Poor therapeutic
outcomes result when an unforgiving drug
meets an unforgiving patient
65
, and the key
to bridging the efficacyeffectiveness gap is
to avoid poor matches. We propose that suc-
cessful attempts to this end will have to be
centred on two questions: which patient for
this drug? and which drug regimen for this
patient? Novel technologies will have to be
harnessed both for the pre- and post-licens-
ing lifespan of drugs. The call for action to
address the first question is directed mostly
to developers of drugs, regulators and payers
PERSPECTI VES
500 | JULY 2011 | VOLUME 10 www.nature.com/reviews/drugdisc
nrd_3501_jul11.indd 500 20/06/2011 16:34
52 | OCTOBER 2011 | THE FUTURE OF DRUG INNOVATION | NATURE REPRINT COLLECTION www.nature.com/reprintcollections/lilly/drug-innovation
Regulators could make a further contribu-
tion to addressing the efficacyeffectiveness
gap: in select cases in which external trial
validity is perceived to be low, or in which
problems associated with everyday clini-
cal use may be anticipated, the assessment
report could provide structured information
on expected relevance of pivotal trials to use
in practice along the lines of, for example,
the PRECIS framework
56
. At least one post-
licensing decision maker, the French Health
Technology Assessment body HAS (French
National Authority for Health), which advises
on the effectiveness and relative effectiveness
of drugs to inform reimbursement and pric-
ing decisions, has proposed a formal meth-
odological framework to predict effectiveness
based on regulatory efficacy trials and expert
input
81
. Time will tell whether this or similar
methods could be more widely used at the
time of licensing.
Which drug regimen for this patient?
The right drug, at the right dose, at the
right time, to the right patient has been at
the core of clinical pharmacology teaching
for decades
82
; it implies the consideration
of as many genotypic, phenotypic and envi-
ronmental patient variables as possible to
individualize drug regimes, considering all
available treatmentoptions.
Industry and regulators aim to design
drug development plans to generate the
information required for tailored dose
regimens to the extent that this is
possible. Covariate-adjusted analysis of
clinical trials has a long tradition in drug
development, and is often used to identify
patients for whom a treatment is more or
less beneficial
83
. Considerable progress
has been made over the past decade or
two in the use of pharmacokinetics/phar-
macodynamics modelling and simulation
(M&S) in drug development to study the
interrelationships among multiple factors
such as gender, age, feeding and fasting,
and comorbidities
84
. The use of M&S has
been encouraged by regulators for optimiz-
ing drug development and recommending
dose adjustments in defined subpopula-
tions, such as children, without specific,
full-powered studies
85
. It will be interesting
to explore how such methodologies could
be applied to observational post-marketing
studies aswell.
However, regulators, industry and payers
of health care can make further contribu-
tions, beyond intelligent pre-licensing trial
designs and analyses, to addressing the
behavioural side of the efficacyeffectiveness
gap (TABLE1).
Quality of prescribing. There has been no
shortage of attempts to promote evidence-
based prescribing and reduce inconsistency
in everyday patient care; training pro-
grammes, dedicated prescriber communi-
cations from regulators and industry, and
clinical practice guidelines have increasingly
been developed
8688
. However, many of these
efforts have had a limited effect on chang-
ing prescriber behaviour, and guideline
adoption is variable
89,90
, but the impact can
be substantial if appropriate measures are
taken, including a focus on ownership
91
. The
reasons for failure are multiple but include
the increasingly demanding health-care
environment for prescribers because of the
widening choice of medicines available,
expanding indications for drug treatment,
greater complexity of treatment regimens
and the pace of change in therapeutics; new
evidence on efficacy or emerging safety
signals mean that what is considered good
prescribing today may not necessarily be
considered so in a years time. Providing
health-care professionals with only printed
reference information, such as formularies
or Dear Health-Care Professional commu-
nications, may no longer be fit for purpose.
The information will not be available when
needed; prescribers simply do not have the
time to consult it as they make rapid point
of care decisions
63
. Against this background,
the burgeoning field of e-healthcare offers
unique opportunities to address prescribing
and medication errors. Advances with the
development of electronic health records,
computerized physician order entry (e-pre-
scribing), and decision support systems pro-
vide opportunities of linking patient-specific
information (for example, comorbidity and
renal insufficiency) with electronic drug-
specific information (for example, contrain-
dications and dose-modification guidance
92
).
Bringing these building blocks of e-health-
care together can help prescribers to improve
drug regimens by including patient-specific
alerts, such as for contraindications, limits of
recommended treatment duration or poten-
tial interactions between drugs prescribed by
different specialists (FIG.4).
Pilot schemes of complete computerized
physician order entry and e-prescribing
tools in outpatient care are currently being
tested
93,94
. Furthermore, integrated but lim-
ited clinical computerized decision support
applications aimed at guiding clinicians to
appropriately handle drug dosing and drug
interactions are now up and running
95,96
.
However, the full statutory label information
from drug regulatory bodies is not available
in a logical format that can interface with
the electronic health record and decision
support systems. The European Medicines
Agency is exploring ways to make label
information available at the time of licensing
in an electronic format that can be integrated
with the other building blocks of e-health-
care at point ofcare
63
.
Regulators have traditionally confined
themselves to providing information on the
rational use of drugs interference with
everyday prescribing was not part of their
role. Boundaries have somewhat changed
with the establishment of RMPs (in the EU)
and REMSs (in the United States). These
post-marketing activities are not limited to
risk assessment but may include a pro-active
risk mitigation component.
A useful example is the anti-epileptic
agent vigabatrin. Because of the potential
for visual loss, it was approved in the United
States with an REMS. One component of an
REMS is elements to assure safe use, which
function as a type of restricted distribution
system. The particular elements in this case
included special certification of health-care
providers who prescribe vigabatrin, special
certification of pharmacies that dispense
vigabatrin, a requirement that vigabatrin be
dispensed to patients with evidence or other
documentation of safe-use conditions, and
enrolment of each patient using vigabatrin
in a registry. In addition to this, the drug has
a dedicated implementation plan to facili-
tate ongoing benefitrisk assessments; all
patients receive a baseline ophthalmologic
evaluation and regular vision monitoring to
ensure that vigabatrin-induced vision loss
is detected as early as possible, and vigaba-
trin therapy is discontinued in patients
who experience an inadequate clinical
response
5
. This relatively new approach to
risk mitigation initiated by regulators may
be interpreted as interference with everyday
practice, but it is hoped that it will contribute
to a favourable benefitrisk profile in real
life, reducing the efficacyeffectivenessgap.
Patient adherence. The impact of poor
adherence on public health and the cost to
the health-care system are well understood
97
.
However, considerations of adherence do
not figure prominently in the evaluation
of pre-licensing trials, and the regulatory
analytical standard, the intention-to-treat
(ITT) analysis, is deliberately blind as to
whether individual patients followed the
treatment protocol. For some treatment
scenarios (such as time consuming, mul-
tiple drug inhalations for children and
adolescents with cystic fibrosis)
98
, it may be
justified to make trials adherence-informed,
PERSPECTI VES
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | JULY 2011 | 503
nrd_3501_jul11.indd 503 20/06/2011 16:34
0CVWTG4GXKGYU&TWI&KUEQXGT[
lniiul, nurrov liconso
(suqo 1)
Widor uion
ouluion
(lor oxumlo,
includinq
murlor-
noquivo
uions )
Clinicul
riuls undor
os-murloinq
commimon
lollov-on, vidor
liconso(s) (suqo 2,
und so on)
Lnricbod uion
ouluion vib bos
oxocod bono-risl
(lor oxumlo,
murlor-osiivo uions)
approach to stratified medicine has changed
fundamentally. In the past, retrospective
identification of responder populations was
sometimes a last resort for drugs that might
have failed for broader populations, but
now many research-based pharmaceutical
companies have modified their approach to
drug development and will routinely pursue
pro-active diagnostic biomarker strategies,
including DNA collection in all trials
19,73
.
This evolution may also reflect a more
fundamental realization by the drug devel-
opment community that the blockbuster
paradigm of old the attempt to maximize
the treatment-eligible population may
not be a winning strategy, and that the goal
should be to optimize the treatment-eligible
population. The change of mindsets is sup-
ported by increasingly powerful tools for
high-throughput genotyping, allowing drug
developers to economically assess ever more
genomic markers
74
.
Progress is also being made in the field
of co-development of targeted drugs and
their companion diagnostics. Regulators
have provided reflections on the key sci-
entific principles that need to be met to
ensure that the performance of the chosen
assay is sufficiently reliable to optimize drug
development and regulatory submission
67,75
.
Moreover, agencies have established consul-
tation procedures to enable the development
and qualification of biomarkers
76,77
.
Some adaptation of the current drug
regulatory paradigm may also be called for
to achieve the competing objectives of: full
exploitation of biomarker strategies for opti-
mization of the treatment-eligible popula-
tion; balancing the need for early access by
patients with a high degree of unmet need
with the ethical imperative to not exclude
other patients from potentially beneficial
treatments; and keeping the drug develop-
ment process efficient and sustainable.
An expert panel has recently proposed a
strategy for the approval of targeted cancer
drugs
73,78
. We would broaden that strategy
to include drugs for non-cancer conditions
and outline what may be called the onion
skin model of drug licensing (FIG.3). In a
drug development programme with a rea-
sonably good a priori chance of identifying
a high benefitrisk subgroup, initial drug
development would focus on marker posi-
tive patients. Marker-negative patients need
not be included in the initial study phase.
It follows that, in the first stage, the marker
need not be shown to predict lack of effect
in the marker-negative population. If the
benefitrisk profile was deemed favour-
able in marker-positive patients, an initial,
narrow license would be granted. In the next
stage, the company would need to assess, as
a post-marketing study, benefitrisk in the
marker-negative stratum (or define the use-
fulness of the test to predict lack of efficacy).
If successful, the label will be broadened to
include a larger treatment-eligible popula-
tion. The second stage is required only if
ethically acceptable, that is, in the absence of
convincing arguments that patients may be
unduly harmed by enrolment in these post-
marketing studies. In some instances, the
goal might most efficiently be achieved by
way of adaptive clinical trial design
78
.
The concept of staggered approval that
is, prioritizing development to an enriched
population of expected high-responders/
high-toleraters (FIG.3) would mark a
departure from the current practice, in some
therapeutic areas, of initially studying last-
line conditions such as cancer patients who
have failed standard treatment. We acknowl-
edge the ethical challenges, but submit that
the last-line first paradigm of enrolling
patients with multiresistant (for example,
cancer) or advanced (for example, autoim-
mune or degenerative) pathologies may
destine to fail potentially useful first-line
treatments
79,80
. Most likely, this form of stag-
gered approval will be based on pharmaco-
genomic biomarkers, but it may apply
equally well to phenotypicmarkers.
Biomarker-guided staggered approval
has the potential to reduce variability in
drug response and help to address the effi-
cacyeffectiveness gap, but there is a sine qua
non; drug utilization will have to mirror the
regulatory pathway. In the first instance, this
implies that regulatory and reimbursement
policies will need to be aligned as closely
as possible. Regulators allow access to the
market, but payers control which patient
groups will be able to receive the drug.
Hence, the success of novel development
paradigms will require an ongoing dialogue
between the regulatory and payers commu-
nities in a given jurisdiction. In the second
instance, alignment of the other actors in the
medication use system will be required, as
discussedbelow.
Figure 3 | The onion skin model of drug licensing. This approach to drug development and
licensing focuses initially on the patient strata with the best expected benefitrisk profile instead of
the sometimes practiced last-line first strategy. The gains from this initially limited focus are smaller
clinical trials and faster access for those patients who are expected to benefit most. The enriched
patient sample is selected by way of a (genotypic or phenotypic) biomarker. Biomarker-negative
patients need not be included in the initial study phase. If the benefitrisk profile was deemed
favourable in marker-positive patients, an initial, narrow license would be granted. In the next stage,
the company would need to assess, as a post-marketing commitment, benefitrisk in the marker-
negative strata. If successful, the label will be broadened to include a larger treatment-eligible
population. A drawback of this regulatory pathway is that the positive and negative predictive values
of the biomarker cannot be estimated during the initial phases of the development and licensing
process; the approach would most likely be justified and useful for drugs that have the potential to
address a high level of unmet medical need.
PERSPECTI VES
502 | JULY 2011 | VOLUME 10 www.nature.com/reviews/drugdisc
nrd_3501_jul11.indd 502 20/06/2011 16:34
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 53
Regulators could make a further contribu-
tion to addressing the efficacyeffectiveness
gap: in select cases in which external trial
validity is perceived to be low, or in which
problems associated with everyday clini-
cal use may be anticipated, the assessment
report could provide structured information
on expected relevance of pivotal trials to use
in practice along the lines of, for example,
the PRECIS framework
56
. At least one post-
licensing decision maker, the French Health
Technology Assessment body HAS (French
National Authority for Health), which advises
on the effectiveness and relative effectiveness
of drugs to inform reimbursement and pric-
ing decisions, has proposed a formal meth-
odological framework to predict effectiveness
based on regulatory efficacy trials and expert
input
81
. Time will tell whether this or similar
methods could be more widely used at the
time of licensing.
Which drug regimen for this patient?
The right drug, at the right dose, at the
right time, to the right patient has been at
the core of clinical pharmacology teaching
for decades
82
; it implies the consideration
of as many genotypic, phenotypic and envi-
ronmental patient variables as possible to
individualize drug regimes, considering all
available treatmentoptions.
Industry and regulators aim to design
drug development plans to generate the
information required for tailored dose
regimens to the extent that this is
possible. Covariate-adjusted analysis of
clinical trials has a long tradition in drug
development, and is often used to identify
patients for whom a treatment is more or
less beneficial
83
. Considerable progress
has been made over the past decade or
two in the use of pharmacokinetics/phar-
macodynamics modelling and simulation
(M&S) in drug development to study the
interrelationships among multiple factors
such as gender, age, feeding and fasting,
and comorbidities
84
. The use of M&S has
been encouraged by regulators for optimiz-
ing drug development and recommending
dose adjustments in defined subpopula-
tions, such as children, without specific,
full-powered studies
85
. It will be interesting
to explore how such methodologies could
be applied to observational post-marketing
studies aswell.
However, regulators, industry and payers
of health care can make further contribu-
tions, beyond intelligent pre-licensing trial
designs and analyses, to addressing the
behavioural side of the efficacyeffectiveness
gap (TABLE1).
Quality of prescribing. There has been no
shortage of attempts to promote evidence-
based prescribing and reduce inconsistency
in everyday patient care; training pro-
grammes, dedicated prescriber communi-
cations from regulators and industry, and
clinical practice guidelines have increasingly
been developed
8688
. However, many of these
efforts have had a limited effect on chang-
ing prescriber behaviour, and guideline
adoption is variable
89,90
, but the impact can
be substantial if appropriate measures are
taken, including a focus on ownership
91
. The
reasons for failure are multiple but include
the increasingly demanding health-care
environment for prescribers because of the
widening choice of medicines available,
expanding indications for drug treatment,
greater complexity of treatment regimens
and the pace of change in therapeutics; new
evidence on efficacy or emerging safety
signals mean that what is considered good
prescribing today may not necessarily be
considered so in a years time. Providing
health-care professionals with only printed
reference information, such as formularies
or Dear Health-Care Professional commu-
nications, may no longer be fit for purpose.
The information will not be available when
needed; prescribers simply do not have the
time to consult it as they make rapid point
of care decisions
63
. Against this background,
the burgeoning field of e-healthcare offers
unique opportunities to address prescribing
and medication errors. Advances with the
development of electronic health records,
computerized physician order entry (e-pre-
scribing), and decision support systems pro-
vide opportunities of linking patient-specific
information (for example, comorbidity and
renal insufficiency) with electronic drug-
specific information (for example, contrain-
dications and dose-modification guidance
92
).
Bringing these building blocks of e-health-
care together can help prescribers to improve
drug regimens by including patient-specific
alerts, such as for contraindications, limits of
recommended treatment duration or poten-
tial interactions between drugs prescribed by
different specialists (FIG.4).
Pilot schemes of complete computerized
physician order entry and e-prescribing
tools in outpatient care are currently being
tested
93,94
. Furthermore, integrated but lim-
ited clinical computerized decision support
applications aimed at guiding clinicians to
appropriately handle drug dosing and drug
interactions are now up and running
95,96
.
However, the full statutory label information
from drug regulatory bodies is not available
in a logical format that can interface with
the electronic health record and decision
support systems. The European Medicines
Agency is exploring ways to make label
information available at the time of licensing
in an electronic format that can be integrated
with the other building blocks of e-health-
care at point ofcare
63
.
Regulators have traditionally confined
themselves to providing information on the
rational use of drugs interference with
everyday prescribing was not part of their
role. Boundaries have somewhat changed
with the establishment of RMPs (in the EU)
and REMSs (in the United States). These
post-marketing activities are not limited to
risk assessment but may include a pro-active
risk mitigation component.
A useful example is the anti-epileptic
agent vigabatrin. Because of the potential
for visual loss, it was approved in the United
States with an REMS. One component of an
REMS is elements to assure safe use, which
function as a type of restricted distribution
system. The particular elements in this case
included special certification of health-care
providers who prescribe vigabatrin, special
certification of pharmacies that dispense
vigabatrin, a requirement that vigabatrin be
dispensed to patients with evidence or other
documentation of safe-use conditions, and
enrolment of each patient using vigabatrin
in a registry. In addition to this, the drug has
a dedicated implementation plan to facili-
tate ongoing benefitrisk assessments; all
patients receive a baseline ophthalmologic
evaluation and regular vision monitoring to
ensure that vigabatrin-induced vision loss
is detected as early as possible, and vigaba-
trin therapy is discontinued in patients
who experience an inadequate clinical
response
5
. This relatively new approach to
risk mitigation initiated by regulators may
be interpreted as interference with everyday
practice, but it is hoped that it will contribute
to a favourable benefitrisk profile in real
life, reducing the efficacyeffectivenessgap.
Patient adherence. The impact of poor
adherence on public health and the cost to
the health-care system are well understood
97
.
However, considerations of adherence do
not figure prominently in the evaluation
of pre-licensing trials, and the regulatory
analytical standard, the intention-to-treat
(ITT) analysis, is deliberately blind as to
whether individual patients followed the
treatment protocol. For some treatment
scenarios (such as time consuming, mul-
tiple drug inhalations for children and
adolescents with cystic fibrosis)
98
, it may be
justified to make trials adherence-informed,
PERSPECTI VES
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | JULY 2011 | 503
nrd_3501_jul11.indd 503 20/06/2011 16:34
0CVWTG4GXKGYU&TWI&KUEQXGT[
lniiul, nurrov liconso
(suqo 1)
Widor uion
ouluion
(lor oxumlo,
includinq
murlor-
noquivo
uions )
Clinicul
riuls undor
os-murloinq
commimon
lollov-on, vidor
liconso(s) (suqo 2,
und so on)
Lnricbod uion
ouluion vib bos
oxocod bono-risl
(lor oxumlo,
murlor-osiivo uions)
approach to stratified medicine has changed
fundamentally. In the past, retrospective
identification of responder populations was
sometimes a last resort for drugs that might
have failed for broader populations, but
now many research-based pharmaceutical
companies have modified their approach to
drug development and will routinely pursue
pro-active diagnostic biomarker strategies,
including DNA collection in all trials
19,73
.
This evolution may also reflect a more
fundamental realization by the drug devel-
opment community that the blockbuster
paradigm of old the attempt to maximize
the treatment-eligible population may
not be a winning strategy, and that the goal
should be to optimize the treatment-eligible
population. The change of mindsets is sup-
ported by increasingly powerful tools for
high-throughput genotyping, allowing drug
developers to economically assess ever more
genomic markers
74
.
Progress is also being made in the field
of co-development of targeted drugs and
their companion diagnostics. Regulators
have provided reflections on the key sci-
entific principles that need to be met to
ensure that the performance of the chosen
assay is sufficiently reliable to optimize drug
development and regulatory submission
67,75
.
Moreover, agencies have established consul-
tation procedures to enable the development
and qualification of biomarkers
76,77
.
Some adaptation of the current drug
regulatory paradigm may also be called for
to achieve the competing objectives of: full
exploitation of biomarker strategies for opti-
mization of the treatment-eligible popula-
tion; balancing the need for early access by
patients with a high degree of unmet need
with the ethical imperative to not exclude
other patients from potentially beneficial
treatments; and keeping the drug develop-
ment process efficient and sustainable.
An expert panel has recently proposed a
strategy for the approval of targeted cancer
drugs
73,78
. We would broaden that strategy
to include drugs for non-cancer conditions
and outline what may be called the onion
skin model of drug licensing (FIG.3). In a
drug development programme with a rea-
sonably good a priori chance of identifying
a high benefitrisk subgroup, initial drug
development would focus on marker posi-
tive patients. Marker-negative patients need
not be included in the initial study phase.
It follows that, in the first stage, the marker
need not be shown to predict lack of effect
in the marker-negative population. If the
benefitrisk profile was deemed favour-
able in marker-positive patients, an initial,
narrow license would be granted. In the next
stage, the company would need to assess, as
a post-marketing study, benefitrisk in the
marker-negative stratum (or define the use-
fulness of the test to predict lack of efficacy).
If successful, the label will be broadened to
include a larger treatment-eligible popula-
tion. The second stage is required only if
ethically acceptable, that is, in the absence of
convincing arguments that patients may be
unduly harmed by enrolment in these post-
marketing studies. In some instances, the
goal might most efficiently be achieved by
way of adaptive clinical trial design
78
.
The concept of staggered approval that
is, prioritizing development to an enriched
population of expected high-responders/
high-toleraters (FIG.3) would mark a
departure from the current practice, in some
therapeutic areas, of initially studying last-
line conditions such as cancer patients who
have failed standard treatment. We acknowl-
edge the ethical challenges, but submit that
the last-line first paradigm of enrolling
patients with multiresistant (for example,
cancer) or advanced (for example, autoim-
mune or degenerative) pathologies may
destine to fail potentially useful first-line
treatments
79,80
. Most likely, this form of stag-
gered approval will be based on pharmaco-
genomic biomarkers, but it may apply
equally well to phenotypicmarkers.
Biomarker-guided staggered approval
has the potential to reduce variability in
drug response and help to address the effi-
cacyeffectiveness gap, but there is a sine qua
non; drug utilization will have to mirror the
regulatory pathway. In the first instance, this
implies that regulatory and reimbursement
policies will need to be aligned as closely
as possible. Regulators allow access to the
market, but payers control which patient
groups will be able to receive the drug.
Hence, the success of novel development
paradigms will require an ongoing dialogue
between the regulatory and payers commu-
nities in a given jurisdiction. In the second
instance, alignment of the other actors in the
medication use system will be required, as
discussedbelow.
Figure 3 | The onion skin model of drug licensing. This approach to drug development and
licensing focuses initially on the patient strata with the best expected benefitrisk profile instead of
the sometimes practiced last-line first strategy. The gains from this initially limited focus are smaller
clinical trials and faster access for those patients who are expected to benefit most. The enriched
patient sample is selected by way of a (genotypic or phenotypic) biomarker. Biomarker-negative
patients need not be included in the initial study phase. If the benefitrisk profile was deemed
favourable in marker-positive patients, an initial, narrow license would be granted. In the next stage,
the company would need to assess, as a post-marketing commitment, benefitrisk in the marker-
negative strata. If successful, the label will be broadened to include a larger treatment-eligible
population. A drawback of this regulatory pathway is that the positive and negative predictive values
of the biomarker cannot be estimated during the initial phases of the development and licensing
process; the approach would most likely be justified and useful for drugs that have the potential to
address a high level of unmet medical need.
PERSPECTI VES
502 | JULY 2011 | VOLUME 10 www.nature.com/reviews/drugdisc
nrd_3501_jul11.indd 502 20/06/2011 16:34
54 | OCTOBER 2011 | THE FUTURE OF DRUG INNOVATION | NATURE REPRINT COLLECTION www.nature.com/reprintcollections/lilly/drug-innovation
have discussed the nonlinear interaction
of different sources of variability. It follows
that even large reductions in variance from
a single source may have counter-intuitively
small effects in reducing the overall variance
in drug response
46
. A more holistic effort
will therefore be required from all players
to tackle the efficacyeffectivenessgap.
Considering the time and cost of bringing
new drugs to market, it seems that attempts to
improve drug effectiveness in real life repre-
sent good value for money; this is a space with
low-hanging fruits that might substantially
improve public health. Revisiting Sir William
Oslers observation, when this potential is
realized, medicine might [indeed become]
a science and not an art.
Hans-Georg Eichler, Eric Abadie, Bruno Flamion,
Hubert Leufkens, Christian K.Schneider and Brigitte
Bloechl-Daum are at the European Medicines Agency,
London, UK.
Hans-Georg Eichler is also at the Massachusetts Institute
of Technology, Cambridge, Massachusetts, USA.
Eric Abadie is also at the European Medicines Agency
Committee for Medicinal Products for Human Use,
London, UK; and theGeneral Directorate Agence
Francaise de Securite Sanitaire des Produits de Sant
(AFSSAPS), Paris, France.
Alasdair Breckenridge is at the Medicines and
Healthcare Products Regulatory Agency, London, UK.
Bruno Flamion is also at the Agence Fdrale des
Mdicaments et des Produits de Sant, Brussels,
Belgium.
Lars L.Gustafsson is at the Division of Clinical
Pharmacology, Department of Laboratory Medicine,
Karolinska Institutet, Stockholm, Sweden.
Hubert Leufkens is also at the Utrecht Institute for
Pharmaceutical Sciences (UIPS), Utrecht,
The Netherlands.
Malcolm Rowland is at the Centre for Applied
Pharmacokinetic Research, School of Pharmacy and
Pharmaceutical Sciences, University of Manchester,
Manchester, UK.
Christian K.Schneider is also at the Paul-Ehrlich-Institut,
Langen, Germany; and the Twincore Centre for
Experimental and Clinical Infection Research,
Hannover, Germany.
Brigitte Bloechl-Daum is also at the Department of
Clinical Pharmacology, Medical University Vienna,
Vienna, Austria.
Correspondence to B.B.-D.
e-mail: brigitte.bloechl-daum@meduniwien.ac.at
doi: 10.1038/nrd3501
Disclaimer: The views expressed in this article are the
personal views of the authors and may not be
understood or quoted as being made on behalf of or
reflecting the position of the regulatory agencies,
health technology assessment bodies or other
organizations that the authors work for.
1. Danish Medicines Agency. Conclusions and
recommendations from the Pharmaceutical Forum.
Danish Medicines Agency [online], http://www.dkma.
dk/1024/visUKLSArtikel.asp?artikelID=17481
(2010).
2. Luce, B. R. et al. EBM, HTA, and CER: clearing the
confusion. Millbank Q. 88, 256276 (2010).
3. European Medicines Agency. European Medicines
Agency recommends measures to manage
contamination of heparin-containing medicines.
European Medicines Agency [online], http://www.ema.
europa.eu/ema/index.jsp?curl=pages/news_and_
events/news/2009/11/news_detail_000315.
jsp&murl=menus/news_and_events/news_and_
events.jsp&mid=WC0b01ac058004d5c1&jsenabled
=true (2008).
4. European Medicines Agency. Studies assessed by the
EMEA indicate no increased risk of developing cancer
for patients who have taken Viracept contaminated
with ethyl mesilate. European Medicines Agency
[online]. http://www.ema.europa.eu/ema/index.
jsp?curl=pages/news_and_events/news/2009/11/
news_detail_000292.jsp&murl=menus/news_and_
events/news_and_events.
jsp&mid=WC0b01ac058004d5c1 (2008).
5. Dal Pan, G. J., Blackburn, S. & Karwoski, C. in
Textbook of Pharmacoepidemiology (eds Strom, B. L.
& Kimmel, S. E.) (John Wiley & Sons, New Jersey), (in
the press).
6. Pocock, S. J. & Lubsen, J. More on subgroup analyses
in clinical trials. N.Engl. J.Med. 358, 2076 (2008).
7. Ingelman-Sundberg, M. Pharmacogenetics: an
opportunity for a safer and more efficient
pharmacotherapy. J. Intern. Med. 250, 186200
(2001).
8. Roses, A. D. Pharmacogenetics in drug discovery and
development: a translational perspective. Nature Rev.
Drug Discov. 7, 807817 (2008).
9. Pharoa, P. D. & Hollingworth, W. Cost effectiveness of
lowering cholesterol concentration with statins in
patients with and without pre-existing coronary heart
disease: life table method applied to health authority
population. BMJ 312, 14431448 (1996).
10. Poole, S. G. & Dooley, M. J. Off-label prescribing in
oncology. Support Care Cancer 12, 302305 (2004).
11. Hsien, L. et al. Off-label drug use among hospitalised
children: identifying areas with the highest need for
research. Pharm. World Sci. 30, 497502 (2008).
12. [No authors listed.] Guidance for off-label use of drugs.
Lancet Neurol. 7, 285 (2008).
13. Schosser, R. Risk/benefit evaluation of drugs: the role
of the pharmaceutical industry in Germany. Eur. Surg.
Res. 34, 203207 (2008).
14. Friedman, M. A. et al. The safety of newly approved
medicines: do recent market removals mean there is a
problem? JAMA 281, 17281734 (1999).
15. [No authors listed.] How a statin might destroy a drug
company. Lancet 361, 793 (2003).
16. European Medicines Agency. EPAR Avandia. European
Medicines Agency [online], http://www.ema.europa.eu/
docs/en_GB/document_library/EPAR_-_Assessment_
Report_-_Variation/human/000666/WC500021280.
pdf (2009).
17. Forslund, T. et al. Usage, risk and benefit of weight-
loss drugs in primary care. Journal of Obesity [online],
http://downloads.mts.hindawi.com/MTS-Files/JOBES/
papers/regular/459263.v2.pdf?AWSAccessKeyId=0C
X53QQSTHRYZZQRKA02&Expires=1305781317&
Signature=hAU9a2Tn5%2BKIOsuXtCdGERM0iqA%
3D (2010).
18. Center for Medical Technology Policy. Effectiveness
Guidance Document: Pragmatic Phase 3
Pharmaceutical Trials. Release Date: September 14,
2010. Center for Medical Technology Policy [online],
http://www.cmtpnet.org/cmtp-research/guidance-
documents/pragmatic-clinical-trials/PCT3EGD.pdf
(2010).
19. Petak, I. et al. Integrating molecular diagnostics into
anticancer drug discovery. Nature Rev. Drug Discov. 9,
523535 (2010).
20. Heerdink, E. R., Urquhart, J. & Leufkens, H. G.
Changes in prescribed doses after market introduction.
Pharmacoepidemiol. Drug Saf. 11, 447453 (2002).
21. Cross, J. et al. Postmarketing drug dosage changes of
499 FDA-approved new molecular entities, 1980
1999. Pharmacoepidemiol. Drug Saf. 11, 439446
(2002).
22. Trusheim, M. R. et al. Stratified medicine: strategic
and economic implications of combining drugs and
clinical biomarkers. Nature Rev. Drug Discov. 6,
287293 (2007).
23. European Medicines Agency. Herceptin EPAR.
European Medicines Agency [online], http://www.ema.
europa.eu/docs/en_GB/document_library/EPAR_-_
Product_Information/human/000278/
WC500074922.pdf (Last updated 19 May 2011).
24. Barron, J. J., Cziraky, M. J., Weisman, T. & Hicks, D. G.
HER2 testing and subsequent trastuzumab treatment
for breast cancer in a managed care environment.
Oncologist 14, 760768 (2009).
25. European Medicines Agency. EPAR Ziagen. European
Medicines Agency [online], http://www.ema.europa.eu/
docs/en_GB/document_library/EPAR_-_Product_
Information/human/000252/WC500050343.pdf (Last
updated 18 Apr 2011).
26. Stocco, G., Crews, K. R. & Evans, W. E. Genetic
polymorphism of inosine-triphosphate-
pyrophosphatase influences mercaptopurine
metabolism and toxicity during treatment of acute
lymphoblastic leukemia individualized for
thiopurine-S-methyl-transferase status. Expert Opin.
Drug Saf. 9, 2337 (2010).
27. Zaza, G., Granata, S., Sallustio, F., Grandaliano, G. &
Schena, F. P. Pharmacogenomics: a new paradigm to
personalize treatments in nephrology patients. Clin.
Exp. Immunol.159, 268280 (2010).
28. ICH Expert Working Group. International Conference
on Harmonisation Guideline E5(R1): Ethnic Factors in
the Acceptability of Foreign Clinical Data. ICH
Harmonisation For Better Health [online], http://www.
ich.org/fileadmin/Public_Web_Site/ICH_Products/
Guidelines/Efficacy/E5_R1/Step4/E5_R1__Guideline.
pdf (1998).
29. Falagas, M. E. & Karageorgopoulos, D. E. Adjustment
of dosing of antimicrobial agents for bodyweight in
adults. Lancet 375, 248251 (2010).
30. Kirsch, I. et al. Initial severity and antidepressant
benefits: a meta-analysis of data submitted to the
Food and Drug Administration. PLoS Med. 5,
260268 (2008).
31. van Staa, T.-P., Leufkens, H. G., Zhang, B. & Smeeth, L.
A comparison of cost effectiveness using data from
randomized trials or actual clinical practice: selective
Cox-2 inhibitors as an example. PLoS Med. 6,
e1000194 (2009).
32. Greenblatt, D. J. Analysis of drug interactions
involving fruit beverages and organic anion-
transporting polypeptides. J.Clin. Pharmacol. 49,
14031407 (2009).
33. Bailey, D. G. Fruit juice inhibition of uptake transport:
a new type of fooddrug interaction. Br. J.Clin.
Pharmacol. 70, 645655 (2010).
34. Klaasen, R., Wijbrandts, C. A., Gerlag, D. M. & Tak,
P. P. Body mass index and clinical response to
infliximab in rheumatoid arthritis. Arthritis Rheum.
63, 359364 (2011).
35. US Government Accountability Office: Report to the
Ranking Member, Committee on Finance, US Senate.
Prescription drugs: FDAs oversight of the promotion
of drugs for off-label uses; July 2008. US Government
Accountability Office [online], http://www.gao.gov/new.
items/d08835.pdf (2008).
36. Radley. D.C., Finkelstein, S.N. & Stafford, R. S. Off-
label prescribing among office-based physicians. Arch.
Intern. Med. 166,10211026 (2006).
37. Jonville-Bra, A. P., Bra, F. & Autret-Lecaq, E. Are
incorrectly used drugs more frequently involved in
adverse drug reactions? A retrospective study. Eur.
J.Clin. Pharmacol. 61, 231236 (2005).
38. Cereza, G., Pedros, C., Garcia, N. & Laporte, J. R.
Topiramate in non-approved indications and acute
myopia or angle-closure glaucoma. Br. J.Clin.
Pharmacol. 60, 578579 (2005).
39. Kohn, L. T., Corrigan, J. M., & Donaldson, M. S. (eds)
To Err is Human: Building a Safer Health System
(National Academy Press, Washington DC, 2000).
40. Bonaccorso, S. & Sturchio, J. L. Perspectives from the
pharmaceutical industry. BMJ 327, 863864
(2003).
41. WHO. Adherence to long-term therapies: evidence for
action. World Health Organization [online], http://
apps.who.int/medicinedocs/en/d/Js4883e/ (2003).
42. Urquhart, J. The odds of the three nons when an aptly
prescribed medicine isnt working: non-compliance,
non-absorption, non-response. Br. J.Clin. Pharmacol.
54, 212220 (2002).
43. Horwitz, R. I. et al. Treatment adherence and risk of
death after a myocardial infarction. Lancet 336,
542545 (1990).
44. Cramer, J. A, Benedict, , Muszbek, N.,
Keskinaslan,A. & Khan, Z. M. The significance of
compliance and persistence in the treatment of
diabetes, hypertension and dyslipidaemia: a review.
Int. J.Clin. Pract. 62, 7687 (2008).
45. Vrijens, B., Gross, R. & Urquhart, J. The odds that
clinically unrecognised poor or partial adherence
confuses population pharmacokinetic/
PERSPECTI VES
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | JULY 2011 | 505
nrd_3501_jul11.indd 505 20/06/2011 16:34
0CVWTG4GXKGYU&TWI&KUEQXGT[
Srucurod
druq
inlormuion
GNCDGN
o-boulbcuro
rocord
o-boulbcuro
duubusos
Pos-murloinq
rosourcb und moniorinq
Comuorizod
bysiciun ordor
onry
Docision
suor sysom
Aroriuo
roscribinq
for example by the use of electronic event
monitors (see below). This added informa-
tion could be used to estimate, in secondary
analyses and by way of modelling and simu-
lation, the effect of incomplete adherence
on effect size and may yield information
on the forgiveness of drugs that is, the
sensitivity of drug effects to sporadic non-
adherence. Osterberg etal.
99
have recently
discussed past experiences with different
study designs and monitoring strategies,
including a design called placebo-substitu-
tion-for-active, which has been applied to
oral contraceptive agents. (Oral contracep-
tives are useful to illustrate different levels
of forgiveness, even within one class: the
original high-dose oral contraceptives were
more forgiving of incomplete patient adher-
ence but had a higher likelihood of causing
thrombotic events compared with the low-
dose oral contraceptive products introduced
later
99
.)
There is now a broad range of proven,
emerging or proposed interventions and
technologies that may successfully improve
adherence. These are generally motivational
and include financial incentives to patients,
payment systems that reward care providers
for better patient outcomes
97,98
and, increas-
ingly, interventions based on information
and communication technologies (ICT).
Directly observed therapy (DOT) pro-
vides an early example of the power of
achieving continuity of patients exposure
to drugs to close the efficacyeffectiveness
gap. Started in the 1990s in New York City,
DOT programmes, in which health work-
ers watch patients take their medications,
have made noticeable reductions in the
numbers of new cases of tuberculosis and in
the incidence of drug-resistant tuberculo-
sis
100
.However, DOT is resource-intensive
and is not practically feasible in most treat-
ment scenarios.
A simple ICT-based example is offered
by a recent study into the effects of a mobile
phone message on antiretroviral treatment
adherence in Kenya: HIV-infected adults
were randomized to a mobile phone short
message service (SMS) intervention or
standard care. Patients in the intervention
group received weekly SMS messages from
a clinic nurse and were required to respond
within 48hours. After 6 and 12months,
patients who received SMS support had
significantly improved drug adherence and
rates of viral suppression compared with the
control individuals
101
. It may be surprising
that such an infrequent and basic interven-
tion would be effective, and it was specu-
lated that the SMS intervention worked by
improving communication and rapport
between health providers and patients;
patients reported during the pilot phase
that it feels like someone cares (REF.102).
Whatever the reasons for its effect, this study
and others evaluating relatively low-cost self-
titration schemes
103
demonstrate the poten-
tial of inexpensive behavioural interventions
on treatmenteffect.
More consistent drug use may also be
supported by technologies such as drug
packaging devices for example, intelligent
pill caps that use light and sound which
can be followed by timely phone calls or text
messages to remind patients to adhere to a
prescription regimen, to order refills from
the pharmacy, and to provide feedback to
care providers
104
.
Complex ingestible electronic systems
are currently in development to enable elec-
tronically observed therapy. For instance,
an edible sensor (consisting of an integrated
circuit embedded in a solid drug dosage
form) is activated after ingestion by stom-
ach fluid and communicates a signal to a
wearable monitor attached to the patients
torso like an adhesive bandage. The monitor
transmits the drug signature, time of intake
and physiological data to a mobile phone,
enabling a feedback loop that includes
reminders to take a particular drug dosage
to patients themselves, to their caregivers or
to health-care providers
105
. To our knowl-
edge, none of these systems has been fully
assessed and important questions about the
long-term clinical safety and utility of ingest-
ible systems remain to be addressed, but the
approach might prove useful in thefuture.
Some adherence-enhancing interventions
are already in routine use, but their potential
is not fully exploited. Non-persistent and
non-adherent patients represent a loss of
income for companies and a loss to payers,
as their investment will not result in the
expected health gain, and low adherence to
rational drug therapy may give rise to higher
overall health-care costs
106
. We are there-
fore surprised by a lack of enthusiasm from
industry and payers of health care to explore
and adopt these new technologies more
aggressively. Regulators should encourage
and support drug developers to consider
adherence-promoting technologies during
pre-marketing development and as a part of
RMPs orREMSs.
Conclusions
The recent availability of electronic health-
care databases for observational studies of
treatment outcomes and the expanded use of
PCTs
107
is likely to reveal a growing number
of incidences in which effectiveness does not
match efficacy. Some effectiveness data may
challenge the actions of all concerned
industry, regulators, payers and health-care
providers.
Pharmacogenomics and phenotypic
biomarkers and, perhaps, new licensing
approaches are expected to reduce but not
eliminate variability of drug response. We
Figure 4 | The role of electronic drug information in reducing the efficacyeffectiveness gap. Most
building blocks of e-healthcare are becoming a reality, but the electronic drug information (e-label)
an electronic, structured format of the authorized drug information remains the missing link
63
.
e-label information will be useful at the individual patientprescriber level and at the health-care
systems level. At point of care, the e-label is linked with patient-specific information from the
e-healthcare record (which is critical in e-prescribing) and with computer physician order entry systems
and their integrated decision-support-systems. e-label information supports prescribing decisions by
alerts with warnings or contraindications that are relevant for a specific patient. At the level of the
health-care system, payers, regulators or health-care managers may link e-label information with
population e-healthcare databases for comparative effectiveness research, post-licensing effectiveness
and safety monitoring, and monitoring of quality of health care.
PERSPECTI VES
504 | JULY 2011 | VOLUME 10 www.nature.com/reviews/drugdisc
nrd_3501_jul11.indd 504 20/06/2011 16:34
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 55
have discussed the nonlinear interaction
of different sources of variability. It follows
that even large reductions in variance from
a single source may have counter-intuitively
small effects in reducing the overall variance
in drug response
46
. A more holistic effort
will therefore be required from all players
to tackle the efficacyeffectivenessgap.
Considering the time and cost of bringing
new drugs to market, it seems that attempts to
improve drug effectiveness in real life repre-
sent good value for money; this is a space with
low-hanging fruits that might substantially
improve public health. Revisiting Sir William
Oslers observation, when this potential is
realized, medicine might [indeed become]
a science and not an art.
Hans-Georg Eichler, Eric Abadie, Bruno Flamion,
Hubert Leufkens, Christian K.Schneider and Brigitte
Bloechl-Daum are at the European Medicines Agency,
London, UK.
Hans-Georg Eichler is also at the Massachusetts Institute
of Technology, Cambridge, Massachusetts, USA.
Eric Abadie is also at the European Medicines Agency
Committee for Medicinal Products for Human Use,
London, UK; and theGeneral Directorate Agence
Francaise de Securite Sanitaire des Produits de Sant
(AFSSAPS), Paris, France.
Alasdair Breckenridge is at the Medicines and
Healthcare Products Regulatory Agency, London, UK.
Bruno Flamion is also at the Agence Fdrale des
Mdicaments et des Produits de Sant, Brussels,
Belgium.
Lars L.Gustafsson is at the Division of Clinical
Pharmacology, Department of Laboratory Medicine,
Karolinska Institutet, Stockholm, Sweden.
Hubert Leufkens is also at the Utrecht Institute for
Pharmaceutical Sciences (UIPS), Utrecht,
The Netherlands.
Malcolm Rowland is at the Centre for Applied
Pharmacokinetic Research, School of Pharmacy and
Pharmaceutical Sciences, University of Manchester,
Manchester, UK.
Christian K.Schneider is also at the Paul-Ehrlich-Institut,
Langen, Germany; and the Twincore Centre for
Experimental and Clinical Infection Research,
Hannover, Germany.
Brigitte Bloechl-Daum is also at the Department of
Clinical Pharmacology, Medical University Vienna,
Vienna, Austria.
Correspondence to B.B.-D.
e-mail: brigitte.bloechl-daum@meduniwien.ac.at
doi: 10.1038/nrd3501
Disclaimer: The views expressed in this article are the
personal views of the authors and may not be
understood or quoted as being made on behalf of or
reflecting the position of the regulatory agencies,
health technology assessment bodies or other
organizations that the authors work for.
1. Danish Medicines Agency. Conclusions and
recommendations from the Pharmaceutical Forum.
Danish Medicines Agency [online], http://www.dkma.
dk/1024/visUKLSArtikel.asp?artikelID=17481
(2010).
2. Luce, B. R. et al. EBM, HTA, and CER: clearing the
confusion. Millbank Q. 88, 256276 (2010).
3. European Medicines Agency. European Medicines
Agency recommends measures to manage
contamination of heparin-containing medicines.
European Medicines Agency [online], http://www.ema.
europa.eu/ema/index.jsp?curl=pages/news_and_
events/news/2009/11/news_detail_000315.
jsp&murl=menus/news_and_events/news_and_
events.jsp&mid=WC0b01ac058004d5c1&jsenabled
=true (2008).
4. European Medicines Agency. Studies assessed by the
EMEA indicate no increased risk of developing cancer
for patients who have taken Viracept contaminated
with ethyl mesilate. European Medicines Agency
[online]. http://www.ema.europa.eu/ema/index.
jsp?curl=pages/news_and_events/news/2009/11/
news_detail_000292.jsp&murl=menus/news_and_
events/news_and_events.
jsp&mid=WC0b01ac058004d5c1 (2008).
5. Dal Pan, G. J., Blackburn, S. & Karwoski, C. in
Textbook of Pharmacoepidemiology (eds Strom, B. L.
& Kimmel, S. E.) (John Wiley & Sons, New Jersey), (in
the press).
6. Pocock, S. J. & Lubsen, J. More on subgroup analyses
in clinical trials. N.Engl. J.Med. 358, 2076 (2008).
7. Ingelman-Sundberg, M. Pharmacogenetics: an
opportunity for a safer and more efficient
pharmacotherapy. J. Intern. Med. 250, 186200
(2001).
8. Roses, A. D. Pharmacogenetics in drug discovery and
development: a translational perspective. Nature Rev.
Drug Discov. 7, 807817 (2008).
9. Pharoa, P. D. & Hollingworth, W. Cost effectiveness of
lowering cholesterol concentration with statins in
patients with and without pre-existing coronary heart
disease: life table method applied to health authority
population. BMJ 312, 14431448 (1996).
10. Poole, S. G. & Dooley, M. J. Off-label prescribing in
oncology. Support Care Cancer 12, 302305 (2004).
11. Hsien, L. et al. Off-label drug use among hospitalised
children: identifying areas with the highest need for
research. Pharm. World Sci. 30, 497502 (2008).
12. [No authors listed.] Guidance for off-label use of drugs.
Lancet Neurol. 7, 285 (2008).
13. Schosser, R. Risk/benefit evaluation of drugs: the role
of the pharmaceutical industry in Germany. Eur. Surg.
Res. 34, 203207 (2008).
14. Friedman, M. A. et al. The safety of newly approved
medicines: do recent market removals mean there is a
problem? JAMA 281, 17281734 (1999).
15. [No authors listed.] How a statin might destroy a drug
company. Lancet 361, 793 (2003).
16. European Medicines Agency. EPAR Avandia. European
Medicines Agency [online], http://www.ema.europa.eu/
docs/en_GB/document_library/EPAR_-_Assessment_
Report_-_Variation/human/000666/WC500021280.
pdf (2009).
17. Forslund, T. et al. Usage, risk and benefit of weight-
loss drugs in primary care. Journal of Obesity [online],
http://downloads.mts.hindawi.com/MTS-Files/JOBES/
papers/regular/459263.v2.pdf?AWSAccessKeyId=0C
X53QQSTHRYZZQRKA02&Expires=1305781317&
Signature=hAU9a2Tn5%2BKIOsuXtCdGERM0iqA%
3D (2010).
18. Center for Medical Technology Policy. Effectiveness
Guidance Document: Pragmatic Phase 3
Pharmaceutical Trials. Release Date: September 14,
2010. Center for Medical Technology Policy [online],
http://www.cmtpnet.org/cmtp-research/guidance-
documents/pragmatic-clinical-trials/PCT3EGD.pdf
(2010).
19. Petak, I. et al. Integrating molecular diagnostics into
anticancer drug discovery. Nature Rev. Drug Discov. 9,
523535 (2010).
20. Heerdink, E. R., Urquhart, J. & Leufkens, H. G.
Changes in prescribed doses after market introduction.
Pharmacoepidemiol. Drug Saf. 11, 447453 (2002).
21. Cross, J. et al. Postmarketing drug dosage changes of
499 FDA-approved new molecular entities, 1980
1999. Pharmacoepidemiol. Drug Saf. 11, 439446
(2002).
22. Trusheim, M. R. et al. Stratified medicine: strategic
and economic implications of combining drugs and
clinical biomarkers. Nature Rev. Drug Discov. 6,
287293 (2007).
23. European Medicines Agency. Herceptin EPAR.
European Medicines Agency [online], http://www.ema.
europa.eu/docs/en_GB/document_library/EPAR_-_
Product_Information/human/000278/
WC500074922.pdf (Last updated 19 May 2011).
24. Barron, J. J., Cziraky, M. J., Weisman, T. & Hicks, D. G.
HER2 testing and subsequent trastuzumab treatment
for breast cancer in a managed care environment.
Oncologist 14, 760768 (2009).
25. European Medicines Agency. EPAR Ziagen. European
Medicines Agency [online], http://www.ema.europa.eu/
docs/en_GB/document_library/EPAR_-_Product_
Information/human/000252/WC500050343.pdf (Last
updated 18 Apr 2011).
26. Stocco, G., Crews, K. R. & Evans, W. E. Genetic
polymorphism of inosine-triphosphate-
pyrophosphatase influences mercaptopurine
metabolism and toxicity during treatment of acute
lymphoblastic leukemia individualized for
thiopurine-S-methyl-transferase status. Expert Opin.
Drug Saf. 9, 2337 (2010).
27. Zaza, G., Granata, S., Sallustio, F., Grandaliano, G. &
Schena, F. P. Pharmacogenomics: a new paradigm to
personalize treatments in nephrology patients. Clin.
Exp. Immunol.159, 268280 (2010).
28. ICH Expert Working Group. International Conference
on Harmonisation Guideline E5(R1): Ethnic Factors in
the Acceptability of Foreign Clinical Data. ICH
Harmonisation For Better Health [online], http://www.
ich.org/fileadmin/Public_Web_Site/ICH_Products/
Guidelines/Efficacy/E5_R1/Step4/E5_R1__Guideline.
pdf (1998).
29. Falagas, M. E. & Karageorgopoulos, D. E. Adjustment
of dosing of antimicrobial agents for bodyweight in
adults. Lancet 375, 248251 (2010).
30. Kirsch, I. et al. Initial severity and antidepressant
benefits: a meta-analysis of data submitted to the
Food and Drug Administration. PLoS Med. 5,
260268 (2008).
31. van Staa, T.-P., Leufkens, H. G., Zhang, B. & Smeeth, L.
A comparison of cost effectiveness using data from
randomized trials or actual clinical practice: selective
Cox-2 inhibitors as an example. PLoS Med. 6,
e1000194 (2009).
32. Greenblatt, D. J. Analysis of drug interactions
involving fruit beverages and organic anion-
transporting polypeptides. J.Clin. Pharmacol. 49,
14031407 (2009).
33. Bailey, D. G. Fruit juice inhibition of uptake transport:
a new type of fooddrug interaction. Br. J.Clin.
Pharmacol. 70, 645655 (2010).
34. Klaasen, R., Wijbrandts, C. A., Gerlag, D. M. & Tak,
P. P. Body mass index and clinical response to
infliximab in rheumatoid arthritis. Arthritis Rheum.
63, 359364 (2011).
35. US Government Accountability Office: Report to the
Ranking Member, Committee on Finance, US Senate.
Prescription drugs: FDAs oversight of the promotion
of drugs for off-label uses; July 2008. US Government
Accountability Office [online], http://www.gao.gov/new.
items/d08835.pdf (2008).
36. Radley. D.C., Finkelstein, S.N. & Stafford, R. S. Off-
label prescribing among office-based physicians. Arch.
Intern. Med. 166,10211026 (2006).
37. Jonville-Bra, A. P., Bra, F. & Autret-Lecaq, E. Are
incorrectly used drugs more frequently involved in
adverse drug reactions? A retrospective study. Eur.
J.Clin. Pharmacol. 61, 231236 (2005).
38. Cereza, G., Pedros, C., Garcia, N. & Laporte, J. R.
Topiramate in non-approved indications and acute
myopia or angle-closure glaucoma. Br. J.Clin.
Pharmacol. 60, 578579 (2005).
39. Kohn, L. T., Corrigan, J. M., & Donaldson, M. S. (eds)
To Err is Human: Building a Safer Health System
(National Academy Press, Washington DC, 2000).
40. Bonaccorso, S. & Sturchio, J. L. Perspectives from the
pharmaceutical industry. BMJ 327, 863864
(2003).
41. WHO. Adherence to long-term therapies: evidence for
action. World Health Organization [online], http://
apps.who.int/medicinedocs/en/d/Js4883e/ (2003).
42. Urquhart, J. The odds of the three nons when an aptly
prescribed medicine isnt working: non-compliance,
non-absorption, non-response. Br. J.Clin. Pharmacol.
54, 212220 (2002).
43. Horwitz, R. I. et al. Treatment adherence and risk of
death after a myocardial infarction. Lancet 336,
542545 (1990).
44. Cramer, J. A, Benedict, , Muszbek, N.,
Keskinaslan,A. & Khan, Z. M. The significance of
compliance and persistence in the treatment of
diabetes, hypertension and dyslipidaemia: a review.
Int. J.Clin. Pract. 62, 7687 (2008).
45. Vrijens, B., Gross, R. & Urquhart, J. The odds that
clinically unrecognised poor or partial adherence
confuses population pharmacokinetic/
PERSPECTI VES
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | JULY 2011 | 505
nrd_3501_jul11.indd 505 20/06/2011 16:34
0CVWTG4GXKGYU&TWI&KUEQXGT[
Srucurod
druq
inlormuion
GNCDGN
o-boulbcuro
rocord
o-boulbcuro
duubusos
Pos-murloinq
rosourcb und moniorinq
Comuorizod
bysiciun ordor
onry
Docision
suor sysom
Aroriuo
roscribinq
for example by the use of electronic event
monitors (see below). This added informa-
tion could be used to estimate, in secondary
analyses and by way of modelling and simu-
lation, the effect of incomplete adherence
on effect size and may yield information
on the forgiveness of drugs that is, the
sensitivity of drug effects to sporadic non-
adherence. Osterberg etal.
99
have recently
discussed past experiences with different
study designs and monitoring strategies,
including a design called placebo-substitu-
tion-for-active, which has been applied to
oral contraceptive agents. (Oral contracep-
tives are useful to illustrate different levels
of forgiveness, even within one class: the
original high-dose oral contraceptives were
more forgiving of incomplete patient adher-
ence but had a higher likelihood of causing
thrombotic events compared with the low-
dose oral contraceptive products introduced
later
99
.)
There is now a broad range of proven,
emerging or proposed interventions and
technologies that may successfully improve
adherence. These are generally motivational
and include financial incentives to patients,
payment systems that reward care providers
for better patient outcomes
97,98
and, increas-
ingly, interventions based on information
and communication technologies (ICT).
Directly observed therapy (DOT) pro-
vides an early example of the power of
achieving continuity of patients exposure
to drugs to close the efficacyeffectiveness
gap. Started in the 1990s in New York City,
DOT programmes, in which health work-
ers watch patients take their medications,
have made noticeable reductions in the
numbers of new cases of tuberculosis and in
the incidence of drug-resistant tuberculo-
sis
100
.However, DOT is resource-intensive
and is not practically feasible in most treat-
ment scenarios.
A simple ICT-based example is offered
by a recent study into the effects of a mobile
phone message on antiretroviral treatment
adherence in Kenya: HIV-infected adults
were randomized to a mobile phone short
message service (SMS) intervention or
standard care. Patients in the intervention
group received weekly SMS messages from
a clinic nurse and were required to respond
within 48hours. After 6 and 12months,
patients who received SMS support had
significantly improved drug adherence and
rates of viral suppression compared with the
control individuals
101
. It may be surprising
that such an infrequent and basic interven-
tion would be effective, and it was specu-
lated that the SMS intervention worked by
improving communication and rapport
between health providers and patients;
patients reported during the pilot phase
that it feels like someone cares (REF.102).
Whatever the reasons for its effect, this study
and others evaluating relatively low-cost self-
titration schemes
103
demonstrate the poten-
tial of inexpensive behavioural interventions
on treatmenteffect.
More consistent drug use may also be
supported by technologies such as drug
packaging devices for example, intelligent
pill caps that use light and sound which
can be followed by timely phone calls or text
messages to remind patients to adhere to a
prescription regimen, to order refills from
the pharmacy, and to provide feedback to
care providers
104
.
Complex ingestible electronic systems
are currently in development to enable elec-
tronically observed therapy. For instance,
an edible sensor (consisting of an integrated
circuit embedded in a solid drug dosage
form) is activated after ingestion by stom-
ach fluid and communicates a signal to a
wearable monitor attached to the patients
torso like an adhesive bandage. The monitor
transmits the drug signature, time of intake
and physiological data to a mobile phone,
enabling a feedback loop that includes
reminders to take a particular drug dosage
to patients themselves, to their caregivers or
to health-care providers
105
. To our knowl-
edge, none of these systems has been fully
assessed and important questions about the
long-term clinical safety and utility of ingest-
ible systems remain to be addressed, but the
approach might prove useful in thefuture.
Some adherence-enhancing interventions
are already in routine use, but their potential
is not fully exploited. Non-persistent and
non-adherent patients represent a loss of
income for companies and a loss to payers,
as their investment will not result in the
expected health gain, and low adherence to
rational drug therapy may give rise to higher
overall health-care costs
106
. We are there-
fore surprised by a lack of enthusiasm from
industry and payers of health care to explore
and adopt these new technologies more
aggressively. Regulators should encourage
and support drug developers to consider
adherence-promoting technologies during
pre-marketing development and as a part of
RMPs orREMSs.
Conclusions
The recent availability of electronic health-
care databases for observational studies of
treatment outcomes and the expanded use of
PCTs
107
is likely to reveal a growing number
of incidences in which effectiveness does not
match efficacy. Some effectiveness data may
challenge the actions of all concerned
industry, regulators, payers and health-care
providers.
Pharmacogenomics and phenotypic
biomarkers and, perhaps, new licensing
approaches are expected to reduce but not
eliminate variability of drug response. We
Figure 4 | The role of electronic drug information in reducing the efficacyeffectiveness gap. Most
building blocks of e-healthcare are becoming a reality, but the electronic drug information (e-label)
an electronic, structured format of the authorized drug information remains the missing link
63
.
e-label information will be useful at the individual patientprescriber level and at the health-care
systems level. At point of care, the e-label is linked with patient-specific information from the
e-healthcare record (which is critical in e-prescribing) and with computer physician order entry systems
and their integrated decision-support-systems. e-label information supports prescribing decisions by
alerts with warnings or contraindications that are relevant for a specific patient. At the level of the
health-care system, payers, regulators or health-care managers may link e-label information with
population e-healthcare databases for comparative effectiveness research, post-licensing effectiveness
and safety monitoring, and monitoring of quality of health care.
PERSPECTI VES
504 | JULY 2011 | VOLUME 10 www.nature.com/reviews/drugdisc
nrd_3501_jul11.indd 504 20/06/2011 16:34
56 | OCTOBER 2011 | THE FUTURE OF DRUG INNOVATION | NATURE REPRINT COLLECTION www.nature.com/reprintcollections/lilly/drug-innovation
0CVWTG4GXKGYU&TWI&KUEQXGT[
N
u
m
b
o
r
o
l
d
r
u
q
s
35
30
25
20
15
10
5
0
2004 2006 2007 2008 2009 2010 2003 2005
Your
lND NDA
14
1
20
4
30
11
21
2 2 2
1
0
24
21
21
24
applications (NDAs) and investigational new
drug applications (INDs) were approved in
China between 2003 and 2010. The novel
pharmaceuticals discussed in this article only
include chemical drugs in classes 1.1 and
1.2 and biological drugs in class 1, which are
defined by the SFDA as not being previously
approved for marketing as a drug anywhere
else in the world. Thus, the scope of novel
drugs in this article is narrower than that of
the new chemical entities (NCEs) used by the
US Food and Drug Administration (FDA).
For example, if a drug was first approved by
the FDA or the European Medicines Agency,
it would not be qualified as a class 1 new drug
by the SFDA when its approval is later sought
in China. Multinational pharmaceutical
companies usually market their drugs in
developed countries first, and in our survey,
all the innovative drugs approved as class
1 by the SFDA are from domestic Chinese
pharmaceutical companies. Consequently,
the class 1 approvals by the SFDA reflect
the status of innovative drug development
solely in domestic Chinese pharmaceutical
companies. Additionally, traditional Chinese
medicine and vaccines are not discussed here.
Analysis
In the period analysed, ~25 drug candidates
were approved for entry into clinical trials
(that is, an IND was granted) and an average
of four drugs were approved for marketing
per year (FIG. 1). However, there was a
significant reduction in the number of drugs
approved for marketing since 2006, with less
than two approvals per year in comparison
with the preceding years that ended with
11 approvals in 2005. This is primarily due
to the introduction by the SFDA in 2007 of
much more stringent rules and regulations
regarding new drug approval and
registration.
A total of 187 novel therapeutics are
currently in clinical trials. Nearly two-thirds
of the therapeutics are in Phase I trials, with
those in Phase II and III trials accounting for
19% and 22%, respectively (FIG. 2a). As shown
in FIG. 2b, oncology is the most common
therapeutic area (32% of therapeutics
analysed), followed by infectious diseases
(17%) and cardiovascular diseases (10%).
With a population of 1.3 billion people and
a rapidly expanding economy, China has
recently risen to become the third largest
pharmaceutical market globally, and it has
been predicted that this market will grow
by 2527% to a value of more than US$50
billion in 2011 (REF. 1). Although many of
the drugs in the current market are either
generic versions or developed outside
China, several multinational pharmaceutical
companies have now located research and
development (R&D) centres in China, and
Chinese pharmaceutical companies are
increasingly focusing on innovative drug
R&D. Furthermore, the Chinese government
implemented a special drug R&D funding
programme in which $2.7 billion was invested
from 2008 to 2010, with another $6 billion to
follow in the next 5 years.
However, information on the output of
innovative drug R&D in China is limited.
With the aim of addressing this issue, we
have collected and analysed information
from the Chinese State Food and Drug
Administration (SFDA) and the Center for
Drug Evaluation of the SFDA (CDE) for all
novel pharmaceuticals for which new drug
FROM THE ANALYSTS COUCH
Innovative drug R&D in China
Jingzong Qi, Qingli Wang, Zhenhang Yu, Xin Chen and Fengshan Wang
Arne Jacobsen: 1969.
Dansk Mobelkunst
Gallery www.dmk.dk
Figure 1 | Annual number of approved INDs
and NDAs for innovative drugs from Chinese
companies. Data were collected from the
website of the Chinese State Food and Drug
Administration (SFDA) and the Center for Drug
Evaluation of the SFDA. IND, investigational new
drug application; NDA, new drug application.
Bearing in mind the importance of
patent protection in drug R&D as well as the
evolution of Chinese patent law in recent
years, we also analysed the patenting of the
investigational therapeutics in China. Patents
for pharmaceuticals are divided into two
categories: compound patents and secondary
patents, which include preparation, detection,
pharmaceutical composition and usage.
Out of 187 investigational drugs, 70 have
compound patent protection in China,
whereas 23 have compound patent protection
in the United States and 16 in Europe (FIG. 2c).
We also investigated the characteristics of
those novel therapeutics that had patent
protection in either the United States or
Europe, which are presented in TABLE 1.
Outlook
The increased investment by the
Chinese government and multinational
pharmaceutical companies, as well as
other improvements (discussed below),
are creating a stronger environment for
innovative drug R&D in China. First, in the
past two decades, the Chinese regulatory
system has undergone a systematic
transformation to adapt to the emergence of
more INDs. The first drug administration
law in China was enacted in 1985, and
there have been four major amendments
since, with the latest one enacted in 2007.
As mentioned above, the SFDA (which
itself was founded in 2003) has introduced
more robust regulations regarding new drug
approval and registration, and to improve
transparency and efficiency, which could
pave the way for the emergence of more
innovative drugs in the long term. For
example, the registration status of an IND
or NDA is publicly available, and applicants
have easy access to all information regarding
the approval process for their drugs. Local
agencies of the SFDA are authorized to
conduct preliminary approval procedures
to increase efficiency. Companies that
provide false information or samples will be
penalized and barred from submitting NDAs
for up to 3 years.
Patent protection is a second factor that
is essential in innovative drug development.
The current Chinese patent law was enacted
doi:10.1038/nrd3435
NEWS & ANALYSI S
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | MAY 2011 | 333
nrd_3435_may11.indd 333 14/04/2011 11:49
pharmacodynamic analyses. Basic Clin. Pharmacol.
Toxicol. 96, 225227 (2005).
46. Urquhart, J. Getting a handle on why good drugs
sometimes dont work. J.R.Coll. Physicians Edinb.
34, 9598 (2004).
47. Centers for Disease Control and Prevention.
Achievements in Public Health, 19001999 Family
Planning. MMWR Morb. Mortal. Wkly. Rep. 48,
10731080 (1999).
48. Vrijens, B. et al. Modellling the association between
adherence and viral load in HIV-infected patients. Stat.
Med. 24, 27192731 (2005).
49. Vrijens, B. & Urquhart, J. Patient adherence to
prescribed antimicrobial drug dosing regimens.
J.Antimicrob. Chemother. 55, 616627 (2005).
50. Olfson, M., West, J. C., Wilk, J. E. & Marcus, S. Factors
affecting the effectiveness of clinical decisions in
treating schizophrenia. in Proc. of the American
Psychiatric Assoc. 156th Annual Meeting
(1722May 2003; San Francisco, California, USA;
Abstract S28C).
51. Vrijens, B., Vincze, G., Kristanto, P., Urquhart, J. &
Burnier, M. Adherence to prescribed antihypertensive
drug treatments: longitudinal study of electronically
compiled dosing histories. BMJ 336, 11141117
(2008).
52. Vincent, O. et al. Effect of concomitant CYP2D6
inhibitor use and tamoxifen adherence on breast
cancer recurrence in early-stage breast cancer. J. Clin.
Oncol. 28, 24232429 (2010).
53. Saevarsdottir, S. et al. Patients with early rheumatoid
arthritis who smoke are less likely to respond to
treatment with methotrexate and tumor necrosis
factor inhibitors. Arthtitis Rheum. 63. 2636 (2011).
54. Harter, J. G. & Peck, C. C. Chronobiology: suggestions
for integrating it into drug development. Ann.
N.Y.Acad. Sci. 618, 563571 (1991).
55. Rothwell, P. M. Factors that can affect the external
validity of randomised controlled trials. PLoS Clin.
Trials 1, e9 (2006).
56. Thorpe, K. E. et al. A pragmatic-explanatory
continuum indicator summary (PRECIS): a tool to help
trial designers. CMAJ 180, e47e57 (2009).
57. Temple, R. Enrichment of clinical study populations.
Clin. Pharmacol. Ther. 88, 774778 (2010).
58. Goldstein, J. Why Medicare Pays so Much For Cancer
Drugs. European Medicines Agency. Wall Street
Journal [online], http://blogs.wsj.com/
health/2009/01/27/why-medicare-pays-so-much-for-ca
ncer-drugs/tab/comments/ (2009).
59. Barbui, C. & Garattini, S. Regulatory policies on
medicines for psychiatric disorders: is Europe on
target? Br. J.Psychiatry 190, 9193 (2007).
60. Woosley, R. L. & Rice, G. A new system for moving drugs
to market. Issues Sci. Technol. XXI, 6368 (2005).
61. Eichler, H. G., Pignatti, F., Flamion, B., Leufkens, H. &
Breckenridge, A. Balancing early market access to new
drugs with the need for benefit/risk data: a mounting
dilemma. Nature Rev. Drug Discov. 7, 818826
(2008).
62. [No authors listed.] Road map to 2015. European
Medicines Agency [online], http://www.ema.europa.eu/
docs/en_GB/document_library/Report/2011/01/
WC500101373.pdf (2010).
63. Maxwell, S., Eichler, H. G., Bucsics, A., Haefeli, W. E. &
Gustafsson, L.L. on behalf of the e-SPC consortium.
e-SPC delivering drug information in the 21st
century: developing new approaches to deliver drug
information to prescribers. Br. J.Clin. Pharmacol. 6Apr
2011 (doi:10.1111/j.136521252011.03981.x.).
64. Urquhart, J. Patient noncompliance with drug
regimens: measurement, clinical correlates, economic
impact. Eur. Heart J. 17 (Suppl. A), 815 (1996).
65. Leufkens, H. G. & Urquhart, J. Variability in patterns of
drug usage. J.Pharm. Pharmacol. 46 (Suppl. 1),
433437 (1994).
66. McQuay, H. J. & Moore, R. A. Using numerical results
from systematic reviews in clinical practice. Ann.
Intern. Med. 126, 712720 (1997).
67. Woodcock J. Assessing the clinical utility of diagnostics
used in drug therapy. Clin. Pharmacol. Ther. 88,
765773 (2010).
68. Mok, T. S. et al. Gefitinib or carboplatin-paclitaxel in
pulmonary adenocarcinoma. N.Engl. J. Med. 361,
947957 (2009).
69. Donnelly, L. A. et al. A paucimorphic variant in the
HMG-CoA reductase gene is associated with lipid-
lowering response to statin treatment in diabetes: a
GoDARTS study. Pharmacogenet. Genomics 18,
10211026 (2008).
70. Flockhart, D. A. Pharmacogenetic testing of CYP2C9
and VKORC1 alleles for warfarin. Genet. Med. 10,
139150 (2008).
71. Ginsburg, G. S. & Voora, D. The long and winding road
to warfarin pharmacogenetic testing. J.Am. Coll.
Cardiol. 55, 28132815 (2010).
72. Kamali, F. & Wynne, H. Pharmacogenetics of warfarin.
Annu. Rev. Med. 61, 6375 (2010).
73. Schilsky, R. L. Personalised medicine in oncology.
Nature Rev. Drug Discov. 9, 363366 (2010).
74. Roses, A. D. Pharmacogenetics in drug discovery and
development: a translational perspective. Nature Rev.
Drug Discov. 7, 807817 (2008).
75. European Medicines Agency. Reflection paper on
co-development of pharmacogenomic biomarkers and
assays in the context of drug development. European
Medicines Agency [online], http://www.ema.europa.eu/
docs/en_GB/document_library/Scientific_
guideline/2010/07/WC500094445.pdf (2010).
76. FDA. International Pharmaceutical Regulatory
Monitor: US FDA draft guidance explains new drug
development tools. FDA News [online], http://www.
fdanews.com/newsletter/article?issueId=14226&artic
leId=131972 (2010).
77. European Medicines Agency. Qualification of novel
methodologies for drug development: guidance to
applicants. European Medicines Agency [online],
http://www.ema.europa.eu/docs/en_GB/document_
library/Regulatory_and_procedural_
guideline/2009/10/WC500004201.pdf (2009).
78. McClellan, M. et al. An accelerated pathway for
targeted cancer therapies. Nature Rev. Drug Discov.
10, 7980 (2011).
79. [No authors listed.] Rethinking therapeutic cancer
vaccines. Nature Rev. Drug Discov. 8, 685686
(2009).
80. Hampel, H. et al. Biomarkers for Alzheimers disease
therapeutic trials. Prog. Neurobiol. 2Dec 2010
(doi:10.1016/j.pneurobio.2010.11.005).
81. Falissard, B. et al. Relative effectiveness assessment of
listed drugs (REAL): a new method for an early
comparison of the effectiveness of approved health
technologies. Int. J.Technol. Assess Health Care 26,
124130 (2010).
82. Birkett, D. et al. Clinical pharmacology in research,
teaching and health care: considerations by IUPHAR,
the Inter-national Union of Basic and Clinical
Pharmacology. Basic Clin. Pharmacol. Toxicol. 107,
531559 (2010).
83. Pocock, S. J., Assmann, S. E., Enos, L. E. & Kasten, L. E.
Subgroup analysis, covariate adjustment and
baseline comparisons in clinical trial reporting: current
practice and problems. Stat. Med. 21, 29172930
(2002).
84. Aarons, L. et al. Role of modelling and simulation in
Phase I drug development. Eur. J.Pharm. Sci. 13,
115122 (2001).
85. Manolis, E. & Pons, G. Proposals for model-based
paediatric medicinal development within the current
European Union regulatory framework. Br. J.Clin.
Pharmacol. 68, 493501 (2009).
86. [No authors listed.] How to reduce prescribing errors.
Lancet 374, 1945 (2009).
87. [No authors listed.] Evidence-based Practice Centres:
synthesizing scientific evidence to improve quality and
effectiveness in health care. Agency for Healthcare
Research and Quality [online], http://www.ahrq.gov/
clinic/epc/ (2011).
88. Bahri, P. Public pharmacovigilance communication:
a process calling for evidence-based, objective-driven
strategies. Drug Saf. 33,10651079 (2010).
89. Smalley, W. et al. Contraindicated use of cisapride:
impact of food and drug administration regulatory
action. JAMA 284, 30363039 (2000).
90. John, J. et al. HER2 testing and subsequent
trastuzumab treatment for breast cancer in a
managed care environment. Oncologist 14, 760768
(2009).
91. Gustafsson, L. L. et al. The Wise List a
comprehensive concept to select, communicate and
achieve recommendations of essential drugs in
ambulatory care in Stockholm. Basic Clin. Pharmacol.
Toxicol.108, 224233 (2011).
92. Shea, S. & Hripcsak, G. Accelerating the use of
electronic health records in physician practices.
N.Engl. J.Med. 362, 192195 (2010).
93. Sjborg, B. et al. Design and implementation of a
point-of-care computerized system for drug therapy in
Stockholm metropolitan health region-bridging the
gap between knowledge and practice. Int. J.Med.
Inform. 76, 497506 (2007).
94. Classen, D. C., Avery, A. J. & Bates, D. W. Evaluation
and certification of computerized provider order entry
systems. J.Am. Med. Inform. Assoc. 14, 4855
(2007).
95. Bttiger, Y. et al. SFINX a drugdrug interaction
database desgined for clinical decision support
systems. Eur. J.Clin. Pharmacol. 95, 627633
(2009).
96. Wettermark, B. et al. The new Swedish Prescribed
Drug Registeropportunities for
pharmacoepidemiological research and experience
from the first six months. Pharmacoepidemiol. Drug
Saf. 16, 726735 (2007).
97. Cutler, D. & Everett, W. Thinking outside the pillbox
medication adherence as a priority for health care
reform. N.Engl. J.Med. 362, 15531555
(2010).
98. Modi, A. C. & Quittner, A. L. Barriers to treatment
adherence for children with cystic fibrosis and asthma:
what gets in the way? J.Pediatr. Psychol. 31,
846858 (2006).
99. Osterberg, L. G., Urquhart, J. & Blaschke, T. F.
Understanding forgiveness: minding and mining the
gaps between pharmacokinetics and therapeutics.
Clin. Pharmacol. Ther. 88, 457459 (2010).
100. Frieden, T. R., Fujiwara, P. I., Washko, R. M. &
Hamburg, M. A. Tuberculosis in New York City
turning the tide. N.Engl. J.Med. 333, 229233
(1995).
101. Lester, R. T. et al. Effects of a mobile phone short
message service on antiretroviral treatment adherence
in Kenya (WelTel Kenya1): a randomised trial. Lancet
376, 18381845 (2010).
102. Chi, B. H. & Stringer, J. S. A. Mobile phones to
improve HIV treatment adherence. Lancet 376,
18071808 (2010).
103. Ogedegbe G. Self-titration for treatment of
uncomplicated hypertension. Lancet 376, 144146
(2010).
104. Singer, E. Message from a pill bottle. Technology
Review [online], http://www.technologyreview.com/
business/26414/?p1=A4 (2010).
105. Au-Yeung, K. Y. et al. A networked system for self-
management of drug therapy and wellness. ACM
Digital Library [online], http://delivery.acm.
org/10.1145/1930000/1921083/p1-au-yeung.pdf?ke
y1=1921083&key2=9929465921&coll=DL&dl=
ACM&CFID=7014173&CFTOKEN=96965669
(2010).
106. Sokol, M. C., McGuigan, K. A., Verbrugge, R. R. &
Epstein, R. S. Impact of medication adherence on
hospitalization risk and healthcare cost. Med. Care
43, 521530 (2005).
107. Ware, J. H. & Hamel, M. B. Pragmatic trials guide
to better patient care? N.Engl. J. Med. 364,
16851687 (2011).
108. Hughes, B. 2009 FDA drug approvals. Nature Rev.
Drug Discov. 9, 8992 (2010).
109. Eichler, H. G., Aronsson, B., Abadie, E. & Salmonson, T.
New drug approval success rate in Europe
in 2009. Nature Rev. Drug Discov. 9, 355356
(2010).
Competing interests statement
The authors declare no competing financial interests.
PERSPECTI VES
506 | JULY 2011 | VOLUME 10 www.nature.com/reviews/drugdisc
nrd_3501_jul11.indd 506 20/06/2011 16:34
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 57
0CVWTG4GXKGYU&TWI&KUEQXGT[
N
u
m
b
o
r
o
l
d
r
u
q
s
35
30
25
20
15
10
5
0
2004 2006 2007 2008 2009 2010 2003 2005
Your
lND NDA
14
1
20
4
30
11
21
2 2 2
1
0
24
21
21
24
applications (NDAs) and investigational new
drug applications (INDs) were approved in
China between 2003 and 2010. The novel
pharmaceuticals discussed in this article only
include chemical drugs in classes 1.1 and
1.2 and biological drugs in class 1, which are
defined by the SFDA as not being previously
approved for marketing as a drug anywhere
else in the world. Thus, the scope of novel
drugs in this article is narrower than that of
the new chemical entities (NCEs) used by the
US Food and Drug Administration (FDA).
For example, if a drug was first approved by
the FDA or the European Medicines Agency,
it would not be qualified as a class 1 new drug
by the SFDA when its approval is later sought
in China. Multinational pharmaceutical
companies usually market their drugs in
developed countries first, and in our survey,
all the innovative drugs approved as class
1 by the SFDA are from domestic Chinese
pharmaceutical companies. Consequently,
the class 1 approvals by the SFDA reflect
the status of innovative drug development
solely in domestic Chinese pharmaceutical
companies. Additionally, traditional Chinese
medicine and vaccines are not discussed here.
Analysis
In the period analysed, ~25 drug candidates
were approved for entry into clinical trials
(that is, an IND was granted) and an average
of four drugs were approved for marketing
per year (FIG. 1). However, there was a
significant reduction in the number of drugs
approved for marketing since 2006, with less
than two approvals per year in comparison
with the preceding years that ended with
11 approvals in 2005. This is primarily due
to the introduction by the SFDA in 2007 of
much more stringent rules and regulations
regarding new drug approval and
registration.
A total of 187 novel therapeutics are
currently in clinical trials. Nearly two-thirds
of the therapeutics are in Phase I trials, with
those in Phase II and III trials accounting for
19% and 22%, respectively (FIG. 2a). As shown
in FIG. 2b, oncology is the most common
therapeutic area (32% of therapeutics
analysed), followed by infectious diseases
(17%) and cardiovascular diseases (10%).
With a population of 1.3 billion people and
a rapidly expanding economy, China has
recently risen to become the third largest
pharmaceutical market globally, and it has
been predicted that this market will grow
by 2527% to a value of more than US$50
billion in 2011 (REF. 1). Although many of
the drugs in the current market are either
generic versions or developed outside
China, several multinational pharmaceutical
companies have now located research and
development (R&D) centres in China, and
Chinese pharmaceutical companies are
increasingly focusing on innovative drug
R&D. Furthermore, the Chinese government
implemented a special drug R&D funding
programme in which $2.7 billion was invested
from 2008 to 2010, with another $6 billion to
follow in the next 5 years.
However, information on the output of
innovative drug R&D in China is limited.
With the aim of addressing this issue, we
have collected and analysed information
from the Chinese State Food and Drug
Administration (SFDA) and the Center for
Drug Evaluation of the SFDA (CDE) for all
novel pharmaceuticals for which new drug
FROM THE ANALYSTS COUCH
Innovative drug R&D in China
Jingzong Qi, Qingli Wang, Zhenhang Yu, Xin Chen and Fengshan Wang
Arne Jacobsen: 1969.
Dansk Mobelkunst
Gallery www.dmk.dk
Figure 1 | Annual number of approved INDs
and NDAs for innovative drugs from Chinese
companies. Data were collected from the
website of the Chinese State Food and Drug
Administration (SFDA) and the Center for Drug
Evaluation of the SFDA. IND, investigational new
drug application; NDA, new drug application.
Bearing in mind the importance of
patent protection in drug R&D as well as the
evolution of Chinese patent law in recent
years, we also analysed the patenting of the
investigational therapeutics in China. Patents
for pharmaceuticals are divided into two
categories: compound patents and secondary
patents, which include preparation, detection,
pharmaceutical composition and usage.
Out of 187 investigational drugs, 70 have
compound patent protection in China,
whereas 23 have compound patent protection
in the United States and 16 in Europe (FIG. 2c).
We also investigated the characteristics of
those novel therapeutics that had patent
protection in either the United States or
Europe, which are presented in TABLE 1.
Outlook
The increased investment by the
Chinese government and multinational
pharmaceutical companies, as well as
other improvements (discussed below),
are creating a stronger environment for
innovative drug R&D in China. First, in the
past two decades, the Chinese regulatory
system has undergone a systematic
transformation to adapt to the emergence of
more INDs. The first drug administration
law in China was enacted in 1985, and
there have been four major amendments
since, with the latest one enacted in 2007.
As mentioned above, the SFDA (which
itself was founded in 2003) has introduced
more robust regulations regarding new drug
approval and registration, and to improve
transparency and efficiency, which could
pave the way for the emergence of more
innovative drugs in the long term. For
example, the registration status of an IND
or NDA is publicly available, and applicants
have easy access to all information regarding
the approval process for their drugs. Local
agencies of the SFDA are authorized to
conduct preliminary approval procedures
to increase efficiency. Companies that
provide false information or samples will be
penalized and barred from submitting NDAs
for up to 3 years.
Patent protection is a second factor that
is essential in innovative drug development.
The current Chinese patent law was enacted
NEWS & ANALYSI S
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | MAY 2011 | 333
nrd_3435_may11.indd 333 14/04/2011 11:49
pharmacodynamic analyses. Basic Clin. Pharmacol.
Toxicol. 96, 225227 (2005).
46. Urquhart, J. Getting a handle on why good drugs
sometimes dont work. J.R.Coll. Physicians Edinb.
34, 9598 (2004).
47. Centers for Disease Control and Prevention.
Achievements in Public Health, 19001999 Family
Planning. MMWR Morb. Mortal. Wkly. Rep. 48,
10731080 (1999).
48. Vrijens, B. et al. Modellling the association between
adherence and viral load in HIV-infected patients. Stat.
Med. 24, 27192731 (2005).
49. Vrijens, B. & Urquhart, J. Patient adherence to
prescribed antimicrobial drug dosing regimens.
J.Antimicrob. Chemother. 55, 616627 (2005).
50. Olfson, M., West, J. C., Wilk, J. E. & Marcus, S. Factors
affecting the effectiveness of clinical decisions in
treating schizophrenia. in Proc. of the American
Psychiatric Assoc. 156th Annual Meeting
(1722May 2003; San Francisco, California, USA;
Abstract S28C).
51. Vrijens, B., Vincze, G., Kristanto, P., Urquhart, J. &
Burnier, M. Adherence to prescribed antihypertensive
drug treatments: longitudinal study of electronically
compiled dosing histories. BMJ 336, 11141117
(2008).
52. Vincent, O. et al. Effect of concomitant CYP2D6
inhibitor use and tamoxifen adherence on breast
cancer recurrence in early-stage breast cancer. J. Clin.
Oncol. 28, 24232429 (2010).
53. Saevarsdottir, S. et al. Patients with early rheumatoid
arthritis who smoke are less likely to respond to
treatment with methotrexate and tumor necrosis
factor inhibitors. Arthtitis Rheum. 63. 2636 (2011).
54. Harter, J. G. & Peck, C. C. Chronobiology: suggestions
for integrating it into drug development. Ann.
N.Y.Acad. Sci. 618, 563571 (1991).
55. Rothwell, P. M. Factors that can affect the external
validity of randomised controlled trials. PLoS Clin.
Trials 1, e9 (2006).
56. Thorpe, K. E. et al. A pragmatic-explanatory
continuum indicator summary (PRECIS): a tool to help
trial designers. CMAJ 180, e47e57 (2009).
57. Temple, R. Enrichment of clinical study populations.
Clin. Pharmacol. Ther. 88, 774778 (2010).
58. Goldstein, J. Why Medicare Pays so Much For Cancer
Drugs. European Medicines Agency. Wall Street
Journal [online], http://blogs.wsj.com/
health/2009/01/27/why-medicare-pays-so-much-for-ca
ncer-drugs/tab/comments/ (2009).
59. Barbui, C. & Garattini, S. Regulatory policies on
medicines for psychiatric disorders: is Europe on
target? Br. J.Psychiatry 190, 9193 (2007).
60. Woosley, R. L. & Rice, G. A new system for moving drugs
to market. Issues Sci. Technol. XXI, 6368 (2005).
61. Eichler, H. G., Pignatti, F., Flamion, B., Leufkens, H. &
Breckenridge, A. Balancing early market access to new
drugs with the need for benefit/risk data: a mounting
dilemma. Nature Rev. Drug Discov. 7, 818826
(2008).
62. [No authors listed.] Road map to 2015. European
Medicines Agency [online], http://www.ema.europa.eu/
docs/en_GB/document_library/Report/2011/01/
WC500101373.pdf (2010).
63. Maxwell, S., Eichler, H. G., Bucsics, A., Haefeli, W. E. &
Gustafsson, L.L. on behalf of the e-SPC consortium.
e-SPC delivering drug information in the 21st
century: developing new approaches to deliver drug
information to prescribers. Br. J.Clin. Pharmacol. 6Apr
2011 (doi:10.1111/j.136521252011.03981.x.).
64. Urquhart, J. Patient noncompliance with drug
regimens: measurement, clinical correlates, economic
impact. Eur. Heart J. 17 (Suppl. A), 815 (1996).
65. Leufkens, H. G. & Urquhart, J. Variability in patterns of
drug usage. J.Pharm. Pharmacol. 46 (Suppl. 1),
433437 (1994).
66. McQuay, H. J. & Moore, R. A. Using numerical results
from systematic reviews in clinical practice. Ann.
Intern. Med. 126, 712720 (1997).
67. Woodcock J. Assessing the clinical utility of diagnostics
used in drug therapy. Clin. Pharmacol. Ther. 88,
765773 (2010).
68. Mok, T. S. et al. Gefitinib or carboplatin-paclitaxel in
pulmonary adenocarcinoma. N.Engl. J. Med. 361,
947957 (2009).
69. Donnelly, L. A. et al. A paucimorphic variant in the
HMG-CoA reductase gene is associated with lipid-
lowering response to statin treatment in diabetes: a
GoDARTS study. Pharmacogenet. Genomics 18,
10211026 (2008).
70. Flockhart, D. A. Pharmacogenetic testing of CYP2C9
and VKORC1 alleles for warfarin. Genet. Med. 10,
139150 (2008).
71. Ginsburg, G. S. & Voora, D. The long and winding road
to warfarin pharmacogenetic testing. J.Am. Coll.
Cardiol. 55, 28132815 (2010).
72. Kamali, F. & Wynne, H. Pharmacogenetics of warfarin.
Annu. Rev. Med. 61, 6375 (2010).
73. Schilsky, R. L. Personalised medicine in oncology.
Nature Rev. Drug Discov. 9, 363366 (2010).
74. Roses, A. D. Pharmacogenetics in drug discovery and
development: a translational perspective. Nature Rev.
Drug Discov. 7, 807817 (2008).
75. European Medicines Agency. Reflection paper on
co-development of pharmacogenomic biomarkers and
assays in the context of drug development. European
Medicines Agency [online], http://www.ema.europa.eu/
docs/en_GB/document_library/Scientific_
guideline/2010/07/WC500094445.pdf (2010).
76. FDA. International Pharmaceutical Regulatory
Monitor: US FDA draft guidance explains new drug
development tools. FDA News [online], http://www.
fdanews.com/newsletter/article?issueId=14226&artic
leId=131972 (2010).
77. European Medicines Agency. Qualification of novel
methodologies for drug development: guidance to
applicants. European Medicines Agency [online],
http://www.ema.europa.eu/docs/en_GB/document_
library/Regulatory_and_procedural_
guideline/2009/10/WC500004201.pdf (2009).
78. McClellan, M. et al. An accelerated pathway for
targeted cancer therapies. Nature Rev. Drug Discov.
10, 7980 (2011).
79. [No authors listed.] Rethinking therapeutic cancer
vaccines. Nature Rev. Drug Discov. 8, 685686
(2009).
80. Hampel, H. et al. Biomarkers for Alzheimers disease
therapeutic trials. Prog. Neurobiol. 2Dec 2010
(doi:10.1016/j.pneurobio.2010.11.005).
81. Falissard, B. et al. Relative effectiveness assessment of
listed drugs (REAL): a new method for an early
comparison of the effectiveness of approved health
technologies. Int. J.Technol. Assess Health Care 26,
124130 (2010).
82. Birkett, D. et al. Clinical pharmacology in research,
teaching and health care: considerations by IUPHAR,
the Inter-national Union of Basic and Clinical
Pharmacology. Basic Clin. Pharmacol. Toxicol. 107,
531559 (2010).
83. Pocock, S. J., Assmann, S. E., Enos, L. E. & Kasten, L. E.
Subgroup analysis, covariate adjustment and
baseline comparisons in clinical trial reporting: current
practice and problems. Stat. Med. 21, 29172930
(2002).
84. Aarons, L. et al. Role of modelling and simulation in
Phase I drug development. Eur. J.Pharm. Sci. 13,
115122 (2001).
85. Manolis, E. & Pons, G. Proposals for model-based
paediatric medicinal development within the current
European Union regulatory framework. Br. J.Clin.
Pharmacol. 68, 493501 (2009).
86. [No authors listed.] How to reduce prescribing errors.
Lancet 374, 1945 (2009).
87. [No authors listed.] Evidence-based Practice Centres:
synthesizing scientific evidence to improve quality and
effectiveness in health care. Agency for Healthcare
Research and Quality [online], http://www.ahrq.gov/
clinic/epc/ (2011).
88. Bahri, P. Public pharmacovigilance communication:
a process calling for evidence-based, objective-driven
strategies. Drug Saf. 33,10651079 (2010).
89. Smalley, W. et al. Contraindicated use of cisapride:
impact of food and drug administration regulatory
action. JAMA 284, 30363039 (2000).
90. John, J. et al. HER2 testing and subsequent
trastuzumab treatment for breast cancer in a
managed care environment. Oncologist 14, 760768
(2009).
91. Gustafsson, L. L. et al. The Wise List a
comprehensive concept to select, communicate and
achieve recommendations of essential drugs in
ambulatory care in Stockholm. Basic Clin. Pharmacol.
Toxicol.108, 224233 (2011).
92. Shea, S. & Hripcsak, G. Accelerating the use of
electronic health records in physician practices.
N.Engl. J.Med. 362, 192195 (2010).
93. Sjborg, B. et al. Design and implementation of a
point-of-care computerized system for drug therapy in
Stockholm metropolitan health region-bridging the
gap between knowledge and practice. Int. J.Med.
Inform. 76, 497506 (2007).
94. Classen, D. C., Avery, A. J. & Bates, D. W. Evaluation
and certification of computerized provider order entry
systems. J.Am. Med. Inform. Assoc. 14, 4855
(2007).
95. Bttiger, Y. et al. SFINX a drugdrug interaction
database desgined for clinical decision support
systems. Eur. J.Clin. Pharmacol. 95, 627633
(2009).
96. Wettermark, B. et al. The new Swedish Prescribed
Drug Registeropportunities for
pharmacoepidemiological research and experience
from the first six months. Pharmacoepidemiol. Drug
Saf. 16, 726735 (2007).
97. Cutler, D. & Everett, W. Thinking outside the pillbox
medication adherence as a priority for health care
reform. N.Engl. J.Med. 362, 15531555
(2010).
98. Modi, A. C. & Quittner, A. L. Barriers to treatment
adherence for children with cystic fibrosis and asthma:
what gets in the way? J.Pediatr. Psychol. 31,
846858 (2006).
99. Osterberg, L. G., Urquhart, J. & Blaschke, T. F.
Understanding forgiveness: minding and mining the
gaps between pharmacokinetics and therapeutics.
Clin. Pharmacol. Ther. 88, 457459 (2010).
100. Frieden, T. R., Fujiwara, P. I., Washko, R. M. &
Hamburg, M. A. Tuberculosis in New York City
turning the tide. N.Engl. J.Med. 333, 229233
(1995).
101. Lester, R. T. et al. Effects of a mobile phone short
message service on antiretroviral treatment adherence
in Kenya (WelTel Kenya1): a randomised trial. Lancet
376, 18381845 (2010).
102. Chi, B. H. & Stringer, J. S. A. Mobile phones to
improve HIV treatment adherence. Lancet 376,
18071808 (2010).
103. Ogedegbe G. Self-titration for treatment of
uncomplicated hypertension. Lancet 376, 144146
(2010).
104. Singer, E. Message from a pill bottle. Technology
Review [online], http://www.technologyreview.com/
business/26414/?p1=A4 (2010).
105. Au-Yeung, K. Y. et al. A networked system for self-
management of drug therapy and wellness. ACM
Digital Library [online], http://delivery.acm.
org/10.1145/1930000/1921083/p1-au-yeung.pdf?ke
y1=1921083&key2=9929465921&coll=DL&dl=
ACM&CFID=7014173&CFTOKEN=96965669
(2010).
106. Sokol, M. C., McGuigan, K. A., Verbrugge, R. R. &
Epstein, R. S. Impact of medication adherence on
hospitalization risk and healthcare cost. Med. Care
43, 521530 (2005).
107. Ware, J. H. & Hamel, M. B. Pragmatic trials guide
to better patient care? N.Engl. J. Med. 364,
16851687 (2011).
108. Hughes, B. 2009 FDA drug approvals. Nature Rev.
Drug Discov. 9, 8992 (2010).
109. Eichler, H. G., Aronsson, B., Abadie, E. & Salmonson, T.
New drug approval success rate in Europe
in 2009. Nature Rev. Drug Discov. 9, 355356
(2010).
Competing interests statement
The authors declare no competing financial interests.
PERSPECTI VES
506 | JULY 2011 | VOLUME 10 www.nature.com/reviews/drugdisc
nrd_3501_jul11.indd 506 20/06/2011 16:34
First published in Nature Reviews Drug Discovery 10, 333-334 (2011); doi:10.1038/nrd3435
58 | OCTOBER 2011 | THE FUTURE OF DRUG INNOVATION | NATURE REPRINT COLLECTION www.nature.com/reprintcollections/lilly/drug-innovation
The impact of mergers on
pharmaceutical R&D
John L.LaMattina
Mergers and acquisitions in the pharmaceutical industry have substantially reduced the
number of major companies over the past 15years. The short-term business rationale for this
extensive consolidation might have been reasonable, but at what cost to research and
development productivity?
John L.LaMattina is the
former President of Pfizer
Global Research and
Development, and is currently
Senior Partner at Puretech
Ventures, Boston,
Massachusetts 02116, USA.
e-mail: john.lamattina@
comcast.net
doi:10.1038/nrd3514
Concerns about the productivity of pharmaceutical
research and development (R&D) are becoming increas-
ingly common in both the mainstream media and sci-
entific literature. A range of possible causes have been
identified, from more challenging therapeutic targets
to excessive bureaucracy, and various approaches to
address these issues have been put forward (for example,
see REFS 1,2). However, the impact of mergers and acqui-
sitions on R&D productivity is less well documented,
because R&D integrations and cuts are largely done pri-
vately. In this article, it is argued that although mergers
and acquisitions in the pharmaceutical industry might
have had a reasonable short-term business rationale,
their impact on the R&D of the organizations involved
has been devastating.
Industry consolidation
When people bemoan the poor productivity of the phar-
maceutical industry at present, they often refer back to
the heyday of new drug approvals by the US Food and
Drug Administration (FDA): the 1990s. Indeed, in terms
of the number of new drugs that were approved, this
decade was more productive, with an average of 31 drugs
per year between 1990 and 1999 (compared with 24 per
year between 2000 and 2009), with a peak of 54 drugs in
1996. One possible contributory factor is that multiple
entries in a single drug class (such as statins) were more
economically viable at thetime.
However, another underlying factor contributing
to the productivity observed in the 1990s was the large
number of pharmaceutical companies at that time.
Many of the drugs that were approved in1996 origi-
nated from companies that no longer exist; indeed, out
of the 42 members of the Pharmaceutical Research and
Manufacturers of America (PhRMA) in 1988, only 11
(~25%) remain today (see Supplementary information
S1 (figure)).
The R&D portfolios of these companies, although
differing in size, tended to be broader in scope than
those of start-up companies that arose during this time,
and it is likely that when a new idea for treating cancer
arose in 1990, 20 companies would have initiated pro-
jects on it. Given the difficulties that are encountered
in R&D, it could reasonably be assumed that only three
or four of these companies would have been success-
ful at bringing a drug based on this idea to market.
Furthermore, the greater diversity of portfolios among
a larger number of companies both large and small
could increase the chances of finding new drugs in
general. Indeed, a recent analysis has indicated that the
number of new drug approvals during the past 60years
is correlated with the number of companies
3
. Now, with
so many fewer major companies involved in pharmaceu-
tical R&D, the chances of success in the industry overall
are likely to be dropping precipitously.
R&D reductions
From a business perspective, mergers and acquisitions
are often considered to be attractive as they remove
duplication, reduce costs and produce synergies.
Furthermore, in the early days of mergers in the phar-
maceutical industry, organizations often described them
as being part of a growth story. In these situations
for example, the merger of Bristol Myers with Squibb
in 1989 the R&D divisions were fused. Programme
overlap was minimized and new projects were added,
and major R&D cuts did notoccur.
This has changed radically in the past decade. In
major mergers today, not only are R&D cuts made, but
entire research sites are eliminated. Nowhere is this
more evident than with Pfizer. Before 1999, Pfizer had
never made a major acquisition. Over the next decade,
it acquired three large companies Warner-Lambert
(in 2000), Pharmacia (in 2003) and Wyeth (in 2009)
and multiple smaller companies, such as Vicuron, Rinat
and Esperion (Supplementary information S1 (figure)).
Over this time frame, to meet its business objectives
(a euphemism for raising its stock price) Pfizer closed
COMMENT
NATURE REVIEWS | DRUG DISCOVERY VOLUME 10 | AUGUST 2011 | 559
nrd_3514_aug11.indd 559 19/07/2011 15:03
0CVWTG4GXKGYU&TWI&KUEQXGT[
N
u
m
b
e
r
o
f
d
r
u
g
s
0
20
40
60
80
100
120
I II III
C
Phase Region
10
20
30
40
50
60
70
80
N
u
m
b
e
r
o
f
d
r
u
g
s
0
CN US EU
E
110
10
23
16
36
41
Cancer
Infection
Cardiovascular
Central nervous system
Endocrine/metabolism
Musculoskeletal
Respiratory
Genitourinal
Gastrointestinal
Others
D
32
11
10
1
1
S
13
3
3
3
R&D IN CHINA | MARKET INDICATORS
min
, which represents the smallest clinically
important delta (SCId) for this clinical trial.
next, the trial designers will determine the
sample size that can detect values of , based
on prior information, that exceed the SCId
with good power. The standard deviation
(between subject variability) is a nuisance
parameter whose true value must be
estimated in order to proceed with the
sample size calculation.
The SCId can often be pre-specified
from purely clinical arguments, whereas the
actual effect size is unknown. Therefore, it is
possible in principle to design a study with
a fixed sample size that will have adequate
power to detect the SCId, in the absence
of adequate prior information about the
actual effect size of the test agent. This is
what statisticians envisaged when they
created the fixed-sample methodology.
However, this fixed sample methodology
has several drawbacks. If the actual effect is
substantially larger than the SCId, a smaller
sample size would have sufficed to attain
adequate power
32
.
Sponsors will not often risk significant
resources on trial sizes based on SCId
assumptions that would lead to larger trials
than the current best guess about the actual
effect size (BOX 4). Instead, a smaller trial
corresponding to that best guess may be run;
if that assumption is too optimistic, and the
Box 2 | Case study: combining poC and dose-ranging trials into a single adaptive trial
This example illustrates how a single adaptive trial can replace two standard trials
proof-of-concept (PoC) and dose-ranging and that the combined trial has greater power than
the standard PoC design, and is substantially better at estimating the doseresponse curve.
The trial evaluated an analgesic drug to treat dental pain and tested seven doses of the drug.
Several designs with different sample sizes, randomization ratios of drug to placebo and starting
doses were simulated against several scenarios. Here, we describe one design with a sample
size of 120 subjects (40 placebo, 80 drug). Bayesian adaptive trials were simulated over seven
drugresponse scenarios to enable comparisons with standard designs. Seven scenarios, which
represent the gamut of probable doseresponse curves were chosen as shown in panel a in the figure.
In simulations, it was found that across all seven scenarios, a single adaptive trial can replace two
standard trials (PoC and dose-ranging). The power of the trend test for PoC was always greater for the
adaptive design, as shown in panel b. When there was a small doseresponse effect (scenarios 2
and 3), the power of the adaptive design was about double that of the standard design. When the effect
size was modest (scenarios 4 and 5), the power was increased to practically 100%. When effect sizes
were large (scenarios 6 and 7), the power was almost 100% for both adaptive and standard designs.
For the same total sample size, the adaptive combined PoCdose-finding trial is more efficient
than the two standard trials in estimating the response at every dose (see panel c). The continuous
curve shows the efficiency of the adaptive design relative to the standard dose-ranging design for
scenario 7. Efficiency at each dose is defined as the ratio of the square of the estimation error of the
standard design to the square of the estimation error of the adaptive design. The bars show the
number of subjects allocated to each dose by the adaptive design. These results are computed by
averaging the results of 1,000 simulations.The overall efficiency across all doses is greater by a
factor of five, whereas for the sloping part of the dose response curve (doses 4, 5 and 6) the adaptive
design is three times more efficient. In panel d, the adaptive combined PoCdose-ranging trial with
60 subjects is as efficient in estimating the response at every dose as the two standard trials with a
combined sample size of 120 subjects. It is also as powerful in testing for PoC.
These results are true irrespective of which of the seven scenarios reflects the true doseresponse
curve. For all seven scenarios for the same sample size, the efficiency of the adaptive design was
about five times that of the standard design over all doses. It was three times that of the standard
design for estimating doseresponse in the sloping part of the doseresponse curve. Another way to
think about this result is that for half the sample size, the adaptive design is as powerful and efficient
as the standard approach with two trials.
PersPecti ves
naTUre revIeWS | Drug Discovery volUMe 8 | deCeMBer 2009 | 953
nrd_persp_dec09.indd 953 16/11/09 13:57:42
Nature Reviews | Drug Discovery
L
e
v
e
l
280 336 392 448 504 560 224 168 112 56
Time (days)
56 0
Total IL-1 (complex)
Antibody
Free IL-1 is suppressed
C-reactive protein
Symptoms
Flaring
Remission
selected group(s) with the control will use
data from the continuing groups from both
stages of the trial.
There are three key potential advantages
of seamless adaptive designs: a reduction
in the duration of the clinical development
programme, by eliminating the time lag that
traditionally occurs between Phase II and
III trials; greater efficiency from the use of
data from both stages, which might mean
that fewer patients are required to obtain
the same quality of information; and earlier
acquisition of long-term safety data, gathered
through continued follow-up of patients
from the first stage (see Supplementary
information S3 (figure))
25,29
.
not all drug development programmes
will be candidates for these designs.
Feasibility considerations for use of these
designs include the length of follow-up
time for the endpoint used for selection
compared with duration of enrolment.
Shorter follow-up will be more conducive
to a seamless adaptive design, whereas a
relatively long endpoint follow-up period
will tend to militate against using such a
design. development programmes that do
not involve complex treatment regimens
might therefore be better suited to such
designs. drug supply and drug packaging
will be expected to be more challenging in
this setting.
a number of logistical and regulatory
actions must be fulfilled to avoid compro-
mising an adaptive trial. First, the actual
algorithm for determining the adaptation
to implement must be specified in advance.
This is usually accomplished by creating a
charter for the independent data monitoring
committee charged with the responsibility
of performing the unblinded interim analysis
and communicating as appropriate with
the sponsor. In addition, the sponsor must
have developed in-house procedures to
ensure that the algorithm is not transmitted
throughout the company, and especially not
to the study investigators.
To maintain trial integrity, the processes
by which interim data are examined and
selection decisions are made and imple-
mented must be considered very carefully.
Current conventions that restrict knowledge
of interim results in ongoing trials should
be respected to avoid compromising the
interpretability of trial results. In some cases
the decision being made at the selection
point of a seamless design will be one for
which sponsor perspective might be relevant
and which has traditionally been a sponsor
responsibility, raising the question of sponsor
involvement in the monitoring process.
a distinction is sometimes made between
seamless adaptive designs that are inferen-
tially seamless or operationally seamless.
In inferentially seamless designs, which we
describe here, the main analysis uses data
from both stages of the trial. In operation-
ally seamless designs, the final analysis only
uses data from patients enrolled after the
selection decision. This may allow a broader
investigation of the first-stage data involving
sponsor personnel and decreases concerns
about trial integrity; in addition, traditional
non-adaptive statistical methodology nor-
mally suffices. Such designs may maintain
the advantage of reducing white space, while
losing the efficiency that results from using
data accrued in stages. regardless, operating
procedures for the monitoring process in
seamless designs must be carefully considered
to ensure that the right expertise is applied
to the decision, while limiting access to the
accruing data as appropriate to maintain
trial integrity.
other considerations for adaptive designs
include the endpoint used for selection.
This need not be the same as the endpoint to
be used in the main study analysis; if a good
surrogate marker is available, this can be
used and might enhance the efficiency of the
seamless trial. Second, modelling and simula-
tion will probably have a very important role
in developing the specific details of seamless
designs (for example, per-group sample sizes
in the different stages, considered under vari-
ous scenarios) to ensure that they are robust
and efficient. Third, the final analysis must
use statistical methodology that is appropriate
for the design: naive comparisons of control
Figure 2 | Dose selection in the development of a therapeutic for MuckleWells syndrome.
MuckleWells syndrome is a rare genetic disorder characterized by fever, urticaria, joint pain and
malaise. A monoclonal antibody against interleukin-1 (iL-1 ), canakinumab, has been developed to
treat this iL-1-dependent inflammatory disease. The antibody is delivered parenterally and binds to
free iL-1, driving it into the inactive complex and leading to remission of symptoms
21
. Total iL-1,
which represents mainly the inactive complex, increases after dosing and can be measured. By the
laws of mass action, the free and active form of iL-1, which cannot be measured, must decrease.
However, the reduction in free iL-1 results in a decrease in markers of inflammation, including
c-reactive protein (which can be measured), and a remission of clinical signs and symptoms of disease.
The clinical data on these relationships can be captured in a mathematical model, shown in the figure,
which is continuously adjusted in the light of new data. This framework simulation could then be used
to propose a suitable dose and dosing regimen that would be predicted to produce a desired response
for the majority of patients (for example, an 80% probability that 90% of patients will be flare-free for
2 months).
PersPecti ves
952 | deCeMBer 2009 | volUMe 8 www.nature.com/reviews/drugdisc
nrd_persp_dec09.indd 952 16/11/09 13:57:42
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 67
Nature Reviews | Drug Discovery
M
e
a
n
r
e
s
p
o
n
s
e
25
20
15
10
5
0
6 8 7 5 4 3 2
Dose
Scenario 1
Scenario 2
Scenario 3
1
a
Scenario 4
Scenario 5
Scenario 6
Scenario 7
A
v
e
r
a
g
e
a
l
l
o
c
a
t
i
o
n
20
18
16
12
14
10
8
6
4
2
0
Dose
Average allocation
Efficiency
c
b
E
f
f
i
c
i
e
n
c
y
E
f
f
i
c
i
e
n
c
y
10
9
8
6
7
5
4
3
2
1
0
10
9
8
6
7
5
4
3
2
1
0
6 7 5 4 3 2
Dose
Adaptive design (sample size = 120)
Adaptive design (sample size = 60)
Standard design (sample size = 120)
1
d
1 2 3 4 5 6 7
Scenario Power of
standard
PoC trial*
Power of
combined
adaptive design
1
2
3
4
5
6
7
5
33
32
86
85
100
99
5
84
67
100
99
100
100
*Sample size = 30.
versus the selected treatment that do not
account for the design will not be appropriate.
Finally, the appropriateness of the design
does not depend on any particular algorithm
for choosing the patient group to be contin-
ued; it is not even necessary for a firm
algorithm to be specified in advance, although
the general principles that will govern the
decision should be clear in advance.
Sample size re-estimation within a
confirmatory trial (Phase III). Sample size
re-estimation (SSr) provides a mechanism for
appropriately using the information obtained
during a confirmatory study to inform and
adjust the necessary sample size going for-
ward
30,31
. This process increases confidence
that an appropriate sample size has been
chosen to answer the primary study questions.
The standard approach used to power a
confirmatory study is to first estimate the
underlying treatment effect on the primary
endpoint based on available prior informa-
tion. The parameter denotes the true
underlying difference between the treat-
ment and control arms with respect to the
primary endpoint. even though the true
value of is unknown, the trial investigators
will usually have in mind a specific value,
min
, which represents the smallest clinically
important delta (SCId) for this clinical trial.
next, the trial designers will determine the
sample size that can detect values of , based
on prior information, that exceed the SCId
with good power. The standard deviation
(between subject variability) is a nuisance
parameter whose true value must be
estimated in order to proceed with the
sample size calculation.
The SCId can often be pre-specified
from purely clinical arguments, whereas the
actual effect size is unknown. Therefore, it is
possible in principle to design a study with
a fixed sample size that will have adequate
power to detect the SCId, in the absence
of adequate prior information about the
actual effect size of the test agent. This is
what statisticians envisaged when they
created the fixed-sample methodology.
However, this fixed sample methodology
has several drawbacks. If the actual effect is
substantially larger than the SCId, a smaller
sample size would have sufficed to attain
adequate power
32
.
Sponsors will not often risk significant
resources on trial sizes based on SCId
assumptions that would lead to larger trials
than the current best guess about the actual
effect size (BOX 4). Instead, a smaller trial
corresponding to that best guess may be run;
if that assumption is too optimistic, and the
Box 2 | Case study: combining poC and dose-ranging trials into a single adaptive trial
This example illustrates how a single adaptive trial can replace two standard trials
proof-of-concept (PoC) and dose-ranging and that the combined trial has greater power than
the standard PoC design, and is substantially better at estimating the doseresponse curve.
The trial evaluated an analgesic drug to treat dental pain and tested seven doses of the drug.
Several designs with different sample sizes, randomization ratios of drug to placebo and starting
doses were simulated against several scenarios. Here, we describe one design with a sample
size of 120 subjects (40 placebo, 80 drug). Bayesian adaptive trials were simulated over seven
drugresponse scenarios to enable comparisons with standard designs. Seven scenarios, which
represent the gamut of probable doseresponse curves were chosen as shown in panel a in the figure.
In simulations, it was found that across all seven scenarios, a single adaptive trial can replace two
standard trials (PoC and dose-ranging). The power of the trend test for PoC was always greater for the
adaptive design, as shown in panel b. When there was a small doseresponse effect (scenarios 2
and 3), the power of the adaptive design was about double that of the standard design. When the effect
size was modest (scenarios 4 and 5), the power was increased to practically 100%. When effect sizes
were large (scenarios 6 and 7), the power was almost 100% for both adaptive and standard designs.
For the same total sample size, the adaptive combined PoCdose-finding trial is more efficient
than the two standard trials in estimating the response at every dose (see panel c). The continuous
curve shows the efficiency of the adaptive design relative to the standard dose-ranging design for
scenario 7. Efficiency at each dose is defined as the ratio of the square of the estimation error of the
standard design to the square of the estimation error of the adaptive design. The bars show the
number of subjects allocated to each dose by the adaptive design. These results are computed by
averaging the results of 1,000 simulations.The overall efficiency across all doses is greater by a
factor of five, whereas for the sloping part of the dose response curve (doses 4, 5 and 6) the adaptive
design is three times more efficient. In panel d, the adaptive combined PoCdose-ranging trial with
60 subjects is as efficient in estimating the response at every dose as the two standard trials with a
combined sample size of 120 subjects. It is also as powerful in testing for PoC.
These results are true irrespective of which of the seven scenarios reflects the true doseresponse
curve. For all seven scenarios for the same sample size, the efficiency of the adaptive design was
about five times that of the standard design over all doses. It was three times that of the standard
design for estimating doseresponse in the sloping part of the doseresponse curve. Another way to
think about this result is that for half the sample size, the adaptive design is as powerful and efficient
as the standard approach with two trials.
PersPecti ves
naTUre revIeWS | Drug Discovery volUMe 8 | deCeMBer 2009 | 953
nrd_persp_dec09.indd 953 16/11/09 13:57:42
Nature Reviews | Drug Discovery
L
e
v
e
l
280 336 392 448 504 560 224 168 112 56
Time (days)
56 0
Total IL-1 (complex)
Antibody
Free IL-1 is suppressed
C-reactive protein
Symptoms
Flaring
Remission
selected group(s) with the control will use
data from the continuing groups from both
stages of the trial.
There are three key potential advantages
of seamless adaptive designs: a reduction
in the duration of the clinical development
programme, by eliminating the time lag that
traditionally occurs between Phase II and
III trials; greater efficiency from the use of
data from both stages, which might mean
that fewer patients are required to obtain
the same quality of information; and earlier
acquisition of long-term safety data, gathered
through continued follow-up of patients
from the first stage (see Supplementary
information S3 (figure))
25,29
.
not all drug development programmes
will be candidates for these designs.
Feasibility considerations for use of these
designs include the length of follow-up
time for the endpoint used for selection
compared with duration of enrolment.
Shorter follow-up will be more conducive
to a seamless adaptive design, whereas a
relatively long endpoint follow-up period
will tend to militate against using such a
design. development programmes that do
not involve complex treatment regimens
might therefore be better suited to such
designs. drug supply and drug packaging
will be expected to be more challenging in
this setting.
a number of logistical and regulatory
actions must be fulfilled to avoid compro-
mising an adaptive trial. First, the actual
algorithm for determining the adaptation
to implement must be specified in advance.
This is usually accomplished by creating a
charter for the independent data monitoring
committee charged with the responsibility
of performing the unblinded interim analysis
and communicating as appropriate with
the sponsor. In addition, the sponsor must
have developed in-house procedures to
ensure that the algorithm is not transmitted
throughout the company, and especially not
to the study investigators.
To maintain trial integrity, the processes
by which interim data are examined and
selection decisions are made and imple-
mented must be considered very carefully.
Current conventions that restrict knowledge
of interim results in ongoing trials should
be respected to avoid compromising the
interpretability of trial results. In some cases
the decision being made at the selection
point of a seamless design will be one for
which sponsor perspective might be relevant
and which has traditionally been a sponsor
responsibility, raising the question of sponsor
involvement in the monitoring process.
a distinction is sometimes made between
seamless adaptive designs that are inferen-
tially seamless or operationally seamless.
In inferentially seamless designs, which we
describe here, the main analysis uses data
from both stages of the trial. In operation-
ally seamless designs, the final analysis only
uses data from patients enrolled after the
selection decision. This may allow a broader
investigation of the first-stage data involving
sponsor personnel and decreases concerns
about trial integrity; in addition, traditional
non-adaptive statistical methodology nor-
mally suffices. Such designs may maintain
the advantage of reducing white space, while
losing the efficiency that results from using
data accrued in stages. regardless, operating
procedures for the monitoring process in
seamless designs must be carefully considered
to ensure that the right expertise is applied
to the decision, while limiting access to the
accruing data as appropriate to maintain
trial integrity.
other considerations for adaptive designs
include the endpoint used for selection.
This need not be the same as the endpoint to
be used in the main study analysis; if a good
surrogate marker is available, this can be
used and might enhance the efficiency of the
seamless trial. Second, modelling and simula-
tion will probably have a very important role
in developing the specific details of seamless
designs (for example, per-group sample sizes
in the different stages, considered under vari-
ous scenarios) to ensure that they are robust
and efficient. Third, the final analysis must
use statistical methodology that is appropriate
for the design: naive comparisons of control
Figure 2 | Dose selection in the development of a therapeutic for MuckleWells syndrome.
MuckleWells syndrome is a rare genetic disorder characterized by fever, urticaria, joint pain and
malaise. A monoclonal antibody against interleukin-1 (iL-1 ), canakinumab, has been developed to
treat this iL-1-dependent inflammatory disease. The antibody is delivered parenterally and binds to
free iL-1, driving it into the inactive complex and leading to remission of symptoms
21
. Total iL-1,
which represents mainly the inactive complex, increases after dosing and can be measured. By the
laws of mass action, the free and active form of iL-1, which cannot be measured, must decrease.
However, the reduction in free iL-1 results in a decrease in markers of inflammation, including
c-reactive protein (which can be measured), and a remission of clinical signs and symptoms of disease.
The clinical data on these relationships can be captured in a mathematical model, shown in the figure,
which is continuously adjusted in the light of new data. This framework simulation could then be used
to propose a suitable dose and dosing regimen that would be predicted to produce a desired response
for the majority of patients (for example, an 80% probability that 90% of patients will be flare-free for
2 months).
PersPecti ves
952 | deCeMBer 2009 | volUMe 8 www.nature.com/reviews/drugdisc
nrd_persp_dec09.indd 952 16/11/09 13:57:42
68 | OCTOBER 2011 | THE FUTURE OF DRUG INNOVATION | NATURE REPRINT COLLECTION www.nature.com/reprintcollections/lilly/drug-innovation
Box 5 | group-sequential and adaptive designs for sample size re-estimation
Group-sequential design. Suppose that the sponsor is unsure of the true value of , but nevertheless
believes that it is larger than the smallest clinically important delta (SCID). In this case, a group-
sequential design might be considered. Such a design is characterized by a maximum sample size,
an interim monitoring strategy and a corresponding boundary for early stopping for efficacy.
The maximum sample size is computed so that the study has adequate power to detect a value
of that the sponsor believes represents a reasonable estimate of the efficacy of the experimental
compound, provided this estimate is at least as large as the SCID. If the sponsor wishes to be very
conservative about this estimate, the maximum sample size needed can be computed to have
adequate power at the SCID itself. An up-front commitment is made to enrol patients up to this
maximum sample size. However, if the true exceeds the SCID, the trial may terminate earlier
with high probability by crossing an early stopping boundary at an interim analysis.
Returning to the example discussed in BOX 4, suppose that the sponsor decides to make an
up-front commitment of 4,000 patients to the trial but intends to monitor the accruing data up to
four times, after 1,000, 2,000, 3,000 and 4,000 patients become evaluable for the primary endpoint.
The commitment of 4,000 patients ensures that the trial will have 88% power to detect a
difference as small as = 0.1 (in this case the SCID). Although this is a rather large sample size to
commit to the trial, the actual sample size is expected to be substantially smaller if the true is
larger than the SCID. This is because at each of the four interim monitoring time points there is a
chance of early termination and a declaration of statistical significance. At each interim analysis,
a test for statistical significance using all available primary endpoint data would be performed,
and the result would be compared with a properly determined early-stopping boundary value.
The trial could be terminated the first time that a boundary is reached, with a valid claim that the
experimental arm is more efficacious than the control arm.
However, sometimes a sponsor might not be willing to make such a large up-front commitment,
particularly when the only currently available data on are from one or two small Phase II trials.
The sponsor might feel more comfortable with a design that starts out with a smaller sample size
of, say, 1,000 patients, with the opportunity to increase the sample size at an interim time point
and after observing data from the trial. This is the motivation for the adaptive design below.
The adaptive design. The group-sequential design described above is characterized by
pre-specifying a maximum sample size up-front and terminating earlier if the true is larger than
anticipated. By contrast, an adaptive design pre-specifies a smaller initial sample size, but with
the possibility of increasing the commitment after seeing some interim data from the trial. On the
surface, this is similar to the usual practice of first running a small Phase II trial to obtain an idea
about efficacy and safety and then following it up with a larger Phase III trial once the efficacy and
safety of the compound have been established. There is, however, an important distinction between
the conventional Phase II followed by Phase III strategy and the adaptive strategy outlined below.
In the conventional approach, the data from the Phase II trial are not combined with the data
from the Phase III trial. The adaptive design, however, uses all the data from both stages for the
final analysis. This can have important advantages both in terms of gaining additional statistical
power, as well as shortening the drug development time. In our example, we stated that the SCID
was 0.1. Supposing that the sponsor believes that the true = 0.2 that is, twice as large as the
SCID if this is indeed the case, then a total sample size of 1,000 patients will have 89% power at
a one-sided level of 0.025. On this basis, the sponsor is prepared to make an initial investment of
1,000 patients to this trial. As an insurance policy, however, the sponsor intends to take an interim
look at the accruing data at the mid-point of the trial, after 500 patients are evaluable for
response. If the estimate of obtained from these 500 is smaller than the sponsor expected,
then the sponsor might choose to increase the sample size to preserve the power of the trial.
Many different criteria can be used to decide whether an increase in sample size is warranted.
A commonly used criterion is conditional power. The conditional power at an interim analysis is
the probability, given the observed data, that the experimental compound will demonstrate
efficacy on completion of the trial. The conditional power computation requires specifying a
value for . One can choose the value specified at the initial design stage or the value estimated
from the interim data. In this example, we use the interim estimated value of for evaluating
conditional power. The table below displays conditional power for various estimated values of
at the interim time point, along with the total sample size needed to achieve 80% conditional
power at the final analysis. The entries in the table assume that = 1.
interim
estimate ()
conditional power without
sample size increase
total sample size needed to achieve
80% conditional power
0.2 95% 720 (sample size reduction)
0.175 86% 890 (sample size reduction)
0.15 72% 1,166 (sample size increase)
0.125 51% 1,757 (sample size increase)
0.1 30% 2,990 (sample size increase)
how the new sample size will be calculated.
Usually, this type of adjustment will not be
permitted by regulatory authorities more
than once.
For unblinded sample size re-estimation,
the sponsor sets up a mechanism (possibly
with the data monitoring committee of
the trial) whereby the SSr is based on an
unblinded estimate of variability (or statistical
information) at the interim analysis. Sample
size may be altered one or more times,
but the maximum statistical information
must be pre-specified.
If the sponsor agrees that there will
be no early stopping for efficacy following
an interim analysis, then no adjustment to
the final analysis criteria is necessary.
The data monitoring committee may
monitor the data one or more times and
adjust the sample size up or down based
on the unblinded estimate of variability
and attempt to reach the pre-specified
maximum information.
When the sponsor pre-specifies the
interim time points at which it is permis-
sible to terminate early for efficacy, the
criteria for each interim analysis must be
pre-specified in a manner that controls the
false-positive rate across the entire study.
This will result in adjustment to the final
analysis criterion if the study is not stopped
early. Interim looks undertaken solely for
administrative purposes, with no inten-
tion of stopping the trial in light of efficacy
data, do not need to have defined criteria.
The trial then proceeds until either it is ter-
minated early for efficacy on the basis of the
pre-defined criteria being reached, or until
the planned maximum information (sample
size or number of events) is reached.
Tackling challenges of new trial designs
Because they are so flexible, these new trial
designs require significant statistical analyses,
simulations and logistical considerations
to verify their operating characteristics,
and therefore tend to require more time
for the planning and protocol development
phase. regulatory agencies and Institutional
review Boards also need to approve the
design format for interim analysis, and these
discussions can sometimes take considerable
time. Such time considerations can lead a
company to follow the traditional route to
clinical development, without fully appre-
ciating the advantages that adaptive designs
can eventually bring in terms of time and
cost savings, and probability of success.
as described above, adaptive designs
further require the following: quickly
observable responses relative to the patient
PersPecti ves
naTUre revIeWS | Drug Discovery volUMe 8 | deCeMBer 2009 | 955
nrd_persp_dec09.indd 955 16/11/09 13:57:43
Nature Reviews | Drug Discovery
R
e
s
p
o
n
s
e
Wasted doses Dose Wasted doses
Box 3 | Adaptive dose finding
In an adaptive dose-finding study, the dose assignment(s) to the next subject, or next cohort of
patients, is based on responses of previous subjects, and the dose assignment is chosen to maximize
the information about the doseresponse curve, according to some pre-defined objective metric
(for example, variability in parameter estimates). In a traditional dose-finding trial, selecting a few
doses may not adequately represent the doseresponse relationship and many patients will be
allocated to non-informative doses (wasted doses), as shown in the figure. In adaptive dose-finding,
the strategy is to initially include only a few patients on many doses to explore the doseresponse,
then to allocate the dose range of interest to more patients. This reduces the allocation of patients
to non-informative doses
27,28
. Compared with fixed randomization, this approach has the ethical
advantage that fewer subjects are assigned doses that are too high or too low. It can also avoid
additional, separate trials that might be necessary when fixed dose-finding trials do not adequately
define the dose range.
Adaptive dose-finding trials also require
an infrastructure that allows the rapid
communication of responses from trial sites to a
central unblinded analysis centre and of adaptive
dose assignments to the trial sites. Randomization
software capable of rapidly computing dynamic
allocation of doses to subjects is additionally
mandated by adaptive trials because pre-specified
randomization lists will not work. In addition,
a flexible drug-supply process is required because
demand for doses is not fixed in advance,
but rather evolves as information on responses at
various doses is gathered as the trial progresses.
Box 4 | issues with the standard clinical development approach
Issues with the standard approach to clinical development can be illustrated by considering a
randomized clinical trial with the following assumptions. Based on available evidence from
early-phase trials, it is estimated that = 1, that the anticipated effect size = 0.2 and that the
smallest clinically important delta (SCID) is 0.1. Rather than conservatively enrolling a sample size
required to demonstrate the SCID (4,000 subjects), the sponsor appropriately powers the trial to
detect the estimated larger (1,000 subjects). Now, suppose that the true underlying value of is
0.15. In that case, a sample size of 2,000 subjects would be required to adequately power the trial
to detect this difference. The difficulty is, of course, that the true underlying value of is not
known at the start of the trial. In this example, the 1,000-subject study would probably yield a
non-significant result, as it is only powered to detect an effect size of 0.2, which is larger than the
actual effect size of 0.15.
In this example, unless the 1,000-patient under-powered trial was repeated with a larger sample
size, then a potentially efficacious treatment would be unnecessarily and unfortunately discarded.
If the trial were to be repeated with the re-estimation of the actual effect size, then 2,000 patients
would need to be enrolled, and the time and resources to perform the original trial (sometimes
more than 3 years) would have been spent without much benefit other than gaining a more
reliable estimate of the actual effect size in order to design the second trial. More importantly,
the subjects for that study would have been put at unnecessary risk because the study had no real
chance of being definitive.
truth is an effect size closer to the SCId,
the trial will be underpowered and therefore
have a high chance of failure.
one approach to solving the problem of
uncertainty about is to design and execute
an additional number of exploratory trials
(typically Phase II studies). These small
Phase II studies are normally carried out to
get a more precise estimate (or best guess)
of the actual and so that the confirma-
tory study might be adequately powered.
each exploratory trial, although somewhat
smaller than confirmatory trials, still
requires significant resources to perform
appropriately. also, the inevitable start-up
time and wind-down activities between
trials have to be included when determining
true programme efficiency and develop-
ment timelines. This might therefore not
be the most efficient way to proceed from
the viewpoint of the entire clinical trial
programme.
Advantages of adaptive SSR in confirmatory
trials. a more flexible approach to the
fixed sample-size methodology is needed.
By altering the sample size using interim
data from the trial itself, this flexibility can
be achieved without compromising the
power or the false-positive rate of the trial
(that is, the chance of making a false claim
of efficacy for a treatment that is not effica-
cious). SSr should be considered in two
situations: when there is significant uncer-
tainty about ; or when there is a substantial
difference between the sample size resulting
from using the SCId and the sample size the
sponsor can justify on the basis of their best
guess of the effect size
29
.
SSr usually involves the choice of a suitable
initial sample size, including one or more
interim analyses at which the sample size
will be re-assessed
30
. There are two distinct
strategies the group sequential strategy
and the adaptive SSr strategy for choosing
the initial sample size, and then altering it on
the basis of data obtained at various interim
analysis time points. The group sequential
strategy, which is also an adaptive design,
begins with a large up-front sample size
commitment and cuts back if the accruing
data suggest that the large sample size is not
needed. The adaptive SSr strategy proceeds
in the opposite direction, starting out with
a smaller initial sample size commitment
but with the option to increase it should the
accruing data suggest that such an increase is
warranted
3033
(BOX 5).
Extending the methodology to unknown .
although the group sequential and adap-
tive SSr methods were presented under the
assumption that the standard deviation
is known, they apply equally for the case
of unknown
3032
. one can start out with
an initial estimate of and corresponding
sample-size estimate. Then, following an
interim analysis, one can re-estimate this
nuisance parameter, input the updated esti-
mate into the equation and re-compute the
sample size. an illustrative example is given
in FIG. 3.
There are two ways to obtain the new
sample size in the situation of unknown :
blinded and unblinded. In the instance of
blinded sample size re-estimation, the
sponsor uses pooled data to estimate .
This is permitted with no penalty to the
analysis criteria (that is, alpha, or the
probability of Type I (false positive) error).
It is preferable that the sponsor pre-specifies
how many times changes are to be made
to the sample size, at what time points and
PersPecti ves
954 | deCeMBer 2009 | volUMe 8 www.nature.com/reviews/drugdisc
nrd_persp_dec09.indd 954 16/11/09 13:57:43
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 69
Box 5 | group-sequential and adaptive designs for sample size re-estimation
Group-sequential design. Suppose that the sponsor is unsure of the true value of , but nevertheless
believes that it is larger than the smallest clinically important delta (SCID). In this case, a group-
sequential design might be considered. Such a design is characterized by a maximum sample size,
an interim monitoring strategy and a corresponding boundary for early stopping for efficacy.
The maximum sample size is computed so that the study has adequate power to detect a value
of that the sponsor believes represents a reasonable estimate of the efficacy of the experimental
compound, provided this estimate is at least as large as the SCID. If the sponsor wishes to be very
conservative about this estimate, the maximum sample size needed can be computed to have
adequate power at the SCID itself. An up-front commitment is made to enrol patients up to this
maximum sample size. However, if the true exceeds the SCID, the trial may terminate earlier
with high probability by crossing an early stopping boundary at an interim analysis.
Returning to the example discussed in BOX 4, suppose that the sponsor decides to make an
up-front commitment of 4,000 patients to the trial but intends to monitor the accruing data up to
four times, after 1,000, 2,000, 3,000 and 4,000 patients become evaluable for the primary endpoint.
The commitment of 4,000 patients ensures that the trial will have 88% power to detect a
difference as small as = 0.1 (in this case the SCID). Although this is a rather large sample size to
commit to the trial, the actual sample size is expected to be substantially smaller if the true is
larger than the SCID. This is because at each of the four interim monitoring time points there is a
chance of early termination and a declaration of statistical significance. At each interim analysis,
a test for statistical significance using all available primary endpoint data would be performed,
and the result would be compared with a properly determined early-stopping boundary value.
The trial could be terminated the first time that a boundary is reached, with a valid claim that the
experimental arm is more efficacious than the control arm.
However, sometimes a sponsor might not be willing to make such a large up-front commitment,
particularly when the only currently available data on are from one or two small Phase II trials.
The sponsor might feel more comfortable with a design that starts out with a smaller sample size
of, say, 1,000 patients, with the opportunity to increase the sample size at an interim time point
and after observing data from the trial. This is the motivation for the adaptive design below.
The adaptive design. The group-sequential design described above is characterized by
pre-specifying a maximum sample size up-front and terminating earlier if the true is larger than
anticipated. By contrast, an adaptive design pre-specifies a smaller initial sample size, but with
the possibility of increasing the commitment after seeing some interim data from the trial. On the
surface, this is similar to the usual practice of first running a small Phase II trial to obtain an idea
about efficacy and safety and then following it up with a larger Phase III trial once the efficacy and
safety of the compound have been established. There is, however, an important distinction between
the conventional Phase II followed by Phase III strategy and the adaptive strategy outlined below.
In the conventional approach, the data from the Phase II trial are not combined with the data
from the Phase III trial. The adaptive design, however, uses all the data from both stages for the
final analysis. This can have important advantages both in terms of gaining additional statistical
power, as well as shortening the drug development time. In our example, we stated that the SCID
was 0.1. Supposing that the sponsor believes that the true = 0.2 that is, twice as large as the
SCID if this is indeed the case, then a total sample size of 1,000 patients will have 89% power at
a one-sided level of 0.025. On this basis, the sponsor is prepared to make an initial investment of
1,000 patients to this trial. As an insurance policy, however, the sponsor intends to take an interim
look at the accruing data at the mid-point of the trial, after 500 patients are evaluable for
response. If the estimate of obtained from these 500 is smaller than the sponsor expected,
then the sponsor might choose to increase the sample size to preserve the power of the trial.
Many different criteria can be used to decide whether an increase in sample size is warranted.
A commonly used criterion is conditional power. The conditional power at an interim analysis is
the probability, given the observed data, that the experimental compound will demonstrate
efficacy on completion of the trial. The conditional power computation requires specifying a
value for . One can choose the value specified at the initial design stage or the value estimated
from the interim data. In this example, we use the interim estimated value of for evaluating
conditional power. The table below displays conditional power for various estimated values of
at the interim time point, along with the total sample size needed to achieve 80% conditional
power at the final analysis. The entries in the table assume that = 1.
interim
estimate ()
conditional power without
sample size increase
total sample size needed to achieve
80% conditional power
0.2 95% 720 (sample size reduction)
0.175 86% 890 (sample size reduction)
0.15 72% 1,166 (sample size increase)
0.125 51% 1,757 (sample size increase)
0.1 30% 2,990 (sample size increase)
how the new sample size will be calculated.
Usually, this type of adjustment will not be
permitted by regulatory authorities more
than once.
For unblinded sample size re-estimation,
the sponsor sets up a mechanism (possibly
with the data monitoring committee of
the trial) whereby the SSr is based on an
unblinded estimate of variability (or statistical
information) at the interim analysis. Sample
size may be altered one or more times,
but the maximum statistical information
must be pre-specified.
If the sponsor agrees that there will
be no early stopping for efficacy following
an interim analysis, then no adjustment to
the final analysis criteria is necessary.
The data monitoring committee may
monitor the data one or more times and
adjust the sample size up or down based
on the unblinded estimate of variability
and attempt to reach the pre-specified
maximum information.
When the sponsor pre-specifies the
interim time points at which it is permis-
sible to terminate early for efficacy, the
criteria for each interim analysis must be
pre-specified in a manner that controls the
false-positive rate across the entire study.
This will result in adjustment to the final
analysis criterion if the study is not stopped
early. Interim looks undertaken solely for
administrative purposes, with no inten-
tion of stopping the trial in light of efficacy
data, do not need to have defined criteria.
The trial then proceeds until either it is ter-
minated early for efficacy on the basis of the
pre-defined criteria being reached, or until
the planned maximum information (sample
size or number of events) is reached.
Tackling challenges of new trial designs
Because they are so flexible, these new trial
designs require significant statistical analyses,
simulations and logistical considerations
to verify their operating characteristics,
and therefore tend to require more time
for the planning and protocol development
phase. regulatory agencies and Institutional
review Boards also need to approve the
design format for interim analysis, and these
discussions can sometimes take considerable
time. Such time considerations can lead a
company to follow the traditional route to
clinical development, without fully appre-
ciating the advantages that adaptive designs
can eventually bring in terms of time and
cost savings, and probability of success.
as described above, adaptive designs
further require the following: quickly
observable responses relative to the patient
PersPecti ves
naTUre revIeWS | Drug Discovery volUMe 8 | deCeMBer 2009 | 955
nrd_persp_dec09.indd 955 16/11/09 13:57:43
Nature Reviews | Drug Discovery
R
e
s
p
o
n
s
e
Wasted doses Dose Wasted doses
Box 3 | Adaptive dose finding
In an adaptive dose-finding study, the dose assignment(s) to the next subject, or next cohort of
patients, is based on responses of previous subjects, and the dose assignment is chosen to maximize
the information about the doseresponse curve, according to some pre-defined objective metric
(for example, variability in parameter estimates). In a traditional dose-finding trial, selecting a few
doses may not adequately represent the doseresponse relationship and many patients will be
allocated to non-informative doses (wasted doses), as shown in the figure. In adaptive dose-finding,
the strategy is to initially include only a few patients on many doses to explore the doseresponse,
then to allocate the dose range of interest to more patients. This reduces the allocation of patients
to non-informative doses
27,28
. Compared with fixed randomization, this approach has the ethical
advantage that fewer subjects are assigned doses that are too high or too low. It can also avoid
additional, separate trials that might be necessary when fixed dose-finding trials do not adequately
define the dose range.
Adaptive dose-finding trials also require
an infrastructure that allows the rapid
communication of responses from trial sites to a
central unblinded analysis centre and of adaptive
dose assignments to the trial sites. Randomization
software capable of rapidly computing dynamic
allocation of doses to subjects is additionally
mandated by adaptive trials because pre-specified
randomization lists will not work. In addition,
a flexible drug-supply process is required because
demand for doses is not fixed in advance,
but rather evolves as information on responses at
various doses is gathered as the trial progresses.
Box 4 | issues with the standard clinical development approach
Issues with the standard approach to clinical development can be illustrated by considering a
randomized clinical trial with the following assumptions. Based on available evidence from
early-phase trials, it is estimated that = 1, that the anticipated effect size = 0.2 and that the
smallest clinically important delta (SCID) is 0.1. Rather than conservatively enrolling a sample size
required to demonstrate the SCID (4,000 subjects), the sponsor appropriately powers the trial to
detect the estimated larger (1,000 subjects). Now, suppose that the true underlying value of is
0.15. In that case, a sample size of 2,000 subjects would be required to adequately power the trial
to detect this difference. The difficulty is, of course, that the true underlying value of is not
known at the start of the trial. In this example, the 1,000-subject study would probably yield a
non-significant result, as it is only powered to detect an effect size of 0.2, which is larger than the
actual effect size of 0.15.
In this example, unless the 1,000-patient under-powered trial was repeated with a larger sample
size, then a potentially efficacious treatment would be unnecessarily and unfortunately discarded.
If the trial were to be repeated with the re-estimation of the actual effect size, then 2,000 patients
would need to be enrolled, and the time and resources to perform the original trial (sometimes
more than 3 years) would have been spent without much benefit other than gaining a more
reliable estimate of the actual effect size in order to design the second trial. More importantly,
the subjects for that study would have been put at unnecessary risk because the study had no real
chance of being definitive.
truth is an effect size closer to the SCId,
the trial will be underpowered and therefore
have a high chance of failure.
one approach to solving the problem of
uncertainty about is to design and execute
an additional number of exploratory trials
(typically Phase II studies). These small
Phase II studies are normally carried out to
get a more precise estimate (or best guess)
of the actual and so that the confirma-
tory study might be adequately powered.
each exploratory trial, although somewhat
smaller than confirmatory trials, still
requires significant resources to perform
appropriately. also, the inevitable start-up
time and wind-down activities between
trials have to be included when determining
true programme efficiency and develop-
ment timelines. This might therefore not
be the most efficient way to proceed from
the viewpoint of the entire clinical trial
programme.
Advantages of adaptive SSR in confirmatory
trials. a more flexible approach to the
fixed sample-size methodology is needed.
By altering the sample size using interim
data from the trial itself, this flexibility can
be achieved without compromising the
power or the false-positive rate of the trial
(that is, the chance of making a false claim
of efficacy for a treatment that is not effica-
cious). SSr should be considered in two
situations: when there is significant uncer-
tainty about ; or when there is a substantial
difference between the sample size resulting
from using the SCId and the sample size the
sponsor can justify on the basis of their best
guess of the effect size
29
.
SSr usually involves the choice of a suitable
initial sample size, including one or more
interim analyses at which the sample size
will be re-assessed
30
. There are two distinct
strategies the group sequential strategy
and the adaptive SSr strategy for choosing
the initial sample size, and then altering it on
the basis of data obtained at various interim
analysis time points. The group sequential
strategy, which is also an adaptive design,
begins with a large up-front sample size
commitment and cuts back if the accruing
data suggest that the large sample size is not
needed. The adaptive SSr strategy proceeds
in the opposite direction, starting out with
a smaller initial sample size commitment
but with the option to increase it should the
accruing data suggest that such an increase is
warranted
3033
(BOX 5).
Extending the methodology to unknown .
although the group sequential and adap-
tive SSr methods were presented under the
assumption that the standard deviation
is known, they apply equally for the case
of unknown
3032
. one can start out with
an initial estimate of and corresponding
sample-size estimate. Then, following an
interim analysis, one can re-estimate this
nuisance parameter, input the updated esti-
mate into the equation and re-compute the
sample size. an illustrative example is given
in FIG. 3.
There are two ways to obtain the new
sample size in the situation of unknown :
blinded and unblinded. In the instance of
blinded sample size re-estimation, the
sponsor uses pooled data to estimate .
This is permitted with no penalty to the
analysis criteria (that is, alpha, or the
probability of Type I (false positive) error).
It is preferable that the sponsor pre-specifies
how many times changes are to be made
to the sample size, at what time points and
PersPecti ves
954 | deCeMBer 2009 | volUMe 8 www.nature.com/reviews/drugdisc
nrd_persp_dec09.indd 954 16/11/09 13:57:43
70 | OCTOBER 2011 | THE FUTURE OF DRUG INNOVATION | NATURE REPRINT COLLECTION www.nature.com/reprintcollections/lilly/drug-innovation
26. Gallo, P. et al. Adaptive designs in clinical drug
development an executive summary of the PhRMA
Working Group. J. Biopharm. Stat. 16, 275283
(2006).
27. Bornkamp, B. et al. Innovative approaches for
designing and analyzing adaptive dose-ranging trials.
J. Biopharm. Stat. 17, 965995 (2007).
28. Weir, C. J., Spiegelhalter, D. J. & Grieve, A. P.
Flexible design and efficient implementation of
adaptive dose-finding studies. J. Biopharm. Stat.
17, 10331050 (2007).
29. Bretz, F., Schmidli, H., Knig, F., Racine, A. &
Maurer, W. Confirmatory seamless Phase II/III clinical
trials with hypotheses selection at interim: general
concepts. Biom. J. 48, 623634 (2006).
30. Mehta, C. R. & Patel, N. R. Adaptive, group
sequential and decision theoretic approaches
to sample size determination. Stat. Med. 25,
32503269 (2006).
31. Chuang-Stein, C., Anderson, K., Gallo, P. & Collins, S.
Sample size reestimation: a review and
recommendations. Drug Inf. J. 40, 475484 (2006).
32. Golub, H. L. The need for more efficient clinical trials.
Stat. Med. 25, 32313235 (2006).
33. Tsiatis, A. A. & Mehta, C. On the inefficiency of the
adaptive design for monitoring clinical trials.
Biometrika 90, 367378 (2003).
Acknowledgements
A special acknowledgment to W. Dere (Amgen), S. Cummings
(UCSF), A. Lee (Pfizer) and E. Berndt (MIT-CBI) for signifi-
cant contributions to discussions leading to this manuscript.
Also, many thanks to the McKinsey Trial Design Team for their
support (M. E., E. F., N. S. and T. T.).
Competing interests statement
The authors declare competing financial interests: see web
version for details.
DATABASES
OMiM:
http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=OMiM
MuckleWells syndrome | type 2 diabetes
SUppLEMEnTARy inFoRMATion
see online article: s1 (box) | s2 (box) | s3 (figure)
ALL Links Are Active in the onLine PDf
PersPecti ves
naTUre revIeWS | Drug Discovery volUMe 8 | deCeMBer 2009 | 957
nrd_persp_dec09.indd 957 16/11/09 13:57:44
Nature Reviews | Drug Discovery
Active
Final analysis
LPFV
Interim analysis
Sample size re-estimation
Enrollment
Control
Power
n
= 0.375
= 90%
= 1.0
= 150
Power
n
= 0.375
= 90%
= 1.4
= 295
Learning
Figure 3 | re-estimating sample size while maintaining statistical power. The figure illustrates
a hypothetical example of a study in which sample size re-estimation due to uncertainty about the
standard deviation led to an increase in sample size to ensure 90% power was maintained. At the
beginning of the trial, the planned sample size was estimated at 150 patients based on a standard
deviation of 1.0. At the interim analysis, the actual standard deviation was 1.4. even though the effect
size () was as originally predicted, an increase in sample size to 295 patients would be required to
maintain 90% power. Without the sample size re-estimation, the power at the final analysis would only
be 64% and there would be much greater risk of a failed trial. LPFv, last patient first visit.
accrual rate or good longitudinal forecasting
models; efficient design and implementa-
tion software and fast computing platforms;
an infrastructure that facilitates rapid
communication across trial sites to the
central unblinded analysis centre and rapid
communication of dose assignments to trial
sites; and a flexible drug-supply process.
appropriate models, which reliably charac-
terize the longitudinal behaviour of clinical
endpoints, or the relationship between
biomarkers and endpoints, are also crucial
to the success of the modern clinical devel-
opment paradigm discussed here. Because
model assumptions often need to be
checked and at times revised after data
have been observed, an intriguing possibility
is to use adaptive modelling approaches.
This is a topic for further research, and is
beyond the scope for this paper.
Maximizing the use of all potential prior
information requires greater collaboration
across functional silos in organizations
to avoid compartmentalization of data.
In practice, the inclusion of a broader sample
of datasets can be difficult because of a lack of
common data standards. These problems are
compounded by competitive hurdles to sharing
what is considered proprietary information
about novel therapies without PoC, which
inhibits the exchange of data. overcoming
internal resistance and aversion to change also
represents a major hurdle for incorporating
the prospective use of novel trial designs and
methodologies, and modelling and simula-
tion, into clinical development programmes.
a key challenge for the implementation
of tools and techniques which advance the
quality, timeliness and efficiency of drug
development is the ability to work across dis-
ciplines and amongst stakeholders to under-
stand how and when to apply these solutions.
To address this challenge, we make the fol-
lowing recommendations. First, a common
vocabulary and a common understanding of
the value of modern trial designs to all stake-
holders needs to be defined and disseminated.
Second, at the same time, guidelines and case
studies for assessing situations in which tools
should be applied, as well as for those scenar-
ios when they should not be utilized, should
be developed and disseminated. Third, there
is a need to create a methodology for dia-
logue with regulatory authorities to facilitate
discussion of clinical strategies which utilize
these tools and address potential constraints
and issues. Finally, it will be crucial to iden-
tify specific solutions to address all mindset
obstacles and factual objections that inhibit
the adoption of modern tools and adaptive
study designs.
John Orloff, Jose Pinheiro, Michael Branson,
Paul Gallo and Donald Stanski are at Novartis
Pharmaceuticals Corporation, One Health Plaza,
East Hanover, New Jersey 07936, USA.
Frank L. Douglas is at the Austen BioInnovation
Institute, 1 South Main Street, Suite 401,
Akron, Ohio 44308, USA.
Susan Levinson
is
at The Strategic Choice LLC, 6 East
Cove Lane, Morristown, New Jersey 07960, USA.
Pravin Chaturvedi is at Napo Pharmaceuticals,
250 East Grand Avenue, Suite 70,
South San Francisco, California 94080, USA.
Ene Ette
is at Anoixis Corporation, 214 North Main
Street, Suite 104, Natick, Massachusetts 01760, USA.
Gigi Hirsch, Nitin Patel,
Sameer Sabir, Stacy Springs
and
Howard Golub
are
at the Center for Biomedical
Innovation, Massachusetts Institute of Technology,
77 Massachusetts Avenue (E19611), Cambridge,
Massachusetts 021394307, USA.
Cyrus Mehta is at Cytel Statistical Software and
Services, 675 Massachusetts Avenue, Cambridge,
Massachusetts 02139, USA.
Matthias R. Evers, Edd Fleming, Navjot Singh and
Tony Tramontin are
at McKinsey & Company, Inc.,
Am Sandtorkai 77, 20457 Hamburg, Germany.
Correspondence to J. O.
email: john.orloff@novartis.com
doi:10.1038/nrd3025
Published online 9 October 2009
1. Booth, B & Zemmel, R. Prospects for productivity.
Nature Rev. Drug Discov. 3, 451456 (2004).
2. Gilbert, J., Henske, P. & Singh, A. Rebuilding big
pharmas business model. In Vivo 21, 14 (2003).
3. Kola, I. & Landis, J. Can the pharmaceutical industry
reduce attrition rates? Nature Rev. Drug Discov. 3,
711716 (2004).
4. Budget US Govt., App., FY 19932003.
5. Parexels Pharmaceutical R&D Statistical Sourcebook
2002/2003 (Parexel International, Waltham, USA,
2003).
6. Adams, C. P. & Brantner, V. V. Spending on new
drug development. Health Econ. 26 Feb 2009
(doi: 10.1002/hec.1454).
7. DiMasi, J. A., Hansen, R. W. & Grabowski, H. G.
The price of innovation: new estimates of drug
development costs. J. Health Econ. 22, 151185
(2003).
8. Adams, C. & Brantner, V. V. Estimating the cost of
new drug development: is it really $802 million?
Health Aff. 2, 420428 (2006).
9. Pharmaceutical R&D Factbook 2007 (CMR
International, London, UK, 2007).
10. KMR General Metrics Study (KMR Group,
Chicago, USA, 2007).
11. Sheiner, L. B. & Steimer, J.-L. Pharmacokinetic/
pharmacodynamic modeling in drug development.
Ann. Rev. Pharmacol. Toxicol. 40, 6795 (2000).
12. Lalonde, R. L. et al. Model-based drug development.
Clin. Pharmacol. Ther. 82, 2132 (2007).
13. Breimer, D. D. & Danhof, M. Relevance of the
application of pharmacokineticpharmacodynamic
modeling concepts in drug development. The Wooden
Shoe paradigm. Clin. Pharmacokinet. 32, 259267
(1997).
14. Danhof, M., Alvan, G., Dahl, S. G., Kuhlmann, J. &
Paintaud, G. Mechanism-based pharmacokinetic/
pharmacodynamic modeling a new classification of
biomarkers. Pharm. Res. 22, 14321437 (2005).
15. Holford, N. H. G., Kimko, H. C., Monteleone, J. P. R.
& Peck, C. C. Simulation of clinical trials. Annu. Rev.
Pharmacol. Toxicol. 40, 209234 (2000).
16. Miller, R. et al. How modeling and simulation have
enhanced decision making in new drug development.
J. Pharmacokinet. Pharmacodyn. 32, 185197
(2005).
17. Berry, D. A. Bayesian statistics. Med. Decis. Making
26, 429430 (2006).
18. Mller, P., Berry, D. A., Grieve, A. P., Smith, M. &
Krams, M. Simulation-based sequential Bayesian
design. J. Stat. Plan. Inference 137, 31403150
(2007).
19. Goggin, T. et al. Modeling and simulation of clinical
trials: an industrial perspective. In Simulation for
Designing of Clinical Trials (eds Kimko, H. C. & Duffull,
S. B.) 227224 (Marcel Dekker, New York, USA,
2002).
20. Reigner, B. G. et al. An evaluation of the integration
of pharmacokinetic and pharmacodynamic principles
in clinical drug development. Experience within
Hoffman La Roche. Clin. Pharmacokinet. 33,
142152 (1997).
21. Lachmann, H. J. et al. Use of canakinumab in the
cryopyrin-associated periodic syndrome. N. Engl.
J. Med. 360, 24162425 (2009).
22. Berry, D. A. Bayesian clinical trials. Nature Rev. Drug
Discov. 5, 2736 (2006).
23. Berry, D. A. Introduction to Bayesian methods III:
use and interpretation of Bayesian tools in design and
analysis. Clin. Trials 2, 295300 (2005).
24. Berry, D. A. Adaptive trial design. Clin. Adv. Hematol.
Oncol. 5, 522524 (2007).
25. Krams, M. et al. Adaptive designs in clinical drug
development: opportunities, challenges, and
scope reflections following PhRMAs November
2006 workshop. J. Biopharm. Stat.17, 957964
(2007).
PersPecti ves
956 | deCeMBer 2009 | volUMe 8 www.nature.com/reviews/drugdisc
nrd_persp_dec09.indd 956 16/11/09 13:57:44
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 71
26. Gallo, P. et al. Adaptive designs in clinical drug
development an executive summary of the PhRMA
Working Group. J. Biopharm. Stat. 16, 275283
(2006).
27. Bornkamp, B. et al. Innovative approaches for
designing and analyzing adaptive dose-ranging trials.
J. Biopharm. Stat. 17, 965995 (2007).
28. Weir, C. J., Spiegelhalter, D. J. & Grieve, A. P.
Flexible design and efficient implementation of
adaptive dose-finding studies. J. Biopharm. Stat.
17, 10331050 (2007).
29. Bretz, F., Schmidli, H., Knig, F., Racine, A. &
Maurer, W. Confirmatory seamless Phase II/III clinical
trials with hypotheses selection at interim: general
concepts. Biom. J. 48, 623634 (2006).
30. Mehta, C. R. & Patel, N. R. Adaptive, group
sequential and decision theoretic approaches
to sample size determination. Stat. Med. 25,
32503269 (2006).
31. Chuang-Stein, C., Anderson, K., Gallo, P. & Collins, S.
Sample size reestimation: a review and
recommendations. Drug Inf. J. 40, 475484 (2006).
32. Golub, H. L. The need for more efficient clinical trials.
Stat. Med. 25, 32313235 (2006).
33. Tsiatis, A. A. & Mehta, C. On the inefficiency of the
adaptive design for monitoring clinical trials.
Biometrika 90, 367378 (2003).
Acknowledgements
A special acknowledgment to W. Dere (Amgen), S. Cummings
(UCSF), A. Lee (Pfizer) and E. Berndt (MIT-CBI) for signifi-
cant contributions to discussions leading to this manuscript.
Also, many thanks to the McKinsey Trial Design Team for their
support (M. E., E. F., N. S. and T. T.).
Competing interests statement
The authors declare competing financial interests: see web
version for details.
DATABASES
OMiM:
http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=OMiM
MuckleWells syndrome | type 2 diabetes
SUppLEMEnTARy inFoRMATion
see online article: s1 (box) | s2 (box) | s3 (figure)
ALL Links Are Active in the onLine PDf
PersPecti ves
naTUre revIeWS | Drug Discovery volUMe 8 | deCeMBer 2009 | 957
nrd_persp_dec09.indd 957 16/11/09 13:57:44
Nature Reviews | Drug Discovery
Active
Final analysis
LPFV
Interim analysis
Sample size re-estimation
Enrollment
Control
Power
n
= 0.375
= 90%
= 1.0
= 150
Power
n
= 0.375
= 90%
= 1.4
= 295
Learning
Figure 3 | re-estimating sample size while maintaining statistical power. The figure illustrates
a hypothetical example of a study in which sample size re-estimation due to uncertainty about the
standard deviation led to an increase in sample size to ensure 90% power was maintained. At the
beginning of the trial, the planned sample size was estimated at 150 patients based on a standard
deviation of 1.0. At the interim analysis, the actual standard deviation was 1.4. even though the effect
size () was as originally predicted, an increase in sample size to 295 patients would be required to
maintain 90% power. Without the sample size re-estimation, the power at the final analysis would only
be 64% and there would be much greater risk of a failed trial. LPFv, last patient first visit.
accrual rate or good longitudinal forecasting
models; efficient design and implementa-
tion software and fast computing platforms;
an infrastructure that facilitates rapid
communication across trial sites to the
central unblinded analysis centre and rapid
communication of dose assignments to trial
sites; and a flexible drug-supply process.
appropriate models, which reliably charac-
terize the longitudinal behaviour of clinical
endpoints, or the relationship between
biomarkers and endpoints, are also crucial
to the success of the modern clinical devel-
opment paradigm discussed here. Because
model assumptions often need to be
checked and at times revised after data
have been observed, an intriguing possibility
is to use adaptive modelling approaches.
This is a topic for further research, and is
beyond the scope for this paper.
Maximizing the use of all potential prior
information requires greater collaboration
across functional silos in organizations
to avoid compartmentalization of data.
In practice, the inclusion of a broader sample
of datasets can be difficult because of a lack of
common data standards. These problems are
compounded by competitive hurdles to sharing
what is considered proprietary information
about novel therapies without PoC, which
inhibits the exchange of data. overcoming
internal resistance and aversion to change also
represents a major hurdle for incorporating
the prospective use of novel trial designs and
methodologies, and modelling and simula-
tion, into clinical development programmes.
a key challenge for the implementation
of tools and techniques which advance the
quality, timeliness and efficiency of drug
development is the ability to work across dis-
ciplines and amongst stakeholders to under-
stand how and when to apply these solutions.
To address this challenge, we make the fol-
lowing recommendations. First, a common
vocabulary and a common understanding of
the value of modern trial designs to all stake-
holders needs to be defined and disseminated.
Second, at the same time, guidelines and case
studies for assessing situations in which tools
should be applied, as well as for those scenar-
ios when they should not be utilized, should
be developed and disseminated. Third, there
is a need to create a methodology for dia-
logue with regulatory authorities to facilitate
discussion of clinical strategies which utilize
these tools and address potential constraints
and issues. Finally, it will be crucial to iden-
tify specific solutions to address all mindset
obstacles and factual objections that inhibit
the adoption of modern tools and adaptive
study designs.
John Orloff, Jose Pinheiro, Michael Branson,
Paul Gallo and Donald Stanski are at Novartis
Pharmaceuticals Corporation, One Health Plaza,
East Hanover, New Jersey 07936, USA.
Frank L. Douglas is at the Austen BioInnovation
Institute, 1 South Main Street, Suite 401,
Akron, Ohio 44308, USA.
Susan Levinson
is
at The Strategic Choice LLC, 6 East
Cove Lane, Morristown, New Jersey 07960, USA.
Pravin Chaturvedi is at Napo Pharmaceuticals,
250 East Grand Avenue, Suite 70,
South San Francisco, California 94080, USA.
Ene Ette
is at Anoixis Corporation, 214 North Main
Street, Suite 104, Natick, Massachusetts 01760, USA.
Gigi Hirsch, Nitin Patel,
Sameer Sabir, Stacy Springs
and
Howard Golub
are
at the Center for Biomedical
Innovation, Massachusetts Institute of Technology,
77 Massachusetts Avenue (E19611), Cambridge,
Massachusetts 021394307, USA.
Cyrus Mehta is at Cytel Statistical Software and
Services, 675 Massachusetts Avenue, Cambridge,
Massachusetts 02139, USA.
Matthias R. Evers, Edd Fleming, Navjot Singh and
Tony Tramontin are
at McKinsey & Company, Inc.,
Am Sandtorkai 77, 20457 Hamburg, Germany.
Correspondence to J. O.
email: john.orloff@novartis.com
doi:10.1038/nrd3025
Published online 9 October 2009
1. Booth, B & Zemmel, R. Prospects for productivity.
Nature Rev. Drug Discov. 3, 451456 (2004).
2. Gilbert, J., Henske, P. & Singh, A. Rebuilding big
pharmas business model. In Vivo 21, 14 (2003).
3. Kola, I. & Landis, J. Can the pharmaceutical industry
reduce attrition rates? Nature Rev. Drug Discov. 3,
711716 (2004).
4. Budget US Govt., App., FY 19932003.
5. Parexels Pharmaceutical R&D Statistical Sourcebook
2002/2003 (Parexel International, Waltham, USA,
2003).
6. Adams, C. P. & Brantner, V. V. Spending on new
drug development. Health Econ. 26 Feb 2009
(doi: 10.1002/hec.1454).
7. DiMasi, J. A., Hansen, R. W. & Grabowski, H. G.
The price of innovation: new estimates of drug
development costs. J. Health Econ. 22, 151185
(2003).
8. Adams, C. & Brantner, V. V. Estimating the cost of
new drug development: is it really $802 million?
Health Aff. 2, 420428 (2006).
9. Pharmaceutical R&D Factbook 2007 (CMR
International, London, UK, 2007).
10. KMR General Metrics Study (KMR Group,
Chicago, USA, 2007).
11. Sheiner, L. B. & Steimer, J.-L. Pharmacokinetic/
pharmacodynamic modeling in drug development.
Ann. Rev. Pharmacol. Toxicol. 40, 6795 (2000).
12. Lalonde, R. L. et al. Model-based drug development.
Clin. Pharmacol. Ther. 82, 2132 (2007).
13. Breimer, D. D. & Danhof, M. Relevance of the
application of pharmacokineticpharmacodynamic
modeling concepts in drug development. The Wooden
Shoe paradigm. Clin. Pharmacokinet. 32, 259267
(1997).
14. Danhof, M., Alvan, G., Dahl, S. G., Kuhlmann, J. &
Paintaud, G. Mechanism-based pharmacokinetic/
pharmacodynamic modeling a new classification of
biomarkers. Pharm. Res. 22, 14321437 (2005).
15. Holford, N. H. G., Kimko, H. C., Monteleone, J. P. R.
& Peck, C. C. Simulation of clinical trials. Annu. Rev.
Pharmacol. Toxicol. 40, 209234 (2000).
16. Miller, R. et al. How modeling and simulation have
enhanced decision making in new drug development.
J. Pharmacokinet. Pharmacodyn. 32, 185197
(2005).
17. Berry, D. A. Bayesian statistics. Med. Decis. Making
26, 429430 (2006).
18. Mller, P., Berry, D. A., Grieve, A. P., Smith, M. &
Krams, M. Simulation-based sequential Bayesian
design. J. Stat. Plan. Inference 137, 31403150
(2007).
19. Goggin, T. et al. Modeling and simulation of clinical
trials: an industrial perspective. In Simulation for
Designing of Clinical Trials (eds Kimko, H. C. & Duffull,
S. B.) 227224 (Marcel Dekker, New York, USA,
2002).
20. Reigner, B. G. et al. An evaluation of the integration
of pharmacokinetic and pharmacodynamic principles
in clinical drug development. Experience within
Hoffman La Roche. Clin. Pharmacokinet. 33,
142152 (1997).
21. Lachmann, H. J. et al. Use of canakinumab in the
cryopyrin-associated periodic syndrome. N. Engl.
J. Med. 360, 24162425 (2009).
22. Berry, D. A. Bayesian clinical trials. Nature Rev. Drug
Discov. 5, 2736 (2006).
23. Berry, D. A. Introduction to Bayesian methods III:
use and interpretation of Bayesian tools in design and
analysis. Clin. Trials 2, 295300 (2005).
24. Berry, D. A. Adaptive trial design. Clin. Adv. Hematol.
Oncol. 5, 522524 (2007).
25. Krams, M. et al. Adaptive designs in clinical drug
development: opportunities, challenges, and
scope reflections following PhRMAs November
2006 workshop. J. Biopharm. Stat.17, 957964
(2007).
PersPecti ves
956 | deCeMBer 2009 | volUMe 8 www.nature.com/reviews/drugdisc
nrd_persp_dec09.indd 956 16/11/09 13:57:44
Brought to you by
Access the insights, advice and commentary of scientists and
entrepreneurs building biotech sectors around the world.
Trade Secrets is an interactive platform aiming to inform a new generation of biotech innovators by
providing rst-person accounts from industry insiders, and by allowing readers to directly interact with
bloggers via the comments section. Our contributors hail from India, China, Latin American, North
America, Europe and beyond, and their backgrounds span the biotech spectrum. Recent posts have covered
business models, recent returns from VC funds, and the Chinese governments role in growing
biotech, to name a few.
Join the global dialogue on life science entrepreneurship.
Scan this code using your mobile device to bookmark the site:
http://blogs.nature.com/trade_secrets
Trade Secrets
A Nature Network blog by Bioentrepreneur
23034-06_Nature_Network_TradeSecrets.indd 1 14/06/2011 16:51
Large pharma is in trouble, but is essential
for the success of the industry. Tadataka Tachi
Yamada, President, Global Health Program,
Bill and Melinda Gates Foundation
The pharmaceutical industry is currently
facing the key challenges of declining R&D
productivity, higher barriers to commercial
success for innovative drugs and substantial
imminent losses of revenue from successful
products due to generic competition.
For example, it has been estimated that
for every US dollar of revenue lost from
established products by the largest pharma
ceutical companies as a group between
2007 and 2012, only 26 cents will be
replaced by revenue from new products
1
.
Awareness of these challenges has
catalysed and continues to drive
considerable reorganizations in the R&D
structures of large pharmaceutical com
panies. Among the goals of such reorganiza
tions has been the promotion of the type of
entrepreneurial culture and behaviour that
is considered to thrive in smaller biotech
nology companies
2
in the hope that this will
increase R&D productivity. Indeed, industry
observers have attributed some of the
present crises in the pharmaceutical industry
to the discouragement of entrepreneurial
behaviour by limitations inherent in the
unwieldy bureaucracies that can proliferate
in large pharmaceutical companies
3
.
Given that the R&D departments in large
pharmaceutical companies in theory provide
strong platforms for innovation and thus
competitive advantage, we therefore sought
to investigate three interrelated questions
about the potential for entrepreneurship in
such companies. First, to what extent is there
evidence of entrepreneurial behaviour in large
pharmaceutical companies? Second, can the
entrepreneurial behaviour characteristic of
small biotechnology firms coexist in the con
text of the largescale and latestage develop
ment activities typical in large pharmaceutical
companies? And third, are there any lessons
from the experiences of R&D leaders in such
companies that could be used to inform the
future development of corporate cultures in
the pharmaceutical industry?
In an attempt to answer these questions,
we first reviewed the relevant literature
and identified some of the characteristics
associated with entrepreneurial behaviour
4
.
It must, however, be noted that there is a
paucity of literature on entrepreneurial
behaviour in industries with a prolonged
cycle time between the application of new
science and product launch, as is the case in
the pharmaceutical industry. We chose to
focus on three principal characteristics of
entrepreneurs which we termed vision,
bias for action and winning attitude and
identified forms of behaviour corresponding
to each category for both individual
entrepreneurs and entrepreneurial
organizations. Vision refers to the ability
to see and the drive to realize the potential
value of nascent ideas and technologies.
Bias for action refers to a readiness to make
and to implement decisions and to modify
these actions as new information becomes
available. Winning attitude is the propensity
to see hurdles as manageable challenges and
to treat what others consider failure merely
as unwanted or unexpected outcomes.
Our research relied on openended
interviews with former and present leaders
of R&D departments in pharmaceutical and
biotechnology companies (see BOX 1 for the
affiliations of the interviewees and BOX 2
for the interview methods). Together, these
organizations represented greater than 35% of
the pharmaceutical industry output in 2007
(as measured in sales)
5,6
. In this article, we
synthesize the findings from these interviews
to highlight common themes and key factors
that could promote entrepreneurial behaviour
in the pharmaceutical industry, and thereby
help to enhance R&D productivity.
Theme 1: fewer shots on goal
Success isnt necessarily how many shots on
goal, but on betting on the high probability.
Its fewer shots on goal. Phil Needleman,
former Senior Executive Vice President and
Chief Scientist, Pharmacia
Approaches to drug discovery that focus
on the number of compounds, which were
established in some companies from the
late 1990s onwards, may have actually
discouraged entrepreneurial behaviour
during the discovery phase. The compound
progression model [which focuses on the
significance of attrition during each phase of
development] might have rendered a major
disservice to the biopharmaceutical industry,
noted Yamada. It took the industry away
from innovation and pushed it to volume.
The consequence of this approach was
a focus on portfolio management and on
quantity instead of quality, and an emphasis
on the production of new molecular entities
(NMEs) at each stage. As Yamada explained,
large companies were then evaluated and
rewarded by analysts for the number of
compounds in their R&D pipeline and,
OuTlOOk
The case for entrepreneurship in
R&D in the pharmaceutical industry
Frank L. Douglas, V. K. Narayanan, Lesa Mitchell and Robert E. Litan
Abstract | A lack of entrepreneurial behaviour has often been highlighted as a
contributor to the decline in the research and development (R&D) productivity
of the pharmaceutical industry. Here, we present an assessment of
entrepreneurship in the industry, based on interviews with 26 former and
current leaders of R&D departments at major pharmaceutical and biotechnology
companies. Factors are highlighted that could be important in promoting
entrepreneurial behaviour, which might serve as a catalyst for revitalizing R&D
productivity.
PeRsPectives
NATURE REVIEWS | Drug Discovery VOlUME 9 | SEPTEMBER 2010 | 683
nrd_persp_sep10.indd 683 18/8/10 14:06:26
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 73
Brought to you by
Access the insights, advice and commentary of scientists and
entrepreneurs building biotech sectors around the world.
Trade Secrets is an interactive platform aiming to inform a new generation of biotech innovators by
providing rst-person accounts from industry insiders, and by allowing readers to directly interact with
bloggers via the comments section. Our contributors hail from India, China, Latin American, North
America, Europe and beyond, and their backgrounds span the biotech spectrum. Recent posts have covered
business models, recent returns from VC funds, and the Chinese governments role in growing
biotech, to name a few.
Join the global dialogue on life science entrepreneurship.
Scan this code using your mobile device to bookmark the site:
http://blogs.nature.com/trade_secrets
Trade Secrets
A Nature Network blog by Bioentrepreneur
23034-06_Nature_Network_TradeSecrets.indd 1 14/06/2011 16:51
Large pharma is in trouble, but is essential
for the success of the industry. Tadataka Tachi
Yamada, President, Global Health Program,
Bill and Melinda Gates Foundation
The pharmaceutical industry is currently
facing the key challenges of declining R&D
productivity, higher barriers to commercial
success for innovative drugs and substantial
imminent losses of revenue from successful
products due to generic competition.
For example, it has been estimated that
for every US dollar of revenue lost from
established products by the largest pharma
ceutical companies as a group between
2007 and 2012, only 26 cents will be
replaced by revenue from new products
1
.
Awareness of these challenges has
catalysed and continues to drive
considerable reorganizations in the R&D
structures of large pharmaceutical com
panies. Among the goals of such reorganiza
tions has been the promotion of the type of
entrepreneurial culture and behaviour that
is considered to thrive in smaller biotech
nology companies
2
in the hope that this will
increase R&D productivity. Indeed, industry
observers have attributed some of the
present crises in the pharmaceutical industry
to the discouragement of entrepreneurial
behaviour by limitations inherent in the
unwieldy bureaucracies that can proliferate
in large pharmaceutical companies
3
.
Given that the R&D departments in large
pharmaceutical companies in theory provide
strong platforms for innovation and thus
competitive advantage, we therefore sought
to investigate three interrelated questions
about the potential for entrepreneurship in
such companies. First, to what extent is there
evidence of entrepreneurial behaviour in large
pharmaceutical companies? Second, can the
entrepreneurial behaviour characteristic of
small biotechnology firms coexist in the con
text of the largescale and latestage develop
ment activities typical in large pharmaceutical
companies? And third, are there any lessons
from the experiences of R&D leaders in such
companies that could be used to inform the
future development of corporate cultures in
the pharmaceutical industry?
In an attempt to answer these questions,
we first reviewed the relevant literature
and identified some of the characteristics
associated with entrepreneurial behaviour
4
.
It must, however, be noted that there is a
paucity of literature on entrepreneurial
behaviour in industries with a prolonged
cycle time between the application of new
science and product launch, as is the case in
the pharmaceutical industry. We chose to
focus on three principal characteristics of
entrepreneurs which we termed vision,
bias for action and winning attitude and
identified forms of behaviour corresponding
to each category for both individual
entrepreneurs and entrepreneurial
organizations. Vision refers to the ability
to see and the drive to realize the potential
value of nascent ideas and technologies.
Bias for action refers to a readiness to make
and to implement decisions and to modify
these actions as new information becomes
available. Winning attitude is the propensity
to see hurdles as manageable challenges and
to treat what others consider failure merely
as unwanted or unexpected outcomes.
Our research relied on openended
interviews with former and present leaders
of R&D departments in pharmaceutical and
biotechnology companies (see BOX 1 for the
affiliations of the interviewees and BOX 2
for the interview methods). Together, these
organizations represented greater than 35% of
the pharmaceutical industry output in 2007
(as measured in sales)
5,6
. In this article, we
synthesize the findings from these interviews
to highlight common themes and key factors
that could promote entrepreneurial behaviour
in the pharmaceutical industry, and thereby
help to enhance R&D productivity.
Theme 1: fewer shots on goal
Success isnt necessarily how many shots on
goal, but on betting on the high probability.
Its fewer shots on goal. Phil Needleman,
former Senior Executive Vice President and
Chief Scientist, Pharmacia
Approaches to drug discovery that focus
on the number of compounds, which were
established in some companies from the
late 1990s onwards, may have actually
discouraged entrepreneurial behaviour
during the discovery phase. The compound
progression model [which focuses on the
significance of attrition during each phase of
development] might have rendered a major
disservice to the biopharmaceutical industry,
noted Yamada. It took the industry away
from innovation and pushed it to volume.
The consequence of this approach was
a focus on portfolio management and on
quantity instead of quality, and an emphasis
on the production of new molecular entities
(NMEs) at each stage. As Yamada explained,
large companies were then evaluated and
rewarded by analysts for the number of
compounds in their R&D pipeline and,
OuTlOOk
The case for entrepreneurship in
R&D in the pharmaceutical industry
Frank L. Douglas, V. K. Narayanan, Lesa Mitchell and Robert E. Litan
Abstract | A lack of entrepreneurial behaviour has often been highlighted as a
contributor to the decline in the research and development (R&D) productivity
of the pharmaceutical industry. Here, we present an assessment of
entrepreneurship in the industry, based on interviews with 26 former and
current leaders of R&D departments at major pharmaceutical and biotechnology
companies. Factors are highlighted that could be important in promoting
entrepreneurial behaviour, which might serve as a catalyst for revitalizing R&D
productivity.
PeRsPectives
NATURE REVIEWS | Drug Discovery VOlUME 9 | SEPTEMBER 2010 | 683
nrd_persp_sep10.indd 683 18/8/10 14:06:26
First published in Nature Reviews Drug Discovery 9, 683-689 (September 2010); doi:10.1038/nrd3230
74 | OCTOBER 2011 | THE FUTURE OF DRUG INNOVATION | NATURE REPRINT COLLECTION www.nature.com/reprintcollections/lilly/drug-innovation
Theme 2: smaller is better
I think the key is creating something which
is close to a biotech company within big
pharma. Garry Neil, Corporate Vice President,
Corporate Office of Science and Technology
(COSAT), Group President, Johnson & Johnson
pharmaceutical R&D
Several heads of research departments
expressed the view that small is better.
Frank Douglas and Tachi Yamada each tried
to reduce size and complexity in their com
panies. In 1998, Douglas introduced the drug
innovation and approval (DI&A) organiza
tion at Hoechst Marion Roussel (now part
of SanofiAventis) in which each of the three
discovery sites (one each in New Jersey, USA,
Frankfurt, Germany, and Paris, France) was
responsible for no more than two to three
therapeutic areas through to Phase IIa, and
a global development centre coordinated the
latestage development and regulatory sub
mission activities. A product development
committee determined which compounds
would be further developed beyond Phase IIa
by the global development centre.
Yamada introduced the Centres of
Excellence for Drug Discovery (CEDDs)
at GlaxoSmithKline. Each CEDD was
responsible for one or two therapeutic areas
through to Phase IIa trials. There was more
autonomy in the CEDD, as compared to
the DI&A, in that the only item that was
centrally controlled was headcount. Recently,
GlaxoSmithKline evolved the CEDDs into
smaller subgroups, as they thought the
CEDDs had become too bureaucratic.
There seems to be an inverse correlation
between the size of an organization and its
potential to develop trust among its constitu
ents and facilitate the rapid exchange of data
for the generation and testing of hypotheses.
Joshua Boger and Vicki Sato described the
focus of Vertex Pharmaceuticals as building
a culture in which people are rewarded for
making quality data rapidly available and
ready for integration. I think they [large
pharmaceutical companies] have difficulty
sharing information quickly holding onto
information can be a form of power it is
part of a behaviour pattern that contributes
to things taking longer, costing more and
creating redundancy, said Sato.
Confidence in the quality of data pre
sented allowed departments to circumvent
the wasteful practice of rechecking data
because of a lack of trust in the expertise or
in the care of those who initially generated
the data. The accessibility of senior managers
and their involvement in project status
discussions is essential in reinforcing these
principles of rapid exchange of quality data
and testing of hypotheses, all of which are
hampered as organizations increase in size.
Boger and Sato also noted that as Vertex
increased in size, much more time was
required to build these cultural aspects. Sato
added: I went to every project team meeting
and before I joined Vertex, Josh went to
every team meeting. It allowed us as senior
executives to lead by example and build the
culture. You can do that when you are small.
However, with 200 to 250 researchers
per therapeutic area, the DI&A and CEDD
groups were still too large in the view of
Goodman, who feels that the optimum size
of a discovery group is one in which all
members could assemble in a modestsized
room and conduct a discussion without
recourse to a microphone. Corr, who led
groups at Searle, ParkeDavis and Pfizer,
thinks that the optimal number is closer to 20
to 40 individuals operating as an autonomous
group. Corr discovered that very small teams
at ParkeDavis allowed for the rapid sharing
of information and resource allocation,
as well as the efficient termination of projects
that would eventually fail. Yamada similarly
talked about small groups being agile and
interconnected to the other person.
A recent experiment at Pfizer, known
as the Biotherapeutics and Bioinnovation
Center, which was led by Goodman and
has since been dissolved, was focused on
managing four to five independent small
biotechnology companies in a network.
In this arrangement, best practices could
be shared and resources leveraged, but each
unit remained autonomous and was to
some extent free to advance its own culture.
The head of each small company was there
fore endowed with a sense of ownership and
could more or less operate as an entrepreneur.
According to Goodman, Pfizer wanted to see
whether such skunkworks strategies, similar
to those used in the information technology
and electrical engineering fields, could be
harnessed to change the way compounds
were typically developed. Neil also supports
this view of the potential of small companies
to produce changes within their respective
larger corporate structures. He characterizes
the culture at Johnson & Johnson as
a hybrid between biotech and large pharma
and attributes its success to the strategy of
maintaining the cultures of newly acquired
companies and adopting their best practices.
Contributing to the apparent consensus on
behalf of the entrepreneurial potential inher
ent in smaller teams, Fishman offered his
perspective on the importance of individuals
in innovation: To me, innovation is generally
an individual effort. There is a person who
sees something different, sees something
new, has a clarity of vision, and the courage
to pursue it. That individual expands to work
in an entrepreneurial team to bring the inno
vation to fruition. Alan Smith expressed a
similar view, noting that in his opinion it is
indeed the curiosity of the individual scien
tist that is most often the driver for discovery
efforts. Robert Armstrong, in commenting
on CHORUS a unit of 32 lilly employees
who comprise an autonomous entity he heads
that conducts lean development from the
candidate selection stage to the proofof
concept of selected lilly compounds said:
not all of them need to be serial entrepre
neurs, but there are individuals who perceive
radically different ways to develop new
molecules and want to enable these concepts
(see also the section on middle managers).
Although many of those interviewed
spoke on behalf of smaller and more entre
preneurial discovery units, Burt Adelman
pointed out that such scale does not in itself
necessarily engender the sense of urgency
crucial to successful product innovation.
He argued that entrepreneurial behaviour
diminished even in biotechnology
companies when the focus was primarily
on publications rather than on products.
In this context, he poses the difficult question
of why scientists who have not been associ
ated even with a failed drug after 6 or 7 years
should still be employed by that company.
George Milne conceded the previously
cited benefits associated with small size, but
also presented an argument on behalf of larger
corporate structures in which smaller units
benefit from the experiences and tacit aggre
gate knowledge of the larger organization.
Milne considers that the biopharmaceutical
industry must learn to scale small entrepre
neurial units without introducing excessive
bureaucracy. Such units thus become empow
ered to unleash random and purposeful
action. Milne also noted that one of the scale
based advantages that a large, entrepreneurial
organization has over a small one is that you
actually get to learn from experiences.
A comment from Jeff leiden provides an
eloquent if blunt summary to a consideration
of the benefits associated with the deploy
ment of smaller teams and the instinctive,
curiositydriven culture they foster: So, it
became clear to me that the way to organize
R&D, and frankly I think the whole busi
ness, is in much smaller entrepreneurial
units where people feel both responsible and
accountable for producing or their unit wont
be renewed. They know that their careers
depend directly on their productivity.
PersPecti ves
NATURE REVIEWS | Drug Discovery VOlUME 9 | SEPTEMBER 2010 | 685
nrd_persp_sep10.indd 685 18/8/10 14:06:26
more recently, for the number in the later
phases of clinical development in particular.
Similarly, research organizations in large
pharmaceutical companies were rewarded
for the number of NMEs produced as
clinical candidates each year. As Corey
Goodman commented, scientists are getting
their bonuses based on trying to make the
numbers. However, with the exception of
a sharp increase between 1996 and 1998,
the number of NMEs approved annually
by the US Food and Drug Administration
(FDA) has not changed over the past five
decades, even though the costs of achieving
approval have increased manyfold during
this period
7
.
Interestingly, an assessment of the value
of small biotechnology companies was driven
by the innovation and science in the one or
two products moving through their pipe
lines. As an example, Tom Glenn recounted
the birth of DNase at Genentech, which was
developed during a biweekly staff meeting
in which research ideas were discussed:
He [Steve Shak, M.D.] brought in two test
tubes. In one test tube, he had this gunky
sputum. In the other test tube, he had this
clear liquid. Ill never forget this. There were
six of us sitting there watching. He mixed
the contents of the two test tubes together,
and they cleared. He said, Gentlemen,
thats DNase. Unbelievable. On the spot we
decided to move forward and finish our
discovery and development program in
DNase, which is now a product marketed
by Genentech.
The insidious consequence of the
focus on quantity in large pharmaceutical
companies has been an emphasis on the
commercially driven evaluation of a portfolio
of compounds, instead of the scientific
merits of each compound. Mark Fishman
similarly expressed scepticism regarding
the deep involvement of commercial
departments before the availability of
clinical data from Phase II trials, when
he stated: Often, they would ask if you
are aligned with the business franchises.
I dont want to be because they are
looking at today, and I want to be there
five to ten years from now. So, if we are
aligned with the current business
franchise, we are dead in the water.
Despite such scepticism, however,
there are those scientists, such as Andreas
Busch, who although not ignoring
compound quality, remain practitioners
of the compound progression approach,
illustrating that innovation can coincide
with less entrepreneurialfocused
approaches. Peter Corr supports Buschs
view, especially when there are more shots
on goal. However, Goodman thinks
that in many of these companies, too many
drugs are being advanced into the clinic.
And Needleman was of the opinion that
success isnt necessarily how many shots
on goal, but on betting on the high
probability. Its fewer shots on goal.
Box 1 | Interviewees
Our research involved open-ended interviews with former and present leaders of research
and development (R&D) departments in large pharmaceutical companies and biotechnology
companies. The sample of interviewees included the following individuals:
Burt Adelman M.D., President of Research and Development at Eleven Biotherapeutics
(2009present), former Executive Vice President of Portfolio Strategy at Biogen Idec
(20032006).
Robert Armstrong Ph.D., Vice President of Global External Research and Development at
Lilly Research Laboratories (2006present).
Lee Babiss Ph.D., Executive Vice President, Global Laboratory Services at Pharmaceutical
Product Development (2010present), former Global Head of Pharmaceutical Research at
Hoffman-LaRoche (20072009).
Joshua Boger Ph.D., founder and former President and CEO of Vertex Pharmaceuticals
(19922009).
Andreas Busch Ph.D., Head of Global Drug Discovery at Bayer Schering Pharma (2007present).
Peter Corr Ph.D., former Senior Vice President of Science and Technology at Pfizer (20022006).
Frank Douglas Ph.D., M.D., former Executive Vice President at Aventis (19952004).
Mark Fishman M.D., President of Novartis Institutes of Biomedical Research (2002present).
Tom Glenn Ph.D., former Vice President of Pharmaceutical Sciences at Genentech (19881990).
Corey Goodman Ph.D., former Head of Biotherapeutics and Bioinnovation Center at Pfizer
(20072009).
Bernd Kirschbaum Ph.D., Executive Vice President of Global Research and Development at
Merck Serono (2008present).
Jeff Leiden Ph.D., former President and Chief Operating Officer, Pharmaceutical Products
Group at Abbott (20012006).
George Milne Ph.D., former Executive Vice President of Global Research and Development at
Pfizer (20002002).
Phil Needleman Ph.D., former Senior Executive Vice President and Chief Scientist at Pharmacia
(20002003).
Garry Neil M.D., Corporate Vice President, Corporate Office of Science and Technology at
Johnson & Johnson (2007present).
John Patterson Ph.D., former Executive Director of Development at AstraZeneca (20052009).
Steven Paul M.D., former Executive Vice President of Science and Technology and President of
Lilly Research Laboratories at Eli Lilly (20032010).
Joerg Reinhardt Ph.D., Chief Operating Officer at Novartis (20002009).
Peter Ringrose Ph.D., former President of the Bristol-Myers Squibb Pharmaceutical Research
Institute at Bristol-Myers Squibb (19972003).
David Rosen D.V.M., Executive Director and Head of Out Licensing, Worldwide Business
Development at Pfizer (20072009).
Leon Rosenberg M.D., Professor in the Department of Molecular Biology at Princeton University,
New Jersey, USA (1997present), former Senior Vice President of Scientific Affairs at
Bristol-Myers Squibb (19911997).
Robert Ruffolo Ph.D., former President of Research and Development at Wyeth (20022008).
Vicki Sato Ph.D., Professor of Management Practice and Professor of the Practice in the
Department of Molecular and Cell Biology at Harvard University, Boston, Massachusetts, USA
(2005present), former President of Vertex Pharmaceuticals (20002005).
Ben Shapiro M.D., former Executive Vice President, Worldwide Licensing and External Research
at Merck (19962003).
Alan Smith Ph.D., Senior Vice President of Research and Chief Scientific Officer at Genzyme
(1996present).
Gus Watanabe M.D. (now deceased), former Executive Vice President of Science and Technology
at Eli Lilly (19942003).
Tachi Yamada M.D., President, Global Health Program at the Bill and Melinda Gates Foundation
(2006present), former Chairman of R&D, GlaxoSmithKline (20012006).
PersPecti ves
684 | SEPTEMBER 2010 | VOlUME 9 www.nature.com/reviews/drugdisc
nrd_persp_sep10.indd 684 18/8/10 14:06:26
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 75
Theme 2: smaller is better
I think the key is creating something which
is close to a biotech company within big
pharma. Garry Neil, Corporate Vice President,
Corporate Office of Science and Technology
(COSAT), Group President, Johnson & Johnson
pharmaceutical R&D
Several heads of research departments
expressed the view that small is better.
Frank Douglas and Tachi Yamada each tried
to reduce size and complexity in their com
panies. In 1998, Douglas introduced the drug
innovation and approval (DI&A) organiza
tion at Hoechst Marion Roussel (now part
of SanofiAventis) in which each of the three
discovery sites (one each in New Jersey, USA,
Frankfurt, Germany, and Paris, France) was
responsible for no more than two to three
therapeutic areas through to Phase IIa, and
a global development centre coordinated the
latestage development and regulatory sub
mission activities. A product development
committee determined which compounds
would be further developed beyond Phase IIa
by the global development centre.
Yamada introduced the Centres of
Excellence for Drug Discovery (CEDDs)
at GlaxoSmithKline. Each CEDD was
responsible for one or two therapeutic areas
through to Phase IIa trials. There was more
autonomy in the CEDD, as compared to
the DI&A, in that the only item that was
centrally controlled was headcount. Recently,
GlaxoSmithKline evolved the CEDDs into
smaller subgroups, as they thought the
CEDDs had become too bureaucratic.
There seems to be an inverse correlation
between the size of an organization and its
potential to develop trust among its constitu
ents and facilitate the rapid exchange of data
for the generation and testing of hypotheses.
Joshua Boger and Vicki Sato described the
focus of Vertex Pharmaceuticals as building
a culture in which people are rewarded for
making quality data rapidly available and
ready for integration. I think they [large
pharmaceutical companies] have difficulty
sharing information quickly holding onto
information can be a form of power it is
part of a behaviour pattern that contributes
to things taking longer, costing more and
creating redundancy, said Sato.
Confidence in the quality of data pre
sented allowed departments to circumvent
the wasteful practice of rechecking data
because of a lack of trust in the expertise or
in the care of those who initially generated
the data. The accessibility of senior managers
and their involvement in project status
discussions is essential in reinforcing these
principles of rapid exchange of quality data
and testing of hypotheses, all of which are
hampered as organizations increase in size.
Boger and Sato also noted that as Vertex
increased in size, much more time was
required to build these cultural aspects. Sato
added: I went to every project team meeting
and before I joined Vertex, Josh went to
every team meeting. It allowed us as senior
executives to lead by example and build the
culture. You can do that when you are small.
However, with 200 to 250 researchers
per therapeutic area, the DI&A and CEDD
groups were still too large in the view of
Goodman, who feels that the optimum size
of a discovery group is one in which all
members could assemble in a modestsized
room and conduct a discussion without
recourse to a microphone. Corr, who led
groups at Searle, ParkeDavis and Pfizer,
thinks that the optimal number is closer to 20
to 40 individuals operating as an autonomous
group. Corr discovered that very small teams
at ParkeDavis allowed for the rapid sharing
of information and resource allocation,
as well as the efficient termination of projects
that would eventually fail. Yamada similarly
talked about small groups being agile and
interconnected to the other person.
A recent experiment at Pfizer, known
as the Biotherapeutics and Bioinnovation
Center, which was led by Goodman and
has since been dissolved, was focused on
managing four to five independent small
biotechnology companies in a network.
In this arrangement, best practices could
be shared and resources leveraged, but each
unit remained autonomous and was to
some extent free to advance its own culture.
The head of each small company was there
fore endowed with a sense of ownership and
could more or less operate as an entrepreneur.
According to Goodman, Pfizer wanted to see
whether such skunkworks strategies, similar
to those used in the information technology
and electrical engineering fields, could be
harnessed to change the way compounds
were typically developed. Neil also supports
this view of the potential of small companies
to produce changes within their respective
larger corporate structures. He characterizes
the culture at Johnson & Johnson as
a hybrid between biotech and large pharma
and attributes its success to the strategy of
maintaining the cultures of newly acquired
companies and adopting their best practices.
Contributing to the apparent consensus on
behalf of the entrepreneurial potential inher
ent in smaller teams, Fishman offered his
perspective on the importance of individuals
in innovation: To me, innovation is generally
an individual effort. There is a person who
sees something different, sees something
new, has a clarity of vision, and the courage
to pursue it. That individual expands to work
in an entrepreneurial team to bring the inno
vation to fruition. Alan Smith expressed a
similar view, noting that in his opinion it is
indeed the curiosity of the individual scien
tist that is most often the driver for discovery
efforts. Robert Armstrong, in commenting
on CHORUS a unit of 32 lilly employees
who comprise an autonomous entity he heads
that conducts lean development from the
candidate selection stage to the proofof
concept of selected lilly compounds said:
not all of them need to be serial entrepre
neurs, but there are individuals who perceive
radically different ways to develop new
molecules and want to enable these concepts
(see also the section on middle managers).
Although many of those interviewed
spoke on behalf of smaller and more entre
preneurial discovery units, Burt Adelman
pointed out that such scale does not in itself
necessarily engender the sense of urgency
crucial to successful product innovation.
He argued that entrepreneurial behaviour
diminished even in biotechnology
companies when the focus was primarily
on publications rather than on products.
In this context, he poses the difficult question
of why scientists who have not been associ
ated even with a failed drug after 6 or 7 years
should still be employed by that company.
George Milne conceded the previously
cited benefits associated with small size, but
also presented an argument on behalf of larger
corporate structures in which smaller units
benefit from the experiences and tacit aggre
gate knowledge of the larger organization.
Milne considers that the biopharmaceutical
industry must learn to scale small entrepre
neurial units without introducing excessive
bureaucracy. Such units thus become empow
ered to unleash random and purposeful
action. Milne also noted that one of the scale
based advantages that a large, entrepreneurial
organization has over a small one is that you
actually get to learn from experiences.
A comment from Jeff leiden provides an
eloquent if blunt summary to a consideration
of the benefits associated with the deploy
ment of smaller teams and the instinctive,
curiositydriven culture they foster: So, it
became clear to me that the way to organize
R&D, and frankly I think the whole busi
ness, is in much smaller entrepreneurial
units where people feel both responsible and
accountable for producing or their unit wont
be renewed. They know that their careers
depend directly on their productivity.
PersPecti ves
NATURE REVIEWS | Drug Discovery VOlUME 9 | SEPTEMBER 2010 | 685
nrd_persp_sep10.indd 685 18/8/10 14:06:26
more recently, for the number in the later
phases of clinical development in particular.
Similarly, research organizations in large
pharmaceutical companies were rewarded
for the number of NMEs produced as
clinical candidates each year. As Corey
Goodman commented, scientists are getting
their bonuses based on trying to make the
numbers. However, with the exception of
a sharp increase between 1996 and 1998,
the number of NMEs approved annually
by the US Food and Drug Administration
(FDA) has not changed over the past five
decades, even though the costs of achieving
approval have increased manyfold during
this period
7
.
Interestingly, an assessment of the value
of small biotechnology companies was driven
by the innovation and science in the one or
two products moving through their pipe
lines. As an example, Tom Glenn recounted
the birth of DNase at Genentech, which was
developed during a biweekly staff meeting
in which research ideas were discussed:
He [Steve Shak, M.D.] brought in two test
tubes. In one test tube, he had this gunky
sputum. In the other test tube, he had this
clear liquid. Ill never forget this. There were
six of us sitting there watching. He mixed
the contents of the two test tubes together,
and they cleared. He said, Gentlemen,
thats DNase. Unbelievable. On the spot we
decided to move forward and finish our
discovery and development program in
DNase, which is now a product marketed
by Genentech.
The insidious consequence of the
focus on quantity in large pharmaceutical
companies has been an emphasis on the
commercially driven evaluation of a portfolio
of compounds, instead of the scientific
merits of each compound. Mark Fishman
similarly expressed scepticism regarding
the deep involvement of commercial
departments before the availability of
clinical data from Phase II trials, when
he stated: Often, they would ask if you
are aligned with the business franchises.
I dont want to be because they are
looking at today, and I want to be there
five to ten years from now. So, if we are
aligned with the current business
franchise, we are dead in the water.
Despite such scepticism, however,
there are those scientists, such as Andreas
Busch, who although not ignoring
compound quality, remain practitioners
of the compound progression approach,
illustrating that innovation can coincide
with less entrepreneurialfocused
approaches. Peter Corr supports Buschs
view, especially when there are more shots
on goal. However, Goodman thinks
that in many of these companies, too many
drugs are being advanced into the clinic.
And Needleman was of the opinion that
success isnt necessarily how many shots
on goal, but on betting on the high
probability. Its fewer shots on goal.
Box 1 | Interviewees
Our research involved open-ended interviews with former and present leaders of research
and development (R&D) departments in large pharmaceutical companies and biotechnology
companies. The sample of interviewees included the following individuals:
Burt Adelman M.D., President of Research and Development at Eleven Biotherapeutics
(2009present), former Executive Vice President of Portfolio Strategy at Biogen Idec
(20032006).
Robert Armstrong Ph.D., Vice President of Global External Research and Development at
Lilly Research Laboratories (2006present).
Lee Babiss Ph.D., Executive Vice President, Global Laboratory Services at Pharmaceutical
Product Development (2010present), former Global Head of Pharmaceutical Research at
Hoffman-LaRoche (20072009).
Joshua Boger Ph.D., founder and former President and CEO of Vertex Pharmaceuticals
(19922009).
Andreas Busch Ph.D., Head of Global Drug Discovery at Bayer Schering Pharma (2007present).
Peter Corr Ph.D., former Senior Vice President of Science and Technology at Pfizer (20022006).
Frank Douglas Ph.D., M.D., former Executive Vice President at Aventis (19952004).
Mark Fishman M.D., President of Novartis Institutes of Biomedical Research (2002present).
Tom Glenn Ph.D., former Vice President of Pharmaceutical Sciences at Genentech (19881990).
Corey Goodman Ph.D., former Head of Biotherapeutics and Bioinnovation Center at Pfizer
(20072009).
Bernd Kirschbaum Ph.D., Executive Vice President of Global Research and Development at
Merck Serono (2008present).
Jeff Leiden Ph.D., former President and Chief Operating Officer, Pharmaceutical Products
Group at Abbott (20012006).
George Milne Ph.D., former Executive Vice President of Global Research and Development at
Pfizer (20002002).
Phil Needleman Ph.D., former Senior Executive Vice President and Chief Scientist at Pharmacia
(20002003).
Garry Neil M.D., Corporate Vice President, Corporate Office of Science and Technology at
Johnson & Johnson (2007present).
John Patterson Ph.D., former Executive Director of Development at AstraZeneca (20052009).
Steven Paul M.D., former Executive Vice President of Science and Technology and President of
Lilly Research Laboratories at Eli Lilly (20032010).
Joerg Reinhardt Ph.D., Chief Operating Officer at Novartis (20002009).
Peter Ringrose Ph.D., former President of the Bristol-Myers Squibb Pharmaceutical Research
Institute at Bristol-Myers Squibb (19972003).
David Rosen D.V.M., Executive Director and Head of Out Licensing, Worldwide Business
Development at Pfizer (20072009).
Leon Rosenberg M.D., Professor in the Department of Molecular Biology at Princeton University,
New Jersey, USA (1997present), former Senior Vice President of Scientific Affairs at
Bristol-Myers Squibb (19911997).
Robert Ruffolo Ph.D., former President of Research and Development at Wyeth (20022008).
Vicki Sato Ph.D., Professor of Management Practice and Professor of the Practice in the
Department of Molecular and Cell Biology at Harvard University, Boston, Massachusetts, USA
(2005present), former President of Vertex Pharmaceuticals (20002005).
Ben Shapiro M.D., former Executive Vice President, Worldwide Licensing and External Research
at Merck (19962003).
Alan Smith Ph.D., Senior Vice President of Research and Chief Scientific Officer at Genzyme
(1996present).
Gus Watanabe M.D. (now deceased), former Executive Vice President of Science and Technology
at Eli Lilly (19942003).
Tachi Yamada M.D., President, Global Health Program at the Bill and Melinda Gates Foundation
(2006present), former Chairman of R&D, GlaxoSmithKline (20012006).
PersPecti ves
684 | SEPTEMBER 2010 | VOlUME 9 www.nature.com/reviews/drugdisc
nrd_persp_sep10.indd 684 18/8/10 14:06:26
76 | OCTOBER 2011 | THE FUTURE OF DRUG INNOVATION | NATURE REPRINT COLLECTION www.nature.com/reprintcollections/lilly/drug-innovation
also introduced the proofofconcept unit
CHORUS (see above), and in an extension of
this concept, lilly launched a joint venture
with Jubilant Organosys in Bangalore, India,
to develop molecules between preclinical
and Phase II testing in May 2009. Through
this collaboration, lilly also benefits from
the potential opportunity to have access to
successful proofofconcept compounds
from sources other than their own research
laboratories. Armstrong said that lilly has
expanded this concept to several companies
in India and China, who work on selected
compounds that lilly has the right to buy
back when predetermined milestones
are achieved. These activities dismantle
vestiges of the not invented here
syndrome that can mean certain death to
entrepreneurial behaviour, he noted.
Paul of Eli lilly summarizes this more
broadly: So, one element of the trans
formation from a corporate perspective
structurally is to go from this FIPCO (Fully
Integrated Pharmaceutical Company)
structure to a FIPNET, Fully Integrated
Pharmaceutical Network. Weve defined
three levels of this FIPNET. level one is
more traditional outsourcing. level two
leverages partnerships with universities and
small as well as larger companies. These
valuesharing partnerships provide both risk
sharing and cost sharing. Finally, a level
three FIPNET or partial ownership model
allows small companies to pursue projects
within the context of their unique cultures.
Our interviews also suggest that discovery
stage collaborations are perceived to be
effective when the collaborators share a
common sense of curiosity and focus on
science. The importance of curiosity as a
driver for the selection of technology, bio
logical mechanisms and collaborations was
stressed as a key component of the culture at
Genzyme by Smith, who added that curiosity
refers to a desire to learn and benefit from
knowledge that others in that university in
India or in France might deem interesting.
We determined that among the tasks
that need to be performed at the middle
management level are the maintenance of
organizational knowledge, the nurturing
of mavericks and true believers, and the
provision of support for the drug discovery
teams. Essential to these roles is the need
to remain close to science.
One of the distinguishing characteristics
of the biotechnology researchers we inter
viewed was their closeness to science and
their desire to retain this proximity. In large
pharmaceutical companies, however, exces
sive concern with milestones often detracts
from the ability of research teams to remain
close to science. Yet to the extent that the
rewards system associated with middle
management is based on the attainment
of milestones and not on the nurturing of
science, bureaucracy imposes barriers that
are detrimental to drug innovation. Indeed,
evolving a more sophisticated and nuanced
reward system for middle management may
be among the most important organizational
priorities for large pharmaceutical compa
nies to stimulate productivity in the crucial
discovery stage.
Theme 5: CEOHead of R&D interaction
You have to really be able to communicate
with your CEO if youre going to do your
job optimally in R&D. Gus Watanabe,
former Executive Vice President of Science
and Technology, Eli lilly
Several of the interviewees, including leon
Rosenberg, Watanabe, Goodman, Milne and
Glenn, stressed the importance of a close
alignment between the CEO and the head of
R&D in building and maintaining an optimal
culture in discovery. Boger described building
an innovative and productive organization as
more of a social experiment than a technical
one. He and Sato described in nearly identical
terms their tireless and consistent efforts to
build, nurture and maintain elements such
as interdisciplinary teamwork, rapid access
to information and a sense of ownership
in their organization. Rosenberg described
the weekly meetings that he used to have
with the CEO: He wasnt a scientist, but he
appreciated science, and he liked scientists.
He and I would converse regularly after
he would read his weekly copy of The New
England Journal of Medicine. This was a great
joy of mine because it kept me very close to
him. It allowed me to put science high in
the order of his thoughts. Smith described
similar efforts and alignment with Genzyme
CEO Henri Termeer in maintaining their
organizational culture. Busch and Bernd
Kirschbaum gave examples of the consider
able challenges and efforts needed to build a
common culture in a newly merged organi
zation and its impact on innovation, and
the important role that alignment with their
CEOs had in their efforts to build the desired
culture in discovery. Douglas also com
mented on the importance of the close align
ment between him and Richard Markham
when they took on the task of building
Hoechst Marion Roussel, the result of merg
ing Hoechst Pharmaceutical, Marion Merrell
Dow and Roussel Uclaf, in their respective
roles as Head of R&D and CEO.
Theme 6: technology and R&D models
My major responsibilities as given to me by
the CEO when I joined BMS were to forge a
single R&D organization out of two groups
with differing strengths in Discovery and
Development. leon Rosenberg, Professor at
Princeton University and former Senior Vice
President of Scientific Affairs, BristolMyers
Squibb
The interviews revealed the unexpected
finding that although each R&D leader
recognized that changing science and tech
nology influenced how they organized their
research units, most had not reflected on the
impact that organizational changes might
have on entrepreneurial behaviour. The
interviewees identified four types of organi
zational structures or models that defined
the point at which commitment was made
to the fullscale clinical development of a
compound (FIG. 1).
First, they described a traditional R&D
organization, in which the transition from
research to development occurred with
the filing of an investigational new drug
application. This is termed the preclinical
proofofconcept (pPoC) model. The second
structure mentioned the human proofof
concept (hPoC) model was similar to this,
with the addition of clinical pharmacology
to improve dose selection and the search for
efficacy in humans.
The third structure, known as the
clinical proofofconcept (cPoC) model,
includes Phase I and Phase IIa trials in
research. It uses biomarkers and pharmaco
kinetic studies to select the best compound
to determine efficacy in the target patients,
with efficacy in Phase IIa trials being the
crucial decision point for full development
(FIG. 1).
Watanabe, deceased since the interviews,
introduced this concept by having M.D.s or
M.D./Ph.D.s responsible for each discovery
therapeutic unit from the concept stage to
Phase IIa trials at Eli lilly. Glenn introduced
the clinical biology unit concept in research at
Ciba Geigy in 1984 with the goal of carrying
out specific studies in patients to achieve
proof of concept. Several other companies
have adopted this model in various forms.
These include the research and early devel
opment (RED) units at Johnson & Johnson,
the research units at MerckSerono, global
drug discovery at Bayer Schering Pharma
and disease biology areas at Roche (it
should be noted that Roches new focus on
personalized healthcare by interweaving
their diagnostic and pharmaceutical divi
sions has moved them to the fourth model;
PersPecti ves
NATURE REVIEWS | Drug Discovery VOlUME 9 | SEPTEMBER 2010 | 687
nrd_persp_sep10.indd 687 18/8/10 14:06:26
Theme 3: reward systems matter
I am firmly a believer that you get what
you reward. Josh Boger, former CEO,
Vertex Pharmaceuticals
In most industries, as companies grow, there
is pressure for each to offer uniform com
pensation, rewards and benefits. Fishman
and Goodman, as well as Peter Ringrose,
each referred to the tendency for all depart
ments to compensate in a similar fashion as
a homogenizing effect. What is curious is
that although large companies recognize the
need to implement special bonus systems
to incentivize sale representatives to act
entrepreneurially, the opposite occurs in
R&D. The lack of incentives has persisted
owing to organizational inertia, but thought
ful R&D leaders have begun to address this
issue by instituting different evaluation and
reward systems.
For example, Yamada observed that Sir
James Black, who had the key role in the
development of blockers and histamine
blockers, never received a major bonus
for his discoveries. As a consequence of
this awareness, Yamada established a new
reward system at GlaxoSmithKline: I set
up a program where once we had a proof
ofconcept molecule, wed form a team of
the top scientists in the company. It was
like a Nobel committee. Theyd go back
and research how was it we got here. If they
could identify one or two or three people
that were really the fundamental reason
for the success of that molecule, then those
people got an extraordinary deal. However,
although Armstrong admits that they should
find a way to reward the members of the
CHORUS that might be different from the
rest of R&D at Eli lilly, he remarked: In this
experiment, this group, first and foremost,
is hugely motivated, very energetic in large
part because theyre uniquely empowered to
actually carry on a tremendous amount of
work in the organization.
Theme 4: underutilized middle managers
I used to give a lecture, and still do, which is
entitled The power of the light you shine.
George Milne, former Executive Vice President
of Global Research and Development, Pfizer
The role of middle managers defined as
those individuals in large pharmaceutical
companies who are not at the executive level,
but who lead large groups or departments
and have considerable responsibilities for
the successful conduct of projects and
programmes emerged as an important
concern in the productivity of discovery
units, even more so than in the case of
development. Milne observed that scientists
become middle managers as a reward for
their outstanding scientific contributions
and often for their entrepreneurial behav
iour. However, after they attain the status
of middle managers, they are rewarded for
productivity as measured by the number
of compounds at the required phase, by
achieving timelines and by performing
activities that engender need for control
and predictability, none of which might
be the appropriate measures for discovery.
Consequently, middle managers can become
frustrated with this change in strategies.
Milne motivated middle managers through
his Hawthorneeffectstyle lecture, reminding
them that although they may not feel that
important, the scientists working under
them feel they are really important and, as
a result, could tell them where their light
shines and where it doesnt.
As we probed the desired qualities that
would facilitate the selection of middle
managers most likely to foster entrepre
neurial behaviour, Yamada, Ringrose,
Sato and Douglas identified two discovery
types, which we term mavericks and true
believers. Mavericks are those scientists
who, although they may share the goals of
the organization, seem to achieve superior
results by thinking and working outside
the prescribed or routine organizational
conventions. True believers not only are
convinced of the scientific approach of their
given project, but can also communicate and
recruit organizational support and resources
for the project a particularly important
quality, according to Sato.
Steven Paul, Armstrong, Boger and
Fishman stressed the importance of middle
managers retaining their scientific/technical
edge if the company is to benefit from
collaborations. Paul and Armstrong also
described a series of approaches used at
Eli lilly to engage middle managers in
entrepreneurial activities. They focused
on the sourcing of innovation as a means
of getting their middle and senior managers
to take ownership for finding the best
solutions, regardless of where they were
identified. Thus, lilly was an early adopter
of the practice of leveraging knowledge
from outside the company for solutions to
internal problems. This successful approach
was later spun out as Innocentive. lilly
Box 2 | Study methods
Before our interviews, we sent each interviewee our lists of behaviours that described both
individual and organizational entrepreneurship and the following questions to serve as a basis
for the interview:
general questions
Did entrepreneurial and big firm characteristics fuel the growth of large biopharmaceutical
companies (big pharma)?
Was or is there entrepreneurial behaviour in big pharma?
Were there lessons that can inform new organizational paradigms to increase productivity?
interview questions
How would you describe your R&D organization when you assumed leadership?
What were its strengths and weaknesses?
What were some of the organizational changes you introduced?
What did you hope to achieve?
How did you balance individual recognition versus team recognition?
What specific outcomes can you cite that were affected by the changes you introduced?
What are the differences between todays challenges and those that existed when you
were head of R&D?
What would you do today to address those challenges?
Did you create any special teams, spin-outs or collaborations to achieve your objectives?
How did you access R&D knowledge from outside your firm? How has this changed in
recent times?
How did you balance your portfolio with respect to investing in long-term projects versus
short-term projects?
The interviews were carried out by teleconference by F. L. Douglas and V. K. Narayanan and
were taped with the permission of the participants. This process allowed us to focus on the
interview and use the transcripts afterwards to improve our understanding of an issue or later
send questions for clarification to the interviewees.
PersPecti ves
686 | SEPTEMBER 2010 | VOlUME 9 www.nature.com/reviews/drugdisc
nrd_persp_sep10.indd 686 18/8/10 14:06:26
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 77
also introduced the proofofconcept unit
CHORUS (see above), and in an extension of
this concept, lilly launched a joint venture
with Jubilant Organosys in Bangalore, India,
to develop molecules between preclinical
and Phase II testing in May 2009. Through
this collaboration, lilly also benefits from
the potential opportunity to have access to
successful proofofconcept compounds
from sources other than their own research
laboratories. Armstrong said that lilly has
expanded this concept to several companies
in India and China, who work on selected
compounds that lilly has the right to buy
back when predetermined milestones
are achieved. These activities dismantle
vestiges of the not invented here
syndrome that can mean certain death to
entrepreneurial behaviour, he noted.
Paul of Eli lilly summarizes this more
broadly: So, one element of the trans
formation from a corporate perspective
structurally is to go from this FIPCO (Fully
Integrated Pharmaceutical Company)
structure to a FIPNET, Fully Integrated
Pharmaceutical Network. Weve defined
three levels of this FIPNET. level one is
more traditional outsourcing. level two
leverages partnerships with universities and
small as well as larger companies. These
valuesharing partnerships provide both risk
sharing and cost sharing. Finally, a level
three FIPNET or partial ownership model
allows small companies to pursue projects
within the context of their unique cultures.
Our interviews also suggest that discovery
stage collaborations are perceived to be
effective when the collaborators share a
common sense of curiosity and focus on
science. The importance of curiosity as a
driver for the selection of technology, bio
logical mechanisms and collaborations was
stressed as a key component of the culture at
Genzyme by Smith, who added that curiosity
refers to a desire to learn and benefit from
knowledge that others in that university in
India or in France might deem interesting.
We determined that among the tasks
that need to be performed at the middle
management level are the maintenance of
organizational knowledge, the nurturing
of mavericks and true believers, and the
provision of support for the drug discovery
teams. Essential to these roles is the need
to remain close to science.
One of the distinguishing characteristics
of the biotechnology researchers we inter
viewed was their closeness to science and
their desire to retain this proximity. In large
pharmaceutical companies, however, exces
sive concern with milestones often detracts
from the ability of research teams to remain
close to science. Yet to the extent that the
rewards system associated with middle
management is based on the attainment
of milestones and not on the nurturing of
science, bureaucracy imposes barriers that
are detrimental to drug innovation. Indeed,
evolving a more sophisticated and nuanced
reward system for middle management may
be among the most important organizational
priorities for large pharmaceutical compa
nies to stimulate productivity in the crucial
discovery stage.
Theme 5: CEOHead of R&D interaction
You have to really be able to communicate
with your CEO if youre going to do your
job optimally in R&D. Gus Watanabe,
former Executive Vice President of Science
and Technology, Eli lilly
Several of the interviewees, including leon
Rosenberg, Watanabe, Goodman, Milne and
Glenn, stressed the importance of a close
alignment between the CEO and the head of
R&D in building and maintaining an optimal
culture in discovery. Boger described building
an innovative and productive organization as
more of a social experiment than a technical
one. He and Sato described in nearly identical
terms their tireless and consistent efforts to
build, nurture and maintain elements such
as interdisciplinary teamwork, rapid access
to information and a sense of ownership
in their organization. Rosenberg described
the weekly meetings that he used to have
with the CEO: He wasnt a scientist, but he
appreciated science, and he liked scientists.
He and I would converse regularly after
he would read his weekly copy of The New
England Journal of Medicine. This was a great
joy of mine because it kept me very close to
him. It allowed me to put science high in
the order of his thoughts. Smith described
similar efforts and alignment with Genzyme
CEO Henri Termeer in maintaining their
organizational culture. Busch and Bernd
Kirschbaum gave examples of the consider
able challenges and efforts needed to build a
common culture in a newly merged organi
zation and its impact on innovation, and
the important role that alignment with their
CEOs had in their efforts to build the desired
culture in discovery. Douglas also com
mented on the importance of the close align
ment between him and Richard Markham
when they took on the task of building
Hoechst Marion Roussel, the result of merg
ing Hoechst Pharmaceutical, Marion Merrell
Dow and Roussel Uclaf, in their respective
roles as Head of R&D and CEO.
Theme 6: technology and R&D models
My major responsibilities as given to me by
the CEO when I joined BMS were to forge a
single R&D organization out of two groups
with differing strengths in Discovery and
Development. leon Rosenberg, Professor at
Princeton University and former Senior Vice
President of Scientific Affairs, BristolMyers
Squibb
The interviews revealed the unexpected
finding that although each R&D leader
recognized that changing science and tech
nology influenced how they organized their
research units, most had not reflected on the
impact that organizational changes might
have on entrepreneurial behaviour. The
interviewees identified four types of organi
zational structures or models that defined
the point at which commitment was made
to the fullscale clinical development of a
compound (FIG. 1).
First, they described a traditional R&D
organization, in which the transition from
research to development occurred with
the filing of an investigational new drug
application. This is termed the preclinical
proofofconcept (pPoC) model. The second
structure mentioned the human proofof
concept (hPoC) model was similar to this,
with the addition of clinical pharmacology
to improve dose selection and the search for
efficacy in humans.
The third structure, known as the
clinical proofofconcept (cPoC) model,
includes Phase I and Phase IIa trials in
research. It uses biomarkers and pharmaco
kinetic studies to select the best compound
to determine efficacy in the target patients,
with efficacy in Phase IIa trials being the
crucial decision point for full development
(FIG. 1).
Watanabe, deceased since the interviews,
introduced this concept by having M.D.s or
M.D./Ph.D.s responsible for each discovery
therapeutic unit from the concept stage to
Phase IIa trials at Eli lilly. Glenn introduced
the clinical biology unit concept in research at
Ciba Geigy in 1984 with the goal of carrying
out specific studies in patients to achieve
proof of concept. Several other companies
have adopted this model in various forms.
These include the research and early devel
opment (RED) units at Johnson & Johnson,
the research units at MerckSerono, global
drug discovery at Bayer Schering Pharma
and disease biology areas at Roche (it
should be noted that Roches new focus on
personalized healthcare by interweaving
their diagnostic and pharmaceutical divi
sions has moved them to the fourth model;
PersPecti ves
NATURE REVIEWS | Drug Discovery VOlUME 9 | SEPTEMBER 2010 | 687
nrd_persp_sep10.indd 687 18/8/10 14:06:26
Theme 3: reward systems matter
I am firmly a believer that you get what
you reward. Josh Boger, former CEO,
Vertex Pharmaceuticals
In most industries, as companies grow, there
is pressure for each to offer uniform com
pensation, rewards and benefits. Fishman
and Goodman, as well as Peter Ringrose,
each referred to the tendency for all depart
ments to compensate in a similar fashion as
a homogenizing effect. What is curious is
that although large companies recognize the
need to implement special bonus systems
to incentivize sale representatives to act
entrepreneurially, the opposite occurs in
R&D. The lack of incentives has persisted
owing to organizational inertia, but thought
ful R&D leaders have begun to address this
issue by instituting different evaluation and
reward systems.
For example, Yamada observed that Sir
James Black, who had the key role in the
development of blockers and histamine
blockers, never received a major bonus
for his discoveries. As a consequence of
this awareness, Yamada established a new
reward system at GlaxoSmithKline: I set
up a program where once we had a proof
ofconcept molecule, wed form a team of
the top scientists in the company. It was
like a Nobel committee. Theyd go back
and research how was it we got here. If they
could identify one or two or three people
that were really the fundamental reason
for the success of that molecule, then those
people got an extraordinary deal. However,
although Armstrong admits that they should
find a way to reward the members of the
CHORUS that might be different from the
rest of R&D at Eli lilly, he remarked: In this
experiment, this group, first and foremost,
is hugely motivated, very energetic in large
part because theyre uniquely empowered to
actually carry on a tremendous amount of
work in the organization.
Theme 4: underutilized middle managers
I used to give a lecture, and still do, which is
entitled The power of the light you shine.
George Milne, former Executive Vice President
of Global Research and Development, Pfizer
The role of middle managers defined as
those individuals in large pharmaceutical
companies who are not at the executive level,
but who lead large groups or departments
and have considerable responsibilities for
the successful conduct of projects and
programmes emerged as an important
concern in the productivity of discovery
units, even more so than in the case of
development. Milne observed that scientists
become middle managers as a reward for
their outstanding scientific contributions
and often for their entrepreneurial behav
iour. However, after they attain the status
of middle managers, they are rewarded for
productivity as measured by the number
of compounds at the required phase, by
achieving timelines and by performing
activities that engender need for control
and predictability, none of which might
be the appropriate measures for discovery.
Consequently, middle managers can become
frustrated with this change in strategies.
Milne motivated middle managers through
his Hawthorneeffectstyle lecture, reminding
them that although they may not feel that
important, the scientists working under
them feel they are really important and, as
a result, could tell them where their light
shines and where it doesnt.
As we probed the desired qualities that
would facilitate the selection of middle
managers most likely to foster entrepre
neurial behaviour, Yamada, Ringrose,
Sato and Douglas identified two discovery
types, which we term mavericks and true
believers. Mavericks are those scientists
who, although they may share the goals of
the organization, seem to achieve superior
results by thinking and working outside
the prescribed or routine organizational
conventions. True believers not only are
convinced of the scientific approach of their
given project, but can also communicate and
recruit organizational support and resources
for the project a particularly important
quality, according to Sato.
Steven Paul, Armstrong, Boger and
Fishman stressed the importance of middle
managers retaining their scientific/technical
edge if the company is to benefit from
collaborations. Paul and Armstrong also
described a series of approaches used at
Eli lilly to engage middle managers in
entrepreneurial activities. They focused
on the sourcing of innovation as a means
of getting their middle and senior managers
to take ownership for finding the best
solutions, regardless of where they were
identified. Thus, lilly was an early adopter
of the practice of leveraging knowledge
from outside the company for solutions to
internal problems. This successful approach
was later spun out as Innocentive. lilly
Box 2 | Study methods
Before our interviews, we sent each interviewee our lists of behaviours that described both
individual and organizational entrepreneurship and the following questions to serve as a basis
for the interview:
general questions
Did entrepreneurial and big firm characteristics fuel the growth of large biopharmaceutical
companies (big pharma)?
Was or is there entrepreneurial behaviour in big pharma?
Were there lessons that can inform new organizational paradigms to increase productivity?
interview questions
How would you describe your R&D organization when you assumed leadership?
What were its strengths and weaknesses?
What were some of the organizational changes you introduced?
What did you hope to achieve?
How did you balance individual recognition versus team recognition?
What specific outcomes can you cite that were affected by the changes you introduced?
What are the differences between todays challenges and those that existed when you
were head of R&D?
What would you do today to address those challenges?
Did you create any special teams, spin-outs or collaborations to achieve your objectives?
How did you access R&D knowledge from outside your firm? How has this changed in
recent times?
How did you balance your portfolio with respect to investing in long-term projects versus
short-term projects?
The interviews were carried out by teleconference by F. L. Douglas and V. K. Narayanan and
were taped with the permission of the participants. This process allowed us to focus on the
interview and use the transcripts afterwards to improve our understanding of an issue or later
send questions for clarification to the interviewees.
PersPecti ves
686 | SEPTEMBER 2010 | VOlUME 9 www.nature.com/reviews/drugdisc
nrd_persp_sep10.indd 686 18/8/10 14:06:26
78 | OCTOBER 2011 | THE FUTURE OF DRUG INNOVATION | NATURE REPRINT COLLECTION www.nature.com/reprintcollections/lilly/drug-innovation
and integration of information generated
by all the relevant disciplines, regardless
of where it is found, must be assisted and
rewarded. We recommend that companies
seek to move towards the sPoC model
(FIG. 1), which extends research to Phase IIa
and also incorporates feedback from
postmarketing surveillance studies to
fuel the continued search for new targets,
bio markers and an understanding of
offtarget effects. These activities are
crucial in the search for the right therapy
for the right patient, and will heighten
the sense of urgency to get drugs to
patients.
Middle managers should be given
incentives to access the best ideas and
the best people globally to drive curiosity
and open innovation. Managing external
networks and rapidly internalizing the
results of new scientific and technical
approaches should also be among their
priorities. Rewards for managers should
be based on the speed with which they
achieve the progression of projects,
facilitated by their capacity to foster the
integration of knowledge and to provide
appropriate guidance to true believers
and mavericks. Ultimately, companies
should use middle managers to transform
their culture from something analogous
to a supertanker to a flotilla of diverse,
nimble and innovative ships, consisting
of the following elements: focus on the
patient, scientific curiosity, collaboration,
speed to solution and rewards that are
aligned with goals.
Multidisciplinary research teams should
consist of no more than 2040 members
who focus on the preclinical and clinical
validation of novel targets/mechanisms
with responsibility through to clinical
proofofconcept in Phase IIa trials.
These units of innovation should be
supported by the traditional discovery
research expert groups, such as molecular
biology and chemistry, which focus on
assessing the molecular validation or
relevance of the target and finding lead
molecules that interact with the target.
Both of these groups should include
specialists in postmarketing surveillance
to ensure relevance to the patient.
They should also perform relevant studies
with academic clinicians to generate
information from subsets of patients,
which might inform the research efforts
and ensure a sPoC approach.
Heads of R&D must focus indefatigably
on building and maintaining an
appropriate entrepreneurial culture.
Furthermore, the support of the CEO
for this focus must be visible and active.
Companies should be more innovative
with respect to reward and recognition
for discovery scientists, to foster bias for
action, ownership and an appropriate
sense of urgency.
Companies should examine what we
term the columns outside the doors
phenomenon and the subtle impact that
this form of recognition might have
on entrepreneurial behaviour. Smith
described this phenomenon, which
occurs across the world: as startup
companies become successful, they are
relocated from humble laboratories to
grander buildings with columns outside
their doors. Interestingly, such edifices
often violate the observed inverse
square relationship between com
munication among scientists in labo
ratories and the distance between these
laboratories. We offer this insight more
as a provocative thought than as a firm
recommendation.
We offer one final thought regarding the
transferability of these insights from drug
discovery research to drug development.
In discovery, our data and previous research
suggests that concept realization the
metric relevant for gauging the effectiveness
of discovery improves as the size of the
innovation unit grows to around 20 to 40
researchers, but then declines as the size of the
unit increases and diseconomies of scale take
effect. In development, it is common wisdom
that the optimal efficiency of the process is
obtained when the size of the unit is consider
ably larger than the optimal size of discovery
units. Interestingly, in large pharmaceutical
companies, it has become increasingly
common to outsource many development
related activities, and as this extends, it is
likely that the efficiencysize relationship
may be turned on its head, with pharma
ceutical companies managing development
with relatively smaller units than they have
at present. In that case, the management of
discovery units may hold valuable lessons
for the conduct of development. These
observations might stimulate large
pharmaceutical companies to do that which
Yamada maintains they can: transform
the industry.
Frank L. Douglas, Lesa Mitchell and Robert E. Litan
are at the Ewing Marion Kauffman Foundation,
Kansas City, Missouri, USA.
Frank L. Douglas is also at the Austen BioInnovation
Institute, Akron, Ohio, USA.
V. K. Narayanan is at the Center for Research
Excellence, LeBow College of Business,
Drexel University, Philadelphia, Pennsylvania, USA.
Correspondence to F.L.D.
e-mail: fdouglas@kauffman.org
doi:10.1038/nrd3230
Published online 20 August 2010
1. Goodman, M. Pharma industry performance metrics:
20072012E. Nature Rev. Drug Discov. 7, 795
(2008).
2. Pisano, G. P. Science Business: The Promise, the
Reality, and the Future of Biotech (Harvard Business
School Press, Boston, Massachusetts, USA, 2006).
3. Cuervo, A., Ribeiro, D. & Roig, S (eds)
Entrepreneurship: Concepts, Theory and Perspective
(Springer, Berlin, Germany, 2007).
4. Schramm, C. J. The Entrepreneurial Imperative:
How Americas Economic Miracle Will Reshape the
World (and Change Your Life) (HarperCollins, 2006).
5. Pharmaceutical Research and Manufacturers of
America. PhRMA Annual Membership Survey.
PhRMA website [online], http://www.phrma.org/files/
attachments/PhRMA%202009%20Profile%20
FINAL.pdf (2009).
6. IMS Health. Global Pharmaceutical Sales, 20012008.
IMS Health website [online], http://www.imshealth.
com/deployedfiles/imshealth/Global/Content/
StaticFile/Top_Line_Data/Global_Pharma_
Sales_2001-2008_Version_2.pdf (2009).
7. Munos, B. Lessons from 60 years of pharmaceutical
innovation. Nature Rev. Drug Discov. 8, 959968
(2009).
Acknowledgements
With special thanks to D. Kaiser, M. Tribbitt and T. Flores for
their research and editorial assistance. We would also like to
thank the following colleagues who participated in these inter-
views: B. Adelman, R. Armstrong, L. Babiss, J. Boger, A. Busch,
P. Corr, M. Fishman, T. Glenn, C. Goodman, B. Kirschbaum,
J. Leiden, G. Milne, P. Needleman, G. Neil, J. Patterson,
S. Paul, J. Reinhardt, P. Ringrose, D. Rosen, L. Rosenberg,
R. Ruffolo, V. Sato, B. Shapiro, A. Smith, G. Watanabe and
T. Yamada (see Box 1).
Competing interests statement
The authors declare competing financial interests: see web
version for details.
FuRTHER INFORMATION
Austen Bioinnovation institution homepage:
www.abiakron.org
All links Are Active in the online pDf
PersPecti ves
NATURE REVIEWS | Drug Discovery VOlUME 9 | SEPTEMBER 2010 | 689
nrd_persp_sep10.indd 689 18/8/10 14:06:27
Nature Reviews | Drug Discovery
Discovery
Discovery and
clinical pharmacology
Discovery, Phase I and Phase IIa trials
Discovery, Phase I and Phase IIa trials, and PMS
Preclinical PoC
Human PoC
Clinical PoC
Stratified PoC
Feedback
and patient
stratification
see below). The formation of the Novartis
Institutes for Biomedical Research (NIBR)
has served to institutionalize this practice,
and to implement the fourth model (see
below).
Present interest in the potential of
translational medicine to find the right
drug for the right patient requires the
integration of several activities. These include
the search for biomarkers that not only help
to select compounds preclinically, but also
help to predict, stratify and monitor the
patients and subgroups who will experience
the requisite efficacy of the compound
and an acceptable level of adverse events.
To achieve this, collaboration between
research and postmarketing surveillance
groups is necessary. The increasing focus
on adverse events, which often have a low
frequency in the preregistration trials
(Phase IIb and Phase III), argues for the
fourth organizational model: the stratified
proofofconcept (sPoC) model (FIG. 1).
This structure allows active feedback
between discovery research, Phase I and
Phase IIa trials and postmarketing
surveillance, and includes the potential
development of biomarkers to identify
those patients who might be more likely
to experience adverse events. There are
instances with such models in which a
change in the administration regimen of
the drug or the selection of an alternative
drug has provided greater benefit to
particular patients.
The impact of structure on the type of
organization is probably best understood
by some historical examples. In 1987, Pfizer
was an early adopter of the clinical biology
unit concept, in which the focus was on
identifying markers of disease and human
models of disease that would rapidly deter
mine whether, and in which patients, novel
mechanismbased compounds would be
efficacious. However, the traditional R&D
structure at Pfizer, in which the transition
between research and development is made
at the beginning of human testing (Phase I),
probably delayed the full implementation of a
cPoC type organization. By contrast, organi
zations such as Eli lilly, which for many
years included Phase I and Phase IIa in the
research units, easily functioned as cPoC type
organizations and are making the transition
to sPoC organizations more rapidly. Another
example is that of Novartis, in which the
creation of the NIBR rapidly converted this
organization from a cPoC to a sPoC focus.
Finally, at Genzyme, the unique focus and
the involvement of patients in the pursuit of
drug innovation contributed to the company
becoming one of the earliest adopters of a
sPoC focus.
Of particular interest is the realization
that the heads of R&D who embrace the
sPoC model all seek to generate a bias for
action that places the patient at the centre
of the research effort. Navigation through
the complexity of priorities in an increas
ingly large company is often the principal
challenge.
Recommendations
Establishing and maintaining an entrepre
neurial culture during drug development
is perhaps easier than during the research
stage as the activities associated with this
later phase are closer to product realization
and clinical application. The inherent sense
of urgency associated with the development
stage is driven by the competitive environ
ment, in which time to market with a
differentiated product is an important
determinant of success. Thus, the creation of
special product teams for individual efforts
and for therapeutic franchises, which are
coled by development and commercial
leaders, is more likely to foster the entrepre
neurial behaviours we have identified, such as
ownership, outcome focus, passion and con
viction, and the ability to recruit the best
people. During this stage, it is also easier to
define successful outcomes, such as comple
tion of a welldefined task in a rapid time
frame, and so it is easier to create incentives
that directly reward achieving these outcomes.
During the research stage, however,
entrepreneurial behaviours are often
compromised by several characteristics.
These include:
Increasing size and complexity of
research groups
Having large portfolios and a focus on
increasing the number of shots on goal
Middle managers focused on timelines
and portfolios, instead of science, technol
ogy and leveraging external knowledge
Influence of the commercial department
too early in the process
The impact of evolving science and
technology on organizational complexity
A lack of alignment between Head of
R&D and CEO with respect to the culture
of research.
The responses from our interviewees with
respect to these differences led us to the
following recommendations:
Organizational structures in research units
should facilitate identifying the right drug
for the right patient. The rapid sharing
Figure 1 | evolution of discovery models to identify the right drug for the right patient. Four
types of organizational structures for discovery research were identified on the basis of the point at
which a commitment is made to the full-scale clinical development of a compound. the integration
of activities needed to identify the right drug for the right patient is catalysing a transition towards
the stratified proof-of-concept (Poc) model, which allows active feedback between discovery,
research, Phase i and Phase iia trials, and post-marketing surveillance (PMs).
PersPecti ves
688 | SEPTEMBER 2010 | VOlUME 9 www.nature.com/reviews/drugdisc
nrd_persp_sep10.indd 688 18/8/10 14:06:27
www.nature.com/reprintcollections/lilly/drug-innovation NATURE REPRINT COLLECTION | THE FUTURE OF DRUG INNOVATION | OCTOBER 2011 | 79
and integration of information generated
by all the relevant disciplines, regardless
of where it is found, must be assisted and
rewarded. We recommend that companies
seek to move towards the sPoC model
(FIG. 1), which extends research to Phase IIa
and also incorporates feedback from
postmarketing surveillance studies to
fuel the continued search for new targets,
bio markers and an understanding of
offtarget effects. These activities are
crucial in the search for the right therapy
for the right patient, and will heighten
the sense of urgency to get drugs to
patients.
Middle managers should be given
incentives to access the best ideas and
the best people globally to drive curiosity
and open innovation. Managing external
networks and rapidly internalizing the
results of new scientific and technical
approaches should also be among their
priorities. Rewards for managers should
be based on the speed with which they
achieve the progression of projects,
facilitated by their capacity to foster the
integration of knowledge and to provide
appropriate guidance to true believers
and mavericks. Ultimately, companies
should use middle managers to transform
their culture from something analogous
to a supertanker to a flotilla of diverse,
nimble and innovative ships, consisting
of the following elements: focus on the
patient, scientific curiosity, collaboration,
speed to solution and rewards that are
aligned with goals.
Multidisciplinary research teams should
consist of no more than 2040 members
who focus on the preclinical and clinical
validation of novel targets/mechanisms
with responsibility through to clinical
proofofconcept in Phase IIa trials.
These units of innovation should be
supported by the traditional discovery
research expert groups, such as molecular
biology and chemistry, which focus on
assessing the molecular validation or
relevance of the target and finding lead
molecules that interact with the target.
Both of these groups should include
specialists in postmarketing surveillance
to ensure relevance to the patient.
They should also perform relevant studies
with academic clinicians to generate
information from subsets of patients,
which might inform the research efforts
and ensure a sPoC approach.
Heads of R&D must focus indefatigably
on building and maintaining an
appropriate entrepreneurial culture.
Furthermore, the support of the CEO
for this focus must be visible and active.
Companies should be more innovative
with respect to reward and recognition
for discovery scientists, to foster bias for
action, ownership and an appropriate
sense of urgency.
Companies should examine what we
term the columns outside the doors
phenomenon and the subtle impact that
this form of recognition might have
on entrepreneurial behaviour. Smith
described this phenomenon, which
occurs across the world: as startup
companies become successful, they are
relocated from humble laboratories to
grander buildings with columns outside
their doors. Interestingly, such edifices
often violate the observed inverse
square relationship between com
munication among scientists in labo
ratories and the distance between these
laboratories. We offer this insight more
as a provocative thought than as a firm
recommendation.
We offer one final thought regarding the
transferability of these insights from drug
discovery research to drug development.
In discovery, our data and previous research
suggests that concept realization the
metric relevant for gauging the effectiveness
of discovery improves as the size of the
innovation unit grows to around 20 to 40
researchers, but then declines as the size of the
unit increases and diseconomies of scale take
effect. In development, it is common wisdom
that the optimal efficiency of the process is
obtained when the size of the unit is consider
ably larger than the optimal size of discovery
units. Interestingly, in large pharmaceutical
companies, it has become increasingly
common to outsource many development
related activities, and as this extends, it is
likely that the efficiencysize relationship
may be turned on its head, with pharma
ceutical companies managing development
with relatively smaller units than they have
at present. In that case, the management of
discovery units may hold valuable lessons
for the conduct of development. These
observations might stimulate large
pharmaceutical companies to do that which
Yamada maintains they can: transform
the industry.
Frank L. Douglas, Lesa Mitchell and Robert E. Litan
are at the Ewing Marion Kauffman Foundation,
Kansas City, Missouri, USA.
Frank L. Douglas is also at the Austen BioInnovation
Institute, Akron, Ohio, USA.
V. K. Narayanan is at the Center for Research
Excellence, LeBow College of Business,
Drexel University, Philadelphia, Pennsylvania, USA.
Correspondence to F.L.D.
e-mail: fdouglas@kauffman.org
doi:10.1038/nrd3230
Published online 20 August 2010
1. Goodman, M. Pharma industry performance metrics:
20072012E. Nature Rev. Drug Discov. 7, 795
(2008).
2. Pisano, G. P. Science Business: The Promise, the
Reality, and the Future of Biotech (Harvard Business
School Press, Boston, Massachusetts, USA, 2006).
3. Cuervo, A., Ribeiro, D. & Roig, S (eds)
Entrepreneurship: Concepts, Theory and Perspective
(Springer, Berlin, Germany, 2007).
4. Schramm, C. J. The Entrepreneurial Imperative:
How Americas Economic Miracle Will Reshape the
World (and Change Your Life) (HarperCollins, 2006).
5. Pharmaceutical Research and Manufacturers of
America. PhRMA Annual Membership Survey.
PhRMA website [online], http://www.phrma.org/files/
attachments/PhRMA%202009%20Profile%20
FINAL.pdf (2009).
6. IMS Health. Global Pharmaceutical Sales, 20012008.
IMS Health website [online], http://www.imshealth.
com/deployedfiles/imshealth/Global/Content/
StaticFile/Top_Line_Data/Global_Pharma_
Sales_2001-2008_Version_2.pdf (2009).
7. Munos, B. Lessons from 60 years of pharmaceutical
innovation. Nature Rev. Drug Discov. 8, 959968
(2009).
Acknowledgements
With special thanks to D. Kaiser, M. Tribbitt and T. Flores for
their research and editorial assistance. We would also like to
thank the following colleagues who participated in these inter-
views: B. Adelman, R. Armstrong, L. Babiss, J. Boger, A. Busch,
P. Corr, M. Fishman, T. Glenn, C. Goodman, B. Kirschbaum,
J. Leiden, G. Milne, P. Needleman, G. Neil, J. Patterson,
S. Paul, J. Reinhardt, P. Ringrose, D. Rosen, L. Rosenberg,
R. Ruffolo, V. Sato, B. Shapiro, A. Smith, G. Watanabe and
T. Yamada (see Box 1).
Competing interests statement
The authors declare competing financial interests: see web
version for details.
FuRTHER INFORMATION
Austen Bioinnovation institution homepage:
www.abiakron.org
All links Are Active in the online pDf
PersPecti ves
NATURE REVIEWS | Drug Discovery VOlUME 9 | SEPTEMBER 2010 | 689
nrd_persp_sep10.indd 689 18/8/10 14:06:27
Nature Reviews | Drug Discovery
Discovery
Discovery and
clinical pharmacology
Discovery, Phase I and Phase IIa trials
Discovery, Phase I and Phase IIa trials, and PMS
Preclinical PoC
Human PoC
Clinical PoC
Stratified PoC
Feedback
and patient
stratification
see below). The formation of the Novartis
Institutes for Biomedical Research (NIBR)
has served to institutionalize this practice,
and to implement the fourth model (see
below).
Present interest in the potential of
translational medicine to find the right
drug for the right patient requires the
integration of several activities. These include
the search for biomarkers that not only help
to select compounds preclinically, but also
help to predict, stratify and monitor the
patients and subgroups who will experience
the requisite efficacy of the compound
and an acceptable level of adverse events.
To achieve this, collaboration between
research and postmarketing surveillance
groups is necessary. The increasing focus
on adverse events, which often have a low
frequency in the preregistration trials
(Phase IIb and Phase III), argues for the
fourth organizational model: the stratified
proofofconcept (sPoC) model (FIG. 1).
This structure allows active feedback
between discovery research, Phase I and
Phase IIa trials and postmarketing
surveillance, and includes the potential
development of biomarkers to identify
those patients who might be more likely
to experience adverse events. There are
instances with such models in which a
change in the administration regimen of
the drug or the selection of an alternative
drug has provided greater benefit to
particular patients.
The impact of structure on the type of
organization is probably best understood
by some historical examples. In 1987, Pfizer
was an early adopter of the clinical biology
unit concept, in which the focus was on
identifying markers of disease and human
models of disease that would rapidly deter
mine whether, and in which patients, novel
mechanismbased compounds would be
efficacious. However, the traditional R&D
structure at Pfizer, in which the transition
between research and development is made
at the beginning of human testing (Phase I),
probably delayed the full implementation of a
cPoC type organization. By contrast, organi
zations such as Eli lilly, which for many
years included Phase I and Phase IIa in the
research units, easily functioned as cPoC type
organizations and are making the transition
to sPoC organizations more rapidly. Another
example is that of Novartis, in which the
creation of the NIBR rapidly converted this
organization from a cPoC to a sPoC focus.
Finally, at Genzyme, the unique focus and
the involvement of patients in the pursuit of
drug innovation contributed to the company
becoming one of the earliest adopters of a
sPoC focus.
Of particular interest is the realization
that the heads of R&D who embrace the
sPoC model all seek to generate a bias for
action that places the patient at the centre
of the research effort. Navigation through
the complexity of priorities in an increas
ingly large company is often the principal
challenge.
Recommendations
Establishing and maintaining an entrepre
neurial culture during drug development
is perhaps easier than during the research
stage as the activities associated with this
later phase are closer to product realization
and clinical application. The inherent sense
of urgency associated with the development
stage is driven by the competitive environ
ment, in which time to market with a
differentiated product is an important
determinant of success. Thus, the creation of
special product teams for individual efforts
and for therapeutic franchises, which are
coled by development and commercial
leaders, is more likely to foster the entrepre
neurial behaviours we have identified, such as
ownership, outcome focus, passion and con
viction, and the ability to recruit the best
people. During this stage, it is also easier to
define successful outcomes, such as comple
tion of a welldefined task in a rapid time
frame, and so it is easier to create incentives
that directly reward achieving these outcomes.
During the research stage, however,
entrepreneurial behaviours are often
compromised by several characteristics.
These include:
Increasing size and complexity of
research groups
Having large portfolios and a focus on
increasing the number of shots on goal
Middle managers focused on timelines
and portfolios, instead of science, technol
ogy and leveraging external knowledge
Influence of the commercial department
too early in the process
The impact of evolving science and
technology on organizational complexity
A lack of alignment between Head of
R&D and CEO with respect to the culture
of research.
The responses from our interviewees with
respect to these differences led us to the
following recommendations:
Organizational structures in research units
should facilitate identifying the right drug
for the right patient. The rapid sharing
Figure 1 | evolution of discovery models to identify the right drug for the right patient. Four
types of organizational structures for discovery research were identified on the basis of the point at
which a commitment is made to the full-scale clinical development of a compound. the integration
of activities needed to identify the right drug for the right patient is catalysing a transition towards
the stratified proof-of-concept (Poc) model, which allows active feedback between discovery,
research, Phase i and Phase iia trials, and post-marketing surveillance (PMs).
PersPecti ves
688 | SEPTEMBER 2010 | VOlUME 9 www.nature.com/reviews/drugdisc
nrd_persp_sep10.indd 688 18/8/10 14:06:27
Were Up for the
Innovation Challenge.
We at Eli Lilly and Company are on
a mission: to optimize cutting edge
science and technology in order to
develop medicines that help people live
longer, healthier and more active lives.
Its a legacy that began for us 135 years
ago in a small building in Indianapolis
and has expanded globally. Today,
Lilly delivers medicines to millions of
patients in 143 countries.
Discovering and developing a new
medicine has always been a highly
complex endeavor, often requiring
clever, breakthrough solutions. Today
the challenge is even greater. We need
to draw on all the brainpower and
creativity we can, no matter where in
the world that expertise resides.
That is one of the reasons we are
strong advocates of collaboration,
both within Lilly and with our external
partners.
Throughout Lillys history, advances
in human health have been achieved
because an individual scientist, or
a team of scientists, looked beyond
what was easy, familiar and safe.
True innovation requires us to solve
daunting scientifc problems and,
often, explore unknown territory. It
means that each of us must be willing
to stretch and challenge ourselves
every day. Lilly scientists dont avoid
diffcult scientifc problems because
they involve greater risk. We take
the risk openly and as a team. In this
way, we can continue to fnd unique
medicines that deliver improved
outcomes for individual patients.
Research is the Heart of the business,
the Soul of the enterprise.
Mr. Eli Lilly, grandson of the company founder,
Colonel Eli Lilly
clinical collections
reprint collection
collections
www.nature.com/reprintcollections/lilly/drug-innovation