Professional Documents
Culture Documents
Sources
– Instrument Characteristics
– Sample Characteristics
– Method Parameters
– Environmental Affects
– Analyst
– Instrument Settings
– Many others
Measuring Variation
– Range
Acceptable Variability
Application Expectation
Recent publications
– Pharma’s Analytical Target Profile (ATP)
– USP’s Performance-Based Procedures
Upcoming publications
– USP Validation and Verification Expert Panel
– USP Statistics Expert Committee
– USP “Requirements for Compendial Validation
<1200>” (working title)
Defining Another Way Forward
Quantification
N N Y 4 N N
Limit
Linearity Y 3 Y 4 N N
Range Y 3 Y 4 ? N
1 Covered in the Precision-Accuracy Study
2 Covered in the Specificity Study
3 Covered in the Range Study
4 Covered in Accuracy Study
5 Covered in Precision Study
6 Covered in the Detectability Study
Precision and Accuracy Study
1.2
0.8
%CV
0.6
0.4
0.2
0
0.00 0.20 0.40 0.60 0.80 1.00 1.20 1.40 1.60 1.80 2.00
Bias
Study Detail
Precision
– % RSD of 6 independent samples at 100%
Accuracy
– Δ from RS label at 100%
– The data obtained for Precision can be used for
Accuracy
Combine with Acceptance Criteria to calculate
probability
Result = NORMDIST(Upper, Mean, SD, TRUE)
-NORMDIST (Lower, Mean, SD, TRUE)
Limit: NLT 0.95
Specificity Study
Retasked Range
Precision-Accuracy evaluation at 80%, 90%,
100%, 110%, and 120%
Instead of Mean in the calculation, use recovery
value
Recovery Value = [Mean]/[Known]*100%
Limit: Each concentration is NLT 0.95
Linearity
Response vs Concentration
Calibration curve
Technique dependent application
Calculated vs Known Concentration
Slope =1
Intercept =0
Accuracy evaluation
How do you measure linearity?
Slope: not correlated to error
Intercept: not correlated to error
R2: limited correlation to error
Linearity
– Pass
– Is the response of the impurity in the Sample ≥ Standard
– Fail
Is the Δ between pass/fail adequate?
If the limit is 0.1%, then acceptable values are
– 0.14% to 0.05%
– LOD does not assure the measurement
–Detectability does.
Detectability
– Resolution
– Tailing
– %RSD
System suitability rarely linked to variance
UseValidation protocol to evaluate Precision and Accuracy
across the days run.
System suitability can then be linked to validation
Specificity
should represent necessary minimums, but should
exceed criteria of validation
Precision, Accuracy & Linearity
Harry Yang, Ph.D.
Member, USP Statistics Expert Committee
Method Validation
Accuracy
Precision
Repeatability
Intermediate precision
Specificity
Limit of detection
Limit of quantitation
Linearity
Range
Common Validation Characteristics
Accuracy
Precision
Repeatability
Intermediate precision
Specificity
Limit of detection
Limit of quantitation
Linearity
Range
Precision
n n
Xn (X i X )2
SD
X i 1
, SD i 1
, RSD
n n 1 X
Accuracy
E[( X T ) 2 ] ( X T ) 2 var[ X ]
Bias X T
µT µX
Accuracy = bias + precision
Validation of Accuracy and Precision
Model
or
or
An Example
Y
t n 1,0.025
Reject H0 if s2 / n (which is the same as p-value < 0.05)
n n
Yn (Y Y )
i
2
where Y i 1
, s2 i 1
, t n 1,0.025 - cutpoint of t-distribution
n n 1
Assessment of Bias: Traditional Approach
p-value ≥ 0.05
Issue with the Traditional Approach
0 Y t n 1, 0.025s / n , Y t n 1, 0.025s / n
Y t n 1, 0.025s / n , Y t n 1, 0.025s / n
Huberta et al, 2004
Comparison Between Significance and Equivalence
Is bias acceptable?
Significance Equivalence
Yes No
Yes No
Yes Yes
No Yes
Equivalence Method
UAL
LAL
True value
a b c
Accessing Conformance to Acceptance Criteria: Precision
< UAL
1 Graybill FA, Wang CM. Confidence intervals on nonnegative linear combinations of variances. J Am Stat Assoc. 1980;75:869–
873.
2. Nijhuis MB, Van den Heuvel ER. Closed-form confidence intervals on measures of precision for an interlaboratory study. J
Biopharmaceutical Stat. 2007;17:123–142.
3. Satterthwaite FE. An approximate distribution of estimates of variance components. Biometric Bull. 1946;2:110–114.
4. Huberta P, Nguyen-Huub JJ, Boulangerc B, et al. Harmonization of strategies for the validation of quantitative analytical
procedures: a SFSTP proposal—part I. J Pharm Biomed Anal. 2004;36:579–586.
5. Huberta P, Nguyen-Huub JJ, Boulangerc B, et al. Harmonization of strategies for the validation of quantitative analytical
procedures: a SFSTP proposal—part II. J Pharm Biomed Anal. 2007;45:70–81.
6. Huberta P, Nguyen-Huub JJ, Boulangerc B, et al. Harmonization of strategies for the validation of quantitative analytical
procedures: a SFSTP proposal—part III. J Pharm Biomed Anal. 2007;45:82–96.
7. Mee RW. b-expectation and b-content tolerance limits for balanced one-way ANOVA random model. Technometrics.
1984;26:251–254.
8. Hahn GJ, Meeker WQ. Statistical Intervals: A Guide for Practitioners. New York:Wiley; 1991:204.
9. Hoffman D, Kringle R. Two-sided tolerance intervals for balanced and unbalanced random effects models. J Biopharm Stat.
2005;15:283–293.
10. Montgomery D. Introduction to Statistical Quality Control. 3rd ed. New York: Wiley; 1996:441.
11. Kushler RH, Hurley P. Confidence bounds for capability indices. J Quality Technol. 1992:24(4):188–195.
12. Wolfinger RD. Tolerance intervals for variance component models using Bayesian simulation. J Quality Technol.
1998;30:18–32.
13. Ntzoufras I. Bayesian Modeling in WinBUGS. New York: Wiley; 2009:308–312.
14. Spiegelhalter D, Thomas A, Best A, and Gilks, W (1996) BUGS 0.5 Examples Volume 1(version i), Example 7, Dyes, pp 24-
26. Available from http://www.mrc-bsu.cam.ac.uk/bugs/documentation/Download/eg05vol1.pdf (accessed November 20,
2012).
15. Burdick R, LeBlond D, Sandell D, Yang H. Statistical methods for validation of method accuracy and precision.
Pharmacopeia Forum, May –June Issue, 39 (3)
.16. USP. USP 36–NF 31, Validation of Compendial Procedures <1225>. Rockville, MD: USP; 2013:983–988.
17. ICH. Validation of analytical procedures: text and methodology Q2(R1). 2005.
http://www.ich.org/fileadmin/Public_Web_Site/ICH_Products/Guidelines/Quality/Q2_R1/Step4/Q2_R1__Guideline.pdf.
Accessed 27 November 2012.
Linearity
Two Types of Linearity
Sample
r=1 r = -1
r=0
Test of Linearity – Lack of Fit (LOF)
Models:
Bias:
Models:
Bias:
Stage 1
Risk assessment
Stage 2
Procedure Performance Qualification (PPQ)
Stage 3
Continued Procedure Performance Verification
Changes
Stage 1 – Procedure Design
Origin of Impurities
Earlier stage
material
Residual solvents
Genotoxic Impurities
General Process for the Synthesis of Drug Substance
Stage 1
Solvent W
A + B C + ( traces of A and B )
Stage 2
Solvent X
C + D E+ ( traces of C and D ) + M ( reaction between A and C )
Reagent R
Stage 3
Solvent Y
E + F Crude API + ( traces of E and F ) + traces of D + degradent of E
Metal catalyst
Stage 4
Solvent Z
Crude API Final API + Traces of earlier stage material
Side reactions
Degradents
Solvents
Reagents
Analytical Method Validation Criteria ….
- Suitability of Instrument
Analytical Category II
Performance Category I Category III Category IV
Charecteristics Quantitative Limit tests
Accuracy Yes Yes * * No
Category III : Procedures for determining performance characteristics ( eg., dissolution, drug release, etc )
Chromatography
Temperature program : ± 20 %
Column length : ± 70 %
4. However, it is possible to apply skip test if the level does not exceed 30% of
the limit. Data of atleast 6 consecutive pilot scale batches or 3 consecutive
production batches would support the justification
For more than one PGI in a drug substance, the TTC limits will be individually
applied, if the impurities are structurally different.
For more than on PGI, but structurally similar, it is expected that the mode of
action would be same, hence a sum of the limits will be accepted.
Regulatory Audit Warning Letter
Your firm did not validate analytical methods used to test APIs.
The inspection revealed that your firm had not validated the HPLC
method for assay and related substances for finished API for human
use..