Professional Documents
Culture Documents
The
difference between the inspection levels listed below is the number of samples to
inspect.
Normal inspection (or level-II inspection): It is the default level, and it is chosen
for 90%+ of inspections.
ISO 2859 definition for normal inspection:
Normal inspection is used when there is no reason to suspect that the [quality level]
differs from an acceptable level.
Unless otherwise specified, level II shall be used. Level I may be used when less
discrimination is needed or level III when greater discrimination is required.
Tightened inspection (or level-III inspection): more samples are checked. This
inspection level is used for suppliers that recently had severe quality problems, or for
high-value products.
ISO 2859 definition for tightened inspection:
Use of a sampling plan with an acceptance criterion that is tighter than that for the
corresponding plan for normal inspection.
Reduced inspection (or level-I inspection): less samples are inspected. This
inspection level is appropriate when the client is confident that the quality of the
products is acceptable.
Note: it is never appropriate for a re-inspection following a refusal.
ISO 2859 definition for reduced inspection:
The discriminatory ability under reduced inspection is less than under normal
inspection.
There are also four other special inspection levels. They are used in cases where the
inspector can only check very few samples. However, the risk of accepting products of
bad quality is higher.
For example: if the inspector has to do a very particular checking that takes him a long
time per product (e.g. dismantling a radio system to see all the components, check the
welding).
Another example: if a particular test ends up in destruction of the product (e.g. undoing
the stitching of a garment to check the cut pieces against the clients patterns).
ISO 2859 definition for special inspection levels:
Four additional special levels, S-1, S-2, S-3 and S-4 [] may be used where relatively
small sample sizes are necessary and larger sampling risks can be tolerated.
Critical defects (totally unacceptable: a user might get harmed, or regulations are not
respected) 0% e.g. plug on an electrical device and it smokes, or a non-welded bar in a bed The
product is dangerous
Major defects (these products would usually not be considered acceptable by the end user)
usually 2.5% e.g. scratches that are noticeable and may prevent the product being sold
Minor defects (there is some departure from specifications, but most users would not mind
it). usually 4.0% e.g. a small scratch on the bottom of a leg of a bed, or on non-visual piece on an
electrical appliance
All Inspection reports generated by the inspection companies listed on Goodada.com will clearly
display the AQL standards and show you if the production has failed or passed.
How do I calculate the correct sample size and acceptance value?
For the majority of products the best suggestion is to use a Standard Level II. If this is the accepted
Level then the table below will provide the sample size, critical, major and minor vales (acceptable
value) see the page below
For any non-standard products, or products where the buyer requires a more detailed inspection,
please refer to the tables below.
Our inspectors would be delighted to assist you to determine the correct levels, sample size and
acceptance numbers
Sample Size Chart this will allow you to determine the amount or quantity of your sample
Lot Size
II
III
S-1
S-2
S-3
S-4
2-8
9-15
16-25
26-50
51-90
91-150
151-280
281-500
501-1200
1201-3200
3201-10000
10001-35000
35001-150000
150001-500000
Use the letter identified in the Sample Size Chart to determine the Acceptance Values and
Sample Size
Code
Letter
Sample
Size
13
20
32
50
80
125
200
315
500
800
1250
2000
Standard Standard
Major
Minor
2.5%
4.0%
0
0
1.0%
0
1.5%
0
6.5%
0
10
10
14
10
14
21
10
14
21
21
10
14
21
21
21
14
21
21
21
21
21
21
21
21
21
21
21
21
21
21
100% check does not yield that much more information than inspecting a statistically
representative sample.
The question becomes: how many products to check?
II
III
S-1
S-2
S-3
S-4
80pcs
200pcs
315pcs
5pcs
8pcs
20pcs
32pcs
As you can see, the numbers of samples to check vary from 5pcs to 315pcs. But a
trained inspector might be able to do it in one day, whatever the inspection level you
choose.
Now lets say you have ordered 40,000pcs of a product. Again, you can see the
differences in sample sizes.
General inspection levels
II
III
S-1
S-2
S-3
S-4
200pcs
500pcs
800pcs
8pcs
13pcs
32pcs
80pcs
In this case, the inspection might take one day of work (for S-1, S-2, S-3, S-4, or
reduced level), two days (under level II), or three days (under level III).
How many samples should be picked and inspected, among a batch of product or parts?
Where is the limit between acceptability and refusal, when it comes to defective
products?
0% for critical defects (totally unacceptable: a user might get harmed, or regulations are
not respected).
2.5% for major defects (these products would usually not be considered acceptable by
the end user).
4.0% for minor defects (there is some departure from specifications, but most users
would not mind it).
These proportions vary in function of the product and its market. Components used in
building an airplane are subject to much lower AQL limits.
Note that this tool is used mostly during final outgoing inspections (when the products
are ready to be shipped out), and sometimes during production (when the number of
products is sufficient to have an idea of the batchs average quality).
The lot size. If you ordered different products, the quantity of each product is a lot size,
and it is advised to perform separate inspections for each lot. If you ordered only one
product, the lot size is the total batch quantity.
The inspection level. Different inspection levels will command different numbers of
samples to inspect. In this article, we will stick to the so-called level II under normal
severity and to single sampling plans.
The AQL level appropriate for your market. If your customers accept very few defects,
you might want to set a lower AQL for both major and minor defects.
There are basically two tables. The first one tells you which code letter to use. Then,
the code letter will give you the sample size and the maximum numbers of defects that
can be accepted.
First table: sample size code letters
Besides, I assume you have set your AQL at 2.5% for major defects and 4.0% for minor
defects. Therefore, here are the limits: the products are accepted if NO MORE than 10
products with major defects AND NO MORE than 14 products with minor defects are
found.
For example, if you find 15 products with major defects and 12 products with minor
defects, the products are refused. If you find 3 with major defects and 7 with minor
defects, they are accepted.
Note: in quality inspections, the number of defective products is only one of the criteria.
It is sometimes called quality, or quality findings. The other criteria are usually on the
inspectors checklist, which typically includes:
Product conformity (aspect, workmanship). If all the products are in red color instead
of orange, there is no need to count each sample as a defect. It makes more sense to
refuse for product conformity.
Specific tests defined in the inspection checklist (they might not be performed on all
inspected samples if they are time-consuming or destructive).
Although individual lots with quality as bad as the acceptance quality limit may be
accepted with fairly high probability, the designation of an acceptance quality limit does
not suggest that this is a desirable quality level. Sampling schemes [] are designed to
encourage suppliers to have process averages consistently better than the AQL.
Note that, in practice, using these statistics means you assume the factory cannot
reasonably be expected to turn out 100% good quality.
Alternatively, you can choose an acceptance on zero plan. As soon as one defect is
found, the inspection is failed. But you can impose this to suppliers only in situations
where quality requirements are very high (in the auto industry, in aerospace).
As you can see in the chart below, the number of samples to check (vertical axis)
increases at a slower pace than the total quantity (horizontal axis).
1. An AQL limit is a target rather than a maximum. The buyer might have a nasty
surprise when receiving a batch of products that passed the inspection. Read more in
this article.
2. A statistical QC approach does nothing to reduce the defects in the first place. Read
more in this article.
You want to check the packaging in full, but only on a few cartons.
You want to perform some time-consuming tests (e.g. a full function test on an electrical
product), and you dont have time to run these tests on all the samples you inspect
visually (in level II, usually).
You want to perform destructive tests (e.g. inspecting bullets by firing them), and
obviously you dont want to destroy too many samples.
Then lets go to the other table, and you can find this information:
If you dont want to accept a defective packing on more than 1.5% of the quantity, the
limit is 1.
In other words, you accept the batch (as far as packing conformity is concerned) if you
find 0 or 1 defective cartons. And you reject it if you find 2 or more.
Note that, when it comes to tests on products and these tests are conducted on a
special level, they are considered critical (i.e. they are failed as soon as 1 sample
fails).
It makes things more simple and avoids lengthy discussions with Chinese suppliers who
dont fully understand how the statistics work.
I hope this explanation was clear. Questions are welcome in the comment section.
Abstract
This paper discusses the application of American National Standards Institute
(ANSI)/American Society for Quality (ASQ) Z1.4-2008: Sampling Procedures and
Tables for Inspection by Attributes. It provides simple instructions on how to correctly
select the sampling plan based on the population size and the acceptable risk. In
addition, this paper provides a general overview of statistics behind the development of
sampling plans. The intent of this paper is to present a quick refresher on sampling by
attributes using the ANSI/ASQ Z1.4 2008 standard and to educate a reader on the
common mistakes users make during the use of this standard.
Introduction
Attribute sampling plans are often used to inspect the effectiveness of the
product/process and to determine the rate of compliance with established criteria. It is a
common pharmaceutical industry practice to employ American National Standards
Institute (ANSI)/American Society for Quality (ASQ) Z1.4-2008: Sampling Procedures
and Tables for Inspection by Attributes for inspection of product/process defects.
ANSI/ASQ Z1.4-2008: Sampling Procedures and Tables for Inspection by Attributes is
an acceptance sampling system that provides tightened, normal, and reduced plans to
be applied for attributes inspection for percent nonconforming or nonconformities per
100 units. The use of sampling tables provides a quicker way of selecting the sampling
plan instead of developing a sampling plan using complex statistics. The standard
provides instructions on how it is supposed to be applied; however, it is often
misinterpreted. The common mistakes include, but not are limited to, the selection of
incorrect sampling size, selection of incorrect acceptance criteria, or attribute plan used
for variable data, etc. Therefore, it is very important to properly interpret the standard
and apply the inspection rules as they are prescribed. Incorrect application can result in
regulatory observations.
(allowable number of defects). If the number of defects exceeds the allowable number of
defects, then the entire lot is rejected.
Inspection Level
The inspection level determines how the lot size and the sample size are related. The
standard divides inspection levels into two main categories: special inspection levels (S1, S-2, S-3, and S-4) and general inspection levels (I, II, III). According to the standard,
inspection Level II should be used unless otherwise specified. The sampling acceptance
criteria discrimination increases from special levels to general levels with Level III
having the greatest discrimination. Special levels shall be used when relatively small
sample sizes are required and large sampling risks can be tolerated.
Inspection Rules
Provisions for each sampling plan include normal, tightened, or reduced inspection.
Normal inspection should always be conducted at the start of inspection. When normal
inspection is applied, tightened inspection can be implemented when two out of five or
fewer consecutive lots failed normal inspection. When tightened inspection is applied,
normal inspection can be implemented when five consecutive lots pass the tightened
inspection. The reduced inspection can be used conditionally when the normal
inspection passes for more than two consecutive lots. Inspection can be discontinued
when 10 consecutive lots remain on tightened inspection. The switching rule diagram is
provided below.
Figure 1: Switching Inspection Rules.
Sampling
Plan
This
plan is
based on
accepting or
rejecting the
lot on one
sample only.
Similar to double
sampling, there may be many
sampling sequences to
determine whether to accept or
reject the lot. Although
complicated, initially, they may
utilize smaller sample sizes to
accept the lot. However, if
there are rejects, then multiple
sampling plans become very
complicated.
Inspection Procedure
The general procedure (Figure 3) in designing the sampling plan is the following.
Figure 3: Inspection Procedure.
S-1
S-2
S-3
S-4
II
III
2 to 8
9 to 15
16 to 25
26 to 50
51 to 90
91 to 150
151 to 280
281 to 500
501 to 1200
1201 to 3200
3201 to 10000
10001 to 35000
35001 to 150000
150001 to 500000
500001 to over
Note: Use first sampling plan below arrow. If sample size equals or exceeds lot or
batch size, do 100% inspection.
Ac = Acceptance Number
Re = Rejection Number
Caution: Note, the sampling plan consists of a sample size and acceptance criteria at
particular AQL. It is common to select one or another; however, this application of the
sampling procedure is incorrect. The correct use of these tables is discussed further.
Defect
Class
Definition
Description
AQL
0.01
%
Major
Minor
For each defect category, defects are also classified into different types. For instance, if
inspecting a bottle for tablet count, closure, seal, label and carton defects, these defects
are not added together since they are results of different packaging processes. Instead,
these defects are added based on the product attribute (tablet count, closure, etc.).
The inspection procedure should include the sampling plan with inspection level, type,
and accept/reject criteria. For instance, if the expected packaging lot size is 36,000
bottles, it would be impossible to test all 36,000 bottles, so a representative sampling
size should be selected. To determine an inspection sample size, ANSI/ASQ Z1.42008Sampling by Attributes Plan, General Inspection II, Tightened Plan can be used.
A lot of 36,000 bottles corresponds to letter N (General Inspection Level II) (see Table I.
A sample size from Table II (Table II-B, Single Sampling Plans for Tightened
Inspection) is selected. Letter N corresponds to sample size of 500. If AQL level desired
is specified as 0.010%, it means that 2000 samples need to be inspected and all 2000
samples should have no defects to pass a lot. For AQL 0.65%, 500 samples require
inspection failing a lot if six defects are found. For AQL 4%, only 315 samples require
inspection failing a lot if 19 defects are found.
Warning
Since the regulatory requirements are very strict when it comes to defects that are
related to safety, purity, etc., it is a common misconception that the sample inspected
must not contain any non-conformance units for the lot to be accepted.
For example, as shown in Figure 8, the OC curves show that lots that are 2% defective
will be accepted 90% of the time inspecting five samples, 82% of the time inspecting 10
samples, 67% of the time inspecting 20 samples, and 13% of the time inspecting 100
sample. With more samples we test, the probability of accepting a lot with defects
decreases. Thus if we claim that we accept zero defects and test a very small sample, in
this case five samples, there is a high probability that we are accepting defects in the lot
without being able to detect them.
Figure 8: Operating Characteristic Curve.
Summary
In summary, correct statistical sampling is required by the pharmaceutical industry
regulations. Understanding of ANSI sampling by attributes and correct application will
help to avoid sampling mistakes and potential observations.
Acronym Listing
AQL
ANSI
ASQ
FDA
GMP
General References
ASQ, ANSI/ASQ Z1.4-2008: Sampling Procedures and Tables for Inspection by
Attributes, 2008.
Code of Federal Regulations, Title 21, Food and Drugs (Government Printing Office,
Washington, DC), Part 211.
K. Stephens, The Handbook of Applied Acceptance Sampling: Plans, Procedures, and
Principles, ASQ Quality Press, 2001.
Is my factory following international and local rules and regulations? (Social Audit)
Has production started correctly? (First Article inspection)
Is my order produced according to my specifications? (Product Inspection)
Is the container well loaded? (Container Loading Inspection)
How to make sure there are no defects? (Defect Sorting Service)
How to ensure the factory introduces the right quality checks? (Production Monitoring)
Register online in order to create your private account on our website; it is free of charge
and requires no commitment.
After activation of your account, you will be able to choose your desired service and provide us
with your requirements, instructions, specifications, criteria and attachments online (24/7).
Our Operations team will prepare, coordinate and arrange your booked service and you will
receive a confirmation email. If you have any questions, you can contact us at any time.
The day of the requested service you will receive your fully illustrated report by email and it
will also be posted on your secured private account.
You will receive one invoice per month, at the end of the month (however, if it is your first time
working with us we ask you to pay in advance).
Register now!
Qualitycontroltermsandglossary
A
Acceptance Number
Acceptance Sampling
Approval Sample
AQL
B
Batch/Lot/Sampling
C
Container Loading Inspection (CLI)
Continuous Sampling Plan
Cost of Poor Quality
Cost of Quality
D
Defects and Defectives
Defects per Hundred Units
Double Sampling Plan
Drawing of Samples
During Production Inspection (DPI)
E
Expression of Nonconformance
F
Factory Audit
First-Articles Inspection
Inspection
Inspection
Inspection
Inspection
Inspection
ISO
by Attribute
Check List
Levels
Protocol
L
Lot or Batch
Nonconformance
Normal Inspection
P
Percent Defective
Pre Shipment Inspection (PSI)
R
Random Sampling
Reduced Inspection
Rejection Number
Representative Sampling
Resubmitted Lots or Batches
S
SA8000
Sample
Sampling Plans
Severity of Inspection
Single Sample Plan
T
Tightened Inspection
Unit of Production
Acceptance Number
The acceptance number is the maximum number of defects or defective units in the sample that will
permit acceptance lot or batch.
Acceptance Sampling
Acceptance Sampling is used to decide whether to accept or reject a production lot. After selecting a
sampling from a production lot, we inspect the units, we count how many defects are found among this
sampling and we use the result (number of defects found versus maximum number of defects allowed)
to decide whether or not to accept or reject the lot.
Approval sample
The approval sample, also called golden sample, pre-production sample or PP-sample, is usually sent
by the buyer to the third party inspection company and manufacturer. It is the product of reference
and will be compared to the production samples. The production and the approval sample should be
very similar. An inspection report will point out the differences.
Read more about the role of the approval sample during an inspection.
AQL
The AQL has two different definitions due to standard changes.
The AQL is the quality level that is the worst tolerable process average when a continuing series of lots
is submitted for acceptance sampling. The following note on the meaning of AQL was introduced with
the ANSI/ASQ Z1.4-2003 revision:
The concept of AQL only applies when an acceptance sampling scheme with rules for switching
between normal, tightened and reduced inspection and discontinuance of sampling inspection is used.
These rules are designed to encourage suppliers to have process averages consistently better than the
AQL. If suppliers fail to do so, there is a high probability of being switched from normal inspection to
tightened inspection where lot acceptance becomes more difficult.
Once on tightened inspection, unless corrective action is taken to improve product quality, it is very
likely that the rule requiring discontinuance of sampling inspection will be invoked. Although individual
lots with quality as bad as the AQL can be accepted with fairly high probability, the designation of an
AQL does not suggest that this is necessarily a desirable quality level.
The AQL is a parameter of the sampling scheme and should not be confused with a process average
which describes the operating level of a manufacturing process. It is expected that the product quality
level will be less than the AQL to avoid excessive non accepted lots. The AQL values are defined as
percent nonconforming or defects or nonconformities per hundred units.
Download the AQL table, and read more to get familiar with the AQL table:
Batch/Lot/Sampling
A batch or lot is a collection of products, all identical in size, type, conditions and time of production.
an inspection of your products (product check according to your P/O: quantity, appearance and
general quality)
Cost of Quality
This refers to all costs involved in the prevention of quality issues, defects, assessments of process
performance, and measurement of financial consequences. Cost of quality is the cost justification of
quality efforts. Cost of quality should be seen as an investment more than a cost.
Drawing of Samples
Basic to sampling inspection is the assurance that the sample selected from a quantity of units
represents the quality of that quantity of units. Hence, the procedure used to select units from a lot
must be such that it assures a sample free of bias
Expression of Nonconformance
The extent of nonconformance of product shall be expressed either in terms of percent defective or in
terms of defects per hundred units (DHU).
Factory Audit
This is a full evaluation of your supplier according to the ISO standards. It covers: profile of the
supplier, internal organization, safety regulations, quality processes, performance, delivery terms and
R&D. The audit also includes extensive worker and manager interviews in the factory worker's
language.
Read about the difference between factory audit and inspection.
First-Articles Inspection
The Initial Production inspection is performed at the very first stage of the mass production. Asia
Quality Focus Inspectors will inspect the quality of the material and components used in the production
process and make sure it fits your requirements and is according to your approved sample (BAT). It
also includes a visual check on the quality of packing materials and accessories. The inspector will also
monitor the assembly process and check the first production run.
The First-Articles Inspection ensures that the customer's specifications are well-understood by the
supplier/factory. The IPC will detect production discrepancies very early in the production processes;
you will thus be able to take corrective actions sooner than later... saving time and securing your
business
Inspection
Inspection is the process of measuring, examining, testing, or otherwise comparing the unit of product
with the requirements.
Read about the difference between inspection and factory audit.
Inspection by Attribute
Inspection by attributes is inspection where by either the unit of product is classified simply as
defective or non-defective, or the number of defects in the unit of product is counted, with respect to a
given requirement or set of requirements.
Inspection checklist
It is a document in which are listed all the details an inspector should check during an inspection. The
objective is to avoid missing any of them.
Read more about how useful is the inspection checklist for an importer.
Inspection Levels
The standards provides for three general inspection levels and four special inspection levels. These
seven levels permit the user to balance the cost of inspection against the amount of protection
required.
Read more and get familiar with the inspection levels:
The difference between the general and special inspection level of the AQL table by
reading this article.
How to choose the right AQL inspection level.
Inspection protocol
It defines all the process and steps the QC has to follow in order to perform the inspection. It includes
the list of the details to check and the order specification verification.
ISO
ISO is a network of the national standards institutes of 157 countries, on the basis of one member per
country, with a Central Secretariat in Geneva, Switzerland, that coordinates the system. ISO is a nongovernmental organization: its members are not, as is the case in the United Nations system,
delegations of national governments. Nevertheless, ISO occupies a special position between the public
and private sectors. This is because, on the one hand, many of its member institutes are part of the
governmental structure of their countries, or are mandated by their government. On the other hand,
other members have their roots uniquely in the private sector, having been set up by national
partnerships of industry associations.
ISO 9000 Standards: this is a set of quality standards developed in 1987 by the International
Organization for Standardization. The three major areas of certification are as follows:
ISO 9002: covers everything except design and development.
ISO 9001: covers all the processes of a company from design and development to procurement,
production, testing, installation and service.
ISO 9003: covers only inspection and testing.
Lot or Batch
The lot size is the total number of units available for random sampling. The lot size only includes
packed products. Also called "inspection lot" or "inspection batch", it is a collection of units of product
from which a sample is to drawn and inspected to determine conformance with the acceptance
criteria.
Nonconformance
Nonconformance may be defined as the failure of a unit of product to conform to specified
requirements for any stated quality characteristic. The extent of nonconformance of product to the
required quality characteristics shall be expressed either in terms of percent defective or in terms of
defects per hundred units (DHU).
Normal Inspection
Normal inspection is what is used where there is no evidence that the quality of product being
submitted is better or worse than the specified quality level.
Percent Defective
The percent defective of any given quantity of units of product is one hundred times the number of
defective units of product contained therein divided by the total number of units of product, i.e.:
Percent defective = number of defectives x100 / number of units inspected.
Random Sampling
This is a standard sampling method by which random samples of units are chosen such that all
combinations of these units have an equal chance of being chosen as the sample.
Reduced Inspection
Reduced inspection under a sampling plan uses the same quality level as for normal inspection, but
requires a smaller sample for inspection.
Rejection Number
The rejection number is the minimum number of defects or defective units in the sample that will
cause rejection of the lot represented by the sample.
Representative Sampling
When appropriate, the number of units in the sample shall be selected in proportion to the size of sublots or sub-batches, or parts or the lot or batch, identified by some rational criterion. When
representative sampling is used, the units from each part of the lot or batch shall be selected at
random.
Sample
A sample consists of one or more units of product drawn from a lot or batch, the units of the sample
being selected at random without regard to their quality. The number of product in the sample is the
sample size.
Sampling Plans
A lot sampling plan is a statement of the sample size or sizes to be used and the associated
acceptance and rejection numbers.
Severity of Inspection
The severity of inspection concerns the total amount, kind and extent of inspection specified by the
quality assurance provisions established for the unit of product, or as dictated by quality history.
Tightened Inspection
Tightened inspection under a sampling procedure plan uses the quality level as for normal inspection,
but requires more stringent acceptance criteria.
Unit of Production
The unit of product is the thing inspected in order to determine its classification as defective or nondefective or to count the number of defects. It may be a single article, a pair, a set, a length, an area,
an operation, a volume, a component of an end product, or the end product itself. The unit of product
may or may not be the same as the unit of purchase, supply, production, or shipment.
All possible functions and possible tests (safety, abuse, printing, etc.)
Download the
AQL table.
Inspection Types
PPI to assure understanding of your product & order
FAI for a successful transition to mass production
DPI to improve quality during mass production
PSI to detect and solve problems before shipment
CLS to ensure punctual & safe transport
DSS to sort out all the most important defects
PM to continuously understand and improve processes
Product Expertise
Textiles & Apparel
Toys
Furniture & Homeware
Electronics & Electrical
Luxury Products
Promotional Goods & Gifts
Automotive Industry