NCCA Certification Accreditation: Self-Assessment Checklist

This self-assessment tool is intended to provide guidance on your programs

readiness to submit an application for accreditation to the National Commission for
Certifying Agencies (NCCA). The NCCA Standards apply to certification programs,
not certificate of attendance or participation, or certificate programs.
The checklist below is intended to identify any gaps in evidence or documentation
that should be addressed before an application is submitted in order to demonstrate
the rigor and completeness needed to achieve or to maintain accreditation. The
checklist provides a short summary of the actual Standard; for the complete
description of the Standard and its Essential Elements, along with Commentary,
please review the complete NCCA Standards
Self-assessed responses in the working toward or do not currently have columns
will likely indicate that a program does not currently meet all of the Standards. The
NCCA strongly advises that your program be able to respond favorably to all of the
criteria below prior to your application submission.
Please note that a self-assessment of having complete evidence to support this
criterion does not guarantee that the evidence will be interpreted by the NCCA as
fully complying with the Standard. It is only intended as an organizing framework for
your program. Once your program believes that the evidence is complete and
submits its application for accreditation, the NCCA will review each application
relative to the intent of the Standard to evaluate compliance and render one of the
following accreditation decisions: Accredit, Defer with revisions required within 90
days, or Deny.
Have
Working
Do not
complet
towards
currently
Self-Assessment Criteria
e
completi
have
evidence
on of
evidence
to
evidence
support
this
criterion
Standard 1-4: Purpose, Governance, and Stakeholders
1) Well-defined purpose, population being
certified, and justification for
appropriateness of activities.
(Standard 1)
2) Autonomy in essential certification
decisions reflected in governance
structure, bylaws, policies
(Standard 2 A and B)
3) Development, administration, scoring of
assessment(s) promote purpose as

defined above
4) (Standard 2C)
5) Distinct firewall between education and
certification activities; no conflict of
interest (Standard 2D)
6) Does not accredit of education or
training, review, etc. leading to
certification (Standard 2D)
7) Certification governance board
a. is elected fairly, without undue
influence
b. is of adequate size
c. has a public member meeting NCCA
criteria
d. has appropriate
representation/balance of
stakeholders and certificants though
continuous election or rotation
(Standard 3)
8) Certification program is financially
viable (Standard 4)
Illustrative sources of supporting evidence: proof of legal status, bylaws,
policies and procedures, organizational charts, financial statements
Standards 5-9: Responsibilities to Stakeholders
1) There is sufficient staff
resources/expertise and use of
consultants to conduct an effective
program (Standard 5)
2) Policies and procedures are established
for key certification activities and
responsibilities and are published,
applied, reviewed, and updated
(Standard 6):
a. Eligibility criteria and application
policies
b. Examination processes and
procedures
c. Listing/outline of performance
domains w/content area weights,
tasks, associated knowledge and
skills
d. Summary of certification
activities/statistics
e. Equitable disciplinary policies to

address complaints or ethics issues

f. Discipline (Standard 6D), nondiscrimination and accommodation
following applicable laws and
regulations
g. Confidentiality/disclosure and conflict
of interest of all key personnel
involved with the certification
program is adequately addressed
(Standard 6B)
h. Appeals policies and procedures to
question eligibility, exam results,
certification status
3) There are published descriptions of
exam development and validation,
eligibility requirements, administration
(Standard 7)
4) Certification is awarded after
appropriate evaluation of knowledge
and skills only, and grandfathering is
not permitted once accredited(Standard
8)
5) Rationale for grandfathering of limited,
qualified certificants prior to
accreditation is provided (Standard 8 - if
applicable)
6) A list of certified individuals is kept and
can be verified upon request, without
violating confidential information
(Standard 9)
Illustrative sources of supporting evidence: Key staff/consultant resumes,
organizational charts, policies and procedures manual, candidate handbook
Standards 10-18: Assessment Instruments
1) There is a rationale and a timeframe for
conducting a job analysis, with periodic
review and update to verify that it is
relevant to current practice (Standard
10 and commentary)
2) The job analysis was conducted of
adequate sample size, given practicing
individuals within the profession or
industry, with a representative group
across practice areas, work settings,
geography, work experience, gender,

etc. (Standard 10, commentary A-G)

3) There is a detailed published report
linking the results of job analysis to
specifications for the assessment
instruments, with weightings for each
domain, the decision rules for any
actions that may deviate from the
survey data, and the experts involved
(Standard 11)
4) The cut or passing score has been set
using accepted criteria, and a technical
report is published, outlining the
methods, procedures, subject matter
expert and consultant involvement, and
results (Standard 12 A and B)
5) The program has documented the
psychometric procedures used to score,
interpret, and report assessment results
(Standard 13 A)
6) Candidates are given score reports with
meaningful information on their
performance beyond the pass/fail result
(Standard 13 B)
7) For responses scored by judgment,
judge qualifications and selection,
standards, and training materials are
documented (Standard 13C and
commentary)
8) Aggregate assessment data is available
to stakeholders (Standard 13D)
9) Reported scores and sub-scores are
sufficiently reliable for the intended
purposes of the assessment
instrument(s), including estimates of
errors of measurement (Standard 14
and commentary)
10)
Reliability or consistency of
pass/fail decisions are reported
(Standard 14 and commentary)
11)
If multiple forms are used,
content and empirical evidence and
rationale for how equivalence and
fairness is ensured is provided
(Standard 15 and commentary)
12)
If assessment instruments are

translated or adapted across cultures,

the methodology is described and the
evidence shows translation/adaptation
practices and empirical comparability in
test scores and inferences. (Standard 15
and commentary)
13)
Security Practices: There are
published secure procedures adhered to
for development and administration of
the assessment instruments (Standard
16 and commentary)
14)
Security Practices: Document
retention policies describe procedures
for secure retention of all assessment
forms, items, reports, and analyses
related to development and
implementation of the program,
including scores, results, and
procedures for personnel authorized to
access them (Standards 17 and 18)
Illustrative sources of supporting evidence:: job analysis report, cut score
reports, technical/test analysis reports, aggregate data reporting, policies and
procedures, item writing manuals, security manuals, proctor manuals, candidate
score reports. Note: Some of these may be for internal use or confidential, while
others are required to be published. Also, some of these documents may come from
consultants or test vendors implementing the security measures.
Standards 19-20: Recertification
1) Periodic recertification is required, with
published rationale for the purpose,
requirements and time interval
(Standard 19)
2) Consequences to certificants who do
not recertify are published (Standard 19
commentary)
3) If recertification is intended to measure
competency (re-testing), the
assessment instrument used is either
the same as for initial certification, or
the separate assessment instrument
meets the same criteria for validity and
reliability (Standard 20 A)
4) If recertification is intended to enhance
competency (continuing education,
practice modules, etc.), there is

rationale for the requirement and how it

contributes to professional development
(Standard 20B)
Illustrative sources of supporting evidence: candidate handbook, website,
recertification policy, recertification assessment technical reports
Standard 21: Maintaining Accreditation
1) I am aware that an annual report must
be submitted by June 1 of each year,
and it will indicate substantive changes
to any aspects of my program(s) as well
as aggregate statistical data and
reports of appeals or complaints