You are on page 1of 24

ASSESSMENT CHECKLIST

JAR FSTD A
Device evaluated Date Evaluation Objective: The objective is to determine if the FSTD is conforming to JAR FSTD A requirements and applicable industry practices. The auditor / evaluator will verify that each requirement, standard and best practice is documented and implemented Address Email:

Evaluation Personnel:

Personnel Interviewed:

Name

Title

Reference

Document / Subject

Location

Last Rev. ( # & Date)

ABY/SIM/001 R00 / 19 January 2012 1/24

FSTD - JAR FSTD A Audit Check-List


Documented
Implemented

JAR FSTD A Initial Issue dated 01. May 2008-SUBPART A- Applicability Applicability (JAR FSTD A.001)
The version of JAR FSTD A agreed by the Authority and used for issue of the initial qualification shall be applicable for future recurrent qualifications of the FSTD unless re-categorized.

JAR FSTD A. 001

IMPLEMENTED : > What is the current version of the MQTG (date, issue) ? Under which regulation is it approved ? (Ref, Date, Version) > Check that the reference documents used by the technicians for running the QTG tests are issued from the current version of the MQTG DOCUMENTED : > Indicate the applicable reference of the internal manual

JAR FSTD A Initial Issue dated 01 May 2008 SUBPART C Airplane flight simulator devices Application for FSTD qualification (JAR FSTD A.015)
The FSTD operator requiring evaluation of a FFS, FTD or FNPT shall apply to the Authority giving 3 months notice. 2 JAR FSTD A.015 (a)
LETTER OF APPLICATION FOR INITIAL JAA EVALUATION OF A FLIGHT ACJ N 1 SIMULATION TRAINING DEVICE. JAR FSTD Part A : To be submitted not less than 3 months prior to requested A.015 (1) qualification date / Part B : To be completed with attached QTG results

IMPLEMENTED : > What is the validity of the qualification certificate ? > If the validity is lower than 3 months, check the evidence of the submission of the application form within the required delay DOCUMENTED :> Indicate the applicable reference of the internal manual IMPLEMENTED : > Check the template used as Evaluation's application form DOCUMENTED : > Indicate the applicable reference of the internal manual

ACJ N 1 Composition of Evaluation Team The team normally consists of at least the following personnel : a type or class rated Training Captain from the FSTD operator or main FSTD users b. sufficient FSTD support staff to assist with the running of tests and operation of the instructors station JAR FSTD A.015 (2)

IMPLEMENTED : > Who is on the team provisioned for an Evaluation ? DOCUMENTED : > Indicate the applicable reference of the internal manual

ABY/SIM/001 R00 / 19 January 2012 2/24

Level

Item

REF EXT

Guidance

Corrective Action

FSTD - JAR FSTD A Audit Check-List


Documented Implemented Level Corrective Action

Item

REF EXT

Guidance

During FSTD evaluations it will be necessary for the Authority to conduct the Objective and Subjective tests described in JARFSTD A.030 and JARFSTD A.035, and detailed in ACJ No 1 to JAR-FSTD A.030. 5 Note : Total of 8 hours allocated to a recurrent evaluation, including 4 hours for Objective testing and 4 hours for recurrent Subjective testing, and provision for extension of the evaluation period.

IMPLEMENTED : > What are the arrangements made for the tests to be completed within an Evaluation ? ACJ N2 JAR FSTD (1.1) DOCUMENTED : > Indicate the applicable reference of the internal manual

Following an evaluation, it is possible that a number of defects may be identified. Generally these defects should be rectified and the Authority notified of such action within 30 days.

ACJ N2 JAR FSTD (1.2)

IMPLEMENTED : > Check the evidence of the rectification of defects identified during an Evaluation DOCUMENTED : > Indicate the applicable reference of the internal manual

Validity of FSTD qualification (JAR FSTD A.020) IMPLEMENTED : > Check the validity of the qualification certificate 7 An FSTD qualification is valid for 12 months unless otherwise specified by the Authority. JAR FSTD A.020 (a) DOCUMENTED : > Indicate the applicable reference of the internal manual

Rules governing FSTD Operators (JAR FSTD A.025)

ABY/SIM/001 R00 / 19 January 2012 3/24

FSTD - JAR FSTD A Audit Check-List


Documented Implemented Level Corrective Action

Item

REF EXT

Guidance

A Quality System shall be established and a Quality Manager designated to monitor compliance with, and the adequacy of, procedures required to ensure the maintenance of the Qualification Level of FSTDs.

JAR FSTD A. 025 (a) (1)

IMPLEMENTED : > Check the evidence of : . an FSTD Operations Manual including, or referring to, Engineering procedures and Quality Assurance procedures . an organizational description including the Accountable Manager and the Quality Manager, as a minimum . Audit reports . A management of findings and associated corrective actions DOCUMENTED : > Indicate the applicable reference of the internal manual

Compliance monitoring shall include a feedback system to the Accountable Manager to ensure corrective action as necessary.

JAR FSTD A. 025 (a) (1)

IMPLEMENTED : > Check evidence(s) of the feedback system to the Accountable Manager (e-mail, distribution list of audit reports, ) DOCUMENTED : > Indicate the applicable reference of the internal manual

The Quality System shall include a Quality Assurance Programme that contains procedures designed to verify that the specified performance, functions and 10 characteristics are being conducted in accordance with all applicable requirements, standards and procedures.

JAR FSTD A. 025 (a) (2)

IMPLEMENTED : > Check that the Quality Assurance Programme identify the processes necessary, and the persons who have the training, experience, responsibility and authority, to carry out the following : a. Perform quality inspections and audits b. Identify and record any concerns or findings, and the evidence c. Initiate or recommend solutions through designated reporting channels d. Verify the implementation of solutions within specific timescale DOCUMENTED : > Indicate the applicable reference of the internal manual

ABY/SIM/001 R00 / 19 January 2012 4/24

FSTD - JAR FSTD A Audit Check-List


Documented Implemented Level Corrective Action

Item

REF EXT

Guidance

IMPLEMENTED : > Check the evidence of the acceptance of the Quality System by the Authority, if any > Check the evidence of the acceptance of the Quality Manager by the Authority, if any JAR FSTD The Quality System and the Quality Manager shall be acceptable to the 11 Authority. A.025 (a) DOCUMENTED : (3) > Indicate the applicable reference of the internal manual

IMPLEMENTED : > Is the Quality System properly documented and updated ? 12 The Quality System shall be described in relevant documentation. JAR FSTD A.025 (a) DOCUMENTED : (4) > Indicate the applicable reference of the internal manual IMPLEMENTED : > Check the evidence of the acceptance of the Accountable Manager by the Authority, if any > Check that the Accountable Manager have corporate authority to ensure that all FSTD Accountable Manager. The person acceptable to the Authority who has corporate authority for ensuring that all necessary activities can be financed and carried out 13 to the standard required by the Authority, and any additional requirements defined by the FSTD operator. ACJ N1 activities can be financed and carried out JAR FSTD A.025 DOCUMENTED : (2.2.1) > Indicate the applicable reference of the internal manual

An FSTD operator should establish a formal written Quality Policy statement that is a commitment by the Accountable Manager as to what the Quality System is 14 intended to achieve. The Quality Policy should reflect the achievement and

ACJ N1 JAR FSTD A.025

IMPLEMENTED : > Check how the Quality Policy is published > Check that the Quality Policy is updated every 2 years as minimum, if applicable

continued compliance with JAR FSTD A together with any additional standards (2.2.1) specified by the FSTD operator.

DOCUMENTED : > Indicate the applicable reference of the internal manual

ABY/SIM/001 R00 / 19 January 2012 5/24

FSTD - JAR FSTD A Audit Check-List


Documented Implemented n Item REF EXT Guidance Level Corrective Action

The primary role of the Quality Manager is to verify, by monitoring activity in the fields of FSTD qualification, that the standards required by the Authority, and any additional requirements defined by the FSTD operator, are being carried out under the supervision of the relevant Manager. The Quality Manager should be responsible for ensuring that the Quality 15 Assurance Program is properly established, implemented and maintained. The Quality Manager should : a. Have direct access to the Accountable Manager; b. Have access to all parts of the FSTD operators and, as necessary, any subcontractors organization.

ACJ N1 JAR FSTD A.025 (2.4.1) (2.4.2) (2.4.3)

IMPLEMENTED : > Check that the organizational structure allows : . a direct access of the Quality Manager to the Accountable Manager . that the Quality Manager have the overall authority to verify that standards are met and ensure that the Quality Assurance Program is established, implemented and maintained > Verify the evidence of audits performed and/or scheduled in all departments of the Operator and any subcontractor's organization, as necessary DOCUMENTED : > Indicate the applicable reference of the internal manual

The posts of the Accountable Manager and the Quality Manager may be combined by FSTD operators whose structure and size may not justify the 16 separation of those two posts. However, in this event, Quality Audits should be conducted by independent personnel.

ACJ N1 JAR FSTD A.025 (2.4.4)

IMPLEMENTED : > If so, verify the evidence of the independence of Quality audits (Formal identification and qualification of internal auditors, Agreement with external subcontractor, ...) DOCUMENTED : > Indicate the applicable reference of the internal manual

ABY/SIM/001 R00 / 19 January 2012 6/24

FSTD - JAR FSTD A Audit Check-List


Documented Implemented Level Corrective Action

Item

REF EXT

Guidance

The FSTD operator should specify the structure of the Quality System. The Quality System should be structured according to the size and complexity of the organisation to be monitored. As a minimum, the Quality System should address the following: a. The provision of JARFSTD A b. Additional standards and procedures c. Quality Policy d. Organisational structure e. Responsibility for the development, establishment and management of the 17 Quality System f. Documentation, including manuals, reports and records g. Quality Procedures h. Quality Assurance Programme i. The provision of adequate financial, material and human resources j. Training requirements for the various functions in the organisation Relevant documentation should include the following: a. Quality Policy / b. Terminology / c. Reference to specified STD technical standards / d. A description of the organisation / e. The allocation of duties and responsibilities / f. Qualification procedures to ensure regulatory compliance / g. The Quality Assurance Programme / h. Document control

IMPLEMENTED : > Estimate if the Quality Departement is properly structured by evaluating the following criteria : . Large organization that hold multiple approvals or cover multiple sites or not . Single device or multiple devices . Role of Quality Manager combined with another position or not . Dedicated team of auditors or single auditor, and/or an agreement for audits subcontracting > Check evidences of audits performed and/or scheduled that cover the overall scope within the required delay (12 months) ACJ N1 JAR FSTD A.025 (3.1.2) (3.1.3) (3.2.1) (3.3) DOCUMENTED : > Indicate the applicable reference of the internal manual

The Quality System should include a feedback system to the Accountable Manager to ensure that corrective actions are both identified and promptly 18 addressed. The feedback system should also specify who is required to rectify discrepancies and non-compliance in each particular case, and the procedure to be followed if corrective action is not completed within an appropriate timescale.

ACJ N1 JAR FSTD A.025 (3.2.2)

IMPLEMENTED : > Check evidences of the management of 3 discrepancies/non-compliances and the associated corrective actions (closed, on-going, overdue) DOCUMENTED : > Indicate the applicable reference of the internal manual

ABY/SIM/001 R00 / 19 January 2012 7/24

FSTD - JAR FSTD A Audit Check-List


Documented Implemented n Item REF EXT Guidance Level Corrective Action

The Quality Assurance Program should include all planned and systematic actions necessary to provide confidence that all maintenance is conducted and all performance maintained in accordance with all applicable requirements, standards and procedures. When establishing a Quality Assurance Program, consideration should, at least, be given to : 19 . Quality inspections . Audit . Auditors . Auditor's independence . Audit Scope . Audit scheduling . Monitoring and corrective action . Management evaluation ACJ N1 JAR FSTD A.025 (4.1.1) (4.1.2)

IMPLEMENTED : > Check the Quality inspection check-lists > Check the Audit check-list > Check the Quality inspections/Audits schedule/program > Check the tool/system used for preventative/corrective action management > Check the template of Management Review > Check the Management Review schedule/program DOCUMENTED : > Indicate the applicable reference of the internal manual

The primary purpose of a quality inspection is to observe a particular event/action/document etc., in order to verify whether established procedures and ACJ N1 requirements are followed during the accomplishment of that event and whether JAR FSTD the required standard is achieved. A.025 20 (4.2.1) Typical subject areas for quality inspections are: (4.2.2) Actual STD operation, Maintenance, Technical standards, Flight simulator safety features

IMPLEMENTED : > Check that the quality inspections program covers the overall scope > Check quality inspections reports DOCUMENTED : > Indicate the applicable reference of the internal manual

ABY/SIM/001 R00 / 19 January 2012 8/24

FSTD - JAR FSTD A Audit Check-List


Implemented Documented

Item

REF EXT

Guidance IMPLEMENTED : > Check the efficiency of the audit's methodology : Regulatory requirements coverage (JAR FSTD A) - Best practices (ARINC) coverage - Documentary and implementation evaluation Findings based on evidences - Opening and closing meeting - Interviews - Evidences gathering ... > Check audit reports DOCUMENTED : > Indicate the applicable reference of the internal manual

An audit is a systematic and independent comparison of the way in which an activity is being conducted against the way in which the published procedures say it should be conducted. Audits should include at least the following quality procedures and processes: a. A statement explaining the scope of the audit. b. Planning and preparation. c. Gathering and recording evidence 21 d. Analysis of the evidence. Techniques which contribute to an effective audit are: a. Interviews or discussions with personnel. b. A review of published documents. c. The examination of an adequate sample of records. d. The witnessing of the activities which make up the operation e. The preservation of documents and the recording of observations. ACJ N1 JAR FSTD A.025 (4.3.1) (4.3.2) (4.3.3)

An FSTD operator should decide, depending on the complexity and size of the organization, whether to make use of a dedicated audit team or a single auditor. ACJ N1 In any event, the auditor or audit team should have relevant FSTD experience. JAR FSTD A.025 (4.4.1) 22 The responsibilities of the auditors should be clearly defined in the relevant documentation. (4.4.2) (4.5.1) Auditors should not have any day to day involvement in the area of activity (4.5.2) which is to be audited.

IMPLEMENTED : > Check the auditors qualification files > Check the agreement for audits subcontracting, if any > Check that the auditors report directly to the Quality Manager, in any case DOCUMENTED : > Indicate the applicable reference of the internal manual

ABY/SIM/001 R00 / 19 January 2012 9/24

Level Corrective Action

FSTD - JAR FSTD A Audit Check-List


Documented Implemented n Item REF EXT Guidance Level Corrective Action

FSTD operators are required to monitor compliance with the procedures they have designed to ensure specified performance and functions. In doing so they should as a minimum, and where appropriate, monitor: a. Organisation b. Plans and objectives c. Maintenance procedures 23 d. FSTD Qualification Level e. Supervision f. FSTD technical status g. Manuals, logs, and records h. Defect deferral i. Personnel training j. Aeroplane modifications management

IMPLEMENTED : > Check that the audit schedule/program covers the overall scope > Check audit reports DOCUMENTED : > Indicate the applicable reference of the internal manual ACJ N1 JAR FSTD A.025 (4.6.1)

A Quality Assurance Programme should include a defined audit schedule and a periodic review. The schedule should be flexible, and allow unscheduled audits when trends are identified. Follow-up audits should be scheduled when necessary to verify that corrective action was carried out and that it was effective. An FSTD operator should establish a schedule of audits to be completed during a specified calendar period. All aspects of the operation should be reviewed within 24 every period of 12 months in accordance with the programme unless an extension to the audit period is accepted as explained below. An FSTD operator may increase the frequency of audits at his discretion but should not decrease the frequency without the agreement of the Authority. When an FSTD operator defines the audit schedule, significant changes to the management, organisation, or technologies should be considered as well as changes to the regulatory requirements. ACJ N1
JAR FSTD

IMPLEMENTED : > Check that the audit schedule covers the overall scope within the required timeframe ( 12 months), and is completed during this period > Check audit reports DOCUMENTED : > Indicate the applicable reference of the internal manual

A.025 (4.7.1) (4.7.2) (4.7.3)

ABY/SIM/001 R00 / 19 January 2012 10/24

FSTD - JAR FSTD A Audit Check-List


Documented Implemented Corrective Action Level

Item

REF EXT

Guidance

The FSTD operator should establish and publish a quality procedure to monitor regulatory compliance on a continuing basis. This monitoring activity should be aimed at eliminating the causes of unsatisfactory performance. Any non-compliance identified as a result of monitoring should be communicated to the manager responsible for taking corrective action or, if appropriate, the Accountable Manager. Such non-compliance should be recorded, ACJ N1 for the purpose of further investigation, in order to determine the cause and to JAR FSTD enable the recommendation of appropriate corrective action. A.025 25 (4.8.1) The Quality Assurance Programme should include procedures to ensure that (4.8.2) corrective actions are taken in response to findings. These quality procedures (4.8.3) should monitor such actions to verify their effectiveness and that they have (4.8.4) been completed. Organisational responsibility and accountability for the implementation of corrective actions resides with the department cited in the report identifying the finding. The Accountable Manager will have the ultimate responsibility for resourcing the corrective action and ensuring, through the Quality Manager, that the corrective action has re-established compliance with the standard required by the Authority, and any additional requirements defined by the FSTD operator.

IMPLEMENTED : > Check that the findings and observations resulting from quality inspections and audits are followed-up until a corrective action has re-established compliance : . Root causes identification . Corrective action definition . A schedule for corrective action . Responsible(s) for implementation . Effectiveness verification at deadline . Tracking of overdues > Check 3 types of corrective actions follow-up : closed - ongoing - overdue

DOCUMENTED : > Indicate the applicable reference of the internal manual

ABY/SIM/001 R00 / 19 January 2012 11/24

FSTD - JAR FSTD A Audit Check-List


Documented Implemented n Item REF EXT Guidance Level Corrective Action

A management evaluation is a comprehensive, systematic, documented review of the Quality System and procedures by the management, and it should consider: a. The results of quality inspections, audits and any other indicators b. The overall effectiveness of the management organisation in achieving stated objectives 26 A management evaluation should identify and correct trends, and prevent, where possible, future non-conformities. Conclusions and recommendations made as a result of an evaluation should be submitted in writing to the responsible manager for action. The Accountable Manager should decide upon the frequency, format, and structure of internal management evaluation activities.

IMPLEMENTED : > Check the inputs and the outputs of the management review reports > Check that one management review is held/scheduled by year as a minimum DOCUMENTED : > Indicate the applicable reference of the internal manual

ACJ N1 JAR FSTD A.025 (4.9.1) (4.9.2) (4.9.3)

Accurate, complete, and readily accessible records documenting the results of 27 the Quality Assurance Programme should be maintained by the FSTD operator.

ACJ N1 JAR FSTD A.025 (4.10.1) (4.10.2)

IMPLEMENTED : > Check by sampling that the following records are retained for a period of 5 years : a. Audit schedules b. Quality inspection and audit reports c. Response to findings d. Corrective action reports e. Follow-up and closure reports f. Management evaluation reports > Check the conditions of archiving : protected from theft, fire and flooding DOCUMENTED : > Indicate the applicable reference of the internal manual

ABY/SIM/001 R00 / 19 January 2012 12/24

FSTD - JAR FSTD A Audit Check-List


Documented Implemented Level Corrective Action

Item

REF EXT

Guidance

FSTD operators may decide to sub-contract out certain activities to external agencies for the provision of services related to areas such as: a. Maintenance b. Manual preparation The ultimate responsibility for the product or service provided by the subcontractor always remains with the FSTD operator. A written agreement should ACJ N1 exist between the FSTD operator and the sub-contractor clearly defining the JAR FSTD services and quality to be provided. The sub-contractor's activities relevant to the A.025 28 agreement should be included in the FSTD operator's Quality Assurance Program. The FSTD operator should ensure that the sub-contractor has the necessary authorization/approval when required, and commands the resources and competence to undertake the task. If the FSTD operator requires the subcontractor to conduct activity which exceeds the subcontractors authorization/approval, the FSTD operator is responsible for ensuring that the subcontractors Quality Assurance takes account of such additional requirements. (5.1.1) (5.1.2) (5.1.3)

IMPLEMENTED : > Check the agreements with sub-contractors (technical parts only), if any > If a contract or purchase agreement adresses a long term support relationship between the OEM and the Operator, check the committed support period, warranties, spares, availability and maintainability demonstrations, and all other support issues, including software support > Check the validity of the authorization/approval of the sub-contractors, if required > Check that the audit schedule include the activities of the subcontractors, if any DOCUMENTED : > Indicate the applicable reference of the internal manual

An FSTD operator should establish effective, well planned and resourced quality related briefing for all personnel. Those responsible for managing the Quality System should receive training covering: 29 a. An introduction to the concept of the Quality System / b. Quality management / c. Concept of Quality Assurance / d. Quality manuals / e. Audit techniques / f. Reporting and recording / g. The way in which the Quality System will function in the organisation ACJ N1 JAR FSTD A.025 (6.1.1) (6.1.2)

IMPLEMENTED : > Check the quality briefing and training records, respectively for all personnel and for those managing the quality system > Check the course supports in case of in-house training > Otherwise, check the agreements with external institutions DOCUMENTED : > Indicate the applicable reference of the internal manual

ABY/SIM/001 R00 / 19 January 2012 13/24

FSTD - JAR FSTD A Audit Check-List


Documented Implemented Level Corrective Action

Item

REF EXT

Guidance

It is recognized that a Quality System tied to measurement of FSTD 30 Performance will probably lead to improving and maintaining training quality.

ACJ N1 JAR FSTD A.025 (7.1.1)

IMPLEMENTED : > Check the Performance report based on ARINC 433, if any > Check its accomplishment at a defined time interval > Check the evidence that it is distributed to the relevant suppliers (OEM, Visual system manufacturer, Supplier of hardware, ..., as applicable) > Check the evidences of investigations and actions taken if the availability f alls below the specified level and/or in case of multiple failure of a single component or system DOCUMENTED : > Indicate the applicable reference of the internal manual

A link shall be maintained between the operators organization, the Authority and the relevant manufacturers to incorporate important modifications, especially: (1) Airplane modifications that are essential for training and checking shall be introduced into all affected FSTDs whether or not enforced by an airworthiness directive (2) Modification of FSTDs, including motion and visual systems (where applicable): (i) When essential for training and checking, FSTD operators shall update their 31 FSTDs. Modifications of the FSTD hardware and software that affect handling,

JAR FSTD

performance and systems operation or any major modifications of the motion A.025 (b) or visual system shall be evaluated to determine the impact on the original qualification criteria. FSTD operators shall prepare amendments for any affected validation tests. The FSTD operator shall test the FSTD to the new criteria. (ii) The Authority shall be advised in advance of any major changes to determine if the tests carried out by the FSTD operator are satisfactory. A special evaluation of the FSTD may be necessary prior to returning it to training following the modification.

IMPLEMENTED : > Check the means of communication between the Operator and its suppliers (Aircraft manufacturer, OEM, Visual system manufacturer, Supplier of hardware, ..., as applicable) : Points of contact, Online databases, Customer fault reporting, ... > Check the information are shared between Operator and its suppliers : SB, SL, Customers advisories / Fleet specific software corrections / Available STD improvements / Spare and repair status / Technical queries status/Discrepancy status/.. > Check the methods of tracking changes in the modeled aircraft (communication of changes to aircraft data packages between aircraft engineering and STD engineering) > Check the status of the modifications incorporated since the initial evaluation : all modifications to software, hardware and firmware with the description of the changes, and its impact to the FSTD, should be documented > Check that it is properly updated > Check by sampling the process of incorporation of a modification and the associated evidences (Amendment to validation tests, Engineering order, QTG running, Record on Technical Log, Authority Notification, Evaluation, Coordination with the training Dpt of the customer (including timing of change), Notification to the instructor community with updated operating instructions) DOCUMENTED : > Indicate the applicable reference of the internal manual

ABY/SIM/001 R00 / 19 January 2012 14/24

FSTD - JAR FSTD A Audit Check-List


Documented Implemented Level Corrective Action

Item

REF EXT

Guidance

Ensure that the FSTD is housed in a suitable environment that supports safe and reliable operation. (1) The FSTD operator shall ensure that the FSTD and its installation comply with the local regulations for health and safety. However, as a minimum all FSTD 32 occupants and maintenance personnel shall be briefed on FSTD safety to ensure that they are aware of all safety equipment and procedures in the FSTD in case of emergency. (2) The FSTD safety features such as emergency stops and emergency lighting shall be checked at least annually and recorded by the FSTD operator.

JAR FSTD A.025 ( c )

IMPLEMENTED : > Check the availability of a safety plan according to local regulations for health and safety, including : . A list and the position of safety equipments . A list of responsible persons . Hazard controls and safe practices . Emergency and accident response > Check the evidences of employee training and communication > Check that the safety features checks (emergency stops and lighting) are included in the Maintenance Program > Check the records of safety features checks DOCUMENTED : > Indicate the applicable reference of the internal manual

ABY/SIM/001 R00 / 19 January 2012 15/24

FSTD - JAR FSTD A Audit Check-List


Documented Implemented n Item REF EXT Guidance Level Corrective Action

. Adequate fire/smoke detection, warning and suppression arrangements should be provided to ensure safe passage of personnel from the FSTD. . Adequate protection should be provided against electrical, mechanical, hydraulic and pneumatic hazards including those arising from the control loading and motion systems to ensure maximum safety of all personnel in the vicinity of the FSTD. . Other areas that should be addressed include: ACJ N3 a. A two way communication system that remains operational in the event of a JAR FSTD 33 total power failure A.025 b. Emergency lighting (2) c. Escape exits and escape routes d. Occupant restraints (seats, seat belts etc.) e. External warning of motion and access ramp or stairs activity f. Danger area markings g. Guard rails and gates h. Motion and control loading emergency stop controls accessible from either pilot or instructor seats i. A manual or automatic electrical power isolation switch.

IMPLEMENTED : > Check physically that the safety elements in place are equivalent, as minimum, to those expected by the ACJ N3 JAR FSTD A.025 > Check that warning and caution stickers are appropriately placed and easily visible DOCUMENTED : > Indicate the applicable reference of the internal manual

IMPLEMENTED : 34 Where additional equipment has been added to the FSTD, even though not required for qualification, it will be assessed to ensure that it does not adversely affect the quality of training. Therefore any subsequent modification, removal or Un-serviceability could affect the qualification of the device. > Check the status of the equipment added since the initial evaluation > Check by sampling the process of addition of an equipment and the associated evidences (Amendment to validation tests, Engineering order, QTG running, Record on Technical Log, Authority Notification, Evaluation,...) DOCUMENTED : > Indicate the applicable reference of the internal manual

JAR FSTD A.025 (d)

ABY/SIM/001 R00 / 19 January 2012 16/24

FSTD - JAR FSTD A Audit Check-List


Documented Implemented n Item REF EXT Guidance Level Corrective Action

Documentation revisions . Ongoing support : When a discrepancy in the documentation is found, it should be corrected as soon as possible 35 . Changes to documentation due to local modifications/improvements : these changes should be identified and integrated into the original documentation in such a way as to make the reader aware that the document has been changed

Best Practice

IMPLEMENTED > Check that the revisions to the original documentation include modifications and improvements > Check the means to report discrepancies found in the documentation to the OEM DOCUMENTED : > Indicate the applicable reference of the internal manual IMPLEMENTED : > Check the Engineering and maintenance staff's trainings records, including : . Ground school on Aircraft systems for the respective fleet . The proper use of test equipement, both old and new state of art . Advanced soldering skills . Installation and alignement of Radio Nav Aids . Advanced classes on modeling tools and techniques . Hydraulic pump/valve rebuilding . Visual maintenance troubleshooting techniques . STD maintenance troubleshooting techniques > Check STD Crew instructor training's trainings records, including : . Reporting STD faults on Electronic Discrepancy Log or Hard Copy Discrepancy Log . Interpretation of STD MEL . Training session quality . Operation and features of the instructor station . Lesson plan creation and editing . Safety features and procedures DOCUMENTED : > Indicate the applicable reference of the internal manual

It is recommended that an initial and an ongoing training program be initiated to 36 continually improve staff skills : . Engineering and maintenance staff training . STD crew instructor training

Best Practice

ABY/SIM/001 R00 / 19 January 2012 17/24

FSTD - JAR FSTD A Audit Check-List


Documented Implemented Corrective Action Level

Item

REF EXT

Guidance

Preventive maintenance activities are initially derived from the OEM data package which provides suggested maintenance activities necessary at defined 36 frequencies.

Best Practice

IMPLEMENTED : > Check the means of planning, launching, tracking and recording the maintenance tasks as defined by the FSTD Maintenance Program, or equivalent > What happens if a maintenance task isn't performed as scheduled ? DOCUMENTED : > Indicate the applicable reference of the internal manual IMPLEMENTED : > Check the reports of the preventive maintenance reviews (inputs and outputs) > Check the evidence of the implementation of an output of a preventive maintenance review

Preventive maintenance reviews should be performed frequently and compared to STD performance metrics, OEM data updates, data collected from fault report forms (derived from corrective maintenance) and maintenance data. Preventive maintenance schedules should then be updated to anticipate and 36 rectify potential STD failures by decreasing intervals between defined scheduled tasks or adding maintenance tasks to the schedule. Ongoing review and updates to preventive maintenance tasks will lead to improved STD availability.

Best Practice

DOCUMENTED : > Indicate the applicable reference of the internal manual

Aging components issues (component that degrades with time regardless of use) : . Electrolytic capacitors . EPROM's . BBRAM 36 . Electrical wiring . Hydraulic components . Motion base . Accessway and maintenance platforms . Batteries

IMPLEMENTED : > Check that the life-limited parts are included in the Maintenance program > Check the means of tracking the life-limited components > Check the means of monitoring the aging components Best Practice DOCUMENTED : > Indicate the applicable reference of the internal manual

ABY/SIM/001 R00 / 19 January 2012 18/24

FSTD - JAR FSTD A Audit Check-List


Documented Implemented Level Corrective Action

Item

REF EXT

Guidance

Measures must be taken in order to return an FSTD to return to an operational state after a minor or major disaster, including : . Software considerations 36 . Hardware considerations Each organization should compile their emergency procedures and include notification information.

Best Practice

IMPLEMENTED : > Check the software backup schedule is including in the Maintenance program (a minimum of quarterly and annual backups, and arrangements to store backups at locations separate from the FSTD site) > Check that the sources of replacement hardware are identified, with periodic checks to assess the provider ability to supply the required equipment DOCUMENTED : > Indicate the applicable reference of the internal manual

Unscheduled maintenance will occur when actions are taken to rectify a fault on an FSTD following an "in-training failure" or a fault found during preventive maintenance. In some cases a fault can be difficult to diagnose and the repair is not obvious. In 36 these cases, a formal process should come into play and should be managed and documented. The repair of these kinds of faults can extend over multiple shifts, even multiple days. The process should eliminate rechecking the same thing more than once and should call for a methodical approach to resolving the problem.

Best Practice

IMPLEMENTED : > Check the evidence of troubleshooting : the fault and the solution are documented with SN/PN of failed LRU recorded > Are diagnostic tools integrated into the FSTD ? (on-line diagnostic, off-line mode for troubleshooting, Electronic fault isolation guide, Cross-references to associated doc,..) > Check the means of feedback loop to raining to allow instructor to trap or record the condition under which a repetitive or a CND (Can Not Duplicate) fault occurs DOCUMENTED : > Indicate the applicable reference of the internal manual IMPLEMENTED : > Check that UOG process exists in case of a critical spare is required and not available > Check the application of the rules of deferring a defect in terms of assigned period > Check the means of record the deferred faults and its accessibility to the users DOCUMENTED : > Indicate the applicable reference of the internal manual

When a fault does not impact training or training can continue with FSTD being used in a limited capacity, then a fault can be deferred and repaired during an 36 assigned maintenance period. It is essential that deferred faults are recorded clearly in deferred log, which should be clearly accessible to training crews as well as technical staff.

Best Practice

ABY/SIM/001 R00 / 19 January 2012 19/24

FSTD - JAR FSTD A Audit Check-List


Documented Implemented n Item REF EXT Guidance Level Corrective Action

IMPLEMENTED : > Does the FSTD incorporate A/C equipment or simulated A/C parts ? What is the philosophy of stock : Association with airline or aircraft OEM, rental pools, acquisition of spares ? > What is the repair philosophy : Repair capabilities "on-site" or nearby with a stock of subcomponent, or Repairs support agreement ? > Checks UOG items, Logistic, Warranty, consignment spares The OEM will normally provide a list of Recommended Spares Listing (RSL). 36 The management of these items involves tracking of consumable issues rates, and component MTBF and MTRR. Best Practice > Check by sampling in the store the spares and consumables inventory

DOCUMENTED : > Indicate the applicable reference of the internal manual

Requirements for FSTD qualified on or after 1 august 2008 (JAR FSTD A.030) Any FSTD submitted for initial evaluation on or after 1 August 2008 will be evaluated against applicable JARFSTD A criteria for the Qualification Levels 34 applied for. Recurrent evaluations of a FSTD will be based on the same version of JAR-FSTD A that was applicable for its initial evaluation. An upgrade will be based on the currently applicable version of JAR-FSTD A. IMPLEMENTED : See JAR FSTD A.001 JAR FSTD A.030 (a) DOCUMENTED : See JAR FSTD A.001

A FSTD shall be assessed in those areas that are essential to completing the flight crewmember training and checking process as applicable. 35 The FSTD shall be subjected to: (1) Validation tests and (2) Functions & subjective tests

JAR FSTD A.030 (b) (c)

IMPLEMENTED : > Check by sampling that the reference documents used by the technicians for running the QTG tests include the tests listed in Part 2 and 3 of JAR FSTD ACJ N1 to JAR FSTD A.030, as a minimum DOCUMENTED : > Indicate the applicable reference of the internal manual

ABY/SIM/001 R00 / 19 January 2012 20/24

FSTD - JAR FSTD A Audit Check-List


Implemented Documented

n Data shall be of a standard that satisfies the Authority before the FSTD can gain a Qualification Level. 36

JAR FSTD A.030 (d)

IMPLEMENTED : > Check that the VDR (Validation Data Roadmap) complies with to JAR FSTD ACJ N App 2 to JAR FSTD A.030 1 DOCUMENTED : > Indicate the applicable reference of the internal manual

37

The FSTD operator shall submit a QTG in a form and manner that is acceptable to the Authority.

JAR FSTD A.030 (e)

IMPLEMENTED : > See JAR FSTD A.015 (a) DOCUMENTED : > See JAR FSTD A.015 (a) IMPLEMENTED : > Check the availability of current MQTG in accordance with the distribution list DOCUMENTED : > Indicate the applicable reference of the internal manual IMPLEMENTED : > Check that the QTG tests are included in the FSTD Maintenance program Check the records/schedules of the running of the complete QTG between each annual evaluation > Check that the records are dated and retained Note : As a minimum, the QTG tests should be run progressively in at least approximately equal 3 monthly blocks on an annual cycle. Each block should be chosen to provide coverage of the different types of validation, functions and subjective tests. It is not acceptable that the complete QTG is run just prior the annual evaluation. DOCUMENTED : > Indicate the applicable reference of the internal manual

38

The QTG will only be approved after completion of an initial or upgrade evaluation, and when all the discrepancies in the QTG have been addressed to the satisfaction of the Authority. After inclusion of the results of the tests witnessed by the Authority, the approved QTG becomes the Master QTG (MQTG), which is the basis for the FSTD qualification and subsequent recurrent FSTD evaluations.

JAR FSTD A.030 (f)

39

The FSTD operator shall run the complete set of tests contained within the MQTG progressively between each annual evaluation by the Authority. Results shall be dated and retained in order to satisfy both the FSTD operator and the Authority that FSTD standards are being maintained.

JAR FSTD A.030 (g) (1)

ABY/SIM/001 R00 / 19 January 2012 21/24

Level

Item

REF EXT

Guidance

Corrective Action

FSTD - JAR FSTD A Audit Check-List


Documented Implemented Guidance Level Corrective Action

Item

REF EXT

The FSTD operator shall establish a Configuration Control System to ensure the continued integrity of the hardware and software of the qualified FSTD. Configuration control should be established in order to document each and every change that is made to hardware and software. When implemented, it will 40 allow correlation between changes made and any negative effects caused by those changes. Proper configuration control will allow recovery back to a known baseline. Configuration control should begin at customer acceptance and then maintained for the life cycle of the FSTD. JAR FSTD A.030 (g)
(2)

IMPLEMENTED : > Has a single configuration control coordinator been nominated to maintain configuration control (the person who shall be contacted before any work is performed) ? > Check the tool/system used to track the evolutions embodied on the software and the hardware since the initial qualification ( For example, a Configuration audit listing in electronic format of all parts (ie software, firmware, hardware), including revision levels, Serial Numbers, and hours in service, as well as, a listing of the aircraft manufacturer's data package, including revision level) > Check the evidences of 4 evolutions (software/hardware and minor/major) and the associated records justifying of their management against the last qualification gained DOCUMENTED : > Indicate the applicable reference of the internal manual

Archiving strategy should provide for a regular & consistent philosophy of backing up the system and changes. 36 Additionally : . Permanent archive of initial acceptance load(s) . Archive after every periodic regulatory review Best Practice

IMPLEMENTED : > Check the archiving of a complete baseline of the initial and reccurent approved hardware and software configuration (Acceptance load), including : . Accepted qualification load . Full system backup . Sub-systems' unique software and firmware backup (e.g. visual, controls, motion, sound, ...) . Master QTG . ATMs, including controls and motion maintenance plots DOCUMENTED : > Indicate the applicable reference of the internal manual

Changes to qualified FSTD (JAR FSTD A.040)

ABY/SIM/001 R00 / 19 January 2012 22/24

FSTD - JAR FSTD A Audit Check-List


Documented Implemented n Item REF EXT Guidance Corrective Action Level

The operator of a qualified FSTD shall inform the Authority of proposed major changes such as: (1) Airplane modifications, which could affect FSTD qualification. (2) FSTD hardware and or software modifications that could affect the handling 41 qualities, performances or system representations. (3) Relocation of the FSTD; and (4) Any deactivation of the FSTD.

IMPLEMENTED : > Are the modifications identified as major/minor on the modifications status ? > Check the evidences of the notifications sent to the Authority among the modifications identified as major on the modifications status JAR FSTD A.040 (a) DOCUMENTED : > Indicate the applicable reference of the internal manual

A FSTD may be upgraded to a higher Qualification Level. Special evaluation is required before the award of a higher Level of Qualification. (1) If an upgrade is proposed the FSTD operator shall seek the advice of the Authority and give full details of the modifications. If the upgrade evaluation does not fall upon the anniversary of the original qualification date, a special evaluation 42 is required to permit the FSTD to continue to qualify even at the previous Qualification Level. (2) In the case of a FSTD upgrade, an FSTD operator shall run all validation tests for the requested Qualification Level. Results from previous evaluations shall not be used to validate FSTD performance for the current upgrade.

IMPLEMENTED : > Has the FSTD has been upgraded to a higher qualification level since its initial qualification ? > If so, check the application form, if any DOCUMENTED : > Indicate the applicable reference of the internal manual

JAR FSTD A.040 (b)

Relocation of a FSTD (1) In instances where a FSTD is moved to a new location, the Authority shall be advised before the planned activity along with a schedule of related events. (2) Prior to returning the FSTD to service at the new location, the FSTD operator shall perform at least one third of the validation tests and, functions and 43 subjective tests to ensure that the FSTD performance meets its original qualification standard. A copy of the test documentation shall be retained together with the FSTD records for review by the Authority. (3) An evaluation of the FSTD in accordance with its original JAA qualification criteria shall be at the discretion of the Authority.

IMPLEMENTED : > Has the FSTD has been relocated since its initial qualification ? > If so, check the application form, if any DOCUMENTED : > Indicate the applicable reference of the internal manual

JAR FSTD A.040 (c )

ABY/SIM/001 R00 / 19 January 2012 23/24

FSTD - JAR FSTD A Audit Check-List


Documented Implemented Level Corrective n Concepts to be approached REF EXT REPORT / OBSERVATIONS / EVIDENCES Action

Deactivation of a currently qualified FSTD (1) If a FSTD operator plans to remove a FSTD from active status for prolonged periods, the Authority shall be notified and suitable controls established for 44 the period during which the FSTD is inactive. (2) The FSTD operator shall agree a procedure with the Authority to ensure that the FSTD can be restored to active status at its original Qualification Level.

IMPLEMENTED : > Has the FSTD has been deactivated since its initial qualification ? > If so, check the application form, if any

JAR FSTD A.040 (d )

DOCUMENTED : > Indicate the applicable reference of the internal manual

Interim FSTD Qualification (JAR FSTD A.045) IMPLEMENTED : > Is the FSTD qualified under an interim qualification level ? > If so, check the associated requirements, details relating to the issue, and the period of validity In case of new aeroplane programmes, special arrangements shall be made 45 to enable an interim Qualification Level to be achieved. JAR FSTD A.045 (a) DOCUMENTED : > Indicate the applicable reference of the internal manual

Transferability of FSTD Qualification (JAR FSTD A.050) IMPLEMENTED : > Has the operator of the FSTD changed since its last qualification ? > If so, check the agreed plan of transfer When there is a change of FSTD operator, the new FSTD operator shall 46 advise JAR FSTD the Authority in advance in order to agree upon a plan of transfer of the FSTD. A.050 (a) DOCUMENTED : > Indicate the applicable reference of the internal manual

References of Internal documentations reviewed during the audit : . . .

ABY/SIM/001 R00 / 19 January 2012 24/24

You might also like