EXAMINATIONS OF B1 AND B2 COURSES

AIRWORTHINESS NOTICE

VERSION : DATE OF IMPLEMENTATION : OFFICE OF PRIME INTEREST :

2.0 30-12-2013 AIRWORTHINESS DIRECTORATE

30/12/2013

AWNOT-078-AWEG-2.0

EXAMINATIONS OF B1 AND B2 COURSES

NAME

DESIGNATION

SIGNATURE

PREPARED BY

Engr. AHMAD MASOOD MAHFOOZ

Senior Airworthiness Surveyor (WG Member SARI Part 66/147)

REVIEWED BY

Engr. NAYYAR H. FARUQUI

Airworthiness Safety Inspector (EASA Project)

VERIFIED BY

MAHR MUMTAZ AHMED

A/GM Airworthiness (Regulations)

APPROVED BY

Engr. MUNAWAR JAMAL QURESHI

Director Airworthiness

TYPE OF DOCUMENT

AIRWORTHINESS NOTICE (AWNOT)

STATUS OF DOCUMENT

CONTROLLED

30/12/2013

AWNOT-078-AWEG-2.0

EXAMINATIONS OF B1 AND B2 COURSES

A.

AUTHORITY:

A1. This Airworthiness Notice is issued under the authority vested in DG CAA vide Rule No. 4 of Civil Aviation Rules, 1994 (CARs,1994).

B.

PURPOSE:

B1. The purpose of this Airworthiness Notice is to explain the procedure and requirements of basic and type B1 and B2 knowledge examinations conducted by ANO-147 approved training organizations.

C.

SCOPE:

C1. This Airworthiness Notice is applicable to all ANO-147 approved training organizations intend to conduct basic knowledge examinations and type B1/B2 course examinations.

D.

DESCRIPTION:

D1. DEFINITIONS: The following terms when used in this AWNOT have the meanings, assigned to them respectively. However, any term used in this AWNOT but not defined herein shall have the same meaning as given in the Civil Aviation Ordinance 1960, Pakistan Civil Aviation Authority Ordinance 1982, Civil Aviation Rules,1994 (CARs,1994) and/ or relevant ICAO Annexes, as the case may be, accordingly. (a) Aircraft means any machine that can derive support in the atmosphere from the reactions of the air other than reactions of the air against the earth's surface; (b) Certifying staff means personnel responsible for the release of an aircraft or a component after maintenance; (c) Aircraft Maintenance Engineer License (AML) shall have the same legal meaning as defined for Aircraft Maintenance License in relevant SARI/EASA documents. D2. BACKGROUND:

D2.1. Refer Para ANO.066.A.25 which states that, An applicant for an Aircraft Maintenance Engineer license or the addition of a category or subcategory to such an Aircraft Maintenance Engineer license shall demonstrate, by examination, a level of knowledge in the appropriate subject modules in accordance with Appendix I to ANO-066. Moreover, the basic knowledge examinations shall be conducted by a training organization appropriately approved under ANO-147 or EASA Part-147. D2.2. Also Refer Para ANO.066.A.45 sub-para f, which states that, Completion of approved aircraft type training, as required by paragraphs (b) to (e) of ANO.066.A.45, shall be demonstrated by an examination. The examination shall comply with Appendix III to ANO-066. The examinations in respect of category B1 or B2 or C aircraft type ratings shall be conducted by training organizations appropriately approved under ANO-147, or the training organisation conducting the approved training course. D2.3. Through this notice, PCAA has explain the procedure and requirements for basic and type B1 and B2 knowledge examinations conducted by ANO-147 approved training organizations D3. PAPERLESS EXAMINATIONS: With effect from 30-06-2014, all basic and type examinations must be conducted Paperless through customized software running in main server. However, examination unit must ensure to secure hardcopies of complete examination process for further review by PCAA auditors at any time. D4. COMMON STANDARDS FOR BASIC AND TYPE TRAINING EXAMINATIONS:

D4.1. All examination MCQ papers shall be made by "Computer Random Selection (CRS)" through customized software. All approved examination unit shall develop a "Question Database (QDB)" for this purpose, which must be independent from the questions bank developed for phase examinations of basic courses.

30/12/2013

Page 1 of 6

AWNOT-078-AWEG-2.0

EXAMINATIONS OF B1 AND B2 COURSES

D4.2. The Question Bank for each course/module should be shown to concern airworthiness officer upon request. The question bank must be updated/revised on regular basis and record of such revision must be maintained. D4.3. Examination Manager shall nominate invigilators/examiners who shall be present during all examinations to ensure the integrity of the examination. Presence of concerned module/course instructor shall not be allowed in the examination hall during examinations in any case. D4.4. Bags, coats, calculators, books, charts, mobile phones, ipads, and any other digital devices shall not be allowed in examination hall. D4.5. Photographic proof of identity must be placed on the desk and will be checked during every exam. The photographic ID must be a passport, CNIC, computerized driving license, or ASF airport entry passes are acceptable. D4.6. Candidates will not be permitted to bring their own pen or pencil and they will not be allowed to have any items on their examination desk other than those provided by the examination staff. D4.7. Candidates appearing in examination shall be separated from each other with the minimum spacing of 1.5m on right/left and 1m on front/back, so that they cannot read each other's examination papers and they will not speak to any person other than the invigilator or examiner. D4.8. Candidates who are proven to be cheating shall be banned from taking any further examination of any module (or incase of type examination for the same phase) within 12 months of the date of the examination in which they were found cheating. D4.9. No examination can be conducted without prior intimation to local Airworthiness field office and HQ Airworthiness at least 05 working days before the date of examination D4.10. All examination results shall be announced within 24 hours of its conduct and a copy of result shall be submit to local airworthiness field office and HQ Airworthiness, may be, through email. D4.11. A failed basic module will not be retaken for at least 90 days and failed phase of type training will not be retaken for atleast 30 days following the date of the failed examination. D4.12. An absent module or phase of type training course, will not be retaken for at least 30 days, only in case of prior intimation to examination manager with some valid and authentic reasons (such as death of blood relative, medical emergency, etc) and upto the satisfaction of quality manager. In all other cases, the absent module will be termed as failed module. D4.13. The examination pass mark is 75%. D5. TYPE TRAINING EXAMINATION STANDARD: All examination must comply with the following:

D5.1. Format of the examination is of the multiple-choice type. Each multiple-choice question must have three alternative answers of which only one must be the correct answer. The time for answering is based upon a nominal average of 120 seconds per level 3 question and 75 seconds per level 1 or 2 question. D5.2. The examination must be of the closed book type. No reference material is permitted. An exception will be made for the case of examining a B1 or B2 candidate's ability to interpret technical documents. D5.3. The number of questions must be at least one question per hour of instruction subject to a minimum of two questions per syllabus subject. PCAA will assess number and level of questions on a sampling basis when approving the course. D5.4. Penalty marking is not to be used to determine whether a candidate has passed.

D5.5. End of module phase examinations cannot be used as part of the final examination unless they contain the correct number and level of questions required upto the satisfaction of PCAA. D5.6. If a trainee fails in any two consecutive phases of type training course, then his/her training will be ceased immediately and the trainee will have to re-attend the complete type training again. D5.7. If a trainee fails in any three phases of type training course, then his/her training will be ceased immediately and the trainee will have to re-attend the complete type training again 30/12/2013 Page 2 of 6 AWNOT-078-AWEG-2.0

EXAMINATIONS OF B1 AND B2 COURSES

D6. D6.1.

MCQs GENERATION: The following principles should be observed when developing multiple choice questions: (a) The examination should measure clearly formulated goals. Therefore, the field and depth of knowledge to be measured by each question must be fully identified. (b) Questions that require specialized knowledge of specific aircraft type, should not be asked in a basic license examination. (c) The use of abbreviations and acronyms should be generally avoided. However where needed only internationally recognized abbreviations and acronyms should be used. In case of doubt use the full form, e.g. angle of attack =12 degrees instead of a=12 (d) Questions and answers should be formulated as simply as possible: the examination is not a test of language. Complex sentences, unusual grammar and double negatives should be avoided. (e) A question should comprise one complete positive proposition. No more than 3 different statements should appear among the suggested responses otherwise the candidate may be able to deduce the correct answer by eliminating the unlikely combinations of statements. (f) Questions should have only one true answer. (g) The correct answer should be absolutely correct and complete or, without doubt, the most preferable. Responses that are so essentially similar that the choice is a matter of opinion rather than a matter of fact should be avoided. The main interest in MCQs is that they can be quickly performed and this is not achieved if doubt exists about the correct answer. (h) The incorrect alternatives must seem equally plausible to anyone ignorant of the subject. All of the alternatives should be clearly related to the question and of similar vocabulary, grammatical construction and length. In numerical questions, the incorrect answers should correspond to procedural errors such as corrections applied in the wrong sense of incorrect unit conversions: they must not be mere random numbers. (i) Calculators are not allowed during examination. Therefore, all calculations should be feasible without a calculator. Where a question involves calculations not feasible without a calculator, such as 10, then the question should specify the appro ximate value of 10. (j) All basic examination questions must be referred to ANO-066 Appendix I examination syllabus.

D7.

ESSAY QUESTION GENERATION:

D7.1. The purpose of the essay is to allow PCAA to determine if candidates can express themselves in a clear and concise manner in the form of a written response, in a technical report format using the technical language of the aviation industry. The essay examination also allows to access, in part, the technical knowledge retained by the individual and with a practical appl ication relevant to a maintenance scenario. D7.2. Each essay question requires the preparation of a written answer on A4 size page/s. The purpose of the essay is to allow the examiner to determine if candidates can express themselves in a clear and concise manner in the form of a written response, in a technical report format using the technical language of the aviation industry. The essay examination also allows assessing, in part, the technical knowledge retained by the individual and with a practical application relevant to a maintenance scenario. D7.3. Each essay question will have a model answer drafted for it, which will also include any known alternative answers that may be relevant for other subdivisions. D7.4. The pass mark for each essay question is 75% in that the candidates answer must contain 75% of the required key points addressed by the question and no significant error related to any required key point.

30/12/2013

Page 3 of 6

AWNOT-078-AWEG-2.0

EXAMINATIONS OF B1 AND B2 COURSES

D7.5. New essay questions shall be raised at least every six months (06) and used questions withdrawn or rested from use. A record of the questions used shall be retained in the records for reference. D7.6. Questions should be written so as to be broad enough to be answered by candidates for all license category or sub-categories (Cat A, B1 & B2) and comply with the following general guidelines. (a) the question topic selected should be generic, applicable to mechanical as well as avionic license categories and have a common technical difficulty level as indicated in ANO-066, Appendix 1. (b) cover technology applicable to most area s of aircraft maintenance. (c) reflects common working practices. (d) it is not type or manufacturer specific and avoids subjects which are rarely found in practice. (e) When drafting a question there is a need to ensure consideration is given to the limited practical experience that most candidates will have. D7.7. In order that the questions and the marking procedures are as consistent as possible, each question and model answer, with the required key areas required (see below) should be reviewed independently by examination manager and at least one examiner. D7.8. When raising questions the following should be considered: (a) a complete A4 side is provided for each question and answer, if required the answer can be extended to reverse side of the page. (b) the question should not be ambiguous but should seek a broad reply rather than be limited in scope for answer. (c) the question should lend itself to be written in a technical report style, in a logical sequence (beginning, middle and end), containing the applicable and relevant technical words needed in the answer. (d) do not ask for drawings/sketches to support the essay. (e) the question must be relevant to the category and level of difficulty listed in the syllabus, e.g. a description of a typical general aviation system may not be acceptable for a typical commercial aeroplane. (f) subject to obvious constraints in relation to the topic being addressed the question should have a strong bias towards the practical maintenance of a system/component and the answer should show an understanding of normal and deteriorated conditions of an aircraft and its systems.

(g) Variations on alternative possible answers which have not been thought of may have to be taken into account to aid the examiner when marking. If considered relevant, the model answer should be amended to include these new points. D7.9. Because of the difficulty in marking an essay answer using key points only, there is a need for the way in which the report was written to be assessed and taken into consideration. D7.10. The total points for each question will add-up to 100 and will need to reflect both the combination of the technical (key point) element and the report style element. D7.11. Each key point will be graded upon its importance and have point weighting allocated to it. The total weight will represent 60% of the mark. D7.12. Key points are the important elements that may be knowledge or experience-based and will include other maintenance orientated factors such as relevant safety precautions or legislative practices if applicable. Excessive reference to the need for MM referral or safety checks may be considered wasteful.

30/12/2013

Page 4 of 6

AWNOT-078-AWEG-2.0

EXAMINATIONS OF B1 AND B2 COURSES

D7.13. The question answer will be analyzed for the clarity and manner in which the essay report is presented and have a weighting allocated to it, which will represent 40% of the mark. D7.14. The answer should show the candidates ability to express himself in technical language. This includes readability of the language, basic grammar and use of terminology. D7.15. The report starts in the beginning and has a logical process to reach a conclusion. D7.16. Supporting diagrams should not be encouraged but if used should supplement the answer and not replace the need for a broad text answer. D7.17. The report should not be indexed, itemized or listed. D7.18. Within reason, the candidate should not be penalized for incorrect spelling. D7.19. A zero mark should only be given in exceptional circumstances. Even if the student misunderstands the question and gives an answer to a different question, a sympathetic mark even if only for the report style should be given, this could up to the maximum percentage allowed. D7.20. The two allocated marks should be added together and written into the answer paper. D7.21. If a question answer resulting in a borderline failure is principally due to written report errors, the paper should be discussed and the mark agreed if possible with another examiner. D8. FACILITY REQUIREMENTS FOR ANO-147 TRAINING ORGANIZATIONS:

D8.1. PCAA may approve any ANO-147 training organization to conduct knowledge examination of B1/B2 courses, provided organization meet following minimum requirements: D8.1.1. For basic knowledge examinations, the organization must be approved to conduct basic B1 or B2 course. D8.1.2. Suitable air-conditioned examination hall with proper seating arrangement, meeting the criteria of Para D4.7, must be available. D8.1.3. Facility to record each examination (through camera) and secure in DVD format, for atleast 5 years, must be available. D8.1.4. Facility for remote surveillance of examination, through IP cameras, must be available. Access to these cameras must be provided to local airworthiness field office and HQ Airworthiness. D8.1.5. Software based computerized examination question bank, having the facility to generate multiple randomly selected question papers, must be available. D8.1.6. Question Database (QDB) must contain atleast 6 times the total number of question to be asked in that particular examination. This database must be updated after each examination by atleast 5% of number of examination questions and used questions withdrawn or rested from use. A record of such updating shall be retained in the records for reference. D8.1.7. Sufficient examination staff must be available. D8.1.8. Failure to comply with any of the above mentioned essential requirement will invalidate the complete examination process. D8.1.9. Any other instruction issued by Airworthiness Directorate for this purpose.

30/12/2013

Page 5 of 6

AWNOT-078-AWEG-2.0

EXAMINATIONS OF B1 AND B2 COURSES

E. E1.

EVIDENCES (ACRONYMS / RECORDS / REFERENCES): ACRONYMS:

CARs 1994 EASA PCAA QDB SARI CIVIL AVIATION RULES 1994 EUROPEAN AVIATION SAFETY AGENCY PAKISTAN CIVIL AVIATION AUTHORITY QUESTION DATABASE SOUTH ASIAN REGIONAL INITIATIVE

E2.
E2.1

RECORDS:
Application for initial/amendment/renewal of AML (CAAF-619-AWRG, PCAA Form 19)

E3.
E3.1 E3.2 E3.3

REFERENCES:
ANO-066-AWRG ANO-147-AWRG CARs 1994 IMPLEMENTATION: This Airworthiness Notice shall be implemented with effect from December 30, 2013 and th supersedes AWNOT-078-AWEG-1.1 dated 9 April, 2013 and all previous information for the subject in any PCAA issued ANO, AWNOT, policy letter or any other publication.

(Engr. MUNAWAR JAMAL QURESHI)

for Dated: 2013 Director Airworthiness Director General, Pakistan Civil Aviation Authority

(MAHR MUMTAZ AHMED)

A/GM Airworthiness (Regulations) Dated, 2013 File No. HQCAA/2233/1/78/AW

30/12/2013

Page 6 of 6

AWNOT-078-AWEG-2.0