Abstract
The e-Assessment and e-Feedback System (eAFS) provides trainees at the Temasek Polytechnic - Lufthansa Technical Training Centre with online assessments and feedback as overall scores. In 2017, personalized dashboard printouts were used to enhance feedback for the Materials and Hardware (M06) practice examination. Each presented a trainee's score for each topic vs the average score of the cohort, total scores of individuals and percentage of grades achieved by the tutorial class vs the highest, lowest, average and individual scores of the cohort. This study examined how participants responded to the personalized dashboard and if and how it influenced their final examination preparation. Data came from two surveys, a staff interview, and practice and actual examination scores. The participant's examination preparation strategies were somewhat influenced by data in their personalized dashboard. However, most reverted to the more standard strategies for their actual final examination preparation. These insights will influence how the trainee e-dashboard will be designed and used.
TopIntroduction
The Temasek Polytechnic - Lufthansa Technical Training Centre (TP-LTTC) in Singapore is the third Lufthansa Technical Training Centre in Asia. Established in 2008, it provides specialised pre-employment Aircraft Maintenance training to third year, first semester students from the Diploma in Aerospace Engineering (AEG) and second year, second semester students from the Diploma in Aerospace Electronics (AEL) at Temasek Polytechnic (TP). The School of Engineering has been audited and certified by the Civil Aviation Authority of Singapore (CAAS) as a Singapore Airworthiness Requirements (SAR) Part 147 Approved Maintenance Training Organisation. As the TP-LTTC programme strictly follows the SAR Part 147 training requirements, its trainees are simultaneously prepared for professional certification examinations with the CAAS.
The syllabus for the intensive 125 full day, six month training programme follows the SAR Part 66 for Aircraft Maintenance Licensing (Civil Aviation Authority of Singapore, 2013). Only Parts B1 and B2 for both Materials and Hardware (M06) and Maintenance Practices (M07) are covered. Curriculum hours total 875 and 714 training hours for trainees from the Diploma in Aerospace Engineering and the Diploma in Aerospace Electronics respectively. Each batch comprises a maximum of 150 trainees who are then placed in five classes, forming 10 tutorial groups. Trainees attend weekly lectures, tutorials and workshop sessions from 9 am to 5 pm, five days a week. They are also assessed continually throughout the training programme.
The pen and paper assessments conducted between 2008 and June 2013 were time-consuming and tedious. Trainers had to print question papers, conduct and grade assessments, and allow trainees time to review their answer scripts and their marks. In addition, there was the arduous process of checking for marking errors, recording, verifying, consolidating and transfering of marks. Table 1 below shows an example of scheduled pen and paper assessments for a customized TP-LTTC main project (MP) / student internship (SIP) project training course for B2 conducted over 78 training days, from 29 October 2012 to 8 March 2013.
Table 1. Written assessment schedule for October 2012 batch
| Assessment | Date | Topics to be tested | No of questions |
| Quiz 1 - MCQ | 8 Jan 2013 | Mechanical topics | 20 |
| Quiz 2 - MCQ | 25 Feb 2013 | Electrical topics | 20 |
| Exam – M06 MCQ | 11 Mar 2013 | All topics in M6 training manual | 60 |
| Exam - M07 MCQ | 12 Mar 2013 | All topics in M7 training manual | 60 |
| Exam – M07 Essay | 12 Mar 2013 | All topics in M7 training manual | 2 |
Key Terms in this Chapter
European Union Aviation Safety Agency (EASA): EASA is an agency of the European Union with responsibility for civil aviation safety. It carries out certification, regulation, and standardisation, and also performs investigation and monitoring.
Airworthiness: Airworthiness is the measure of an aircraft's suitability for safe flight. Certification of airworthiness is conferred by a certificate of airworthiness from the state of aircraft registry national aviation authority, and is maintained by performing the required maintenance actions.
SAR (Singapore Airworthiness Requirements) Part 66: CAAS Requirements for licensing of aircraft maintenance personnel.
Temasek Polytechnic (TP): Established in April 1990, TP a tertiary educational institution in Singapore which offers full-time and part-time diploma courses in applied science, business, design, engineering, and Informatics and IT.
Civil Aviation Authority of Singapore (CAAS): CASS is Singapore's national aviation authority and a statutory board under the Ministry of Transport of the Government of Singapore.
SAR (Singapore Airworthiness Requirements) 147: Pursuant to paragraph 17A of the Air Navigation Order, the SAF – 147 prescribes the requirements of an approved maintenance training organization.
Blackboard (BB): Blackboard is the largest education technology and services company in the world, serving nearly 100 million users in countries in every region around the globe.
Diploma in Aerospace Electronics: This three-year course offered by Temasek Polytechnic covers avionic systems, aircraft navigation and flight control systems.
LockDown Browser – Respondus: It is a customized browser that locks down the testing environment within a learning management system.
Diploma in Aerospace Engineering: This three-year course offered by Temasek Polytechnic covers aircraft flight, aircraft design, airframe structure, engine systems, and manufacturing of aircraft systems.