When Exams Go to Work: A Study on the Perceived Effectiveness of Oral and Written Exams in a Corporate Training Setting

Abstract

Oral and written exams have been widely used and accepted as effective learning tools. Exams are now being used within companies in training employees. It is now generally accepted that any credible assessment process or exam must have the attributes of reliability, validity, acceptability, feasibility (cost) and educational impact (Brown and Glasner, 1999). Lyons, Kisilka & Pawlas, (1998) added objectivity and Svinicki (1999) added that exams should be recognizable and realistic as criteria for exam effectiveness. Thus general objective of the study was to describe how effective oral and written exams are in a corporate setting based on the perspective of those who make and those who take the test. Research questions and specific objectives focused on investigating the exams" purpose, reliability, validity, acceptability, cost effectiveness and areas for improvement. The study utilized a concurrent mixed method design. Self-administered surveys with descriptive and scale questions were disseminated via email. Semi-structured interviews were done as well. Results showed that trainers and trainees agree that the purpose of the exams is to assess and develop them. Written exams were a measure of knowledge transfer. On the other hand, oral exams served as an application of theory in practice. More test takers prefer oral over written since they believe it is a better measure of their understanding and not just memorization. Trainers mentioned a must to balance a variety of exams to cater to different learning styles. Employees are convinced that the exams are reliable and valid in doing their purpose. They believe so since it goes through a lot of processes, different experts, and is constantly improved. The costs are not an issue since the company has the budget. Trainers claim that their key is a sales culture prioritizing people development. A Study on the Perceived Effectiveness of Oral and Written Exams in a Corporate Training Setting iv | P a g eThus, they do not see time and material resources as costs but as part of developing the people. Still, it was raised that the exams can be time-consuming. This is the main area for improvement. Exams were desired to be more automated and paperless. This would make answering and checking easier and faster, and cut down costs. Trainees wanted not to be rushed and sacrifice sleep preparing for the exams. However, trainers explained this is a needed discomfort for them to feel the pressure. Other areas for improvement include the focus of exam types, giving handouts, and better evaluation forms. Moving forward, it was also desired that practical application be more of the focus. It can be concluded that the oral and written exams are effective in assessing and developing people for the company under study. This is based on the perspective of the people in the company. As such, the exams might not work for other people or corporations. Moving forward, future studies could gather the perspective of other companies or fields.