Boey Chee Kin
National Institute of Technology, HeadquartersTitle –
Oral Presentation is a core communication skills competence in Singapore polytechnics. Proficiency in delivery skills, in pitch, volume, and pace requires personalised feedback. Feedback closes the loop between students’ actual and desired performance (De Grez et al., 2012; Ko, 2019). However, students may not get enough personalised feedback in their practice sessions (Van Ginkel, Gulikers, Biemans, & Mulder, 2015).
Recently, AI has taken centre stage to enhance presentation effectiveness. Microsoft’s Presenter Coach (2019), with an improved version, Speaker Coach (2022), is a mechanism for oral presentation feedback. Students click “Rehearse with Coach” and get on-screen guidance on pace, volume, pitch, word stress and filler words, for better delivery (Microsoft, 2019). Personalised feedback is through a detailed metrics-based actionable insights report, also highlighting strengths. Research suggests that positive feedback directed at task performance enhances students’ self-efficacy (Hattie & Timberly, 2007).
A pilot study was conducted in 2020, with 125 part-time students, to measure the effect size of Presenter Coach on students’ oral presentation delivery. A quasi-experimental design was used in two formative assessment trial presentations, with comparison. For Trial 1, students presented without exposure to Presenter Coach. Tutors rated students’ delivery using standardised rubric. After Trial 1, students were exposed to Presenter Coach via a demonstration and practised asynchronously with Presenter Coach. In Trial 2, tutors assessed students’ presentation delivery, using identical rubric. In 2021, the study was replicated with 175 part-time students. Students completed a perception survey on the usefulness of practice with Presenter Coach. In 2022, 392 full-time students completed the same survey for the subject Effective Communication.
The results show that AI positively impacts delivery practice. The effect size for the pilot test was huge (d= 2.732), and in 2021, it was large (d= 1.206). Students in 2020 (97.3%) and 2021 (94.9%) found Presenter Coach useful. The top three areas of benefit were pace, filler reduction and intonation in 2020 and pace, pitch, and volume in 2021. 87.2% of the full-time students benefitted from Speaker Coach practice. Pace, filler reduction, and pitch were the top three benefits. The study will interest those keen on exploring oral presentation feedback, with AI data-driven insights for effective delivery.