Evaluation of the Victorian Deaf Education Institute C-Print Trial
C-Print is a speech-to-text captioning technology and service developed at the National Technical Institute for the Deaf (NTID), Rochester Institute of Technology, New York. The system provides communication access to individuals who are deaf or hard of hearing (D/HH) in educational and other environments. Trained C-Print captionists, present in the classroom or at another location, type a meaning-for-meaning transcription of what is said by teachers and students during a class. The captioned text is available within a few seconds for students to read on their iPad or computer screens, and as a transcript to be accessed after the lesson.
The VDEI C-Print trial aimed to investigate the impact of using C-Print on students' access to curriculum, students' inclusion in the learning process, and communication and participation with peers and educators in Victorian classrooms.
The Evaluation of the Victorian Deaf Education Institute C-Print Trial was completed by Dr Renée Punch in May 2016. The evaluation, based on a framework developed for the evaluation of the Real-time Captioning project employed a mixed-methods approach combining the collection and analysis of both quantitative and qualitative data. The data sources included a school data audit of students' progress in achievement, behaviour, and attitude; a student survey; literacy assessments; a teacher survey, and interviews with captionists and coordinators of the C-Print program.
Results of the evaluation indicated that the trial of C-Print, while brief and involving only a small number of students, was well-received by all stakeholders. Teachers, coordinators, and captionists found its implementation straightforward, involving minimal technical or other difficulties. There is some evidence that the program benefitted participating students in the three areas that were the goals of the trial, with enhancement of students' access to class content, academic engagement, and class participation. In general, the qualitative data from the student and teacher survey open-ended responses and the interviews with program staff reinforced and extended the findings from the quantitative data. Teachers indicated a particularly positive response to the program and strong perceptions of benefit to students. Students indicated a less enthusiastic but nevertheless generally positive response to the program, and all of them reported satisfaction at their involvement in the program.
Access the Executive Summary of the Evaluation of the VDEI C-Print Trial here (pdf - 103.47kb)
Comparison of the C-Print and Real-time Captioning Trial
A comparison of the VDEI Real-time Captioning and C-Print Projects, was completed by Dr Renée Punch in May 2016.
Overall, the evaluation trials found that both programs offered benefits to students in terms of enhanced access to curriculum material, inclusion in the learning process, and communication and participation in the classroom. Both programs appeared to be well-received by teaching staff and the majority of the students involved. Although there were some differences involved in the implementation of the programs, neither program seemed to present major difficulties or challenges that could not be overcome.
In both program evaluations, teachers reported that captioning was more effective for some students than others. In general, students with high levels of academic motivation and, in particular, literacy skills appeared likely to benefit the most from captioning.
Access the Comparison of the Evaluation of the Victorian Deaf Education Institute Real-time Captioning and C-Print Projects here (pdf - 90.57kb)