Projects
RealTime Interaction
A team at the University of Southampton has been investigating how to improve the real time usability of speech recognition generated text. Real time editing, personal display technologies, and annotation tools are among some of the innovations being researched and developed by the Consortium.
To improve speech recognition caption accuracy, an application called RealTimeEdit was developed to enable corrections of speech recognition errors to be made in real-time. One editor can find and correct errors or the task of finding and correcting errors can be shared between two editors, one using the mouse and the other the keyboard. It is also possible to use multiple editors sequentially to allow a 2nd operator to correct errors that a 1st operator did not have time to correct. In this way a real-time editor can be used in situations where high accuracy captions are required. Investigations have shown that an operator can make up to 15 corrections per minute without training or experience with the system.
While projecting the text onto a large screen in the classroom has been used successfully in Liberated Learning classrooms it is clear that in many situations an individual personalised and customisable display (e.g. font size, formatting, colour, etc) would be preferable or essential. A personalised server and client have been developed to enable users to customise their displays on their own networked computers.
In situations where there is more than one person speaking, using multiple instances of IBM ViaScribe over a network can create captions in multiple windows using the personal display client. To produce a single transcript of the session with speakers identified, the application RealTimeMerge was developed to add the speaker’s name to the text captions and merge the streams from the instances of ViaScribe. The individual and/or merged outputs can be edited in real time.
To support note taking in lectures or meetings, the application RealTimeAnnotate has been developed to enable annotations synchronised with the captions to be made in real time.
For more information about RealTime Interaction, please contact:
Dr. Mike Wald
email: M.Wald@soton.ac.uk
|
