Seshat : A sync system for Audiobooks and eBooks
In this degree project we present a way to construct a synchronization system that is able to create a timings file, which is the file the system uses to know how to sync the eBook and audiobook, using speech recognition and estimation algorithms. This file is then used by the system to let the user select a sentence and have the audiobook start reading from that sentence, or vice versa. This system can create these files with a mean offset from a manu-ally timed file which is within our expectations for the system.
We use estimation algorithms to fill in the blanks where the speech recognition falls short. Speech recognition accuracy is typically between 40-60%, sometimes dipping lower, so there are blanks to fill in. Using basic algebraic principles of calculating velocity we can ex-trapolate the speed of a reader, using the duration of the audiobook as the time and the amount of characters written as the distance. For increased accuracy we derive this value on a per-chapter basis.
Using this method we are able to create accurate files, which the user can use to freely sync any location in the book. Our system is designed to work for any book in the world that does not have an audiobook which cuts off between sentences in the audio files.
We manually create timings files for four different books with widely varying publishing dates, author styles, reader style and gender to create as wide and representative a testing pool as possible for the project
AT THIS PAGE YOU CAN DOWNLOAD THE WHOLE ESSAY. (follow the link to the next page)