Mechanisms for multimodality: taking fiction to another dimension

Glass, Kevin R; Bangay, Shaun D; Alcock, Bruce

Title: Mechanisms for multimodality: taking fiction to another dimension
Creator: Glass, Kevin R
Creator: Bangay, Shaun D
Creator: Alcock, Bruce
Subject: To be catalogued
Date Issued: 2007
Date: 2007
Type: text
Type: article
Identifier: http://hdl.handle.net/10962/433226
Identifier: vital:72953
Identifier: https://doi.org/10.1145/1294685.1294708
Description: We present methods for automatically constructing representations of fiction books in a range of modalities: audibly, graphically and as 3D virtual environments. The correspondence between the sequential ordering of events against the order of events presented in the text is used to correctly resolve the dynamic interactions for each representation. Synthesised audio created from the fiction text is used to calibrate the base time-line against which the other forms of media are correctly aligned. The audio stream is based on speech synthesis using the text of the book, and is enhanced using distinct voices for the different characters in a book. Sound effects are included automatically. The graphical representation represents the text (as subtitles), identifies active characters and provides visual feedback of the content of the story. Dynamic virtual environments conform to the constraints implied by the story, and are used as a source of further visual content. These representations are all aligned to a common time-line, and combined using sequencing facilities to provide a multimodal version of the original text.
Format: 9 pages
Format: pdf
Language: English
Relation: Proceedings of the 5th international conference on Computer graphics, virtual reality, visualisation and interaction in Africa
Relation: Glass, K., Bangay, S. and Alcock, B., 2007, October. Mechanisms for multimodality: taking fiction to another dimension. In Proceedings of the 5th international conference on Computer graphics, virtual reality, visualisation and interaction in Africa (pp. 135-144)
Relation: Proceedings of the 5th international conference on Computer graphics, virtual reality, visualisation and interaction in Africa volume 2007 number 1 135 144 2007 978-1-59593-906-7
Rights: Publisher
Rights: Use of this resource is governed by the terms and conditions of the ACM Digital Library Statement (https://libraries.acm.org/digital-library/policies#anchor3)

Hits: 113
Visitors: 118
Downloads: 7

Collections

Bangay, Shaun Douglas (Dr)

RU Department of Computer Science

SDG 09. Industry, Innovation and Infrastructure

		Thumbnail	File	Description	Size	Format
View Details Download			SOURCE1	Mechanisms for multimodality.pdf	684 KB	Adobe Acrobat PDF	View Details Download