Abstract
An abstract semantic model called the augmented transition network (ATN), which can model video data and user interactions, is proposed. An ATN and its subnetworks can model video data based on different granularities such as scenes, shots and key frames. Multimedia input strings are used as inputs for ATNs. The details of how to use multimedia input strings to model video data are also discussed.