As video data have been used in multimedia information systems, the need for the database support that provides an efficient way for users to retrieve video data is growing. In this paper, we propose a video data model that integrates feature based model and annotation based model for the purpose of improving content-based retrieval of video data. The proposed video data can act as a generic video data model for multimedia applications, and support free annotations, image features, and structure information of video data within the same framework. The proposed video query language provides semantics to access arbitrary segments in the video data. It can formalize various kinds of queries based on the video contents.