Lecture Notes in Computer Science, 2008, Volume 5223/2008, 335-343, DOI: 10.1007/978-3-540-87730-1_30

Multimodal Comprehension of Graphics with Textual Annotations: The Role of Graphical Means Relating Annotations and Graph Lines

Cengiz Acarturk, Christopher Habel and Kursat Cagiltay

View Related Documents

Abstract

Graphs are often accompanied by text, i.e. linguistically coded information, augmenting the information presented diagrammatically. Thus, graph comprehension by humans often constitutes comprehension and integration of information provided by different representational modalities, namely graphical elements and verbal constituents. In this study we focus on textual annotations to line graphs providing information about events, processes and their temporal properties as well as temporal relations about the events and processes in question. We present results of an experimental investigation on parameters which influence subject’s interpretations concerning the temporal properties of the annotated events and on eye movement behavior. In particular, we discuss the role of graph shape and the role of graphical means for relating textual annotations and determined parts of the graph line.

Keywords  text-graphics comprehension - annotations - line graphs - temporal relations

Fulltext Preview

Image of the first page of the fulltext document