The Theory of Visual Sentences to Formalize Interactive Visual Languages

Abstract

This chapter introduces an approach to the theory of visual languages, based on the notion of visual sentence as defined by the integration of pictures and descriptions. The paper proceeds by firstly tracking the history of the ideas that stemmed from the initial IEEE Workshop held at Hiroshima (Japan) during 1984 and then gradually progressing towards the formalisms that build up the theory of visual languages. The theory of visual sentences allows a coherent view of both static and dynamic aspects of human-computer interaction, as well as of the relations between the user and the machine during the interaction.