Search Results

Now showing 1 - 2 of 2
  • Item
    A Compositional Semantics for Graphics
    (Eurographics Association, 1988) Pineda, Luis A.
    In this paper a theory for developing "intelligent" interactive graphic systems is detailed. The Fregean compositionality principle is enunciated for graphical representations. Geometrical symbols and relations receive semantic interpretations which are expressed as first order relations in the first order logical language. These interpretations are introduced with the help of deictic expressions. Deictic expressions constitute one associative mechanism between analogical representational systems used in graphics, and functional representational systems commonly used in AI applications. Interpretations of graphical symbols and geometrical relations between them constitute an ontology upon which complex linguistic interpretations are assigned to graphics. A concept of graphical grammar is introduced. Frege's compositionality principle, and the notion of graphical grammar lead to a concept of meaningful drawing. The graphical grammar constitutes a second associative mechanism between the two representational systems that have been mentioned. The truth conditions for relations in the graphical grammar are computed through geometrical knowledge. Computational geometry algorithms are associated with the high level representational system by means of the graphical grammar. Semantic interpretations of graphics are useful in carrying out natural language-like dialogue about graphical representations. Dialogues refer to true facts in particular interactive states, A notion of interactive state as a function of time and situation is then developed. One example of how this theory can be used in linking interactive graphics with AI applications is given. In the example, the semantic interpretation of a geographical map is constructed. This theory has been tested with an experimental program called GRAFLOG. The program is implemented in PROLOG and GKS.
  • Item
    GRAFLOG: Understanding Drawings through Natural Language
    (Blackwell Publishing Ltd and the Eurographics Association, 1988) Pineda, Luis A.; Klein, Ewan; Lee, John
    This paper describes an experimental interactive graphics interface, GRAFLOG, in which drawings receive linguistic interpretations. It is possible to emulate linguistic interaction in situations where graphics is thought to be necessary. The paper presents examples of such a kind of dialogue and the architecture of the implementation. The paper explains how representations of drawings can be constructed by treating graphical symbols as"objects", and how a parallel linguistic interpretation for these symbols can be constructed. It highlights the relevance of"deictic expressions" and"spatial prepositions" in building the interface mechanisms between these two kinds of representations. Lastly, it shows how a reasoning component is constructed for making deductions from premises that are found in both the graphical and linguistic domains. Using GRAFLOG, it is possible to represent knowledge through words and pictures. GRAFLOG is implemented, using an object oriented programming style, in PROLOG and GKS.