de.mpg.escidoc.pubman.appbase.FacesBean
English
 
Help Guide Disclaimer Contact us Login
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT

Released

Conference Paper

The ecological approach to multimodal system design

MPS-Authors
http://pubman.mpdl.mpg.de/cone/persons/resource/persons96341

Romary,  Laurent
Max Planck Digital Library, Max Planck Society;

Locator
There are no locators available
Fulltext (public)

gw.pdf
(Any fulltext), 116KB

Supplementary Material (public)
There is no public supplementary material available
Citation

De Angeli, A., Wolff, F., Romary, L., & Gerbino, W. (1999). The ecological approach to multimodal system design. In A. Braffort, R. Gherbi, S. Gibet, J. Richardson, & D. Teil (Eds.), Gesture-Based Communication in Human-Computer Interaction: International Gesture Workshop, GW'99, Gif-sur-Yvette, France, March 1999. Proceedings (pp. 49-52). Berlin / Heidelberg: Springer.


Cite as: http://hdl.handle.net/11858/00-001M-0000-0013-878B-A
Abstract
Following the ecological approach to visual perception, this paper presents a framework that emphasizes the role of vision on referring actions. In particular, affordances are utilized to explain gestures variability in a multimodal human-computer interaction. Such a proposal is consistent with empirical findings obtained in different simulation studies showing how referring gestures are determined by the mutuality of information coming from the target and the set of movements available to the speaker. A prototype that follows anthropomorphic perceptual principles to analyze gestures has been developed and tested in preliminary computational validations.