The ecological approach to multimodal system design

De Angeli, Antonella; Wolff, Frédéric; Romary, Laurent; Gerbino, Walter

Item

ITEM ACTIONSEXPORT

Add to Basket

Local TagsRelease HistoryDetailsSummary

Released

Conference Paper

The ecological approach to multimodal system design

MPS-Authors

/persons/resource/persons96341

Romary, Laurent
Max Planck Digital Library, Max Planck Society;

External Resource

No external resources are shared

Fulltext (restricted access)

There are currently no full texts shared for your IP range.

Fulltext (public)

gw.pdf
(Any fulltext), 116KB

Supplementary Material (public)

There is no public supplementary material available

Citation

De Angeli, A., Wolff, F., Romary, L., & Gerbino, W. (1999). The ecological approach to multimodal system design. In A. Braffort, R. Gherbi, S. Gibet, J. Richardson, & D. Teil (Eds.), Gesture-Based Communication in Human-Computer Interaction: International Gesture Workshop, GW'99, Gif-sur-Yvette, France, March 1999. Proceedings (pp. 49-52). Berlin / Heidelberg: Springer.

Cite as: https://hdl.handle.net/11858/00-001M-0000-0013-878B-A

Abstract

Following the ecological approach to visual perception, this paper presents a framework that emphasizes the role of vision on referring actions. In particular, affordances are utilized to explain gestures variability in a multimodal human-computer interaction. Such a proposal is consistent with empirical findings obtained in different simulation studies showing how referring gestures are determined by the mutuality of information coming from the target and the set of movements available to the speaker. A prototype that follows anthropomorphic perceptual principles to analyze gestures has been developed and tested in preliminary computational validations.