Relevance and Perceptual Constraints in Multimodal Referring Actions

Landragin, Frédéric; De Angeli, Antonella; Wolff, Frédéric; Lopez, Patrice; Romary, Laurent

Item

ITEM ACTIONSEXPORT

Add to Basket

Local TagsRelease HistoryDetailsSummary

Released

Book Chapter

Relevance and Perceptual Constraints in Multimodal Referring Actions

MPS-Authors

/persons/resource/persons96341

Romary, Laurent
Max Planck Digital Library, Max Planck Society;

External Resource

No external resources are shared

Fulltext (restricted access)

There are currently no full texts shared for your IP range.

Fulltext (public)

There are no public fulltexts stored in PuRe

Supplementary Material (public)

There is no public supplementary material available

Citation

Landragin, F., De Angeli, A., Wolff, F., Lopez, P., & Romary, L. (2002). Relevance and Perceptual Constraints in Multimodal Referring Actions. In R. Kibble, & K. Deemter (Eds.), Information Sharing: Reference and Presupposition in Language Generation and Interpretation (pp. 395-413). CSLI Publications.

Cite as: https://hdl.handle.net/11858/00-001M-0000-0013-8774-9

Abstract

In this chapter we present a first attempt to score the relevance of multimodal referring expressions within a task oriented environment. It is based upon the application of the ecological approach to multimodal system design, which in particular implies that perception has to play a central role in the understanding of a demonstrative gesture. Experimental results are presented, together with the scores obtained by combining the linguistic characteristic of the referring expression and the properties of the corresponding gestures (if any). Even if the calculus that we present is limited to contextual effects and has to be refined, it seems to be already suited to validate our approach regarding the importance of group salience and access type in the choice of a referring mode.