English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
 
 
DownloadE-Mail
  Cross modal transfer in face recognition

Dopjans, L., Wallraven, C., & Bülthoff, H. (2007). Cross modal transfer in face recognition. Poster presented at 10th Tübinger Wahrnehmungskonferenz (TWK 2007), Tübingen, Germany.

Item is

Files

show Files

Locators

show
hide
Description:
-
OA-Status:

Creators

show
hide
 Creators:
Dopjans, L1, 2, Author           
Wallraven, C1, 2, Author           
Bülthoff, HH1, 2, Author           
Affiliations:
1Department Human Perception, Cognition and Action, Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_1497797              
2Max Planck Institute for Biological Cybernetics, Max Planck Society, Spemannstrasse 38, 72076 Tübingen, DE, ou_1497794              

Content

show
hide
Free keywords: -
 Abstract: Prior studies have shown that humans can recognize faces by touch alone but perform poorly in cross-modal face recognition [1]. Here we want to shed further light on haptic face recognition
with four experiments using a well-defined stimulus face space based on the morphable MPIFace-
Database. Experiment 1 used a same/different task with sequentially presented faces
which established that subjects were able to discriminate faces haptically, using short term
memory. In Experiment 2 we used an old/new recognition task for which different sets of
three faces (out of six) were learned haptically with three subsequent haptic test-blocks and
one visual test-block. In contrast to Casey and Newell (2007) we used the same printed face
masks for recognition in both modalities. We found that participants could recognize faces
haptically although recognition accuracy was low (65) and tended to decrease across blocks.
Cross-modal recognition, however, was at chance level (48). In Experiment 3, we changed
the design such that haptic memory was refreshed before each test-block by repeated exposure
to the three learned faces. We found that performance increased significantly to 76 and
that it became more consistent across blocks. Most importantly, however, we found clear
evidence for cross-modal transfer as visual performance rose above chance level (62). Our
results demonstrate that during visual face recognition, participants have access to information
learned during haptic exploration allowing them to perhaps form a visual image from haptic
information. In Experiment 4, we interchanged learning and recognition modality with respect
to Experiments 2+3, testing within-modality recognition in the visual domain and cross-modal
transfer by haptic recognition of the face masks. Using the same experimental design as in
Experiment 2, we found that performance in the visual within-modality condition increased
significantly to 89 and that it became more consistent across blocks (71 compared to 39
for Experiment 2). However, recognition accuracy decreased across blocks (from 96 to 87).
Interestingly, cross-modal performance was significantly higher than in Experiments 2 (at 69)
demonstrating a clear advantage in cross-modal transfer for vision as the learning modality. The
reasons for the observed differences in cross-modal transfer remain to be investigated. Possible
factors include differences in visual versus haptic memory permanence, vision as the dominant
and therefore preferred learning modality, and finally the role of visual imagery in cross-modal
transfer.

Details

show
hide
Language(s):
 Dates: 2007-07
 Publication Status: Issued
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: BibTex Citekey: 4716
 Degree: -

Event

show
hide
Title: 10th Tübinger Wahrnehmungskonferenz (TWK 2007)
Place of Event: Tübingen, Germany
Start-/End Date: 2007-07-27 - 2007-07-29

Legal Case

show

Project information

show

Source 1

show
hide
Title: 10th Tübinger Perception Conference: TWK 2007
Source Genre: Proceedings
 Creator(s):
Bülthoff, HH1, Editor           
Chatziastros, A1, Editor           
Mallot, HA, Editor           
Ulrich, R, Editor
Affiliations:
1 Department Human Perception, Cognition and Action, Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_1497797            
Publ. Info: Kirchentellinsfurt, Germany : Knirsch
Pages: - Volume / Issue: - Sequence Number: - Start / End Page: 66 Identifier: ISBN: 3-927091-77-4