English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
 
 
DownloadE-Mail
 DetailsSummary
  Learning-Based Facial Rearticulation Using Streams of 3D Scans

Bargmann, R., Blanz, V., & Seidel, H.-P. (2006). Learning-Based Facial Rearticulation Using Streams of 3D Scans. In The 14th Pacific Conference on Computer Graphics and Applications (pp. 232-241). Taipei, Taiwan: National Taiwan University.

Item is

 

show all hide all

Basic

show hide
Item Permalink: https://hdl.handle.net/11858/00-001M-0000-000F-2352-B Version Permalink: https://hdl.handle.net/11858/00-001M-0000-000F-2353-9
Genre: Conference Paper

Files

show Files
hide Files
:
bargmann_pg06.pdf (Any fulltext), 4MB
 
File Permalink:
-
Name:
bargmann_pg06.pdf
Description:
-
OA-Status:
Visibility:
Private
MIME-Type / Checksum:
application/pdf
Technical Metadata:
Copyright Date:
-
Copyright Info:
-
License:
-

Locators

show

Creators

show
hide
 Creators:
Bargmann, Robert1, Author           
Blanz, Volker1, Author           
Seidel, Hans-Peter1, Author           
Chen, Bing-Yu, Editor
Affiliations:
1Computer Graphics, MPI for Informatics, Max Planck Society, ou_40047              

Content

show
hide
Free keywords: -
 Abstract: In this paper, we present a new approach that generates synthetic mouth articulations from an audio file and that transfers them to different face meshes. It is based on learning articulations from a stream of 3D scans of a real person acquired by a structured light scanner at 40 three-dimensional frames per second. Correspondence between these scans over several speech sequences is established via optical flow. We propose a novel type of Principal Component Analysis that considers variances only in a sub-region of the face, while retaining the full dimensionality of the original vector space of sample scans. Audio is recorded at the same time, so the head scans can be synchronized with phoneme and viseme information for computing viseme clusters. Given a new audio sequence along with text data, we are able to quickly create in a fully automated fashion an animation synchronized with that new sentence by morphing between the visemes along a path in viseme-space. The methods described in the paper include an automated process for data analysis in streams of 3D scans, and a framework that connects the system to existing static face modeling technology for articulation transfer.

Details

show
hide
Language(s): eng - English
 Dates: 2007-03-052006
 Publication Status: Issued
 Pages: -
 Publishing info: Taipei, Taiwan : National Taiwan University
 Table of Contents: -
 Rev. Type: -
 Identifiers: eDoc: 314524
Other: Local-ID: C125675300671F7B-A5BB7F7B58C3D91FC125723A002F550A-Bargmann2005
 Degree: -

Event

show
hide
Title: Untitled Event
Place of Event: Taipei, Taiwan
Start-/End Date: 2006-10-11

Legal Case

show

Project information

show

Source 1

show
hide
Title: The 14th Pacific Conference on Computer Graphics and Applications
Source Genre: Proceedings
 Creator(s):
Affiliations:
Publ. Info: Taipei, Taiwan : National Taiwan University
Pages: - Volume / Issue: - Sequence Number: - Start / End Page: 232 - 241 Identifier: -