CA2284348A1 - A method of creating 3 d facial models starting from face images - Google Patents

A method of creating 3 d facial models starting from face images Download PDF

Info

Publication number
CA2284348A1
CA2284348A1 CA002284348A CA2284348A CA2284348A1 CA 2284348 A1 CA2284348 A1 CA 2284348A1 CA 002284348 A CA002284348 A CA 002284348A CA 2284348 A CA2284348 A CA 2284348A CA 2284348 A1 CA2284348 A1 CA 2284348A1
Authority
CA
Canada
Prior art keywords
model
creating
video
face images
facial
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002284348A
Other languages
French (fr)
Other versions
CA2284348C (en
Inventor
Gianluca Francini
Mauro Quaglia
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Telecom Italia SpA
Original Assignee
CSELT Centro Studi e Laboratori Telecomunicazioni SpA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by CSELT Centro Studi e Laboratori Telecomunicazioni SpA filed Critical CSELT Centro Studi e Laboratori Telecomunicazioni SpA
Publication of CA2284348A1 publication Critical patent/CA2284348A1/en
Application granted granted Critical
Publication of CA2284348C publication Critical patent/CA2284348C/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/001—Texturing; Colouring; Generation of texture or colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/04—Texture mapping
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/10—Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation

Abstract

The method allows the creation of 3-D facial models, which can be used, for instance, for the avatar implementation, video-communication applications, video games, video productions, and for the creation of advanced man-machine interfaces.
At least one image of a human face is provided together with a 3D facial model (M) having a vertex structure and comprising a number of surfaces chosen within the set formed by a face surface (V), surfaces of the right eye (OD) and left eye (OS), respectively, and surfaces of the upper teeth (DS) and lower teeth (DI), respectively.
Among the vertices of the structure of the model (M) and on such at least one face image, respective sets of homologous points are chosen. The model structure (M) is then modified in such a way that the above respective sets of homologous points are made to coincide.
CA002284348A 1998-10-02 1999-10-01 A method of creating 3 d facial models starting from face images Expired - Lifetime CA2284348C (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IT1998TO000828A IT1315446B1 (en) 1998-10-02 1998-10-02 PROCEDURE FOR THE CREATION OF THREE-DIMENSIONAL FACIAL MODELS TO START FROM FACE IMAGES.
ITT098A000828 1998-10-02

Publications (2)

Publication Number Publication Date
CA2284348A1 true CA2284348A1 (en) 2000-04-02
CA2284348C CA2284348C (en) 2006-06-06

Family

ID=11417076

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002284348A Expired - Lifetime CA2284348C (en) 1998-10-02 1999-10-01 A method of creating 3 d facial models starting from face images

Country Status (8)

Country Link
US (1) US6532011B1 (en)
EP (2) EP0991023B1 (en)
JP (1) JP3288353B2 (en)
AT (2) ATE504896T1 (en)
CA (1) CA2284348C (en)
DE (2) DE69922898T2 (en)
ES (2) ES2366243T3 (en)
IT (1) IT1315446B1 (en)

Families Citing this family (64)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6807290B2 (en) * 2000-03-09 2004-10-19 Microsoft Corporation Rapid computer modeling of faces for animation
DE10018143C5 (en) * 2000-04-12 2012-09-06 Oerlikon Trading Ag, Trübbach DLC layer system and method and apparatus for producing such a layer system
TW517210B (en) * 2000-08-31 2003-01-11 Bextech Inc A method for generating speaking expression variation without distortion in 2D picture using polygon computation
US7203648B1 (en) 2000-11-03 2007-04-10 At&T Corp. Method for sending multi-media messages with customized audio
US7035803B1 (en) 2000-11-03 2006-04-25 At&T Corp. Method for sending multi-media messages using customizable background images
US6976082B1 (en) 2000-11-03 2005-12-13 At&T Corp. System and method for receiving multi-media messages
US6963839B1 (en) * 2000-11-03 2005-11-08 At&T Corp. System and method of controlling sound in a multi-media communication application
US6990452B1 (en) 2000-11-03 2006-01-24 At&T Corp. Method for sending multi-media messages using emoticons
US7091976B1 (en) 2000-11-03 2006-08-15 At&T Corp. System and method of customizing animated entities for use in a multi-media communication application
US20080040227A1 (en) 2000-11-03 2008-02-14 At&T Corp. System and method of marketing using a multi-media communication system
US7020305B2 (en) * 2000-12-06 2006-03-28 Microsoft Corporation System and method providing improved head motion estimations for animation
JP4419320B2 (en) * 2000-12-25 2010-02-24 コニカミノルタホールディングス株式会社 3D shape data generator
KR100422471B1 (en) * 2001-02-08 2004-03-11 비쥬텍쓰리디(주) Apparatus and method for creation personal photo avatar
US20020154174A1 (en) * 2001-04-23 2002-10-24 Redlich Arthur Norman Method and system for providing a service in a photorealistic, 3-D environment
US9400921B2 (en) * 2001-05-09 2016-07-26 Intel Corporation Method and system using a data-driven model for monocular face tracking
SE519929C2 (en) * 2001-07-26 2003-04-29 Ericsson Telefon Ab L M Procedure, system and terminal for changing or updating during ongoing calls eg. avatars on other users' terminals in a mobile telecommunications system
GB2382289B (en) 2001-09-28 2005-07-06 Canon Kk Method and apparatus for generating models of individuals
US20030069732A1 (en) * 2001-10-09 2003-04-10 Eastman Kodak Company Method for creating a personalized animated storyteller for audibilizing content
US7671861B1 (en) * 2001-11-02 2010-03-02 At&T Intellectual Property Ii, L.P. Apparatus and method of customizing animated entities for use in a multi-media communication application
GB2389289B (en) * 2002-04-30 2005-09-14 Canon Kk Method and apparatus for generating models of individuals
CN1313979C (en) * 2002-05-03 2007-05-02 三星电子株式会社 Apparatus and method for generating 3-D cartoon
US7174033B2 (en) 2002-05-22 2007-02-06 A4Vision Methods and systems for detecting and recognizing an object based on 3D image data
US7257236B2 (en) 2002-05-22 2007-08-14 A4Vision Methods and systems for detecting and recognizing objects in a controlled wide area
JP4357155B2 (en) * 2002-05-28 2009-11-04 株式会社セガ Animation image generation program
ITTO20020724A1 (en) * 2002-08-14 2004-02-15 Telecom Italia Lab Spa PROCEDURE AND SYSTEM FOR THE TRANSMISSION OF MESSAGES TO
EP1431810A1 (en) * 2002-12-16 2004-06-23 Agfa-Gevaert AG Method for automatic determination of colour correction data for the reproduction or digital images
US20040152512A1 (en) * 2003-02-05 2004-08-05 Collodi David J. Video game with customizable character appearance
US20040157527A1 (en) * 2003-02-10 2004-08-12 Omar Ruupak Nanyamka Novelty articles for famous persons and method for making same
JP2006522411A (en) * 2003-03-06 2006-09-28 アニメトリックス，インク． Generating an image database of objects containing multiple features
US7643671B2 (en) * 2003-03-24 2010-01-05 Animetrics Inc. Facial recognition system and method
US7711155B1 (en) * 2003-04-14 2010-05-04 Videomining Corporation Method and system for enhancing three dimensional face modeling using demographic classification
US7421097B2 (en) * 2003-05-27 2008-09-02 Honeywell International Inc. Face identification verification using 3 dimensional modeling
US7388580B2 (en) * 2004-05-07 2008-06-17 Valve Corporation Generating eyes for a character in a virtual environment
US8139068B2 (en) * 2005-07-29 2012-03-20 Autodesk, Inc. Three-dimensional animation of soft tissue of characters using controls associated with a surface mesh
US20070080967A1 (en) * 2005-10-11 2007-04-12 Animetrics Inc. Generation of normalized 2D imagery and ID systems via 2D to 3D lifting of multifeatured objects
JP4760349B2 (en) * 2005-12-07 2011-08-31 ソニー株式会社 Image processing apparatus, image processing method, and program
US7567251B2 (en) * 2006-01-10 2009-07-28 Sony Corporation Techniques for creating facial animation using a face mesh
US8047915B2 (en) 2006-01-11 2011-11-01 Lyle Corporate Development, Inc. Character for computer game and method
US8059917B2 (en) * 2007-04-30 2011-11-15 Texas Instruments Incorporated 3-D modeling
US20080298643A1 (en) * 2007-05-30 2008-12-04 Lawther Joel S Composite person model from image collection
KR100940862B1 (en) * 2007-12-17 2010-02-09 한국전자통신연구원 Head motion tracking method for 3d facial model animation from a video stream
US8131063B2 (en) 2008-07-16 2012-03-06 Seiko Epson Corporation Model-based object image processing
US8029140B2 (en) 2008-09-18 2011-10-04 Disney Enterprises, Inc. Device to produce a floating image
US8042948B2 (en) * 2008-09-18 2011-10-25 Disney Enterprises, Inc. Apparatus that produces a three-dimensional image
US8208717B2 (en) 2009-02-25 2012-06-26 Seiko Epson Corporation Combining subcomponent models for object image modeling
US8260038B2 (en) 2009-02-25 2012-09-04 Seiko Epson Corporation Subdivision weighting for robust object model fitting
US8204301B2 (en) 2009-02-25 2012-06-19 Seiko Epson Corporation Iterative data reweighting for balanced model learning
US8260039B2 (en) 2009-02-25 2012-09-04 Seiko Epson Corporation Object model fitting using manifold constraints
KR101640458B1 (en) * 2009-06-25 2016-07-18 삼성전자주식회사 Display device and Computer-Readable Recording Medium
US20110025689A1 (en) * 2009-07-29 2011-02-03 Microsoft Corporation Auto-Generating A Visual Representation
PL2337327T3 (en) 2009-12-15 2014-04-30 Deutsche Telekom Ag Method and device for highlighting selected objects in image and video messages
US8884982B2 (en) 2009-12-15 2014-11-11 Deutsche Telekom Ag Method and apparatus for identifying speakers and emphasizing selected objects in picture and video messages
ES2464341T3 (en) 2009-12-15 2014-06-02 Deutsche Telekom Ag Procedure and device to highlight selected objects in picture and video messages
WO2012007795A1 (en) * 2010-07-16 2012-01-19 Sony Ericsson Mobile Communications Ab Three dimensional face modeling and sharing based on two dimensional images
CN102129706A (en) * 2011-03-10 2011-07-20 西北工业大学 Virtual human eye emotion expression simulation method
CN102902355B (en) * 2012-08-31 2015-12-02 中国科学院自动化研究所 The space interaction method of mobile device
GB2510201B (en) * 2013-01-29 2017-05-03 Toshiba Res Europe Ltd A computer generated head
US10708545B2 (en) 2018-01-17 2020-07-07 Duelight Llc System, method, and computer program for transmitting face models based on face data points
KR101783453B1 (en) * 2015-10-05 2017-09-29 (주)감성과학연구센터 Method and Apparatus for extracting information of facial movement based on Action Unit
KR20170081544A (en) * 2016-01-04 2017-07-12 한국전자통신연구원 Apparatus and method for restoring experience items
WO2019177870A1 (en) * 2018-03-15 2019-09-19 Magic Leap, Inc. Animating virtual avatar facial movements
US10607065B2 (en) * 2018-05-03 2020-03-31 Adobe Inc. Generation of parameterized avatars
CN108961369B (en) * 2018-07-11 2023-03-17 厦门黑镜科技有限公司 Method and device for generating 3D animation
US10817365B2 (en) 2018-11-09 2020-10-27 Adobe Inc. Anomaly detection for incremental application deployments

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1994023390A1 (en) * 1993-03-29 1994-10-13 Matsushita Electric Industrial Co., Ltd. Apparatus for identifying person
US6031539A (en) * 1997-03-10 2000-02-29 Digital Equipment Corporation Facial image method and apparatus for semi-automatically mapping a face on to a wireframe topology
US6154222A (en) * 1997-03-27 2000-11-28 At&T Corp Method for defining animation parameters for an animation definition interface

Also Published As

Publication number Publication date
DE69943344D1 (en) 2011-05-19
ITTO980828A1 (en) 2000-04-02
JP3288353B2 (en) 2002-06-04
EP0991023A3 (en) 2001-02-21
ATE286286T1 (en) 2005-01-15
EP0991023B1 (en) 2004-12-29
ATE504896T1 (en) 2011-04-15
IT1315446B1 (en) 2003-02-11
EP1424655A3 (en) 2006-08-30
EP1424655B1 (en) 2011-04-06
CA2284348C (en) 2006-06-06
ES2237010T3 (en) 2005-07-16
ES2366243T3 (en) 2011-10-18
DE69922898T2 (en) 2005-12-15
EP0991023A2 (en) 2000-04-05
US6532011B1 (en) 2003-03-11
JP2000113217A (en) 2000-04-21
EP1424655A2 (en) 2004-06-02
DE69922898D1 (en) 2005-02-03

Similar Documents

Publication Publication Date Title
CA2284348A1 (en) A method of creating 3 d facial models starting from face images
Lee et al. Head modeling from pictures and morphing in 3D with image metamorphosis based on triangulation
KR100327541B1 (en) 3D facial modeling system and modeling method
WO2002031775A3 (en) Method for three-dimensional facial animation
ATE335247T1 (en) METHOD AND SYSTEM FOR RECORDING AND REPRESENTING THREE-DIMENSIONAL GEOMETRY, COLOR AND SHADOWS OF ANIMATED OBJECTS
CN101968892A (en) Method for automatically adjusting three-dimensional face model according to one face picture
CA2121005A1 (en) Methods and apparatus for synthesizing a three-dimensional image signal and producing a two-dimensional visual display therefrom
EP3347876A1 (en) Device and method for generating a model of an object using superimposed image data in a virtual environment
EP1276076A3 (en) Method for representing three-dimensional scenes
WO2018162509A2 (en) Device and method for the representation of a spatial image of an object in a virtual environment
CN100552539C (en) A kind of act method for making of three-dimensional film image of encircling
MY105450A (en) Improvements in three-dimensional imagery.
CN101347680A (en) System for producing big head doll with pure man tridimensional head portrait and implementing method thereof
CN202171927U (en) Phantom imaging system
CN206237530U (en) Four sides holographic interaction system
CA2327779A1 (en) Display techniques for three-dimensional virtual reality
Ebihara et al. Real-time facial expression detection based on frequency domain transform
CN111369648A (en) Model and animation interaction method based on 3D technology
EP0867839A3 (en) Method for compositing an image of a real object with a virtual scene
CN110853147A (en) Three-dimensional face transformation method
CN106774869A (en) A kind of method for realizing virtual reality, device and virtual implementing helmet
Schwartz Computers and Appropriation Art: The Transformation of a Work or Idea for a New Creation
Luntraru et al. Harmonizing 2D and 3D in Modern Animation.
Song Research on the Application of Computer 3D Technology in the Creation of Films Adapted from Literary Works
Ebihara et al. Virtual Kabuki system.

Legal Events

Date Code Title Description
EEER Examination request
MKEX Expiry

Effective date: 20191001