WO2007044815A3 - Generation of normalized 2d imagery and id systems via 2d to 3d lifting of multifeatured objects - Google Patents

Generation of normalized 2d imagery and id systems via 2d to 3d lifting of multifeatured objects Download PDF

Info

Publication number
WO2007044815A3
WO2007044815A3 PCT/US2006/039737 US2006039737W WO2007044815A3 WO 2007044815 A3 WO2007044815 A3 WO 2007044815A3 US 2006039737 W US2006039737 W US 2006039737W WO 2007044815 A3 WO2007044815 A3 WO 2007044815A3
Authority
WO
WIPO (PCT)
Prior art keywords
normalized
imagery
lifting
generation
avatar
Prior art date
Application number
PCT/US2006/039737
Other languages
French (fr)
Other versions
WO2007044815A2 (en
Inventor
Michael I Miller
Original Assignee
Animetrics Inc
Michael I Miller
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Animetrics Inc, Michael I Miller filed Critical Animetrics Inc
Publication of WO2007044815A2 publication Critical patent/WO2007044815A2/en
Publication of WO2007044815A3 publication Critical patent/WO2007044815A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional objects
    • G06V20/653—Three-dimensional objects by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional objects
    • G06V20/647—Three-dimensional objects by matching two-dimensional images to three-dimensional objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/162—Detection; Localisation; Normalisation using pixel segmentation or colour matching

Abstract

Image acquisition system (202) captures target image (402) and generates (206) best-fitting avatar (404) using the methods described above. Best-fitting avatar is geometrically normalized by backing out deformations corresponding to non-intrinsic and non-permanent features of the target head (406). The geometrically normalized avatar is lit with normal lighting (406), and projected into an image plane corresponding to a normal pose, such as a face-on view. The resulting image (408) is geometrically normalized with respect to shape (expressions and temporary surface alterations) and pose, as well as photometrically normalized with respect to lighting.
PCT/US2006/039737 2005-10-11 2006-10-11 Generation of normalized 2d imagery and id systems via 2d to 3d lifting of multifeatured objects WO2007044815A2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US72525105P 2005-10-11 2005-10-11
US60/725,251 2005-10-11
US11/482,242 US20070080967A1 (en) 2005-10-11 2006-06-29 Generation of normalized 2D imagery and ID systems via 2D to 3D lifting of multifeatured objects
US11/482,242 2006-06-29

Publications (2)

Publication Number Publication Date
WO2007044815A2 WO2007044815A2 (en) 2007-04-19
WO2007044815A3 true WO2007044815A3 (en) 2009-04-16

Family

ID=37910687

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/039737 WO2007044815A2 (en) 2005-10-11 2006-10-11 Generation of normalized 2d imagery and id systems via 2d to 3d lifting of multifeatured objects

Country Status (2)

Country Link
US (2) US20070080967A1 (en)
WO (1) WO2007044815A2 (en)

Families Citing this family (78)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007098579A1 (en) * 2006-02-28 2007-09-07 National Research Council Of Canada Method and system for locating landmarks on 3d models
JP4585471B2 (en) * 2006-03-07 2010-11-24 株式会社東芝 Feature point detection apparatus and method
CA2668941C (en) * 2006-11-17 2015-12-29 Thomson Licensing System and method for model fitting and registration of objects for 2d-to-3d conversion
US20080212835A1 (en) * 2007-03-01 2008-09-04 Amon Tavor Object Tracking by 3-Dimensional Modeling
JP4337064B2 (en) * 2007-04-04 2009-09-30 ソニー株式会社 Information processing apparatus, information processing method, and program
GB0707921D0 (en) * 2007-04-24 2007-05-30 Renishaw Plc Apparatus and method for surface measurement
CN101441781B (en) * 2007-11-23 2011-02-02 鸿富锦精密工业（深圳）有限公司 Curved surface overturning method
US8131063B2 (en) 2008-07-16 2012-03-06 Seiko Epson Corporation Model-based object image processing
US9223469B2 (en) * 2008-08-22 2015-12-29 Intellectual Ventures Fund 83 Llc Configuring a virtual world user-interface
WO2010049693A2 (en) * 2008-10-29 2010-05-06 Renishaw Plc Measurement method
US8260038B2 (en) 2009-02-25 2012-09-04 Seiko Epson Corporation Subdivision weighting for robust object model fitting
US8208717B2 (en) 2009-02-25 2012-06-26 Seiko Epson Corporation Combining subcomponent models for object image modeling
US8204301B2 (en) 2009-02-25 2012-06-19 Seiko Epson Corporation Iterative data reweighting for balanced model learning
US8260039B2 (en) 2009-02-25 2012-09-04 Seiko Epson Corporation Object model fitting using manifold constraints
US20110025689A1 (en) * 2009-07-29 2011-02-03 Microsoft Corporation Auto-Generating A Visual Representation
ES2353099B1 (en) * 2009-07-30 2012-01-02 Fundacion Para Progreso Soft Computing METHOD AND FORENSIC IDENTIFICATION SYSTEM BY SOFT COMPUTING BASED CRANEOFACIAL SUPERPOSITION.
JP5423379B2 (en) * 2009-08-31 2014-02-19 ソニー株式会社 Image processing apparatus, image processing method, and program
JP2011090466A (en) * 2009-10-21 2011-05-06 Sony Corp Information processing apparatus, method, and program
US9244533B2 (en) * 2009-12-17 2016-01-26 Microsoft Technology Licensing, Llc Camera navigation for presentations
KR20110070056A (en) * 2009-12-18 2011-06-24 한국전자통신연구원 Method and apparatus for easy and intuitive generation of user-customized 3d avatar with high-quality
KR20110071213A (en) * 2009-12-21 2011-06-29 한국전자통신연구원 Apparatus and method for 3d face avatar reconstruction using stereo vision and face detection unit
US20110237980A1 (en) * 2010-03-29 2011-09-29 Cranial Technologies, Inc. Assessment and classification system
US8570343B2 (en) * 2010-04-20 2013-10-29 Dassault Systemes Automatic generation of 3D models from packaged goods product images
USRE49044E1 (en) 2010-06-01 2022-04-19 Apple Inc. Automatic avatar creation
US9053562B1 (en) * 2010-06-24 2015-06-09 Gregory S. Rabin Two dimensional to three dimensional moving image converter
US9132352B1 (en) 2010-06-24 2015-09-15 Gregory S. Rabin Interactive system and method for rendering an object
US9454823B2 (en) * 2010-07-28 2016-09-27 arian Medical Systems, Inc. Knowledge-based automatic image segmentation
US20130130797A1 (en) * 2010-08-24 2013-05-23 Janos Stone Systems and methods for transforming and/or generating a tangible physical structure based on user input information
US8442288B2 (en) * 2010-11-08 2013-05-14 Cranial Technologies, Inc. Method and apparatus for processing three-dimensional digital mesh image representative data of three-dimensional subjects
US8494237B2 (en) * 2010-11-08 2013-07-23 Cranial Technologies, Inc Method and apparatus for processing digital image representations of a head shape
US8711210B2 (en) 2010-12-14 2014-04-29 Raytheon Company Facial recognition using a sphericity metric
WO2012082077A2 (en) * 2010-12-17 2012-06-21 Agency For Science, Technology And Research Pose-independent 3d face reconstruction from a sample 2d face image
US9165404B2 (en) * 2011-07-14 2015-10-20 Samsung Electronics Co., Ltd. Method, apparatus, and system for processing virtual world
US10013787B2 (en) * 2011-12-12 2018-07-03 Faceshift Ag Method for facial animation
US9671566B2 (en) 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
US9852512B2 (en) 2013-03-13 2017-12-26 Electronic Scripting Products, Inc. Reduced homography based on structural redundancy of conditioned motion
US8970709B2 (en) 2013-03-13 2015-03-03 Electronic Scripting Products, Inc. Reduced homography for recovery of pose parameters of an optical apparatus producing image data with structural uncertainty
WO2015006784A2 (en) 2013-07-12 2015-01-15 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
US10533850B2 (en) 2013-07-12 2020-01-14 Magic Leap, Inc. Method and system for inserting recognized object data into a virtual world
CN103729510B (en) * 2013-12-25 2016-09-14 合肥工业大学 Based on the interior 3 D complex model exact mirror image symmetry computational methods accumulateing conversion
US10203762B2 (en) 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
US9699123B2 (en) 2014-04-01 2017-07-04 Ditto Technologies, Inc. Methods, systems, and non-transitory machine-readable medium for incorporating a series of images resident on a user device into an existing web browser session
US10852838B2 (en) 2014-06-14 2020-12-01 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
EP4206870A1 (en) * 2014-06-14 2023-07-05 Magic Leap, Inc. Method for updating a virtual world
US9589178B2 (en) * 2014-09-12 2017-03-07 Htc Corporation Image processing with facial features
CN104463969B (en) * 2014-12-09 2017-09-26 广西界围信息科技有限公司 A kind of method for building up of the model of geographical photo to aviation tilt
RU2582852C1 (en) * 2015-01-21 2016-04-27 Общество с ограниченной ответственностью "Вокорд СофтЛаб" (ООО "Вокорд СофтЛаб") Automatic construction of 3d model of face based on series of 2d images or movie
CN106033621B (en) 2015-03-17 2018-08-24 阿里巴巴集团控股有限公司 A kind of method and device of three-dimensional modeling
JP6754619B2 (en) * 2015-06-24 2020-09-16 三星電子株式会社Ｓａｍｓｕｎｇ Ｅｌｅｃｔｒｏｎｉｃｓ Ｃｏ．，Ｌｔｄ． Face recognition method and device
KR20170000748A (en) 2015-06-24 2017-01-03 삼성전자주식회사 Method and apparatus for face recognition
EP3433818A1 (en) 2016-03-21 2019-01-30 The Procter and Gamble Company Systems and methods for providing customized product recommendations
US11577159B2 (en) 2016-05-26 2023-02-14 Electronic Scripting Products Inc. Realistic virtual/augmented/mixed reality viewing and interactions
US9875398B1 (en) 2016-06-30 2018-01-23 The United States Of America As Represented By The Secretary Of The Army System and method for face recognition with two-dimensional sensing modality
US10452896B1 (en) * 2016-09-06 2019-10-22 Apple Inc. Technique for creating avatar from image data
US10483004B2 (en) * 2016-09-29 2019-11-19 Disney Enterprises, Inc. Model-based teeth reconstruction
US10586379B2 (en) * 2017-03-08 2020-03-10 Ebay Inc. Integration of 3D models
US20180268614A1 (en) * 2017-03-16 2018-09-20 General Electric Company Systems and methods for aligning pmi object on a model
US10621771B2 (en) 2017-03-21 2020-04-14 The Procter & Gamble Company Methods for age appearance simulation
US10614623B2 (en) 2017-03-21 2020-04-07 Canfield Scientific, Incorporated Methods and apparatuses for age appearance simulation
US10977509B2 (en) * 2017-03-27 2021-04-13 Samsung Electronics Co., Ltd. Image processing method and apparatus for object detection
KR101908851B1 (en) * 2017-04-14 2018-10-17 한국 한의학 연구원 Apparatus and method for correcting facial posture
WO2018222808A1 (en) 2017-05-31 2018-12-06 The Procter & Gamble Company Systems and methods for determining apparent skin age
KR102339915B1 (en) 2017-05-31 2021-12-17 더 프록터 앤드 갬블 캄파니 Systems and methods for guiding a user to take a selfie
CN109145684B (en) * 2017-06-19 2022-02-18 西南科技大学 Head state monitoring method based on region best matching feature points
CN107978010B (en) * 2017-11-27 2021-03-05 浙江工商大学 Staged precise shape matching method
CN108366250B (en) * 2018-02-06 2020-03-17 深圳市鹰硕技术有限公司 Image display system, method and digital glasses
US11508107B2 (en) 2018-02-26 2022-11-22 Didimo, Inc. Additional developments to the automatic rig creation process
US10796468B2 (en) 2018-02-26 2020-10-06 Didimo, Inc. Automatic rig creation process
US11741650B2 (en) 2018-03-06 2023-08-29 Didimo, Inc. Advanced electronic messaging utilizing animatable 3D models
WO2019173108A1 (en) * 2018-03-06 2019-09-12 Didimo, Inc. Electronic messaging utilizing animatable 3d models
US11727656B2 (en) 2018-06-12 2023-08-15 Ebay Inc. Reconstruction of 3D model with immersive experience
US11049310B2 (en) * 2019-01-18 2021-06-29 Snap Inc. Photorealistic real-time portrait animation
CN110032927A (en) * 2019-02-27 2019-07-19 视缘(上海)智能科技有限公司 A kind of face identification method
CN110111246B (en) * 2019-05-15 2022-02-25 北京市商汤科技开发有限公司 Virtual head portrait generation method and device and storage medium
US11645800B2 (en) 2019-08-29 2023-05-09 Didimo, Inc. Advanced systems and methods for automatically generating an animatable object from various types of user input
US11182945B2 (en) 2019-08-29 2021-11-23 Didimo, Inc. Automatically generating an animatable object from various types of user input
CN110728668B (en) * 2019-10-09 2022-06-28 中国科学院光电技术研究所 Airspace high-pass filter for maintaining small target form
US11417011B2 (en) * 2020-02-11 2022-08-16 Nvidia Corporation 3D human body pose estimation using a model trained from unlabeled multi-view data

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1139269A2 (en) * 2000-03-30 2001-10-04 Nec Corporation Method for matching a two-dimensional image to one of a plurality of three-dimensional candidate models contained in a database
US20020012454A1 (en) * 2000-03-09 2002-01-31 Zicheng Liu Rapid computer modeling of faces for animation
US6556196B1 (en) * 1999-03-19 2003-04-29 Max-Planck-Gesellschaft Zur Forderung Der Wissenschaften E.V. Method and apparatus for the processing of images
US6940545B1 (en) * 2000-02-28 2005-09-06 Eastman Kodak Company Face detecting camera and method

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5742291A (en) * 1995-05-09 1998-04-21 Synthonics Incorporated Method and apparatus for creation of three-dimensional wire frames
US5844573A (en) * 1995-06-07 1998-12-01 Massachusetts Institute Of Technology Image compression by pointwise prototype correspondence using shape and texture information
US6226418B1 (en) * 1997-11-07 2001-05-01 Washington University Rapid convolution based large deformation image matching via landmark and volume imagery
US5990901A (en) * 1997-06-27 1999-11-23 Microsoft Corporation Model based image editing and correction
WO1999015945A2 (en) * 1997-09-23 1999-04-01 Enroute, Inc. Generating three-dimensional models of objects defined by two-dimensional image data
US6249600B1 (en) * 1997-11-07 2001-06-19 The Trustees Of Columbia University In The City Of New York System and method for generation of a three-dimensional solid model
WO1999027838A2 (en) * 1997-12-01 1999-06-10 Eraslan Arsev H Three-dimensional face identification system
US6362833B2 (en) * 1998-04-08 2002-03-26 Intel Corporation Method and apparatus for progressively constructing a series of morphs between two-dimensional or three-dimensional models
IT1315446B1 (en) * 1998-10-02 2003-02-11 Cselt Centro Studi Lab Telecom PROCEDURE FOR THE CREATION OF THREE-DIMENSIONAL FACIAL MODELS TO START FROM FACE IMAGES.
JP4025442B2 (en) * 1998-12-01 2007-12-19 富士通株式会社 3D model conversion apparatus and method
JP3575679B2 (en) * 2000-03-31 2004-10-13 日本電気株式会社 Face matching method, recording medium storing the matching method, and face matching device
US6975750B2 (en) * 2000-12-01 2005-12-13 Microsoft Corp. System and method for face recognition using synthesized training images
GB2383915B (en) * 2001-11-23 2005-09-28 Canon Kk Method and apparatus for generating models of individuals
US7221809B2 (en) * 2001-12-17 2007-05-22 Genex Technologies, Inc. Face recognition system and method
AU2003219926A1 (en) * 2002-02-26 2003-09-09 Canesta, Inc. Method and apparatus for recognizing objects
KR100528330B1 (en) * 2003-02-19 2005-11-16 삼성전자주식회사 Method for coating surface of inorganic powder and coated inorganic powder manufactured using the same
WO2004081853A1 (en) * 2003-03-06 2004-09-23 Animetrics, Inc. Viewpoint-invariant image matching and generation of three-dimensional models from two-dimensional imagery

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6556196B1 (en) * 1999-03-19 2003-04-29 Max-Planck-Gesellschaft Zur Forderung Der Wissenschaften E.V. Method and apparatus for the processing of images
US6940545B1 (en) * 2000-02-28 2005-09-06 Eastman Kodak Company Face detecting camera and method
US20020012454A1 (en) * 2000-03-09 2002-01-31 Zicheng Liu Rapid computer modeling of faces for animation
EP1139269A2 (en) * 2000-03-30 2001-10-04 Nec Corporation Method for matching a two-dimensional image to one of a plurality of three-dimensional candidate models contained in a database

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"2000, In Proceedings of the Intemational Conference on Image Processing", article ZHAO ET AL.: "3D Model Enhanced Faced Recognition", pages: 50 - 53 *

Also Published As

Publication number Publication date
US20100149177A1 (en) 2010-06-17
US20070080967A1 (en) 2007-04-12
WO2007044815A2 (en) 2007-04-19

Similar Documents

Publication Publication Date Title
WO2007044815A3 (en) Generation of normalized 2d imagery and id systems via 2d to 3d lifting of multifeatured objects
WO2005010825A3 (en) Method and sytem for the three-dimensional surface reconstruction of an object
WO2007096893A3 (en) Range mapping using speckle decorrelation
ES2564807T3 (en) Process for preparation of pure amorphous calcium rosuvastatin
WO2003087991A3 (en) System and method for authentication of a workpiece using three dimensional shape recovery
WO2014048571A8 (en) High resolution microscopy by means of structured illumination at large working distances
EP1304264A3 (en) A 360 degree vision system for a vehicle
CN103512636B (en) A kind of water detection method based on laser scanning
FR2925706B1 (en) DEVICE FOR EVALUATING THE SURFACE OF A TIRE.
EP1992980A3 (en) Reflective image display system
WO2009075330A1 (en) Measuring method, inspecting method, measuring apparatus and inspecting apparatus
EP1729260A3 (en) Behaviour detection
WO2011071623A3 (en) Accelerating bitmap remoting by identifying and extracting 2d patterns from source bitmaps
WO2008010987A3 (en) Memorial cross
CN204329903U (en) Hand-held laser three-dimensional scanning equipment
CN106493731B (en) A method of it realizing that brake disc is torn open using robot 3D vision and stamps
CN109859235A (en) A kind of night mobile car light tracing detection system, method and apparatus
CN211969992U (en) Steel bar marking device based on three-dimensional data acquisition system
CN104121986A (en) Urban light-pollution monitoring device and method based on unmanned aerial vehicle
MX2007012783A (en) Systems and methods of identifying and manipulating objects.
CN205261380U (en) Domestic ceiling lamp
WO2012038321A3 (en) Method and apparatus for detecting and/or assessing three-dimensional elevated structures on a surface of a document
CN204248725U (en) A kind of auxiliary installation device of air throttle of gas machine
CN206021218U (en) A kind of anti-beat Multifunctional computer mouse roller
CN105005065A (en) Fire point positioning method of forest fireproof mobile intelligent terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06816720

Country of ref document: EP

Kind code of ref document: A2