WO2006127177A3 - A system and method for applying digital make-up in video conferencing - Google Patents

A system and method for applying digital make-up in video conferencing Download PDF

Info

Publication number
WO2006127177A3
WO2006127177A3 PCT/US2006/014268 US2006014268W WO2006127177A3 WO 2006127177 A3 WO2006127177 A3 WO 2006127177A3 US 2006014268 W US2006014268 W US 2006014268W WO 2006127177 A3 WO2006127177 A3 WO 2006127177A3
Authority
WO
WIPO (PCT)
Prior art keywords
make
participant
video conferencing
applying digital
face
Prior art date
Application number
PCT/US2006/014268
Other languages
French (fr)
Other versions
WO2006127177A2 (en
Inventor
He Li-Wei
Michael Cohen
Yong Rui
Shinichi Manaka
Original Assignee
Microsoft Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Corporation filed Critical Microsoft Corporation
Publication of WO2006127177A2 publication Critical patent/WO2006127177A2/en
Publication of WO2006127177A3 publication Critical patent/WO2006127177A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals

Abstract

A method of digitally adding the appearance of makeup to a videoconferencing participant. The system and method for applying digital make-up operates in a loop processing sequential video frames. For each input frame, there are typically three general steps: 1) Locating the face, eye and mouth regions; 2) Applying digital make-up to the face; and 3) Blending the make-up region with the rest of the face. In one embodiment, the background in the frame containing a video conferencing participant can also be modified so that other video conferencing participants cannot clearly see the background behind the participant in the image frame. In another embodiment, the video conferencing participant tries to make his or her own image look comical or altered. In yet another embodiment, a remote participant tries to make another look funny to the other participants.
PCT/US2006/014268 2005-05-25 2006-04-14 A system and method for applying digital make-up in video conferencing WO2006127177A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/137,252 2005-05-25
US11/137,252 US7612794B2 (en) 2005-05-25 2005-05-25 System and method for applying digital make-up in video conferencing

Publications (2)

Publication Number Publication Date
WO2006127177A2 WO2006127177A2 (en) 2006-11-30
WO2006127177A3 true WO2006127177A3 (en) 2009-09-17

Family

ID=37452538

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/014268 WO2006127177A2 (en) 2005-05-25 2006-04-14 A system and method for applying digital make-up in video conferencing

Country Status (2)

Country Link
US (1) US7612794B2 (en)
WO (1) WO2006127177A2 (en)

Families Citing this family (69)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7792970B2 (en) 2005-06-17 2010-09-07 Fotonation Vision Limited Method for establishing a paired connection between media devices
US7471846B2 (en) * 2003-06-26 2008-12-30 Fotonation Vision Limited Perfecting the effect of flash within an image acquisition devices using face detection
US8948468B2 (en) 2003-06-26 2015-02-03 Fotonation Limited Modification of viewing parameters for digital images using face detection information
US8494286B2 (en) 2008-02-05 2013-07-23 DigitalOptics Corporation Europe Limited Face detection in mid-shot digital images
US7440593B1 (en) 2003-06-26 2008-10-21 Fotonation Vision Limited Method of improving orientation and color balance of digital images using face detection information
US7844076B2 (en) 2003-06-26 2010-11-30 Fotonation Vision Limited Digital image processing using face detection and skin tone information
US7565030B2 (en) * 2003-06-26 2009-07-21 Fotonation Vision Limited Detecting orientation of digital images using face detection information
US7574016B2 (en) 2003-06-26 2009-08-11 Fotonation Vision Limited Digital image processing using face detection information
US7269292B2 (en) 2003-06-26 2007-09-11 Fotonation Vision Limited Digital image adjustable compression and resolution using face detection information
US8503800B2 (en) 2007-03-05 2013-08-06 DigitalOptics Corporation Europe Limited Illumination detection using classifier chains
KR101240261B1 (en) * 2006-02-07 2013-03-07 엘지전자 주식회사 The apparatus and method for image communication of mobile communication terminal
US7742624B2 (en) * 2006-04-25 2010-06-22 Motorola, Inc. Perspective improvement for image and video applications
EP2033142B1 (en) 2006-06-12 2011-01-26 Tessera Technologies Ireland Limited Advances in extending the aam techniques from grayscale to color images
US20080005269A1 (en) * 2006-06-29 2008-01-03 Knighton Mark S Method and apparatus to share high quality images in a teleconference
US7924306B2 (en) * 2006-09-15 2011-04-12 Hewlett-Packard Development Company, L.P. Videoconferencing with enhanced illusion of physical presence in a common space
FR2907569B1 (en) * 2006-10-24 2009-05-29 Jean Marc Robin METHOD AND DEVICE FOR VIRTUAL SIMULATION OF A VIDEO IMAGE SEQUENCE
US8055067B2 (en) 2007-01-18 2011-11-08 DigitalOptics Corporation Europe Limited Color segmentation
ATE472140T1 (en) 2007-02-28 2010-07-15 Fotonation Vision Ltd SEPARATION OF DIRECTIONAL ILLUMINATION VARIABILITY IN STATISTICAL FACIAL MODELING BASED ON TEXTURE SPACE DECOMPOSITIONS
US8144186B2 (en) * 2007-03-09 2012-03-27 Polycom, Inc. Appearance matching for videoconferencing
US7916971B2 (en) 2007-05-24 2011-03-29 Tessera Technologies Ireland Limited Image processing method and apparatus
KR20080103813A (en) * 2007-05-25 2008-11-28 삼성전자주식회사 Mobile communication terminal and method for video call thereof
US8253770B2 (en) * 2007-05-31 2012-08-28 Eastman Kodak Company Residential video communication system
JP2009031870A (en) * 2007-07-24 2009-02-12 Seiko Epson Corp Image processing for estimation of photographic object distance
US8279254B2 (en) * 2007-08-02 2012-10-02 Siemens Enterprise Communications Gmbh & Co. Kg Method and system for video conferencing in a virtual environment
US20090234716A1 (en) * 2008-03-17 2009-09-17 Photometria, Inc. Method of monetizing online personal beauty product selections
US7855737B2 (en) 2008-03-26 2010-12-21 Fotonation Ireland Limited Method of making a digital camera image of a scene including the camera user
CN101562682A (en) * 2008-04-14 2009-10-21 鸿富锦精密工业（深圳）有限公司 Video image processing system, server, user side and video image processing method thereof
US8311275B1 (en) 2008-06-10 2012-11-13 Mindmancer AB Selective viewing of a scene
CN106919911A (en) 2008-07-30 2017-07-04 快图有限公司 Modified using the automatic face and skin of face detection
US8194097B2 (en) * 2008-12-12 2012-06-05 Seiko Epson Corporation Virtual masking using rigid parametric modeling
US8570429B2 (en) * 2009-02-27 2013-10-29 Samsung Electronics Co., Ltd. Image processing method and apparatus and digital photographing apparatus using the same
US8379917B2 (en) 2009-10-02 2013-02-19 DigitalOptics Corporation Europe Limited Face recognition performance using additional image features
US8723912B2 (en) * 2010-07-06 2014-05-13 DigitalOptics Corporation Europe Limited Scene background blurring including face modeling
US8823739B2 (en) 2010-08-25 2014-09-02 International Business Machines Corporation Background replacement for videoconferencing
US20120236105A1 (en) 2011-03-14 2012-09-20 Motorola Mobility, Inc. Method and apparatus for morphing a user during a video call
US8767030B2 (en) * 2011-04-07 2014-07-01 Tara Chand Singhal System and method for a grooming mirror in a portable electronic device with a user-facing camera
KR20140099319A (en) 2011-12-04 2014-08-11 디지털 메이크업 엘티디 Digital makeup
CN103999096B (en) * 2011-12-16 2017-12-08 英特尔公司 Picture quality for the reduction of video data background area
US9154732B2 (en) 2012-04-09 2015-10-06 Futurewei Technologies, Inc. Visual conditioning for augmented-reality-assisted video conferencing
US9460462B1 (en) 2012-05-22 2016-10-04 Image Metrics Limited Monetization using video-based simulation of cosmetic products
US8737735B2 (en) * 2012-06-15 2014-05-27 At&T Intellectual Property I, L.P. System and method of bilateral image filtering
US8947491B2 (en) * 2012-06-28 2015-02-03 Microsoft Corporation Communication system
US8886953B1 (en) 2012-09-14 2014-11-11 Google Inc. Image processing
US9265458B2 (en) 2012-12-04 2016-02-23 Sync-Think, Inc. Application of smooth pursuit cognitive testing paradigms to clinical drug development
US9380976B2 (en) 2013-03-11 2016-07-05 Sync-Think, Inc. Optical neuroinformatics
US20140325396A1 (en) * 2013-04-30 2014-10-30 Vonage Network Llc Methods and systems for simultaneous display of multimedia during a video communication
EP2824913A1 (en) * 2013-07-09 2015-01-14 Alcatel Lucent A method for generating an immersive video of a plurality of persons
US10586570B2 (en) 2014-02-05 2020-03-10 Snap Inc. Real time video processing for changing proportions of an object in the video
CN104853134B (en) * 2014-02-13 2019-05-07 腾讯科技（深圳）有限公司 A kind of video communication method and device
JP6472183B2 (en) * 2014-07-28 2019-02-20 キヤノン株式会社 Image processing apparatus, control method thereof, and program
GB201419441D0 (en) 2014-10-31 2014-12-17 Microsoft Corp Modifying video call data
US10116901B2 (en) * 2015-03-18 2018-10-30 Avatar Merger Sub II, LLC Background modification in video conferencing
US9232189B2 (en) * 2015-03-18 2016-01-05 Avatar Merger Sub Ii, Llc. Background modification in video conferencing
CN106303361A (en) * 2015-06-11 2017-01-04 阿里巴巴集团控股有限公司 Image processing method, device, system and graphic process unit in video calling
CN107613199B (en) * 2016-06-02 2020-03-13 Oppo广东移动通信有限公司 Blurred photo generation method and device and mobile terminal
JP6731616B2 (en) * 2016-06-10 2020-07-29 パナソニックＩｐマネジメント株式会社 Virtual makeup device, virtual makeup method, and virtual makeup program
US11120495B2 (en) 2016-09-15 2021-09-14 GlamST LLC Generating virtual makeup products
US11315173B2 (en) * 2016-09-15 2022-04-26 GlamST LLC Applying virtual makeup products
JP7259838B2 (en) * 2018-03-13 2023-04-18 ソニーグループ株式会社 Information processing device, information processing method, and recording medium
US10719729B2 (en) 2018-06-06 2020-07-21 Perfect Corp. Systems and methods for generating skin tone profiles
US10922534B2 (en) * 2018-10-26 2021-02-16 At&T Intellectual Property I, L.P. Identifying and addressing offensive actions in visual communication sessions
US10498973B1 (en) 2018-10-26 2019-12-03 At&T Intellectual Property I, L.P. Physical object-based visual workspace configuration system
US20210358181A1 (en) * 2018-10-29 2021-11-18 Sony Group Corporation Display device and display control method
US10785421B2 (en) * 2018-12-08 2020-09-22 Fuji Xerox Co., Ltd. Systems and methods for implementing personal camera that adapts to its surroundings, both co-located and remote
EP3691277A1 (en) * 2019-01-30 2020-08-05 Ubimax GmbH Computer-implemented method and system of augmenting a video stream of an environment
US11350059B1 (en) * 2021-01-26 2022-05-31 Dell Products, Lp System and method for intelligent appearance monitoring management system for videoconferencing applications
CN115631124A (en) 2021-07-02 2023-01-20 祖玛视频通讯公司 Method for providing video appearance adjustment in video communication system
WO2023278809A1 (en) * 2021-07-02 2023-01-05 Zoom Video Communications, Inc. Providing video appearance adjustments within a video communication system
EP4170609A1 (en) 2021-10-21 2023-04-26 Koninklijke Philips N.V. Automated filter selection for altering a stream

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010037191A1 (en) * 2000-03-15 2001-11-01 Infiniteface Inc. Three-dimensional beauty simulation client-server system
US6526161B1 (en) * 1999-08-30 2003-02-25 Koninklijke Philips Electronics N.V. System and method for biometrics-based facial feature extraction
US20040218827A1 (en) * 2003-05-02 2004-11-04 Michael Cohen System and method for low bandwidth video streaming for face-to-face teleconferencing

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6278491B1 (en) * 1998-01-29 2001-08-21 Hewlett-Packard Company Apparatus and a method for automatically detecting and reducing red-eye in a digital image
CN1537300A (en) * 2000-12-22 2004-10-13 Communication system
US7039222B2 (en) * 2003-02-28 2006-05-02 Eastman Kodak Company Method and system for enhancing portrait images that are processed in a batch mode
MXPA06012546A (en) * 2004-04-30 2007-04-12 Worldgate Service Inc Adaptive video telephone system.
US7133048B2 (en) * 2004-06-30 2006-11-07 Mitsubishi Electric Research Laboratories, Inc. Variable multilinear models for facial synthesis
US7227567B1 (en) * 2004-09-14 2007-06-05 Avaya Technology Corp. Customizable background for video communications

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6526161B1 (en) * 1999-08-30 2003-02-25 Koninklijke Philips Electronics N.V. System and method for biometrics-based facial feature extraction
US20010037191A1 (en) * 2000-03-15 2001-11-01 Infiniteface Inc. Three-dimensional beauty simulation client-server system
US20040218827A1 (en) * 2003-05-02 2004-11-04 Michael Cohen System and method for low bandwidth video streaming for face-to-face teleconferencing

Also Published As

Publication number Publication date
WO2006127177A2 (en) 2006-11-30
US20060268101A1 (en) 2006-11-30
US7612794B2 (en) 2009-11-03

Similar Documents

Publication Publication Date Title
WO2006127177A3 (en) A system and method for applying digital make-up in video conferencing
US9392226B2 (en) Generating and rendering synthesized views with multiple video streams in telepresence video conference sessions
WO2004112290A3 (en) Receiving system for video conferencing system
WO2006116750A3 (en) Multi-participant conferencing
US20120206560A1 (en) Augmenting a video conference
US20090244257A1 (en) Virtual round-table videoconference
DE102015100911A1 (en) Improved communication between remote participants using advanced and virtual reality
WO2005013600A3 (en) Virtual conference room
WO2018141408A1 (en) IMPROVED METHOD AND SYSTEM FOR VIDEO CONFERENCES WITH HMDs
EP1381237A3 (en) Multi-participant conference system with controllable content and delivery via back-channel video interface
WO2007123960A3 (en) System and method for enhancing eye gaze in a telepresence system
WO2008033768A3 (en) Videoconferencing with enhanced illusion of physical presence in a common space
EP1091582A3 (en) Enhanced video programming apparatus and method providing a shared whiteboard
WO2020106932A1 (en) Systems and methods for scheduled video chat sessions
EP2759127A1 (en) Augmenting a video conference
US10674191B2 (en) Systems and methods to remotely synchronize digital data
US11558563B2 (en) Systems and methods for immersive scenes
FR2835385B1 (en) VIDEO-CONFERENCE SYSTEM FOR TELEWORK
CN108271058B (en) Video interaction method, user client, server and storage medium
TWI248021B (en) Method and system for correcting out-of-focus eyesight of attendant images in video conferencing
Gorzynski et al. The halo B2B studio
Kidane Concerning Violence: Nine Scenes from the Anti-Imperialistic Self-Defense
Maingard Framing South African national cinema and television
Mark et al. An experiment using life-size hdtv
Otsuka et al. A system for reconstructing multiparty conversation field based on augmented head motion by dynamic projection

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: RU

122 Ep: pct application non-entry in european phase

Ref document number: 06750334

Country of ref document: EP

Kind code of ref document: A2