CA2284032A1 - Real-time method of digitally altering a video data stream to remove portions of the original image and substitute elements to create a new image - Google Patents

Real-time method of digitally altering a video data stream to remove portions of the original image and substitute elements to create a new image Download PDF

Info

Publication number
CA2284032A1
CA2284032A1 CA002284032A CA2284032A CA2284032A1 CA 2284032 A1 CA2284032 A1 CA 2284032A1 CA 002284032 A CA002284032 A CA 002284032A CA 2284032 A CA2284032 A CA 2284032A CA 2284032 A1 CA2284032 A1 CA 2284032A1
Authority
CA
Canada
Prior art keywords
real
image
data stream
video data
background
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002284032A
Other languages
French (fr)
Other versions
CA2284032C (en
Inventor
Michael D. Steffano
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Metaphor Group
Original Assignee
Michael D. Steffano
The Metaphor Group
Viewics Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=25229445&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=CA2284032(A1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Michael D. Steffano, The Metaphor Group, Viewics Corporation filed Critical Michael D. Steffano
Publication of CA2284032A1 publication Critical patent/CA2284032A1/en
Application granted granted Critical
Publication of CA2284032C publication Critical patent/CA2284032C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs

Abstract

A method that allows the real-time replacement of the designated background portion (54) of an incoming video signal with an alternate background (72).
The method utilizes the actual background image for reference (48) as the basis for determining the background and foreground elements within the image with the end result being comparable to traditional blue-screen processes, such as chroma-key and ultimatte technology, but requiring only a personal computer, video camera and the software. In this case, however, the reference background image can be any reasonably static scene with a sufficient and stable light source captured by the camera. The video data stream is modified in real-time by comparisons against the reference background image and is then passed onto its original destination. Multiple signal-noise processing algorithms are applied in real-time against the signal to achieve a visually acceptable matte.
CA002284032A 1997-03-18 1998-03-11 Real-time method of digitally altering a video data stream to remove portions of the original image and substitute elements to create a new image Expired - Fee Related CA2284032C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US08/819,921 1997-03-18
US08/819,921 US5764306A (en) 1997-03-18 1997-03-18 Real-time method of digitally altering a video data stream to remove portions of the original image and substitute elements to create a new image
PCT/US1998/004698 WO1998042126A1 (en) 1997-03-18 1998-03-11 Real-time method of digitally altering a video data stream to remove portions of the original image and substitute elements to create a new image

Publications (2)

Publication Number Publication Date
CA2284032A1 true CA2284032A1 (en) 1998-09-24
CA2284032C CA2284032C (en) 2001-04-10

Family

ID=25229445

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002284032A Expired - Fee Related CA2284032C (en) 1997-03-18 1998-03-11 Real-time method of digitally altering a video data stream to remove portions of the original image and substitute elements to create a new image

Country Status (8)

Country Link
US (1) US5764306A (en)
EP (1) EP0970579A4 (en)
JP (1) JP2000513174A (en)
CN (1) CN1251235A (en)
AU (1) AU6457198A (en)
CA (1) CA2284032C (en)
TW (1) TW361043B (en)
WO (1) WO1998042126A1 (en)

Families Citing this family (81)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100423379B1 (en) * 1995-05-12 2004-07-23 소니 가부시끼 가이샤 Key signal generating device, picture producing device, key signal generating method, and picture producing method
US6301382B1 (en) * 1996-06-07 2001-10-09 Microsoft Corporation Extracting a matte of a foreground object from multiple backgrounds by triangulation
US6011595A (en) * 1997-09-19 2000-01-04 Eastman Kodak Company Method for segmenting a digital image into a foreground region and a key color region
US7843510B1 (en) 1998-01-16 2010-11-30 Ecole Polytechnique Federale De Lausanne Method and system for combining video sequences with spatio-temporal alignment
US6122006A (en) * 1998-02-03 2000-09-19 Eastman Kodak Company Method for previewing a scene before actual capture by a motion-picture camera
US6134345A (en) * 1998-08-28 2000-10-17 Ultimatte Corporation Comprehensive method for removing from an image the background surrounding a selected subject
US6674485B2 (en) * 1998-08-31 2004-01-06 Hitachi Software Engineering Co., Ltd. Apparatus and method for image compositing
US6909874B2 (en) * 2000-04-12 2005-06-21 Thomson Licensing Sa. Interactive tutorial method, system, and computer program product for real time media production
US6952221B1 (en) 1998-12-18 2005-10-04 Thomson Licensing S.A. System and method for real time video production and distribution
US6760916B2 (en) * 2000-01-14 2004-07-06 Parkervision, Inc. Method, system and computer program product for producing and distributing enhanced media downstreams
US6452612B1 (en) * 1998-12-18 2002-09-17 Parkervision, Inc. Real time video production system and method
US20030001880A1 (en) * 2001-04-18 2003-01-02 Parkervision, Inc. Method, system, and computer program product for producing and distributing enhanced media
US20030214605A1 (en) * 1998-12-18 2003-11-20 Snyder Robert J. Autokeying method, system, and computer program product
US20040027368A1 (en) * 2002-05-09 2004-02-12 Parkervision, Inc. Time sheet for real time video production system and method
US7835920B2 (en) * 1998-12-18 2010-11-16 Thomson Licensing Director interface for production automation control
US11109114B2 (en) * 2001-04-18 2021-08-31 Grass Valley Canada Advertisement management method, system, and computer program product
US8560951B1 (en) 1998-12-18 2013-10-15 Thomson Licensing System and method for real time video production and distribution
US9123380B2 (en) 1998-12-18 2015-09-01 Gvbb Holdings S.A.R.L. Systems, methods, and computer program products for automated real-time execution of live inserts of repurposed stored content distribution, and multiple aspect ratio automated simulcast production
US7024677B1 (en) 1998-12-18 2006-04-04 Thomson Licensing System and method for real time video production and multicasting
US6950130B1 (en) * 1999-01-05 2005-09-27 Sharp Laboratories Of America, Inc. Method of image background replacement
US6892353B1 (en) * 1999-04-02 2005-05-10 Apple Computer, Inc. Edit to tape
US6671419B1 (en) 1999-07-02 2003-12-30 Intel Corporation Method for reducing shadows and/or noise in a digital image
US6771834B1 (en) 1999-07-02 2004-08-03 Intel Corporation Method for segmenting a digital image
JP2001036801A (en) * 1999-07-23 2001-02-09 Sharp Corp Image pickup device
US6798897B1 (en) * 1999-09-05 2004-09-28 Protrack Ltd. Real time image registration, motion detection and background replacement using discrete local motion estimation
US20060244839A1 (en) * 1999-11-10 2006-11-02 Logitech Europe S.A. Method and system for providing multi-media data from various sources to various client applications
US6870574B2 (en) * 2000-03-08 2005-03-22 Mitchell Kriegman Method and apparatus for enhanced puppetry or similar types of performances utilizing a virtual set
WO2001080186A1 (en) * 2000-04-14 2001-10-25 Orlean Holding N.V. An improved system and method for digitally editing a composite image
US8564661B2 (en) 2000-10-24 2013-10-22 Objectvideo, Inc. Video analytic rule detection system and method
US8711217B2 (en) 2000-10-24 2014-04-29 Objectvideo, Inc. Video surveillance system employing video primitives
US9892606B2 (en) 2001-11-15 2018-02-13 Avigilon Fortress Corporation Video surveillance system employing video primitives
AU2001215223A1 (en) * 2000-11-20 2002-05-27 Orlean Holding N.V. Improved two-image cropping system and method and the use thereof in the digitalprinting and surveillance field
CA2438739C (en) * 2001-02-16 2009-12-29 Imatte, Inc. Interactive teleconferencing display system
US7424175B2 (en) 2001-03-23 2008-09-09 Objectvideo, Inc. Video segmentation using statistical pixel modeling
US6625310B2 (en) * 2001-03-23 2003-09-23 Diamondback Vision, Inc. Video segmentation using statistical pixel modeling
US7184590B2 (en) * 2002-07-17 2007-02-27 Lockheed Martin Corporation Algorithm selector
US6999600B2 (en) * 2003-01-30 2006-02-14 Objectvideo, Inc. Video scene background maintenance using change detection and classification
CA2523680C (en) * 2003-05-02 2015-06-23 Allan Robert Staker Interactive system and method for video compositing
GB2402010B (en) * 2003-05-20 2006-07-19 British Broadcasting Corp Video processing
CN100375005C (en) * 2003-08-19 2008-03-12 皇家飞利浦电子股份有限公司 A visual content signal apparatus and a method of displaying a visual content signal thereof
KR20060002602A (en) * 2004-07-02 2006-01-09 엘지전자 주식회사 A method and a apparatus of transmitting alternated video signal for mobile phone
US7590290B2 (en) * 2004-07-21 2009-09-15 Canon Kabushiki Kaisha Fail safe image processing apparatus
US8606950B2 (en) * 2005-06-08 2013-12-10 Logitech Europe S.A. System and method for transparently processing multimedia data
CA2613998C (en) 2005-06-08 2016-01-05 Thomson Licensing Method, apparatus and system for alternate image/video insertion
JP2009533778A (en) * 2006-04-17 2009-09-17 オブジェクトビデオ インコーポレイテッド Video segmentation using statistical pixel modeling
US8098330B2 (en) * 2006-07-28 2012-01-17 International Business Machines Corporation Mapping of presentation material
TWI376930B (en) * 2006-09-04 2012-11-11 Via Tech Inc Scenario simulation system and method for a multimedia device
US7924306B2 (en) * 2006-09-15 2011-04-12 Hewlett-Packard Development Company, L.P. Videoconferencing with enhanced illusion of physical presence in a common space
US20080117333A1 (en) * 2006-11-17 2008-05-22 Disney Enterprises, Inc. Method, System And Computer Program Product For Video Insertion
US7834894B2 (en) * 2007-04-03 2010-11-16 Lifetouch Inc. Method and apparatus for background replacement in still photographs
US8264468B1 (en) 2007-06-19 2012-09-11 Imaging Systems Technology, Inc. Touch system for blue screen
US8330730B1 (en) 2007-09-04 2012-12-11 Imaging Systems Technology, Inc. Calibrating of interactive touch system for image compositing
WO2009036415A1 (en) * 2007-09-12 2009-03-19 Event Mall, Inc. System, apparatus, software and process for integrating video images
US8121409B2 (en) * 2008-02-26 2012-02-21 Cyberlink Corp. Method for handling static text and logos in stabilized images
WO2010002921A1 (en) * 2008-07-01 2010-01-07 Yoostar Entertainment Group, Inc. Interactive systems and methods for video compositing
CN101753851B (en) * 2008-12-17 2011-12-28 华为终端有限公司 Method for replacing background, method for synthesizing virtual scene, as well as relevant system and equipment
KR101016095B1 (en) * 2009-02-20 2011-02-17 성균관대학교산학협력단 Method and apparatus for detecting changes in background of images using binary images thereof and hough transform
US9165605B1 (en) 2009-09-11 2015-10-20 Lindsay Friedman System and method for personal floating video
CN102387311A (en) * 2010-09-02 2012-03-21 深圳Tcl新技术有限公司 Device for synthesizing video images and method for synthesizing video images
US9153031B2 (en) 2011-06-22 2015-10-06 Microsoft Technology Licensing, Llc Modifying video regions using mobile device input
US8917764B2 (en) 2011-08-08 2014-12-23 Ittiam Systems (P) Ltd System and method for virtualization of ambient environments in live video streaming
WO2014170886A1 (en) * 2013-04-17 2014-10-23 Digital Makeup Ltd System and method for online processing of video images in real time
US10332560B2 (en) 2013-05-06 2019-06-25 Noo Inc. Audio-video compositing and effects
CN103578124B (en) * 2013-11-07 2017-02-08 深圳市掌网科技股份有限公司 Method and device for switching digital painting and calligraphy backgrounds
KR102031874B1 (en) * 2014-06-10 2019-11-27 삼성전자주식회사 Electronic Device Using Composition Information of Picture and Shooting Method of Using the Same
US9792716B2 (en) * 2014-06-13 2017-10-17 Arcsoft Inc. Enhancing video chatting
US10924815B2 (en) * 2015-12-31 2021-02-16 Idomoo Ltd System and method for generating and updating video news edition
US10437875B2 (en) 2016-11-29 2019-10-08 International Business Machines Corporation Media affinity management system
CN106713942B (en) * 2016-12-27 2020-06-09 广州华多网络科技有限公司 Video processing method and device
US10812562B1 (en) * 2018-06-21 2020-10-20 Architecture Technology Corporation Bandwidth dependent media stream compression
US10862938B1 (en) * 2018-06-21 2020-12-08 Architecture Technology Corporation Bandwidth-dependent media stream compression
US11182618B2 (en) * 2018-09-04 2021-11-23 Pandoodle Corporation Method and system for dynamically analyzing, modifying, and distributing digital images and video
US10992979B2 (en) 2018-12-04 2021-04-27 International Business Machines Corporation Modification of electronic messaging spaces for enhanced presentation of content in a video broadcast
US10887582B2 (en) 2019-01-22 2021-01-05 Fyusion, Inc. Object damage aggregation
US10949978B2 (en) 2019-01-22 2021-03-16 Fyusion, Inc. Automatic background replacement for single-image and multi-view captures
US11783443B2 (en) 2019-01-22 2023-10-10 Fyusion, Inc. Extraction of standardized images from a single view or multi-view capture
US11176704B2 (en) 2019-01-22 2021-11-16 Fyusion, Inc. Object pose estimation in visual data
CN110490950B (en) * 2019-08-20 2021-07-13 腾讯科技（深圳）有限公司 Image sample generation method and device, computer equipment and storage medium
US11776142B2 (en) 2020-01-16 2023-10-03 Fyusion, Inc. Structuring visual data
US11562474B2 (en) 2020-01-16 2023-01-24 Fyusion, Inc. Mobile multi-camera multi-view capture
US11605151B2 (en) 2021-03-02 2023-03-14 Fyusion, Inc. Vehicle undercarriage imaging

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4160994A (en) * 1975-06-07 1979-07-10 Sonex International Corp. Luminance key amplifier
US4473842A (en) * 1981-07-06 1984-09-25 Tokyo Shibaura Denki Kabushiki Kaisha Apparatus and method for examining printed circuit board provided with electronic parts
PT77084B (en) * 1982-07-23 1986-01-27 British Telecomm Improvements relating to data transmission
US4568981A (en) * 1983-04-08 1986-02-04 Ampex Corporation Font recall system and method of operation
JPS60194696A (en) * 1984-03-15 1985-10-03 Toshiba Corp Digital chromakey device
US4646134A (en) * 1984-03-21 1987-02-24 Sony Corporation Apparatus for encoding image signal
CA1287161C (en) * 1984-09-17 1991-07-30 Akihiro Furukawa Apparatus for discriminating a moving region and a stationary region in a video signal
US4800432A (en) * 1986-10-24 1989-01-24 The Grass Valley Group, Inc. Video Difference key generator
JP2604371B2 (en) * 1987-04-30 1997-04-30 日本電気株式会社 Orthogonal transform coding device
EP0330455A3 (en) * 1988-02-22 1990-07-04 Kabushiki Kaisha Toshiba Image encoding apparatus
US4968132A (en) * 1989-05-24 1990-11-06 Bran Ferren Traveling matte extraction system
US5264837A (en) * 1991-10-31 1993-11-23 International Business Machines Corporation Video insertion processing system
US5249039A (en) * 1991-11-18 1993-09-28 The Grass Valley Group, Inc. Chroma key method and apparatus
GB2263038B (en) * 1991-12-30 1996-01-31 Apple Computer Apparatus for manipulating streams of data
US5469536A (en) * 1992-02-25 1995-11-21 Imageware Software, Inc. Image editing system including masking capability
US5345313A (en) * 1992-02-25 1994-09-06 Imageware Software, Inc Image editing system for taking a background and inserting part of an image therein
US5379129A (en) * 1992-05-08 1995-01-03 Apple Computer, Inc. Method for compositing a source and destination image using a mask image
SG44005A1 (en) * 1992-12-11 1997-11-14 Philips Electronics Nv System for combining multiple-format multiple-source video signals

Also Published As

Publication number Publication date
EP0970579A1 (en) 2000-01-12
CN1251235A (en) 2000-04-19
JP2000513174A (en) 2000-10-03
WO1998042126A1 (en) 1998-09-24
AU6457198A (en) 1998-10-12
TW361043B (en) 1999-06-11
EP0970579A4 (en) 2001-03-21
CA2284032C (en) 2001-04-10
US5764306A (en) 1998-06-09

Similar Documents

Publication Publication Date Title
CA2284032A1 (en) Real-time method of digitally altering a video data stream to remove portions of the original image and substitute elements to create a new image
ATE280978T1 (en) MOSAIC IMAGE PROCESSING SYSTEM
CA2201682A1 (en) Processing image data
EP1098526A3 (en) Video editing apparatus and method
EP0446647A3 (en) Digital color video camera with auto-focus, auto-exposure and auto-white balance, and an auto-exposure system therefor which compensates for abnormal lighting
EP0942608A3 (en) Video signal processor and color video camera
ES2079473T3 (en) AUTOMATIC IMAGE TAKING MACHINE.
EP1313326A3 (en) Video encoder, video decoder, video processor and methods thereof
CA2270189A1 (en) Digital camcorder apparatus with mpeg-2-compatible video compression
WO2003083773A3 (en) Imaging method and system
AU2950197A (en) Device and process for producing a composite picture
DE69522245T2 (en) TV camera with digital video signal processing circuit
CA2081711A1 (en) Video analysis system for editing a recorded or broadcast, televised program and its use for post-production techniques, especially multilingual post-production techniques
US4160994A (en) Luminance key amplifier
JPS54140828A (en) Luminance-color separation system
GB9204115D0 (en) Video image processing
EP0967805A3 (en) Digital video processing
CA2201681A1 (en) Processing image data
EP0403759A3 (en) Arrangement for obtaining pictoral effects in video apparatus
CA2442628A1 (en) Digital video processing method and apparatus thereof
EP1289270A3 (en) Method of making digital photograph
JPS5633252A (en) Photographing process for damaged cutting tool
WO2001078007A3 (en) Method for processing an image
SE9403479L (en) Close imaging of components
JPS5717291A (en) High level chroma killer system for color television camera

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed