WO2009024442A3 - Method for synchronizing media data streams - Google Patents

Method for synchronizing media data streams Download PDF

Info

Publication number
WO2009024442A3
WO2009024442A3 PCT/EP2008/060055 EP2008060055W WO2009024442A3 WO 2009024442 A3 WO2009024442 A3 WO 2009024442A3 EP 2008060055 W EP2008060055 W EP 2008060055W WO 2009024442 A3 WO2009024442 A3 WO 2009024442A3
Authority
WO
WIPO (PCT)
Prior art keywords
media data
data streams
synchronizing media
synchronizing
media
Prior art date
Application number
PCT/EP2008/060055
Other languages
German (de)
French (fr)
Other versions
WO2009024442A2 (en
Inventor
Perez Jesus Fernando Guitarte
Klaus Lukas
Original Assignee
Siemens Ag
Perez Jesus Fernando Guitarte
Klaus Lukas
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Ag, Perez Jesus Fernando Guitarte, Klaus Lukas filed Critical Siemens Ag
Publication of WO2009024442A2 publication Critical patent/WO2009024442A2/en
Publication of WO2009024442A3 publication Critical patent/WO2009024442A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341—Demultiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/24—Speech recognition using non-acoustical features
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368—Multiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/06—Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
    • G10L21/10—Transforming into visible information
    • G10L2021/105—Synthesis of the lips movements from speech, e.g. for talking heads

Abstract

The invention relates to a method and an apparatus for synchronizing media data streams (AU, VI) each comprising media data contents (A1, A2, V1, V2) of a predefined media class, wherein the data streams (AU, VI) are temporally synchronized on the basis of the media data contents (A1, A2, V1, V2).
PCT/EP2008/060055 2007-08-22 2008-07-31 Method for synchronizing media data streams WO2009024442A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102007039603.3 2007-08-22
DE102007039603A DE102007039603A1 (en) 2007-08-22 2007-08-22 Method for synchronizing media data streams

Publications (2)

Publication Number Publication Date
WO2009024442A2 WO2009024442A2 (en) 2009-02-26
WO2009024442A3 true WO2009024442A3 (en) 2009-04-23

Family

ID=40263335

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2008/060055 WO2009024442A2 (en) 2007-08-22 2008-07-31 Method for synchronizing media data streams

Country Status (2)

Country Link
DE (1) DE102007039603A1 (en)
WO (1) WO2009024442A2 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2955183B3 (en) * 2010-01-11 2012-01-13 Didier Calle METHOD FOR AUTOMATICALLY PROCESSING DIGITAL DATA FOR DOUBLING OR POST SYNCHRONIZATION OF VIDEOS
EP2814259A1 (en) * 2013-06-11 2014-12-17 Koninklijke KPN N.V. Method, system, capturing device and synchronization server for enabling synchronization of rendering of multiple content parts, using a reference rendering timeline
CN106067989B (en) * 2016-04-28 2022-05-17 江苏大学 Portrait voice video synchronous calibration device and method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0336032A1 (en) * 1988-04-07 1989-10-11 Research Triangle Institute Audio visual speech recognition
US5572261A (en) * 1995-06-07 1996-11-05 Cooper; J. Carl Automatic audio to video timing measurement device and method
WO2005099251A1 (en) * 2004-04-07 2005-10-20 Koninklijke Philips Electronics N.V. Video-audio synchronization
WO2006113409A2 (en) * 2005-04-13 2006-10-26 Pixel Instruments, Corp. Method, system, and program product for measuring audio video synchronization using lip and teeth charateristics

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100236974B1 (en) * 1996-12-13 2000-02-01 정선종 Sync. system between motion picture and text/voice converter
US7499104B2 (en) * 2003-05-16 2009-03-03 Pixel Instruments Corporation Method and apparatus for determining relative timing of image and associated information
US20050047664A1 (en) * 2003-08-27 2005-03-03 Nefian Ara Victor Identifying a speaker using markov models

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0336032A1 (en) * 1988-04-07 1989-10-11 Research Triangle Institute Audio visual speech recognition
US5572261A (en) * 1995-06-07 1996-11-05 Cooper; J. Carl Automatic audio to video timing measurement device and method
WO2005099251A1 (en) * 2004-04-07 2005-10-20 Koninklijke Philips Electronics N.V. Video-audio synchronization
WO2006113409A2 (en) * 2005-04-13 2006-10-26 Pixel Instruments, Corp. Method, system, and program product for measuring audio video synchronization using lip and teeth charateristics

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
POTAMIANOS G ET AL: "An image transform approach for HMM based automatic lipreading", IMAGE PROCESSING, 1998. ICIP 98. PROCEEDINGS. 1998 INTERNATIONAL CONFE RENCE ON CHICAGO, IL, USA 4-7 OCT. 1998, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, US, vol. 3, 4 October 1998 (1998-10-04), pages 173 - 177, XP010586875, ISBN: 978-0-8186-8821-8 *

Also Published As

Publication number Publication date
DE102007039603A1 (en) 2009-02-26
WO2009024442A2 (en) 2009-02-26

Similar Documents

Publication Publication Date Title
WO2009051426A3 (en) Sensory effect media generating and consuming method and apparatus thereof
WO2008023352A3 (en) Method and apparatus for generating a summary
WO2006078928A3 (en) System and method for creating variable quality images of a slide
EP1899865A4 (en) Method, system, apparatus&computer program product for enabling the pre-download of media objects
EP2370906A4 (en) System, method, and apparatus for providing telephony and digital media services
WO2007103037A3 (en) System and method for generating a separated signal
EP2179388A4 (en) Method, system and apparatus for electronic business suited for conventional retailing
EP2717540A4 (en) Method, apparatus, and system for transmitting media data based on over the top (ott)
WO2010039875A3 (en) Out-of-synchronization handling method and apparatus
EP2073429A4 (en) Data synchronous method, system and apparatus
EP1994681A4 (en) Method for transforming data, and method for transmitting and receiving data using the same
WO2010053537A3 (en) Multi-phase filter medium
WO2009047750A3 (en) System and method for synchronized video sharing
WO2007072255A3 (en) A device for and a method of processing an input data stream comprising a sequence of input frames
WO2010052514A3 (en) Systems and methods for utilizing ims data security mechanisms in a circuit switched network
EP3776176A4 (en) System and method for asynchronous, multiple clock domain data streams coalescing and resynchronization
WO2009148769A3 (en) Virtual media device
EP2211587A4 (en) Method, system, server and client for transmitting media stream data
EP4062647A4 (en) System and method for data stream synchronization
WO2010116028A3 (en) Method for controlling an electronic device using audio feedback
WO2009024442A3 (en) Method for synchronizing media data streams
WO2012099417A3 (en) Method and apparatus for transmitting a multimedia data packet using cross-layer optimization
WO2011059193A3 (en) Method of recording and replaying video data, and display device using the same
EP1883198A4 (en) Method and system for interacting with media servers based on the sip protocol
WO2008130963A3 (en) Interworking between h.320/h.324 and sip

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08786680

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 08786680

Country of ref document: EP

Kind code of ref document: A2