EP1204277A3 - Subliminally embedded keys in video for synchronization - Google Patents

Subliminally embedded keys in video for synchronization Download PDF

Info

Publication number
EP1204277A3
EP1204277A3 EP01308791A EP01308791A EP1204277A3 EP 1204277 A3 EP1204277 A3 EP 1204277A3 EP 01308791 A EP01308791 A EP 01308791A EP 01308791 A EP01308791 A EP 01308791A EP 1204277 A3 EP1204277 A3 EP 1204277A3
Authority
EP
European Patent Office
Prior art keywords
video
data
data file
audio
synchronism
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP01308791A
Other languages
German (de)
French (fr)
Other versions
EP1204277B1 (en
EP1204277A2 (en
Inventor
Ajit M. Limaye
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tektronix Inc
Original Assignee
Tektronix Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tektronix Inc filed Critical Tektronix Inc
Publication of EP1204277A2 publication Critical patent/EP1204277A2/en
Publication of EP1204277A3 publication Critical patent/EP1204277A3/en
Application granted granted Critical
Publication of EP1204277B1 publication Critical patent/EP1204277B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2389—Multiplex stream processing, e.g. multiplex stream encrypting
    • H04N21/23892—Multiplex stream processing, e.g. multiplex stream encrypting involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level

Abstract

A data file containing metadata and/or control data is synchronized with associated audio/video data by subliminally embedding a key in a frame of the audio/video. The key indicates the location of the data file and a time after the embedded frame in which the data file is to be activated to be in synchronism with the audio/video. The data file is accessed via an alternate channel and held in a buffer until the time indicated by the key. The metadata from the data file is played out for display in synchronism with the associated audio/video data, and instructions contained in the control data are executed in synchronism with the associated audio/video data.
EP01308791A 2000-11-06 2001-10-16 Subliminally embedded keys in video for synchronization Expired - Lifetime EP1204277B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/707,520 US6642966B1 (en) 2000-11-06 2000-11-06 Subliminally embedded keys in video for synchronization
US707520 2000-11-06

Publications (3)

Publication Number Publication Date
EP1204277A2 EP1204277A2 (en) 2002-05-08
EP1204277A3 true EP1204277A3 (en) 2003-06-04
EP1204277B1 EP1204277B1 (en) 2009-06-03

Family

ID=24842041

Family Applications (1)

Application Number Title Priority Date Filing Date
EP01308791A Expired - Lifetime EP1204277B1 (en) 2000-11-06 2001-10-16 Subliminally embedded keys in video for synchronization

Country Status (6)

Country Link
US (1) US6642966B1 (en)
EP (1) EP1204277B1 (en)
JP (1) JP4076754B2 (en)
CN (1) CN1283104C (en)
DE (1) DE60138860D1 (en)
ES (1) ES2328222T3 (en)

Families Citing this family (64)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7095871B2 (en) 1995-07-27 2006-08-22 Digimarc Corporation Digital asset management and linking media signals with related data using watermarks
EP2312474A1 (en) * 1999-04-13 2011-04-20 Canon Kabushiki Kaisha Data processing method and apparatus
US7096416B1 (en) * 2000-10-30 2006-08-22 Autovod Methods and apparatuses for synchronizing mixed-media data files
RU2285352C2 (en) * 2000-11-08 2006-10-10 Конинклейке Филипс Электроникс Н.В. Method and device for command transfer
US20020083091A1 (en) * 2000-11-29 2002-06-27 Gregory Pulier Seamless integration of video on a background object
US7822969B2 (en) * 2001-04-16 2010-10-26 Digimarc Corporation Watermark systems and methods
US6903779B2 (en) * 2001-05-16 2005-06-07 Yahoo! Inc. Method and system for displaying related components of a media stream that has been transmitted over a computer network
US20020188959A1 (en) * 2001-06-12 2002-12-12 Koninklijke Philips Electronics N.V. Parallel and synchronized display of augmented multimedia information
US7415539B2 (en) * 2001-09-28 2008-08-19 Siebel Systems, Inc. Method and apparatus for detecting insufficient memory for data extraction processes
US7257649B2 (en) * 2001-09-28 2007-08-14 Siebel Systems, Inc. Method and system for transferring information during server synchronization with a computing device
US7260439B2 (en) * 2001-11-01 2007-08-21 Fuji Xerox Co., Ltd. Systems and methods for the automatic extraction of audio excerpts
US7886151B2 (en) * 2002-01-22 2011-02-08 Purdue Research Foundation Temporal synchronization of video and audio signals
US20050120208A1 (en) * 2002-01-25 2005-06-02 Albert Dobson Robert W. Data transmission systems
US20040034655A1 (en) * 2002-07-17 2004-02-19 Tecu Kirk Steven Multimedia system and method
US7239981B2 (en) 2002-07-26 2007-07-03 Arbitron Inc. Systems and methods for gathering audience measurement data
JP2004120440A (en) * 2002-09-26 2004-04-15 Toshiba Corp Server device and client device
US8959016B2 (en) 2002-09-27 2015-02-17 The Nielsen Company (Us), Llc Activating functions in processing devices using start codes embedded in audio
US9711153B2 (en) 2002-09-27 2017-07-18 The Nielsen Company (Us), Llc Activating functions in processing devices using encoded audio and detecting audio signatures
US7778438B2 (en) 2002-09-30 2010-08-17 Myport Technologies, Inc. Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval
US6996251B2 (en) 2002-09-30 2006-02-07 Myport Technologies, Inc. Forensic communication apparatus and method
US10721066B2 (en) 2002-09-30 2020-07-21 Myport Ip, Inc. Method for voice assistant, location tagging, multi-media capture, transmission, speech to text conversion, photo/video image/object recognition, creation of searchable metatags/contextual tags, storage and search retrieval
CN1745374A (en) 2002-12-27 2006-03-08 尼尔逊媒介研究股份有限公司 Methods and apparatus for transcoding metadata
GB2400254A (en) 2003-03-31 2004-10-06 Sony Uk Ltd Video processing
ATE373389T1 (en) 2003-07-25 2007-09-15 Koninkl Philips Electronics Nv METHOD AND DEVICE FOR GENERATING AND DETECTING FINGERPRINTS FOR SYNCHRONIZING AUDIO AND VIDEO
AU2003279935A1 (en) * 2003-08-29 2005-04-14 Nielsen Media Research, Inc. Methods and apparatus for embedding and recovering an image for use with video content
ES2279084T3 (en) * 2003-10-21 2007-08-16 France Telecom PROCEDURE AND DEVICE FOR TRANSMISSION OF DATA ASSOCIATED WITH INFORMATION TRANSMITTED.
JP4649850B2 (en) * 2004-03-04 2011-03-16 ソニー株式会社 Content playback device, content recording device, network system, and content recording / playback method
US8407752B2 (en) * 2004-03-18 2013-03-26 Digimarc Corporation Synchronizing broadcast content with corresponding network content
US7602820B2 (en) 2005-02-01 2009-10-13 Time Warner Cable Inc. Apparatus and methods for multi-stage multiplexing in a network
US8443040B2 (en) * 2005-05-26 2013-05-14 Citrix Systems Inc. Method and system for synchronizing presentation of a dynamic data set to a plurality of nodes
JP2009521170A (en) * 2005-12-22 2009-05-28 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Script synchronization method using watermark
DE602006012123D1 (en) * 2005-12-23 2010-03-25 Ambx Uk Ltd SCRIPT SYNCHRONIZATION VIA FINGERPRINTS DETERMINED FROM A CONTENT STREAM
US7729508B2 (en) 2006-01-11 2010-06-01 Hewlett-Packard Development Company, L.P. Modifying data
US8363161B2 (en) * 2006-05-26 2013-01-29 Broadcom Corporation Systems, methods, and apparatus for synchronization of audio and video signals
WO2008038187A2 (en) * 2006-09-26 2008-04-03 Ambx Uk Limited Creation and handling of a bitstream comprising video frames and auxiliary data
US7739596B2 (en) 2007-04-06 2010-06-15 Yahoo! Inc. Method and system for displaying contextual advertisements with media
US9794605B2 (en) * 2007-06-28 2017-10-17 Apple Inc. Using time-stamped event entries to facilitate synchronizing data streams
US8625607B2 (en) * 2007-07-24 2014-01-07 Time Warner Cable Enterprises Llc Generation, distribution and use of content metadata in a network
US8363716B2 (en) 2008-09-16 2013-01-29 Intel Corporation Systems and methods for video/multimedia rendering, composition, and user interactivity
US8359205B2 (en) 2008-10-24 2013-01-22 The Nielsen Company (Us), Llc Methods and apparatus to perform audio watermarking and watermark detection and extraction
US9667365B2 (en) 2008-10-24 2017-05-30 The Nielsen Company (Us), Llc Methods and apparatus to perform audio watermarking and watermark detection and extraction
US8121830B2 (en) 2008-10-24 2012-02-21 The Nielsen Company (Us), Llc Methods and apparatus to extract data encoded in media content
US8508357B2 (en) 2008-11-26 2013-08-13 The Nielsen Company (Us), Llc Methods and apparatus to encode and decode audio for shopper location and advertisement presentation tracking
FI124520B (en) * 2009-04-14 2014-09-30 Moncef Gabbouj Procedure and arrangement for synchronizing digital multimedia signals
CN104683827A (en) 2009-05-01 2015-06-03 尼尔森（美国）有限公司 Methods and apparatus to provide secondary content in association with primary broadcast media content
US20120308196A1 (en) * 2009-11-25 2012-12-06 Thomas Bowman System and method for uploading and downloading a video file and synchronizing videos with an audio file
US9380356B2 (en) 2011-04-12 2016-06-28 The Nielsen Company (Us), Llc Methods and apparatus to generate a tag for media content
US9209978B2 (en) 2012-05-15 2015-12-08 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US9210208B2 (en) 2011-06-21 2015-12-08 The Nielsen Company (Us), Llc Monitoring streaming media content
US9282366B2 (en) 2012-08-13 2016-03-08 The Nielsen Company (Us), Llc Methods and apparatus to communicate audience measurement information
US9313544B2 (en) 2013-02-14 2016-04-12 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US9711152B2 (en) 2013-07-31 2017-07-18 The Nielsen Company (Us), Llc Systems apparatus and methods for encoding/decoding persistent universal media codes to encoded audio
US20150039321A1 (en) 2013-07-31 2015-02-05 Arbitron Inc. Apparatus, System and Method for Reading Codes From Digital Audio on a Processing Device
WO2015039888A1 (en) 2013-09-20 2015-03-26 Koninklijke Kpn N.V. Correlating timeline information between media streams
WO2015039891A1 (en) * 2013-09-20 2015-03-26 Koninklijke Kpn N.V. Correlating timeline information between media streams
US9332035B2 (en) 2013-10-10 2016-05-03 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
US9699499B2 (en) 2014-04-30 2017-07-04 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
EP3149955B1 (en) * 2014-05-28 2019-05-01 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Data processor and transport of user control data to audio decoders and renderers
US10652127B2 (en) 2014-10-03 2020-05-12 The Nielsen Company (Us), Llc Fusing online media monitoring data with secondary online data feeds to generate ratings data for online media exposure
US9769417B1 (en) * 2014-11-05 2017-09-19 Lattice Semiconductor Corporation Metadata transfer in audio video systems
US9762965B2 (en) 2015-05-29 2017-09-12 The Nielsen Company (Us), Llc Methods and apparatus to measure exposure to streaming media
TWI720153B (en) * 2016-03-29 2021-03-01 日商新力股份有限公司 Transmission device, transmission method, reception device, reception method and transmission and transmission system
TWI602076B (en) * 2016-05-13 2017-10-11 矽統科技股份有限公司 Method for locking audio/voice processing effect and audio receiving device
CN112351273B (en) * 2020-11-04 2022-03-01 新华三大数据技术有限公司 Video playing quality detection method and device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998017064A1 (en) * 1996-10-16 1998-04-23 Gemstar Development Corporation Access to internet data through a television system
US5774666A (en) * 1996-10-18 1998-06-30 Silicon Graphics, Inc. System and method for displaying uniform network resource locators embedded in time-based medium
US5774664A (en) * 1996-03-08 1998-06-30 Actv, Inc. Enhanced video programming system and method for incorporating and displaying retrieved integrated internet information segments
EP0965227A1 (en) * 1997-03-11 1999-12-22 Actv, Inc. A digital interactive system for providing full interactivity with live programming events
WO2000045599A2 (en) * 1999-02-01 2000-08-03 Emuse Corporation Interactive system
US6122403A (en) * 1995-07-27 2000-09-19 Digimarc Corporation Computer system linked by using information in data objects

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4969041A (en) 1988-09-23 1990-11-06 Dubner Computer Systems, Inc. Embedment of data in a video signal
US5543849A (en) * 1992-10-13 1996-08-06 Gilbarco Inc. Synchronization of prerecorded audio/video signals with multi-media controllers
US5537141A (en) * 1994-04-15 1996-07-16 Actv, Inc. Distance learning system providing individual television participation, audio responses and memory for every student
EP0824821B1 (en) * 1995-05-08 2002-04-17 Digimarc Corporation Steganographical embedding of auxiliary data and calibration data in image data
US5818441A (en) * 1995-06-15 1998-10-06 Intel Corporation System and method for simulating two-way connectivity for one way data streams
US6018768A (en) * 1996-03-08 2000-01-25 Actv, Inc. Enhanced video programming system and method for incorporating and displaying retrieved integrated internet information segments
US5778181A (en) * 1996-03-08 1998-07-07 Actv, Inc. Enhanced video programming system and method for incorporating and displaying retrieved integrated internet information segments
US6058430A (en) * 1996-04-19 2000-05-02 Kaplan; Kenneth B. Vertical blanking interval encoding of internet addresses for integrated television/internet devices
US5842978A (en) * 1996-11-18 1998-12-01 Levy; Itchak Supplemental audio visual emergency reviewing apparatus and method
US6173317B1 (en) * 1997-03-14 2001-01-09 Microsoft Corporation Streaming and displaying a video stream with synchronized annotations over a computer network
US6211919B1 (en) * 1997-03-28 2001-04-03 Tektronix, Inc. Transparent embedment of data in a video signal
US6061719A (en) * 1997-11-06 2000-05-09 Lucent Technologies Inc. Synchronized presentation of television programming and web content
US6075561A (en) 1998-02-20 2000-06-13 Tektronix, Inc. Low duty-cycle transport of video reference images
US6426778B1 (en) * 1998-04-03 2002-07-30 Avid Technology, Inc. System and method for providing interactive components in motion video
US6169541B1 (en) * 1998-05-28 2001-01-02 International Business Machines Corporation Method, apparatus and system for integrating television signals with internet access
US6493872B1 (en) * 1998-09-16 2002-12-10 Innovatv Method and apparatus for synchronous presentation of video and audio transmissions and their interactive enhancement streams for TV and internet environments
US6357042B2 (en) * 1998-09-16 2002-03-12 Anand Srinivasan Method and apparatus for multiplexing separately-authored metadata for insertion into a video data stream
WO2001076242A2 (en) * 2000-03-31 2001-10-11 Intellocity Usa, Inc. System and method for local meta data insertion
AU2002237748A1 (en) * 2000-10-19 2002-05-21 Loudeye Technologies, Inc. System and method for selective insertion of content into streaming media

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6122403A (en) * 1995-07-27 2000-09-19 Digimarc Corporation Computer system linked by using information in data objects
US5774664A (en) * 1996-03-08 1998-06-30 Actv, Inc. Enhanced video programming system and method for incorporating and displaying retrieved integrated internet information segments
WO1998017064A1 (en) * 1996-10-16 1998-04-23 Gemstar Development Corporation Access to internet data through a television system
US5774666A (en) * 1996-10-18 1998-06-30 Silicon Graphics, Inc. System and method for displaying uniform network resource locators embedded in time-based medium
EP0965227A1 (en) * 1997-03-11 1999-12-22 Actv, Inc. A digital interactive system for providing full interactivity with live programming events
WO2000045599A2 (en) * 1999-02-01 2000-08-03 Emuse Corporation Interactive system

Also Published As

Publication number Publication date
CN1283104C (en) 2006-11-01
JP2002199360A (en) 2002-07-12
EP1204277B1 (en) 2009-06-03
EP1204277A2 (en) 2002-05-08
ES2328222T3 (en) 2009-11-11
US6642966B1 (en) 2003-11-04
DE60138860D1 (en) 2009-07-16
CN1355652A (en) 2002-06-26
JP4076754B2 (en) 2008-04-16

Similar Documents

Publication Publication Date Title
EP1204277A3 (en) Subliminally embedded keys in video for synchronization
WO2002065651A3 (en) Method of inserting additional data into a compressed signal
GB2351409B (en) Watermarking
EP1276329A3 (en) System and method for secure watermarking of a digital image sequence
WO2003063486A3 (en) Digital television system having personalized addressable content
DE60207439D1 (en) SYSTEM FOR SYNCHRONIZING THE REPRODUCTION OF TWO OR MORE LINKED REPRODUCTORY DEVICES THROUGH SUBTITLES
TW200737126A (en) Method and apparatus for correlating two data sections
WO2002039715A3 (en) Methods and apparatus for presenting a digital video work customized to viewer preferences
AU2003277919A1 (en) Method and apparatus for synchronizing data streams containing audio, video and/or other data
WO2005115107A3 (en) System and method for synchronization of a portable media player to a user's profile
AU2002256836A1 (en) Metadata type fro media data format
EP1420342A4 (en) Information processing apparatus and method
WO2004038538A3 (en) Digital data insertion apparatus and methods for use with compressed audio/video data
EP1793617A3 (en) Synchronization device and method in a digital broadcast receiver
DE60111722D1 (en) INTERRUPTION AND CONTINUED SHARING FOR ADVANCED TELEVISION
EP1729522A3 (en) Apparatus and method for synchronized playback
TW200633534A (en) System, method and apparatus for clean channel change
CA2244472A1 (en) Circuit for synchronizing picture and method therefor
AU2003210936A1 (en) System and method for providing video program information or video program content to a user
TW200739512A (en) Method and device for displaying the content of a region of interest within a video image
EP1071294A3 (en) System, method and recording medium for audio-video synchronous playback
EP1416491A3 (en) Multimedia contents editing apparatus and multimedia contents playback apparatus
TW200623877A (en) Video signal multiplexer, video signal multiplexing method, and picture reproducer
TW200629918A (en) Transcoding closed captioning data from broadcast DTV onto DVD
WO2001093590A3 (en) Video message sending

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

AX Request for extension of the european patent

Free format text: AL;LT;LV;MK;RO;SI

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

AX Request for extension of the european patent

Extension state: AL LT LV MK RO SI

RIC1 Information provided on ipc code assigned before grant

Ipc: 7H 04N 7/26 B

Ipc: 7H 04N 7/24 A

17P Request for examination filed

Effective date: 20030714

AKX Designation fees paid

Designated state(s): DE ES FR GB IT

17Q First examination report despatched

Effective date: 20041118

17Q First examination report despatched

Effective date: 20041118

17Q First examination report despatched

Effective date: 20041118

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): DE ES FR GB IT

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 60138860

Country of ref document: DE

Date of ref document: 20090716

Kind code of ref document: P

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2328222

Country of ref document: ES

Kind code of ref document: T3

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20100304

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 15

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20151026

Year of fee payment: 15

Ref country code: DE

Payment date: 20151028

Year of fee payment: 15

Ref country code: GB

Payment date: 20151027

Year of fee payment: 15

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20151019

Year of fee payment: 15

Ref country code: ES

Payment date: 20151026

Year of fee payment: 15

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 60138860

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20161016

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20170630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161016

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170503

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161016

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20090603

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20181121

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161017