WO2012006304A3 - Motion compensation using vector quantized interpolation filters - Google Patents

Motion compensation using vector quantized interpolation filters Download PDF

Info

Publication number
WO2012006304A3
WO2012006304A3 PCT/US2011/043005 US2011043005W WO2012006304A3 WO 2012006304 A3 WO2012006304 A3 WO 2012006304A3 US 2011043005 W US2011043005 W US 2011043005W WO 2012006304 A3 WO2012006304 A3 WO 2012006304A3
Authority
WO
WIPO (PCT)
Prior art keywords
filter
encoder
block
interpolation filters
interpolation
Prior art date
Application number
PCT/US2011/043005
Other languages
French (fr)
Other versions
WO2012006304A2 (en
Inventor
Barin Geoffry Haskell
Original Assignee
Apple Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Apple Inc. filed Critical Apple Inc.
Publication of WO2012006304A2 publication Critical patent/WO2012006304A2/en
Publication of WO2012006304A3 publication Critical patent/WO2012006304A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H04N19/147—Data rate or code amount at the encoder output according to rate distortion criteria
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Abstract

The present disclosure describes use of dynamically assignable interpolation filters as part of motion compensated prediction. An encoder and a decoder each may store common codebooks that define a variety of interpolation filters that may be applied to predicted video data. During runtime coding, an encoder calculates characteristics of an ideal interpolation filter to be applied to a reference block that would minimize prediction error when the reference block would be used to predict an input block of video data. Once the characteristics of the ideal filter are identified, the encoder may search its local codebook to find a filter that best matches the idea filter. The encoder may filter the reference block by the best matching filter stored in the codebook as it codes the input block. The encoder also may transmit an identifier of the best matching filter to a decoder, which will use the interpolation filter on predicted block as it decodes coded data for the block.
PCT/US2011/043005 2010-07-06 2011-07-06 Motion compensation using vector quantized interpolation filters WO2012006304A2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US36176810P 2010-07-06 2010-07-06
US61/361,768 2010-07-06
US12/875,029 US20120008686A1 (en) 2010-07-06 2010-09-02 Motion compensation using vector quantized interpolation filters
US12/875,029 2010-09-02

Publications (2)

Publication Number Publication Date
WO2012006304A2 WO2012006304A2 (en) 2012-01-12
WO2012006304A3 true WO2012006304A3 (en) 2013-02-28

Family

ID=44628378

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2011/043005 WO2012006304A2 (en) 2010-07-06 2011-07-06 Motion compensation using vector quantized interpolation filters

Country Status (3)

Country Link
US (1) US20120008686A1 (en)
TW (1) TW201216716A (en)
WO (1) WO2012006304A2 (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8761245B2 (en) * 2010-12-21 2014-06-24 Intel Corporation Content adaptive motion compensation filtering for high efficiency video coding
US9313519B2 (en) 2011-03-11 2016-04-12 Google Technology Holdings LLC Interpolation filter selection using prediction unit (PU) size
EP2724534A2 (en) 2011-06-24 2014-04-30 Motorola Mobility LLC Selection of phase offsets for interpolation filters for motion compensation
KR101590736B1 (en) 2011-07-01 2016-02-01 모토로라 모빌리티 엘엘씨 Joint sub-pixel interpolation filter for temporal prediction
WO2014078068A1 (en) * 2012-11-13 2014-05-22 Intel Corporation Content adaptive transform coding for next generation video
US9749642B2 (en) * 2014-01-08 2017-08-29 Microsoft Technology Licensing, Llc Selection of motion vector precision
US9942560B2 (en) 2014-01-08 2018-04-10 Microsoft Technology Licensing, Llc Encoding screen capture data
US9774881B2 (en) 2014-01-08 2017-09-26 Microsoft Technology Licensing, Llc Representing motion vectors in an encoded bitstream
US10009622B1 (en) 2015-12-15 2018-06-26 Google Llc Video coding with degradation of residuals
CN110719466B (en) * 2018-07-13 2022-12-23 北京字节跳动网络技术有限公司 Method, apparatus and storage medium for video processing
CN111432242B (en) * 2020-03-31 2022-05-27 广州市百果园信息技术有限公司 Encrypted video call method, device, equipment and storage medium

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004006558A2 (en) * 2002-07-09 2004-01-15 Nokia Corporation Method and system for selecting interpolation filter type in video coding

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR970002964B1 (en) * 1993-12-24 1997-03-13 대우전자 주식회사 A filter of time interpolation for image signal
US6069670A (en) * 1995-05-02 2000-05-30 Innovision Limited Motion compensated filtering
GB2311184A (en) * 1996-03-13 1997-09-17 Innovision Plc Motion vector field error estimation
US5796875A (en) * 1996-08-13 1998-08-18 Sony Electronics, Inc. Selective de-blocking filter for DCT compressed images
US6956617B2 (en) * 2000-11-17 2005-10-18 Texas Instruments Incorporated Image scaling and sample rate conversion by interpolation with non-linear positioning vector
US7386049B2 (en) * 2002-05-29 2008-06-10 Innovation Management Sciences, Llc Predictive interpolation of a video signal
US7664184B2 (en) * 2004-07-21 2010-02-16 Amimon Ltd. Interpolation image compression
US8208564B2 (en) * 2005-06-24 2012-06-26 Ntt Docomo, Inc. Method and apparatus for video encoding and decoding using adaptive interpolation
WO2008084378A2 (en) * 2007-01-09 2008-07-17 Nokia Corporation Adaptive interpolation filters for video coding
KR101369746B1 (en) * 2007-01-22 2014-03-07 삼성전자주식회사 Method and apparatus for Video encoding and decoding using adaptive interpolation filter
US7813538B2 (en) * 2007-04-17 2010-10-12 University Of Washington Shadowing pipe mosaicing algorithms with application to esophageal endoscopy
US8804831B2 (en) * 2008-04-10 2014-08-12 Qualcomm Incorporated Offsets at sub-pixel resolution
US8811484B2 (en) * 2008-07-07 2014-08-19 Qualcomm Incorporated Video encoding by filter selection

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004006558A2 (en) * 2002-07-09 2004-01-15 Nokia Corporation Method and system for selecting interpolation filter type in video coding

Non-Patent Citations (12)

* Cited by examiner, † Cited by third party
Title
BHASKAR RAMAMURTHI ET AL: "Classified Vector Quantization of Images", IEEE TRANSACTIONS ON COMMUNICATIONS, IEEE SERVICE CENTER, PISCATAWAY, NJ. USA, vol. COM-34, no. 11, 1 November 1986 (1986-11-01), pages 1105 - 1115, XP001375263, ISSN: 0090-6778 *
FOWLER ET AL: "A Survey of Adaptive Vector Quantization| Part II: Classification and Comparison of Algorithms", IPS LABORATORY TECHNICAL REPORT TR-97-02, 1 March 1997 (1997-03-01), pages 1 - 19, XP055039445, Retrieved from the Internet <URL:http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.41.4387&rep=rep1&type=pdf> [retrieved on 20120927] *
FOWLER J E ED - STORER J A ET AL: "Adaptive vector quantization-Part I: a unifying structure", DATA COMPRESSION CONFERENCE, 1997. DCC '97. PROCEEDINGS SNOWBIRD, UT, USA 25-27 MARCH 1997, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, US, 25 March 1997 (1997-03-25), pages 437, XP010218773, ISBN: 978-0-8186-7761-8, DOI: 10.1109/DCC.1997.582094 *
KEMAN YU ET AL: "Half-pixel Motion Estimation Bypass Based on a Linear Model", 24. PICTURE CODING SYMPOSIUM;15-12-2004 - 17-12-2004; SAN FRANSISCO,, 15 December 2004 (2004-12-15), XP030080114 *
KIMATA H ET AL: "3D ADAPTIVE MOTION VECTOR CODING INTEGRATED WITH BLOCK-BASED ADAPTIVE INTERPOLATION FILTER", SYSTEMS & COMPUTERS IN JAPAN, WILEY, HOBOKEN, NJ, US, vol. 35, no. 14, 1 December 2004 (2004-12-01), pages 10 - 20, XP001211995, ISSN: 0882-1666, DOI: 10.1002/SCJ.20125 *
REN J ET AL: "Comparison of Power Consumption for Motion Compensation and Deblocking Filters in High Definition Video Coding", CONSUMER ELECTRONICS, 2007. ISCE 2007. IEEE INTERNATIONAL SYMPOSIUM ON, IEEE, PI, 1 June 2007 (2007-06-01), pages 1 - 5, XP031160348, ISBN: 978-1-4244-1109-2 *
RIBAS-CORBERA JORDI ET AL: "Optimal motion vector accuracy for block-based motion-compensated video coders", SPIE PROCEEDINGS, THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING - SPIE, BELLINGHAM, WASHINGTON, USA, vol. 2668, 1 January 1996 (1996-01-01), pages 302 - 314, XP002336827, ISSN: 0277-786X, DOI: 10.1117/12.235425 *
SHEN ET AL: "An adaptive and fast fractional pixel search algorithm in H.264", SIGNAL PROCESSING, ELSEVIER SCIENCE PUBLISHERS B.V. AMSTERDAM, NL, vol. 87, no. 11, 1 August 2007 (2007-08-01), pages 2629 - 2639, XP022163124, ISSN: 0165-1684, DOI: 10.1016/J.SIGPRO.2007.04.013 *
THOMAS WEDI ET AL: "Interpolation filters for motion compensated prediction with 1/4 and 1/8 pel accuracy for H.26L", 10. VCEG MEETING; 16-05-2000 - 19-05-2000; OSAKA, JP; (VIDEO CODINGEXPERTS GROUP OF ITU-T SG.16),, no. q15j14, 10 May 2000 (2000-05-10), XP030003045, ISSN: 0000-0466 *
VATIS Y ET AL: "Locally adaptive non-separable interpolation filter for H.264/AVC", PROCEEDINGS. INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, IEEE, NEW YORK, NY, US, 8 October 2006 (2006-10-08), pages 33 - 36, XP002454497 *
VATIS Y ET AL: "R-D opt adaptive interp filter in KTA reference model", 31. VCEG MEETING; 79. MPEG MEETING; 15-01-2007 - 16-01-2007;MARRAKECH; (VIDEO CODING EXPERTS GROUP OF ITU-T SG.16),, no. VCEG-AE16, 14 January 2007 (2007-01-14), XP030003519, ISSN: 0000-0157 *
ZHANG K ET AL: "Single-Pass Encoding Using Multiple Adaptive Interpolation Filters", 37. VCEG MEETING; 15-4-2009 - 18-4-2009; YOKOHAMA, JP; (VIDEO CODINGEXPERTS GROUP OF ITU-T SG.16),, no. VCEG-AK26, 11 April 2009 (2009-04-11), XP030003678, ISSN: 0000-0085 *

Also Published As

Publication number Publication date
WO2012006304A2 (en) 2012-01-12
TW201216716A (en) 2012-04-16
US20120008686A1 (en) 2012-01-12

Similar Documents

Publication Publication Date Title
WO2012006304A3 (en) Motion compensation using vector quantized interpolation filters
WO2015138943A3 (en) Block adaptive color-space conversion coding
WO2013006297A9 (en) Applying non-square transforms to video data
WO2011002809A3 (en) Template matching for video coding
WO2007046060A3 (en) Compression and decompression of data vectors
WO2013106705A3 (en) Coding parameter sets and nal unit headers for video coding
WO2016030327A3 (en) Encoder, decoder and method for encoding and decoding audio content using parameters for enhancing a concealment
WO2010068020A3 (en) Multi- view video coding/decoding method and apparatus
WO2013002895A8 (en) Transition between run and level coding modes
RU2017101574A (en) SYSTEMS AND METHODS FOR OPTIMIZATION OF THE MODEL PARAMETER BASED ON THE THREE-DIMENSIONAL REPRESENTATION OF COLORS
WO2010050706A3 (en) Method and apparatus for encoding a motion vector, and method and apparatus for encoding/decoding image using same
WO2010045380A3 (en) Weighted prediction based on vectorized entropy coding
WO2009157674A3 (en) Method for encoding/decoding motion vector and apparatus thereof
WO2009126915A8 (en) Rate-distortion defined interpolation for video coding based on fixed filter or adaptive filter
WO2011139099A3 (en) Method and apparatus for processing a video signal
WO2011019246A3 (en) Method and apparatus for encoding/decoding image by controlling accuracy of motion vector
PL3869508T3 (en) Determining a weighting function having low complexity for linear predictive coding (lpc) coefficients quantization
EP3909147C0 (en) Type-2 codebook compression using multi-stage quantization
ATE538540T1 (en) METHOD FOR CODING VECTORS
WO2011129672A3 (en) Video encoding/decoding apparatus and method
WO2012077959A3 (en) Method and device for encoding/decoding image in spatial domain for noise component
WO2013002550A3 (en) Method and apparatus for coding/decoding through high-speed coding unit mode decision
AU2018260836A1 (en) Encoder, decoder, system and methods for encoding and decoding
EP3868102A4 (en) An encoder, a decoder and corresponding methods using history based motion vector prediction
WO2014161994A3 (en) Advanced quantizer

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11731608

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11731608

Country of ref document: EP

Kind code of ref document: A2