WO2007029945A1 - Procede et appareil ameliorant l'efficacite du codage entropique, procede de codage video et appareil utilisant ledit procede - Google Patents

Procede et appareil ameliorant l'efficacite du codage entropique, procede de codage video et appareil utilisant ledit procede Download PDF

Info

Publication number
WO2007029945A1
WO2007029945A1 PCT/KR2006/003492 KR2006003492W WO2007029945A1 WO 2007029945 A1 WO2007029945 A1 WO 2007029945A1 KR 2006003492 W KR2006003492 W KR 2006003492W WO 2007029945 A1 WO2007029945 A1 WO 2007029945A1
Authority
WO
WIPO (PCT)
Prior art keywords
coefficient
coefficients
layer
block
vlc
Prior art date
Application number
PCT/KR2006/003492
Other languages
English (en)
Inventor
Bae-Keun Lee
Woo-Jin Han
Original Assignee
Samsung Electronics Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020050122564A external-priority patent/KR100736086B1/ko
Application filed by Samsung Electronics Co., Ltd. filed Critical Samsung Electronics Co., Ltd.
Priority to JP2008528956A priority Critical patent/JP4834732B2/ja
Priority to EP06798638A priority patent/EP1922881A4/fr
Priority to CN2006800325755A priority patent/CN101258755B/zh
Publication of WO2007029945A1 publication Critical patent/WO2007029945A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/34—Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/91—Entropy coding, e.g. variable length coding [VLC] or arithmetic coding

Definitions

  • Apparatuses and methods consistent with the present invention relate to a video compression technique and, more particularly, to a method and an apparatus for enhancing the performance of entropy coding in a multilayer-based codec.
  • a basic principle of data compression is to remove redundancy.
  • Data may be compressed by removing spatial redundancy such as a repetition of colors or objects, temporal redundancy such as the repetition of adjacent frames in a moving picture or a repetition of sounds in an audio file, or psychovisual redundancy considering the fact that the visual and perceptive abilities of human beings are insensitive to high frequencies.
  • temporal redundancy is removed by temporal filtering based on motion compensation
  • spatial redundancy is removed by a spatial transformation.
  • the result of removing redundancy is data loss.
  • a quantized result is coded without loss through entropy coding.
  • Entropy coding technologies currently used in the H.264 standard include Context-
  • CAVLC Adaptive Variable Length Coding
  • CABAC Context-Adaptive Binary Arithmetic Coding
  • Table 1 shows the parameters that are encoded in each entropy coding technique in the H.264 standard.
  • a macroblock type showing whether the macroblock is an inter-prediction mode or an intra-prediction mode a macroblock pattern showing a form of a subblock that constitutes a macroblock, a quantization parameter, an index determining a quantization step, a reference frame index showing a number of a frame referred to in an inter-prediction mode, and a motion vector are coded by Exp_Golomb.
  • residual data showing a difference between an original image and a prediction image is coded by CAVLC.
  • CABAC shows good performance with parameters having high complexity.
  • VLC Variable Length Coding
  • JVT-P056 'Variable length code for SVC'(JVT-P056, Poznan, 16th JVT meeting; hereinafter, called JVT-P056)
  • JVT-P056 a document submitted by J. Ridge and M. Karczewicz in the 16th JVT meeting, presents a CAVLC technique that considers characteristics of SVC.
  • JVT-P056 follows the same procedure as the existing H.264 in a discrete layer, but uses a VLC technique according to separate statistical characteristics in a Fine Granular Scalable (FGS) layer.
  • FGS Fine Granular Scalable
  • JSVM Joint Scalable Video Model
  • the JVT-P056 presents a VLC technique for an FGS layer.
  • the technique uses an existing CAVLC technique in a discrete layer, but uses a separate technique using statistical characteristics of the FGS layer.
  • JVT-P056 suggests a technique for the significant pass as follows.
  • a codeword is characterized by 'm', a cut-off parameter. If 'C, a symbol to be coded, does not exceed m, the symbol is encoded using Exp_Golomb code. If the symbol C is bigger than m, it is divided into the two parts of a length and a suffix according to Formula 1, and is encoded. [16]
  • [17] 'P' is an encoded codeword, and consists of a length and a suffix (00, 10, or 10).
  • JVT-P056 presents a way to allocate a codeword having a different length by using one VLC table based on the number of zeros which are included in each refinement bit group.
  • the refinement bit group contains refinement bits in groups of a predetermined number. For example, four refinement bits may be considered as one refinement bit group.
  • JVT-P056 a technique using one fixed VLC table when coding refinement bits in the refinement pass is presented. But, when considering that there are different zero ( 1 O') distributions for different frames, slices, macroblocks, or transformation blocks (blocks generated after the discrete cosine transformation (DCT)), one VLC table is not enough.
  • DCT discrete cosine transformation
  • FIG. 1 shows the rate of bits that are not zeros in FGS layers in a case where a single VLC table is used in a refinement pass.
  • the number of FGS layers increases, the number of non-zeros among blocks to be coded increases to a maximum of 15% (zeros decrease by a maximum 15%).
  • zeros decrease by a maximum 15%.
  • a single VLC table which is assumed to have a high number of zeross, is efficiently used in the first FGS layer, it is not guaranteed to be efficient in the upper FGS layer. Rather, it would be more efficient to use different VLC tables for each FGS layer. Therefore, there is a need for a technique that uses different tables for each FGS layer in a refinement pass.
  • the present invention provides a method and an apparatus for enhancing performance of entropy coding by using inter-layer correlation between layers in a multilayer-based codec.
  • the present invention provides a method and an apparatus for enhancing performance of entropy coding by selecting VLC tables according to characteristics of each FGS layer in a refinement pass.
  • an entropy coding method that codes a first coefficient included in a block of a predetermined layer among coefficients generated by coding a multilayer video without loss, where the entropy coding method may include (a) obtaining a distribution of a second coefficient included in an area of a base layer corresponding to the block, (b) selecting a lookup table which is appropriate to the obtained distribution among a plurality of lookup tables, and (c) transforming the first coefficient into a value mapped to the selected lookup table.
  • an entropy decoding method that restores a first coefficient on the block of the layer by decoding a first bitstream of a predetermined layer among input bitstreams without loss
  • the entropy decoding method may include (a) restoring a second coefficient included in an area of a base layer corresponding to the block, (b) obtaining a distribution of the restored second coefficient, (c) selecting a lookup table which is appropriate to the obtained distribution among a plurality of lookup tables, and (d) transforming the first bitstream into the first coefficient based on the selected lookup table.
  • variable length decoding method that codes a first coefficient of the FGS (Fine Granular Scalable) layer among coefficients consisting of one discrete layer and at least one or more FGS layers without loss
  • the variable length decoding method may include (a) grouping an absolute value of the first coefficient in units of predetermined numbers, (b) producing the rate of zeros among the second coefficients included in a predetermined unit area to which the first coefficient belongs, (c) selecting one among a plurality of variable length coding (VLC) tables depending on whether the rate exceeds a predetermined threshold, and (d) transforming the absolute value of the grouped first coefficient into a corresponding codeword by referring to the selected VLC table.
  • VLC variable length coding
  • variable length decoding method that restores a first coefficient of the FGS layer by decoding a first bitstream of an FGS layer among the input bitstreams without loss
  • the variable length decoding method may include (a) producing the rate of zeros among the restored second coefficients included in a predetermined unit area to which the first coefficient belongs, (b) selecting one among a plurality of VLC tables depending on whether the rate exceeds a predetermined threshold, and (c) restoring the first coefficient corresponding to a predetermined codeword on the selected VLC table among the first bitstream.
  • variable length decoding method that restores a refinement coefficient of the FGS layer by decoding a first bitstream of an FGS layer among the input bitstreams without loss
  • the variable length decoding method may include (a) reading a token of a VLC table inserted by predetermined unit areas in the first bitstream, (b) loading a VLC table corresponding to the token, and (c) restoring the first coefficient corresponding to a predetermined codeword on the loaded VLC table among the first bitstream.
  • an entropy decoding apparatus for restoring a first coefficient on a block of the layer by decoding a first bitstream of a predetermined layer among the input bitstream without loss
  • the entropy decoding apparatus may include a unit restoring a second coefficient included in an area of a base layer corresponding to the block; a unit obtaining a distribution of the restored second coefficient; a unit selecting a lookup table which is appropriate for the obtained distribution among a plurality of lookup tables; and a unit transforming the first bitstream into the first coefficient based on the selected lookup table.
  • variable length decoding apparatus for restoring a first coefficient of the FGS layer by decoding a first bitstream of a FGS layer among the input bitstream without loss
  • the variable length decoding apparatus may include a unit producing the rate of zeros among the restored second coefficients included in predetermined unit areas to which the first coefficient belongs; a unit selecting one among a plurality of VLC tables depending on whether the rate exceeds a predetermined threshold; and a unit restoring the first coefficient corresponding to a predetermined codeword on the selected VLC table among the first bitstream.
  • variable length decoding apparatus for restoring refinement coefficients of the FGS layer by decoding a first bitstream of an FGS layer among the input bitstream without loss
  • the variable length decoding apparatus including a unit reading a token of a VLC table inserted by predetermined unit areas in the first bitstream; a unit loading a VLC table corresponding to the token; and a unit restoring the first coefficient corresponding to a predetermined codeword of the loaded VLC table among the first bitstream.
  • FlG. 1 illustrates a rate of non-zero coefficients of FGS layers when a single VLC table is used
  • FlG. 2 illustrates the concept of entropy coding the current layer by using characteristics of a basic layer
  • FlG. 3 is a block diagram illustrating the structure of CAVLC according to an extended CALVC technique
  • FlG. 4 illustrates the concept of referring to neighboring blocks and blocks of a base layer in the CAVLC encoding of blocks of the current layer
  • FlG. 5 illustrates the structure of a CAVLC decoder corresponding to the CAVLC encoder of the FlG. 3;
  • FlG. 6 illustrates an example where quantization coefficients are indicated separately as one or more discrete layers and at least one FGS layer;
  • FlG. 7 is a block diagram illustrating the structure of a refinement coefficient encoder according to an exemplary embodiment of the present invention.
  • FlG. 8 is a block diagram illustrating the structure of a refinement coefficient decoder corresponding to the refinement coefficient encoder of FlG. 7;
  • FlG. 9 is a block diagram illustrating the structure of a multilayer-based video encoder, which an entropy encoder may be applied to, as shown in FlG. 3 or FlG. 7;
  • FlG. 10 is a block diagram illustrating the structure of a multilayer-based video decoder, which an entropy decoder may be applied to, as shown in FlG. 5 or FlG. 8.
  • the present invention presents two techniques.
  • One is an extended CAVLC technique using the correlation between layers (hereinafter called 'extended CAVLC), and another is a technique that improves the performance of entropy coding by using VLC tables adapted to the FGS layer.
  • the intra-base mode is a method that sets an image of a basic layer corresponding to a block of the current layer as a prediction signal, thereby improving the coding efficiency by differentiating the current layer block and the prediction signal.
  • the term 'block' signifies a transform unit in spatial transform (e.g., a 4 x 4 or 8 x 8 grid of pixels).
  • the residual prediction mode is a method that additionally improves the coding efficiency by obtaining the difference between base residual signals that are generated through inter- prediction of a base layer.
  • the prediction signal or the base residual signal provides more effective information than other blocks of the current layer or other residual signals of the current layer. Therefore, it may be desirable to utilize characteristics of base layers in selecting a look-up table, as shown FIG. 2.
  • the SVC draft allows the intra-base mode and the residual prediction mode to be used.
  • an Intra_base_mode flag is 1, it indicates that the intra-base mode is used, and if a Res_pred_flag is 1, it indicates that the residual prediction mode is used. If each flag is 0, it indicates that the concerned mode is not used. Therefore, in order to use the extended CAVLC technique presented in the present invention, at least one of the flags should be 1.
  • FIG. 3 is a block diagram illustrating the structure of CAVLC according to an extended CALVC technique.
  • FIG. 3 is similar to the CAVLC encoder used in the existing H.264, but is different in that it may only use characteristics of base blocks when selecting a look-up table, and may combine characteristics of neighboring blocks and base blocks, and a Num_Trail coding unit 110 may store the number of coefficients (TotalCoeffs) and TrailingOnes by referring to the selected reference table.
  • FIG. 4 illustrates the concept of referring to neighboring blocks A and B of block
  • a base layer may be a discrete layer having the QCIF resolution
  • the current layer may be a discrete layer having the CIF resolution. Because there is little correlation between a discrete layer and an FGS layer or between FGS layers, it would be difficult to apply the concept.
  • a reference table selection unit 160 may count non-zero coefficients among coefficients included in the base block D.
  • a look-up table may be selected according to the count (see Table 2).
  • Table 1 may be a table for allocating shorts codes to TotalCoeffs of small values and allocating long codes to TotalCoeffs of big values.
  • Table 2 may be biased to the side of coefficients having intermediate numbers (relatively short codes are allocated to TotalCoeff values around 2 to 4).
  • Table 3 may be biased to the side of coefficients having high numbers, and Table 4 may allocate fixed 6-bit codes to all TotalCoeff and TrailingOnes values.
  • a reference table selection unit 160 may select a look-up table by combining non-zero counts (nA, nB) of neighboring blocks A and B and counts (nD) of non-zero coefficients of base blocks.
  • the counts (nD) may be obtained by the following equation 2.
  • nD round(w xnA + w xnB + w xnC) (2)
  • w , w , and w are weights, respectively, and they sum to 1.
  • the weights may be all 1/3, or the weight of a base block may be set to a larger value. Or, the weights may be set as values making a commonly-used Rate-Distortion (R-D) cost function a minimum.
  • R-D Rate-Distortion
  • Formula 2 shows a weighted average as an example of calculating representative values from a plurality of data.
  • the table selection unit 160 may select one among at least 4 look-up tables by applying the nD calculated by equation 2 to Table 2.
  • Num_Trail coding unit (110) may code non-zero coefficients (TotalCoeff) and TrailingOnes based on look-up tables selected by the table selection unit 160.
  • the Trailing Ones refer to the coefficients that are 1 or -1.
  • the Sign_Trail coding unit 120 may code symbols of TrailingOnes as a single bit
  • the level coding unit 130 may code levels (sizes) of remaining coefficients except the TrailingOnes.
  • the Total_zeros coding unit 140 may code the number of total zeros (TotalZeros) before the last coefficient among the non-zero coefficients.
  • the run coding unit 15 may code the number of zeros existing in between the non-zero coefficients. In this way, a CAVLC-coded bitstream may be output. Because the selected look-up table may be selected by passing the same process in the CAVLC decoding process, the information may not have to be included in the bitstream.
  • FIG. 5 is a block diagram illustrating the structure of a CAVLC decoder corresponding to the CAVLC encoder of FIG. 3.
  • a table selection unit 260 may use characteristics of coefficients of base blocks, or may combine characteristics of coefficients of base blocks and coefficients of neighboring blocks, and then may select one among a plurality of look-up tables, thereby providing the selected look-up table to a Num_Trail decoding unit 210. As in the video encoding process, because the upper layer (the current layer) may be restored after the base layer is restored, a look-up table selected in the table selection unit 260 and a look-up table selected in the table selection unit (160 of FIG. 3) may be the same.
  • the Num_Trail decoding unit 210 may restore TotalCoeffs and TrailingOnes from bits which are same with the items of the look-up table from the first of the input bitstream, based on the provided look-up table. Then, the Sign_Trail decoding unit 220 may restore the symbols of the TrailingOnes by reading bits sequentially.
  • a level decoding unit 230 may read codes on levels included in the bitstream, and may restore levels (sizes) of coefficients except the TrailingOnes among non-zero coefficients.
  • a Total_Zeros decoding unit 240 may read codes corresponding to TotalZeros, and may restore the TotalZeros (the number of non-zero coefficients).
  • a run decoding unit 250 may read remaining bitstreams among the input bitstreams, and may insert as many zeros as the number of runs in between the non-zero coefficients.
  • the total number of the inserted Os should be same as TotalZeros. In this way, coefficients before the CAVLC coding are restored.
  • JVT-P056 presents a technique of applying VLC instead of CABAC in the entropy coding of FGS layers.
  • VLC table is used, considering a characteristic that there is a greater possibility that zeros may be generated in a refinement pass of FGS layers.
  • the number of zeros increases in upper layers, and even in the same FGS layer, the distribution of zeros is not the same in frames, slices, macroblocks or blocks. Therefore, it is difficult to choose an optimal VLC table. Rather, a technique is required that may adaptively select one table among a plurality of VLC tables.
  • VLC tables to be selected based on the number of zeros included in a unit area (a frame, a slice, a macroblock, or a block).
  • FIG. 6 illustrates an example where quantization coefficients are indicated separately as one or more discrete layers and at least one FGS layer according to an FGS scheme. Each layer is indicated by blocks consisting of coefficients of 4x4 units. Numbers in the same location are used to express one quantization coefficient.
  • the FGS scheme is used to support scalability in terms of bit rate, and a variable bit rate may be implemented by truncating upper layer. Of course, it's also possible that a few numbers in some layers are truncated.
  • coefficients located in the second row of the first line in a 4x4 block are 3, -1, and 1.
  • all these coefficients are necessary, but depending on the situation, 1, or 1 and -1 may be truncated, and in a decoder step, the quantization coefficients may be restored only by low-layer coefficients which are relatively important (of course, a loss is generated).
  • the FSG layers are very different from discrete layers in terms of characteristics.
  • the FGS layers are composed of values having a difference concept. Also, while other values except 0, 1, and -1 may appear in the discrete layers, 0, 1, and -1 are common in the FGS layers.
  • An adaptive VLC technique by layers according to exemplary embodiments of the present invention may be especially suitable for being applied to the refinement pass.
  • coefficients of a discrete layer are coded by VLC, it may be desirable to code considering level, run, and other parameters as shown in FlG. 3.
  • level, run, and other parameters as shown in FlG. 3.
  • a separate VLC coding scheme may be required.
  • FlG. 7 is a block diagram illustrating the structure of a refinement coefficient encoder 300 according to an exemplary embodiment of the present invention.
  • refinement coefficients may be input to a grouping unit 310.
  • the grouping unit 310 may group the input refinement coefficients by a predetermined number, for example, by 4 numbers, then may provide the absolute value (size: consists of 1 or 0) to a size coding unit 330, and may provide the sign (sign: a sign of the refinement coefficient except 0) to a sign coding unit 3 3 0.
  • a VLC table for using in the size coding unit 330 may be selected by referring to refinement coefficients of the coded unit area (including a frame, a slice, a macroblock, or a block).
  • the unit area may be a frame, a slice, a macroblock, or a block to which the current refinement coefficient belongs. For example, if a table is selected by frame units, the number of candidate tables decreases, but it is disadvantageous in terms of adaptivity of table selection. If a table is selected by block units, it will have a high adaptivity, but the number of candidate tables for selection increases. Therefore, it is desirable that a user selects a unit area by considering the use, the purpose, and other parameters.
  • a table selection unit 320 may count the number of zeros among bits belonging to the unit area. Then, if the rate occupied by zeros among the bits exceeds a predetermined threshold (a first threshold), a table biased to zero (e.g., the table of JVT-P056) may be selected, otherwise a table relatively less biases to zero may be selected.
  • a predetermined threshold e.g., the table of JVT-P056
  • two or more VLC tables may be used. If a table is selected among two VLC tables (expressed as switching), only one threshold may be necessary, and as the number of VLC table increases, a second threshold, a third threshold, and others may additionally be necessary.
  • the thresholds may be values that may be determined empirically or experimentally, for example, they may be 7/8, 3/4, 2/3, 1/2, and others.
  • VLC tables of Table 3 and Table 4 may be used. If the number of zeros of the unit area exceeds 2/3, the VLC table of Table 3, which is biased to zero, may be used. Also, if the number of zeros is less than 2/3, the VLC table of Table 4, which is less biased to zero, may be used.
  • 'Symbol' in FlG. 3 and FlG. 4 refers to a size value of a refinement coefficient row which is grouped by 4s, and 'codeword' refers to the result of coding of the symbol.
  • VLC table of Table 3 is the same as the VLC table presented in JVT-P056.
  • VLC table which is different from Table 3, is illustrated.
  • the VLC table of Table 4 gives the shortest codeword in the case where two of the 4 bits of a symbol are 1, and gives the second shortest codeword in the case where two of the 4 bits are 1 and all 4 bits are 0. Therefore, if the VLC table of Table 4 is applied to cases where there are many ones in the refinement coefficients (especially, in high FGS layers), the size of generated codes may be reduced. It is of course possible to express characteristics of refinement co ⁇ efficients in more detail by using a greater number of threads and VLC tables.
  • a token on a VLC table which may be selected by the table selection unit 320, may be provided to the size selection unit 330.
  • the token refers to an index corresponding to each VLC table.
  • the size coding unit may read the VLC table corresponding to the provided token from the table storing unit 340.
  • the table storing unit may be implemented in the form of a nonvolatile memory device such as a ROM, PROM, EPROM, EEPROM, a flash memory, or a storage media such as a hard disk.
  • the size coding unit 330 may transform an absolute value (i.e., a symbol) of a predetermined number (i.e., 4) of refinement coefficients which may be provided from the grouping unit 310 into a codeword by referring to a VLC table corresponding to the token.
  • a sign coding unit 350 may code a sign which may be provided from the grouping unit 310 as a one bit sign code. Normally, the sign code is 0 in the case of a positive sign, and 1 in the case of a negative sign.
  • a Mux i.e., a multiplexer 360 may generate a bitstream by mixing a set of codewords which may be output from the size coding unit 330, and a set of sign codes which may be output from the sign coding unit 350.
  • the grouping unit 310 may group the set of refinement coefficients by 4s, and provide 1011 and 0011, the absolute values, to the size coding unit 330, and the signs -+++- to the sign coding unit 350.
  • the table selection unit 320 may deliver a token for the VLC table of Table 4 to the size coding unit 330.
  • the size coding unit 330 may read a VLC table like that of Table 4 from the table storing unit 340, and may transform the provided 1011 and 00 1 1 to a corresponding codeword.
  • the value which may be output from the size coding unit 330 and may be input to the Mux 360, is 11110100.
  • the sign coding unit 350 may transform the sign -+++- to 10001. It is possible to additionally apply a certain entropy coding method to the transformed 10001. Then, the Mux 360 may combine 11110100 and 10001, and output it.
  • FIG. 8 is a block diagram illustrating the structure of a refinement coefficient decoder corresponding to the refinement coefficient encoder 300 of FIG. 7.
  • the input bitstream may be divided into a set of codewords and a set of sign codes through a Demux (i.e., a demultiplexer) 410.
  • the set of codewords may be provided to a size decoding unit 430, and the set of sign codes to the sign decoding unit 450, respectively.
  • the table selection unit 420 may calculate the rate of zeros among refinement coefficients included in the restored unit area, and then may select one of the two VLC tables, depending on whether the rate exceeds the threshold.
  • the threshold it is also possible to set a plurality of thresholds and to use three or more VLC tables.
  • a size decoding unit 430 may read the selected VLC table from a table storing unit
  • the codeword may be transformed into a symbol corresponding to the codeword.
  • the transformed symbol may be provided to a sign decoding unit 450.
  • the sign decoding unit 450 may sequentially read sign codes provided from the Demux 410, and then may give signs corresponding to the sign codes to values which are not zero (i.e., 1) among symbols (consisting of 4 bits) which may be provided from the size decoding unit 430 in order. By this method current refinement coefficients may be restored from the bitstream.
  • the Demux 410 may divide it into 11110100 and 10001, and may provide the former to the size decoding unit 430 and the latter to the sign decoding unit 450.
  • the table selection unit may confirm that the refinement coefficient of the restored unit area does not reach 2/3, and may deliver a token of a VLC table of Table 4 to the size decoding unit 430.
  • the size decoding unit 430 may check whether there is a same codeword among codewords of Table 4. Because there is no same codeword until 11110, it may check for the next 111101. Because this codeword exists in Table 4, the symbol 1011 corresponding to the codeword is restored. Therefore, the value, which may be output from the size decoding unit 430, and may be input to the sign decoding unit 450, is 10110011.
  • one of a plurality of candidate VLC tables may be selected in the refinement coefficient decoder, as in the encoder 300. But, because the FGS layer, when delivered to the decoder 400, is sent after some parts of the layer are truncated, in the case where the current block uses surrounding features within the unit area, a problem may occur where a VLC table is used which is not the same in the encoder and decoder, thereby generating a serious problem that the decoder cannot restore original coefficients.
  • VLC table may be included in a bitstream, and may be delivered to the refinement coefficient decoder 400.
  • the VLC table may be selected by unit areas, in other words, units of a frame, a slice, a macroblock, or a block unit. And if a VLC table is selected in minute units, because the overhead may be bigger when transported, it is desirable for the unit area to be a slice or a macroblock. In this case, the token may be included in a slice header or a macroblock header, and transported.
  • the refinement coefficient decoder 400 which received a bitstream in which the token is included, may take a VLC table corresponding to the token directly from the table storing unit 440, so the table selection unit 420 may be omitted.
  • FlG. 9 is a block diagram illustrating the structure of a multilayer-based video encoder 1000, in which an entropy encoder may be applied, as shown in FlG. 3 or FlG. 7.
  • An original video sequence may be input to a enhancement layer encoder 600, and a base layer encoder 500 after being downsampled by a downsampling unit 550 (only when there is a change in resolution between layers).
  • a prediction unit 610 may get residual signals by differentiating images predicted by a predetermined method in the current macroblock.
  • the prediction methods may be a directional intra-prediction, an inter-prediction, intra-base prediction, and residual prediction.
  • a transform unit 620 may transform the obtained residual signals by using spatial transform techniques such as the DCT, wavelet transform, and others, thereby generating transform coefficients.
  • a quantization unit 630 may quantize the transform coefficients by predetermined quantization steps (as the quantization steps get bigger, the loss or the compression rate gets higher), thereby generating quantization coefficients.
  • the base layer encoder may include a prediction unit 510, a transform unit 520, and a quantization unit 530 of same functions. But, the prediction unit 510 may not use an intra-base prediction or a residual prediction.
  • An entropy encoder 640 may output an enhancement layer bitstream by encoding the quantization coefficients without loss, and in the same manner, the entropy encoder 540 may output the base layer bitstream.
  • a Mux 650 may generate bitstreams to be sent to an end of the video decoder by combining the enhancement layer bitstream and the base layer bitstream.
  • the entropy encoder 640 may include the CAVLC encoder 100 of FlG. 3 or the refinement coefficient encoder 300 of FlG. 7. If the entropy encoder 640 is the CAVLC encoder 100, a lookup table may be selected based on the number of non- zeros among quantization coefficients of a base block provided from the quantization unit 530, and a CAVLC encoding process such as Num_Trail coding, and others may be executed according to the selected lookup table.
  • the entropy encoder 640 may be operated as the refinement coefficient encoder 300, the base layer corresponds to a discrete layer, and the enhancement layer corresponds to an FGS layer.
  • the entropy encoder 640 may encode coefficients in which the coefficient of a discrete layer is zero, that is, refinement coefficients, without loss. At this time, the entropy encoder 640 may be provided refinement coefficients included in the unit area from the quantization unit 630.
  • FlG. 10 is a block diagram illustrating the structure of a multilayer-based video decoder 2000 which may be applied to the entropy decoder, as shown in FlG. 5 or FlG. 8.
  • An input bitstream may be divided into an enhancement layer bitstream and a base layer bitstream through a Demux 860, and may be provided to an enhancement layer encoder 800 and a base layer decoder 700, respectively.
  • An entropy decoder 810 may restore a quantization coefficient by decoding without loss in a way that corresponds to the entropy encoder 640.
  • An inverse quantization unit 820 may de-quantize the restored quantization coefficient to a quantization step used in a quantization unit 630.
  • An inverse transform unit 830 may inversely transform the de-quantized results by using inverse spatial transform techniques such as the inverse DCT transform or the inverse wavelet transform.
  • An inverse prediction unit 840 may obtain a prediction image from the prediction unit in the same way, and may restore the video sequence by adding the inversely transformed result to the obtained prediction image.
  • a base layer decoder may also include an entropy decoder 710, an inverse quantization unit 720, an inverse transform unit 730, and an inverse prediction unit 740 having the same functions.
  • the entropy decoder 810 may include the CAVLC decoder 200 of FlG. 5 or the refinement coefficient decoder 400 of FlG. 8. If the entropy decoder 810 is a CAVLC decoder 200, a lookup table may be selected based on the number of non-zeros among quantization coefficients of a base block provided from an entropy decoder 710 of a base layer decoder 700, and a CAVLC decoding process such as Num_Trail, and others may be executed according the selected lookup table.
  • the base layer corresponds to a discrete layer
  • the enhancement layer corresponds to an FGS layer.
  • the entropy decoder 810 may encode coefficients, in which the coefficient of a discrete layer is zero, that is, refinement coefficients, without loss. At this time, the entropy decoder 810 may use refinement coefficients included in the entropy-decoded unit area.
  • Each element in FIG. 2 through FIG. 6 may be implemented as software such as tasks, classes, sub-routines, processes, objects, execution threads, and programs, or hardware such as a Field-Programmable Gate Array (FPGA) or an ASIC (Application-Specific Integrated Circuit), and may also be implemented as a combination of software and the hardware.
  • the elements may be included in storage media which is readable by a computer, or may be distributed in a plurality of computers.
  • the performance of an entropy coding in a multilayer-based video codec can be improved, thereby providing an improved video image quality.

Abstract

La présente invention concerne un appareil qui améliore l'efficacité du codage entropique dans un codec à plusieurs couches et un procédé de codage entropique qui consiste à obtenir une distribution d'un deuxième coefficient inclus dans une région d'une couche de base correspondant au bloc, à sélectionner parmi une pluralité de tables de consultation, une table de consultation qui est appropriée à la distribution obtenue et à transformer le premier coefficient en une valeur mappée sur la table de consultation sélectionnée.
PCT/KR2006/003492 2005-09-06 2006-09-04 Procede et appareil ameliorant l'efficacite du codage entropique, procede de codage video et appareil utilisant ledit procede WO2007029945A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2008528956A JP4834732B2 (ja) 2005-09-06 2006-09-04 エントロピコーディングの性能向上方法および装置、前記方法を利用したビデオコーディング方法および装置
EP06798638A EP1922881A4 (fr) 2005-09-06 2006-09-04 Procede et appareil ameliorant l'efficacite du codage entropique, procede de codage video et appareil utilisant ledit procede
CN2006800325755A CN101258755B (zh) 2005-09-06 2006-09-04 增强熵编码、视频编码方法及其装置的性能的方法和装置

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US71374605P 2005-09-06 2005-09-06
US60/713,746 2005-09-06
KR1020050122564A KR100736086B1 (ko) 2005-09-06 2005-12-13 엔트로피 코딩의 성능 향상 방법 및 장치, 상기 방법을이용한 비디오 코딩 방법 및 장치
KR10-2005-0122564 2005-12-13

Publications (1)

Publication Number Publication Date
WO2007029945A1 true WO2007029945A1 (fr) 2007-03-15

Family

ID=37836030

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2006/003492 WO2007029945A1 (fr) 2005-09-06 2006-09-04 Procede et appareil ameliorant l'efficacite du codage entropique, procede de codage video et appareil utilisant ledit procede

Country Status (2)

Country Link
EP (1) EP1922881A4 (fr)
WO (1) WO2007029945A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007112341A2 (fr) * 2006-03-27 2007-10-04 Qualcomm Incorporated Procédés et systèmes de codage de coefficients de raffinement dans la compression vidéo
GB2539488B (en) * 2015-06-18 2019-03-27 Gurulogic Microsystems Oy Encoder, decoder and method employing palette utilization and compression
US10419752B2 (en) 2009-12-16 2019-09-17 Electronics And Telecommunications Research Institute Adaptive image encoding device and method

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6097842A (en) * 1996-09-09 2000-08-01 Sony Corporation Picture encoding and/or decoding apparatus and method for providing scalability of a video object whose position changes with time and a recording medium having the same recorded thereon
US6351563B1 (en) * 1997-07-09 2002-02-26 Hyundai Electronics Ind. Co., Ltd. Apparatus and method for coding/decoding scalable shape binary image using mode of lower and current layers

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7099387B2 (en) * 2002-03-22 2006-08-29 Realnetorks, Inc. Context-adaptive VLC video transform coefficients encoding/decoding methods and apparatuses

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6097842A (en) * 1996-09-09 2000-08-01 Sony Corporation Picture encoding and/or decoding apparatus and method for providing scalability of a video object whose position changes with time and a recording medium having the same recorded thereon
US6351563B1 (en) * 1997-07-09 2002-02-26 Hyundai Electronics Ind. Co., Ltd. Apparatus and method for coding/decoding scalable shape binary image using mode of lower and current layers

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
OHM J.-R.: "Advances in scalable video coding", PROC. OF THE IEEE, vol. 93, no. 1, January 2005 (2005-01-01), pages 42 - 56, XP011123852 *
RIDGE J. AND KARCZEWICZ M.: "Variable length codes for SVC", JTV-P056, 16TH JVT MEETING PL, 24 July 2005 (2005-07-24) - 29 July 2005 (2005-07-29), XP008077615 *
See also references of EP1922881A4 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007112341A2 (fr) * 2006-03-27 2007-10-04 Qualcomm Incorporated Procédés et systèmes de codage de coefficients de raffinement dans la compression vidéo
WO2007112341A3 (fr) * 2006-03-27 2008-01-10 Qualcomm Inc Procédés et systèmes de codage de coefficients de raffinement dans la compression vidéo
US8401082B2 (en) 2006-03-27 2013-03-19 Qualcomm Incorporated Methods and systems for refinement coefficient coding in video compression
US10419752B2 (en) 2009-12-16 2019-09-17 Electronics And Telecommunications Research Institute Adaptive image encoding device and method
US10708580B2 (en) 2009-12-16 2020-07-07 Electronics And Telecommunications Research Institute Adaptive image encoding device and method
US10728541B2 (en) 2009-12-16 2020-07-28 Electronics And Telecommunications Research Institute Adaptive image encoding device and method
US11659159B2 (en) 2009-12-16 2023-05-23 Electronics And Telecommunications Research Institute Adaptive image encoding device and method
US11805243B2 (en) 2009-12-16 2023-10-31 Electronics And Telecommunications Research Institute Adaptive image encoding device and method
US11812012B2 (en) 2009-12-16 2023-11-07 Electronics And Telecommunications Research Institute Adaptive image encoding device and method
GB2539488B (en) * 2015-06-18 2019-03-27 Gurulogic Microsystems Oy Encoder, decoder and method employing palette utilization and compression
US11202083B2 (en) 2015-06-18 2021-12-14 Gurulogic Microsystems Oy Encoder, decoder and method employing palette utilization and compression

Also Published As

Publication number Publication date
EP1922881A4 (fr) 2012-03-21
EP1922881A1 (fr) 2008-05-21

Similar Documents

Publication Publication Date Title
US8514943B2 (en) Method and apparatus for enhancing performance of entropy coding, video coding method and apparatus using the method
US7348903B2 (en) Method and apparatus for enhancing performance of entropy coding, and video coding method and apparatus using the entropy coding performance enhancing method
KR100809298B1 (ko) 플래그 인코딩 방법, 플래그 디코딩 방법, 및 상기 방법을이용한 장치
US8345752B2 (en) Method and apparatus for entropy encoding/decoding
US20070086516A1 (en) Method of encoding flags in layer using inter-layer correlation, method and apparatus for decoding coded flags
US20070237240A1 (en) Video coding method and apparatus supporting independent parsing
US20070177664A1 (en) Entropy encoding/decoding method and apparatus
US7840083B2 (en) Method of encoding flag, method of decoding flag, and apparatus thereof
KR100714706B1 (ko) 엔트로피 코딩의 성능 향상 방법 및 장치, 상기 방법을이용한 비디오 코딩 방법 및 장치
US20070133677A1 (en) Method and apparatus for encoding and decoding video signals on group basis
WO2007035070A1 (fr) Procede et appareil d'amelioration de l'efficacite du codage entropique et procede de codage video, et appareil utilisant ce procede
US20070071088A1 (en) Method and apparatus for entropy encoding and entropy decoding fine-granularity scalability layer video data
US20070133676A1 (en) Method and apparatus for encoding and decoding video signal depending on characteristics of coefficients included in block of FGS layer
KR100834757B1 (ko) 엔트로피 부호화 효율을 향상시키는 방법 및 그 방법을이용한 비디오 인코더 및 비디오 디코더
KR102226893B1 (ko) 영상 복호화 방법 및 이를 이용하는 장치
WO2007029945A1 (fr) Procede et appareil ameliorant l'efficacite du codage entropique, procede de codage video et appareil utilisant ledit procede
KR100763192B1 (ko) Ｆｇｓ 계층의 비디오 데이터를 엔트로피 부호화 및복호화하는 방법 및 장치

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200680032575.5

Country of ref document: CN

DPE2 Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2006798638

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2008528956

Country of ref document: JP

Ref document number: 383/MUMNP/2008

Country of ref document: IN

NENP Non-entry into the national phase

Ref country code: DE