Recherche Images Maps Play YouTube Actualités Gmail Drive Plus »
Connexion
Les utilisateurs de lecteurs d'écran peuvent cliquer sur ce lien pour activer le mode d'accessibilité. Celui-ci propose les mêmes fonctionnalités principales, mais il est optimisé pour votre lecteur d'écran.

Brevets

  1. Recherche avancée dans les brevets
Numéro de publicationUSRE42660 E1
Type de publicationOctroi
Numéro de demandeUS 11/834,347
Date de publication30 août 2011
Date de dépôt6 août 2007
Date de priorité9 sept. 1997
Autre référence de publicationDE19829468A1, DE19829468C2, US6240135, USRE42516, USRE42693, USRE42713, USRE42851
Numéro de publication11834347, 834347, US RE42660 E1, US RE42660E1, US-E1-RE42660, USRE42660 E1, USRE42660E1
InventeursHyun Mun Kim, Jong Beom Ra, Sung Deuk Kim, Young Su Lee
Cessionnaire d'origineVideo Enhancement Solutions LLC
Exporter la citationBiBTeX, EndNote, RefMan
Liens externes: USPTO, Cession USPTO, Espacenet
Method of removing blocking artifacts in a coding system of a moving picture
US RE42660 E1
Résumé
A method of coding a moving picture reduces blocking artifacts. The method includes defining pixel sets S0, S1, S2 around a block boundary, selectively determining a deblocking mode as a default mode or a DC offset mode depending on the degree of blocking artifacts. If the default mode is selected, frequency information is obtained around the block boundary per pixel using a 4-point DCT kernel, for example, a magnitude of a discontinuous component belonging to the block boundary is replaced with a minimum magnitude of discontinuous components belonging to the surroundings of the block boundary in the frequency domain and the replacing step is applied to the spatial domain. If the DC offset mode is selected and a determination is made to perform DC offset mode, the blocking artifacts in a smooth region are removed in the DC offset mode.
Images(6)
Previous page
Next page
Revendications(19)
1. A method for removing blocking artifacts in a coding system of a moving picture comprising the steps of:
determining a plurality of pixel sets around a block boundary;
selecting one of a first mode and a second mode as a deblocking mode based on a degree of blocking artifacts;
performing an analysis, if the first mode is selected, comprising,
obtaining frequency information for each of the plurality of pixel sets,
replacing a magnitude of at least one discontinuous component in the frequency domain of a selected pixel set of the plurality of pixel sets belonging to the block boundary with a magnitude of at least one corresponding discontinuous component belonging to a replacement pixel set of the plurality of pixel sets near the block boundary, and
applying the replaced frequency information of the selected pixel set to the spatial domain to remove the blocking artifacts; and
removing the blocking artifacts in the second mode, if the second mode is selected and a second mode condition is satisfied.
2. The method as claimed in claim 1, wherein the magnitude of the discontinuous component of the selected pixel set is replaced with a minimum value of a magnitude of discontinuous components of one of a first pixel set and a second pixel set when the selected pixel set is located across the block boundary and the first and second pixel sets are located within a block adjacent the block boundary.
3. The method of claim 1, further comprising determining a mode decision value, wherein the second mode is selected if the mode decision value is greater than a first threshold value.
4. The method as claimed in claim 3, wherein mode decision value is determined based on the following equation:

mode decision value=φ(v0−v1)+φ(v1−v2)+φ(v2−v3)+φ(v3−v4)+φ(v4−v5)+φ(v5−v1)+φ(v7−v8)+φ(v8−v9),
wherein φ(γ)=1 when |γ|≦ a second threshold value and φ(γ)=0 otherwise, and wherein v0−v9 are boundary pixel values, and
wherein φ(γ) is a function generating 1 or 0 according to |γ| to γ is a variable denoting a result of substraction of two given boundary pixel values.
5. The method as claimed in claim 1, wherein the second mode condition is satisfied when an absolute value of a maximum data value minus a minimum data value in block boundary pixels is smaller than 2QP, wherein the maximum data value=MAX(v1, v2, v3, v4, v5, v6, v7, v8), the minimum data value=MIN(v1, v2, v3, v4, v5, v6, v7, v8), QP is the quantization parameter of a block adjacent the block boundary and v1−v8 are pixels.
6. The method as claimed in claim 1, wherein the second mode performs low pass filtering to remove the blocking artifacts.
7. The method as claimed in claim 1, wherein the deblocking filtering in the default mode is performed by replacing the magnitude of the discontinuous component of pixels v4 and v5 that sandwich the block boundary with v4′ and v5′, according to the following equation:
v4′=v4−d
v5′=v5+d
d=CLIP(c2.(a3,0′−a3,0)//c3,0,(v4−v5)/2)*δ(|a3,0|<QP
d=CLIP(c2.(a3,0′−a3,0)//c3,0,(v4−v5)/2)*δ(|a3,0|<QP)
a3,0′=SIGN(a3,0)*MIN(|a3,0|,|a3,1|,|a3,2|)
a3,0=([c1−c2 c2−c1]*[v3v4v5v6])T)//c3
a3,1=([c1−c2 c2−c1]*[v1v2v3v4])T)//c3
a3,2=([c1−c2 c2−c1]*[v5v6v7v8])T)//c3,
where QP is the quantization parameter of the block containing the pixel v5, values c1, c2, c3 are kernel constants used in a DCT, and values of a3,0, a3,1, a3,2 are the discontinuous component in each of the plurality of pixel sets, respectively, and
wherein d is a variable used to calculate v4′ and v5′ and denotes a result of a function CLIP (x, p, q) where x, p, and q are integers,
wherein the function CLIP (x, p, q) clips x to a value between p and q,
wherein δ(condition) is a function generating 1 if the “condition” is ture and generating 0 if the “condition” is not ture,
wherein T denotes a transpose of vector matrix, and
wherein v1, v2, v3, v4, v5, v6, v7, and v8 denote boundary pixel values.
8. The method as claimed in claim 7, wherein c1 and c2 are approximated to an integer and c3 is approximated to a multiple of 2, wherein the DCT is a 4-point DCT used to determine the frequency information, and wherein a3,0, a3,1, a3,2 are evaluated from an inner product of the DCT kernel and the selected pixel set being S0, a first pixel set S1 and a second pixel set S2.
9. The method as claimed in claim 7, wherein |a3,0|< QP prevents over-smoothing.
10. The method as claimed in claim 1, further comprising performing the deblocking filtering process around horizontal and vertical block boundaries in a frame.
11. The method of claim 1, wherein the removing blocking artifacts in the second mode satisfies the following equation:
v n = k = - 4 4 b k · p n + k , 1 n 8
Pm=(|v1−v0<QP)?v0:v1,Pm=(|v1−v0|<QP)?v0:v1,
if m<1;
vm, if 1≦m≦8;
(|v8−v9|<QP) v9:v8, if m>8;
(|v8−v9|>QP)?v9:v8, if m>8;
{bk: −4≦k≦4}={1,1,2,2,4,2,2,1,1}//16,
where v0−v9 are boundary pixels, QP is the quantization parameter of a block adjacent the block boundary, and vn is an adjusted pixel value,
wherein bk and pn+k are variables used to calculate the adjusted pixel value vn where n is an integer among 1, 2, 3, 4, 5, 6, 7, and 8,
wherein bk changes according to a value of k where k is one of −4, −3, −2, −1, 0, 1, 2, 3, 4,
wherein pn+k is decided according to pm where m=n+k and m is integer,
wherein Pm is one of boundary pixels values v0 to v9 according to given conditions of (|v1−v0|>QP) and (|v8−v9|QP) and a value of m.
12. The method of claim 1, wherein the replacement pixel set contains a minimum magnitude of the at least one corresponding discontinuous component.
13. The method of claim 1, wherein the first mode is the default mode and the second mode is the DC offset mode, and wherein each of the plurality of pixel sets has four pixels.
14. A method for removing blocking artifacts in a coding system comprising:
determining at least pixel sets S0, S1, S2 around a block boundary;
selecting one of a default mode and a DC offset mode as a deblocking mode based on an amount of blocking artifacts;
deblocking filtering of pixels adjacent the block boundary if the default mode is selected; and
removing artifacts in the DC offset mode, if the DC offset mode is selected and a DC offset mode condition is satisfied, wherein the artifacts are removed in the DC offset mode according to the following equation:
v n = k = - 4 4 b k · p n + k , 1 n 8

Pm=(|v1−v0|<QP)?v0:v1,
if m<1;
vm, if 1≦m≦8;
(|v8−v9|<QP) v9:v8, if m>8;
{bk: −4}={1,1,2,2,4,2,2,1,1}//16,
wherein v0−v9 are boundary pixels, QP is the quanatation parameter of a block adjacent the block boundary, and vn is an adjusted pixel value.
15. The method of claim 14, wherein the deblocking filtering step comprises:
obtaining frequency information for each of the plurality of pixel sets S0, S1, S2;
replacing a magnitude of at least one discontinuous component in the frequency domain of a selected pixel set S0 of the plurality of pixel sets belonging to the block boundary with a magnitude of at least one corresponding discontinuous component belonging to a replacement pixel set S1, S2 of the plurality of pixel sets near the block boundary; and
applying the replaced frequency information of the selected pixel set S0 to the spatial domain to remove the blocking artifacts.
16. The method of claim 14, further comprising determining a mode decision value, wherein the DC offset mode is selected if the mode decision value is greater than a first threshold value, wherein mode decision value is determined based on the following equation:

mode decision value=φ(v0−v1)+φ(v1−v2)+φ(v2−v3)+φ(v3−v4)+φ(v4−v5)+φ(v5−v1)+φ(v7−v8)+φ(v8−v9),
wherein φ(γ)=1 when a second threshold value and φ(γ)=0 otherwise, and wherein v0−v9 are boundary pixel values.
17. The method of claim 14, wherein the DC offset mode condition is satisfied when an absolute value of a maximum data value minus a minimum data value in block boundary pixels is smaller than 2QP, wherein the maximum data value=MAX(v1, v2, v3, v4, v5, v6, v7, v8), the minimum data value=MIN(v1, v2, v3, v4, v5, v6, v7, v8), QP is the quantization parameter of a block adjacent the block boundary and v1−v8 are the block boundary pixels.
18. The method of claim 14, wherein the deblocking filtering in the default mode is performed by replacing the magnitude of the discontinuous component of pixels v4 and v5 sandwiching the block boundary with v4′ and v5′, according to the following equation:
v4′=v4−d
v5′=v5+d
d=CLIP(c2.(a3,0′−a3,0)//c3,0,(v4−v5)/2)*δ(|a3,0|>QP
a3,0′=SIGN(a3,0)*MIN(|a3,0|,|a3,1|,|a3,2|)
a3,0=([c1−c2 c2−c1]*[v3v4v5v6]T)//c3
a3,1=([c1−c2 c2−c1]*[v1v2v3v4]T)//c3
a3,2=([c1−c2 c2−c1]*[v5v6v7v8]T)//c3,
where QP is the quantization parameter of the block containing the pixel v5, values c1, c2, c3 are kernel constants used in a 4-point DCT, and values of a3,0, a3,1, a3,2 are based on a simple inner product of the DCT kernel and the selected pixel set S0, a first pixel set S1 and the second pixel set S2.
19. The method of claim 14, further comprising performing the determining through removing steps for each horizontal and vertical block boundaries in a frame.
Description

Notice: More than one reissue application has been filed for the reissue of U.S. Pat. No. 6,240,135. The reissue applications are application Ser. Nos. 11/834,312; 11/834,347(the present application); 11/851,551; 11/851,529; and 11/851,517, all of which are divisional reissues of U.S. Pat. No. 6,240,135.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a method of coding data, and more particularly, to a method of removing blocking artifacts when coding image signals such as in a moving picture at low-bit-rate.

2. Background of the Related Art

Generally, to efficiently compress a time variable video sequence, it is necessary to remove redundancy in the temporal domain as well as in the two-dimensional spatial domain. In moving picture experts group (MPEG), discrete cosine transform (DCT) is used to remove the redundancy in the two-dimensional spatial domain while a motion compensation method is used to remove the redundancy in the temporal domain.

The DCT is a method of removing the correlativity between data through a two-dimensional spatial transformation. Each block in a picture is spatially transformed using the DCT after the picture is divided into blocks. Data that has been spatially transformed tends to be driven to a certain direction. Only a group of the data driven in the certain direction is quantized and transmitted.

Pictures, which are consecutive in the temporal domain, tend to form motions of a human being or an object at the center of the frame. This property is used to reduce the redundancy of the temporal domain in the motion compensation method. A volume of data to be transmitted can be minimized by taking out a similar region from the preceding picture to fill a corresponding region, which has not been changed (or has very little change), in the present picture. The operation of finding the most similar blocks between pictures is called a motion estimation. The displacement representing a degree of motion is called a motion vector. MPEG uses a motion compensation-DCT method so that the two methods combine.

When a compression technique is combined with a DCT algorithm, the DCT transform is usually performed after input data is sampled in a unit size of 8×8, and the transform coefficients are quantized with respect to a visual property using quantization values from a quantization table. Then, the data is compressed through a run length coding (RLC). The data processed with the DCT is converted from a spatial domain to a frequency domain and compressed through the quantization with respect to the visual property of human beings, not to be visually recognized. For example, since eyes of human beings are insensitive to a high frequency, a high frequency coefficient is quantized in a large step size.

For the quantized data, the data having a relatively high frequency is coded with a short code word. The quantized data having a low frequency is coded with a long code word. Thus, the data is finally compressed.

In processing a moving picture as discussed above, blocks are individually processed to maximize the compression ratio and coding efficiency. However, the individual process causes blocking artifacts that disturb the eyes of human beings at boundaries between blocks.

A related art method of removing blocking artifacts will be described with reference to FIGS. 1 and 2. FIG. 1 is a pixel matrix illustrating a method for removing blocking artifacts. FIG. 2 is a pixel matrix illustrating block boundaries in horizontal and vertical directions.

Various algorithms have been presented for removing blocking artifacts that appear in a coding system, which individually processes blocks. For example, MPEG-4 used a deblocking filter by Telenor, which uses the following algorithm:

    • If B is replaced with B1 and C is replaced with C1,
    • B1=B+d1,
    • C1=C−d1, and
    • d1=sign(d)*(MAX(0,|d|−MAX(0,2*|d|−QP)))
      where d=(3A−8B+8C−3D)/16 and QP denotes the quantization parameter of the macroblock where pixel C belongs.

In processing a MPEG-4 moving picture, blocking artifacts are removed using the above algorithm to improve picture quality. However, it is difficult to effectively remove the blocking artifacts with the above with a small operation capacity in a real time operation. For example, coding and decoding a moving picture is a real time operation. In other words, to completely remove the blocking artifacts, a large calculation amount is needed, which is undesirable in efficiency.

Alternatively, to remove the blocking artifacts, there is provided a method of changing processes of coding and decoding. This method increases the amount of bits to be transmitted.

Still another method for removing blocking artifacts is based on the theory of projection onto convex sets (POCS). However, this method is applied only to a still picture because of an iteration structure and long convergence time.

Thus, the related art methods for removing blocking artifacts in a coding system of a moving picture have several problems. First, in performing an algorithm for removing the blocking artifacts, a calculation is complicated and the calculation amount and time become correspondingly large. Further, the blocking artifacts are not removed in either complex regions or smooth regions in a picture. In addition, the amount of bits to be transmitted increases.

SUMMARY OF THE INVENTION

An object of the present invention is to provide a method of removing blocking artifacts in a coding system that substantially obviates one or more of the problems due to limitations and disadvantages of the related art.

Another object of the present invention is to remove blocking artifacts when necessary in a smooth portion of a moving picture.

Yet another object of the present invention is to provide a method of removing blocking artifacts in a coding system of a moving picture where blocking artifacts of the moving picture are removed at real time using frequency features around a block boundary without increasing the amount of bits.

To achieve at least the above objects in a whole or in parts, a method of removing blocking artifacts in a coding system according to the present invention includes determining at least pixel sets S0, S1, S2 around a block boundary, selecting one of a default mode and a DC offset mode as a deblocking mode based on an amount of blocking artifacts, deblocking filtering pixels adjacent the block boundary if a default mode is selected, deblocking filtering of pixels adjacent the block boundary if a default mode is selected, and removing artifacts in the DC offset mode when the DC offset mode is selected and a DC offset mode condition is satisfied, where the artifacts are removed in the DC offset mode according to the following equation:

v n = k = - 4 4 b k · p n + k , 1 n 8
Pm=(|v1−v0|<QP)?v0:v1,

    • If m<1;
    • vm, if 1≦m≦8;
    • (|v8−v9|<QP) v9:v8, if m>8;
    • (|v8−v9|<QP)?v9:v8, if m>8;
    • {bk:−4≦k≦4}={1,1,2,2,4,2,2,1,1}//16,
      wherein v0−v9 are boundary pixels, QP is the quanatation parameter of a block adjacent the block boundary, and vn is an adjusted pixel value.

To further achieve the above advantages and in accordance with the purpose of the present invention, as embodied and broadly described, a method of removing blocking artifacts in a coding system of a moving picture according to the present invention includes the steps of defining pixel sets S0, S1, S2 around block boundary, selectively determining a deblocking mode as a default mode or a DC offset mode depending on the degree of blocking artifacts after obtaining a mode decision value, obtaining frequency information around the block boundary per pixel using 4-point DCT kernel if the default mode is determined, replacing a magnitude of a discontinuous component belonging to the block boundary with a minimum magnitude of discontinuous components belonging to the surroundings of the block boundary in the frequency domain and applying this replacing step to the spatial domain, judging whether or not it is necessary to perform DC offset mode if the DC offset mode is determined, and removing the blocking artifacts in a smooth region when the judgment is to perform the DC offset mode.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be described in detail with reference to the following drawings in which like reference numerals refer to like elements wherein:

FIG. 1 is a diagram showing a pixel matrix illustrating a related art method of removing blocking artifacts;

FIG. 2 is a diagram showing a pixel matrix illustrating block boundaries in horizontal and vertical directions;

FIG. 3 is a schematic diagram showing a 4-point DCT basis;

FIG. 4 is a flow chart showing a preferred embodiment of a method of removing blocking artifacts according to the present invention; and

FIG. 5 is a table showing exemplary results of a preferred embodiment of a method of removing blocking artifacts according to the present invention.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

In a preferred embodiment of the present invention, blocking artifacts at a block boundary are removed in a frequency domain not a spatial domain. Frequency features around the block boundary are preferably obtained using a 4-point DCT kernel, which can be easily calculated. Thus, a complex region at the block boundary can effectively be processed by extending the smoothness of a picture from the frequency domain to the spatial domain.

Using the 4-point DCT kernel has advantages that frequency analysis is possible and deblocking can easily be processed. Therefore, the 4-point DCT Kernel can efficiently remove the blocking artifacts of a real time moving picture.

The blocking artifacts appear at the block boundary between fixed block patterns in the form of a line of discontinuity. Accordingly, removal of the blocking artifacts involves transformation of the discontinuity of the block boundary region to continuity.

FIG. 2 shows a block boundary region in a horizontal or a vertical direction. In one-dimensional images consisting of four points such as S0, S1 and S2 located around the block boundary, S1 and S2 are individually processed with a block-unit compression method. Thus, S1 and S2 are not influenced by the blocking artifacts. However, S0 is located across a block boundary. Thus, S0 is directly influenced by the blocking artifacts.

In the preferred embodiment according to the present invention, frequency information in S1 and S2 is used to reduce the blocking artifacts from S0. When images change smoothly, image features of S0, S1 and S2 are similar to one another. This means that image features of S0, S1 and S2 are also similar to one another in the frequency domain.

Since the frequency features of S0, S1 and S2 are similar, the frequency component of S0 influenced by the blocking artifacts is adjusted considering the frequency components of S1, S2, which can remove the blocking artifacts. Here, DCT, which is widely applied as an image compression technique, is used as a frequency analysis tool.

The blocking artifacts may appear in both horizontal and vertical block boundaries. In the preferred embodiment according to the present invention, after the blocking artifacts at the horizontal block boundary are removed, the blocking artifacts at the vertical block boundary are removed.

Pixel sets S0, S1 and S2, which overlap, can be defined around the horizontal block boundary. S0 is a 4-point pixel set arranged across the block boundary while S1 and S2 are 4-point pixel sets that adjoin the block boundary.

That is to say, the pixel set S0 contains a discontinuity. The discontinuity in S0 is removed in the preferred embodiment using common information (e.g., between S0 and S2), which are not directly influenced by the discontinuity of the block boundary.

The 4-point DCT basis is used to get information around the block boundary and is shown in FIG. 3. The 4-point DCT basis vectors have symmetric and anti-symmetric properties. In other words, assuming the 4-point DCT coefficients of S0 are defined as a0,0(DC), a1,0, a2,0, a3,0, although both a2,0 and a3,0 are the high frequency components, a2,0 is symmetric and a3,0 is anti-symmetric around the center.

As shown in FIG. 2, since the center of S0 is coincident with the block boundary, a factor directly affecting the block discontinuity is not the symmetric component but the anti-symmetric component. Thus, in the preferred embodiment the magnitude of a3,0 in the frequency domain is adjusted based on the anti-symmetric component so that the block discontinuity can be adjusted. An appropriate adjustment of a3,0 in the frequency domain is directly related to the removal of the block discontinuity in the spatial domain.

Operations for reduction or removal of the block discontinuity will now be described. In the preferred embodiment, the magnitude of a3,0 is replaced with the minimum value of the magnitudes of a3,1 and a3,2. By doing this, a large blocking artifact, which appears when one side of the block boundary to be processed is smooth, can be removed. For a complex region where both S1 and S2 are the objects of motion (i.e., all the values of the magnitudes of a3,0, a3,1 and a3,2 are large), there is little influence on the block boundary.

A method for removing the blocking artifacts in a default mode in the preferred embodiment is as follows:

    • v4′=v4−d;
    • v5′=v5+d; and
    • d=CLIP(c2.(a3,0′−a3,0)//c3,0,(v4−v5)/2)*δ(|a3,0|<QP),
      where a3,0′=SIGN(a3,0)*MIN(|a3,0|,|a3,1|,|a3,2|),
    • a3,0=([c1−c2 c2−c1]*[v3v4v5v6]T)//c3,
    • a3,1=([c1−c2 c2−c1]*[v1v2v3v4]T)//c3, and
    • a3,2=([c1−c2 c2−c1]*[v5v6v7v8]T)//c3.

Thus, boundary pixels v4 and v5 that adjoin the boundary are replaced with v4′ and v5′, respectively. QP is the quantization parameter of the macroblock where pixel v5 belongs. Values c1, c2, c3 are kernel constants used in the 4-point DCT. The values of c1 and c2 are approximated to an integer, and the value of c3 is approximated to a multiple of 2. The values of a3,0, a3,1, a3,2 are evaluated from the simple inner product of the DCT kernel and the pixel sets S0, S1 and S2.

The condition |a3,0|<QP is used to count the influence of the quantization parameter on the blocking artifacts. The condition |a3,0|<QP also prevents over-smoothing when the blocking artifacts are not very serious. The clipping operation on the compensated value is performed to prevent the direction of the gradient at the block boundary from being enlarged or changed in an opposite direction.

This filtering process is performed in both horizontal and vertical block boundaries. In this manner, the blocking artifacts in the whole frame can be removed.

In the default mode, only the boundary pixel values v4 and v5 are compensated. Thus, the default mode is not sufficient to remove the blocking artifacts in a very smooth region, such as a setting in a picture. Therefore, in the preferred embodiment the blocking artifacts in the smooth region are removed by a DC offset mode.

A method for removing the blocking artifacts in the DC offset mode in the preferred embodiment is as follows:

    • max=MAX(v1, v2, v3, v4, v5, v6, v7, v8),
    • min=MIN(v1, v2, v3, v4, v5, v6, v7, v8),
    • if(|max−min|2QP), /*low pass filtering*/

v n = k = - 4 4 b k · p n + k , 1 n 8
Pm=(|v1−v0|<QP)?v0:v1,

    • if m<1;
    • vm, if 1≦m≦8;
    • (|v8−v9|<QP) v9:v8, if m>8;
    • (|v8−v9|<QP)?v9:v8, if m>8;
    • {bk:−4≦k≦4}={1,1,2,2,4,2,2,1,1}//16.

If the absolute value of the maximum data value minus minimum data value in the block boundary pixels is smaller than twice the quantization parameter (i.e., if deblocking is required), the blocking artifacts in the smooth region are removed by the DC offset mode.

The decision to use the default mode or to use the DC offset mode is preferably made based on the following condition:
Mode decision value(eq_cnt)=φ(v0−v1)+φ(v1−v2)+φ(v2−v3)+φ(v3−v4)+φ(v4−v5)+φ(v5−v1)+φ(v7−v8)+φ(v8−v9),

    • where φ(γ)=1 if |γ|≦THR1(first threshold value) and φ(γ)=0 otherwise.

If the mode decision value eq_cnt≧THR2(i.e., a second threshold value), the DC offset mode is applied. In the remaining cases, default mode is applied.

A method for removing the blocking artifacts to code a moving picture at low-rate-bit according to the preferred embodiment of the present invention will be described with reference to FIG. 4. After beginning in FIG. 4, control continues to step 401S. In step 401S, three pixel sets S0, S1, S2 are defined based on the horizontal block boundary. From step 401S, control continues to step 402S.

In step 402S, the mode decision value (e.g., eq_cnt) is determined and control continues to step 403S. In step 403S, the mode decision value is compared with a decision value (e.g., a second threshold value THR2 preferably set by a user) to perform deblocking filtering process by selecting the mode depending on the degree of the blocking artifacts in the picture.

If the determination in step 403S is negative, control continues to step 404S where the default mode is set. From step 404S, control continues to step 405S where frequency information around the block boundary on each of the pixel is determined, for example, using the 4-point DCT kernel. From step 405S, control continues to step 406S.

In step 406S, the magnitude of the discontinuous component belonging to the block boundary is replaced with the minimum magnitude of the discontinuous components belonging to the surroundings of the block boundary in the frequency domain. This adjusting operation is applied to the spatial domain. That is, the magnitude of the discontinuous component belonging to the block boundary is replaced with the minimum magnitude of the discontinuous components belonging to the surroundings of the block boundary in the spatial domain.

In the default mode of the preferred embodiment, the blocking artifacts are removed in step 406S using the 40 method as described below:

    • v4′=v4−d;
    • v5′=v5+d; and
    • d=CLIP(c2.(a3,0′−a3,0)//c3,0,(v4−v5)/2)*δ(|a3|<QP,
      where a3,0′=SIGN(a3,0)*MIN(|a3,0|,|a3,1|,|a3,2|),
    • a3,0=([c1−c2 c2−c1]*[v3v4v5v6]T)//c3,
    • a3,1=([c1−c2 c2−c1]*[v1v2v3v4]T)//c3,
    • a3,2=([c1−c2 c2−c1]*[v5v6v7v8]T)//c3. In the default mode, the blocking artifacts are effectively removed in a complex region. However, the default mode does not sufficiently remove blocking artifacts in a smooth region.

If the determination in step 403S is affirmative, control continues to step 407S where the DC offset mode is set to remove the blocking artifacts. From step 407S, control continues to step 408S where the minimum and maximum data values (min, max) are determined. From step 408S, control continues to step 409S where a determination is made to remove the blocking artifacts in the default mode. If the determination in step 409S is negative, the process ends. If the determination in step 409S is affirmative, control continues to step 410S.

In the DC offset mode according to the preferred embodiment, in step 410S, the blocking artifacts are removed using the following algorithm.

    • max=MAX(v1, v2, v3, v4, v5, v6, v7, v8),
    • min=MIN(v1, v2, v3, v4, v5, v6, v7, v8),
    • if(|max−min|<2.QP), /*low pass filtering*/

v n = k = - 4 4 b k · p n + k , 1 n 8
Pm=(|v1−v0|<QP)?v0:v1,

    • if m<1;
    • vm, if 1≦m≦8;
    • (|v8−v9|<QP) v′9:v8, if m>8;
    • (|v8−v9|<QP)?v9:v8, if m>8;
    • {bk: −4≦k≦4}={1,1,2,2,4,2,2,1,1}//16.

The maximum data value and the minimum data value in the block boundary pixels are obtained in step 408S. Then, if the absolute value of the maximum data value minus the minimum data value is smaller than 2QP (i.e., if deblocking is required), the blocking artifacts in the smooth region are removed by the DC offset mode in steps 409S and 410S.

From step 406S and 410S, control continues to step 411S. If the deblocking filtering process around the horizontal block boundary is completed, the deblocking filtering process around the vertical block boundary is performed in step 411S. From step 411S, control continues to step 412S.

In step 412S, the deblocking filtering processes around the horizontal and vertical block boundaries repeat over the whole frame. From step 412S, the process ends.

FIG. 5 is a table illustrating exemplary PSNR properties according to the method of removing the blocking artifacts of the preferred embodiment. The conditions yielding the exemplary results of FIG. 5 are as follows:

    • 300 frames (only the initial frame was coded in intra.);
    • Fixed QP;
    • H.263 quantization;
    • F_code=1;
    • Enable DC/AC prediction; and
    • Rectangular shape VOP.
      As shown in FIG. 5, the method for removing the blocking artifacts of the preferred embodiment improves results relative to VM (no filtering) of MPEG-4.

As described above, the method for removing the blocking artifacts according to the preferred embodiments of the present invention has various advantages. The deblocking filtering process is performed using features of the frequency domain so that the blocking artifacts are effectively removed. Further, the blocking artifacts are removed in both the complex and smooth regions. Thus, an excellent image or picture quality is provided. In addition, amount of bits does not increase.

The foregoing embodiments are merely exemplary and are not to be construed as limiting the present invention. The present teaching can be readily applied to other types of apparatuses. The description of the present invention is intended to be illustrative, and not to limit the scope of the claims. Many alternatives, modifications, and variations will be apparent to those skilled in the art.

Citations de brevets
Brevet cité Date de dépôt Date de publication Déposant Titre
US49031385 avr. 198920 févr. 1990Dainippon Screen Mfg. Co. Ltd.Method of and apparatus for eliminating interblock distortion due to compressed image data
US49410437 juin 198910 juil. 1990Siemens AktiengesellschaftMethod for reducing blocking artifacts in video scene coding with discrete cosine transformation (DCT) at a low data rate
US52298649 avr. 199120 juil. 1993Fuji Photo Film Co., Ltd.Device for regenerating a picture signal by decoding
US53370887 sept. 19939 août 1994Matsushita Electric Industrial Co. Ltd.Method of correcting an image signal decoded in block units
US53673857 mai 199222 nov. 1994Picturetel CorporationMethod and apparatus for processing block coded image data to reduce boundary artifacts between adjacent image blocks
US54229649 avr. 19936 juin 1995Sat (Societe Anonyme De Telecommunications)Method and device for spatial filtering of digital images decoded by transformation of block
US54540515 août 199126 sept. 1995Eastman Kodak CompanyMethod of reducing block artifacts created by block transform compression algorithms
US5565921 *15 mars 199415 oct. 1996Olympus Optical Co., Ltd.Motion-adaptive image signal processing system
US5590064 *26 oct. 199431 déc. 1996Intel CorporationPost-filtering for decoded video signals
US55966591 sept. 199221 janv. 1997Apple Computer, Inc.Preprocessing and postprocessing for vector quantization
US560865212 mai 19954 mars 1997Intel CorporationReducing blocking effects in block transfer encoders
US5629778 *15 mai 199513 mai 1997Polaroid CorporationMethod and apparatus for reduction of image data compression noise
US5677736 *8 juil. 199614 oct. 1997Minolta Co., Ltd.Data processor
US568047728 sept. 199221 oct. 1997Dainippon Screen Mfg. Co., Ltd.Method of and apparatus for converting image signal representing image having gradation
US5740283 *6 juil. 199514 avr. 1998Rubin, Bednarek & Associates, Inc.Digital video compression utilizing mixed vector and scalar outputs
US57872046 févr. 199728 juil. 1998Olympus Optical Co., Ltd.Image signal decoding device capable of removing block distortion with simple structure
US578721022 sept. 199528 juil. 1998Daewood Electronics, Co., Ltd.Post-processing method for use in an image signal decoding system
US579687513 août 199618 août 1998Sony CorporationSelective de-blocking filter for DCT compressed images
US58526821 févr. 199622 déc. 1998Daewoo Electronics, Co., Ltd.Post-processing method and apparatus for use in a video signal decoding apparatus
US5903679 *14 avr. 199711 mai 1999Korea Telecommunication AuthorityMethod for decoding signal vector-quantized by blocks
US5911008 *29 avr. 19978 juin 1999Nippon Telegraph And Telephone CorporationScheme for detecting shot boundaries in compressed video data using inter-frame/inter-field prediction coding and intra-frame/intra-field coding
US592337622 oct. 199813 juil. 1999Iterated Systems, Inc.Method and system for the fractal compression of data using an integrated circuit for discrete cosine transform compression/decompression
US593710119 janv. 199610 août 1999Samsung Electronics Co., Ltd.Post-processing device for eliminating blocking artifact and method therefor
US59499178 mars 19967 sept. 1999Sharp Kabushiki KaishaBlock distortion corrector and image signal expander
US597419615 mars 199626 oct. 1999Sony CorporationMethod and apparatus for blocking effect reduction in images
US602886717 févr. 199922 févr. 2000Covad Communications Group, Inc.System, method, and network for providing high speed remote access from any location connected by a local loop to a central office
US6028967 *22 janv. 199822 févr. 2000Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US6040879 *21 avr. 199721 mars 2000Samsung Electronics Co., Ltd.Method for decoding video data corrupted by channel noise
US605249010 oct. 199718 avr. 2000At&T Corp.Video coder employing pixel transposition
US6104434 *17 juin 199715 août 2000Fujitsu LimitedVideo coding apparatus and decoding apparatus
US614470014 mai 19977 nov. 2000Daewoo Electronics Co., Ltd.Method and apparatuses for removing blocking effect in a motion picture decoder
US615142015 déc. 199521 nov. 2000Polaroid CorporationMinimizing blocking artifacts in a filtered image
US616716410 mars 199826 déc. 2000Samsung Electronics Co., Ltd.One-dimensional signal adaptive filter for reducing blocking effect and filtering method
US61887996 févr. 199813 févr. 2001Matsushita Electric Industrial Co., Ltd.Method and apparatus for removing noise in still and moving pictures
US624013524 avr. 199829 mai 2001Lg Electronics IncMethod of removing blocking artifacts in a coding system of a moving picture
US6314209 *8 juil. 19976 nov. 2001Hyundai Electronics Industries, Co., Ltd.Video information coding method using object boundary block merging/splitting technique
US63175223 déc. 199813 nov. 2001Philips Electronics North America Corp.Systems and methods for post-processing decompressed images
US63209058 juil. 199820 nov. 2001Stream Machine CompanyPostprocessing system for removing blocking artifacts in block-based codecs
US646318223 déc. 19968 oct. 2002Canon Kabushiki KaishaImage processing apparatus and method for removing noise near an edge of an image
US66149465 oct. 20002 sept. 2003Eastman Kodak CompanySystem and method for correcting defects in digital images through selective fill-in from surrounding areas
US672494412 mars 199820 avr. 2004Nokia Mobile Phones, Ltd.Adaptive filter
US700317020 sept. 200221 févr. 2006Pegasus Imaging CorporationMethods and apparatus for improving quality of block-transform coded images
US70031742 juil. 200121 févr. 2006Corel CorporationRemoval of block encoding artifacts
US700625529 mars 200128 févr. 2006Sharp Laboratories Of AmericaAdaptive image filtering based on a distance transform
US703139322 oct. 200118 avr. 2006Matsushita Electric Industrial Co., Ltd.Block distortion detection method, block distortion detection apparatus, block distortion removal method, and block distortion removal apparatus
US705450325 févr. 200230 mai 2006Seiko Epson CorporationImage processing system, image processing method, and image processing program
US72095942 août 200524 avr. 2007Pegasus Imaging CorporationMethods and apparatus for improving quality of block-transform coded images
US72337064 janv. 200719 juin 2007Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US723975518 févr. 20003 juil. 2007Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US72628864 janv. 200728 août 2007Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US72775934 janv. 20072 oct. 2007Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US728368124 janv. 200716 oct. 2007Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US728368224 janv. 200716 oct. 2007Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US72896829 févr. 200730 oct. 2007Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US729273314 oct. 20036 nov. 2007Matsushita Electric Industrial Co., Ltd.Image processing apparatus and image processing method
US73051424 janv. 20074 déc. 2007Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US730514324 janv. 20074 déc. 2007Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US735291312 juin 20021 avr. 2008Silicon Optix Inc.System and method for correcting multiple axis displacement distortion
US735956928 juin 200715 avr. 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US73595707 août 200715 avr. 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US73629137 août 200722 avr. 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US73629147 août 200722 avr. 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US737961619 oct. 200727 mai 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US737961719 oct. 200727 mai 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US738293019 oct. 20073 juin 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US739192128 juin 200724 juin 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US73919227 août 200724 juin 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US739192419 oct. 200724 juin 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US73949457 août 20071 juil. 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US739785329 avr. 20048 juil. 2008Mediatek IncorporationAdaptive de-blocking filtering apparatus and method for MPEG video decoder
US739796519 oct. 20078 juil. 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US739796619 oct. 20078 juil. 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US739796719 oct. 20078 juil. 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US740078019 oct. 200715 juil. 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US740366729 août 200722 juil. 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US740620919 oct. 200729 juil. 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US743701529 août 200714 oct. 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US745408218 avr. 200818 nov. 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US746378618 avr. 20089 déc. 2008Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US749295918 avr. 200817 févr. 2009Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US749296018 avr. 200817 févr. 2009Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US749296118 avr. 200817 févr. 2009Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US749623918 avr. 200824 févr. 2009Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US749959818 avr. 20083 mars 2009Lg Electronics Inc.Method of reducing a blocking artifact when coding moving picture
US793192312 oct. 200726 avr. 2011Rheon Automatic Machinery Co., Ltd.Apparatus and method for manufacturing a loaf of bread
US2003013816025 févr. 200224 juil. 2003Masaki IshikawaImage processing system, image processing method, and image processing program
US2003019401311 avr. 200216 oct. 2003Alvarez Jose RobertoAdaptive pixel processing
US2005019606614 juil. 20048 sept. 2005Changsung KimMethod and apparatus for removing blocking artifacts of video picture via loop filtering using perceptual thresholds
US2005024391129 avr. 20043 nov. 2005Do-Kyoung KwonAdaptive de-blocking filtering apparatus and method for mpeg video decoder
US2005024391229 avr. 20043 nov. 2005Do-Kyoung KwonAdaptive de-blocking filtering apparatus and method for mpeg video decoder
US2005024391329 avr. 20043 nov. 2005Do-Kyoung KwonAdaptive de-blocking filtering apparatus and method for mpeg video decoder
US2005024391429 avr. 20043 nov. 2005Do-Kyoung KwonAdaptive de-blocking filtering apparatus and method for mpeg video decoder
US2005024391529 avr. 20043 nov. 2005Do-Kyoung KwonAdaptive de-blocking filtering apparatus and method for mpeg video decoder
US2005024391629 avr. 20043 nov. 2005Do-Kyoung KwonAdaptive de-blocking filtering apparatus and method for mpeg video decoder
US2005024406329 avr. 20043 nov. 2005Do-Kyoung KwonAdaptive de-blocking filtering apparatus and method for mpeg video decoder
US2006015935112 janv. 200620 juil. 2006Lg Electronics Inc.Apparatus and method for compensating images in display device
US200602749595 juin 20067 déc. 2006Patrick PiastowskiImage processing to reduce blocking artifacts
US2007007109523 sept. 200529 mars 2007Kyoungwon LimDe-blocking and de-ringing systems and methods
US200702238351 août 200627 sept. 2007Fujitsu LimitedBlock noise detecting method and apparatus, and block noise reducing method and apparatus
US2008003789317 avr. 200714 févr. 2008Pioneer CorporationBlock noise removal device
EP0808068A213 mai 199719 nov. 1997Daewoo Electronics Co., LtdMethods and apparatus for removing blocking effect in a motion picture decoder
JP2002232889A Titre non disponible
WO2002096117A124 mai 200228 nov. 2002Pace Soft Silicon LtdDeblocking block-based video data
Citations hors brevets
Référence
1Avideh Zakhor, "Iterative Procedures for Reduction of Blocking Effects in Transform Image Coding", IEEE Transactions on Circuits and Systems for Video Technology, vol. 2, No. 1, pp. 91-95 (Mar. 1992).
2Barzykina, E et al., Removal of blocking artifacts using random pattern filtering, Image Processing, 1999 International Conference, vol.: 3, 1999, pp. 904-908 vol. 2.
3Byeungwoo Jeon et al, Blocking Artifacts reduction in image compression with block boundary discontinuity criteron, Circuits and System for Video Technology, IEEE Transactions on, vol.: Jun. 8, 1998, pp. 345-357.
4G. de Haan et al., "IC for Motion-Compression 100Hz TV With Natural-Motion Move-Mode", IEEE Transactions on Consumer Electronics, vol. 42, pp. 165-174 (Feb. 1996).
5Gary J. Sullivan et al., "Motion Compensation for Video Compression Using Control Grid Interpolation", IEEE International Conference, pp. 2713-2716 (1991).
6Kasezawa, T., Blocking artifacts reduction using discrete cosine transfomr, Consumer Electronics, IEEE Transactions on, vol.: 43 Issue: 1, Feb. 1997, pp. 48-55.
7Lai, Yung-Kai et al., "Image Enhancement for Low Bit-rate JPEG and MPEG Coding via Postprocessing", Proc. SPIE vol. 2727 Feb. 1996 , 1484-1494.
8Mei-Yin Shen te al., Fast compression artifact reduction technique based on nonlinear filter, Circuits and Systems, 1999. ISCAS '99. Proceedings of the 1999 IEEE International Symposium on, vol.: 4, 1999, pp. 179-182.
9Minami, Shigenobu et al., "An Optimization Approach for Removing Blocking Effects in Transform Coding", IEEE Transactions on Circuits and Systems for Video Technology, vol. 5 No. 2 Apr. 1995, 74-82.
10Nakajima, Yasuyuki, et al., "A PEL Adaptive Reduction of Coding Artifacts for MPEG Video Signals", pp. 928-932, IEEE, 1994.
11Ozcelik, Taner et al., "Image and Video Compression Algorithms Based on Recovery Techniques Using Mean Field Annealing", Proceedings of the IEEE, vol. 83, No. 2, pp. 304-316, Feb. 1995.
12Yongyi Yang et al., "Regularized Reconstructions to Reduce Blocking Artifacts of Block Discrete Cosine Transform Compressed Images", IEEE Transactions on Circuits and Systems for Video Technology, vol. 3, No. 6, pp. 421-432 (Dec. 1993).
13Yung-Kai Lai et al., Removal of blocking artifacts of DCT transform by classified space-frequency filtering, Signals, System and Computers, 1995, Conference Record of the Twenty-Nine Asilmar Conference on, vol.: 2, 1996, pp. 1457-1461.
Classifications
Classification aux États-Unis375/240.01, 382/268, 348/420.1
Classification internationaleH04N1/41, G06K9/40, G06T9/00, H04N7/24, H04N7/26, H04N7/30, H04B1/66
Classification coopérativeH04N19/00563, H04N19/00133, H04N19/00303, H04N19/00157, H04N19/00066, H04N19/0089, H04N19/00909
Classification européenneH04N7/26P4, H04N7/26C, H04N7/26F, H04N7/26A8E, H04N7/26A4F, H04N7/26A6C2, H04N7/26A6
Événements juridiques
DateCodeÉvénementDescription
29 nov. 2013ASAssignment
Owner name: LG ELECTRONICS INC., KOREA, REPUBLIC OF
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:VIDEO ENHANCEMENT SOLUTIONS LLC;REEL/FRAME:031744/0542
Effective date: 20120927