CN101656881B - Moving image coding method, and moving image decoding method - Google Patents

Abstract

A moving image coding apparatus (10) for performing inter-picture predictive coding on pictures constituting a moving image is provided with a coding unit (103) for performing predictive error coding on image data; a decoding unit (105) for performing predictive error decoding on an output from the coding unit (103); a reference picture memory (117) for holding output data from the decoding unit (105); and a motion vector detection unit (108) for detecting forward and backward motion vectors on the basis of decoded image data stored in the memory (117). When coding a B picture, a picture that is timewise closest to the target picture is used as a candidate picture for forward reference, and an I or P picture that is timewise closest to the target picture is used as a candidate picture for backward reference. The moving image coding apparatus (10) so constructed can improve coding efficiency of a B picture to be subjected to bidirectional predictive coding.

Description

Dynamic image encoding method and dynamic image decoding method

The application is that application number is 02815766.4, the applying date is on November 6th, 2002, denomination of invention is divided an application for " dynamic image encoding method and dynamic image decoding method ".

Technical field

The present invention relates to moving image encoding (video coding) method and moving picture decoding (video decode) method, relate in particular to constituting each picture of moving image, the method for encoding or decoding with reference to other pictures of this moving image.

Background technology

Generally; When the picture that constitutes moving image was encoded, each picture was divided into a plurality of, and utilizes the direction in space of moving image and the redundancy of time direction; To every compressed encoding that carries out the image information that each picture has (below, also abbreviate coding as).As the coding of the redundancy of utilizing direction in space, there is the relevant interior coding of picture of pixel value that utilizes in the picture.As the coding of the redundancy of utilizing time orientation, there is the relevant inter-picture prediction coding of pixel value that utilizes between picture.The inter-picture prediction coding is; To (to be encoded) markup; Be positioned at the picture (forward direction picture or forward direction are with reference to picture) in the place ahead in time with reference to relative this markup, perhaps this markup is positioned at the processing that the picture (back to picture or back to reference to picture) at rear is encoded in time relatively.

The forward direction picture is a picture more Zao than object picture on DISPLAY ORDER, on the time shaft (below, be called " demonstration time shaft ") of demonstration time of each picture of expression, is positioned at the front side of markup.The back is a picture slower than object picture on DISPLAY ORDER to picture, is showing on the time shaft, is positioned at the rear side of markup.In addition, in the explanation below, be called with reference to picture at the picture of time institute's reference that markup is encoded.

In the inter-picture prediction coding, specifically be exactly with respect to motion vector,, to obtain the prediction data of the view data of this markup based on the motion compensation process of this motion vector with reference to picture through the detected object picture.Then, the redundancy on the direction in space of the picture of the differential data of the view data through removing this prediction data and markup is carried out compressed encoding for the data volume of markup.

In addition, as the decoding processing of the picture of encoding, the interior decoding of picture of coding in the corresponding picture is arranged, and decode between the picture of encoding between corresponding picture.Between picture in the decoding, the identical picture of picture of coding time institute's reference between reference and picture.Just, with reference to picture Xra and the coded picture Xtg of Xrb, decode with reference to above-mentioned picture Xra and Xrb.

Figure 43 (a)-43 (c) is the figure that expression constitutes a plurality of pictures of moving image.

In Figure 43 (a), the part of a plurality of pictures that constitute a moving image Mpt is shown, just, picture F (k)～F (k+2n-1) [k, n: integer].In each picture F (k)～F (k+2n-1), be set with demonstration time t (k)～t (k+2n-1).Shown in Figure 43 (a), this each picture respectively shows on the demonstration time shaft X of time T dis in expression, arrange by the demonstration time sequencing, and these pictures, (n) is divided into group by each predetermined number.These picture groups are called as GOP (Group of Pictures), become for the coded data of moving image and carry out random-access least unit.In the explanation below, the picture group is also noted by abridging sometimes and is GOP.

For example, (i) individual picture group Gp (i) is made up of picture F (k)～F (k+n-1).(i+1) individual picture group Gp (i+1) is made up of picture F (n+k)～F (k+2n-1).

Each picture is divided into the picture bar (slice) that consists of a plurality of macro blocks.For example, macro block is that the pixel count in vertical direction and horizontal direction all is 16 rectangular area.In addition, picture F (k+1) shown in Figure 43 (b), is divided into a plurality of picture bar SL1～SLm [m: natural number].Picture bar SL2 shown in Figure 43 (c), is made up of a plurality of macro block MB1～MBr [r: natural number].

Figure 44 is the figure that is used for the coded data of account for motion image, and expression is to the encode structure of resulting stream of each picture that constitutes moving image.

Stream Smp is the coded data of a corresponding image sequence (for example moving image).This stream Smp is made up of zone (common information zone) Cstr of the bit string that is arranged with the common information that is equivalent to title etc. and zone (GOP zone) Dgop that is arranged with the bit string of corresponding each GOP.In common information zone C str, include synchrodata Sstr and title Hstr corresponding to stream.In GOP region D gop, include corresponding picture group (GOP) Gp (1)～Gp (i-1), Gp (i), bit string Bg (1)～Bg (i-1) of Gp (i+1)～Gp (I) [i, I: integer], Bg (i), Bg (i+1)～Bg (I).

Corresponding to each bit string of each GOP, constitute by zone (common information zone) Cgop of the bit string that is arranged with the common information that is equivalent to title etc. and zone (picture area) Dpct that is arranged with the bit string of corresponding each picture.In common information zone C gop, include synchrodata Sgop and title Hgop corresponding to GOP.In the picture area Dpct of the bit string Bg of corresponding picture group G (i) (i), include corresponding picture F (k '), F (k '+1), F (k '+2), F (k '+3) ..., F (k '+s) [k ', s: integer] bit string Bf (k '), Bf (k '+1), Bf (k '+2), Bf (k '+3) ..., Bf k '+s).Picture F (k '), F (k '+1), F (k '+2), F (k '+3) ..., F (k '+s) change by coded sequence and arranged picture F (the k)～F (k+n-1) that arranges by above-mentioned DISPLAY ORDER.

Each bit string of corresponding each picture is by zone (common information zone) Cpct of the bit string that is arranged with the common information that is equivalent to title etc. be arranged with corresponding each zone as the bit string of bar (as the bar zone) Dslc and constitute.In common information zone C pct, include synchrodata Spct and title Hpct for picture.For example; At the picture F (k '+1) by scramble time sequence arrangement (coded sequence arrangement) is under the situation by the picture F (k+1) that shows time sequencing arrangement (DISPLAY ORDER arrangement); In the picture bar region D slc of the bit string Bf (k '+1) of corresponding picture F (k '+1), comprise corresponding above-mentioned each bit string Bs1～Bsm as bar SL1～SLm.

Corresponding each each bit string as bar is made up of zone (common information zone) Cslc of the bit string that is arranged with the common information that is equivalent to title etc. and zone (macro block zone) Dmb that is arranged with the bit string of corresponding each macro block.In common information zone C slc, include synchrodata Sslc and title Hslc for the picture bar.For example, be under the situation of the picture F (k+1) that arranges of DISPLAY ORDER at the picture F (k '+1) that coded sequence is arranged, in the macro block region D mb of correspondence, comprise bit string Bm1～Bmr of corresponding above-mentioned each macro block MB1～MBr as the bit string Bs2 of bar SL2.

As stated; The coded data of a corresponding moving image (image sequence just), have by correspondence as the fluid layer of the stream Smp of this coded data, GOP layer that correspondence constitutes above-mentioned stream, the picture frame layer and being equivalent to that is equivalent to constitute the picture of above-mentioned each GOP constitutes the hierarchical structure that the picture bar layer of the picture bar of above-mentioned each picture is formed.

; MPEG (Moving Picture Experts Group)-1, MPEG-2, MPEG-4, ITU-T suggestion H.263, in the moving image encoding mode that H.26L waits, the picture that the picture of implementing coding in the picture is called as the I picture, implement the inter-picture prediction coding is called as P picture or B picture.

Below, the definition of I picture, P picture, B picture is described.

The I picture is not with reference to the coded picture of other picture.P picture or B picture are with reference to the coded picture of other picture.Strictness, P picture are when each picture is encoded, and can select any one picture that the I mode is encoded and the P mode is encoded.The B picture is when each picture is encoded, and can select any one picture that the I mode is encoded, the P mode is encoded and the B mode is encoded.

The I mode is encoded, and is the object piece of markup not to be carried out the processing of encoding in the picture with reference to other picture.The P mode encode be with reference to one coded picture the object piece of markup is carried out the processing of inter-picture prediction coding.The B mode encode be with reference to two coded picture the object piece of markup is carried out the processing of inter-picture prediction coding.

Encoding or the encode picture of time institute's reference of B mode in above-mentioned P mode, is I picture or the P picture beyond the markup, also can be positioned at markup the place ahead the forward direction picture and be positioned at rear back of markup to picture.

But, in two pictures that in the B mode is encoded, carry out reference and the combination, three kinds of situation are arranged.Just, the situation with reference to two forward direction pictures is arranged in the B mode is encoded, after two to the situation of picture and with reference to behind a forward direction picture and one to the situation of picture.

Figure 45 is the figure of the moving image encoding mode of explanation above-mentioned MPEG etc.In Figure 45, markup and the corresponding relation with reference to picture (at the picture of time institute's reference that markup is encoded) are shown.

Constitute moving image each picture F (k)～F (k+7) ..., the coding of F (k+17)～F (k+21), such picture with reference to other carries out shown in arrow Z.Specifically, being in the picture of the end side of an arrow Z, is to encode through inter-picture prediction with reference to the picture that is in the top side of this arrow.In Figure 45, above-mentioned picture F (k)～F (k+7) ..., picture F (the k)～F (k+4) shown in F (k+17)～F (k+21) and Figure 43 (a) ..., F (k+n-2)～F (k+n+4) ..., F (k+2n-2), F (k+2n-1) be identical.These pictures are showing that pressing DISPLAY ORDER on the time shaft X arranges.Picture F (k)～F (k+7) ..., demonstration time of F (k+17)～F (k+21), be time t (k)～t (k+7) ..., t (k+17)～t (k+21).The picture type of picture F (k)～F (k+7) is, I, B, B, P, B, B, P, B, and the picture type of picture F (k+17)～F (k+21) is, B, P, B, B, P.

For example, from the B mode of the B picture F (k+1) of second of beginning shown in Figure 45 is encoded, with reference to the I picture F (k) of beginning and the 4th P picture F (k+3).In addition, from the P mode of the P picture F (k+3) of the 4th of beginning shown in Figure 45 is encoded, with reference to the I picture F (k) of beginning.

Although shown in Figure 45 in the P of P picture mode is encoded with reference to the situation of forward direction picture, also can be in the P of P picture mode is encoded with reference to the back to picture.In addition, although shown in Figure 45 in the B of B picture mode is encoded with reference to forward direction picture and back to the situation of picture, also can be in the B of B picture mode is encoded with reference to two forward direction pictures, perhaps with reference to after two to picture.

In addition, in MPEG-4 and the moving image encoding mode that H.26L waits, when the B picture is encoded, can select to be called the coded system of direct mode.

Figure 46 (a) and Figure 46 (b) are the figure that is used to explain the inter-picture prediction coding that is carried out with this direct mode.Shown in Figure 46 (a) in direct mode employed motion vector.

In Figure 46 (a), picture P1, B2, B3, P4 are equivalent to picture F (k+3) shown in Figure 45～F (k+6) [k=-2], and time t (1), t (2), t (3), t (4) (t (1)＜t (2)＜t (3)＜t (4)) are the demonstration time of picture P1, B2, B3, P4.In addition, X is the demonstration time shaft that expression shows time T dis among the figure.

Below, just the situation that the piece BL3 of picture B3 encodes is described particularly with direct mode.

In the case, the markup that becomes the encoding process object is picture B3, and the object piece that becomes the object of encoding process is piece BL3.

In the predictive coding of the piece BL3 of picture B3 is handled, utilize the rear that is positioned at picture B3, the motion vector MV4 of the piece BL4 of the picture P4 that encodes recently.This piece BL4 equates for the relative position of picture B3 with above-mentioned BL3 for the relative position of picture P4.Just, shown in Figure 46 (b), (x4, y4), (x3 y3) equates with coordinate with respect to the datum mark Ob3 of the piece BL3 of the datum mark O3 of picture P3 with respect to the coordinate of the datum mark Ob4 of the piece BL4 of the datum mark O4 of picture P4.In addition, the motion vector MV4 of piece BL4 is an employed motion vector in the predictive coding of piece BL4.The motion vector MV4 of this piece BL4 is to obtain through the motion detection with reference to the piece BL4 of forward direction picture P1, the region R 4f of expression forward direction picture P1 corresponding blocks BL4.

Then,, use motion vector MV3f and the MV3b parallel, implement with reference to forward direction picture P1 and the bi-directional predictive coding of back to picture P4 with motion vector MV4 for the piece BL3 of above-mentioned picture B3.Motion vector MV3f is illustrated in encode forward direction picture region R 3f P1, corresponding blocks BL3 of time institute's reference to piece BL3.Motion vector MV3b is illustrated in the back to region R 3b picture P4, corresponding blocks BL3 of time institute's reference of encoding to piece BL3.

, in ITU-T suggestion (Annex U H.263++), about a plurality of pictures are recorded and narrated as the framework under the situation about using with reference to the candidate of picture to some extent.In this records and narrates, be used for preserving become with reference to the view data of the picture (candidate screen) of the candidate of picture with reference to picture memory, be divided into short period picture memory and long period picture memory.The short period picture memory is the storage area that is used for preserving the data of the near in time candidate screen of relative markup (adjacent candidate screen).The long period picture memory is the storage area that is used for preserving the data of relative markup candidate screen far away in time (distant place candidate screen).Specifically, above-mentioned distant place candidate screen, the distance with markup is left on the quantity of the candidate screen from markup to this distant place candidate screen, surpasses the quantity that can be stored in the candidate screen in the short period picture memory.

In addition; In ITU-T suggestion (AnnexU H.263++); Relevant for the record that utilizes method of short period picture memory and long period picture memory, and and then, about picture being specified also record to some extent of method with reference to the index (the following cross index that also abbreviates as) of picture.

At first, just the designation method for the cross index of picture describes simply.

Figure 47 (a) and Figure 47 (b) are used to explain a plurality of pictures that constitute moving image are specified the figure of the method for cross indexes.Figure 47 (a) is illustrated in the be encoded candidate (candidate screen) of picture of time institute's reference of picture P16.Figure 47 (b) is illustrated in the be encoded candidate (candidate screen) of picture of time institute's reference of picture B15.

Picture P4, B2, B3, P7, B5, B6, P10, B8, B9, P13, B11, B12, P16, B14, B15, P19, B17, P18 shown in Figure 47 (a) changes by coded sequence and to have arranged picture F (k+1) shown in Figure 45～F (k+17) and (k=1) obtain.The arrangement of a plurality of pictures shown in Figure 47 (a) is the arrangements at the last picture of time shaft (scramble time axle) Y of time (scramble time) Tenc that representes each picture is encoded.

Below, shown in Figure 47 (a), the situation that the piece enforcement P mode of P picture P16 is encoded describes.

In the case, in 4 forward direction P pictures (picture P4, P7, P10, P13), be suitable for the picture that the time carries out reference at coding with reference to one.Just, above-mentioned forward direction P picture P4, P7, P10, P13 are when the P of picture P16 mode is encoded, can specify the candidate screen that becomes with reference to picture.Give cross index respectively to these candidate screen P4, P7, P10, P13.

For in the giving of the cross index of such candidate screen, on above-mentioned scramble time axle Y, apart from the near more candidate screen of picture P16 that becomes coded object, the cross index that the value of being endowed is more little.Specifically, be exactly shown in Figure 47 (a), last, give cross index [0], [1], [2], [3] respectively to picture P13, P10, P7, P4.In addition, the information of the cross index that expression is given each candidate screen as the parameter of motion compensation, is recorded and narrated in the bit string of the object piece of corresponding picture P16.

Then, shown in Figure 47 (b), the situation that the piece enforcement B mode of B picture B15 is encoded describes.

In the case, behind 4 forward direction pictures (picture P4, P7, P10, P13) and 1 in picture (picture P16), with reference to two pictures that carry out reference when being suitable for encoding.Just, forward direction picture P4, P7, P10, P13 and back are when the B of picture B15 mode is encoded, can be designated as the candidate screen with reference to picture to picture P16.Behind 4 forward direction pictures and 1, become under the situation of candidate screen, give cross index forward direction picture P4, P7, P10, P13 to picture, and to the back to picture P16 give expression it by the code [b] of back to the candidate screen of reference.

Carrying out in the giving of cross index for such candidate screen, to the forward direction picture as candidate screen, on above-mentioned scramble time axle Y, the picture B15 of coded object is near more apart from becoming, just the more little cross index of the value of giving.Specifically, be exactly shown in Figure 47 (b), last at picture P13, P10, P7, P4, give cross index [0], [1], [2], [3].In addition, the information of the cross index that expression is given each candidate screen as the parameter of motion compensation, is recorded and narrated in the bit string of the object piece of corresponding picture B15.

Then, will advise at ITU-T being recorded and narrated in (AnnexU H.263++), the adding method of cross index, with short period picture memory and long period picture memory utilize method to associate to describe.

In the short period picture memory; Storage can be used as the candidate screen of carrying out appointment with reference to picture for markup in order; And to the candidate screen of being stored by give cross index (in other words, according to decoding order, or according to the bit string order) to the storage order of memory.In addition, when the B picture was decoded, the picture of in memory, being stored recently to treating with reference to picture, and to other picture, carried out giving of cross index with the storage order to memory as the back.

Below, just can be used as for the candidate with reference to picture of markup and utilize the situation of 4 forward direction pictures to describe particularly.

Figure 48 (a) and Figure 48 (b) are the figure of the part of expression a plurality of pictures of constituting moving image, wherein represent the situation of picture having been carried out arranging (Figure 48 (a)) and by coded sequence picture has been carried out arranging (Figure 48 (b)) by DISPLAY ORDER.In addition, picture P1, B2, B3, P4, B5, B6, P7, B8, B9, P10, B11, B12, P13, B14, B15, P16, B17, B18, the P19 shown in Figure 48 (a) is equivalent to picture F (k+3) shown in Figure 45～F (k+21) [k=-2].

Figure 49 is the figure with reference to the management example of picture memory that is used to explain for the picture of such arrangement.

In Figure 49;, markup is kept at when being encoded with reference to the coded picture in the picture memory; With corresponding preserve this storage area of coded picture the logical storage numbering and to this coded picture cross index of giving associate and represent.

In Figure 49, picture P16, B14, B15 are markup.Logical storage numbering (0)～(4), expression is with reference to the position in logic (storage area) in the picture memory.Be encoded time of (perhaps decoding) of the value of the logical storage numbering of corresponding each storage area, the picture of in storage area, being stored of processing is slow more, just becomes more little value.

Below, the management with reference to picture memory is described particularly.

When the coding (decoding) of picture P16, in reference to storage area picture memory, (0)～(3) expression of logical storage numbering, store picture P13, P10, P7, P4 respectively.Give cross index [0], [1], [2], [3] respectively to this picture P13, P10, P7, P4.

When the coding (decoding) of picture B14 and B15, in reference to storage area picture memory, (0)～(4) expression of logical storage numbering, picture P16, P13, P10, P7, P4 are arranged.At this moment, give expression as by the code [b] of back to the candidate screen of reference to picture P16, and to remaining by the candidate screen P13 of forward direction reference, P10, P7, P4, give cross index [0], [1], [2], [3] respectively.

The information of the reference marker that expression is given above-mentioned each candidate screen; It is the parameter of motion compensation; When the piece of markup is encoded, as expression will which picture in above-mentioned a plurality of candidate screen as having carried out the information of using with reference to picture, record is in should the bit string of piece.At this moment, in this cross index, its value is more little just gives short more code.

; In above-mentioned existing coding method, because when the piece for the B picture carries out predictive coding, I picture or P picture are designated as to reference to picture; So markup and can be elongated with reference to the distance of picture on showing time shaft (below, be also referred to as time gap).

For example; When in the predictive coding shown in Figure 48 (b) for the piece of B picture B15; Forward direction picture P13 and back are under picture P16 is designated as to the situation with reference to picture; Time gap Ltd between B picture B15 (markup) and the forward direction picture P13 (with reference to picture) (=t (15)-t (13)) shown in Figure 50 (a), becomes 2 picture interval (2Pitv).

In addition; When in predictive coding shown in Figure 48 (b), for the piece of B picture B15; Forward direction picture P13 and P10 are designated as under the situation with reference to picture; Time gap Ltd between B picture B15 (markup) and the forward direction picture P10 (with reference to picture) (=t (15)-t (10)) shown in Figure 50 (b), becomes 5 picture interval (5Pitv).

Especially when between I picture and P picture, the number of the B picture that is perhaps inserted between two of adjacency P pictures becomes under the many situation, markup and then become greatly with reference to the time gap Ltd between the picture, and this just becomes significantly low reason of code efficiency.

In addition; In common coding method, have can be in the B of picture mode is encoded, to apart from the near in time picture nearby of markup with reference to a plurality of back; Give than the distant place picture that this markup is far away in time certainly the situation of the cross index of value that also will be big.

In the case; In motion detection for the piece of markup; Because it is more by the situation of reference on the probability from the closer in time candidate screen of markup; In other words, more owing to being designated as with reference to the situation of picture apart from the closer in time candidate screen of markup, so cause the deterioration of code efficiency.

Below, just in the B mode for the piece of B picture B15 shown in Figure 51 (a) is encoded, describe particularly under to picture P16 and P19 after two by the situation of reference.

In the case; Shown in Figure 51 (a); Press picture B2, B3, P4, B5, B6, P7, B8, B9, P10, B11, B12, P13, B14, B15, P16, B17, B18, P19 that DISPLAY ORDER is arranged, changed row to become coded sequence P7, B2, B3, P10, B5, B6, P13, B8, B9, P16, B11, B12, P19, B14, the B15 shown in Figure 51 (b).

In addition, in the case, behind 3 forward direction pictures (picture P7, P10, P13) and 2 in picture (picture P16, P19), with reference to two pictures that are suitable for encoding process.Specifically, forward direction picture P7, P10, P13 and back are when the piece of picture B15 is encoded, can specify the candidate screen that becomes with reference to picture to picture P16, P19.Behind 3 forward direction pictures and 2,, as stated, become under the situation of candidate screen, give cross index to picture P16, P19 forward direction picture P7, P10, P13 and back to picture.

For in the giving of the cross index of such candidate screen, on above-mentioned scramble time axle Y, apart from the near more candidate screen of picture B15 that becomes coded object, the cross index that the value of being endowed is more little.Specifically, be exactly shown in Figure 51 (b), to picture P19, P16, P13, P10, P7, give cross index [0], [1], [2], [3], [4] respectively.

; In the case, showing on the time shaft X value [1] of the cross index that is endowed apart from the near P picture P16 of markup (picture B15); Just, just cause the deterioration of code efficiency than big from value [0] as the cross index of the B picture B15 of markup P picture P19 far away.

The present invention accomplishes for the problem points that solves above-mentioned that kind; Purpose provides the dynamic image encoding method that can avoid by the reduction of markup and and the code efficiency that cause long with reference to the time gap between the picture, and corresponding to the dynamic image decoding method of the dynamic image encoding method of the reduction that can avoid code efficiency like this.

In addition; The purpose of this invention is to provide can be in predictive coding is handled by the candidate screen of reference; Can not cause the deterioration of code efficiency and give the dynamic image encoding method of cross index, and corresponding to the dynamic image decoding method of the dynamic image encoding method of the deterioration that can avoid code efficiency like this.

Summary of the invention

According to dynamic image encoding method of the present invention; Be that a kind of a plurality of pictures the formation moving image are divided into a plurality of respectively; By the dynamic image encoding method that each piece is encoded to each picture, this method comprises the coding step that the piece of the markup that becomes coded object is carried out predictive coding with reference to coded picture; And above-mentioned coding step is when coded picture has carried out the B picture of predictive coding of piece of this markup with reference to two in markup, with reference at least one B picture of having encoded the piece of this markup is carried out predictive coding.

According to the present invention; In above-mentioned dynamic image encoding method; In above-mentioned coding step, when markup was the B picture, B picture of having encoded of reference carried out predictive coding to the piece of this markup; And in markup is when coded picture has carried out the P picture of predictive coding of its piece with reference to one, with reference to any B picture of having encoded each piece of this markup is not carried out predictive coding.

According to the present invention; In above-mentioned dynamic image encoding method; In each of a plurality of pictures that constitute above-mentioned moving image; Respectively in above-mentioned coding step as the I picture that does not carry out the coding of its piece with reference to coded picture, with reference to one coded picture carry out its piece predictive coding the P picture and with reference to two the coded picture a certain picture of B picture that carries out the predictive coding of its piece encoded; And; Above-mentioned coding step; When markup is the B picture; With reference at least one B picture of having encoded the piece of this markup is carried out predictive coding, and the candidate screen number with reference to picture of this markup reference when encoding, be equal to or less than the candidate number with reference to picture of reference when encoding this markup as the P picture as the B picture.

According to the present invention; In above-mentioned dynamic image encoding method; In each of a plurality of pictures that constitute above-mentioned moving image; Respectively in above-mentioned coding step as the I picture that does not carry out the coding of its piece with reference to coded picture, with reference to one coded picture carry out its piece predictive coding the P picture and with reference to two the coded picture a certain picture of B picture that carries out the predictive coding of its piece encoded; And; Above-mentioned coding step; When markup is the B picture, the B picture that the piece of this markup is carried out the reference of predictive coding time institute, just this markup and relatively this markup showing the B picture between immediate I in position on the time shaft or the P picture.

According to the present invention; In above-mentioned dynamic image encoding method; In above-mentioned coding step, when markup is the B picture, the piece of this markup is carried out predictive coding with reference at least one B picture of having encoded; And the B picture of having encoded of representing this reference is included in by in the resulting bit string that the picture that constitutes above-mentioned moving image is encoded in the picture position information that shows the position on the time shaft.

According to the present invention; In above-mentioned dynamic image encoding method; Above-mentioned picture position information, by from above-mentioned markup to the B picture of having encoded of time institute's reference that it is encoded, show that the distance on the time shaft is near more, the just short more code of code length is represented.

According to the present invention; In above-mentioned dynamic image encoding method; In above-mentioned coding step; When markup is the B picture, the piece of this markup is carried out predictive coding and in reference at least one B picture of having encoded by the resulting bit string of the coding of the picture that constitutes above-mentioned moving image, comprise the information that is illustrated in the B picture of having encoded of reference when encoding as the B picture of above-mentioned markup as heading message.

According to dynamic image encoding method of the present invention; Be that a kind of each a plurality of pictures that constitute moving image is divided into a plurality of respectively; The dynamic image encoding method of each picture being encoded by each piece; This method comprise at least with reference to one coded picture carry out with reference to and implement its piece predictive coding the P picture and with reference to two coded picture B pictures of carrying out the predictive coding of its piece, the coding step that the markup that becomes coded object is encoded; And; In above-mentioned coding step; Direct mode at the motion vector that is arranged in this markup reference block reference pictures of having encoded, that be positioned at the position spatially identical nearby with use with this object piece; When encoding, with reference to according to the determined coded picture of certain rule as the object piece of the B picture of markup.

According to the present invention; In above-mentioned dynamic image encoding method; In above-mentioned coding step, when above-mentioned object piece being encoded, with reference to being positioned near before the above-mentioned markup and DISPLAY ORDER first coded picture more Zao than this markup with direct mode.

According to the present invention, in above-mentioned dynamic image encoding method, comprise the reference pictures of having encoded of said reference piece, be the DISPLAY ORDER backward reference P picture slower than above-mentioned markup; And; In above-mentioned coding step; Based on the big or small MVR of the motion vector of said reference piece, above-mentioned backward reference P picture and this reference block be encoded second picture of time institute's reference showing on the time shaft apart from TRD, above-mentioned markup and above-mentioned first picture showing on the time shaft apart from TRF, above-mentioned markup and above-mentioned second picture showing on the time shaft apart from TRB; Obtain the forward motion vector (MVR * TRF/TRD) of above-mentioned object piece; And backward motion vector ((TRB-TRD) * MVR/TRD), and use this forward motion vector and this backward motion vector to carry out bi-directional predicted.

According to the present invention; In above-mentioned dynamic image encoding method; In above-mentioned coding step, when above-mentioned object piece being encoded, with reference to the forward direction of the coding picture the most nearby, that DISPLAY ORDER is more Zao than this markup that is positioned at above-mentioned markup with direct mode; And with reference to be positioned at above-mentioned markup the most nearby, DISPLAY ORDER than the slow coding of this markup after to picture, the motion vector that carries out above-mentioned object piece be 0 bi-directional predicted.

According to the present invention; In above-mentioned dynamic image encoding method; In above-mentioned coding step, when with direct mode above-mentioned object piece being encoded, the image information of economizing the whereabouts prediction error information and be 0 object piece is inserted in, bit string corresponding to above-mentioned moving image.

According to the present invention, in above-mentioned dynamic image encoding method, in above-mentioned coding step, be 0 o'clock in the prediction error information of above-mentioned object piece, the image information of saving this object piece is corresponding to the insertion in the bit string of above-mentioned moving image.

According to the present invention; In above-mentioned dynamic image encoding method; In above-mentioned coding step,, give with reference to picture index to becoming the candidate screen with reference to picture of when markup is encoded, carrying out reference; When the object piece being encoded, with reference to being endowed specific candidate screen with reference to picture index with direct mode.

According to the present invention; In above-mentioned dynamic image encoding method, in above-mentioned coding step, near the picture before the markup; Be only when markup is encoded as under the situation with reference to the candidate screen of picture; When this markup coding, carry out in the candidate screen of reference, to except near the picture that is positioned at the place ahead of this markup the picture before this markup, give above-mentioned specific with reference to picture index.

According to the present invention; In above-mentioned dynamic image encoding method; In above-mentioned coding step,, markup carries out in the candidate screen of reference when decoding, and more Zao to DISPLAY ORDER than this markup; Offscreen near the candidate screen of this markup except near before this markup given above-mentioned specific for picture index.

According to the present invention, in above-mentioned dynamic image encoding method, comprise the reference pictures of having encoded of said reference piece, be the DISPLAY ORDER backward reference P picture slower than above-mentioned markup; And in above-mentioned coding step, when with direct mode the object piece being encoded, reference is at the first forward direction picture reference of said reference block encoding time institute, that DISPLAY ORDER is more Zao than this markup.

According to the present invention; In above-mentioned dynamic image encoding method; In above-mentioned coding step; When above-mentioned object piece being encoded with direct mode; With reference to being positioned near DISPLAY ORDER than the second forward direction picture before the Zao markup of this markup, and, based on big or small MVR, above-mentioned backward reference P picture and the above-mentioned first forward direction picture of the motion vector of said reference piece show on the time shaft apart from TRD, above-mentioned markup and the above-mentioned second forward direction picture on the demonstration time shaft apart from TRF, above-mentioned markup and the above-mentioned first forward direction picture on the demonstration time shaft apart from TRB; Obtain forward motion vector (MVR * TRF/TRD), the backward motion vector ((TRB-TRD) * MVR/TRD) of the motion vector of above-mentioned object piece.

According to the present invention; In above-mentioned dynamic image encoding method; In above-mentioned coding step, with direct mode during to above-mentioned object block encoding, at the DISPLAY ORDER forward direction picture of treating reference more Zao than above-mentioned markup; Be not present in maintenance with reference under the situation in the memory of picture, more Zao with reference to DISPLAY ORDER, near the picture of this markup than above-mentioned markup.

According to dynamic image encoding method of the present invention; Be that a kind of each to a plurality of pictures of constituting moving image is encoded and generated the dynamic image encoding method to bit string that should each picture, this method comprises the coding step of markup to be encoded being encoded with reference to the picture of having encoded; And; Above-mentioned coding step comprises: a plurality of with reference to candidate screen to as in the candidate of the picture of above-mentioned time institute's reference that markup is encoded; The picture that the DISPLAY ORDER of its DISPLAY ORDER and this coded object picture is near more, step given in the index with reference to picture index that the value of giving is more little; And will the picture of above-mentioned time institute's reference that markup is encoded obtain to give with reference to picture index, be additional to the indexing step of above-mentioned bit string.

According to dynamic image encoding method of the present invention; Be that a kind of each to a plurality of pictures of constituting moving image is encoded and generated the dynamic image encoding method to bit string that should each picture, this method comprises the coding step of the markup that becomes the encoding process object being encoded with reference to the picture of encoding process; And, in above-mentioned coding step, in above-mentioned bit string, record and narrate the above-mentioned markup of expression for the encoding process of other later pictures of this markup the time whether as the sign that uses with reference to the candidate of picture.

According to dynamic image decoding method of the present invention; Be a kind of respectively to each of a plurality of pictures of constituting moving image; Each piece by as the processing unit of this picture is decoded; To be transformed into the dynamic image decoding method of view data to bit string that should each picture, and comprise with reference to decoded picture the piece of markup to be decoded is carried out the decoding step of prediction decoding; And, in above-mentioned decoding step, be when decoded picture has been carried out the B picture of prediction decoding of its piece with reference to two in markup, with reference at least one decoded B picture the piece of this markup is carried out prediction decoding.

According to the present invention; In above-mentioned dynamic image decoding method; In above-mentioned decoding step, when markup was the B picture, decoded B picture of reference carried out prediction decoding to the piece of this markup; And in markup is when decoded picture has been carried out the P picture of prediction decoding of its piece with reference to one, with reference to any decoded B picture each piece of this markup is not carried out prediction decoding.

According to the present invention; In above-mentioned dynamic image decoding method; In each of a plurality of pictures that constitute above-mentioned moving image; In above-mentioned decoding step as the I picture that does not carry out the decoding of its piece with reference to decoded picture, with reference to one decoded picture carry out its piece prediction decoding the P picture and with reference to two the decoded picture a certain picture of B picture that carries out the prediction decoding of its piece decoded; And; In above-mentioned decoding step; When markup is the B picture; With reference at least one decoded B picture the piece of this markup is carried out prediction decoding, and the candidate number with reference to picture of this markup reference when decoding, be equal to or less than the candidate number with reference to picture of reference when decoding this markup as the P picture as the B picture.

According to the present invention; In above-mentioned dynamic image decoding method; In each of a plurality of pictures that constitute above-mentioned moving image; In above-mentioned decoding step as the I picture that does not carry out the decoding of its piece with reference to decoded picture, with reference to one decoded picture carry out its piece prediction decoding the P picture and with reference to two the decoded picture a certain picture of B picture that carries out the prediction decoding of its piece decoded; And; In above-mentioned decoding step; When markup is the B picture, to the B picture that the piece of this markup carries out the reference of prediction decoding time institute, just insert in this markup and relatively this markup at the B picture that shows between immediate I in position on the time shaft or the P picture.

According to the present invention; In above-mentioned dynamic image decoding method; In above-mentioned decoding step, when markup is the B picture, is based on and is comprised in the above-mentioned bit string; Represent above-mentioned decoded B picture in the picture position information that shows the position on the time shaft, carry out the piece of this markup being carried out the processing of prediction decoding with reference to decoded B picture.

According to the present invention, in above-mentioned dynamic image decoding method, above-mentioned picture position information, near more by the distance decoded B picture from above-mentioned markup to time institute's reference of decoding at it, on the demonstration time shaft, code length is represented with regard to short more code.

According to the present invention; In above-mentioned dynamic image decoding method; In above-mentioned decoding step; When markup is the B picture, be based on corresponding to comprised in the bit string as the picture of the composition that constitutes above-mentioned moving image, be illustrated in when the object B picture encoded with reference to the heading message of this situation of B picture of having encoded, carry out the piece of this markup being carried out the processing of prediction decoding with reference at least one decoded B picture.

According to dynamic image decoding method of the present invention; Be a kind of respectively to each of a plurality of pictures of constituting moving image; Each piece for as the processing unit of each picture is decoded; Thereby will be for conversion into the dynamic image decoding method of view data corresponding to the bit string of this each picture; This method comprise with reference at least to one decoded picture carry out with reference to and implement its piece prediction decoding the P picture and with reference to two decoded picture carry out the B picture of the prediction decoding of its piece, markup to be decoded is carried out the decoding step of prediction decoding; And; In above-mentioned decoding step; Direct mode at the motion vector that is arranged in this markup reference block decoded reference pictures, that be positioned at the position spatially identical nearby with use with this object piece; When decoding, with reference to according to the determined decoded picture of certain rule as the object piece of the B picture of markup.

According to the present invention; In above-mentioned dynamic image decoding method; In above-mentioned decoding step, when above-mentioned object piece being decoded, with reference to being positioned near before the above-mentioned markup and DISPLAY ORDER first coded picture more Zao than this markup with direct mode.

According to the present invention, in above-mentioned dynamic image decoding method, comprise the decoded reference pictures of said reference piece, be the DISPLAY ORDER backward reference P picture slower than above-mentioned markup; And; In above-mentioned decoding step; Based on the big or small MVR of the motion vector of said reference piece, above-mentioned backward reference P picture and second picture of this reference block institute's reference of decoded time showing on the time shaft apart from TRD, above-mentioned markup and above-mentioned first picture showing on the time shaft apart from TRF, above-mentioned markup and above-mentioned second picture showing on the time shaft apart from TRB; Obtain forward motion vector (MVR * TRF/TRD), and backward motion vector ((TRB-TRD) * MVR/TRD) of above-mentioned object piece.

According to the present invention; In above-mentioned dynamic image decoding method; In above-mentioned decoding step, when above-mentioned object piece being decoded, with reference to the forward direction of the decoding picture the most nearby, that DISPLAY ORDER is more Zao than this markup that is positioned at above-mentioned markup with direct mode; And with reference to be positioned at above-mentioned markup the most nearby, DISPLAY ORDER than the slow decoding of this markup after to picture, the motion vector that carries out above-mentioned object piece be 0 bi-directional predicted.

According to the present invention; In above-mentioned dynamic image decoding method; In above-mentioned decoding step; When above-mentioned object piece being decoded with direct mode, use the motion vector of said reference piece, to be not included in the above-mentioned bit string, prediction error information is that the image information of 0 object piece is restored.

According to the present invention, in above-mentioned dynamic image decoding method, in above-mentioned decoding step, use the motion vector of said reference piece, to be not included in the above-mentioned bit string, prediction error information is that the image information of 0 object piece is restored.

According to the present invention, in above-mentioned dynamic image decoding method,, give with reference to picture index to when markup is decoded, carrying out the candidate screen of the picture of reference; And, in above-mentioned decoding step, when the object piece being decoded, with reference to being endowed specific picture with reference to picture index with direct mode.

According to the present invention; In above-mentioned dynamic image decoding method; Near the picture before the markup,, markup, when this markup decoding, carries out in the candidate screen of reference when being decoded only as under the situation with reference to candidate screen; To except near the offscreen picture that is positioned at the place ahead of this markup before this markup, give above-mentioned specific with reference to picture index; And, in above-mentioned decoding step, when the object piece being decoded, with reference to being endowed above-mentioned specific picture with reference to picture index with direct mode.

According to the present invention; In above-mentioned dynamic image decoding method; Above-mentioned specific with reference to picture index,, markup carries out in the candidate screen of reference when being decoded, and more Zao to DISPLAY ORDER than this markup; Offscreen near the candidate screen of this markup except near before this markup given; And, in above-mentioned decoding step, when the object piece being decoded, with reference to being endowed above-mentioned specific picture with reference to picture index with direct mode.

According to the present invention, in above-mentioned dynamic image decoding method, comprise the decoded reference pictures of said reference piece, be the DISPLAY ORDER backward reference P picture slower than above-mentioned markup; And in above-mentioned decoding step, when with direct mode the object piece being decoded, reference is at the first forward direction picture institute's reference of decoded time of said reference piece, that DISPLAY ORDER is more Zao than above-mentioned markup.

According to the present invention; In above-mentioned dynamic image decoding method; In above-mentioned decoding step; When above-mentioned object piece being decoded with direct mode; With reference to being positioned near DISPLAY ORDER than the second forward direction picture before the Zao markup of this markup, and, based on big or small MVR, above-mentioned backward reference P picture and the above-mentioned first forward direction picture of the motion vector of said reference piece show on the time shaft apart from TRD, above-mentioned markup and the above-mentioned second forward direction picture on the demonstration time shaft apart from TRF, above-mentioned markup and the above-mentioned first forward direction picture on the demonstration time shaft apart from TRB; Obtain forward motion vector (MVR * TRF/TRD), and backward motion vector ((TRB-TRD) * MVR/TRD) of the motion vector of above-mentioned object piece.

According to the present invention; In above-mentioned dynamic image decoding method; In above-mentioned decoding step, when above-mentioned object piece being decoded, at the DISPLAY ORDER forward direction picture of treating reference more Zao than above-mentioned markup with direct mode; Be not present in maintenance with reference under the situation in the memory of picture, more Zao with reference to DISPLAY ORDER, near the picture of this markup than above-mentioned markup.

According to dynamic image decoding method of the present invention; Be that a kind of each to a plurality of pictures of constituting moving image is decoded and will be transformed into the dynamic image decoding method of view data corresponding to the bit string of this each picture, this method comprises the decoding step of markup to be decoded being decoded with reference to decoded picture; And; Above-mentioned decoding step comprises: a plurality of with reference to candidate screen to as in the candidate of the picture of above-mentioned time institute's reference that markup is decoded; The picture that the DISPLAY ORDER of its DISPLAY ORDER and this decoder object picture is near more; Step given in the index with reference to picture index that the value of giving is more little; With added in the bit string that is based on above-mentioned markup, the picture of above-mentioned time institute's reference that markup is encoded obtain to give with reference to picture index, and above-mentioned index give be endowed in the step with reference to candidate screen with reference to picture index, confirm to confirm step with reference to picture at the picture of above-mentioned time institute's reference that markup is decoded.

According to dynamic image decoding method of the present invention; Be that a kind of each to a plurality of pictures of constituting moving image is decoded respectively; To be transformed into the dynamic image decoding method of view data to bit string that should each picture, this method comprises the decoding step of the markup that becomes decoder object being decoded with reference at least one decoded picture, in above-mentioned bit string, record and narrate have the above-mentioned markup of expression for other later pictures of this markup when decoded whether as the sign that uses with reference to the candidate of picture; And; In above-mentioned decoding step,, carry out the management of decoded markup based on above-mentioned sign.

As stated; In the present invention; Moving image provides a kind of each a plurality of pictures that constitute moving image to be divided into a plurality of respectively; And by the dynamic image encoding method that each piece is encoded to each picture, this method comprises the coding step that the piece of the markup that becomes coded object is carried out predictive coding with reference to coded picture; And; In above-mentioned coding step; In markup is when coded picture has carried out the B picture of predictive coding of its piece with reference to two, with reference at least one B picture of having encoded the piece of this markup is carried out predictive coding, therefore; Just can, the B picture use the relative immediate forward direction of this B picture when being encoded with reference to picture.Thus, just can improve the precision of prediction of the motion compensation of B picture, can obtain the raising of code efficiency.

In above-mentioned dynamic image encoding method; In above-mentioned coding step; When markup is the B picture; With reference to the B picture of having encoded the piece of this markup is carried out predictive coding, and be when coded picture has carried out the P picture of predictive coding of its piece with reference to one, each piece of this markup is not carried out predictive coding with reference to any B picture of having encoded in markup.Therefore, just can become with reference to the candidate screen in the memory of the picture of the candidate of picture and manage storage.

In above-mentioned dynamic image encoding method; Constitute each of a plurality of pictures of above-mentioned moving image; Respectively in above-mentioned coding step as the I picture that does not carry out the coding of its piece with reference to coded picture; With reference to one coded picture carry out its piece predictive coding the P picture and with reference to two the coded picture a certain picture of B picture that carries out the predictive coding of its piece encoded; And; In above-mentioned coding step; When markup is the B picture; With reference at least one B picture of having encoded the piece of this markup is carried out predictive coding, and the candidate number with reference to picture of this markup reference when encoding, be equal to or less than the candidate number with reference to picture of reference when encoding this markup as the P picture as the B picture.Therefore, just can avoid owing to when the B picture is encoded, causing storing increase with reference to the capacity of the memory of candidate screen with reference to other B picture.

In above-mentioned dynamic image encoding method; Constitute each of a plurality of pictures of above-mentioned moving image; Respectively in above-mentioned coding step as the I picture that does not carry out the coding of its piece with reference to coded picture; With reference to one coded picture carry out its piece predictive coding the P picture and with reference to two the coded picture a certain picture of B picture that carries out the predictive coding of its piece encoded; And; In above-mentioned coding step; When markup is the B picture,, just be inserted in this markup and the B picture of this markup between immediate I on the DISPLAY ORDER or P picture relatively to the B picture that the piece of this markup carries out the reference of predictive coding time institute.Therefore, just can improve the precision of prediction in the motion compensation of B picture, and can obtain the raising of code efficiency.

In above-mentioned dynamic image encoding method; In above-mentioned coding step; When markup is the B picture; With reference at least one B picture of having encoded the piece of this markup is carried out predictive coding, and with the B picture of having encoded of this reference, expression shows and is included in the picture position information of the position on the time shaft by in the resulting bit string of the coding of the picture that constitutes above-mentioned moving image.Therefore, just can detect simply when the B picture is encoded as employed with reference to candidate B picture in the decoding side with reference to picture.

In above-mentioned dynamic image encoding method, above-mentioned picture position information, by the B picture of having encoded from above-mentioned markup to time institute's reference of encoding at it, show that the distance on the time shaft is near more, the just short more code of code length is represented.Therefore, just can reduce the needed size of code of being used by the candidate screen of forward direction reference when being illustrated in the decoding side and being identified in the B picture and being encoded of information.

In above-mentioned dynamic image encoding method, in above-mentioned coding step, when markup is the B picture, the piece of this markup is carried out predictive coding with reference at least one B picture of having encoded; And, in by the resulting bit string of the coding of the picture that constitutes above-mentioned moving image, comprise as heading message and to be illustrated in when encoding with reference to the information of the B picture situation of having encoded as the B picture of above-mentioned markup.The B picture that therefore, just can detect when the B picture is encoded other simply in the decoding side is by the situation of forward direction reference.

In addition; In moving image of the present invention; Provide a kind of each a plurality of pictures that constitute moving image to be divided into a plurality of respectively; By the dynamic image encoding method that each piece is encoded to each picture, this method comprise with reference at least to one coded picture carry out with reference to and implement its piece predictive coding the P picture and with reference to two coded picture B pictures of carrying out the predictive coding of its piece, the coding step that the markup that becomes coded object is carried out predictive coding; And; In above-mentioned coding step; In the direct mode of the motion vector that is arranged in this markup reference block reference pictures of having encoded, that be positioned at the position spatially identical nearby with use, when encoding, with reference to according to the determined coded picture of certain rule as the object piece of the B picture of markup with this object piece; Therefore, can make forecasting efficiency optimum according to the coding situation.

In above-mentioned dynamic image encoding method, in above-mentioned coding step, when above-mentioned object piece being encoded, with reference to being positioned near first coded picture before the above-mentioned markup, that DISPLAY ORDER is more Zao than this markup with direct mode.Therefore, the coded prediction efficient of B picture under direct mode is improved.

In above-mentioned dynamic image encoding method, comprise the reference pictures of having encoded of said reference piece, be the DISPLAY ORDER backward reference P picture slower than above-mentioned markup; And; In above-mentioned coding step; Based on the big or small MVR of the motion vector of said reference piece, above-mentioned backward reference P picture and this reference block be encoded second picture of time institute's reference showing on the time shaft apart from TRD, above-mentioned markup and above-mentioned first picture showing on the time shaft apart from TRF, above-mentioned markup and above-mentioned second picture showing on the time shaft apart from TRB; Obtain the forward motion vector (MVR * TRF/TRD) of above-mentioned object piece; And backward motion vector ((TRB-TRD) * MVR/TRD), and use this forward motion vector and this backward motion vector to carry out bi-directional predicted.Therefore, just can be created on the motion vector of the object piece that uses the direct mode well from the motion vector precision of the piece beyond the object piece.

In above-mentioned dynamic image encoding method; In above-mentioned coding step; When above-mentioned object piece being encoded with direct mode; With reference to being positioned at the forward direction of the coding picture, that DISPLAY ORDER is Zao than this markup of above-mentioned markup the most nearby, and reference be positioned at above-mentioned markup the most nearby, DISPLAY ORDER than the slow coding of this markup after to picture, the motion vector that carries out above-mentioned object piece be 0 bi-directional predicted.Therefore, in the process that the B picture is encoded under direct mode, just do not need the calibration of motion vector to handle, can obtain the reduction of treating capacity.

In above-mentioned dynamic image encoding method, in above-mentioned coding step, when above-mentioned object piece being encoded, economize the whereabouts prediction error information and be the insertion of bit string image information, corresponding above-mentioned moving image of 0 object piece with direct mode.Therefore, the reduction of size of code just becomes possibility.

In above-mentioned dynamic image encoding method, in above-mentioned coding step, be 0 o'clock in the prediction error information of above-mentioned object piece, economize the insertion in bit string image information, corresponding above-mentioned moving image of this object piece of whereabouts.Therefore, the reduction of size of code just becomes possibility.

In above-mentioned dynamic image encoding method; In above-mentioned coding step; Picture to the candidate that becomes the picture that when markup is encoded, carries out reference; Give with reference to picture index, and when with direct mode the object piece being encoded, with reference to being endowed the specific picture with reference to picture index.Therefore, can make forecasting efficiency optimum according to the coding situation.

In above-mentioned dynamic image encoding method; In above-mentioned coding step; Near the picture before the markup, be when markup is encoded only as under the situation with reference to the picture of the candidate of picture, when markup is encoded, carry out in the candidate screen of reference; To except near the offscreen picture that is positioned at the place ahead of this markup before this markup, give above-mentioned specific with reference to picture index.Therefore, the coded prediction efficient of B picture under direct mode is improved and just become possibility.

In above-mentioned dynamic image encoding method; In above-mentioned coding step;, markup carries out when being encoded in the candidate screen of reference, and more Zao to DISPLAY ORDER than this markup, beyond the picture before this markup; Near the candidate screen of this markup, give above-mentioned specific with reference to picture index.Therefore, the coded prediction efficient of B picture under direct mode is improved and just become possibility.

In above-mentioned dynamic image encoding method, comprising the reference pictures of having encoded of said reference piece, be the DISPLAY ORDER backward reference P picture slower than above-mentioned markup; And, in above-mentioned coding step, when the object piece being encoded, with reference to first forward direction picture time institute's reference, that DISPLAY ORDER is more Zao than this markup that is encoded at the said reference piece with direct mode.Therefore, the coded prediction efficient of B picture under direct mode is improved and just become possibility.

In above-mentioned dynamic image encoding method; In above-mentioned coding step; When above-mentioned object piece being encoded with direct mode; With reference to being positioned near DISPLAY ORDER than the second forward direction picture before the Zao markup of this markup; Based on big or small MVR, above-mentioned backward reference P picture and the above-mentioned first forward direction picture of the motion vector of said reference piece show on the time shaft apart from TRD, above-mentioned markup and the above-mentioned second forward direction picture showing on the time shaft apart from TRF, above-mentioned markup and the above-mentioned first forward direction picture showing on the time shaft apart from TRB; Obtain forward motion vector (MVR * TRF/TRD), and backward motion vector ((TRB-TRD) * MVR/TRD) of the motion vector of above-mentioned object piece.Therefore, just can be created on the motion vector of the object piece that uses the direct mode well from the motion vector precision of the piece beyond the object piece.

In above-mentioned dynamic image encoding method; In above-mentioned coding step; When above-mentioned object piece being encoded,, be not present in maintenance with reference under the situation in the memory of picture at the DISPLAY ORDER forward direction picture of treating reference more Zao than above-mentioned markup with direct mode; More Zao with reference to DISPLAY ORDER than above-mentioned markup, near the picture of this markup.Therefore, just can avoid the forecasting efficiency in the process that the B picture is encoded under direct mode to reduce greatly.

In addition; In the present invention; Provide a kind of each to a plurality of pictures of constituting moving image to encode respectively; Generation is to the dynamic image encoding method of bit string that should each picture, and this method comprises the coding step of the markup that becomes coded object being encoded with reference to the picture of having encoded; And above-mentioned coding step comprises; A plurality of to as in the candidate of the picture of above-mentioned time institute's reference that markup is encoded with reference to candidate screen; The picture that the DISPLAY ORDER of its DISPLAY ORDER and this coded object picture is near more, step given in the index with reference to picture index that the value of giving is more little; With will above-mentioned picture of markup being encoded time institute's reference be endowed with reference to picture index, be additional to the indexing step of above-mentioned bit string.Therefore, just can be to as the most selecteed in time near the picture of markup with reference to picture, give littler of picture index, thus, just can make with reference to the size of code of picture index minimum, and the raising of acquisition code efficiency.

In addition; In the present invention; Provide a kind of each to a plurality of pictures of constituting moving image to encode respectively; Generation is to the dynamic image encoding method of bit string that should each picture, and this method comprises the coding step of the markup that becomes the encoding process object being encoded with reference to the picture of encoding process; And, in above-mentioned coding step, in above-mentioned bit string, record and narrate the above-mentioned markup of expression for the encoding process of other later pictures of this markup the time whether as the sign that uses with reference to the candidate of picture.Therefore; For example; When being encoded for the B picture of implementing the bi-directional predictive coding processing; The immediate forward direction picture of this B picture position just becomes possibility as using with reference to picture relatively, just can improve the precision of prediction of the motion compensation of B picture, and can obtain the raising of code efficiency.

In the present invention; Provide a kind of respectively to each of a plurality of pictures of constituting moving image; Each piece of processing unit by as this picture is decoded; To be transformed into the dynamic image decoding method of view data to bit string that should each picture, this method comprises with reference to decoded picture carries out the decoding step of prediction decoding to the piece of markup to be decoded; And, in above-mentioned decoding step, be when decoded picture has been carried out the B picture of prediction decoding of its piece with reference to two in markup, with reference to decoded B picture the piece of this markup is carried out prediction decoding.Therefore, just can the B picture be used as the candidate screen of forward direction reference and the piece of coded B picture is correctly decoded.

In above-mentioned dynamic image decoding method; In above-mentioned decoding step; When markup is the B picture; With reference to decoded B picture the piece of this markup being carried out prediction decoding, is when decoded picture has been carried out the P picture of prediction decoding of its piece with reference to one in markup, with reference to decoded B picture each piece of this markup is not carried out prediction decoding.Therefore, the management that becomes with reference to the candidate screen in the memory of the picture of the candidate of picture in storage just becomes simple.

In above-mentioned dynamic image decoding method; Constitute each of a plurality of pictures of above-mentioned moving image; Respectively in above-mentioned decoding step as the I picture that does not carry out the decoding of its piece with reference to decoded picture; With reference to one decoded picture carry out its piece prediction decoding the P picture and with reference to two the decoded picture a certain picture of B picture that carries out the prediction decoding of its piece decoded; And; In above-mentioned decoding step; When markup is the B picture; With reference to decoded B picture the piece of this markup is carried out prediction decoding, and the candidate number with reference to picture of this markup reference when decoding, be equal to or less than the candidate number with reference to picture of reference when decoding this markup as the P picture as the B picture.Therefore, just can avoid owing to when the B picture is decoded, causing storing increase with reference to the capacity of the memory of candidate screen with reference to other B picture.

In above-mentioned dynamic image decoding method; Constitute each of a plurality of pictures of above-mentioned moving image; Respectively in above-mentioned decoding step as the I picture that does not carry out the decoding of its piece with reference to decoded picture; With reference to one decoded picture carry out its piece prediction decoding the P picture and with reference to two the decoded picture a certain picture of B picture that carries out the prediction decoding of its piece decoded; And; In above-mentioned decoding step; When markup is the B picture, the B picture that the piece of this markup is carried out the reference of prediction decoding time institute, just this markup and relatively this markup showing the B picture between immediate I in position on the time shaft or the P picture.Therefore, just can improve the precision of prediction in the motion compensation of B picture, and can obtain the raising of code efficiency.

In above-mentioned dynamic image decoding method; In above-mentioned decoding step; When markup is the B picture; Be based on that comprised in the above-mentioned bit string, above-mentioned decoded B picture, be illustrated in the picture position information that shows the position on the time shaft, carry out the piece of this markup being carried out the processing of prediction decoding with reference to decoded B picture.Therefore, just can correctly differentiate when the B picture is encoded as employed with reference to candidate B picture in the decoding side with reference to picture.

In above-mentioned dynamic image decoding method, above-mentioned picture position information by the decoded B picture from above-mentioned markup to time institute's reference of decoding at it, shows that the distance on the time shaft is near more, and the just short more code of code length is represented.Therefore, just can subdue the needed size of code of when the decoding side is identified in the B picture and is encoded, being used of information by the candidate screen of forward direction reference.

In above-mentioned dynamic image decoding method; In above-mentioned decoding step; When markup is the B picture; Be based on and comprised in the bit string of the corresponding picture that constitutes above-mentioned moving image, be illustrated in when encoding, carry out the piece of this markup being carried out the processing of prediction decoding with reference to decoded B picture with reference to the heading message of the B picture situation of having encoded as the B picture of above-mentioned markup.Therefore, just can be in handling for the prediction decoding of object piece, the B picture of reliably and promptly differentiating when the B picture is encoded other is by the situation of forward direction reference.

In addition; In the present invention; Provide a kind of and decode by each piece of processing unit, will be transformed into the dynamic image decoding method of view data bit string that should each picture as this picture respectively to a plurality of pictures of constituting moving image each; This method comprises reference at least; To one decoded picture carry out with reference to and implement its piece prediction decoding the P picture and with reference to two decoded picture carry out the B picture of the prediction decoding of its piece, markup to be decoded is carried out the decoding step of prediction decoding; And; In above-mentioned decoding step; Direct mode at the motion vector that is arranged in this markup reference block decoded reference pictures, that be positioned at the position spatially identical nearby with use with this object piece; When decoding, with reference to according to the determined decoded picture of certain rule as the object piece of the B picture of markup.Therefore, just can realize corresponding to the coding/decoding method that can make the optimum coding method of forecasting efficiency according to the coding situation.

In above-mentioned dynamic image decoding method, in above-mentioned decoding step, when above-mentioned object piece being decoded with direct mode, with reference to being positioned near before the above-mentioned markup, first coded picture that DISPLAY ORDER is more Zao than this markup.Therefore, B picture forecasting efficiency in the decoded process under direct mode is improved.

In above-mentioned dynamic image decoding method, comprise the decoded reference pictures of said reference piece, be the DISPLAY ORDER backward reference P picture slower than above-mentioned markup; And; In above-mentioned decoding step; Based on the big or small MVR of the motion vector of said reference piece, above-mentioned backward reference P picture and second picture of this reference block institute's reference of decoded time showing on the time shaft apart from TRD, above-mentioned markup and above-mentioned first picture showing on the time shaft apart from TRF, above-mentioned markup and above-mentioned second picture showing on the time shaft apart from TRB; Obtain forward motion vector (MVR * TRF/TRD), and backward motion vector ((TRB-TRD) * MVR/TRD) of above-mentioned object piece.Therefore, just can be created on the motion vector of the object piece that uses the direct mode well from the motion vector precision of the piece beyond the object piece.

In above-mentioned dynamic image decoding method; In above-mentioned decoding step, when above-mentioned object piece being decoded with direct mode, with reference to be positioned at above-mentioned markup the most nearby; The forward direction of the decoding picture that DISPLAY ORDER is more Zao than this markup; And with reference to be positioned at above-mentioned markup the most nearby, DISPLAY ORDER than the slow decoding of this markup after to picture, the motion vector that carries out above-mentioned object piece be 0 bi-directional predicted.Therefore, under direct mode, in the decoded process, just do not need the calibration of motion vector to handle, can obtain alleviating of treating capacity at the B picture.

In above-mentioned dynamic image decoding method; In above-mentioned decoding step, when above-mentioned object piece being decoded, use the motion vector of said reference piece with direct mode; To not being included in the above-mentioned bit string, prediction error information is that the image information of 0 object piece is restored.Therefore, just can use the motion vector of other pieces, to be not included in the bit string, prediction error information is that 0 object piece carries out prediction decoding.

In above-mentioned dynamic image decoding method, in above-mentioned decoding step, use the motion vector of said reference piece, to not being included in the above-mentioned bit string, prediction error information is that the image information of 0 object piece is restored.Therefore, just can use the motion vector of other pieces, to be not included in the bit string, prediction error information is that 0 object piece carries out prediction decoding.

In above-mentioned dynamic image decoding method; Picture to the candidate that becomes the picture that when markup is decoded, carries out reference is given with reference to picture index; In above-mentioned decoding step; When the object piece being decoded, with reference to being endowed specific picture with reference to picture index with direct mode.Therefore, just can realize corresponding to the coding/decoding method that can make the optimum coding method of forecasting efficiency according to the coding situation.

In above-mentioned dynamic image decoding method; Near the picture before the markup; Be only as under the situation with reference to the picture of candidate when markup is decoded; When this is decoded to markup, carry out in the candidate screen of reference, to except near the offscreen picture that is positioned at the place ahead of this markup before this markup, give above-mentioned specific with reference to picture index; And, in above-mentioned decoding step, when the object piece being decoded, with reference to being endowed above-mentioned specific picture with reference to picture index with direct mode.Therefore, the decoding forecasting efficiency of B picture under direct mode improved and just become possibility.

In above-mentioned dynamic image decoding method; Above-mentioned specific with reference to picture index;, markup carries out when being decoded in the candidate screen of reference, and more Zao to DISPLAY ORDER than this markup, beyond the picture before this markup; Near the candidate screen of this markup, give; And, in above-mentioned decoding step, when the object piece being decoded, with reference to being endowed above-mentioned specific picture with reference to picture index with direct mode.Therefore, the decoding forecasting efficiency of B picture under direct mode improved and just become possibility.

In above-mentioned dynamic image decoding method, comprise the decoded reference pictures of said reference piece, be the DISPLAY ORDER backward reference P picture slower than above-mentioned markup; And, in above-mentioned decoding step, when the object piece being decoded with direct mode, with reference in the institute's reference of decoded time of said reference piece, the first forward direction picture that DISPLAY ORDER is more Zao than above-mentioned markup.Therefore, the decoding forecasting efficiency of B picture under direct mode improved and just become possibility.

In above-mentioned dynamic image decoding method; In above-mentioned decoding step; When above-mentioned object piece being decoded with direct mode; With reference to being positioned near DISPLAY ORDER than the second forward direction picture before the Zao markup of this markup; Based on big or small MVR, above-mentioned backward reference P picture and the above-mentioned first forward direction picture of the motion vector of said reference piece show on the time shaft apart from TRD, above-mentioned markup and the above-mentioned second forward direction picture showing on the time shaft apart from TRF, above-mentioned markup and the above-mentioned first forward direction picture showing on the time shaft apart from TRB; Obtain forward motion vector (MVR * TRF/TRD), and backward motion vector ((TRB-TRD) * MVR/TRD) of the motion vector of above-mentioned object piece.Therefore, just can be created on the motion vector of the object piece that uses the direct mode well from the motion vector precision of the piece beyond the object piece.

In above-mentioned dynamic image decoding method; In above-mentioned decoding step; When above-mentioned object piece being decoded,, be not present in maintenance with reference under the situation in the memory of picture at the DISPLAY ORDER forward direction picture of treating reference more Zao than above-mentioned markup with direct mode; More Zao with reference to DISPLAY ORDER than above-mentioned markup, near the picture of this markup.Therefore, just can avoid B picture forecasting efficiency in the decoded process under direct mode to reduce in a large number.

In addition; In the present invention; Provide a kind of each to a plurality of pictures of constituting moving image to decode respectively; To be transformed into the dynamic image decoding method of view data to bit string that should each picture, this method comprises the decoding step of markup to be decoded being decoded with reference to decoded picture; And above-mentioned decoding step comprises; A plurality of to as in the candidate of the picture of above-mentioned time institute's reference that markup is decoded with reference to candidate screen; The picture that the DISPLAY ORDER of its DISPLAY ORDER and this decoder object picture is near more, step given in the index with reference to picture index that the value of giving is more little; With added in the bit string that is based on above-mentioned markup; Above-mentioned picture of markup being encoded time institute's reference be endowed with reference to picture index; And above-mentioned index give be endowed in the step with reference to candidate screen with reference to picture index, confirm to confirm step with reference to picture at the picture of above-mentioned time institute's reference that markup is decoded.Therefore, just can correctly decode, by can to the most selecteed in time near the picture of markup, give the littler high bit string that coding method generated of the code efficiency with reference to picture index.

In addition; In the present invention; Provide a kind of each to a plurality of pictures of constituting moving image to decode respectively; To be transformed into the dynamic image decoding method of view data to bit string that should each picture, this method comprises the decoding step of the markup that becomes the decoding processing object being decoded with reference to the picture of decoding processing; In above-mentioned bit string, record and narrate have the above-mentioned markup of expression for the decoding processing of other later pictures of this markup the time whether as the sign that uses with reference to the candidate of picture; And in above-mentioned decoding step; Based on above-mentioned sign, implemented the management of the markup of decoding processing.Therefore, just can correctly decode, with reference to picture, except that the P picture of having implemented the forward predictive coded processing, also use and implemented the B picture bit string that generated, corresponding B picture that bi-directional predictive coding is handled as forward direction.

Description of drawings

Fig. 1 is the block diagram that explanation utilizes the dynamic image encoding device of execution mode 1 of the present invention.

Fig. 2 (a) and 2 (b) are the sketch mapes that explanation utilizes the dynamic image encoding method of execution mode 1 of the present invention, the wherein arrangement of the DISPLAY ORDER of Fig. 2 (a) expression picture, the arrangement of the coded sequence of Fig. 2 (b) expression picture.

Fig. 3 is the sketch map of moving image decoding apparatus of dynamic image encoding device and the execution mode 2 of explanation execution mode 1, representes the interior P of diode-capacitor storage in the lump, the method for B picture.

Fig. 4 (a) and 4 (b) are the key diagrams of execution mode 1, the 1st example (Fig. 4 (a)) and the 2nd example (Fig. 4 (b)) of expression direct mode coding (picture B11).

Fig. 5 (a) and 5 (b) are the sketch mapes of execution mode 1, the 3rd example (5 (a)) and the 4th example (5 (b)) of expression direct mode coding (picture B11).

Fig. 6 (a)-6 (c) is the key diagram of execution mode 1, and the 5th example (6 (a)) of expression direct mode coding (picture B11) is jumped over piece (Fig. 6 (b)) and jumped over identifier (Fig. 6 (c)).

Fig. 7 (a) and 7 (b) are the key diagrams of execution mode 1, the 1st example (7 (a)) and the 2nd example (7 (b)) of expression direct mode coding (picture B12).

Fig. 8 (a) and 8 (b) are the key diagrams of execution mode 1, the 3rd example (8 (a)) and the 4th example (8 (b)) of expression direct mode coding (picture B12).

Fig. 9 (a) and 9 (b) are the key diagrams of execution mode 1, and expression is with reference to the 1st example (9 (a)) of the B picture more on the front of immediate forward direction P picture and the 2nd example (, 9 (b)).

Figure 10 (a) and 10 (b) are the key diagrams of execution mode 1, and expression is not with reference to the 1st example (10 (a)) and the 2nd example (10 (b)) of the B picture more on the front of immediate forward direction I picture or P picture.

Figure 11 is the key diagram of execution mode 1 and 2, the 1st method that expression is separately managed the P picture in the memory and B picture.

Figure 12 is the key diagram of execution mode 1 and 2, the 2nd method that expression is separately managed the P picture in the memory and B picture.

Figure 13 is the key diagram of execution mode 1 and 2, the 3rd method that expression is separately managed the P picture in the memory and B picture.

Figure 14 is the key diagram of execution mode 1 and 2, the 4th method that expression is separately managed the P picture in the memory and B picture.

Figure 15 is the block diagram that explanation utilizes the moving image decoding apparatus of execution mode 2 of the present invention to use.

Figure 16 (a) and 16 (b) are the sketch mapes that explanation utilizes the dynamic image decoding method of execution mode 2 of the present invention, the wherein arrangement of the decoding order of 16 (a) expression picture, the arrangement of the DISPLAY ORDER of 16 (b) expression picture.

Figure 17 is the key diagram of execution mode 2, representes bi-directional predicted decoding (picture B11).

Figure 18 (a) and 18 (b) are the key diagrams of execution mode 2, the 1st example (18 (a)) and the 2nd example (18 (b)) of expression direct mode decoding (picture B11).

Figure 19 (a) and 19 (b) are the key diagrams of execution mode 2, the 3rd example (19 (a)) and the 4th example (19 (b)) of expression direct mode decoding (picture B11).

Figure 20 is the key diagram of execution mode 2, representes bi-directional predicted decoding (picture B12).

Figure 21 (a) and 21 (b) are the key diagrams of execution mode 2, the 1st example (21 (a)) and the 2nd example (21 (b)) of expression direct mode decoding (picture B12).

Figure 22 (a) and 22 (b) are the key diagrams of execution mode 2, the 3rd example (22 (a)) and the 4th example (22 (b)) of expression direct mode decoding (picture B12).

Figure 23 is the block diagram that explanation utilizes the dynamic image encoding device of execution mode 3 of the present invention to use.

Figure 24 is the sketch map of dynamic image encoding device of explanation execution mode 3, representes the P in the diode-capacitor storage in the lump, the method for B picture.

Figure 25 (a) and 25 (b) are the key diagrams of above-mentioned execution mode 3, and the situation near the decoding of the situation (25 (a)) of the decoding of the B picture after the P picture and the picture be not scheduled to is not carried out in expression.

Figure 26 is the block diagram that explanation utilizes the moving image decoding apparatus of execution mode 4 of the present invention.

Figure 27 is the block diagram that explanation utilizes the dynamic image encoding device of execution mode 5 of the present invention.

Figure 28 is the key diagram of execution mode 5, the management method of expression picture memory and with reference to the adding method of picture index.

Figure 29 (a) and 29 (b) are the key diagrams of execution mode 5, and the picture of expression DISPLAY ORDER is arranged the picture of (29 (a)) and coded sequence and arranged.

Figure 30 is the key diagram of execution mode 5, the management method of expression picture memory and with reference to the adding method of picture index.

Figure 31 is the key diagram of execution mode 5, expression use two systems with reference under the situation of picture index, the data structure of the bit string of corresponding blocks.

Figure 32 is the block diagram that explanation utilizes the moving image decoding apparatus of execution mode 6 of the present invention to use.

Figure 33 is the block diagram that explanation utilizes the dynamic image encoding device of execution mode 7 of the present invention.

Figure 34 (a) and 34 (b) are the sketch mapes that explanation utilizes the dynamic image encoding method of execution mode 7 of the present invention, the arrangement (34 (b)) of the coded sequence of the arrangement (34 (a)) of the DISPLAY ORDER of expression picture and expression picture.

Figure 35 is the block diagram that explanation utilizes the moving image decoding apparatus of execution mode 8 of the present invention.

Figure 36 (a) and 36 (b) are the sketch mapes that explanation utilizes the dynamic image encoding method of execution mode 7 of the present invention, the arrangement (36 (b)) of the DISPLAY ORDER of the arrangement (36 (a)) of the decoding order of expression picture and expression picture.

Figure 37 is the key diagram of execution mode 8, the management method of expression picture memory.

Figure 38 (a) and 38 (b) are the storage medium of expression by the program of the device of each execution mode of software realization, and Figure 38 (c) is the figure that the computer system of storage medium is used in expression.

Figure 39 is the figure of application example of dynamic image encoding method and the dynamic image decoding method of above-mentioned each execution mode of explanation, and expression realizes the content provider system of content converting service.

Figure 40 is the figure of the portable phone of the explanation dynamic image encoding method and the dynamic image decoding method that have utilized above-mentioned each execution mode.

Figure 41 is the block diagram of the detailed structure of expression portable phone shown in Figure 40.

Figure 42 is the concept map of the digital broadcasting of the expression dynamic image encoding device and the moving image decoding apparatus that have utilized above-mentioned each execution mode with system.

Figure 43 (a) and 43 (c) are the key diagrams of existing dynamic image encoding method, and expression constitutes the arrangement (43 (a)) of the picture of moving image, distinguish the picture bar (43 (b)) and the macro block (43 (c)) of picture.

Figure 44 is the figure of the coded data of the general moving image of explanation, and expression is to the encode structure of resulting stream of each picture that constitutes moving image.

Figure 45 is the figure of the moving image encoding mode of explanation existing MPEG etc., indicated object picture and relation at the picture of this time institute's reference that markup is encoded.

Figure 46 (a) and 46 (b) are the key diagrams of existing direct mode coding, are illustrated in the motion vector (46 (a)) that uses in the direct mode and for the relative position (46 (b)) of the piece of picture.

Figure 47 (a) and 47 (b) are the key diagrams of existing adding method with reference to picture index, and expression is given for the index that carries out the candidate screen of reference at the P picture, when the B picture is encoded.

Figure 48 (a) and 48 (b) are the key diagrams of existing dynamic image encoding method, the arrangement (48 (a)) of the DISPLAY ORDER of the picture of expression formation moving image, and the arrangement of coded sequence (48 (b)).

Figure 49 is the key diagram of existing dynamic image encoding method, and expression is for the management example with reference to picture memory of the picture of the arrangement of above-mentioned coded sequence.

Figure 50 (a) and 50 (b) are the figure of problem points of the existing inter-picture prediction coding method of expression, the situation (50 (b)) that is illustrated in the situation (50 (a)) of carrying out two-way reference and two pictures is carried out the rear reference.

Figure 51 (a) and 51 (b) are the figure of the problem points of the existing adding method with reference to picture index of expression, the arrangement (51 (b)) of the arrangement (51 (a)) of the picture of expression DISPLAY ORDER and the picture of coded sequence.

Embodiment

[execution mode 1]

Fig. 1 is the block diagram that explanation utilizes the dynamic image encoding device of execution mode 1 of the present invention to use.

The dynamic image encoding device 10 of this execution mode 1 is divided into fixing data processing unit (piece) to each of a plurality of pictures that constitute moving image respectively, and by each piece the view data of each picture is encoded.

In specific words, this dynamic image encoding device 10 has view data (input data) Id of the picture that storage imports, the input picture memory 101 of the data I d that is stored by each piece output simultaneously; Will be from above-mentioned with reference to picture memory 101 output, become the differential data of prediction data Pd of view data Md and this object piece of the object piece of coded object, the calculus of differences unit 102 that calculates as the prediction error data PEd of object piece; The coded prediction error unit 103 that carries out compressed encoding with view data Md or prediction error data PEd to above-mentioned object piece.Above-mentioned with reference to picture memory 101 in, based on markup and relation, carry out the processing that coded sequence by picture changes the view data of the picture that row imports by DISPLAY ORDER to the picture (with reference to picture) of its predictive coding time institute reference.

Dynamic image encoding device 10, dateout (coded data) Ed that also has above-mentioned coded prediction error unit 103 expands decoding, and the predicated error decoding unit 105 of the decoding differential data PDd of object output piece; The decoding differential data PDd of this object piece of addition and the prediction data Pd of above-mentioned object piece, and the add operation unit 106 of the decoded data Dd of object output piece; With based on this decoded data of memory control signal Cd2 record Dd, and with the decoded data Dd that is stored as the data Rd in the candidate (candidate screen) of the picture of the coding time institute reference of carrying out the object piece export with reference to picture memory 117.

Dynamic image encoding device 10; Also have based on above-mentioned dateout (view data of object piece) Md with reference to dateout (data of the candidate screen) Rd of picture memory 117, the motion vector detecting unit 108 of the motion vector MV of detected object piece with reference to picture memory 101; With motion vector MV and above-mentioned each dateout Md, Rd, confirm the coded system of corresponding objects piece, simultaneously the mode selected cell 109 of output switch control signal Cs2 with reference to picture memory 101,117 based on this object piece.Above-mentioned motion vector detecting unit 108 with reference to a plurality of candidate screen that can reference when the predictive coding of object piece, detects the motion detection of above-mentioned motion vector.In addition, aforesaid way selected cell 109 to above-mentioned object piece, selects a coded system so that code efficiency becomes optimum from a plurality of coded systems.At this moment, under inter-picture prediction is encoded selecteed situation, from selecting best picture a plurality of candidate screen of reference.

In the dynamic image encoding device 10 of this execution mode 1; For the P picture (just; When a piece is carried out predictive coding; With reference to the picture of a picture of having encoded), select coded system in the picture, use the inter-picture prediction coded system of motion vector and do not use in the inter-picture prediction coded system of motion vector (just motion vector is 0).In addition; For the B picture (just; When a piece is carried out predictive coding; Picture with reference to two pictures of having encoded), in coded system, the inter-picture prediction coded system of using forward motion vector, the inter-picture prediction coded system of using backward motion vector, the inter-picture prediction coded system of using bi-directional motion vector and the direct mode in the selection picture.In addition, in this execution mode 1, when the piece of above-mentioned B picture being encoded, with reference to showing on the time shaft near the coded picture before the markup with direct mode.

In addition, dynamic image encoding device 10, have be arranged on above-mentioned with reference to the selector switch 111 between picture memory 101 and the calculus of differences unit 102; Be arranged on the selector switch 112 between calculus of differences unit 102 and the coded prediction error unit 103; Be arranged on reference to the connection cut-off switch 113 between picture memory 101 and aforesaid way selected cell 109 and the motion vector detecting unit 108; Be arranged on the connection cut-off switch 114 between aforesaid way selected cell 109 and the add operation unit 106 and be arranged on the connection cut-off switch 115 between above-mentioned coded prediction error unit 103 and the predicated error decoding unit 105.

In addition, dynamic image encoding device 10 has and is used for controlling through switch controlling signal Cs1 the connection off action of above-mentioned switch 113～115, and output code generates the coding control unit 110 of control signal Cd1 and memory control signal Cd2 simultaneously; And generate control signal Cd1 based on code dateout (coded data) Ed of coded prediction error unit 103 is carried out Variable Length Code, and output is corresponding to the bit string generation unit 104 of the bit string Bs of object piece.In this bit string generation unit 104, input has motion vector that expression detected by motion vector detecting unit 108 and by the information of mode selected cell 109 determined coded system Ms.In bit string Bs, include the information of expression corresponding to the motion vector MV and the coded system Ms of object piece corresponding to this object piece.

Above-mentioned selector switch 111 has an input terminal Ta and two lead-out terminal Tb1 and Tb2, and according to above-mentioned switch controlling signal Cs2, this input terminal Ta is connected to the side of above-mentioned two lead-out terminal Tb1, Tb2.Above-mentioned selector switch 112 has two input terminal Tc1 and Tc2 and a lead-out terminal Td, and according to above-mentioned switch controlling signal Cs2, this lead-out terminal Td is connected to the side of above-mentioned two input terminal Tc1, Tc2.In addition; Through above-mentioned selector switch 111; To the view data Md of input terminal Ta input from exporting with reference to picture memory 101; From a side lead-out terminal Tb1 to the input terminal Tc1 output of selector switch 112 from above-mentioned view data Md with reference to picture memory 101, from the opposing party's lead-out terminal Tb2 to 102 outputs of calculus of differences unit from above-mentioned view data Md with reference to picture memory 101.Through above-mentioned selector switch 112; Input terminal Tc1 to a side imports from above-mentioned view data Md with reference to picture memory 101; Input terminal Tc2 to the opposing party imports by calculus of differences unit 102 resulting differential data PEd; From lead-out terminal Td, the side of this view data Md and differential data PEd is outputed to coded prediction error unit 103.

Action in the face of dynamic image encoding device 10 describes down.

In the explanation below, the demonstration time ratio becomes the picture (markup) of coded object and wants picture (forward direction picture) early be meant that relative markup is positioned at the picture in the place ahead in time, perhaps also is called the picture in the place ahead that is positioned at markup simply.In addition, show that the picture that the time ratio markup will be slow (back is to picture) is meant that relative markup is positioned at the picture at rear in time, perhaps also is called the picture at the rear that is positioned at markup simply.In addition, in the explanation of each execution mode below, the expression that " on the time " is so is short ofly done the implication that special instruction is then represented " by showing time sequencing " in advance.

In the dynamic image encoding device 10 of execution mode 1, input image data Id is by showing that time sequencing is imported into reference to picture memory 101 with picture unit.

Fig. 2 (a) is the figure of explanation stored order of view data of each picture in reference to picture memory 101.In Fig. 2 (a), ordinate is represented picture.Symbol shown in the bottom right of each picture, first letter representation picture type (I, P or B), the picture index of the numeral time sequencing of back.Just; Picture P1, B2, B3, P4, B5, B6, P7, B8, B9, P10, B11, B12, P13, B14, B15, P16 shown in Fig. 2 (a); Be equivalent to picture F (k+3) shown in Figure 45～F (k+18) [k=-2]; And these pictures are pressed DISPLAY ORDER, just along showing that time shaft X arranges from DISPLAY ORDER beginning early in order.

In with reference to picture memory 101, the view data of picture is pressed the DISPLAY ORDER storage of picture.In the view data of this picture of being stored in reference to picture memory 101, changed the order of lining up corresponding to the coding of picture from the DISPLAY ORDER of picture.Below, for the purpose of simplifying the description, the view data of picture also is called picture simply.

Specifically, the order with picture in reference to picture memory 101 changes the processing of lining up coded sequence from input sequence (DISPLAY ORDER), carries out based on the reference relation in the inter-picture prediction coding.Just, carry out this and change row's processing, make when first picture is encoded as should before first picture, being encoded with reference to employed second picture of picture.

When the P picture coding, relative coding markup (P picture) is in nearby 3 pictures (I or P picture) in the place ahead in time, is used as the candidate screen with reference to picture.In the predictive coding of the piece of P picture, from above-mentioned 3 candidate screen with reference to maximum 1.

In addition; When the B picture is encoded; Relatively markup (B picture) is positioned at 2 of the place ahead in time near picture (I or P picture), markup is positioned at the immediate B picture in the place ahead and the markup I or the P picture that are positioned at the rear in time relatively in time relatively, uses as the candidate screen with reference to picture.In the predictive coding of the piece of B picture, from above-mentioned 4 candidate screen with reference to maximum 2.

Specifically, picture P10, B11, B12, P13 and to corresponding relation that should each picture, shown in the arrow among Fig. 2 (a) with reference to the candidate screen of picture.Just, when P picture P10 was encoded, picture P1, P4, P7 were used as the candidate screen with reference to picture, and when P picture P13 was encoded, picture P4, P7, P10 were used as the candidate screen with reference to picture.In addition, when B picture B11 was encoded, picture P7, B9, P10, P13 were as the candidate screen with reference to picture, and when B picture B12 was encoded, picture P7, P10, B11, P13 were as the candidate screen with reference to picture.

In addition, Fig. 2 (b) expression will be from the order of the picture of the picture P1～P16 shown in Fig. 2 (a), changes the order of lining up the picture behind the coded sequence from DISPLAY ORDER.After changing row; Picture shown in Fig. 2 (a), shown in Fig. 2 (b), last at time shaft (scramble time axle) Y of presentation code time; According to its scramble time order, just arrange by the order of picture P4, B2, B3, P7, B5, B6, P10, B8, B9, P13, B11, B12, P16.

In with reference to picture memory 101, carried out changing the data of row's picture,,, called over each predetermined data processing unit according to the scramble time.In this execution mode, data processing unit is the data unit of carrying out motion compensation, more specifically, is exactly the rectangular-shaped image space (macro block) of all having arranged 16 pixels in the horizontal direction with vertical direction.But in the explanation below, macro block also is called piece simply.

Below, the encoding process of picture P13, B11, B12 is described in order.

< encoding process of picture P13 >

At first, the encoding process to picture P13 describes.

Because becoming picture (markup) P13 of coded object is the P picture; So, be to carry out being positioned at the place ahead or rear 1 the unidirectional inter-picture prediction coding of coded picture in time with reference to markup relatively for the inter-picture prediction of the object piece among picture P13 coding.

In the explanation below, just use the P picture in the place ahead that is positioned at markup to describe as situation with reference to picture.

In the case, as the coding of picture P13, use the inter-picture prediction coding of forward direction reference.In addition, in the process that the P picture is encoded, as not using the B picture with reference to picture.Thereby, in the case,, be 3 pictures (I or P picture) in the place ahead with reference to the candidate screen of picture, specifically, be exactly picture P4, P7, P10.The coding of these candidate screen finishes when markup begins to encode, and the data of corresponding candidate screen (decoded data) Dd is stored in reference to picture memory 117 with reference in the picture memory 101.

In the process that the P picture is encoded, coding control unit 110 is through each switch of switch controlling signal Cs1 control, so that switch 113,114 and 115 becomes on-state.View data Md from the macro block of the corresponding picture P13 that reads with reference to picture memory 101 is input to motion vector detecting unit 108, mode selected cell 109 and calculus of differences unit 102.

Motion vector detecting unit 108 is used to be stored in reference to the decode image data Rd of picture memory with reference to the picture P4 in the picture memory 117, P7, P10, detects the motion vector MV of the macro block of picture P13.Then, detected motion vector MV is outputed to mode selected cell 109.

Mode selected cell 109 uses by the detected motion vector of motion vector detecting unit 108, confirms the coded system of the piece of picture P13.Coded system representes with what kind of method piece to be encoded.For example, as stated, under the situation of P picture, the inter-picture prediction of coding, use motion vector is encoded, is not used the inter-picture prediction coding of motion vector (motion is made as 0 to be handled) in picture, confirms a coded system.When confirming coded system, confirming, generally is to select to make to give as size of code in the quantity of the position that will be scheduled to that encoding error is minimum coded system under the situation of piece.At this moment, under the situation of selecting the inter-picture prediction coding, as from picture P4, P7, P10, selecting optimal one with reference to picture.

By mode selected cell 109 determined coded system Ms, outputed to bit string generation unit 104.In addition; At determined coded system Ms is under the situation with reference to the coded system of forward direction picture, through being that the information Rp of which the detected motion vector and so on reference to picture P4, P7, P10 is also outputed to bit string generation unit 104 with reference to the resulting vector of the motion detection of forward direction picture (forward motion vector) MVp and this motion vector.

Representing under the situation of inter-picture prediction coded system by mode selected cell 109 determined coded system Ms; Employed motion vector MVp and this motion vector are the information Rp of which the detected motion vector and so on reference to picture P4, P7, P10 in inter-picture prediction coding, are stored motion vector storage unit 116.

In addition, in mode selected cell 109, and for the corresponding motion compensation of the determined coded system of object piece, use with reference to picture with for the motion vector of object piece and carry out.So resulting by this motion compensation, for the prediction data Pd of object piece, outputed to calculus of differences unit 102 and add operation unit 106.

But, selecting in the picture under the situation of coded system generation forecast data Pd not in mode selected cell 109.In addition, make input terminal Ta be connected to lead-out terminal Tb1 through control switch 111, and make lead-out terminal Td be connected to input terminal Tc1 under the situation of coded system having selected in the picture through control switch 112.On the other hand, under the situation of having selected the inter-picture prediction coding, make input terminal Ta be connected to lead-out terminal Tb2 through control switch 111, and make lead-out terminal Td be connected to input terminal Tc2 through control switch 112.

Below, just to selecting the inter-picture prediction coded system to describe as the situation of coded system Ms by mode selected cell 109.

The view data Md of the piece of input picture P13 and in calculus of differences unit 102 from the prediction data Pd of the correspondence of mode selected cell 109.Calculus of differences unit 102 calculates view data Md and the differential data of prediction data Pd of the piece of picture P13, and this differential data is exported as prediction error data PEd.

Prediction error data PEd is imported into coded prediction error unit 103.Coded prediction error unit 103 is implemented encoding process such as frequency translation and quantification and is generated coded data Ed to the prediction error data PEd that imported.These processing, like processing such as frequency translation and quantifications, with correspondence in the horizontal direction with vertical direction on all arranged the rectangular-shaped image space (sub-piece) of 8 pixels data be that unit carries out.

The coded data Ed of 103 outputs from the coded prediction error unit is imported into bit string generation unit 104 and predicated error decoding unit 105.

Bit string generation unit 104 carries out Variable Length Code to the coded data Ed that is imported and generates bit string.And then, the information of Ms such as additional movement vector MVp and coded system in this bit string, and come the heading message etc. of own coding control unit 110 and generate bit string Bs.

At coded system Ms is to carry out under the situation of coded system of the place ahead reference, and information (with reference to the image information) Rp which of picture P4, P7, P10 to detect motion vector and so on reference to also is affixed in the bit string.

Then, to describing with reference to the management method of picture memory and the information with reference to picture (with reference to image information) in the expression candidate screen.

Fig. 3 is illustrated in the situation that changes along with the process of time with reference to the picture of being stored in the picture memory 117.This carries out according to the memory control signal Cd2 that comes own coding control unit 110 with reference to the management of picture memory 117 with reference to picture memory 117.In addition, the storage area (#1)～(#5) that has 5 picture amounts with reference to picture memory 117.In each storage area, can store the view data of 1 picture amount.But the memory cell of each picture is not limited to 1 with reference to the zone in the picture memory, also can be a memory.

At first, the management method with reference to picture memory is described.

When the coding of picture P13 begins, in each storage area (#1)～(#5), maintain picture B8, P4, P7, P10, B9 with reference to picture memory 117.Though picture B9 does not use in the process that picture P13 is encoded, in order to use in the process that is encoded at picture B11, and remain in reference in the picture memory 117.Picture P13 is used as picture P4, P7 and P10 and encodes with reference to the candidate screen of picture.Coded picture P13 is held in the storage area (#1) that has kept picture B8.It the reasons are as follows.Though picture P4, P7, P10 and B9 are used as the candidate screen with reference to picture when picture P13 and later picture thereof are encoded, picture B8 can not be used as with reference to picture when these picture codings.In Fig. 3, the picture shown in the circular mark is the moment of having accomplished at the coding of markup, is stored in the picture (markup) with reference to picture memory 117 at last.

Then, for concrete explaining as the method for giving each candidate screen with reference to the information of picture with reference to picture index.

This is with reference to picture index, is to be illustrated in when each piece encoded, and which picture is used as the information with reference to picture in reference to the candidate screen of picture.In other words, above-mentioned with reference to picture index, be which the information among the picture P4 that uses candidate when being illustrated in the motion vector of object piece of detected object picture (picture P13), P7, the P10.With reference in the giving of picture index, use from begin to give in order the method for index apart from the nearest in time candidate screen of markup.

Specifically be exactly; When the piece of markup P13 is encoded; Picture P10 is designated as under the situation with reference to picture, and then the candidate screen in tight the place ahead of additional representation markup P13 is designated as the information (with reference to picture index [0]) with reference to picture in the bit string of markup P13.When the piece of markup P13 was encoded, picture P7 was by under the situation of reference, and then the candidate screen before 2 of additional representation markup P13 is designated as the information (with reference to picture index [1]) with reference to picture in the bit string of markup P13.When the piece of markup P13 was encoded, picture P4 was by under the situation of reference, and then the candidate screen before 3 of additional representation markup P13 is designated as the information (with reference to picture index [2]) with reference to picture in the bit string of markup P13.

In Fig. 3, represent,, when markup is encoded, will become the back to candidate with reference to picture as the picture that is endowed symbol [b] with reference to image information.

< encoding process of picture B11 >

Encoding process in the face of picture B11 describes down.

Because picture (markup) to be encoded is picture B11, so, carry out being positioned at the place ahead or rear 2 predictive codings between the bi-directional picture of coded picture in time with reference to markup relatively for the inter-picture prediction coding of the object piece among the picture B11.

Below, just as with reference to picture, the situation of using a picture (I picture, P picture or B picture) in the place ahead that is positioned at markup and being positioned at a picture (I picture or P picture) at the rear of markup describes.

Just, in the case,, use two approaching in time pictures of relative markup (picture B11) (I or P picture) as the candidate screen of forward direction with reference to picture, and the relative markup immediate B picture in position in time.In addition, to reference to picture, use relative markup to be in immediate I or P picture in time as the back.Thereby, in the case,, be exactly picture P7, B9 and P10 (forward direction picture) and picture P13 (back is to picture) for the candidate screen of picture B11 with reference to picture.

When preparation being used as when other pictures are encoded when encoding with reference to the B picture of picture, coding control unit 110 makes switch 113,114,115 become on-state through each switch of switch controlling signal Cs1 control.Because picture B11 is used as with reference to picture when other pictures are encoded, so coding control unit 110 makes switch 113,114,115 become on-state through each switch of switch controlling signal Cs1 control.From what read with reference to picture memory 101, the view data Md of the piece of corresponding picture B11 is imported into motion vector detecting unit 108, mode selected cell 109 and calculus of differences unit 102.

Motion vector detecting unit 108 is carried out the detection of forward motion vector and backward motion vector for the object piece of picture B11.When these motion vector detection, be stored in reference to picture P7, B9 and P10 in the picture memory 117, be used as the candidate screen of forward direction with reference to picture, picture P13 is used as the back to reference to picture.The detection of backward motion vector is based on carrying out to the picture P13 with reference to picture as the back.By the detected motion vector of motion vector detecting unit 108, outputed to mode selected cell 109.

Mode selected cell 109 uses by the detected motion vector of motion vector detecting unit 108, confirms the coded system of the object piece of picture B11.In this occasion; The coded system of B picture B11; For example, in the picture coding, used forward motion vector the inter-picture prediction coding, used backward motion vector the inter-picture prediction coding, used the inter-picture prediction coding of bi-directional motion vector, and select in the direct mode.In coded system is to have used under the situation of inter-picture prediction coding of forward motion vector, from picture P7, B9 and P10, selects optimal picture as with reference to picture.

Below, the processing of the piece of picture B11 being encoded with direct mode is described.

[the 1st example of direct mode coding]

The 1st example that Fig. 4 (a) expression is encoded to piece (object piece) BLa1 of picture (markup) B11 with direct mode.The conduct that this direct mode coding utilizes the rear that is in picture B11 is with reference to motion vector (benchmark motion vector) MVc1 with piece (reference block) BLb1 of object piece BLa1 same position that is among picture (reference pictures) P13 of picture.Motion vector MVc1 is the employed motion vector when encoding of the piece BLb1 to picture P13, and is stored in the motion vector storage unit 116.This motion vector MVc1 is detected with reference to above-mentioned picture P10, and the zone C Rc1 of the corresponding blocks BLb1 of expression picture P10.To piece BLa1, use the motion vector MVd1 parallel, MVe1 and conduct with reference to the selected picture P10 of picture, P13 with motion vector MVc1, implement bi-directional predictive coding and handle.The motion vector MVd1 that when this piece BLa1 is encoded, uses, and MVe1 be respectively the forward motion vector of zone C Rd1 of the corresponding blocks BLa1 of expression picture P10, and the backward motion vector of the zone C Re1 of the corresponding blocks BLa1 of expression picture P13.

In the case, the big or small MVF of forward motion vector MVd1 and the big or small MVB of backward motion vector MVe1 can be obtained respectively by formula (1), (2).

MVF＝MVR×TRF/TRD ...(1)

MVB=(TRB-TRD) * MVR/TRD ... (2) wherein, MVF, MVB be the horizontal component and the vertical component of expressive movement vector respectively.

In addition; MVR is the size (by the direction on sign symbol (sign) expression 2 dimension spaces) of motion vector MVc1, TRD be markup (picture B11) back to reference to picture (picture P13) and in this back to the be encoded time gap of picture (picture P10) of time institute's reference of the piece BLb1 with reference to picture (picture P13).In addition, TRF is a markup (picture B11) and near the time gap with reference to picture (picture P10) before it, and TRB be markup (picture B11) and in the back to the be encoded time gap of picture (picture P10) of time institute's reference of the piece BLb1 with reference to picture.

[the 2nd example of direct mode coding]

The 2nd example of the encoding process of using direct mode then, is described.

The 2nd example that Fig. 4 (b) expression is encoded to piece (object piece) BLa2 of picture (markup) B11 with direct mode.

The conduct that this direct mode coding utilizes the rear that is in picture B11 is with reference to motion vector (benchmark motion vector) MVf2 with piece (reference block) BLb2 of piece BLa2 same position that is among the picture P13 of picture.Motion vector MVf2 is piece BLb2 employed motion vector when being encoded, and is stored in the motion vector storage unit 116.This motion vector MVf2 is detected with reference to above-mentioned picture P7, and the zone C Rf2 of the corresponding blocks BLb2 of expression picture P7.To piece BLa2, use the motion vector MVg2 parallel, MVh2 and conduct with reference to selected picture P10 of picture and picture P13 with motion vector MVf2, implement bi-directional predictive coding and handle.The motion vector MVg2 that when this piece BLa2 is encoded, uses, and MVh2 represent the forward motion vector of zone C Rg2 of the corresponding blocks BLa2 of picture P10 and the backward motion vector of the zone C Rh2 of the corresponding blocks BLa2 of expression picture P13 respectively.

In the case, motion vector MVg2, and big or small MVF, the MVB of MVh2 can be obtained by above-mentioned formula (1), (2) respectively.

As stated; In direct mode; To when object piece BLa2 is encoded as the back to calibrating with reference to motion vector MVf2 in the picture, that be positioned at the BLb2 of the position relatively identical with this object piece, thereby obtain forward motion vector MVg2 and backward motion vector MVh2 for the object piece.So, under the selecteed situation of direct mode, the information that just need not send the motion vector of object piece.And, since as forward direction with reference to picture, use apart from the markup immediate coded picture in position in time, so can make the forecasting efficiency raising.

[the 3rd example of direct mode coding]

The 3rd example of the encoding process of using direct mode then, is described.

The 3rd example of encoding process is carried out in Fig. 5 (a) expression to piece (object piece) BLa3 of picture (markup) B11 with direct mode.

This direct mode coding utilize as picture B11 back to reference among picture (reference pictures) P13 of picture, be in motion vector (benchmark motion vector) MVc3 with the piece BLb3 of piece BLa3 same position.Motion vector MVc3 is an employed motion vector when piece BLb3 is encoded, and is stored in the motion vector storage unit 116.This motion vector MVc3 is detected with reference to above-mentioned picture P7, and the zone C Rc3 of the corresponding blocks BLb3 of expression picture P7.To piece BLa3; Use motion vector MVd3, the MVe3 parallel with motion vector MVc3; With the picture of the time institute's reference that is encoded at piece BLb3 (as forward direction with reference to the selected picture P7 of picture) and as the back to picture P13 with reference to picture, implement bi-directional predicted processing.In the case, the forward motion vector of the zone C Rd3 of the motion vector MVd3 that uses when object piece BLa3 is encoded, the corresponding blocks BLa3 that MVe3 representes picture P7 respectively, and the backward motion vector of the zone C Re3 of the corresponding blocks BLa3 of expression picture P13.

In the case, the big or small MVF of motion vector MVd3, MVe3, MVB can be obtained by following formula (3) and top formula (2) respectively.

MVF＝MVR×TRB/TRD...(3)

Wherein, MVR is the size of motion vector MVc3.

As stated; In the coding of the direct mode shown in Fig. 5 (a); To when the object piece is encoded, being used as the back to calibrating with reference to motion vector MVc3 in the picture, that be positioned at the piece BLb3 of the position relatively identical with this object piece; Thereby obtain forward motion vector MVd3 and backward motion vector MVe3 for the object piece, so under the selecteed situation of direct mode, the information that just need not send the motion vector of object piece.

When the picture P13 of the time institute's reference that is encoded at piece BLb3 from reference to picture memory 117 under the situation of deletion, immediate forward direction is in time got final product with reference to picture as the forward direction in the direct mode with reference to picture P10.Processing in the direct mode in the case, identical with the processing (the 1st example) of the direct mode shown in Fig. 4 (a).

[the 4th example of direct mode coding]

The 4th example of the encoding process of using direct mode then, is described.

The 4th example of the processing that Fig. 5 (b) expression is encoded to piece (object piece) BLa4 of picture (markup) B11 with direct mode.

In the case, for object piece BLa4, based on back to the picture P13 with reference to picture with reference to selected immediate picture P10 of picture and conduct as forward direction, the enforcement motion vector is 0 bi-directional predicted processing.Motion vector MVf4, the MVh4 that uses when promptly piece BLa4 being encoded is the expression picture motion vector with the zone relative same position of object piece BLa4 (piece) CRf4 P10, and the expression picture motion vector with the zone relative same position of object piece BLa4 (piece) CRh4 P13.

As stated, in the direct mode shown in Fig. 5 (b) coding, the motion vector of object piece is set to 0 by the strong hand.Therefore, under the selecteed situation of direct mode, then there is no need to send the information of the motion vector of object piece, and do not need the calibration of motion vector to handle, reduction that can the picked up signal treating capacity.The method also can be applied to, for example, and back to being as picture B11 with reference to the piece that is in piece BLa4 same position among the picture P13 of picture, such as, do not had the such situation of piece of motion vector by the piece that kind of intraframe coding.Thereby, even in the back to reference to being in that piece with object piece same position does not have motion vector and under the situation of encoding, also can using direct mode and code efficiency is improved in the picture.

The processing of above-mentioned direct mode (the 1st～the 4th example), not only can be applicable to picture the demonstration time be spaced apart fixing situation, also can be applicable to picture the demonstration time be spaced apart variable situation.

[the 5th example of direct mode coding]

Then, the 5th example of the predictive coding under the direct mode of the situation of the variable spaced of demonstration time of picture being handled as the encoding process of using direct mode describes.

Fig. 6 (a) is the figure of the 5th example of the explanation encoding process of using direct mode, and expression is handled the predictive coding under the direct mode as the 2nd example and is applied to the processing under the situation of demonstration variable spaced of picture.

In the case; Bi-directional predictive coding for the object piece BLa5 of markup B11 is handled; Utilization be in picture B11 the rear conduct with reference among picture (reference pictures) P13 of picture, be in motion vector (benchmark motion vector) MVf5 with piece (object piece) BLb5 of object piece BLa5 same position, handle (the 2nd example) with the predictive coding under the direct mode shown in Fig. 4 (b) and likewise carry out.Motion vector MVf5 is the employed motion vector when encoding of the piece BLb5 to picture P13, the zone C Rf5 of the corresponding blocks BLb5 of expression picture P7.In addition, parallel corresponding to motion vector MVg5, the MVh5 of object piece with motion vector MVf5.These motion vectors MVg5, MVh5 are respectively the backward motion vector of zone C Rh5 of corresponding blocks BLa5 of forward motion vector and expression picture P13 of zone C Rg5 of the corresponding blocks BLa5 of expression picture P10 in addition.

Also have, in the case, the big or small MVF of motion vector MVg5, MVh5, MVB also with direct mode under processing (the 2nd example) the same, can obtain by formula (1), (2) respectively.

[jumping over the processing of particular block]

Then, in the encoding process under the direct mode, specific piece is described as jumping over the situation that piece handles.

When in the encoding process under the direct mode; Be under 0 the situation at the differential data of corresponding objects piece; In coded prediction error unit 103, can not generated corresponding to the coded data of this object piece, do not export the bit string of corresponding objects piece from bit string generation unit 104.Differential data is 0 piece like this, handles as jumping over piece.

Below, explain specific piece as jumping over the situation that piece is handled particularly.

Fig. 6 (b) expression is as the specific picture F of the part of moving image.

In this picture F; The value of the differential data (prediction error data) of corresponding blocks MB (r-1), MB (r) and MB (r+3) is non-0 value in the piece MB of adjacency (r-1)～MB (r+3), and the value that correspondence is positioned at the differential data (prediction error data) of piece MB (r+1) and piece MB (r+2) between piece MB (r) and the piece MB (r+3) is 0.

In the case, under direct mode, piece MB (r+1) and piece MB (r+2) handle as jumping over piece, in the bit string Bs of corresponding moving image, do not comprise the bit string corresponding to piece MB (r+1) and piece MB (r+2).

Fig. 6 (c) be used for explanation with piece MB (r+1) and piece MB (r+2) as the figure that jumps over the flow structure under the situation that piece handles, shown in it corresponding to the part of piece MB (r) and the piece MB (r+3) of bit string Bs.

Between bit string Bmb (r) and bit string Bmb (r+3) corresponding to piece MB (r+3) corresponding to piece MB (r), allocation list be shown in have between these pieces that two conducts jump over piece that piece is processed jump over identifier Sf (Sk:2).In addition, between bit string Bmb (r-1) and the bit string Bmb (r) corresponding to piece MB (r) corresponding to piece MB (r-1), allocation list is shown in not to be had between these pieces to jump over identifier Sf (Sk:0) as what jump over piece that piece is processed.

Bit string Bmb (r) corresponding to piece MB (r) is made up of Hmb of title portion and data portion Dmb, in data portion Dmb, comprises the view data that is encoded corresponding to this piece.In addition, in the Hmb of title portion, comprise the expression macro block (mb) type, just this piece is the mode sign Fm that is encoded with what kind of coded system; Be illustrated in the coding time institute's reference picture with reference to image information Rp; And the information Bmvf, the Bmvb that are illustrated in employed motion vector when encoding.This piece MB (R) handles through bi-directional predictive coding and encodes, and information Bmvf, the Bmvb of expression motion vector, is illustrated respectively in the value of employed forward motion vector, backward motion vector in the bi-directional predicted processing.In addition, corresponding to corresponding other the bit string of piece such as the bit string Bmb (r+3) of piece MB (r+3), also have and the identical structure of bit string Bmb (r) corresponding to piece MB (r).

As stated, through under direct mode, be that 0 piece is handled as jumping over piece with differential data, just in bit string, also comprise mode information and jump over information corresponding to this piece, the reduction of size of code just becomes possibility.

Whether piece is jumped over, and can detect from the identifier Sf that jumps near preceding of the bit string that is disposed at each piece.In addition, whether piece is jumped over, and also can be learnt by the index information of recording and narrating the piece in the bit string of corresponding each piece etc.

In addition; In processing example (the 1st example) under the direct mode shown in Fig. 4 (a), the processing example (the 2nd example) under the direct mode shown in Fig. 4 (b), the processing example (the 3rd example) under the direct mode shown in Fig. 5 (a); Also can not to be that 0 piece is all handled as jumping over piece with differential data; But with relative markup be positioned in time near preceding picture as forward direction with reference to picture; And it is bi-directional predicted to use size to be that 0 motion vector carries out for the object piece, only under the differential data of object piece is 0 situation, this object piece is handled as jumping over piece.

In addition, for the selection of the coded system of object piece, generally be to make encoding error corresponding to the quantity of predetermined position for minimum.Outputed to bit string generation unit 104 by mode selected cell 109 determined coded systems.In addition, based on by mode selected cell 109 determined coded systems from reference to the resulting prediction data of picture, outputed to calculus of differences unit 102 and add operation unit 106.But under the selecteed situation of coding, no prediction data is exported in picture.In addition, under the situation that mode selected cell 109 is selected to encode in the picture, make input terminal Ta be connected to lead-out terminal Tb1, make lead-out terminal Td be connected to input terminal Tc1 through switch 112 is controlled through switch 111 is controlled.Under the situation of selecting the inter-picture prediction coding, through being controlled, switch 111 make input terminal Ta be connected to lead-out terminal Tb2, and control through degree switch 112 and make lead-out terminal Td be connected to input terminal Tc2.

Below, the action by the dynamic image encoding device 10 under the situation of mode selected cell 109 selection inter-picture prediction codings is described.

Calculus of differences unit 102 receives from the prediction data Pd of mode selected cell 109 inputs.Calculus of differences unit 102, calculating is exported this differential data corresponding to the view data of the piece of picture B11 and the differential data of prediction data as prediction error data PEd.Prediction error data PEd is imported into coded prediction error unit 103.Coded prediction error unit 103 generates coded data Ed through the prediction error data PEd that is imported is implemented encoding process such as frequency translation and quantification.The coded data Ed of 103 outputs from the coded prediction error unit is imported into bit string generation unit 104 and predicated error decoding unit 105.

Bit string generation unit 104 to the coded data Ed that is imported, is implemented Variable Length Code etc., and then generates bit string Bs through the information of additional movement vector and coded system etc., and exports this bit string Bs.At this moment, be to carry out under the situation of forward direction with reference to coded system in coded system, be used for discerning information (with reference to the image information) Rp which of picture P7, B9, P10 to detect forward motion vector with reference to and also be affixed among the bit string Bs.

Then, use describing in the process that Fig. 3 is encoded to picture B11 with reference to the management method of picture memory with reference to the adding method of image information.

When the coding of picture B11 begins, in reference to picture memory 117, store picture P4, P7, P10, P13, B9.Picture B11 carries out bi-directional predictive coding as the back to the candidate screen of reference with picture P13 with the candidate screen that picture P7, B9, P10 are used as the forward direction reference.The picture B11 that has encoded is stored in the storage area (#2) of having stored picture P4, because picture P4 is in the encoding process of the later picture of picture B11, not as using with reference to picture.

In the process that this picture B11 is encoded; Be used for discerning for the forward motion vector of object piece which the method for information (with reference to image information) as additional with reference to picture P7, B9, P10, use from time apart from markup (picture B11) nearest begin to give in order the method for index with reference to candidate screen.With reference to candidate screen, be when markup is encoded, to can be used as the picture of selecting with reference to picture.

Specifically, exactly picture P10 is given with reference to picture index [0], picture B9 is given with reference to picture index [1], and picture P7 is given with reference to picture index [2].

Thereby, when carrying out markup encoded with reference under the situation of picture P10, with reference to picture index [0] as expression with reference to the information of candidate screen in the tight the place ahead of markup recorded and narrated in bit string corresponding to the object piece.Likewise, with reference under the situation of picture B9, with reference to picture index [1] as expression with reference to the information of the candidate screen before 2 of the markup, recorded and narrated in bit string for the object piece.With reference under the situation of picture P7, with reference to picture index [2] as expression with reference to the information of the candidate screen before 3 of the markup recorded and narrated in bit string corresponding to the object piece.

For with reference to the giving of the code of picture [0], [1], [2], be more little according to the value of index, code length carries out with regard to short more such mode.

Generally, candidate screen is used as the probability with reference to picture, and the candidate screen near more in time apart from markup is just high more.Thereby,, be overall code amount in the time of just can reducing the motion vector of detection of expression object piece with reference to each code of which candidate screen through giving code by this way.

Predicated error decoding unit 105 for the coded data corresponding to the object piece of being imported, is implemented the decoding processing of re-quantization and frequency inverse conversion etc., generates the also decoding differential data PDd of object output piece.Decoding differential data PDd is by add operation unit 106 and prediction data Pd addition, and the decoded data Dd of the resulting object piece of addition is stored with reference to picture memory 117 thus.

Through with above-mentioned same processing, the rest block of picture B11 is carried out encoding process.After the processing of whole pieces of picture B11 finishes, then carry out the encoding process of picture B12.

< encoding process of picture B12 >

Then, the encoding process to picture B12 describes.

Because picture B12 is the B picture, so, be to be positioned at the place ahead or rear 2 predictive codings between the coded picture bi-directional picture of carrying out in time with reference to markup relatively to the inter-picture prediction coding of the object piece among the picture B12.

Below, just used the situation of the inter-picture prediction coding of two-way reference to describe as the encoding process of picture B12.Thereby, in the case,, use relative markup by showing approaching 2 pictures (I or P picture) of time sequencing as the candidate screen of forward direction with reference to picture, perhaps markup is pressed the immediate B picture of demonstration time sequencing relatively.In addition, to reference to picture, use relative markup as the back by showing immediate I of time sequencing or P picture.Thereby, in the case, for picture B12 with reference to candidate screen, be exactly picture P7, P10, B11 (forward direction picture) and picture P13 (back to picture).

When to preparation when other pictures are encoded, be used as when encoding with reference to the B picture of picture, coding control unit 110 is controlled each switch and is made switch 113,114,115 become on-state.Because picture B12 is used as with reference to picture when other pictures are encoded, so coding control unit 110 is controlled each switch and made switch 113,114,115 become on-state.Thereby, from 101 that read with reference to picture memory, corresponding to the view data of the piece of picture B12, be imported into motion vector detecting unit 108, mode selected cell 109 and calculus of differences unit 102.

Motion vector detecting unit 108; With being stored in reference to picture P7, P10, B11 in the picture memory 117; Candidate screen as the forward direction reference; With being stored in reference to the picture P13 in the picture memory 117 as the back to reference to picture, carry out corresponding to the forward motion vector of the object piece of picture B12 and the detection of backward motion vector.

Detected motion vector is outputed to mode selected cell 109.

Mode selected cell 109 uses by motion vector detecting unit 108 detected motion vectors, confirms the coded system of the object piece of picture B12.In this occasion; As coded system to B picture B12; In picture, encode, use the inter-picture prediction coding of forward motion vector, the inter-picture prediction coding of use backward motion vector, the inter-picture prediction coding of use bi-directional motion vector, and select in the direct mode.Under the situation of coded system, from picture P7, P10, B11, select optimal picture as with reference to picture for the inter-picture prediction coding that uses forward motion vector.

Below, explain with direct mode the piece of picture B12 is carried out encoding process.

[the 1st example of direct mode coding]

The situation that Fig. 7 (a) expression is encoded to piece (object piece) BLa5 of picture (markup) B12 with direct mode.This direct mode coding utilize picture B12 the rear conduct with reference among picture (reference pictures) P13 of picture, be in motion vector (benchmark motion vector) MVc5 with piece (reference block) BLb5 of object piece BLa5 same position.Motion vector MVc5 is piece BLb5 employed motion vector when being encoded, and is stored in the motion vector storage unit 116.This motion vector MVc5, the zone C Rc5 of corresponding BLb5 of expression picture P10.To piece BLa5, use the motion vector parallel with motion vector MVc5, based on picture B11, P13, implement bi-directional predictive coding and handle with reference to picture as piece BLa5.The motion vector that uses when piece BLa5 is encoded is the motion vector MVd5 of the zone C Rd5 of the corresponding blocks BLa5 among the expression picture B11, and the motion vector MVe5 of the zone C Re5 of the corresponding blocks BLa5 among the expression picture P13.The big or small MVF of motion vector MVd5, MVe5, MVB can be obtained by above-mentioned formula (1), (2) respectively.

[the 2nd example of direct mode coding]

The 2nd example of the encoding process of using direct mode then, is described.

The situation that Fig. 7 (b) expression is encoded to piece (object piece) BLa6 of picture (markup) B12 with direct mode.The conduct that this direct mode coding utilizes the rear that is in picture B12 with reference among picture (reference pictures) P13 of picture, be in motion vector (benchmark motion vector) MVf6 with piece (reference block) BLb6 of object piece BLa6 same position.Motion vector MVc6 is piece BLb6 employed motion vector when being encoded, and is stored in the motion vector storage unit 116.This motion vector MVf6, expression picture P7 is corresponding to the zone C Rf6 of piece BLb6.To piece BLa6, use the motion vector parallel with motion vector MVc6, based on as picture B11 and picture P13, implement bi-directional predictive coding and handle with reference to picture.The motion vector that uses when piece BLa6 is encoded is that expression is the motion vector MVg6 that representes the zone C Rg6 of the corresponding blocks BLa6 of picture B11, and the motion vector MVh6 of the zone C Rh6 of the corresponding blocks BLa6 of expression picture P13.Big or small MVF and the MVB of motion vector MVg6 and MVh6 can be obtained by above-mentioned formula (1), (2) respectively.

As stated; In direct mode; Calibrate to motion vector MVf6 picture, that be positioned at the BLb6 of the position relatively identical of reference when object piece BLa6 is encoded, being used as the back, thereby obtain forward motion vector MVg6 and backward motion vector MVh6 for the object piece with this object piece.So, under the selecteed situation of direct mode, the information that just need not send the motion vector of object piece.And, since as forward direction with reference to picture, use apart from markup by showing the immediate coded picture in time sequencing position, so can make the forecasting efficiency raising.

[the 3rd example of direct mode coding]

The 3rd example of the encoding process of using direct mode then, is described.

The 3rd example of encoding process is carried out in Fig. 8 (a) expression to piece (object piece) BLa7 among picture (markup) B12 with direct mode.

This direct mode coding utilize be in picture B12 back to conduct with reference among picture (reference pictures) P13 of picture, be in motion vector (benchmark motion vector) MVc7 with piece (reference block) BLb7 of piece BLa7 same position.Motion vector MVc7 is an employed motion vector when piece BLb7 is encoded, and is stored in the motion vector storage unit 116.This motion vector MVc7, the zone C Rc7 of the corresponding blocks BLb7 among the expression picture P7.To piece BLa7, use the motion vector parallel with motion vector MVc7, will with piece BLb7 be encoded the identical picture (picture P7) of the picture of time institute's reference as forward direction with reference to picture, with picture P13 as the back to reference to picture, implement bi-directional predictive coding and handle.The motion vector that uses when piece BLa7 is encoded is the motion vector MVe7 of the zone C Re7 of the corresponding blocks BLa7 of the motion vector MVd7 of the zone C Rd7 of the corresponding blocks BLa7 of expression picture P7 and expression picture P13.

Big or small MVF, the MVB of above-mentioned motion vector MVd7 and MVe7 can be obtained by above-mentioned formula (2), (3) respectively.

When the picture of the time institute's reference that is encoded at piece BLb7 under situation with reference to picture memory 117 deletions, immediate forward direction is used as forward direction in the direct mode with reference to picture with reference to picture in time.Direct mode coding in the case is identical with the 1st example of direct mode coding.

As stated; In the coding of the direct mode shown in Fig. 8 (a); To when the object piece is encoded as the back to the picture of reference; The motion vector MVf7 that is positioned at the piece BLb7 of the position relatively identical with this object piece calibrates, thereby obtains forward motion vector MVd7 and backward motion vector MVe7 corresponding to the object piece.So, under the selecteed situation of direct mode, the information that just need not send the motion vector of object piece.

[the 4th example of direct mode coding]

The 4th example of the encoding process of using direct mode then, is described.

The 4th example of the processing that Fig. 8 (b) expression is encoded to piece (object piece) BLa8 of picture (markup) B12 with direct mode.

In the case, for object piece BLa8, based on back to the picture P13 with reference to picture with reference to selected immediate picture P10 of picture and conduct as forward direction, the enforcement motion vector is 0 bi-directional predicted processing.That is motion vector MVf8, the MVh8 that uses when, piece BLa8 being encoded be respectively among the expression picture P11 with object piece BLa8 relatively among motion vector and the expression picture P13 of the zone of same position (piece) CRf8 with the object piece BLa8 motion vector of the zone of same position (piece) CRh8 relatively.

As stated, in the direct mode shown in Fig. 8 (b) coding, the motion vector of object piece is set to 0 by the strong hand.Therefore, under the selecteed situation of direct mode, then there is no need to send the information of the motion vector of object piece, and do not need the calibration of motion vector to handle, reduction that can the picked up signal treating capacity.The method also can be applied to, for example, and back to being as picture B12 with reference to the piece that is in piece BLa8 same position among the picture P13 of picture, such as, do not had the such situation of piece of motion vector by the piece that kind of intraframe coding.Thereby,, also can use direct mode and make the code efficiency raising even do not have under the situation that motion vector ground encodes in reference to picture, be in piece with object piece same position in the back.

Processing under the direct mode of above-mentioned picture B12 (the 1st～the 4th example); Not only can be applicable to picture DISPLAY ORDER be spaced apart fixing situation; Also can be applicable to picture DISPLAY ORDER be spaced apart variable situation, the situation of the picture B11 shown in Fig. 6 (a).

In addition; In the encoding process under the direct mode of picture B12; Same with the encoding process under the direct mode of picture B11; Be that coded prediction error unit 103 does not generate the coded data corresponding to this object piece, does not export the bit string corresponding to the object piece from bit string generation unit 104 under 0 the situation at differential data corresponding to the object piece.Like this, differential data is 0 piece, and is the same with the situation of the picture B11 shown in Fig. 6 (b), Fig. 6 (c), handles as jumping over piece.

In addition; In processing example (the 2nd example) under the direct mode shown in processing under the direct mode shown in Fig. 7 (a) example (the 1st example), Fig. 7 (b), the processing example (the 3rd example) under the direct mode shown in Fig. 8 (a), also can not to be that 0 piece is all handled as jumping over piece with differential data.In other words; Be relative markup to be positioned near preceding picture in time be used as forward direction with reference to picture; And to use size be that 0 motion vector carries out bi-directional predicted for the object piece; And only under the differential data of object piece is 0 situation, this object piece is handled as jumping over piece.

When the mode selected cell 109 of coded system confirm by to(for) the object piece of picture B12; The same with the encoding process of the object piece of picture B11; For object piece generation forecast data PEd, this prediction data PEd is outputed to calculus of differences unit 102 and add operation unit 106.But, under the selecteed situation of in picture, encoding, from mode selected cell 109 not prediction of output data.In addition, be to carry out as coded system to the control of each switch 111,112 according to which that select by mode selected cell 109 to encode between coding and picture in the pictures, the same with the control of the coding situation of picture B11.

Below, when being encoded, picture P12 selected the action of the dynamic image encoding device 10 under the situation of inter-picture prediction coding to describe by mode selected cell 109.

In the case; Calculus of differences unit 102, coded prediction error unit 103, bit string generation unit 104, predicated error decoding unit 105, add operation unit 106 and with reference to picture memory 117 and have selected the situation of inter-picture prediction coding to move by mode selected cell 109 when picture P11 is encoded the samely.

But; In the case; Because the candidate screen of forward direction reference is different with the situation of the coding of picture P11; So in the coded system for the object piece is when carrying out the coded system of forward direction reference, be additional to the object piece bit string become with reference to image information that to be used to discern forward motion vector be which the information with reference to picture P7, P10, B11.

In addition, when picture B12 is encoded, with reference to the picture memory management method with reference to the adding method of image information, just the same with method when picture B11 is encoded shown in Figure 3.

As stated, in execution mode 1 of the present invention, B picture (markup) when encoding, as the candidate screen of forward direction reference, is also being used the B picture except that the P picture.So, as for the object B picture with reference to picture, use the immediate forward direction picture be positioned at this B picture just to become possibility, thereby can improve the precision of prediction of the motion compensation of B picture, can obtain the raising of code efficiency.

In execution mode 1, in the process that the P picture is encoded, do not use the B picture as with reference to picture.Therefore,, also can restart decoding, fully carry out the recovery from mistake through next I or P picture from the picture that produced decoding error even in the middle of decoding, produced under the wrong situation.But, even in the process that the P picture is encoded with the B picture as with reference to picture, the effect of other that obtained by this execution mode can not change yet.

In addition; Because the candidate screen with the forward direction reference in the B picture codec is made as 2 P pictures and 1 B picture; So when with the existing situation that will be made as 3 P pictures relatively the time, on quantity, do not change for the candidate screen of the forward direction reference of B picture for the candidate of the forward direction reference of B picture.Therefore, can avoid, storage that the B picture causes to increase and the increase of the treating capacity of motion detection with reference to the capacity with reference to picture memory of candidate screen owing in candidate screen, comprising for the forward direction reference of B picture.

In addition; In this execution mode 1; The B picture is implemented the information of inter-picture prediction encoding process to expression with reference to forward direction B picture, and be illustrated in this forward direction with reference to the time be with reference to the information of several I or P picture and several B pictures, record and narrate heading message for the bit string that will generate.Therefore, just can understand when decoding by the bit string that dynamic image encoding device generated, need which kind of capacity with reference to picture memory.

In addition; In bit string during information such as additional movement vector and coded system; In coded system is to carry out under the situation of coded system of forward direction reference, in bit string additional to give as the candidate screen of forward direction reference, be used to discern with reference to picture with reference to image information, and and then according to the management method of using with reference to picture with reference to picture memory; To give apart from the nearest in time candidate screen of markup with reference to image information, represent with short code length.So, just can reduce to express size of code with reference to the integral body of the code of image information.In addition, in management with reference to picture memory, for example since with the kind of picture it doesn't matter ground to managing, so can make with reference to picture memory amount minimum with reference to picture memory.

In addition, in this execution mode 1, the zone through separating the P picture and the zone of B picture carry out using the management with reference to picture memory with reference to picture, just become simple and easy with reference to the management of picture memory.

In addition, when with direct mode the piece of B picture being encoded, using relatively as forward direction with reference to picture, this B picture just can make thus for the forecasting efficiency of B picture under direct mode and improve by the immediate picture of time DISPLAY ORDER.

In addition, when the piece of B picture being encoded, use in the back when being encoded by the picture of forward direction reference with reference to picture, just can make thus for the forecasting efficiency raising of B picture under direct mode with reference to picture as forward direction with direct mode.

In addition; When the piece of B picture being encoded with direct mode; Based on forward direction with reference to picture and back to carry out with reference to picture with motion vector be made as 0 bi-directional predicted, so just do not need the calibration of the motion vector under the direct mode to handle, reduction that can the acquired information treating capacity.At this moment, even under the piece with reference to the object piece same position in the picture is having the situation of motion vector, do not encode being in, also can use direct mode that code efficiency is improved with the back.

In addition, when the piece of B picture being encoded,, in bit string, do not record and narrate information, so the reduction of size of code just becomes possibility about this object piece if be 0 for the predicated error of object piece with direct mode.

In this execution mode 1; Motion compensation is to be unit with each by the image space (macro block) that 16 pixels of level * vertical 16 pixels are formed, and the coding of prediction error image is to be that unit handles with each image space (sub-piece) of being made up of 8 pixels of level * vertical 8 pixels.But the pixel count of each macro block (sub-piece) in the motion compensation (coding of prediction error image) also can be with shown in the above-mentioned execution mode 1 different.

In addition, although in this execution mode 1, be that 2 situation is that example is illustrated with the number of continuous B picture, the number of continuous B picture also can be more than or equal to 3.

For example, between I picture and P picture, perhaps the number of the B picture between 2 P pictures also can be 3 or 4.

In addition; In this execution mode 1; Coded system to the P picture is in picture, to encode, used the inter-picture prediction coding of motion vector and do not use the inter-picture prediction coding of motion vector to select; And the coded system of B picture be in the picture coding, used forward motion vector the inter-picture prediction coding, used backward motion vector the inter-picture prediction coding, used the inter-picture prediction coding of bi-directional motion vector, and select among the direct mode.But the coded system of P picture or B picture also can be the mode beyond shown in the above-mentioned execution mode 1.

For example, do not using under the situation of direct mode, just do not needing the motion vector storage unit 116 in the dynamic image encoding device 10 as the coded system of B picture.

In addition; Although in this execution mode 1; Picture B11 (B12) as the B picture is the candidate screen with reference to picture when other pictures are encoded, but when other pictures are encoded without the B picture as with reference to picture the time, just there is no need to be stored in reference in the picture memory 117.In the case, coding control unit 110 breaks off switch 114,115.

In addition, although in this execution mode 1, the quantity of the candidate screen of the forward direction reference of using in the process that the P picture is encoded is 3, is not limited to this.For example, in the process that the P picture is encoded, also can use 2 or more than or equal to 4 picture candidate screen as the forward direction reference.

In addition; Although in this execution mode 1; The candidate screen of the forward direction reference of using in the process that the B picture is encoded is 2 P pictures and 1 B picture, but the candidate screen of the forward direction reference in the process that the B picture is encoded is not limited to the situation of above-mentioned execution mode 1.

For example, in the process that the B picture is encoded, also can use 1 P picture and 2 B pictures, 2 P pictures and 2 B pictures, and no matter immediate in time 3 pictures of picture type as the candidate screen of forward direction reference.In addition, also can not with immediate B picture on the demonstration time shaft, but will show that the B picture that leave markup on the time shaft uses as the candidate screen of reference.

In addition; When the piece of B picture is encoded; With reference to after 1 to picture; Only under the situation of a picture as the candidate screen of forward direction reference near markup, the indicated object piece is which picture to carry out information encoded (with reference to image information) with reference to just to there is no need to record and narrate in bit string.

In addition, in this execution mode 1, when the B picture is encoded, with reference to the B picture in more the place ahead of the immediate forward direction P picture that is located at markup.But when the B picture is encoded, needn't be with reference to the B picture in more the place ahead of immediate forward direction I that is located at markup or P picture.At this moment, when the bit string that is generated is decoded,, also can restart decoding, can fully carry out recovery from mistake through next I or P picture from the picture that produces decoding error even in the middle of decoding, produce mistake.

For example, Fig. 9 (a) and Fig. 9 (b) are when being illustrated in the B picture and being encoded, with reference to the figure of the situation of the B picture in more the place ahead of the immediate forward direction P picture that is located at markup.

Fig. 9 (a) expression picture is arranged with the B picture and with reference to an example of the relation of picture.Particularly, the number of B picture of expression between the P of adjacency picture is 2 in Fig. 9 (a), is the situation of 1 P picture and 2 B pictures for the forward direction of B picture with reference to the candidate screen of picture (just B picture be encoded the picture of time institute's reference).

Fig. 9 (b) expression picture is arranged with the B picture and with reference to another example of the relation of picture.Particularly, the number of B picture of expression between the P picture is 4 in Fig. 9 (b), for the forward direction of B picture with reference to the candidate screen of picture for the situation of picture type it doesn't matter ground is positioned in time immediate 2 pictures of markup.

When Figure 10 (a) and Figure 10 (b) are illustrated in the B picture and are encoded, not with reference to the situation of the B picture in more the place ahead of immediate forward direction I or P picture.

Particularly; In Figure 10 (a); The number of the B picture of expression between the P picture is 2; Is 1 P picture and 1 B picture for the forward direction of B picture with reference to the candidate screen of picture, and the B picture in more the place ahead of immediate forward direction P picture that is located at markup is not as the situation of above-mentioned forward direction with reference to the candidate screen of picture.

In Figure 10 (b); The number of the B picture of expression between the P picture is 4; Is 1 P picture and 1 B picture for the forward direction of B picture with reference to the candidate screen of picture, and the B picture in more the place ahead of immediate forward direction P picture that is located at markup is not as the situation of above-mentioned forward direction with reference to the candidate screen of picture.

In addition; In this execution mode 1; The quantity of using for the P picture with reference to candidate screen is 3; The candidate screen of the forward direction reference of using for the B picture is 2 P pictures and 1 B picture, but frame numbers that promptly can reference when the P picture is encoded is identical with the frame numbers of forward direction reference when the B picture is encoded, but but the frame numbers that the frame numbers of forward direction reference also can reference than when the P picture is encoded when the B picture is encoded lack.

In addition, in this execution mode 1, the example as the encoding process of direct mode is illustrated 4 methods, but in direct mode, can uses in these methods, also can use a plurality of in 4 methods.But under the situation of using a plurality of methods, preferably will represent to use the information (DM mode information) of which direct mode to record and narrate in bit string.

For example, under the situation that spreads all over a method of the whole use of sequence, DM mode information is recorded and narrated in the title of sequence integral body.Under situation, DM mode information is recorded and narrated in the title of this picture a method of each picture and selecting.Under situation, DM mode information is recorded and narrated in the title of piece a method of each piece selection.

Although, be picture or piece, also can be the GOP (Group of pictures) that comprises a number of frames, by the picture bar of a plurality of GOB that form (Group of blocks), divided frame etc. as the unit of selecting the coding method under the above-mentioned direct mode.

In addition, although in this execution mode 1, the management method as with reference to picture memory describes with reference to Fig. 3, is not limited to shown in Figure 3 with reference to the management method of picture memory.

Below, other the management method with reference to picture memory is described.

At first, to describing with reference to Figure 11 as the 1st example under the situation that becomes P picture and B picture to manage with reference to the employed whole picture segmentation of picture.

In the case, establish,, have the zone of P picture storage area (#1)～(#4), B picture storage area (#1), 6 picture amounts of (#2) total as storage area with reference to picture memory 117.The memory cell of each picture is not limited to one with reference to the zone in the picture memory, also can be a memory.

When the coding of picture P13 begins, in P picture storage area (#1)～(#4), store picture P1, P4, P7, P10 respectively, and in this B picture storage area (#1), (#2), store picture B8, B9 respectively with reference to picture memory 117.Picture P13 is used as picture P4, P7, P10 to encode with reference to the candidate screen of picture; And the picture P13 that storage has been encoded in having stored the zone (#1) of picture P1, because picture P1 is used as with reference to picture at picture P13 and later picture thereof the Shi Buhui that is encoded.

In the case, will give the method for picture P4 as candidate screen, P7, P10 with reference to image information, with method shown in Figure 3 likewise to the near more in time candidate screen value of giving of relative markup more little with reference to picture index.

Particularly, to giving with reference to picture index [0] apart from the hithermost forward direction candidate screen of markup, to apart from markup the 2nd near candidate screen give with reference to picture index [1], and to giving with reference to picture index [2] apart from markup candidate screen farthest.

In Figure 11,, as giving symbol [b] with reference to image information, when markup and later picture thereof are encoded,, give symbol [n] to not as picture with reference to picture to being used as the back to picture with reference to picture.

Then, to being divided into the 2nd example under the situation that P picture and B picture manage, describe with reference to Figure 12 as the whole pictures that use with reference to picture.

Because the storage management in this 2nd example is identical with the 1st example shown in Figure 11, its explanation of Therefore, omited.

In this 2nd example,, make the picture that is stored in the P picture storage area preferentially carry out the method that index is given as adding method with reference to picture index.But because in the process that picture P13 is encoded, the B picture is not used as with reference to picture, gives so the B picture is not carried out index.Thereby, picture P10 is given with reference to picture index [0], picture P7 is given with reference to picture index [1], picture P4 is given with reference to picture index [2].

Then, to describing with reference to Figure 13 as the 3rd example that is divided into reference to the employed whole pictures of picture under the situation that P picture and B picture manage.

Because the storage management in this 3rd example is identical with the 1st example shown in Figure 11, its explanation of Therefore, omited.

In this 3rd example,, make the picture that is stored in the B picture storage area preferentially carry out the method that index is given as adding method with reference to picture index.But because in the process that picture P13 is encoded, the B picture is not used as with reference to picture, gives so the B picture is not carried out index.Thereby, picture P10 is given with reference to picture index [0], picture P7 is given with reference to picture index [1], picture P4 is given with reference to picture index [2].

Then, to describing with reference to Figure 14 as the 4th example that is divided into reference to the employed whole pictures of picture under the situation that P picture and B picture manage.

Because the storage management in this 4th example is identical with the 1st example shown in Figure 11, its explanation of Therefore, omited.

In this 4th example, as adding method, use each picture to encoding with reference to image information, confirm it is to make the picture of among which of P picture storage area and B picture storage area, being stored preferential, give method with reference to picture index.

Specifically, for example,, confirm that make the picture of in which storage area of P picture storage area and B picture storage area, being stored preferentially carry out index gives according to apart from hithermost in time the kind of markup with reference to picture.

In the process that picture P13 is encoded,, give so make the picture of in P picture storage area, being stored preferentially carry out index because the B picture is not used as with reference to picture.Thereby, picture P10 is given with reference to picture index [0], picture P7 is given with reference to picture index [1], picture P4 is given with reference to picture index [2].In the case, make the picture of P picture storage area preferentially carry out the information of giving expression, record and narrate in the title of picture with reference to picture index.

In the adding method with reference to picture index of above-mentioned Fig. 3 and Figure 11～shown in Figure 14, more little with reference to the value of picture index, expression is just short more with reference to the code length of the code of picture index.General since relatively markup in time the closer to picture be used as with reference to the probability of picture high more; So through confirming like this code length of expression, just can reduce to express quantity with reference to the code of the integral body of the code of picture index with reference to the code of picture index.

Although about with reference to the management method of picture memory with reference to the adding method of picture index, show Fig. 3, Figure 11～5 methods shown in Figure 14, also can select to use any one in these 5 methods in advance.Also can switch a plurality of methods in these 5 methods of use.But, preferably will use the information of which method and so on to record and narrate as heading message or the like switching under the situation of using a plurality of methods.

In addition; Through as heading message; Record and narrate 3 of expression P picture uses and carry out the inter-picture prediction information encoded with reference to candidate screen; Just can understand when the bit string Bs that the dynamic image encoding device 10 by this execution mode 1 is generated decodes, need which kind of capacity with reference to picture memory.These heading messages also can be recorded and narrated in the title of sequence integral body, also can record and narrate in the title of each GOP that comprises a plurality of pictures (Group of pictures), perhaps in the title of each picture.

Below, that uses when being encoded as picture B11 describes with reference to the management method of picture memory with reference to the method beyond the method shown in Figure 3 of the adding method of image information (will be divided into the method that P picture and B picture are managed with reference to candidate screen).

At first, use Figure 11, explain being divided into the 1st example that the B picture of P picture manages with reference to candidate screen.

When the coding of picture B11 began, in reference to picture memory 117, picture P4, P7, P10, P13 were stored in P picture storage area, and B8, B9 are stored in B picture storage area.Picture B11 encodes as the back picture P13 candidate screen that picture P7, B9, P10 are used as the forward direction reference to the candidate screen of reference then.The picture B11 that has encoded is stored in the storage area of having stored picture P8, because picture B8 is in the process that picture B11 and later picture thereof are encoded, as not using with reference to picture.

In the case; As the method that will give each picture with reference to image information (just be used for being illustrated in and be to use when detecting forward motion vector with reference to which of picture P7, B9, P10) with reference to the information of candidate screen, with the example of adding method shown in Figure 3 likewise use from time apart from the nearest beginning of markup in order to give the method for index with reference to candidate screen.

Just; Candidate screen (picture P10) to the tight the place ahead of markup (picture B11) is given with reference to picture index [0]; Candidate screen (picture B9) to before 2 of the markup is given with reference to picture index [1], and the candidate screen (picture P7) before 3 of the markup is given with reference to picture index [2].

Then, use Figure 12, will be divided into the 2nd example that P picture and B picture manage with reference to candidate screen and explain when picture B11 is encoded.

Because in this 2nd example, storage management is identical with the 1st example illustrated in fig. 11, its explanation of Therefore, omited.

In this 2nd example,, make the picture that is stored in the P picture storage area preferentially carry out the method that index is given as adding method with reference to picture index.Thereby, picture P10 is given with reference to picture index [0], picture P7 is given with reference to picture index [1], picture B9 is given with reference to picture index [2].

Then, use Figure 13, will be divided into the 3rd example that P picture and B picture manage with reference to candidate screen and explain when picture B11 is encoded.

Because in this 3rd example, storage management is identical with the 1st example illustrated in fig. 11, its explanation of Therefore, omited.

In this 3rd example,, make the picture that is stored in the B picture storage area preferentially carry out the method that index is given as adding method with reference to picture index.Thereby, picture B9 is given with reference to picture index [0], picture P10 is given with reference to picture index [1], picture P7 is given with reference to picture index [2].

Then, use Figure 14, will be divided into the 4th example that P picture and B picture manage with reference to candidate screen and explain when picture B11 is encoded.

Because in this 4th example, storage management is identical with the 1st example illustrated in fig. 11, its explanation of Therefore, omited.

In this 4th example, as adding method, use each picture of encoding is confirmed it is to make the picture of in which zone of P picture storage area and B picture storage area, being stored preferential with reference to picture index, give method with reference to image information.

Specifically, be according to hithermost in time the kind of markup that becomes coded object relatively with reference to candidate screen, confirm that which memory is preferentially carried out index gives.

In the process that picture B11 is encoded,,, gives in the picture of in P picture storage area, being stored so preferentially being carried out index because the hithermost in time forward direction of markup is picture P10 with reference to picture relatively.

Thereby, picture P10 is given with reference to picture index [0], picture P7 is given with reference to picture index [1], picture B9 is given with reference to picture index [2].In the case, make the picture of P picture storage area preferentially carry out the information of giving expression, record and narrate in the title of picture with reference to picture index.

When picture B11 is encoded in the method (Fig. 3, Figure 11～5 methods shown in Figure 14) of giving with reference to picture index; The same with the situation of the coding of picture P13; Value with reference to picture index is more little, and expression is just short more with reference to the code length of the code of picture index.

In addition, the same with the situation of the coding of P picture P13 in the process that B picture B11 is encoded, also can select to use any one in above-mentioned 5 methods in advance.Also can switch a plurality of methods in these 5 methods of use.But switching under the situation of using a plurality of methods, the information that preferably should use which method and so on or the like is recorded and narrated as heading message.

In addition; Through as heading message; Record and narrate expression B picture with forward direction B picture as implementing the inter-picture prediction encoding process with reference to candidate screen, and the candidate screen of the forward direction reference of when the B picture is encoded, using is, the information of 2 I or P picture and 1 B picture; Just can understand when the bit string that the dynamic image encoding device 10 by this execution mode 1 is generated is decoded, need have which kind of memory capacity with reference to picture memory.These heading messages also can be recorded and narrated in the title of sequence integral body, also can record and narrate in the title of each GOP that comprises a plurality of pictures (Group of pictures), perhaps in the title of each picture.

That uses when being encoded as picture B12 at last, describes with reference to the management method of picture memory with reference to the method beyond the method shown in Figure 3 of the adding method of image information (being about to be divided into the method that P picture and B picture are managed with reference to candidate screen).

Because Figure 11～the 1st example～3rd example shown in Figure 13 is identical with the situation of the coding of picture B11, its explanation of Therefore, omited.

Therefore, about picture B12, use Figure 14 only to explain and to be divided into the 4th example that P picture and B picture are managed with reference to candidate screen.

In this 4th example, about storage management since with when picture B11 is encoded will with reference to candidate screen be divided into that P picture and B picture manage the 1st routine identical, its explanation of Therefore, omited.

In this 4th example; To detect forward motion vector be the method for giving each picture with reference to which the information of candidate screen P7, P10 and B11 about being illustrated in; Should use each picture, confirm it is to make the preferential method of candidate screen of in which zone of P picture storage area and B picture storage area, being stored encoding.

Specifically for example; In the process that picture B12 is encoded; According to apart from hithermost in time the kind of markup, confirm to make the candidate screen of P picture storage area and which storage area of B picture storage area preferentially to carry out cross index and give with reference to picture.

In the process that picture B12 is encoded,,, gives in the picture of in B picture storage area, being stored so preferentially being carried out index owing to the candidate screen apart from the hithermost in time forward direction reference of markup (picture B12) is picture B11.

Thereby, picture B11 is given with reference to picture index [0], picture P10 is given with reference to picture index [1], picture P7 is given with reference to picture index [2].In the case, make the picture of B picture storage area preferentially carry out the information of giving expression, record and narrate in the title of each picture with reference to picture index.

In addition; As heading message; The same with the situation that picture B11 is encoded; Record expression B picture also is used as forward direction B picture implements the inter-picture prediction encoding process with reference to candidate screen, and the candidate screen of the forward direction reference of when the B picture is encoded, using is the information of 2 I or P picture and 1 B picture.

In addition; In this execution mode 1; Just the quantity with reference to candidate screen for the P picture is 3, is the situation of 2 P pictures and 1 B picture for the candidate screen of the forward direction reference of B picture, and 5 examples with reference to the management method of picture memory (Fig. 3, Figure 11～Figure 14) have been described.But 5 examples with reference to the management method of picture memory also can be applied to quantity and execution mode 1 condition of different with reference to candidate screen respectively.Under quantity condition of different, different with execution mode 1 with reference to the capacity of picture memory with reference to candidate screen.

In addition; In this execution mode 1; Be distinguished into reference to candidate screen P picture and B picture to the method (4 examples shown in Figure 11～Figure 14) of managing with reference to picture memory in, store the P picture into P picture storage area, store the B picture into B picture storage area.But in the memory cell of stored picture, also can be utilized in H.263++ in defined short period picture memory and long period picture memory.For example, have respectively the short period picture memory is utilized as P picture storage area, the method that the long period picture memory is utilized as B picture storage area.

[execution mode 2]

Describe in the face of execution mode 2 of the present invention down.

Figure 15 is the block diagram that explanation utilizes the moving image decoding apparatus of execution mode 2 of the present invention to use.

Moving image decoding apparatus 20 is decoded to the bit string Bs that exports from the dynamic image encoding device 10 of execution mode 1.

Particularly, this moving image decoding apparatus 20 has the bit string analytic unit 201 that rheme string Bs analytically carries out the extraction of various data; Coded data Ed from 201 outputs of this bit string analytic unit is decoded and the predicated error decoding unit 202 of prediction of output error information PDd; And based on selecting the mode decoding unit 223 of relevant mode information (coded system) Ms output switch control signal Cs with the mode that is extracted by this bit string analytic unit 201.

Moving image decoding apparatus 20 also has and keeps the decoded image data DId of institute, with institute's image stored data as comparable data Rd or output image data Od export with reference to picture memory 207; Based on the information of the motion vector MV that is extracted from these data of reading (reference image data) Rd, by above-mentioned bit string analytic unit 201 and from the coded system Ms of aforesaid way decoding unit 223, the motion compensation decoding unit 205 of generation forecast data Pd with reference to picture memory 207; And above-mentioned prediction data Pd is added to the dateout PDd of above-mentioned predicated error decoding unit 202, the add operation unit 208 of generating solution code data Ad.

Moving image decoding apparatus 20 also has based on by 201 extracting header information of above-mentioned bit string analytic unit Ih, controls the memory control unit 204 with reference to picture memory 207 through memory control signal Cm; Be arranged on the selector switch 209 between above-mentioned predicated error decoding unit 202 and the add operation unit 208; And be arranged on this add operation unit 208 and with reference to the selector switch between the picture memory 207 210.

Above-mentioned selector switch 209 has an input terminal Te and two lead-out terminal Tf1 and Tf2, and according to above-mentioned switch controlling signal Cs, this input terminal Te is connected to the side of above-mentioned two lead-out terminal Tf1, Tf2.Selector switch 210 has two input terminal Tg1 and Tg2 and a lead-out terminal Th, and according to above-mentioned switch controlling signal Cs, this lead-out terminal Th is connected to the side of above-mentioned two input terminal Tg1, Tg2.In addition; Through above-mentioned selector switch 209; Input terminal Te is applied the dateout PDd of predicated error decoding unit 202; From a side lead-out terminal Tf1 the input terminal Tg1 of selector switch 210 is exported the dateout PDd of above-mentioned predicated error decoding unit 202, from the opposing party's lead-out terminal Tf2 dateout PDd to the above-mentioned predicated error decoding unit 202 of add operation unit 208 outputs.Through above-mentioned selector switch 210; One side's input terminal Tg1 is imported the dateout PDd of above-mentioned predicated error decoding unit 202; The opposing party's input terminal Tg2 is imported the dateout Ad of add operation unit 208; From lead-out terminal Th, a certain side of this dateout PDd and Ad is outputed to reference to picture memory 207 as decode image data DId.

In addition, moving image decoding apparatus 20 has the motion vector MV of maintenance from motion compensation decoding unit 205, the motion vector storage unit 226 that the motion vector MV that is stored is exported to above-mentioned motion compensation decoding unit 205.

Action in the face of moving image decoding apparatus 20 describes down.

In the explanation below, markup to be decoded relatively is meant that showing the picture that is positioned at the place ahead or rear on the time shaft relative markup is in the picture at the place ahead or rear in time, perhaps also is called forward direction or back simply to picture.

In moving image decoding apparatus shown in Figure 15 20, the bit string Bs that input is generated by the dynamic image encoding device 10 of execution mode 1.In this execution mode 2, the bit string of P picture is positioned at selected 1 of 3 candidate screen (I or P picture) nearby at the place ahead or rear in time with reference to relative P picture and implements the inter-picture prediction coding and obtain.In addition, the bit string of B picture with reference to relative this B picture be arranged in the place ahead or rear 4 candidate screen (just be in time 2 I or the P picture in immediate the place ahead, in time be in immediate 1 B picture and be positioned at the I or the P picture at rear in time) selected 2 implement the inter-picture prediction coding and obtain.In for 4 candidate screen, comprise another B picture that this object B picture relatively is in the place ahead in time as the B picture of process object.

In addition, P picture or B picture are with reference to which candidate screen to encode, and the heading message that can be used as bit string is recorded and narrated.Thereby, be just can learn through extracting this heading message by bit string analytic unit 201 with reference to what which picture carried out about the coding of process object picture.This heading message Ih is also to memory control unit 204 outputs.

In the case, the coded data corresponding with the picture in the bit string shown in Figure 16 (a), arranged according to coded sequence.

Specifically, the coded data of the picture among the bit string Bs is arranged by the order of picture P4, B2, B3, P7, B5, B6, P10, B8, B9, P13, B11, B12, P16, B14, B15.In other words, the arrangement of this picture becomes from the last decode time of the decode time axle Y beginning early of expression decode time Tdec and in order each picture has been carried out sequence arrangement (pressing decoding order arranges).

Figure 16 (b), the picture that expression will be arranged by above-mentioned decoding order changes the arrangement of lining up by the picture of DISPLAY ORDER.Just; In Figure 16 (b); The arrangement of picture B2, B3, P4, B5, B6, P7, B8, B9, P10, B11, B12, P13, B14, B15, P16 is in order each picture to be carried out sequence arrangement (pressing DISPLAY ORDER arranges) from the demonstration time shaft X demonstration time sequencing beginning early of expression demonstration time T dis.

Below, the decoding processing of picture P13, B11, B12 is described in this order.

< decoding processing of picture P13 >

The bit string of picture P13 is input to bit string analytic unit 201.Bit string analytic unit 201 carries out extracting from the input bit string processing of various data.Various data are: the expression mode of carrying out is selected the information of usefulness, the i.e. information of presentation code mode Ms (the following coded system that also abbreviates as); The information (the following motion vector that also abbreviates as) of expression motion vector MV, heading message, coded data (view data) etc.The coded system Ms that is extracted outputs to mode decoding unit 203.In addition, the motion vector MV that is extracted outputs to motion compensation decoding unit 205.And then the coded prediction error data Ed that is extracted by bit string analytic unit 201 outputs to predicated error decoding unit 202.

Mode decoding unit 203 based on from the coded system Ms that bit string extracted, carries out the switching controls of switch 209 and 210.Under the situation of in coded system is represented picture, encoding, switch 209 is controlled so that input terminal Te is connected to lead-out terminal Tf1, and switch 210 is controlled so that lead-out terminal Th is connected to input terminal Tg1.In addition, represent in coded system under the situation of inter-picture prediction coding switch 209 to be controlled so that input terminal Te is connected to lead-out terminal Tf2, switch 210 is controlled so that lead-out terminal Th is connected to input terminal Tg2.In addition, mode decoding unit 203 outputs to motion compensation decoding unit 205 with coded system Ms.

Below, coded system is represented the situation of inter-picture prediction coding describes.

Predicated error decoding unit 202 is decoded to the coded data Ed that is imported, generation forecast error information PDd.The prediction error data PDd that is generated outputs to switch 209.In the case, because the input terminal Te of switch 209 is connected to lead-out terminal Tf2, so prediction error data PDd outputs to add operation unit 208.

Motion compensation decoding unit 205 carries out motion compensation based on the motion vector MV that is extracted by analytic unit 201 with reference to picture index Rp, and from obtaining motion compensated image with reference to picture memory 207.This motion compensated image is corresponding to the image in the zone of object piece to be decoded in the markup.

Picture P13 utilizes picture P4, P7, P10 to implement coding as forward direction with reference to candidate screen.When carrying out decoding processing for picture P13, these candidate screen are decoded and be stored in reference in the picture memory 207.

Therefore, motion compensation decoding unit 205 confirms be that which picture among above-mentioned picture P4, P7, the P10 is used as with reference to picture when the object piece decoding of above-mentioned picture P13.Then, motion compensation decoding unit 205 based on motion vector, from reference to picture memory 207, is obtained with reference to the image in the zone of the object piece in the picture correspondence as motion compensated image.

Use Fig. 3 to explain below by the time dependent situation of picture with reference to picture memory 207 storages, and with reference to definite method of picture.

With reference to picture memory 207 by memory control unit 204 control, this control system based on from bit string heading message extracted, which kind of expression carries out with reference to the information (with reference to image information) that obtains P picture and B picture.

Storage area (#1)～(#5) as shown in Figure 3, have 5 picture amounts with reference to picture memory 207.When the decoding of picture P13 begins, in reference to picture memory 207, store picture B8, P4, P7, P10, B9.Picture P13 is used as picture P4, P7, P10 to decode with reference to the candidate of picture.In the storage area of having stored picture B8, the storage decoded pictures P13 of institute.It the reasons are as follows, picture P4, P7, P10 when picture P13 and later picture thereof are decoded, be used as the candidate screen with reference to picture, and picture B8 are not used as with reference to picture to these picture codecs the time.

In Fig. 3, the picture shown in each circular mark is the moment of having accomplished in the decoding of markup, is stored in the picture (markup) with reference to picture memory 207 at last.

In the case, when the motion vector of the object piece that detects picture P13, be just can be according to being additional to confirming of motion vector with reference to image information with reference to which picture.

Specifically with reference to image information is exactly with reference to picture index, and, to giving with reference to picture index of picture P13 with reference to candidate screen.Is near more in time apart from markup (picture P13) with reference to candidate screen to what give with reference to candidate screen with reference to picture index, and value is just more little.

Particularly; Under the situation with reference to picture P10 when picture P13 object piece is encoded, the information (for example with reference to picture index [0]) that the candidate screen in tight the place ahead of indicated object picture (picture P10) is used as with reference to picture is is just recorded and narrated in the bit string of object piece.In addition, under the situation with reference to picture P7 when the object piece is encoded, the information (for example with reference to picture index [1]) that the candidate screen before 2 of the indicated object picture is used as with reference to picture is is just recorded and narrated in the bit string of this object piece.In addition, under the situation with reference to picture P4 when picture P13 object piece is encoded, the candidate screen before 3 of the indicated object picture is used as the information (for example with reference to picture index [2]) with reference to picture, just records and narrates in the bit string of this object piece.

With reference to picture index, just can understand which candidate screen is used as with reference to picture when the object piece is encoded according to this.

Like this, the motion compensated image image of the zone of corresponding objects piece in the picture (just with reference to) according to motion vector with reference to image information, from reference to picture memory 207, is obtained in motion compensation decoding unit 205.

The motion compensated image that generates like this outputs to add operation unit 208.

In addition, motion compensation decoding unit 205 when carrying out the decoding of P picture, outputs to motion vector storage unit 226 with motion vector MV with reference to image information Rp.

Add operation unit 208 is with data (prediction data) the Pd addition of prediction error data PDd and motion compensated image and generating solution code data Ad.The decoded data Ad that is generated outputs to reference to picture memory 207 as decode image data DId through switch 210.

Like this, the piece of picture P13 is decoded in order.When whole pieces of picture P13 are all decoded, just carry out the decoding of picture B11.

< decoding processing of picture B11 >

Because the action of bit string analytic unit 201, mode decoding unit 203 and predicated error decoding unit 202, identical during with the decoding processing of picture P13, its explanation of Therefore, omited.

Motion compensation decoding unit 205 generates moving compensating data from the information of the motion vector imported etc.What output to motion compensation decoding unit 205 from bit string analytic unit 201 is motion vector and with reference to picture index.Through with picture P7, B9 and P10 as the candidate screen of forward direction reference, and picture P13 handled and obtains picture B11 to the predictive coding of the candidate screen of reference as the back.Markup is being decoded during constantly these have been implemented decoding processing and have been stored in reference to picture memory 207 with reference to candidate screen.

Below, use Fig. 3 to explain by the time dependent situation of picture with reference to picture memory 207 storages, and with reference to definite method of picture.

With reference to picture memory 207 by memory control unit 204 control, this control system based on from bit string heading message extracted, be illustrated in carried out when P picture and B picture carried out coding which kind of with reference to and so on information Ih.

When the decoding of picture B11 begins, in reference to picture memory, store picture P13, P4, P7, P10, B9.For picture B11, picture P7, B9, P10 are used as the candidate screen of forward direction reference, and picture P13 are used as back to implementing decoding processing with reference to picture.In the storage area of stored picture P4, the storage decoded pictures B11 of institute, this is because picture P4 is not used as the candidate with reference to picture when picture B11 and later picture thereof are decoded.

In the case, when detecting forward motion vector, be with reference to which candidate screen, just can be according to being additional to confirming of motion vector with reference to image information.

Particularly; Under the situation with reference to picture P10 when the object piece of picture B11 is encoded, the information (for example with reference to picture index [0]) that the candidate screen in tight the place ahead of indicated object picture (picture P10) is used as with reference to picture is is just recorded and narrated in the bit string of this object piece.In addition, when when the object piece is encoded with reference under the situation of picture B9, the information (for example with reference to picture index [1]) that the candidate screen before 2 of the indicated object picture is used as with reference to picture is is just recorded and narrated in the bit string of this object piece.In addition, when when the object piece is encoded with reference under the situation of picture P7, the candidate screen before 3 of the indicated object picture is used as the information (for example with reference to picture index [2]) with reference to picture, just records and narrates in the bit string of this object piece.

Thereby, with reference to picture index, just can understand which candidate screen is used as with reference to picture when the object piece is encoded according to this.

Motion compensation decoding unit 205 is under the situation of bi-directional predictive coding in the mode of selecting, and according to reference to picture index, confirms to use which picture of picture P7, B9 and P10 to carry out the forward direction reference.Then, motion compensation decoding unit 205, based on forward motion vector from obtaining the forward motion compensation image with reference to picture memory 207, in addition, based on backward motion vector from obtaining the reverse compensating images with reference to picture memory 207.

Then, motion compensation decoding unit 205 through the summation averaging of forward motion compensation image and reverse compensating images, generates motion compensated image.

Then, the processing of using forward direction and backward motion vector to generate motion compensated image is described.

(bi-directional predicted mode)

Figure 17 representes that the decoder object picture is picture B11, and piece (object piece) BLa01 of the decoder object that becomes picture B11 is carried out the situation of bi-directional predicted decoding.

At first, explain that forward direction is picture P10 with reference to picture, then to being the situation of picture P13 with reference to picture.

In the case, forward motion vector is the motion vector MVe01 of expression picture zone C Re01 P10, corresponding blocks BLa01.Backward motion vector is expression, the motion vector MVg01 of zone C Rg01 picture P13, corresponding blocks BLa01.

Thereby; Motion compensation decoding unit 205; From with reference to picture memory 207, obtain the image of the zone C Re01 among the picture P10 as forward direction with reference to image, as the back to the image of obtaining the zone C Rg01 among the picture P13 with reference to image; The image of these two zone C Re01 and CRg01 is implemented the summation averaging of view data, obtain motion compensated image corresponding to above-mentioned object piece BLa01.

Then, explain that forward direction is picture B9 with reference to picture, the back is to being the situation of picture P13 with reference to picture.

In the case, forward motion vector is the motion vector MVf01 of the zone C Rf01 of the corresponding blocks BLa01 of expression picture B9.Backward motion vector is the motion vector MVg01 of the zone C Rg01 of the corresponding blocks BLa01 of expression picture P13.

Thereby; Motion compensation decoding unit 205; From with reference to picture memory 207, obtain the image of the zone C Rf01 among the picture B9 as forward direction with reference to image, as the back to the image of obtaining the zone C Rg01 among the picture P13 with reference to image; The image of these two zone C Rf01 and CRg01 is implemented the summation averaging of view data, obtain motion compensated image corresponding to above-mentioned object piece BLa01.

(direct mode)

In addition; In coded system is under the situation of direct mode; Motion compensation decoding unit 205, obtain in motion vector storage unit 226, stored, markup B11 back to motion vector (benchmark motion vector) with reference to relative position picture P13, picture the piece identical with the object piece.Motion compensation decoding unit 205 uses this benchmark motion vector, from obtain with reference to picture memory 207 forward direction with reference to image and back to reference to image.Then, the 205 pairs of forward directions in motion compensation decoding unit are with reference to image and back to the summation averaging of implementing view data with reference to image, thereby generation is corresponding to the motion compensated image of above-mentioned object piece.In the explanation below,, also be called the piece that is in the particular block same position of a picture simply for the piece in the relative position of picture and other pictures that specific piece in the picture equates.

Figure 18 (a) expression is with reference near the picture P10 before the picture B11, the situation (the 1st example of direct mode decoding) of the piece BLa10 of picture B11 being decoded with direct mode.

The benchmark motion vector that under direct mode, uses in the decoded process at piece BLa10 is, when piece BLa10 is decoded after to picture (reference pictures) P13 of reference, be in forward motion vector (benchmark motion vector) MVh10 with piece (reference block) BLg10 of piece BLa10 same position.This forward direction motion vector MVh10, expression near the picture P10 before the picture B11, corresponding to the motion vector of the zone C Rh10 of reference block BLg10.

In the case, as the forward motion vector MVk10 of piece BLa10 to be decoded, use zone C Rk10 among the above-mentioned picture P10 of expression, corresponding objects piece BLa10, with the parallel motion vector of said reference motion vector MVh10.In addition, among the backward motion vector MVi10 as the piece BLa10 of object to be decoded, use zone C Ri10 among the above-mentioned picture P13 of expression, corresponding objects piece BLa10, with the parallel motion vector of said reference motion vector MVh10.

Thereby; Motion compensation decoding unit 205; From with reference to picture memory 207, obtain forward direction with reference to the image among the zone C Rk10 of picture P10 as forward direction with reference to image, obtain the back to reference to the image among the zone C Ri10 of picture P13 as the back to reference to image; View data through for these two images is carried out summation averaging, obtains the motion compensated image (predicted picture) corresponding to object piece BLa10.

In the case, the size (MVB) of the size of forward motion vector MVk10 (MVF) and backward motion vector MVi10 can be used the size (MVR) of said reference motion vector MVh10, is obtained by above-mentioned formula (1), (2).

If the big or small MVF of each motion vector, MVB represent the horizontal component and the vertical component of motion vector respectively.

In addition, TRD is, the object piece BLa10's of picture B11 is back to reference to picture P13 with the time gap of the picture P10 of forward direction reference when decoded is being carried out to piece (reference block) BLg10 with reference to picture (reference pictures) P13 in this back.In addition, TRF is, picture B11 and near the time gap with reference to picture P10 before it, TRB be, picture B11 and to the time gap of back picture P10 of reference when the piece BLg10 with reference to picture P13 decodes.

Figure 18 (b) expression is with reference near the picture P10 before the picture B11, the situation (the 2nd example of direct mode decoding) of the piece BLa10 of picture B11 being decoded with direct mode.

In the 2nd example of this direct mode decoding; Different with the 1st example of the direct mode decoding shown in Figure 18 (a); Picture reference block (just for object piece back to reference to picture, with the piece of object piece same position) being carried out forward direction reference when decoded is picture P7.

Just, the benchmark motion vector that under direct mode, uses in the decoded process at piece BLa20 is, when piece BLa20 is decoded by the back in the picture P13 of reference, be in the forward motion vector MVh20 with the piece BLg20 of piece BLa20 same position.This forward direction motion vector MVh20, be expression the place ahead of being positioned at markup B11 picture P7, corresponding to the motion vector of the zone C Rh20 of reference block BLg20.

In the case, as the forward motion vector MVk20 of piece BLa20 to be decoded, use zone C Rk20 among the above-mentioned picture P10 of expression, corresponding objects piece BLa20, with the parallel motion vector of said reference motion vector MVh20.In addition, as the backward motion vector MVi20 of piece BLa20 to be decoded, use zone C Ri20 among the above-mentioned picture P13 of expression, corresponding objects piece BLa20, with the parallel motion vector of said reference motion vector MVh20.

Thereby; Motion compensation decoding unit 205; From with reference to picture memory 207, obtain forward direction with reference to the image among the zone C Rk20 of picture P10 as forward direction with reference to image, obtain the back to reference to the image among the zone C Ri20 of picture P13 as the back to reference to image; View data through for these two images is carried out summation averaging, obtains the motion compensated image (predicted picture) corresponding to object piece BLa20.

In the case; The size of forward motion vector MVk20 (MVF), and the size (MVB) of backward motion vector MVi20 can be used the size (MVR) of said reference motion vector MVh20; Same with the 1st example of above-mentioned direct mode decoding, obtain by above-mentioned formula (1), (2).

Figure 19 (a) expression is with reference to the picture P7 that is positioned near the place ahead of the picture P10 before the picture B11, the situation (the 3rd example of direct mode decoding) of the piece BLa30 of picture B11 being decoded with direct mode.

In the 3rd example of this direct mode decoding; Different with the 1st example of the direct mode decoding shown in Figure 18 (a) and Figure 18 (b) with the 2nd example; At the picture that the object piece is carried out forward direction reference when decoded; Be not near the picture before the markup, but when the reference block (with the piece of object piece same position) of reference pictures is decoded the picture of forward direction reference.Reference pictures be when the object piece is decoded after to the picture of reference.

Just, the benchmark motion vector that under direct mode, uses in the decoded process at piece BLa30 is, when piece BLa30 is decoded after in the picture P13 of reference, be in the forward motion vector MVh30 with the piece BLg30 of piece BLa30 same position.This forward direction motion vector MVh30 is the motion vector of zone C Rh30 picture P7, corresponding reference block BLg30 that expression is positioned at the place ahead of markup B11.

In the case, as the forward motion vector MVk30 of piece BLa30 to be decoded, use zone C Rk30 among the above-mentioned picture P7 of expression, corresponding objects piece BLa30, with the parallel motion vector of said reference motion vector MVh30.In addition, as the backward motion vector MVi30 of piece BLa30 to be decoded, use expression zone C Ri30 above-mentioned picture P13, corresponding objects piece BLa30, with the parallel motion vector of said reference motion vector MVh30.

Thereby; Motion compensation decoding unit 205; From with reference to picture memory 207, obtain forward direction with reference to the image of the zone C Rk30 of picture P7 as forward direction with reference to image, obtain the back to reference to the image of the zone C Ri30 of picture P13 as the back to reference to image; View data through for these two images is carried out summation averaging, obtains the motion compensated image (predicted picture) corresponding to object piece BLa30.

In the case, the size of forward motion vector MVk30 (MVF), and the size (MVB) of backward motion vector MVi30 can be used the size (MVR) of said reference motion vector MVh30, are obtained by above-mentioned formula (2), (3).

When at the picture of piece BLg30 institute's reference of decoded time under situation with reference to picture memory 207 deletions, with the immediate forward direction picture in position P10 in time as the forward direction in the 3rd example of direct mode decoding with reference to picture.Processing in the 3rd example of direct mode decoding in the case, identical with the 1st example of direct mode decoding.

It is 0 motion vector that size is used in Figure 19 (b) expression, the situation (the 4th example that direct mode is decoded) of the piece BLa40 of picture B11 being decoded with direct mode.

In the 4th example of this direct mode decoding, the size of the benchmark motion vector that uses in the 1st example of the direct mode decoding shown in Figure 18 (a) and Figure 18 (b) and the 2nd example is 0.

In the case, in the forward motion vector MVk40 and backward motion vector MVi40 of piece BLa40 to be decoded, the use size is 0 motion vector.

Just, above-mentioned forward motion vector MVk40, among the expression picture P10, be positioned at object piece BLa40 same position, with zone (piece) CRk40 of the same size of object piece.In addition, above-mentioned backward motion vector MVi40, among the expression picture P13, be positioned at object piece BLa40 same position, with zone (piece) CRi40 of the same size of object piece.

Thereby; Motion compensation decoding unit 205; From with reference to picture memory 207, obtain forward direction with reference to the image of zone (piece) CRk40 of picture P10 as forward direction with reference to image, obtain the back to reference to the image of the zone C Ri40 of picture P13 as the back to reference to image; View data through for these two images is carried out summation averaging, obtains the motion compensated image (predicted picture) for object piece BLa40.The method can be applicable to, for example, and back as picture B11 to being, as by the piece of intraframe coding, there not being the such situation of piece of motion vector with reference to the piece that is in piece BLa40 same position among the picture P13 of picture.

The data of the motion compensated image that is generated like this are to 208 outputs of add operation unit.In add operation unit 208, the data of prediction error data of being imported and motion compensated image are added up mutually, generate decoded image data.The decode image data that is generated is outputed to reference to picture memory 207 through switch 210, and decoded picture is stored this with reference to picture memory 207.

Memory control unit 204, based on from bit string heading message extracted, P picture and B picture be which kind of adopts with reference to the information Ih that encodes and so on, to controlling with reference to picture memory 207.

As above above-mentioned, the piece of picture B11 is decoded by order.When whole pieces of picture B11 are decoded, carry out the decoding of picture B12.

In the decoded process of above-mentioned B picture, sometimes specific piece is handled as jumping over piece., below, the decoding of jumping over piece is described simply.

In the decoding processing of the bit string of importing; Through index information that jumps over identifier and piece of in this bit string, being recorded and narrated etc.; Distinguish that particular block is used as and jump under the situation that piece handles, carry out motion compensation, just obtaining corresponding to the predicted picture of object piece with direct mode.

For example, shown in Fig. 6 (b), with the piece MB (r) of picture B11 and the piece MB (r+1) between the piece MB (r+1) and piece MB (r+2) as jumping under the situation that piece handles, detect by bit string analytic unit 201 and to jump over identifier Sf among the bit string Bs.When this jumped over identifier Sf and is imported into mode decoding unit 223,223 pairs of motion compensation decoding unit of mode decoding unit send instruction made it carry out motion compensation with direct mode.

So; Motion compensation decoding unit 205; Based on be included in forward direction with reference among the picture P10 and with as jumping over the image (forward direction is with reference to image) that piece that piece handles is in the piece of same position; With with as jumping over the image that piece that piece handles is in the piece of same position (back to reference to image), obtain the predicted picture of piece MB (r+1) and MB (r+2), and the data of predicted picture outputed to add operation unit 208.Predicated error decoding unit 202, as the differential data that is treated to the piece that jumps over piece, output valve is 0 data.In add operation unit 208; Because the differential data as jumping over the piece that piece handles is 0; So the data of the predicted picture of piece MB (r+1) and MB (r+2), the data that are used as the decoded picture of piece MB (r+1) and MB (r+2) output to reference to picture memory 207.

In addition; In processing example (the 2nd example) under the direct mode shown in processing under the direct mode shown in Figure 18 (a) example (the 1st example), Figure 18 (b), the processing example (the 3rd example) under the direct mode shown in 19 (a), not to be that 0 piece is all handled as jumping over piece with differential data.In other words; With relative markup be positioned in time near preceding picture as forward direction with reference to picture; And using size is that 0 motion vector carries out bi-directional predicted for the object piece; And only under the differential data of object piece is 0 situation, this object piece is handled as jumping over piece.

Under these circumstances, when the identifier etc. of jumping over from bit string Bs is learnt specific piece when jumping over piece, motion compensation process, should through will be in time near preceding with reference to picture as forward direction with reference to picture, motion is 0 bi-directional predicted carrying out.

< decoding processing of picture B12 >

Because the action of bit string analytic unit 201, mode decoding unit 203 and predicated error decoding unit 202, identical during with the decoding processing of picture P10, its explanation of Therefore, omited.

Motion compensation decoding unit 205 generates motion-compensated image data from the information of the motion vector imported etc.That be input to motion compensation decoding unit 205 is motion vector MV and with reference to picture index Rp.Picture B12 be with picture P7, P10 and B11 as the candidate screen of forward direction reference, picture P13 is implemented encoding process as the back to the candidate screen of reference.These candidate screen are in decoding decoded constantly and being stored in reference to picture memory 207 to markup.

By the time dependent situation of picture with reference to picture memory 207 storage, and with reference to definite method of picture, the method when illustrated picture B11 is decoded with using Fig. 3 is identical.

In the presentation code mode is under the situation of bi-directional predictive coding mode, and motion compensation decoding unit 205 according to reference to picture index, confirms which picture of picture P7, P10 and B11 has been carried out the forward direction reference.Then, motion compensation decoding unit 205 based on forward motion vector from obtaining forward direction with reference to image with reference to picture memory 207, and, in addition, based on backward motion vector from obtaining the back with reference to picture memory 207 to reference to image.Then, motion compensation decoding unit 205, through to forward direction with reference to image and back to the summation averaging of implementing view data with reference to image, the motion compensated image of formation object piece.

(bi-directional predicted mode)

Figure 20 representes that the decoder object picture is picture B12, and piece (object piece) BLa02 of the decoder object that becomes picture B12 is carried out the situation of bi-directional predicted decoding.

At first, explain that forward direction is picture B11 with reference to picture, the back is to being the situation of picture P13 with reference to picture.

In the case, forward motion vector is the motion vector MVe02 corresponding to the zone C Re02 of piece BLa02 of expression picture B11.Backward motion vector is the motion vector MVg02 corresponding to the zone C Rg02 of piece BLa02 of expression picture P13.

Thereby; Motion compensation decoding unit 205; From with reference to picture memory 207, the image of obtaining the zone C Re02 among the picture B11 as forward direction with reference to image, the image of obtaining the zone C Rg02 among the picture P13 as the back to reference to image; The image of these two zone C Re02 and CRg02 is implemented the summation averaging of view data, obtain motion compensated image for above-mentioned object piece BLa02.

Then, be picture P10 to forward direction with reference to picture, explain to the situation that with reference to picture is picture P13 the back.

In the case, forward motion vector is the motion vector MVf02 corresponding to the zone C Rf02 of piece BLa02 of expression picture P10.Backward motion vector is the motion vector MVg02 corresponding to the zone C Rg02 of piece BLa02 of expression picture P13.

Thereby; Motion compensation decoding unit 205; From with reference to picture memory 207, the image of obtaining the zone C Rf02 among the picture P10 as forward direction with reference to image, the image of obtaining the zone C Rg02 among the picture P13 as the back to reference to image; The image of these two zone C Rf02 and CRg02 is implemented the summation averaging of view data, obtain the motion compensated image of above-mentioned object piece BLa02.

(direct mode)

In addition; In coded system is under the situation of direct mode; Motion compensation decoding unit 205, obtain in motion vector storage unit 226, stored, markup B12 back to motion vector (benchmark motion vector) with reference to the reference block (piece that relative position is identical with the object piece) of picture P13.Motion compensation decoding unit 205, through using this benchmark motion vector, from obtain with reference to picture memory 207 forward direction with reference to image and back to reference to image.Then, the 205 pairs of forward directions in motion compensation decoding unit generate the motion compensated image for above-mentioned object piece with reference to image and back to implementing the view data summation averaging with reference to image.

Figure 21 (a) expression is with reference near the picture B11 before the picture B12, the situation (the 1st example of direct mode decoding) of the piece BLa50 of picture B12 being decoded with direct mode.

The benchmark motion vector that under direct mode, uses in the decoded process at piece BLa50 is, when piece BLa50 is decoded after to the forward motion vector MVj50 of the reference block (being in piece BLg50) of the picture P13 of reference with piece BLa50 same position.This forward direction motion vector MVj50, be expression the place ahead picture P10 nearby of being positioned at picture B11, corresponding to the motion vector of the zone C Rj50 of reference block BLg50.

In the case, as the forward motion vector MVk50 of the piece BLa50 of decoder object, use expression be included in above-mentioned picture B11, corresponding to the zone C Rk50 of object piece BLa50, with the parallel motion vector of said reference motion vector MVj50.In addition, as the backward motion vector MVi50 of the piece BLa50 of decoder object, use expression be included in above-mentioned picture P13, corresponding to the zone C Ri50 of object piece BLa50, with the parallel motion vector of said reference motion vector MVj50.

Thereby; Motion compensation decoding unit 205; From with reference to picture memory 207, obtain forward direction with reference to the image of the zone C Rk50 of picture B11 as forward direction with reference to image, obtain the back to reference to the image of the zone C Ri50 of picture P13 as the back to reference to image; View data through for these two images is carried out summation averaging, obtains the motion compensated image (predicted picture) for object piece BLa50.

In the case, the size of forward motion vector MVk50 (MVF), and the size (MVB) of backward motion vector MVi50 can be used the size (MVR) of said reference motion vector MVj50, are obtained by above-mentioned formula (1), (2).

The big or small MVF of each motion vector, MVB be the horizontal component and the vertical component of expressive movement vector respectively.

Figure 21 (b) expression is with reference to the picture B11 in the place ahead of picture B12, the situation (the 2nd example of direct mode decoding) of the piece BLa60 of picture B12 being decoded with direct mode.

In the 2nd example of this direct mode decoding, different with the 1st example of the direct mode decoding shown in Figure 21 (a), reference block (just the object piece back to reference in the picture, and the piece of object piece same position) picture of forward direction reference when decoded is picture P7.

Just, the benchmark motion vector that under direct mode, uses in the decoded process at piece BLa60 is, when piece BLa60 is decoded after to the forward motion vector MVj60 of the reference block (being in piece BLg60) of the picture P13 of reference with piece BLa60 same position.This forward direction motion vector MVj60, be expression the place ahead of being positioned at markup B12 picture P7, corresponding to the motion vector of the zone C Rj60 of reference block BLg60.

In the case, as the forward motion vector MVk60 of the piece BLa60 of decoder object, use the above-mentioned picture B11 of expression, corresponding to the zone C Rk60 of object piece BLa60, with the parallel motion vector of said reference motion vector MVj60.In addition, as the backward motion vector MVi60 of the piece BLa60 of decoder object, use the above-mentioned picture P13 of expression, corresponding to the zone C Ri60 of object piece BLa60, with the parallel motion vector of said reference motion vector MVj60.

Thereby; Motion compensation decoding unit 205; From with reference to picture memory 207, obtain forward direction with reference to the image of the zone C Rk60 of picture B11 as forward direction with reference to image, obtain the back to reference to the image of the zone C Ri60 of picture P13 as the back to reference to image; View data through for these two images is carried out summation averaging, obtains the motion compensated image (predicted picture) of object piece BLa60.

In the case; The size of forward motion vector MVk60 (MVF), and the size (MVB) of backward motion vector MVi60 can be used the size (MVR) of said reference motion vector MVj60; The same with the 1st example of above-mentioned direct mode decoding, obtain by above-mentioned formula (1) and (2).

Figure 22 (a) expression is with reference to being positioned at than at the immediate forward direction picture P10 of the picture B12 picture P7 in the place ahead more, the situation (the 3rd example of direct mode decoding) of the piece BLa70 of picture B12 being decoded with direct mode.

In the 3rd example of this direct mode decoding; Different with the 1st example of the direct mode decoding shown in Figure 21 (a) and Figure 21 (b) with the 2nd example; The picture of forward direction reference when the object piece is decoded; Be not near the picture before the markup, but when the reference block of reference pictures is decoded the picture of forward direction reference.Reference pictures be when the object piece is decoded after to the picture of reference.

Just, the benchmark motion vector that under direct mode, uses in the decoded process at piece BLa70 is, when piece BLa70 is decoded after to the forward motion vector MVj70 of reference block (being in the piece) BLg70 of the picture P13 of reference with piece BLa70 same position.This forward direction motion vector MVj70, be expression the place ahead of being positioned at markup B12 picture P7, corresponding to the motion vector of the zone C Rj70 of reference block BLg70.

In the case, as the forward motion vector MVk70 of the piece BLa70 of decoder object, use the above-mentioned picture P7 of expression, corresponding to the zone C Rk70 of object piece BLa70, with the parallel motion vector of said reference motion vector MVj70.In addition, as the backward motion vector MVi70 of the piece BLa70 of decoder object, use the above-mentioned picture P13 of expression, corresponding to the zone C Ri70 of object piece BLa70, with the parallel motion vector of said reference motion vector MVj70.

Thereby; Motion compensation decoding unit 205; From with reference to picture memory 207, obtain forward direction with reference to the image of the zone C Rk70 of picture P7 as forward direction with reference to image, obtain the back to reference to the image of the zone C Ri70 of picture P13 as the back to reference to image; View data through for these two images is carried out summation averaging, obtains the motion compensated image (predicted picture) of object piece BLa70.

In the case, the size of forward motion vector MVk70 (MVF), and the size (MVB) of backward motion vector MVi70 can be used the size (MVR) of said reference motion vector MVj70, are obtained by above-mentioned formula (2), (3).

When at the picture of piece BLg70 institute's reference of decoded time under situation with reference to picture memory 207 deletions, with the immediate forward direction picture in position P10 in time as the forward direction in the 3rd example of direct mode decoding with reference to picture.Processing in the 3rd example of direct mode decoding in the case, identical with the 1st example of direct mode decoding.

It is 0 motion vector that size is used in Figure 22 (b) expression, the situation (the 4th example that direct mode is decoded) of the piece BLa80 of picture B12 being decoded with direct mode.

In the 4th example of this direct mode decoding, be 0 with the 1st example of the decoding of the direct mode shown in Figure 21 (a) and Figure 21 (b) and the size of the benchmark motion vector in the 2nd example.

In the case, as forward motion vector MVk80 and the backward motion vector MVi80 of the piece BLa80 of decoder object, using size is 0 motion vector.

Just, above-mentioned forward motion vector MVk80, expression picture B11, be positioned at object piece BLa80 same position, with zone (piece) CRk80 of the same size of object piece.In addition, above-mentioned backward motion vector MVi80, expression picture P13, be positioned at object piece BLa80 same position, with zone (piece) CRi80 of the same size of object piece.

Thereby; Motion compensation decoding unit 205; From with reference to picture memory 207, obtain forward direction with reference to the image of zone (piece) CRk80 of picture B11 as forward direction with reference to image, obtain the back to reference to the image of the zone C Ri80 of picture P13 as the back to reference to image; View data through for these two images is carried out summation averaging, obtains the motion compensated image (predicted picture) for object piece BLa80.The method also can be applied to, for example, and back as picture B12 to being, as by the piece of intraframe coding, there not being the such situation of piece of motion vector with reference to the piece that is in piece BLa80 same position among the picture P13 of picture.

The data of the motion compensated image that is generated like this output to add operation unit 208.Add operation unit 208 is with the data addition of prediction error data of being imported and motion compensated image and generate decode image data.The decode image data that is generated outputs to reference to picture memory 207 through switch 210.

As stated, the piece of picture B12 is implemented decoding processing in order.The view data of each picture of in reference to picture memory 207, being stored is arranged the back again in chronological order and is exported as output image data Od.

Then, shown in Figure 16 (a), for the later picture of being arranged by the decode time order of picture B12, according to picture type, through decoding with above-mentioned picture P13, B11, the same processing of B12.Figure 16 (b) expression is by the arrangement of the picture that shows row that time sequencing changes.

When in the decoding processing of the bit string of being imported; When through index information that jumps over identifier and piece of in this bit string, being recorded and narrated etc.; Distinguish that particular block is used as and jump under the situation that piece handles; Likewise carry out motion compensation with the situation of the decoding of picture B11, just obtaining corresponding to the predicted picture of object piece with direct mode.

As stated; Because in the moving image decoding apparatus 20 of this execution mode 2; When the piece of B picture is decoded; Candidate screen as the forward direction reference is used the B picture of decoding with the P picture of decoding; Be based on comprised in the bit string corresponding to object piece to be decoded, when being illustrated in this object piece and being encoded by the information of the candidate screen of forward direction reference (with reference to picture index), generate the predicted picture of this object piece, so just can be to correctly decoding the B picture as the piece of the coded B picture of the candidate screen of forward direction reference.

In addition, in moving image decoding apparatus 20, under the situation that the object piece to be decoded of B picture is encoded with direct mode,, come the motion vector of calculating object piece based on being in the motion vector of the piece of same position with this object piece.So, the promptly necessary information that is able to the motion vector of the coded piece of direct mode in the decoding side from the coding side-draw.

In addition, in moving image decoding apparatus 20, based on comprised in bit string as heading message, the information of used candidate screen when being illustrated in P picture and B picture and being encoded, the data of the decoded picture of managing in to be stored with reference to picture memory.For example, in the moment that the decoding processing of a picture has been accomplished, deleting successively in the later decoding processing of this picture can be as the data with reference to the picture of picture, so just can efficient utilize picture memory well.

In addition; When the object piece of P picture was decoded, which picture in the candidate screen was used as with reference to picture, (just; The motion vector of object piece to be decoded with reference to which candidate screen obtains) can confirming from be attached to motion vector information with reference to image information.

Equally; When the object piece of B picture is decoded; Which picture in the candidate screen of forward direction reference is used as with reference to picture; (just, the forward motion vector of object piece to be decoded with reference to which candidate screen obtains) can confirming with reference to image information from be attached to motion vector information.

Although in this execution mode 2, what adopt for one of a plurality of coded systems of B picture is direct mode, also can not use direct mode as the coded system of B picture.In the case, the motion vector storage unit 226 that does not just need moving image decoding apparatus 20.

In addition; In this execution mode 2; As direct mode; Specifically recorded and narrated 4 methods (the 4th example shown in the 3rd example shown in the 2nd example shown in the 1st example shown in Figure 18 (a) or Figure 21 (a), Figure 18 (b) or Figure 21 (b), Figure 19 (a) or Figure 22 (a), Figure 19 (b) or Figure 22 (b) just), in decoding device, used and in code device, decode as the corresponding method of the used method of direct mode.Specifically, using as direct mode under the situation of a plurality of methods, use is recorded and narrated in bit string, and expression has used the information of which kind of method to decode as concrete direct mode.

At this moment, the action of motion compensation decoding unit 205 just changes according to this information.For example; At the piece with motion compensation is under the situation of additional this information of unit; Confirm the codings that used which method in above-mentioned 4 concrete grammars to carry out as direct mode by mode decoding unit 223, and the concrete grammar of determined direct mode is sent to motion compensation decoding unit 205.Then, motion compensation decoding unit 205, which is used in above-mentioned 4 methods according to the concrete grammar as direct mode, carries out suitable motion compensated prediction decoding processing.

In addition; The information (DM mode information) that is used and so in which method of concrete grammar as direct mode; Record and narrate in the whole title of sequence, GOP title, picture title, or in the bar title situation under; To each sequence integral body, GOP, picture, or picture bar, DM mode information is sent to motion compensation decoding unit 205 from bit string analytic unit 201, the action of motion compensation decoding unit 205 is changed.

Although in this execution mode 2,2 B pictures are between I picture and the P picture or between the P picture of adjacency, and the number of continuous B picture also can be 3 or 4.

In addition, although in this execution mode 2, the quantity of the candidate screen of the forward direction reference of adopting for the P picture is 3, and the quantity with reference to candidate screen of P picture also can be the value beyond 3.

In addition, although in this execution mode 2, the candidate screen of the forward direction reference of when the B picture is decoded, using is 2 I or P picture and 1 B picture, and the candidate screen of forward direction reference is not limited to this when the B picture is decoded.

In addition; In this execution mode 2; As method to managing with reference to picture memory when picture P13, picture B11 and picture B12 are decoded, that kind as shown in Figure 3 is to as being illustrated with reference to the P picture of the candidate of picture and the method that the B picture is managed in the lump.But with reference to the management method of picture memory, also can be 4 the illustrated methods of use Figure 11～Figure 14 in execution mode 1, just, will be used as whole pictures with reference to the candidate of picture and be divided into the method that P picture and B picture are managed.

In the case, with reference to picture memory 207, the zone that has 6 picture amounts as storage area, just, P picture memory (#1)～(#4), B picture memory (#1) and (#2).In addition, these 6 storage areas are not limited to be formed on 1 with reference to the situation in the picture memory, also can be that 6 storage areas independently constitute with reference to picture memory by 1 respectively.

In addition; Shown in figure 14, when the coding side, to each picture to be encoded; Use confirms to make P picture storage area and B picture storage area, and which is preferentially given under the situation with reference to the method for picture index; Moving image decoding apparatus can be illustrated in the information in the bit string that is in preferential storage area in above-mentioned two storage areas through use, based on be identified in the picture that is used as in the candidate screen with reference to picture simply with reference to picture index.

For example, be under the situation of picture B11 at the decoder object picture owing to be picture P10 with reference to picture apart from the hithermost in time forward direction of this markup, so that be stored in picture in the P picture memory and preferentially carry out index and give.Thereby, when the object piece of picture B11 is encoded, as heading message, additional with reference to picture index [0] under picture P10 is used as with reference to the situation of picture in the bit string of object piece.Likewise, additional with reference to picture index [1] under picture P7 is used as with reference to the situation of picture, and additional with reference to picture index [2] under picture B9 is used as with reference to the situation of picture.Thereby moving image decoding apparatus just can be according to reference to picture index, understands which candidate screen is used as with reference to picture when the object piece is encoded.

In the case, because expression makes the candidate screen of P picture memory preferentially carry out the information that index is given, be used as heading message and be included in the bit string, so just can more easily discern through utilizing this information with reference to picture.

In addition, be under the situation of picture B12 at the decoder object picture owing to be picture B11 with reference to picture apart from the hithermost in time forward direction of this markup, so that be stored in picture in the B picture memory and preferentially carry out index and give.Thereby, when the object piece of picture B12 is encoded, as heading message, additional with reference to picture index [0] under picture B11 is used as with reference to the situation of picture in the bit string of object piece.Likewise, additional with reference to picture index [1] under picture P10 is used as with reference to the situation of picture, and additional with reference to picture index [2] under picture P7 is used as with reference to the situation of picture.Thereby moving image decoding apparatus just can be according to reference to picture index, understands which candidate screen is used as with reference to picture when the object piece is encoded.

In the case, because expression makes the candidate screen of B picture memory preferentially carry out the information that index is given, be used as heading message and be included in the bit string, so just can more easily discern through utilizing this information with reference to picture.

In addition, in the coding side,, there is use (, perhaps to switch the situation of using a plurality of methods in 5 methods with reference to the situation of a method of selecting in advance among Fig. 3, Figure 11～Figure 14) in above-mentioned 5 methods as management method with reference to picture memory.For example; Switch above-mentioned a plurality of methods to the situation of managing with reference to picture memory under; Moving image decoding apparatus, just can be based in the bit string to be recorded and narrated, expression used the information of which management method to each picture, confirm with reference to picture index.

In addition; In above-mentioned execution mode 2; The quantity of having recorded and narrated for the P picture with reference to candidate screen is 3, is 5 examples with reference to the management method of picture memory (Fig. 3, Figure 11～Figure 14) of 2 P pictures and 1 B picture for the candidate screen of the forward direction reference of B picture.But, also can be applied to quantity and execution mode 2 condition of different respectively with reference to candidate screen with reference to 5 examples of the management method of picture memory.Under the quantity condition of different with reference to candidate screen like this, also different with execution mode 2 with reference to the capacity of picture memory.

In addition; In above-mentioned execution mode 2; Be illustrated in being distinguished into P picture and B picture with reference to candidate screen in the method (4 examples shown in Figure 11～Figure 14) of managing with reference to picture memory; Store the P picture into P picture storage area, the B picture is stored into the situation of B picture storage area.But, in the memory cell of stored picture, also can be utilized in H.263++ in defined short period picture memory and long period picture memory.For example, have short period picture storage is utilized as P picture storage area, the method that the long period picture memory is utilized as B picture storage area.

[execution mode 3]

Figure 23 is the block diagram that explanation utilizes the dynamic image encoding device of execution mode 3 of the present invention.

The dynamic image encoding device 30 of this execution mode 3; Can be according to control signal from the outside; To give method to candidate screen, switch to according to being carried out the method for giving (default adding method) by the rule of initial setting and utilizing default adding method that candidate screen is given with reference to picture index with reference to picture index with reference to picture index; And then, according to coding situation any one to the adaptation adding method that changes with reference to picture index given with adapting to.

Particularly, the action of an action form of the dynamic image encoding device 30 of this execution mode 3 dynamic image encoding device 10 that is execution mode 1.In other words, the dynamic image encoding device 30 of execution mode 3, select default adding method as its situation with reference to the adding method of picture index under, then carry out the processing same with the dynamic image encoding device of execution mode 1 10.

Below, dynamic image encoding device 30 is specified.

This dynamic image encoding device 30 is with the coding control unit 110 in the dynamic image encoding device 10 of coding control unit 130 replacement execution modes 1.Coding control unit 130; According to control signal Cont from the outside; To give method to candidate screen with reference to picture index; Switch to according to being given the method with reference to picture index (default adding method) to candidate screen by the rule of initial setting; Utilize default adding method to give the 1st step with comprising, with any one of the method (adaptation adding method) of the 2nd step that changes with reference to picture index of giving candidate screen to utilizing default adding method with reference to picture index to candidate screen with adapting to.

In addition, coding control unit 130 has, by each coded object picture to a plurality of with reference to candidate screen, detect respectively as detecting unit (not shown) with reference to the code efficiency under the picture situation.This control unit 130 of encoding, according to by the detected code efficiency of this detecting unit, change for each candidate screen of utilizing default adding method to set with reference to picture index.

More specifically; 130 pairs of control units of coding utilize the value with reference to picture index of each candidate screen that default adding method sets; So that for markup a plurality of with reference to candidate screen in; As high more, more little with reference to the value of picture index with reference to the code efficiency of the markup under the picture situation.

Then, mode selected cell 139, in direct mode, as for the forward direction of object piece with reference to picture, the picture and selecting that will be endowed with reference to picture index [0] is that forward direction is with reference to picture.Mode selected cell 139, the predictive coding mode beyond direct mode for example in the bi-directional predictive coding mode, carries out selecting the processing with reference to picture from a plurality of candidate screen according to code efficiency.

Other assemblies of the dynamic image encoding device 30 of this execution mode 3, identical with in the dynamic image encoding device 10 of execution mode 1.

Then, the action to dynamic image encoding device 30 describes.

In this dynamic image encoding device 30; At the control signal Cont of basis from the outside; As the method with reference to picture index of giving for candidate screen; Under the selecteed situation of default adding method, the action of dynamic image encoding device 30, identical with the action of the dynamic image encoding device 10 of execution mode 1.

On the other hand; At the control signal Cont of basis from the outside; As the method with reference to picture index of giving for candidate screen; Adapt under the selecteed situation of adding method, in this dynamic image encoding device 30, the dynamic image encoding device 10 through the 1st step and execution mode 1 carries out giving with reference to picture index in the same way.

Adapting under the selecteed situation of adding method, in this dynamic image encoding device 30, through the 2nd step, to utilizing changing that default adding method gives with reference to picture index with adapting to.

Below, to adapt under the selecteed situation of adding method, describe with reference to the concrete adding method of picture index.But in the explanation below, the suppose object picture is picture B12.

At first, as shown in Figure 3 in the 1st step, the candidate screen of forward direction reference is given with reference to picture index, so that more little with reference to the value of picture index apart from the near more candidate screen of markup.Just, be endowed with reference to picture index [1], be endowed with reference to picture index [0], be endowed with reference to picture index [2] with reference to picture P10 with reference to picture P7 with reference to picture B11.

Then, shown in figure 24 in the 2nd step, will with reference to picture P10 be altered to [0] with reference to picture index [1], will be with reference to picture B11 be altered to [1] with reference to picture index [0].

This rewriting with reference to picture index to each markup is based on code efficiency and carries out.In addition, dynamic image encoding device 30 will be represented according to external control signal Cont, be to set default adding method to be inserted in the bit string as heading message with which the information that adapts to adding method as adding method.In addition, setting under the situation that adapts to adding method, will be that the information of how to carry out also is inserted in the bit string as heading message with reference to giving of picture index.

As stated, in this execution mode 3, just can according to code efficiency, will under direct mode, should carry out the forward direction reference candidate screen be made as [0] with reference to picture index.

Just, in execution mode 1 since to apart from markup nearest in time with reference to candidate screen, the value of giving little with reference to picture index, so in direct mode, can only be with reference to apart from the nearest in time picture B11 of markup B12.But in this execution mode 3, if code efficiency can improve, then can forward direction with reference to apart from the picture beyond the nearest in time picture B11 of markup B12.

In addition, in the case, owing to can the picture that this picture B12 carries out reference with direct mode be made as P10 rather than B11, so just there is no need picture B11 is decoded.Thereby, just can shown in Figure 25 (a), such decoding handle near the B picture after the P picture, just can under the unwanted situation of picture B11, obtain the high speed of decoding processing.In addition, even owing to also can decode because of the data shortcoming that transmits picture B11 such as mistake, so can make the reliability raising of decoding.

As stated,, confirm under direct mode, to carry out the picture of reference with having a mind, then can shown in Figure 25 (a), handle on such picture ground of not decoding predetermined if can at random give with reference to picture index.

And then, shown in Figure 25 (b), handle even under the situation that 3 B pictures are arranged between the P picture, also can not encode predetermined picture.Therefore, when in advance at the unwanted picture of coding side understanding user, just can omit such picture to obtain the reduction in processing time in the decoding.

In Figure 25 (b),, also can carry out the decoding of other pictures even picture B3 is not decoded.

Just, in the adding method of execution mode 1 since picture B4 under direct mode with reference to picture B3, so just need decode for decoded picture B4 to picture B3.But in this execution mode 3, owing to can at random be set in the picture that carries out reference under the direct mode, the decoding of picture B3 just becomes and there is no need thus.

And then; In this execution mode 3; Since carry out with reference to picture index give so that apart from the near more candidate screen of markup give more little value with reference to picture index; And based on confirm with reference to picture index under the direct mode with reference to picture, so can improve code efficiency, simultaneously can accomplish reduction in processing time through the shortening of motion vector.

In addition, in the decoding side, because when with direct mode the object piece being handled, the forward direction of giving with reference to picture index [0] is used as with reference to picture with reference to candidate screen at once, so just can shorten the time of decoding.

In addition,, be based on the candidate screen that code efficiency confirms to be rewritten into reference to picture index [0] although in above-mentioned execution mode 3, the also picture of easy reference, for example nearest in time P picture be made as [0] with reference to picture index.

In addition, although the picture that in above-mentioned execution mode 3, carries out reference with direct mode is that the present invention is not limited to this with reference to the picture of picture index for [0].Such as, also can encode, and be based on the information of carrying out reference under this direct mode learning the information of carrying out the situation of reference with direct mode, when direct mode, decode.

[execution mode 4]

Figure 26 is the block diagram that explanation utilizes the moving image decoding apparatus 40 of execution mode 4 of the present invention.

This moving image decoding apparatus 40; Reception is from the bit string of the dynamic image encoding device 30 of execution mode 3; And be based on comprised in this bit string, which of above-mentioned default adding method and above-mentioned adaptation adding method expression should adopt with and carry out the information of giving (adding method indication information) with reference to picture index, carries out the decoding processing of each picture.

Just, the action of an action form of the moving image decoding apparatus 40 of this execution mode 4 moving image decoding apparatus 20 that is execution mode 2.In other words, the moving image decoding apparatus 40 of execution mode 4 is using under the situation of default adding method as the adding method with reference to picture index, and the action of moving image decoding apparatus 40 is identical with the moving image decoding apparatus 20 of execution mode 2.

Below, dynamic image encoding device 40 is specified.

This moving image decoding apparatus 40; With the memory control unit 204 in the moving image decoding apparatus 20 of memory control unit 244 replacement execution modes 2; Memory control unit 244; Be based in the bit string as the adding method indication information that heading message comprised, carry out and the management of above-mentioned default adding method and the some corresponding memory that adapt to adding method.

Other assemblies of the moving image decoding apparatus 40 of this execution mode 4, identical with in the moving image decoding apparatus 20 of execution mode 2.

Then the action to dynamic image encoding device 40 describes.

This moving image decoding apparatus 40, carry out with in from the bit string of dynamic image encoding device 30 as adding method indication information corresponding action that heading message comprised.

Just; This moving image decoding apparatus 40; Under situation about being selected as at coding side default adding method with reference to the adding method of picture index; Just, in bit string, comprise under the situation of expression default adding method selecteed information, likewise move with the moving image decoding apparatus 20 of execution mode 2.

On the other hand; This moving image decoding apparatus 40 is under situation about being selected as at coding lateral adaptation adding method with reference to the adding method of picture index, just; In bit string, comprise under the situation of the selecteed information of expression adaptation adding method, carry out and adaptation adding method corresponding action.In the case, owing to also be included in the bit string, so be that giving of cross index carried out on the basis with this information as heading message with reference to the information of how to carry out of giving of picture index.

Below, the action that adapts to dynamic image encoding device 40 under the selecteed situation of adding method is described.

In with reference to picture memory 207, shown in figure 24, when markup is handled, all be stored in the rewriting in each storage area with reference to candidate screen.

Specifically, be under the situation of picture B12 at the decoder object picture, for decoding processing, select to carry out from candidate screen with reference to picture according to the heading message of object piece as the picture B12 of this object piece.

For example; Coded system at the object piece is under the situation of bi-directional predictive coding mode; The decoding processing of object piece does; As forward direction with reference to picture from candidate screen P10, B11, P7, select to be endowed with in the heading message of object piece, comprised with reference to the identical picture of picture index with reference to picture index.In the heading message that is contained in the object piece with reference to picture index under the situation of [1], then as forward direction with reference to picture and selecting candidate screen B11.Then, for the bi-directional predicted decoding processing of object piece, as forward direction with reference to picture with reference to candidate screen B11, as the back to carrying out with reference to picture P13 with reference to picture.

In addition, be under the situation of direct mode in the coded system of object piece, from candidate screen P7, P10, B9, be endowed with reference to the candidate screen (picture P10) of picture index with reference to picture and selecting for [0] as forward direction.Then, for the decoding processing of object piece, as forward direction with reference to picture with reference to candidate screen P10, as the back to carrying out with reference to picture P13 with reference to picture.

As stated; In this execution mode 4; To carrying out the management of memory shown in figure 24 with reference to picture memory 207; Just, storage management is that use has been changed the value with reference to picture index of being given by default adding method according to the coding situation and carried out as the value with reference to picture index of each candidate screen.So, just can realize rewriting the coding/decoding method with reference to picture index of candidate screen corresponding to coding method according to code efficiency.

Just; In execution mode 2 and since to apart from markup nearest in time with reference to candidate screen, the value of giving little with reference to picture index; So in direct mode; Can only be with reference to apart from the nearest in time picture B11 of markup B12, but in this execution mode 4, can forward direction with reference to apart from the picture beyond the nearest in time picture B11 of markup B12.

In addition, in the case, be P10 rather than B11 owing to carry out the picture of reference when the piece of picture B12 decoded under direct mode, so just there is no need picture B11 is decoded.Thereby, just can shown in Figure 25 (a), such decoding handle near the B picture after the P picture, just can under the unwanted situation of picture B11, obtain the high speed of decoding processing.In addition, even owing to also can decode because of the data shortcoming that transmits picture B11 such as mistake, so can make the reliability raising of decoding.

As stated; If can be chosen as value arbitrarily according to the value that the coding situation will be given with reference to candidate screen with reference to picture index; Confirm under direct mode, to carry out the picture of reference wittingly, then can shown in Figure 25 (a), that kind not decode predetermined picture and handle.

And then; Shown in Figure 25 (b); Handle even under the situation that 3 B pictures are arranged between the P picture, also can not encode predetermined picture, when in advance at the unwanted picture of coding side understanding user, just can omit such picture to obtain the reduction in processing time in the decoding.

In Figure 25 (b),, also can carry out the decoding of other pictures even picture B3 is not decoded.

Just, owing in execution mode 2, picture B4 is decoded with reference to picture B3 under direct mode, so just need decode to picture B3.But in this execution mode 4, when in the coding side, carry out just can picture B3 not being decoded under the situation that the picture of reference can at random set with direct mode.

In addition, when when the decoding side is handled the object piece with direct mode, owing to the forward direction of giving with reference to picture index [0] is used as with reference to picture with reference to candidate screen at once, so just can shorten the time of decoding.

Although in above-mentioned each form of implementation 1～4, be illustrated in the coding of P picture or when decoding not with reference to the situation of B picture, in the time of also can or decoding at the coding of P picture with reference to the B picture.

In addition,, the situation based on the time gap between the demonstration Time Calculation picture of each picture is shown, also can obtains the time gap between picture based on the information beyond the demonstration time equal time of each picture although in above-mentioned each form of implementation 1～4.

For example, also can each picture be set whenever picture is processed the Counter Value that just increases progressively, can calculate the time gap between picture based on this Counter Value.

Particularly, all comprise under the situation of temporal information,, video information and audio-frequency information are managed so that two kinds of information keeps synchronous and is not easy based on this time information because the unit of temporal information is very little at the video flowing and the audio stream of a content.But, consider that the synchronous management of video information and audio-frequency information just becomes simple through the arrangement of above-mentioned each picture being managed by Counter Value.

In addition, in above-mentioned each form of implementation 1～4, with data processing unit, for example, the heading message and the data portion that make GOP and picture etc. are included in the bit string of corresponding each data processing unit and transmit not discretely.But they are separated with different stream transmits.

For example, also can be under the situation that data units of transfer such as stream being distinguished into packet transmits, title portion and the data portion of corresponding above-mentioned picture are separated transmitted.In the case, also there are title portion and data portion not to be included in the situation in the same stream.But; In the data of having used packet transmit; Even the order that title portion and data portion transmit is discontinuous, also just corresponding title portion transmits with different packets with data portion, and the title portion of correspondence and the corresponding relation of data portion are stored by the heading message of packet etc.; Situation about therefore, being included in the same bit string with title portion and data portion in fact is identical.

And then; Although in above-mentioned each form of implementation 1～4; Above-mentioned with reference to picture index; Which a plurality ofly when being identified in the object piece and being encoded used by the information of reference, but this also can be used as demonstration with reference to picture index and uses with reference to the information of the position of candidate screen for a plurality of forward directions of the markup of the object that becomes encoding process or decoding processing with reference to the picture in the candidate screen.Particularly; Because adding method with reference to picture index in above-mentioned form of implementation 1 and 2; Perhaps in form of implementation 3 and 4 the default adding method, to above-mentioned a plurality of forward directions with reference to candidate screen give apart from markup more closely value more little with reference to picture index, so just can be according to giving the size with reference to the value of picture index of each forward direction with reference to candidate screen; Detect each forward direction (just with reference to the position of candidate screen; Detect each forward direction with reference to candidate screen, whole forward directions with reference to picture in, for apart from which near picture of markup).

In addition, can be in bit string corresponding to moving image, with the relative position of such each the forward direction candidate screen of expression comprise each picture that expression constitutes moving image dividually at the position identification information that shows the position on the time shaft with reference to picture index.This position identification information is different with the temporal information of demonstration time of expression picture, is the information of confirming the relative position of each picture.

In addition, in above-mentioned each form of implementation 1～4, be illustrated under the direct mode as reference pictures, use when the piece of the markup that becomes coding or decoder object is decoded after to the situation of the picture of reference (for markup back to reference to picture).But under direct mode,, can use back to reference to the offscreen picture of having handled for markup as reference pictures, for example, the picture of forward direction reference when the piece of markup is encoded.

[execution mode 5]

Figure 27 is the block diagram that explanation utilizes dynamic image encoding device 50 usefulness of execution mode 5 of the present invention.

This dynamic image encoding device 50, the candidate screen of when P picture and B picture are encoded, carrying out the forward direction reference, and for different with the dynamic image encoding device 10 of above-mentioned execution mode 1 on the coded system of B picture.

Just, this dynamic image encoding device 50, the coding control unit 110 and mode selected cell 109 of replacement execution mode 1 have the coding control unit 150 and mode selected cell 159 that carry out with their different actions.

Specifically; The coding control unit 150 of the dynamic image encoding device 50 of execution mode 5; To controlling with reference to picture memory 117 so that, when the P picture was encoded, 4 pictures (I or P picture) that are positioned at this P picture the place ahead were used as the candidate screen of forward direction reference; When the B picture is encoded, is positioned at 4 pictures (I or P picture) in this B picture the place ahead, 1 I that is positioned at immediate 1 forward direction B picture of this B picture and rear or P picture and is used as candidate screen.

In addition; The mode selected cell 159 of execution mode 5; To the piece (object piece) of P picture when encoding; As the coded system of object piece, in picture coding, use the inter-picture prediction coding of motion vector and do not use the inter-picture prediction coding of motion vector (motion is made as 0 to be handled) and select one.To the piece (object piece) of B picture when encoding; As the coded system of object piece, in picture coding, use forward motion vector the inter-picture prediction coding, use the inter-picture prediction coding of backward motion vector and use the inter-picture prediction coding of forward motion vector and backward motion vector and select one.Just; The mode selected cell 159 of the dynamic image encoding device 50 of this execution mode 5; With the mode selected cell 109 of the dynamic image encoding device 10 of execution mode 1, only do not using on the direct mode this point different, therefore; This dynamic image encoding device 50 does not have the motion vector storage unit 116 of dynamic image encoding device 10.

In addition, coding control unit of the dynamic image encoding device 50 of this execution mode 5 150 and part beyond the mode selected cell 159, identical with in the dynamic image encoding device 10 of execution mode 1.

Then, the action to dynamic image encoding device 50 describes.

The input picture is by showing that time sequencing is input to input picture memory 101 with picture unit.Shown in Figure 29 (a), by showing that each picture P0 of time sequencing, B1, B2, P3, B4, B5, P6, B7, B8, P9, B10, B11, P12, B13, B14, P15, B16, B17 and P18 are input to input picture memory 101.

Each picture of in input picture memory 101, being imported shown in Figure 29 (b), changes row by coded sequence.This changes the reference relation that row is based in the inter-picture prediction coding and carries out.Just, carry out the row that changes of the picture of importing,, encode earlier than the 1st picture so that when the 1st picture is encoded, be used as the 2nd picture with reference to the candidate of picture.

In this execution mode 5, when P picture (markup) was encoded, 4 the approaching pictures (I or P picture) that are in its place ahead in time were used as the candidate with reference to picture.In addition, when the B picture coding, the immediate I or the P picture that be in 4 pictures (I or P picture) in its approaching the place ahead in time, are in immediate 1 B picture in its place ahead and are in the rear in time are used as the candidate with reference to picture.

In input picture memory 101, carried out changing each picture of row, read by the unit of each motion compensation.In this execution mode 5, the unit of motion compensation is 16 pixels of level * vertical 16 pixel sizes, just pixel is arranged in rectangular rectangular area, and the pixel count of horizontal direction and the pixel count of vertical direction be the zone (macro block) of 16 pixels.In the explanation below, macro block abbreviates piece as.

Below, the encoding process of picture P15, B13, B14 is described in this order.

< encoding process of picture P15 >

Because picture P15 is the P picture, so implement to use the inter-picture prediction of forward direction reference to encode to this picture.In addition, in the process that the P picture is encoded, the B picture is not used as with reference to picture.

Figure 28 representes the situation with reference to the management of the picture in the picture memory 117.

For example, in the coding zero hour of picture P15, in reference to picture memory 117, on the storage area that has been endowed the logical storage numbering, the ascending order according to the logical storage numbering stores picture P12, B11, P9, P6, P3.These pictures are encoded, and institute's image stored data in reference to picture memory 117 are by 50 decoded image data of dynamic image encoding device.Below, for the purpose of simplifying the description, will in memory, store the picture of its view data, the picture that also abbreviates as in memory to be stored.

To in reference to picture memory 117, stored with reference to candidate screen, through the coding control unit 150 control, carry out giving with reference to picture index.This index is given, and is not by the coded sequence of picture but the time sequencing when showing is carried out.Particularly, be exactly in chronological order to new with reference to candidate screen, the order that just shows slow with reference to candidate screen, the value of giving less with reference to picture index.But, when the P picture coding, the B picture is not carried out giving with reference to picture index.In addition, when the B picture is encoded, in chronological order to up-to-date with reference to candidate screen, give expression as the back to the symbol of handling with reference to picture [b].

According to such definite method with reference to picture index, shown in figure 28, to picture P12, P9, P6, P3 give with reference to picture index, be respectively [0], [1], [2], [3], B11 does not give with reference to picture index to picture.

In addition, when the P picture coding, coding control unit 150 is controlled so that switch 113,114,115 becomes connection each switch.Piece from the picture P15 that read of input picture memory 101 is input to motion vector detecting unit 108, mode selected cell 159 and calculus of differences unit 102.

Motion vector detecting unit 108 will be in the picture that is stored in reference to picture memory 117, is endowed picture P12 with reference to picture index, P9, P6, P3 as using with reference to candidate screen, the piece among the picture P15 is carried out the detection of motion vector.In the case, from picture P12, P9, P6 and P3, select optimally with reference to candidate screen, the detection of motion vector is carried out with reference to picture with reference to selected.Afterwards, with detected motion vector, to mode selected cell 159 and 104 outputs of bit string generation unit.In addition, motion vector is the information Rp with reference to which resulting motion vector of picture P12, P9, P6, P3 and so on, promptly also exports to mode selected cell 159 with reference to picture index.

Mode selected cell 159 uses by the detected motion vector of motion vector detecting unit 108, confirms the coded system of the piece of picture P15.Coded system, expression with which kind of method is encoded to piece.For example, to the piece of P picture,, select coding in the picture as coded system, use motion vector the inter-picture prediction coding, do not use in the inter-picture prediction coding of motion vector (motion is made as 0 to be handled).The selection of coded system generally is to make under predetermined figure place encoding error for minimum.

By mode selected cell 159 determined coded system Ms, output to bit string generation unit 104.In addition, be to carry out under the situation of coded system of forward direction reference in determined coded system, with reference to picture index also to 104 outputs of bit string generation unit.

In addition, the resulting predicted picture Pd of coded system based on being confirmed by mode selected cell 159 is outputed to calculus of differences unit 102 and add operation unit 106.But, under having selected the situation of encoding in the picture, not prediction of output image Pd.In addition, under the situation of having selected to encode in the picture by mode selected cell 159, make input terminal Ta be connected to lead-out terminal Tb2, make lead-out terminal Td be connected to input terminal Tc2 through switch 112 is controlled through switch 111 is controlled.

Below, select the situation of inter-picture prediction coding to describe to mode selected cell 159.Because the action of in the case calculus of differences unit 102, coded prediction error unit 103, bit string generation unit 104 and predicated error decoding unit 105 is identical with execution mode 1, so its explanation is omitted.

When the encoding process of whole piece of picture P15 finished, coding control unit 150 carried out corresponding to the logical storage numbering of the picture of in reference to picture memory 117, being stored with reference to the renewal of picture index.

Just, because the picture P15 that has encoded, by showing that time sequencing is all newer than which picture of in reference to picture memory 117, being stored, so picture P15 just stores the storage area that is set logical storage numbering (0) into.Then, the logical storage numbering with reference to the storage area of picture that has stored other just increases progressively 1.And then, because next coded object picture is the picture B13 as the B picture, so picture B11 is also carried out giving with reference to picture index.Thus, in the storage area that is set logical storage numbering (0)～(5), stored picture P15, P12, B11, P9, P6, P3 give respectively with reference to picture index [0], [1], [2], [3], [4] picture P12, B11, P9, P6, P3 respectively.Because becoming next markup is the B picture,, gives expression and be used as the back to the symbol of handling with reference to picture [b] so, replace with reference to picture index to being stored in the picture P15 of logical storage numbering 0.

< encoding process of picture B13 >

Because picture B13 is the B picture, so use the inter-picture prediction coding of two-way reference.In the case,, use approaching in time 4 I or P picture and immediate in time 1 B picture,, use to be in immediate I or P picture in time as the candidate screen of back to reference as the candidate screen of forward direction reference.Thereby, be picture P12, B11, P9, P6, P3 just for the candidate screen of the forward direction reference of picture B13, and be picture P15 just for the back candidate screen of picture B13 to reference.These are stored in reference in the picture memory 117 with reference to candidate screen., shown in figure 28 to these with reference to candidate screen, give logical storage numbering and with reference to picture index.

When coding B picture, coding control unit 150 is controlled so that switch 113,114,115 becomes connection each switch.Thereby the piece from the picture B13 that read of input picture memory 101 is imported into motion vector detecting unit 108, mode selected cell 109, calculus of differences unit 102.

In motion vector detecting unit 108; With being stored in the candidate screen that is used as the forward direction reference with reference to the picture P12 in the picture memory 117, B11, P9, P6, P3; With picture P15 as the back to the candidate screen of reference, carry out forward motion vector and the detection of backward motion vector of the piece of picture B13.In the case, the detection of forward motion vector, through from picture P12, B11, P9, P6, P3 with optimal picture and selecting for to carry out with reference to picture.Detected motion vector is to mode selected cell 159 and 104 outputs of bit string generation unit.In addition, forward motion vector is which the information Rp of motion vector and so on reference to picture P12, B11, P9, P6, P3, promptly with reference to picture index also to 159 outputs of mode selected cell.

Then, the action of mode selected cell 159, calculus of differences unit 102, bit string generation unit 104 and predicated error decoding unit 105, identical when encoding with picture P15.

When the processing of the whole pieces among the picture B13 finishes,, carry out corresponding to the logical storage numbering of the picture of in reference to picture memory 117, being stored with reference to the renewal of picture index through the control of coding control unit 150.

Just; Because picture B13; By show time sequencing than the picture P15 that in reference to picture memory 117, is stored also preceding, than the picture P12 that in reference to picture memory 117, is stored also after, be set the storage area that logical storage is numbered (1) so picture B13 just stores into.In addition, owing to be not used as in the encoding process of picture B11 picture afterwards, deleted with reference to picture.At this moment, expression is outputed to bit string generation unit 104 from the information with reference to the picture memory deletion as control signal Cs1 with picture B11.Bit string is recorded and narrated and outputed to bit string generation unit 104 with this information as heading message.In addition, the logical storage of the storage area of corresponding picture P12 numbering just increases progressively 1.

Next markup to be encoded is the picture B14 as the B picture.Thereby the picture of in the storage area with logical storage numbering (0), being stored is used as the back to reference to picture, and the picture beyond it is given with reference to picture index.Thus; In storage area corresponding to logical storage numbering (0)～(5); Distinguish stored picture P15, B13, P12, P9, P6, P3, and picture B13, P12, P9, P6, P3 are given respectively with reference to picture index [0], [1], [2], [3], [4].

< encoding process of picture B14 >

Because picture B14 is the B picture, so use the inter-picture prediction coding of two-way reference.In this case, as picture B14 with reference to picture, use picture B13, P12, P9, P6, P3 as forward direction with reference to picture, as the back to using picture P15 with reference to picture.In the processing of B picture, coding control unit 150 is controlled so that switch 113,114,115 becomes connection each switch.Thereby the piece of the picture B14 that from input picture memory 101, reads is imported into motion vector detecting unit 108, mode selected cell 159, calculus of differences unit 102.

Motion vector detecting unit 108; With being stored in the candidate screen that is used as the forward direction reference with reference to the picture B13 in the picture memory 117, P12, P9, P6, P3; With picture P15 as the back to the candidate screen of reference, carry out forward motion vector and the detection of backward motion vector of the piece of picture B14.In the case, the detection of forward motion vector is through becoming to carry out with reference to picture with optimal picture and selecting from picture B13, P12, P9, P6, P3.Detected motion vector is outputed to mode selected cell 159 and bit string generation unit 104.In addition, forward motion vector is the information Rp with reference to which resulting motion vector of picture B13, P12, P9, P6, P3 and so on, promptly with reference to picture index, is also outputed to mode selected cell 159.

Then, the action of mode selected cell 159, calculus of differences unit 102, bit string generation unit 104, predicated error decoding unit 105 and add operation unit 106, identical substantially when being encoded with picture P15.

When the processing of the whole pieces among the picture B14 finishes,, carry out corresponding to the logical storage numbering of the picture of in reference to picture memory 117, being stored with reference to the renewal of picture index through the control of coding control unit 150.

Just; Because picture B14; By show time sequencing than the picture P15 that in reference to picture memory 117, is stored also preceding, than the picture B13 that in reference to picture memory 117, is stored also after, be set the storage area that logical storage is numbered (1) so picture B14 just stores into.In addition, so deleted owing to not being used as in the encoding process of picture B13 picture afterwards with reference to picture.At this moment, expression is outputed to bit string generation unit 104 from the information with reference to the picture memory deletion as control signal Cs1 with picture B13.Bit string generation unit 104 is recorded and narrated this information in bit string as heading message.

Next markup to be encoded is the picture P18 as the P picture.Correspondingly, the offscreen picture of B is given with reference to picture index.Thus, in the storage area of logical storage numbering (0)～(5), stored picture P15, B14, P12, P9, P6 give respectively with reference to picture index [0], [1], [2], [3] picture P15, P12, P9, P6 respectively.

As stated; In this execution mode 5; Because in a plurality of candidate screen for the forward direction reference of coded object picture; Slow more just value of giving of its demonstration time more little with reference to picture index (forward motion vector that just is used to be identified in the detected object piece has been to use the information of which candidate screen), so in candidate screen as with reference to the easiest selecteed picture of picture, just the value of giving littler with reference to picture index.Thus, just can make, and can obtain the raising of code efficiency for size of code minimum with reference to picture index.

Below, to the effect of this execution mode 5, be to be example as the situation of carrying out with reference to candidate screen with other B picture with coding for the B picture, the problem points that simultaneously prior art is existed describes particularly.

For example, suppose that the picture of moving image is arranged as shown in Figure 29 (a), the forward direction when encoding for markup uses the situation of 4 P pictures and 1 B picture to describe with reference to candidate screen.

Figure 30 representes the management example with reference to the picture in the picture memory in the case.In addition, in this memory, candidate screen is stored by coded sequence.

When picture P15 encoded, the ascending order according to the logical storage numbering in reference to picture memory stored picture B11, P12, P9, P6, P3 as candidate screen.In addition, to these candidate screen, give respectively with reference to picture index [0], [1], [2, [3], [4].Thereby, the Shi Buhui that is encoded at the P picture as the B picture (here being picture B11) with reference to picture, has been given with reference to picture index.Therefore, produce can not be used with reference to picture index, can cause the deterioration of code efficiency.

In addition, when picture B13 encodes, in reference to picture memory, store picture P15, B11, P12, P9, P6, P3 by the logical storage indexed sequential.To picture P15 give expression as the back to the symbol [b] that uses with reference to picture, to remaining picture, give respectively with reference to picture index [0], [1], [2, [3], [4].Thereby, picture B13 (markup) the picture B11 far away in time that adjusts the distance, than apart from the near in time picture P12 of this picture B13, it is little of picture index that the value of giving is also wanted.General under the situation of motion detection; Because the candidate screen near in time apart from markup is used as with reference to the situation of picture many on the probability; So when the value of picture B11 far away in time with reference to picture index become than near in time picture P12 with reference to the also little value of picture index the time, can cause the deterioration of code efficiency.

And then, when picture B14 is encoded, in reference to picture memory, store picture B13, P15, B11, P12, P9, P6 by the logical storage indexed sequential.To picture B13 give expression as the back to the symbol [b] that uses with reference to picture, to remaining picture, give respectively with reference to picture index [0], [1], [2, [3], [4].Thereby, formerly should be used as the back of picture B14 to picture P15 with reference to picture, but be used as the candidate screen of forward direction reference.And the picture B13 of the candidate of the former forward direction reference that should be used as picture B14 but is used as the back to reference to candidate screen.As a result, correctly encode just become the difficulty.In addition, when picture B14 encodes, then be present in reference in the picture memory as the picture B11 that is not used as with reference to the picture of picture.

On the other hand, in execution mode 5 of the present invention, shown in figure 28; Because in reference to picture memory; Press DISPLAY ORDER storage object picture with reference to candidate screen, in the candidate screen of forward direction reference, slow more just value of giving of its demonstration time more little with reference to picture index; So in candidate screen, as with reference to the easiest selecteed picture of picture, just give littler with reference to picture index.Thus, just can make, can obtain the raising of code efficiency for size of code minimum with reference to picture index.

In addition, when the P picture coding, because the B picture is not carried out with reference to the giving of picture index,, further improve code efficiency so just can avoid the generation with reference to picture index that can not be used.

In addition, when the B picture coding, because to the picture in the storage area that is stored in the minimum logical storage numbering of respective value, do not give with reference to use picture index, and with this picture as after to using with reference to picture.So, when the predictive coding of B picture, just can avoid the P picture of Ying Houxiang reference but to be used as the situation of forward direction with reference to picture.

In addition, when becoming the picture that is not used as with reference to picture with reference to picture memory deletion, in bit string, record and narrate the information that deletion has been carried out in expression.So, just can detect from having deleted with reference to picture memory the decoding processing of decoder object picture and later picture thereof and not be used as picture with reference to picture in the decoding side.

In addition; In above-mentioned execution mode 5; Motion compensation is a unit with the image space of being made up of 16 pixels of level * vertical 16 pixels (macro block), and the coding of prediction error image is being that unit handles by the image space (sub-piece) that 8 pixels of level * vertical 8 pixels are formed.But as the macro block of the unit of motion compensation (coding of prediction error image) or the pixel count of sub-piece, can be with above-mentioned different.

In addition, in above-mentioned execution mode 5, the number of continuous B picture is 2, but the number of above-mentioned continuous B picture also can be 3 or more.

In addition, in above-mentioned execution mode 5, be 4, but it also can be other value beyond 4 to the quantity of the candidate screen of forward direction reference when the P picture is encoded.

In addition, in above-mentioned execution mode 5, the candidate screen of forward direction reference is 4 P pictures and 1 B picture during to the B picture coding, but the candidate screen of the forward direction reference of B picture is not limited to these pictures.

In addition, in above-mentioned execution mode 5, become each picture coded object, that constitute moving image, when other later pictures of this each picture are encoded, be used as with reference to picture.But a plurality of pictures that constitute moving image also can comprise the picture that is not used as with reference to picture.In the case, through in reference to picture memory, not storing the picture that is not used as with reference to picture, just obtain the effect same with above-mentioned execution mode 5.

In addition, in above-mentioned execution mode 5, for the coding of B picture be with other B picture as carrying out with reference to candidate screen, but can be not do not carry out with reference to other B picture for the coding of B picture yet.In the case, in reference to picture memory, do not store the B picture.Even perhaps also give with reference to picture index under these circumstances, just can obtain the effect same with above-mentioned execution mode 5 according to the demonstration time sequencing of picture.

In addition, in above-mentioned execution mode 5, be give 1 system with reference to picture index, but also can be respectively to forward direction, back to give different system with reference to picture index.

In addition; In this execution mode 5; In the candidate screen of forward direction reference, slow more just value of giving of its demonstration time more little with reference to picture index, but if in candidate screen as with reference to the easiest selecteed picture of picture; Just the value of giving littler with reference to picture index, then be not limited to above-mentioned explanation.

In addition, Figure 31 is expression corresponding to the concept map of having given with reference to the structure (form of coding image signal) of the bit string of the picture of picture index.

The code signal Pt that is equivalent to 1 picture includes the heading message Hp that in the picture beginning, comprised and the data portion Dp after this.In heading message Hp, include control signal (RPSL).The coded data (bit string) that in data portion Dp, includes corresponding each piece in addition.

For example, bit string BLx is the bit string with the piece of coded system coding in the picture, and bit string BLy is the bit string with the piece of the coding of the inter-picture prediction coded system beyond the coded system in the picture.

In the bit string BLx of piece, include heading message Hbx, about the information Prx of coded system and the image information Dbx that is encoded.In the bit string BLy of piece, include heading message Hby, about the information Pry of coded system, the 1st with reference to picture index Rld1, the 2nd with reference to picture index Rld2, the 1st motion vector MV1, the 2nd motion vector MV2 and the image information Dby that is encoded.Can judge through the information Pry relevant with coded system be to use the 1st, the 2nd with reference among picture index Rld1, the Rld2 which.

At first, make forward direction back relatively to preferentially giving with reference to picture index Rld1 with reference to candidate screen with reference to candidate screen.Make the back to preferentially giving with reference to picture index Rld2 with reference to candidate screen with reference to the relative forward direction of candidate screen.

[execution mode 6]

Figure 32 is the block diagram that explanation utilizes moving image decoding apparatus 60 usefulness of execution mode 6 of the present invention.

The moving image decoding apparatus 60 of this execution mode 6 is decoded to the bit string Bs that exports from the dynamic image encoding device 50 of above-mentioned execution mode 5.

The moving image decoding apparatus 60 of this execution mode 6, the candidate screen of when P picture and B picture are decoded, carrying out the forward direction reference, and the coded system of B picture is different with the moving image decoding apparatus 20 of above-mentioned execution mode 2.

Just, the moving image decoding apparatus 60 of this execution mode 6, the memory control unit 204 and mode decoding unit 223 of replacement execution mode 2 have the memory control unit 264 and mode decoding unit 263 that carry out with their different actions.

Specifically; The memory control unit 264 of the moving image decoding apparatus 60 of execution mode 6; To controlling with reference to picture memory 207 so that, when the P picture was decoded, 4 pictures (I or P picture) that are positioned at this P picture the place ahead were used as the candidate screen of forward direction reference; When the B picture is decoded, is positioned at 4 pictures (I or P picture) in this B picture the place ahead, 1 I that is positioned at immediate 1 forward direction B picture of this B picture and rear or P picture and is used as candidate screen.

In addition; The mode decoding unit 263 of the moving image decoding apparatus 60 of execution mode 6; When piece (object piece) decoding of P picture; As the coded system of object piece, decoding in picture, use the inter-picture prediction decoding of motion vector and do not use the inter-picture prediction decoding of motion vector (will move and handle) one of selection as 0.When piece (object piece) decoding of B picture; As the decoding process of object piece, decoding in picture, use forward motion vector the inter-picture prediction decoding, use the inter-picture prediction decoding of backward motion vector and use the inter-picture prediction decoding of forward motion vector and backward motion vector and select one.

Just; The mode decoding unit 263 of the moving image decoding apparatus 60 of this execution mode 6; With the mode decoding unit 223 of the moving image decoding apparatus 20 of execution mode 2, only do not using on the decoding processing this point of corresponding direct mode different, thereby; This moving image decoding apparatus 60 does not have the motion vector storage unit 226 of moving image decoding apparatus 20.

In addition, the moving image decoding apparatus 60 of execution mode 6 is except memory control unit 264 with the mode decoding unit 263, identical with the moving image decoding apparatus 20 of execution mode 2.

Then, the action to dynamic image encoding device 60 describes.

Input is from the bit string Bs of dynamic image encoding device 50 outputs of execution mode 5 in moving image decoding apparatus shown in Figure 32 60.In this bit string Bs, be as carry out the inter-picture prediction coding with reference to candidate screen with 4 I nearby that are in its place ahead in time or P picture for each P picture.In addition, each B picture is as encoding with reference to candidate screen with 4 P pictures that are in its immediate the place ahead in time, 1 forward direction B picture and the immediate I or the P picture that are in its rear in time.

In the case, the order of the picture in the bit string is shown in Figure 29 (b).

Below, the decoding processing of picture P15, B13, B14 is described in this order.

< decoding processing of picture P15 >

The bit string of picture P15 is imported into bit string analytic unit 201.Bit string analytic unit 201 extracts various data from the input bit string.Various data are the information of coded system and motion vector etc.The information that the mode that is extracted is selected (coded system) Ms is outputed to mode decoding unit 263.In addition, the motion vector MV that is extracted is outputed to motion compensation decoding unit 205.And then, coded prediction error data Ed is exported to predicated error decoding unit 202.

Mode decoding unit 263 with reference to from the coded system Ms that bit string extracted, carries out the control of switch 209 and 210.Under the situation of in coded system is picture, encoding, switch 209 is controlled so that input terminal Te is connected to lead-out terminal Tf1, switch 210 is controlled so that lead-out terminal Th is connected to input terminal Tg1.On the other hand, be under the situation of inter-picture prediction coding in coded system, switch 209 is controlled so that input terminal Te is connected to lead-out terminal Tf2, switch 210 is controlled so that lead-out terminal Th is connected to input terminal Tg2.

In addition, mode decoding unit 263 also outputs to motion compensation decoding unit 205 with coded system Ms.

Below, be that the situation that inter-picture prediction is encoded describes to coded system.

Predicated error decoding unit 202 is decoded generation forecast error information PDd to the coded data Ed that imports.The prediction error data PDd that is generated outputs to switch 209.Because the input terminal Te of switch 209 is connected to lead-out terminal Tf1, so prediction error data PDd outputs to add operation unit 208.

Motion compensation decoding unit 205 according to the information of the motion vector of being imported etc., generates motion compensated image.Be input to the information of motion compensation decoding unit 205, for motion vector MV with reference to picture index Rp.Motion compensation decoding unit 205 is based on these information, from obtain motion compensated image (predicted picture) with reference to picture memory 207.Picture P15 is that picture P12, P9, P6, P3 are encoded as the candidate with reference to picture, and these pictures are decoded and be stored in reference to picture memory 207.

Figure 28 is illustrated in the picture of being stored with reference in the picture memory 207.Shown in figure 28, when picture P15 is decoded, in reference to picture memory 207, store picture P12, B11, P9, P6, P3.

Memory control unit 264 is carried out giving with reference to picture index to what in reference to picture memory 207, store with reference to candidate screen.This gives with reference to picture index, based on the demonstration time sequencing of picture carry out so that up-to-date picture value of being endowed little with reference to picture index.When the P picture is decoded, the B picture is not carried out giving with reference to picture index.Thereby, corresponding to picture P12, P9, P6, P3 be respectively [0], [1], [2], [3] with reference to picture index, and picture B11 is not given with reference to picture index.

Motion compensation decoding unit 205 according to reference to picture index, confirms when the object piece is encoded it is which picture with reference to picture P12, P9, P6, P3.Then, motion compensation decoding unit 205,, is obtained predicted picture (prediction data Pd) and is generated motion compensated image (predicted picture) from reference to picture memory 207 with reference to picture and motion vector based on determined.The motion compensated image that generates is like this outputed to add operation unit 208.

Add operation unit 208 generates decoded picture (data Ad) with prediction error image of being imported and motion compensated image addition.The decoded picture that is generated outputs to reference to picture memory 207 through switch 210.

When whole macro blocks of picture P15 were decoded, memory control unit 264 carried out corresponding to the logical storage of the picture of in reference to picture memory 207, being stored numbering with reference to the renewal of picture index.

At this moment, because picture P15 is newer than any picture of in reference to picture memory 207, being stored in chronological order, so picture P15 just stores the storage area that is set logical storage numbering (0) into.Then, there is the logical storage numbering of storage area of other candidate screen to increase progressively 1 corresponding stored.

In addition, because next decoder object picture is picture B13, so picture B11 is carried out giving with reference to picture index.Thus, in the storage area that is set logical storage numbering (0)～(5), stored picture P15, P12, B11, P9, P6, P3 give respectively with reference to picture index [0], [1], [2], [3], [4] picture P12, B11, P9, P6, P3 respectively.

< decoding processing of picture B13 >

Because the action of bit string analytic unit 201, mode decoding unit 203 and predicated error decoding unit 202, so identical during with the decoding processing of picture P15 is the omission of their action specification.

Motion compensation decoding unit 205 generates moving compensating data from the information of the motion vector imported etc.The information that is input to motion compensation decoding unit 205 is motion vector and with reference to picture index.Picture B11 encodes as the back picture P15 candidate screen that picture P12, B11, P9, P6, P3 are used as the forward direction reference to the candidate screen of reference.In the decoding of picture B13 constantly, these candidate screen are decoded and be stored in reference to picture memory 207.

In coded system is that motion compensation decoding unit 205 according to reference to picture index, is confirmed when picture B13 is encoded, and carries out the forward direction reference with which candidate screen of picture P12, B11, P9, P6, P3 under the perhaps bi-directional predicted situation of forward prediction.Then, motion compensation decoding unit 205, based on determined with reference to picture and forward motion vector from obtaining the forward motion compensation image with reference to picture memory 207.In coded system is under the situation of bi-directional predicted predictive pictures coding or back forecast coding, motion compensation decoding unit 205, based on determined with reference to picture and backward motion vector from obtaining the reverse compensating images with reference to picture memory 207.Then, motion compensation decoding unit 205 uses forward motion compensation image and reverse compensating images, generates motion compensated image (predictive picture).

The motion compensated image that is generated is like this outputed to add operation unit 208.Add operation unit 208 generates decoded picture with prediction error image of being imported and motion compensated image addition.The decoded picture that is generated outputs to reference to picture memory 207 through switch 210.

When whole pieces of picture B13 were decoded, memory control unit 264 carried out corresponding to the logical storage of the picture of in reference to picture memory 207, being stored numbering with reference to the renewal of picture index.Because picture B13; By showing that time sequencing is also more forward than the picture P15 that in reference to picture memory 207, is stored; After also will leaning on than the picture P12 that in reference to picture memory 207, is stored, so picture B13 just stores the storage area that is set logical storage numbering (1) into.

In addition because in bit string, record and narrate have expression with picture B11 from information with reference to the picture memory deletion, picture B11 is from being deleted with reference to picture memory 207 quilts so 264 pairs of memory control units are controlled with reference to picture memory.

In addition, the logical storage numbering with reference to the storage area of candidate screen P12 that stores other is increased progressively 1.Thus, in the storage area that is set logical storage numbering (0)～(5), stored picture P15, B13, P12, P9, P6, P3 give respectively with reference to picture index [0], [1], [2], [3], [4] picture B13, P12, P9, P6, P3 respectively.

< decoding processing of picture B14 >

Because the action of bit string analytic unit 201, mode decoding unit 203 and predicated error decoding unit 202, so identical during with the decoding processing of picture P15 is the omission of their action specification.

Motion compensation decoding unit 205 generates moving compensating data from the information of the motion vector imported etc.The information that is input to motion compensation decoding unit 205 is motion vector and with reference to picture index.Picture B14 is the candidate screen that picture B13, P12, P9, P6, P3 is used as the forward direction reference; Picture P15 is encoded to the candidate screen of reference as the back; In the decoding of picture B14 constantly, these candidate screen are decoded and be stored in reference to picture memory 207.

When coded system was forward predictive coded or bi-directional predictive coding, motion compensation decoding unit 205, confirmed when picture B14 is encoded which picture of picture B13, P12, P9, P6, P3 is by the forward direction reference according to reference to picture index.Then, motion compensation decoding unit 205, based on determined with reference to picture and forward motion vector from obtaining the forward motion compensation image with reference to picture memory 207.Be under the situation of predictive pictures coding of bi-directional predicted or back forecast in coded system, motion compensation decoding unit 205, based on determined with reference to picture and backward motion vector from obtaining the reverse compensating images with reference to picture memory 207.Then, motion compensation decoding unit 205 uses forward motion compensation image and reverse compensating images, generates motion compensated image.

The motion compensated image that generates like this outputs to add operation unit 208.By add operation unit 208, prediction error image of being imported and motion compensated image addition are generated decoded picture.The decoded picture that is generated outputs to reference to picture memory 207 through switch 210.

When the processing of the whole pieces among the picture B14 finishes,, carry out corresponding to the logical storage numbering of the picture of in reference to picture memory 207, being stored with reference to the renewal of picture index by memory control unit 264.Because picture B14; By showing that time sequencing is also more forward than the picture P15 that in reference to picture memory 207, is stored; After also leaning on than the picture B13 that in reference to picture memory 207, is stored, so picture B14 just stores the storage area that is set logical storage numbering (1) into.In addition, because in bit string, recording and narrating has expression with the information of picture B13 from deleting with reference to picture memory, picture B13 is from deleting with reference to picture memory 207 so 264 pairs of these memories of memory control unit are controlled.

Because next decoder object picture is the picture P18 as the P picture, and the offscreen picture of B is given with reference to picture index.Thus, in the storage area that is set logical storage numbering (0)～(5), distinguish stored picture P15, B14, P12, P9, P6, P3, and picture P15, P12, P9, P6 are given respectively with reference to picture index [0], [1], [2], [3] and [4].

In addition, from reference to picture memory 207, institute's decoded pictures is exported as output image by the demonstration time sequencing.

Below, each picture thereafter is through decoding with corresponding similarly processing of picture type.

As stated; In this execution mode 6; In a plurality of candidate screen corresponding to the forward direction reference of decoder object picture; Slow more just value of giving of its demonstration time more little with reference to picture index (forward motion vector that just is used for the identifying object piece is with reference to the resulting information of which candidate screen), and be based on comprised in the bit string of markup with reference to picture index, from above-mentioned a plurality of candidate screen, confirm with reference to picture.So, in candidate screen as with reference to the easiest selecteed picture of picture, just the value of giving littler with reference to picture index.Thus, just can make size of code minimum with reference to picture index, and can be to correctly decoding by the resulting bit string of the high coding method of code efficiency.

In addition, when the P picture codec, because the B picture is not carried out with reference to the giving of picture index, thus just can avoid the generation with reference to picture index that can not be used, and can be to correctly decoding by the resulting bit string of the high coding method of code efficiency.

In addition; Because when the B picture codec, the picture that will in the storage area of the minimum logical storage numbering of the value of being set, be stored, as afterwards to handling with reference to picture; This picture is not carried out giving with reference to picture index; So when the predictive coding of B picture, just can avoid the P picture to be used as the situation of forward direction, and can be to correctly decoding by the resulting bit string of the high coding method of code efficiency with reference to picture.

In addition, recorded and narrated under the situation of bit string from become the information that is not used as with reference to the picture of picture with reference to picture memory deletion, based on this information from reference to the picture memory deletion with reference to picture, so just can effectively utilize with reference to picture memory.

In addition, in above-mentioned execution mode 6, the arrangement as a plurality of pictures that constitute moving image illustrates the arrangement of the picture of 2 B pictures between the P of adjacency picture.But the number of the B picture between the P of adjacency picture also can be other value, for example, and 3 or 4.

In addition, in above-mentioned execution mode 6, be 4 for the quantity of the candidate screen of the forward direction reference of P picture, but it also can be other value.

In above-mentioned execution mode 6, for the candidate screen of the forward direction reference of B picture, be 4 P pictures and 1 B picture, but, be not limited to this as candidate screen for the forward direction reference of B picture.

In addition, in above-mentioned execution mode 6, each picture that constitutes moving image is used as with reference to picture when other later pictures of this each picture are decoded, but a plurality of pictures of moving image also can comprise the picture that is not used as with reference to picture.In the case, through in reference to picture memory, not storing the picture that is not used as with reference to picture, just can obtain the effect same with above-mentioned execution mode 6.

In addition, in above-mentioned execution mode 6, the decoding of B picture be with other B picture as carrying out with reference to candidate screen, but can be not do not carry out with reference to other B picture for the decoding of B picture yet.In the case, in reference to picture memory, do not store the B picture.Also be in the case, give with reference to picture index, just can obtain the effect same with above-mentioned execution mode 6 according to the demonstration time sequencing of picture.

In above-mentioned execution mode 6; For the purpose of simplifying the description; To being used to manage with reference to the memory of candidate screen and being used for the memory that decoded picture changes row and output by DISPLAY ORDER is not illustrated with reference to picture memory as 1 with making any distinction between, but moving image decoding apparatus 60; Also can have respectively and be used to manage with reference to the diode-capacitor storage of candidate screen and be used for decoded picture is changed row's memory by what DISPLAY ORDER changed row and output.

In the case, diode-capacitor storage will output to motion compensation decoding unit 205 with reference to candidate screen by 264 controls of memory control unit.In addition, change the decoded picture image that row's memory will be arranged by decoding order, change row and output successively by DISPLAY ORDER.

In addition, in above-mentioned execution mode 6, show by 1 rule and give situation with reference to picture index to candidate screen; Be 1 system just with reference to picture index; But as with reference to picture index, also can be as illustrated in the enforcement mode 5, use 2 systems with reference to picture index.

[execution mode 7]

Figure 33 is the block diagram that explanation utilizes dynamic image encoding device 70 usefulness of execution mode 7 of the present invention.

This dynamic image encoding device 70, the candidate screen of when P picture and B picture are encoded, carrying out the forward direction reference, and for different with the dynamic image encoding device 10 of above-mentioned execution mode 1 on the coded system of B picture.

Just, this dynamic image encoding device 70, the coding control unit 110 and mode selected cell 109 of replacement execution mode 1 have the coding control unit 170 and mode selected cell 179 that carry out with their different actions.

Specifically; The coding control unit 170 of execution mode 7; To controlling with reference to picture memory 117 so that, when the P picture coding, 3 pictures (I or P picture) that are positioned at this P picture the place ahead are used as the candidate screen of forward direction reference; And when the B picture coding, be positioned at 2 pictures (I or P picture) in this B picture the place ahead, 1 I that is positioned at immediate 1 forward direction B picture of this B picture and rear or P picture and be used as candidate screen.But, be positioned at relative markup at the B picture in more the place ahead of the I in immediate the place ahead or P picture not by reference.

Above-mentioned coding control unit 170 is controlled so that whether the indicated object picture is inserted in the bit string corresponding to markup by the sign of reference for the encoding process of the later picture of this markup the time according to control signal Cd bit strings generation unit 104.Specifically, be exactly bit string generation unit 104 control by control signal Cd so that be illustrated in when decoding should be with the storage of markup to reference to the information in the picture memory 117, and represent that it should store during information append in the bit string.

In addition; The mode selected cell 179 of execution mode 7; When piece (object piece) coding of P picture; As the coded system of object piece, in picture coding, use the inter-picture prediction coding of motion vector and do not use the inter-picture prediction coding of motion vector (motion is made as 0 to be handled) and select one, when the block encoding of B picture; As the coded system of object piece, in picture coding, use forward motion vector the inter-picture prediction coding, use the inter-picture prediction coding of backward motion vector and use the inter-picture prediction coding of forward motion vector and backward motion vector and select one.Just; The mode selected cell 179 of the dynamic image encoding device 70 of this execution mode 7; With the mode selected cell 109 of the dynamic image encoding device 10 of execution mode 1, only do not using on the direct mode this point different, thereby; This dynamic image encoding device 70 does not have the motion vector storage unit 116 of dynamic image encoding device 10.Other assemblies of the dynamic image encoding device 70 of execution mode 7, all with the dynamic image encoding device 10 of execution mode 1 in identical.

The dynamic image encoding device 70 of this execution mode 7; With the dynamic image encoding device 50 of execution mode 5, control so that whether the indicated object picture is inserted in the bit string different on this point by the sign of reference for the encoding process of the later picture of this markup the time at coding control unit 170 bit strings generation units 104.Particularly, utilize control signal Cd that coding generation unit 104 is controlled, so that whether the indicated object picture is inserted in the bit string corresponding to markup by the sign of reference for the encoding process of the later picture of this markup the time.In addition, dynamic image encoding device 70, also different on P picture and B picture are encoded the candidate screen of time institute's reference with dynamic image encoding device 50.Except above-mentioned difference, other each points in this dynamic image encoding device 70 are all identical with dynamic image encoding device 50.

Then, the action to dynamic image encoding device 70 describes.

Input image data Id is input to input picture memory 101 with picture unit in chronological order.

Figure 34 (a) is illustrated in the order of the picture of being imported in the input picture memory 101.

In input picture memory 101, shown in Figure 34 (a), each picture begins to import in order from picture P1.In Figure 34 (a), picture P1, P4, P7, P10, P13, P16, P19, P22 are the P pictures, and picture B2, B3, B5, B6, B8, B9, B11, B12, B14, B15, B17, B18, B20, B21 are the B pictures.

When the P picture coding, this P picture 3 pictures (I or P picture) nearby of being in the place ahead in time are used as the candidate with reference to picture relatively.In addition, when the B picture was encoded, this B picture 2 pictures (I or P picture), immediate 1 the B picture that is in the place ahead and the immediate I or P picture at rear of being in its place ahead nearby in time was used as the candidate with reference to picture relatively.But when the B picture coding, the B picture in more the place ahead of I or P picture that is located at immediate the place ahead is not by reference.In addition, when the I picture is encoded, not with reference to other picture.

The data I d of each picture of in input picture memory 101, being imported changes row by coded sequence.Below just abbreviate the data of each picture as picture.

In other words, the order of picture is changed the row that changes who lines up coded sequence from input sequence handle, the reference relation that is based in the inter-picture prediction encoding process is carried out.Change during row handles at this, each picture is changed row so that be used as the 2nd picture with reference to the candidate of picture when the 1st picture coding, also formerly encode than the 1st picture.

Specifically, from each picture of picture P10～P13 with reference to the corresponding relation between the candidate screen, shown in the arrow among Figure 34 (a).Just, when P picture P10 was encoded, picture P1, P4, P7 were by reference, and when P picture P13 was encoded, picture P4, P7, P10 were by reference.In addition, when B picture B11 was encoded, picture P7, P10, P13 were by reference, and when B picture B12 was encoded, picture P7, P10, B11, P13 were by reference.

Figure 34 (b) expression has carried out changing the order of the picture behind the row to the picture from the picture B2 shown in Figure 34 (a) to P22.After changing row, each picture is arranged by the order of P4, B2, B3, P7, B5, B6, P10, B8, B9, P13, B11, B12, P16, B14, B15, P19, B17, B18, P22.

In input picture memory 101, carried out changing each picture of row,, read according to the scramble time order to each predetermined data processing unit.In this execution mode 7, data processing unit is the data cell of carrying out motion compensation, more specifically says, is a rectangular image space (macro block) of all having arranged 16 pixels in the horizontal direction with vertical direction.In the explanation below, abbreviate macro block as piece.

Below, the encoding process of picture P13, B11, B12 is described in order.

< encoding process of picture P13 >

Because picture P13 is the P picture, so use the inter-picture prediction of forward direction reference to encode as the encoding process of picture P13.In the case, be 3 I or the P picture that relative markup is positioned at the place ahead with reference to candidate screen, specifically be exactly picture P4, P7, P10.These are with reference to candidate screen, and encoding process finishes, and are stored in reference to picture memory 117 corresponding to the data Dd of decoded picture.

In the process that the P picture is encoded, coding control unit 170 is controlled so that switch 113,114,115 becomes connection each switch.

The corresponding data M d of piece with the picture P13 that is read from input picture memory 101 is input to motion vector detecting unit 108, mode selected cell 179, calculus of differences unit 102.

Motion vector detecting unit 108 is utilized to be stored in the decode image data Rd with reference to the picture P4 in the picture memory 117, P7, P10, carries out the detection of motion vector MV of the piece of picture P13.In the case, from picture P4, P7, P10, select optimally with reference to picture, and the detection of motion vector is through carrying out with reference to selected picture.Afterwards, detected motion vector MV is outputed to mode selected cell 179 and bit string generation unit 104.In addition, expression with reference among picture P4, P7, the P10 which when detecting motion vector MV, receive with reference to and so on information (with reference to image information), also outputed to mode selected cell 179.

In mode selected cell 179, use by the detected motion vector of motion vector detecting unit 108, confirm the coded system of the piece of picture P13.

Specifically; Be exactly under the situation of P picture coding; The inter-picture prediction of coding, use motion vector is encoded, is not used the inter-picture prediction coding of motion vector (motion is made as 0 to be handled) in picture, confirms to use which method to encode.In the confirming of coded system, generally be to select to make to give as size of code in position that encoding error is minimum method under the situation of piece with predetermined quantity.

By mode selected cell 179 determined coded system Ms, outputed to bit string generation unit 104.In addition, be to carry out under the situation of coded system of forward direction reference at determined coded system Ms, when being illustrated in forward motion vector and detecting with reference to which the information (with reference to image information) of picture P4, P7, P10, also to 104 outputs of bit string generation unit.

Afterwards, from mode selected cell 179 determined coded system Ms accordingly with reference to the resulting predicted image data Pd of picture, outputed to calculus of differences unit 102 and add operation unit 106.But, under having selected the situation of encoding in the picture, do not export above-mentioned predicted image data Pd.In addition, selected identical in switch 111 and 112 control and the execution mode 5 under the situation of coding in the picture.

Below, just by mode selected cell 179 as coding mode selection the situation of inter-picture prediction coding describe.

The action of calculus of differences unit 102, coded prediction error unit 103, bit string generation unit 104 and predicated error decoding unit 105 and coding control unit 170, identical with in the execution mode 5.

But, in this execution mode 7, as the heading message of picture P13, additional representation picture P13 with 3 I in the place ahead or P picture as carrying out information encoded with reference to candidate screen.In addition, because picture P13 will should be stored into the decoded data Dd of corresponding picture P13 with reference to the information in the picture memory 117 (sign) so be illustrated in when decoding by reference when other pictures are encoded, also the heading message as picture P13 is able to add.And then, expression should with picture P13 store into reference to during in the picture memory 117 up to accomplishing the decoded information of picture P22, also add as the heading message of picture P13.

Method as the above-mentioned memory period of representing picture 13; The temporal information of with good grounds picture P22 (for example; Time-based positional information; Like picture index, decode time information or show temporal information etc.) method represented, the method for representing according to information during from picture P13 to picture P22 (for example frame numbers etc.) etc.Above-mentioned heading message, can be used as with the picture is the heading message of unit, just as the heading message to each markup, records and narrates.Also can be used as the whole heading message of sequence or be that the heading message of unit (the for example GOP unit in the MPEG mode) is recorded and narrated with the frame.

In the coded system for each piece of picture P13, under the situation for the coded system of carrying out the forward direction reference, being illustrated in when detecting forward motion vector is that which information (with reference to image information) with reference among picture P4, P7, the P10 also is affixed in the bit string.For example, motion vector for situation about obtaining with reference to picture P10 under, the P picture in tight the place ahead of presentation code markup is for just appending in the bit string with reference to the information (with reference to picture index) of picture.Motion vector for situation about obtaining with reference to picture P7 under, the P picture before 2 of the presentation code markup just appends in the bit string for the information (with reference to picture index) with reference to picture.Motion vector be with reference to the resulting situation of picture P4 under, the P picture before 3 of the presentation code markup just appends in the bit string for the information (with reference to picture index) with reference to picture.For example; Can be with reference to picture by picture with reference to tight the place ahead of picture index [0] indicated object picture; By being with reference to picture, by being with reference to picture with reference to the picture before 3 of picture index [2] indicated object picture with reference to the picture before 2 of picture index [1] indicated object picture.

In addition, as heading message, record and narrate expression P picture and use 3 to carry out the inter-picture prediction information encoded with reference to candidate screen.

Through processing same as described above, carry out handling for the remaining macroblock encoding of picture P13.When the whole macroblock encoding processing for picture P13 finishes, then carry out the encoding process of picture B11.

< encoding process of picture B11 >

Because picture B11 is the B picture, so use the inter-picture prediction of two-way reference to encode as the encoding process of picture B11.In the case; Use apart from 2 approaching in time pictures of markup (picture B11) (I or P picture) and immediate in time 1 B picture as the candidate screen of forward direction reference, use apart from immediate in time I of coded object picture or P picture to the candidate screen of reference as the back.But not with reference to its immediate I that surpasses markup or the B picture of P picture.

Thereby, use picture P7, P10 as the forward direction of picture B11 with reference to picture, back as picture B11 to using picture P13 with reference to picture.In the processing of the 1st B picture of 2 continuous B pictures, because this B picture of the 1st is used as with reference to picture when another B picture is encoded, so coding control unit 170 is controlled so that switch 113,114,115 becomes connection each switch.Therefore, the corresponding view data Md of piece with the picture B11 that is read from input picture memory 101 is imported into motion vector detecting unit 108, mode selected cell 179, calculus of differences unit 102.

Motion vector detecting unit 108; The picture P7, the P10 that are stored in reference to picture memory 117 are used as the candidate screen of forward direction reference; With being stored in reference to the picture P13 of picture memory 117 as the back, carry out detection with corresponding forward motion vector of the piece of picture B11 and backward motion vector to using with reference to picture.In the case, the detection of forward motion vector is carried out with reference to picture through selection is optimal from picture P7, P10.Detected motion vector is to mode selected cell 179 and 104 outputs of bit string generation unit.In addition, forward motion vector is the information (with reference to image information) of which detected motion vector with reference to picture P7, P10 and so on, also to 179 outputs of mode selected cell.

Mode selected cell 179 uses by the detected motion vector of motion vector detecting unit 108, confirms the piece corresponding coding manner with picture B11.As the coded system of B picture, for example in the picture coded system, use forward motion vector the inter-picture prediction coded system, use the inter-picture prediction coded system of backward motion vector and use the inter-picture prediction coded system of bi-directional motion vector to select.In the selection of this coded system, also as above-mentioned, select to make quantity in the position that will be scheduled to give as size of code that encoding error is minimum conventional method (mode) under the situation of piece.

By mode selected cell 179 determined coded systems, outputed to bit string generation unit 104.In addition, from mode selected cell 179 determined coded system Ms accordingly with reference to the resulting predicted image data Pd of picture, outputed to calculus of differences unit 102 and add operation unit 106.But, under having selected the situation of encoding in the picture, not prediction of output view data Pd.In addition, under the situation of having selected to encode in the picture by mode selected cell 179, to switch 111 and 112, same control when carrying out with above-mentioned picture P13 coding.

Below, the situation of having been selected the inter-picture prediction coding by mode selected cell 179 is described.

In the case, the action of calculus of differences unit 102, coded prediction error unit 103, bit string generation unit 104 and predicated error decoding unit 105 and coding control unit 170, identical with in the execution mode 5.

In coded system is to carry out under the situation of coded system of forward direction reference, and reference was that which information (with reference to image information) among picture P7, the P10 also is affixed in the bit string when expression was detected forward motion vector.For example; In reference is under the situation of picture P10; Be exactly the presentation code markup tight the place ahead candidate screen for reference to picture with reference to image information, under situation with reference to picture P7, be exactly before 2 of presentation code markup candidate screen for reference to picture with reference to image information.For example, can be with reference to picture by candidate screen with reference to tight the place ahead of picture index [0] indicated object picture, be with reference to picture by candidate screen with reference to tight the place ahead of picture index [1] indicated object picture.

In addition, in the case, the B picture of presentation code object be with the B picture in the place ahead also as the information of implementing the inter-picture prediction encoding process with reference to picture, do not advance additional as heading message.In addition, the place ahead of the B picture of presentation code object be the information of 2 I or P picture and 1 B picture with reference to candidate screen, add as heading message.And then expression with reference to the information of the B picture that is positioned at the place ahead more than the I or the P picture in the immediate the place ahead of relative coding object B picture, is not advanced additional as heading message.

Thus, when the bit string Bs that the dynamic image encoding device 70 by this execution mode 7 is generated decodes, just can know need have which kind of memory capacity with reference to picture memory.Above-mentioned these heading messages, can be used as with the picture is the heading message of unit, just as the heading message to each markup, records and narrates.Also can be used as the whole heading message of sequence or be that the heading message of unit (for example the GOP in the MPEG mode etc.) is recorded and narrated with several pictures.

In addition; Because picture B11 is used as with reference to picture to the picture coding at its rear the time; So when decoding, should store decode image data Dd into information with reference to picture memory 117 and so on corresponding to this picture B11; And be illustrated in reference to should store in the picture memory 117 these data Dd during for the information when the decoding of picture B12 finishes, add as heading message respectively.

When remaining encoding process for picture B11 finishes, then carry out the encoding process of picture B12.

< encoding process of picture B12 >

Because picture B12 is the B picture, so use the inter-picture prediction of two-way reference to encode as the encoding process of picture B12.In the case, use approaching in time 2 I or P picture as the candidate screen of forward direction reference, apart from the immediate in time B picture of this coded object picture B12 apart from coded object picture B12.In addition, in time be in immediate I or P picture to the candidate screen use of reference apart from this markup B12 as the back.Specifically, be picture P7, P10, B11 for the candidate screen of the forward direction reference of picture B12, back to being picture P13 for picture B12 with reference to picture.

Because picture B12 is not used as with reference to picture to other picture codings the time, so coding control unit 170 according to control signal Cs1 each switch is controlled so that switch 113 becomes connection, and switch 114,115 becomes disconnection.Therefore, the corresponding view data Md of piece with the picture B12 that is read from input picture memory 101 is imported into motion vector detecting unit 108, mode selected cell 179, calculus of differences unit 102.

Motion vector detecting unit 108; The picture P7, P10, the B11 that are stored in reference to picture memory 117 are used as forward direction with reference to picture; The picture P13 that is stored in reference to picture memory 117 is used as the back to reference to picture, carries out the detection of forward motion vector and the backward motion vector corresponding with the piece of picture B12.

In the case, the detection of forward motion vector is carried out with reference to picture through selection is optimal from picture P7, P10, B11.Detected motion vector is outputed to mode selected cell 179 and bit string generation unit 104.In addition, forward motion vector is the information (with reference to image information) with reference to which detected motion vector of picture P7, P10, B11 and so on, also to 179 outputs of mode selected cell.

Mode selected cell 179 uses by the detected motion vector of motion vector detecting unit 108, confirms to be applied to the coded system of the piece of picture B12.As the coded system of B picture, in the picture coded system, use the inter-picture prediction coded system of forward motion vector, select among using the inter-picture prediction coded system of backward motion vector and using the inter-picture prediction coded system of bi-directional motion vector.

By mode selected cell 179 determined coded system Ms, to 104 outputs of bit string generation unit.In addition, from mode selected cell 179 determined coded systems accordingly with reference to the resulting predicted image data Pd of picture, outputed to calculus of differences unit 102 and add operation unit 106.But, under the situation of in selecting picture, encoding, not prediction of output view data Pd.

In addition, under the situation of selecting to encode in the picture by mode selected cell 179, switch 111 and 112, the control mode when being encoded with above-mentioned picture P13 is identical.

Below, the situation of having been selected the inter-picture prediction coding by mode selected cell 179 is described.

In the case, the action of calculus of differences unit 102, coded prediction error unit 103, bit string generation unit 104 and predicated error decoding unit 105 and coding control unit 170, identical with in the execution mode 5.

In coded system is to carry out under the situation of coded system of forward direction reference, and forward motion vector also is affixed in the bit string for the information (with reference to image information) with reference to which detected motion vector of picture P7, P10, B11 and so on.

In addition; As heading message; Presentation code object B picture B12 be B picture B11 with its place ahead also as the information of implementing the inter-picture prediction encoding process with reference to the candidate of picture, and the candidate screen of expression forward direction reference is that the information of 2 I or P picture and 1 B picture is is also recorded and narrated.

In addition, as heading message, to expression picture B12 when the encoding process of the picture at its rear as adding with reference to the information of picture.

Thus, just can judge easily that the decode image data Dd of corresponding picture B12 need not store into reference to picture memory when decoding, thereby make management become simple and easy with reference to picture memory.

Above-mentioned these heading messages can be recorded and narrated with picture unit as heading message, just record and narrate as the heading message of each markup to be encoded.In addition, also can be used as the whole heading message of sequence or record and narrate with the heading message of several picture unit (for example the GOP in the MPEG mode etc.).

Through same processing, carry out the remaining encoding process of picture B12.

Then, each picture corresponding view data later with above-mentioned picture B12 through corresponding with picture type, encoded with above-mentioned same processing.For example, P picture and picture P13 likewise handle, and the 1st B picture (picture B14, B17 etc.) of continuous B picture is handled with picture B11 equally.The 2nd B picture (picture B15, B18 etc.) of continuous in addition B picture is likewise handled with picture B12.

Like this; In the dynamic image encoding device 70 of this execution mode 7; When the B picture being encoded,, beyond the P picture, also use the B picture owing to candidate screen as the forward direction reference as markup; So with reference to picture, just can utilize the immediate forward direction that is positioned at the coded object picture with reference to picture as forward direction.Thus, just can improve precision of prediction, can obtain the raising of code efficiency for the motion compensation of B picture.

And when as markup the B picture being encoded, as heading message, this markup of additional representation is (during decoding) when other picture codings, whether is used as the information with reference to picture.And then, as heading message, additional representation this markup during at other picture codings (during decoding) be used as under the situation with reference to the information of picture, should this coded object picture be stored into reference to the information during the picture memory.So when the bit string Bs from 70 outputs of this dynamic image encoding device is decoded; Just can recognize at an easy rate and when decoding, in picture memory, store what picture; Perhaps this memory period how long, thereby the management with reference to picture memory when decoding is simplified.

In this execution mode 7, at the object B picture with other B picture as implementing under the situation of encoding process with reference to picture, this situation is recorded and narrated as the heading message of the B picture of coded object.But this heading message might not be recorded and narrated with picture unit.Also can be used as the whole heading message of sequence or record and narrate with the heading message of several picture unit (for example the GOP in the MPEG mode etc.).

In this execution mode 7; Motion compensation is to be that unit carries out with the macro block of being made up of 16 pixels (horizontal direction) * 16 pixels (vertical direction); The encoding process of prediction error image data is to be unit with the piece of being made up of 4 pixels (horizontal direction) * 4 pixels (vertical direction), is that unit handles with the piece of being made up of 8 pixels (horizontal direction) * 8 pixels (vertical direction) perhaps.But the encoding process of motion compensation and prediction error image data can be that unit carries out with the image space that the number of pixels different with these units formed also.

In addition; In this execution mode 7; The coded system of P picture be in picture coded system, use the inter-picture prediction coded system of motion vector and do not use the inter-picture prediction coded system of motion vector and select 1 coded system, the coded system of B picture be in picture coded system, use forward motion vector the inter-picture prediction coded system, use backward motion vector the inter-picture prediction coded system, use the inter-picture prediction coded system of bi-directional motion vector and select 1 coded system.But select the method for the coded system of P picture and B picture, be not limited to above-mentioned execution mode 7.

In addition, in this execution mode 7, be employed between I picture and the P picture, and between the P of adjacency picture, insert the image sequence of 2 B pictures.But between I picture and P picture, and the number of the B picture that inserts between the P picture of adjacency is not 2 yet in image sequence, such as, be 3 or 4.

In addition, although in this execution mode 7, be 3 to the frame numbers that is used as the candidate screen of forward direction reference when the P picture coding, it also can be other value.

In addition, although in this execution mode 7, when the B picture coding, as the candidate screen of forward direction reference, use 2 P pictures and 1 B picture, the candidate screen of the forward direction reference of conduct when the sign indicating number of B picture also can be not limited thereto.For example, as candidate screen for the forward direction reference of B picture, can use 1 P picture and 2 B pictures, 2 P pictures and 2 B pictures, or with picture type it doesn't matter ground in time the position near 3 pictures of markup.

When the B picture coding, only with the position near 1 picture of this B picture as with reference to picture, the expression piece is just need not record and narrate in bit string with reference to the information (with reference to image information) which picture is encoded and so on.

In addition, in this execution mode 7, when the B picture coding, the B picture that is positioned at the place ahead more near the forward direction I or the P picture of this B picture than the position is as with reference to picture.But when the B picture coding, also can the B picture that be positioned at the place ahead than the immediate forward direction P picture that is positioned at this B picture more be used as with reference to picture.

[execution mode 8]

Figure 35 is the block diagram that explanation utilizes moving image decoding apparatus 80 usefulness of execution mode 8 of the present invention.

The moving image decoding apparatus 80 of this execution mode 8 is decoded to the bit string Bs that exports from the dynamic image encoding device 70 of above-mentioned execution mode 7.

This moving image decoding apparatus 80 carries out on the candidate screen of forward direction reference when P picture and B picture codec, and for different with the moving image decoding apparatus 20 of above-mentioned execution mode 2 on the decoding process of B picture.

Just, this moving image decoding apparatus 80, the memory control unit 204 and mode decoding unit 223 of replacement execution mode 2 have the memory control unit 284 and mode decoding unit 283 that carry out with their different actions.

Specifically; The memory control unit 284 of execution mode 8; To controlling with reference to picture memory 287 so that when the P picture codec; 3 pictures (I or P picture) that are positioned at this P picture the place ahead are used as the candidate screen of forward direction reference, when the B picture codec, are positioned at 2 pictures (I or P picture) in this B picture the place ahead, 1 I that is positioned at immediate 1 forward direction B picture of this B picture and rear or P picture and are used as candidate screen.But be set in relative markup and do not carry out reference at the I in its immediate the place ahead or the B picture more on the front of P picture.

Above-mentioned memory control unit 284; Be based on inserted in the bit string corresponding to markup, represent whether this markup carries out reference for the encoding process of the later picture of this markup time the sign, utilize control signal Cm to reference to controlling with picture memory 207.

Specifically, in bit string corresponding to markup, comprise be illustrated in when decoding should be with the storage of markup to information (sign) with reference to picture memory 207, and represent that it should store during information.

In addition; The mode decoding unit 283 of execution mode 8; When the piece decoding of P picture; As the decoding process of object piece, decoding in the picture, select one among using the inter-picture prediction decoding of motion vector and not using the inter-picture prediction decoding of motion vector (motion is made as 0 to be handled).When the piece decoding of B picture; As the decoding process of object piece, decoding in the picture, use the inter-picture prediction decoding of forward motion vector, select one among using the inter-picture prediction decoding of backward motion vector and using the inter-picture prediction decoding of forward motion vector and backward motion vector.Just; The mode decoding unit 283 of the moving image decoding apparatus 80 of this execution mode 8; With the mode decoding unit 223 of the moving image decoding apparatus 20 of execution mode 2, only do not using on the direct mode this point different, thereby; This moving image decoding apparatus 80 does not have the motion vector storage unit 226 of moving image decoding apparatus 20.And, other assemblies of the moving image decoding apparatus 80 of execution mode 8, identical with in the moving image decoding apparatus 20 of execution mode 2.

In addition; The moving image decoding apparatus 80 of this execution mode 8; With the moving image decoding apparatus 60 of execution mode 6, control so that different on this point during whether this markup is inserted into corresponding to the bit string of this markup by the sign of reference when being illustrated in the encoding process of the picture later for markup at memory control unit 284 bit strings generation units 104.In addition, in moving image decoding apparatus 80, also different with the moving image decoding apparatus 60 of above-mentioned execution mode 6 in the candidate screen of P picture and B picture codec time institute reference.Other assemblies in the moving image decoding apparatus 80 of this execution mode 8, identical with the moving image decoding apparatus 60 of execution mode 6.

Then, 80 actions describe to dynamic image encoding device.

In the moving image decoding apparatus 80 of this execution mode 8, the bit string Bs that input is generated by the dynamic image encoding device 70 of above-mentioned execution mode 7.

In this execution mode 8, when the P picture codec, 3 the approaching pictures (I or P picture) that relative this P picture are in time the place ahead use as the candidate with reference to picture.On the other hand, when the B picture codec, 1 I or the P picture that relative this B picture are in time 2 pictures (I or P picture) in approaching the place ahead, immediate 1 the B picture that is in the place ahead and rear use as the candidate with reference to picture.But, when the B picture is decoded, do not carry out reference to being positioned at the I that is in immediate the place ahead in time or the B picture more on the front of P picture.In addition, when the I picture codec, not with reference to other picture.

In addition, the heading message Ih that which picture information with reference to picture of being used as is used as bit string Bs when being illustrated in P picture or B picture codec, in candidate screen records and narrates, and this heading message, is extracted by bit string analytic unit 201.

This heading message Ih is outputed to memory control unit 284.This heading message can be used as the whole heading message of sequence, is that the heading message of unit (for example the GOP in the MPEF mode etc.), the heading message of picture unit are recorded and narrated with several pictures.

Be input to the order of the picture among the bit string Bs of this moving image decoding apparatus 80, shown in Figure 36 (a), be the decoding order of picture.Below, the decoding processing of picture P13, B11, B12 is described in order particularly.

< decoding processing of picture P13 >

When the bit string of corresponding picture P13 was imported into bit string analytic unit 201, bit string analytic unit 201 extracted various data from the bit string of input.Various data are information and above-mentioned heading message Ih of selecting with mode relevant information (coded system) Ms, motion vector MV or the like.The coded system Ms that is extracted is outputed to mode decoding unit 283.In addition, the motion vector MV that is extracted is outputed to motion compensation decoding unit 205.And then the coded data Ed that is extracted by bit string analytic unit 201 is outputed to predicated error decoding unit 202.

Mode decoding unit 283, information (coded system) Ms with reference to the mode that extracts from bit string is selected controls switch 209 and 210.Coded system in coded system Ms is picture, and when coded system Ms is the inter-picture prediction coded system to 209 and 210 control, identical with above-mentioned execution mode 6.

In addition, mode decoding unit 283 outputs to motion compensation decoding unit 205 with coded system Ms.

Below, be that the situation of inter-picture prediction coded system describes to selection mode.

Because the action of predicated error decoding unit 202, motion compensation decoding unit 205, add operation unit 208, identical with in the execution mode 6 is so its explanation is omitted.

Figure 37 representes by the time dependent situation of picture of storing data with reference to picture memory 207.

When the decoding of picture P13 begins, in reference to the region R 1 of picture memory 207, R2, R3, store picture B8, P7, P10.To picture P13, with picture P7, P10 as implementing decoding processing with reference to the candidate of picture, and in the storage area R1 that has stored picture B8 stored picture P13.The heading message of each picture that the rewriting with reference to the view data of each picture in the picture memory like this is based in the bit string to be added is carried out.This heading message is to be illustrated in reference in the picture memory 207; Until accomplishing, the decoding processing of picture P13 all answers stored picture P7; Until accomplishing, the decoding processing of picture P16 all answers stored picture P10, until the decoding processing of picture B9 is accomplished the information of all answering stored picture B8.

In other words owing to can judge picture B8 needs no longer in the decoded process of the later picture of picture P13, so stored picture B8 with reference to picture storage area R1, P13 rewrites by picture.

In addition, owing to, recording and narrating and represent picture P13, so be stored in reference in the picture memory till during at least to this until the decoding completion of picture P19 all should be stored in reference to the information in the picture memory as the heading message of picture P13.

As stated, the piece among the picture P13 is decoded in order.When whole when decoded, just begin decoding processing for picture B11 corresponding to the coded data of the piece of picture P13.

< decoding processing of picture B11 >

Because identical in the action of bit string analytic unit 201, mode decoding unit 203 and predicated error decoding unit 202 and the decoding processing of picture P13, so to their action specification omission.

Motion compensation decoding unit 205 according to the information of being imported, like the information of motion vector etc., generates motion-compensated image data Pd.Just, the information that is input to motion compensation decoding unit 205 be with corresponding to the motion vector MV of above-mentioned picture B11 with reference to the relevant information of picture index.Picture B11 carries out reference as forward direction with reference to picture with picture P10, and picture P13 is implemented encoding process as the back to carrying out reference with reference to picture.Thereby when picture B11 decoded, these candidate screen P10, P13 were through decoding, and corresponding decode image data DId is stored in reference to picture memory 207.

In coded system is under the situation of bi-directional predicted predictive pictures coded system; Motion compensation decoding unit 205; Information based on the expression forward motion vector; From obtaining forward direction with reference to image, based on the information of expression backward motion vector, from obtaining the back with reference to picture memory 207 to reference to image with reference to picture memory 207.Then, motion compensation decoding unit 205 through to forward direction with reference to image and back to carrying out summation averaging with reference to image, generate motion compensated image.The data Pd of the motion compensated image that is generated is like this outputed to add operation unit 208.

Add operation unit 208, with prediction error image data PDd that is imported and motion-compensated image data Pd addition, output addition view data Ad.The addition view data Ad that so generates outputs to reference to picture memory 207 through switch 210 as decode image data DId.

With reference to picture memory control unit 284, based on as the heading message of bit string, expression P picture and B picture are the information which candidate screen to implement encoding process with reference to, carry out the control with reference to picture memory 207.

Figure 37 representes with reference to the time dependent situation of the store status of the picture in the picture memory 207.

When the decoding of picture B11 begins, in reference to picture memory 207, store picture P13, P7, P10.Picture B11, with picture P10, P13 as implementing decoding processing with reference to picture, stored picture B11 in the storage area R2 that has stored picture P7.The rewriting with reference to the view data of each picture in the picture memory like this, the heading message of each picture that is based in the bit string to be added is carried out.This heading message is to be illustrated in reference in the picture memory 207; Picture P7 should store when the decoding processing of picture P13 is accomplished; Picture P10 should store when the decoding processing of picture P16 is accomplished, and picture P13 should carry out canned data when the decoding processing of picture P19 is accomplished.

In other words owing to can judge picture P7 needs no longer when the later picture of picture P13 is decoded, so just stored picture P7 with reference to picture storage area R2 in, stored picture B11.

In addition; Because heading message as picture B11; Record has expression picture B11 until the decoding of picture B12 all should be stored in reference to the information in the picture memory 207 when accomplishing, so till during at least to this, picture B11 is stored in reference in the picture memory 207.

As stated, decode in order corresponding to the coded data of the piece of picture B11.When whole when decoded, carry out the decoding of picture B12 corresponding to the coded data of the piece of picture B11.

< decoding processing of picture B12 >

Because the action of above-mentioned bit string analytic unit 201, mode decoding unit 203 and predicated error decoding unit 202, the action during with picture P13 decoding processing is identical, so the omission of their action specification.

Motion compensation decoding unit 205 according to the information of the motion vector of being imported etc., generates motion-compensated image data Pd.Just, the information that is input to motion compensation decoding unit 205 is corresponding to the motion vector of picture B12 with reference to picture index.Picture B12 uses as forward direction picture P10 and B11 with reference to the candidate of picture, picture P13 is implemented encoding process as the back to carrying out reference with reference to picture.These candidate screen P10, B11, P13 are through decoding, and corresponding decode image data is stored in reference to picture memory 207.

In coded system is under the situation of bi-directional predictive coding mode; Motion compensation decoding unit 205; According to confirming with reference to picture index picture B12 implements encoding process as forward direction with reference to picture with which picture of picture P10, B11; Then, based on the information of expression forward motion vector, from obtaining forward direction with reference to image with reference to picture memory 207.In addition, motion compensation decoding unit 205 is based on the information of expression backward motion vector, from obtaining the back with reference to picture memory 207 to reference to image.Then, through to forward direction with reference to image and back to carrying out summation averaging with reference to image, generate motion compensated image.The data Pd of the motion compensated image that so generates is to 208 outputs of add operation unit.

Add operation unit 208, with the prediction error image data PDd and the motion-compensated image data Pd addition of input, output addition view data Ad.The addition view data Ad that so generates outputs to reference to picture memory 207 through switch 210 as decode image data DId.

Memory control unit 284, based on from bit string heading message extracted, which P picture and B picture be to use implement the information of encoding process and so on reference to picture, carries out the control with reference to picture memory 207.

Figure 37 representes to go up the situation that changes in time with reference to the store status of the picture in the picture memory 207.When the decoding processing of picture B12 begins, in reference to picture memory 207, store picture P13, B11, P10.Picture B12, with picture P13, B11, P10 as implementing decoding processing with reference to candidate screen.Because expression picture B12 is not used as heading message as the information with reference to picture and so on and records and narrates when other pictures are decoded,, and export as output image data Od so the decoded data of picture B12 just is not stored in reference in the picture memory 207.

As stated, decode in order corresponding to the coded data of the piece of picture B12.Be stored in decode image data with reference to each picture in the picture memory 207; And be not stored in reference to the decode image data in the picture memory; Shown in Figure 36 (b), handle by showing that time sequencing is implemented to reset, Od exports as output image data.

Thereafter, each with each picture respective coding data according to picture type, through with above-mentioned same processing, implement decoding processing.

Particularly, P picture and picture P13 are likewise implemented coded data is carried out process of decoding, the 1st the B picture (picture B14, B17 or the like) of continuous B picture implemented and the same decoding processing of picture B11.In addition, the 2nd the B picture (picture B15, B18 etc.) of continuous B picture implemented and the same decoding processing of picture B12.

As stated; In the moving image decoding apparatus 80 of this execution mode 8, owing to when decoding B picture, the B picture is used as with reference to candidate screen; So; Just can when coding B picture,, except that the P picture, also use the resulting bit string of encoding process of B picture correctly to decode to through candidate screen as the forward direction reference.In addition, owing to use the expression P picture that obtains from bit string and B picture which is to use implement the information of encoding process and so on reference to picture, carry out control, so just become possibility with reference to effective utilization of picture memory with reference to picture memory.Just; Be used as view data when making decoding processing afterwards in advance with reference to the picture of picture; Remain on reference in the picture memory; And be not used as view data during afterwards decoding processing of deletion in order with reference to the picture of picture, just can effectively utilize with reference to picture memory.

This execution mode 8 use corresponding to the bit string of between the P of adjacency picture, inserting the image sequence of 2 B pictures, but the number of the B picture between the P of adjacency picture is not limited to 2, for example also can be 3 or 4.

In addition, in this execution mode 8, when the decoding processing of P picture, use 2 pictures, but the quantity of when the decoding processing of P picture, carrying out the forward direction candidate screen of reference also can be the quantity beyond 2 as the candidate screen of forward direction reference.

In addition; In this execution mode 8, when the B picture codec, as the candidate screen of forward direction reference; Be to use 1 P picture and 1 B picture; And than relative decoder object B picture in time the immediate I in position or P picture be positioned at the place ahead more the B picture as with reference to picture, but when the decoding processing of B picture as the picture that uses with reference to candidate screen, also can be with shown in the above-mentioned execution mode 8 different.In addition, when the decoding processing of B picture, the immediate I in position or the P picture B picture that is positioned at the place ahead more also can be as with reference to picture in time than relative decoder object B picture.

In addition, in this execution mode 8, when other picture codecs, be not used as decode image data, be not stored in, but decode image data can be stored in this memory with reference to picture memory with reference to the picture of picture.

For example, when the output of the decode image data that makes each picture slightly postpones than the decoding of each picture, just need the decode image data of each picture be stored into reference to picture memory.In the case, on reference to picture memory, be provided with as the different zone of the storage area of storing with reference to the decode image data of candidate screen, and storage is not used as the decode image data with reference to the picture of picture in this zone.In the case, though increase with reference to the memory capacity of picture memory, identical with reference to the management method of picture memory and above-mentioned execution mode 8, so can be easy to realize management with reference to picture memory.

Although in above-mentioned execution mode 2,4,6,8, all picture all is as with reference to candidate screen, not necessarily wants whole pictures all to be used as with reference to candidate screen.

In brief; Usually, moving image decoding apparatus is no matter decoded picture is to be used as or not to be used as with reference to candidate screen; In case be stored decoding buffer storage (decoded frame memory) afterwards, this decoded picture just read successively and shown from this decoding buffer storage.

In execution mode 2,4,6,8 of the present invention; All pictures are used as with reference to candidate screen, thereby, decoded picture all be stored storage as with reference to candidate screen with reference to picture memory; Afterwards, decoded picture from being read successively with reference to picture memory and being shown.

But, as stated, be not decoded picture all be used as with reference to candidate screen.Thereby; Also can make decoded picture; Not only preserve not as picture in case be stored with reference to candidate screen; But also preserve as afterwards with reference to the decoding buffer storage (decoded frame memory) of the picture of candidate screen, this decoded picture just read successively and shown from this decoding buffer storage.

In above-mentioned each execution mode, illustrate by hardware and realize dynamic image encoding device or moving image decoding apparatus, but these devices also can be realized by software.In the case; Record the data storage medium of floppy disc etc. through the program that will be used to carry out encoding process shown in above-mentioned each execution mode or decoding processing in advance, independently just can realize above-mentioned dynamic image encoding device or moving image decoding apparatus at an easy rate in the computer system.

Figure 38 (a)-38 (c) is used to explain that any one moving image encoding of carrying out execution mode 1,3,5,7 is handled and the figure of the computer system that any one moving picture decoding of execution mode 2,4,6,8 is handled.

Figure 38 (a) expression is included in front view, its cutaway view and the floppy disc main body D of floppy disc FD of the storage medium of the program of using in the computer system.The example of the physical format of Figure 38 (b) expression floppy disc main body D.

Floppy disc FD is built in above-mentioned disk main body D in the shell F, on the surface of this disk main body D, inwardly week forms a plurality of magnetic track Tr with concentric circles from periphery, and each magnetic track is split up into 16 sector Se along angle direction.Thereby, in having stored the floppy disc FD of said procedure, be used for carrying out the program that above-mentioned moving image encoding is handled or moving picture decoding is handled and just be recorded in the storage area of on above-mentioned disk main body D, being given (sector).

In addition, Figure 38 (c) expression is used for carrying out the record of said procedure or the structure of reproduction at floppy disc FD.When said procedure being recorded among the floppy disc FD, from computer system Csys said procedure is written to floppy disc FD through floppy disk driver FDD.When the program in utilization is recorded in floppy disc FD is constructed above-mentioned dynamic image encoding device or moving image decoding apparatus in computer system, computer system Csys is read and be sent to said procedure from floppy disc FD through floppy disk driver FDD.

Although in above-mentioned explanation, be to be that example is given an example with the floppy disc as recording medium, use CD also can likewise utilize the moving image encoding of software to handle or the moving picture decoding processing with the situation of using above-mentioned floppy disc.In addition, recording medium is not limited to this, also can be CD-ROM, storage card, ROM cassette tape etc., as long as can logging program.Under the situation of using these data carriers, also can likewise carry out moving image encoding and handle perhaps moving picture decoding processing with the situation of using above-mentioned floppy disc by computer system.

Below, to the application example of dynamic image encoding method shown in the above-mentioned execution mode and dynamic image decoding method and use its system to describe.

Figure 39 is the integrally-built block diagram that expression realizes the content provider system 1100 of content converting service.

Communication service provide the district to be split up into institute to hope big or small zone (sub-district), in each sub-district, be respectively arranged with base station 1107～1110 as fixed radio station.

In this content provider system 1100; For example; Through ISP 1102, telephone network 1104 and base station 1107～1110, each equipment such as portable phone 1200 of computer 1111, PDA (personal digital assistant) 1112, camera 1113, portable phone 1114, band camera is connected to internet 1101.

But content provider system 1100 does not limit and will comprise all a plurality of equipment shown in Figure 39, can comprise the part of a plurality of equipment shown in Figure 39 yet.In addition, each equipment can not be directly connected to telephone network 1104 through the base station 1107～1110 as fixed radio station yet.

Camera 1113 be similar digital camera can be to the equipment of object movement image photography.In addition; Portable phone is the portable telephone of PDC (Personal Digital Communication) mode, CDMA (Code Division Multiple Access) mode or GSM (Global System for Mobile Communications) mode; Perhaps also can be PHS (Personal Handyphone System) etc., any one mode.

Streaming server 1103, through base station 1109, telephone network 1104 is connected with camera 1113.In this system, use camera 1113 can carry out the on-site delivery based on the data of the encoding process of user's transmission.The encoding process of captured data both can be by camera 1113, and the server that also can be handled by the transmission of carrying out data etc. carries out.Take resulting motion image data by 1116 pairs of moving images of camera and also can send to streaming server 1103 through computer 1111.Camera 1116 be wait can shot object still frame or the equipment of moving image, like digital camera.In the case, the coding of motion image data is undertaken all can by which of camera 1116, computer 1111.In addition, encoding process is undertaken by the LSI1117 that computer 1111 and camera 1116 have.

The software that encoding/decoding image is used can be stored in the storage medium (CD-ROM, floppy disc, hard disc etc.) as the recording medium that can be read by computer 1111 grades.And then motion image data also can be sent by the portable phone 1200 of band camera.This motion image data is the data of being carried out encoding process by the LSI that portable phone 1200 has.

In this content provider system 1100, the content that the user takes through camera 1113 or camera 1116 etc. (for example, taking the video live telecast of concert etc.) likewise carries out sending to streaming server 1103 from camera after the encoding process with above-mentioned execution mode.From streaming server 1103, the client computer of filing a request banishd the foregoing data send.

As client computer, the computer 1111 that can decode to the data of above-mentioned encoding process, PDA1112, camera 1113, portable phone 1114 etc. are arranged.

In such content provider system 1100, can receive and reproduce at client-side through coded data, and then through receiving the decode in real time at client-side, and reproduce, just can also realize private broadcast.

In the coding of each equipment that constitutes this system, decoding, use dynamic image encoding device or the moving image decoding apparatus shown in above-mentioned each execution mode.

Example as moving image encoding or decoding device describes portable phone.

Figure 40 is the figure that the portable phone 1200 of dynamic image encoding method illustrated in above-mentioned any execution mode and dynamic image decoding method is used in expression.

This portable phone 1200 has; Be used for and base station 1110 between the transmitting-receiving electric wave antenna 1201; But the video image of shot object or the camera unit of still frame 1203; Like the CCD camera, show by the captured video image of camera unit 1203, by the display unit 1202 of the LCD of the data of video image that antenna 1201 received etc. etc.

Portable phone 1200 has; The main unit 1204 of a plurality of operation keyss is installed; Be used to carry out the voice-output unit 1208 of the loud speaker etc. of voice output; Be used to carry out the voice-input unit 1205 of the microphone etc. of phonetic entry; The recording medium 1207 of the data that are used to keep data, the data of moving image or the data of still frame etc., the data encoded of the data of captured moving image or still frame, the mail that received or decoded is used for can recording medium 1207 being installed to the receptacle unit 1206 of portable phone 1200.

Recording medium 1207 has a kind of flash memory element of EEPROM (Electrically Erasable Programmable Read OnlyMemory) that can erasable nonvolatile memory as electricity in plastic casing, like the SD card.

Use Figure 41 that portable phone 1200 is described in more detail below.

Portable phone 1200 has the main control unit 1241 that each parts of the main unit that disposes display unit 1202 and operation keys 1204 are controlled blanketly.

Portable phone 1200 also has power circuit unit 1240, operation Input Control Element 1234, image encoding unit 1242, camera interface unit 1233, LCD (LiquidCrystal Display) control unit 1232, picture decoding unit 1239, demultiplexing/resolving cell 1238, recoding/reproduction unit 1237, modulation-demodulation circuit unit 1236 and Audio Processing Unit 1235.Each parts of portable phone 1200 interconnect through synchronous bus 1250.

Power circuit unit 1240, when by user operation with calling terminal/when power supply power supply key becomes to on-state, through by battery pack to each parts power supply, but the portable phone 1200 that starts the band camera is an operate condition.

In portable phone 1200, through each parts action of control control of the main control unit 1241 formed by CPU, ROM and RAM etc.In specific words, in portable phone 1200, when the voice call mode,, be transformed into digital voice data by Audio Processing Unit 1235 through to the resulting voice signal of the phonetic entry of voice-input unit 1205.Digital voice data is implemented spread processing by modulation-demodulation circuit unit 1236, and then implements digitaltoanalogconversion by transmission circuit unit 1231 and handle and frequency conversion process, sends through antenna 1201.

In this portable phone 1200, the reception signal that when the voice call mode, is received by antenna 1201 is exaggerated and implements frequency conversion process and analog-to-digital conversion is handled.Receive signal and implement contrary spread processing by modulation-demodulation circuit 1236 again, be transformed into analog voice signal by Audio Processing Unit 1235, this signal is through voice-output unit 1208 outputs.

Under the situation of portable phone 1200 send Email during at data communication mode, the text data of the Email that the operation of the operation keys 1204 through main unit is imported sends to main control unit 1241 through operation Input Control Element 1234.Main control unit 1241; Each parts is controlled so that by 1236 pairs of text datas enforcement of modulation-demodulation circuit spread processing, after implementing digitaltoanalogconversions processing and frequency conversion process by transmission circuit unit 1231, send to base station 1110 through antenna 1201.

When portable phone 1200 sends view data under data communication mode, supply to image encoding unit 1242 through camera interface unit 1233 by camera unit 1203 captured view data.In portable phone 1200, under the situation of not sending view data, also can will take acquired image data by camera unit 1203 with LCD control unit 1232 and directly be shown in display unit 1202 through camera interface unit 1233.

Image encoding unit 1242 disposes in above-mentioned each execution mode illustrated dynamic image encoding device in any.This image encoding unit 1242 is transformed into coded image data through by dynamic image encoding method any in the above-mentioned execution mode view data of being supplied with from camera unit 1203 being carried out compressed encoding, sends to demultiplexing/resolving cell 1238.In addition, simultaneously, portable phone 1200 will be input to voice-input unit 1205 by camera unit 1203 in photography voice send to demultiplexing/resolving cell 1238 through Audio Processing Unit 1235 as the speech data of numeral.

Demultiplexing/resolving cell 1238 carries out demultiplexing to the coded image data of 1242 supplies from the image encoding unit and the speech data of supplying with from Audio Processing Unit 1235 in a predetermined manner.The resulting demultiplexing data of its result are implemented spread processing by modulation-demodulation circuit 1236, and then implement digitaltoanalogconversion by transmission circuit unit 1231 and handle and frequency conversion process, send through antenna 1201.

Portable phone 1200; When under data communication mode, being received in the data of the motion pictures files that is linked in homepage etc.; Through antenna 1201 from the base station the 1110 reception signals that receive; Implement contrary spread processing by modulation-demodulation circuit 1236, the resultant demultiplexing data of its result send to demultiplexing/resolving cell 1238.

When the demultiplexing data that received through antenna 1201 are decoded; Demultiplexing/resolving cell 1238; Through the demultiplexing data being decomposed the coding bit string that is divided into view data and the coding bit string of speech data; Through synchronous bus 1250 this coded image data is supplied with picture decoding unit 1239, simultaneously this speech data is supplied with Audio Processing Unit 1235.

Picture decoding unit 1239 disposes and utilizes any one moving image decoding apparatus in the execution mode of the present invention.Picture decoding unit 1239; Through with coding/decoding method corresponding to any one coding method in the above-mentioned execution mode; The coding bit string of view data decoded generates the reproducing motion pictures data, and through LCD control unit 1223 it is supplied with display unit 1202.The demonstration of the motion image data that thus, carries out in the motion pictures files that for example homepage linked, being comprised.Meanwhile, audio treatment unit 1235 is supplied with voice-output unit 1208 with it after voice data is transformed into simulated audio signal.The reproduction of the voice data that thus, carries out in the motion pictures files that for example homepage linked, being comprised.

, can use any one dynamic image encoding method and the system of dynamic image decoding method in the above-mentioned execution mode here, and in the example that is limited to the foregoing feed system.

Recently, utilize the digital broadcasting of satellite or surface wave to become hot issue, the picture coding device of above-mentioned execution mode and picture decoding apparatus also can that kind shown in figure 42 be applied to digital broadcasting and use system.

More specifically, ganged up radio communication corresponding to the bits of coded of video information and 1409 sent to satellites 1410 such as communication satellite or broadcasting satellite from the broadcasting station.When broadcasting satellite 1410 receives the coding bit string of above-mentioned video image information, the electric wave of output broadcasting usefulness, this electric wave is received by the antenna 1406 of the family that has the satellite broadcasting receiving equipment.For example, in the device of television set (receiver) 1401 or STB (STB) 1407 grades, the coding bit string is decoded, and reproduce video information.

In addition, on as the coding bit string of the storage medium 1402 of the CD of recording medium and DVD etc. and the transcriber of decoding, the moving image decoding apparatus shown in any one in the above-mentioned execution mode can be installed also in reading and recording.

In the case, the vision signal of reproduction is shown on the monitor 1404.Also can be in the STB 1407 of the antenna 1406 that is connected to cable 1405 that cable TV uses or the broadcasting of satellite/terrestrial ripple the mounted movable picture decoding apparatus, reproduce by the output of 1408 pairs of these moving image decoding apparatus of monitor of television set.In the case, moving image decoding apparatus also can not be contained in STB, but be contained in the television set.In addition, also can in the automobile with antenna 1,411 1412, receive signal, on the display unit such as the auto navigation 1413 in being equipped on automobile 1412 moving image reproduced from satellite 1410 or base station 1107 grades.

And then, also can encode to picture signal, and record recording medium by the dynamic image encoding device shown in any one in the above-mentioned execution mode.

Tape deck at object lesson is a register 1420, as with picture signal record to the DVD register of DVD dish 1421 and with picture signal record to the magnetic disk recorder of hard disc etc.Picture signal also can record SD card 1422.In addition; If register 1420 possesses the moving image decoding apparatus shown in any one in the above-mentioned execution mode; Then can pass through register 1420, institute's images recorded signal in DVD dish 1421 and SD card 1422 is reproduced, show by monitor 1408.

Here; Structure as auto navigation 1413; Can be included in camera unit 1203, camera interface unit 1233, the part beyond the image encoding unit 1242 in the structure of portable phone shown in Figure 41, too to computer 1111 and television set (receiver) 1401 etc.

In addition,, can install: have both receiving type terminals of encoder/decoder, only have the transmission terminal of encoder and only have 3 kinds of the receiving terminals etc. of decoder as the terminal of portable phone 1114.

As stated, in above-mentioned any equipment/system, dynamic image encoding method shown in any one or dynamic image decoding method in the above-mentioned execution mode can be used, just illustrated in the above-described embodiment effect can be obtained through such processing.

In addition, need not superfluous words, execution mode of the present invention and application example thereof are not limited to shown in this specification.

As stated; Dynamic image encoding method and dynamic image decoding method according to the present invention; When becoming the coding or the markup of decoder object and be the B picture, as for markup with reference to picture, can use the immediate forward direction picture that is positioned at this markup; Can improve the precision of prediction of the motion compensation of B picture, and obtain the raising of code efficiency.Particularly, these methods transmit or the data processing of storing moving image data in of great use.

Claims (4)

1. one kind is used for picture coding method that markup is encoded, and said picture coding method comprises with reference to coded picture carries out the coding step of predictive coding to markup,

Wherein, in said coding step, be when can be under the P pattern-coding it being carried out the P picture of predictive coding in markup, from candidate screen, specify be used for the P picture with reference to picture,

Wherein candidate screen comprise near the forward direction I of markup or P picture and except that near the forward direction I of markup or the one or more forward directions the P picture and back to I or P picture, and

In markup is when can be under the B pattern-coding it being carried out the B picture of predictive coding, from I picture, P picture or B picture, specify be used for the B picture with reference to picture,

Wherein markup can not be with reference to being positioned at respect to the B picture of markup in more the place ahead of the I in immediate the place ahead or P picture.

2. one kind is used for picture coding equipment that markup is encoded, and said picture coding equipment comprises with reference to coded picture carries out the code device of predictive coding to markup,

Wherein, said code device is when can be under the P pattern-coding it being carried out the P picture of predictive coding in markup, from candidate screen, specify be used for the P picture with reference to picture,

Wherein candidate screen comprise near the forward direction I of markup or P picture and except that near the forward direction I of markup or the one or more forward directions the P picture and back to I or P picture, and

Said code device is when can be under the B pattern-coding it being carried out the B picture of predictive coding in markup, from I picture, P picture or B picture, specify be used for the B picture with reference to picture,

Wherein markup can not be with reference to being positioned at respect to the B picture of markup in more the place ahead of the I in immediate the place ahead or P picture.

3. one kind is used for markup is carried out the decoded pictures coding/decoding method, and said picture codec method comprises with reference to decoded picture carries out the decoding step of prediction decoding to markup,

Wherein, in said decoding step, be when can be under the P mode decoding it being carried out the P picture of prediction decoding in markup, from candidate screen, specify be used for the P picture with reference to picture,

Wherein candidate screen comprise near the forward direction I of markup or P picture and except that near the forward direction I of markup or the forward direction the P picture and back to I or P picture; And

In markup is when can be under the B mode decoding it being carried out the B picture of prediction decoding, from I picture, P picture or B picture, specify be used for the B picture with reference to picture,

Wherein markup can not reference position be positioned in time the B picture near the place ahead of the I of object B picture or P picture.

4. one kind is used for markup is carried out the decoded pictures decoding device, and said picture codec equipment comprises with reference to decoded picture carries out the decoding device of prediction decoding to markup,

Wherein, said decoding device is when can be under the P mode decoding it being carried out the P picture of prediction decoding in markup, from candidate screen, specify be used for the P picture with reference to picture,

Wherein candidate screen comprise near the forward direction I of markup or P picture and except that near the forward direction I of markup or the forward direction the P picture and back to I or P picture; And

Said decoding device is when can be under the B mode decoding it being carried out the B picture of prediction decoding in markup, from I picture, P picture or B picture, specify be used for the B picture with reference to picture,

Wherein markup can not reference position be positioned in time the B picture near the place ahead of the I of object B picture or P picture.

Images