CN100515085C - Moving picture decoding method - Google Patents

Abstract

A moving picture coding apparatus for performing inter-picture prediction coding on a picture constituting a moving picture includes a coding unit for performing prediction error coding on image data, a decoding unit for performing prediction error decoding on the output of the coding unit, a reference picture memory for storing output data from the decoding unit, and a motion vector detector for detecting a motion vector according to the decoded image data stored in the memory. When coding a B picture as a coding object picture, information indicating whether the coding object picture is used as a reference picture upon coding of another picture is added as header information. In a decoding apparatus for decoding a code string Bs output from the moving picture coding apparatus, it is possible to simplify management of a memory for storing reference pictures according to the aforementioned header information.

Description

Dynamic image decoding method

The application be that November 6, application number in 2002 are 02803477.5 the applying date, denomination of invention divides an application for the Chinese patent application of " dynamic image encoding method and dynamic image decoding method ".

Technical field

The present invention relates to dynamic image decoding method, relate in particular to constituting the picture of moving image, the method for decoding with reference to other pictures of this moving image.

Background technology

Generally, in the coding of the picture that constitutes moving image, each picture is divided into a plurality of, and utilizes the direction in space of moving image and the redundancy of time direction, to every compressed encoding that carries out the image information that each picture has (below, also abbreviate coding as).Here, in the coding of the redundancy of utilizing direction in space, use the relevant interior coding of picture of pixel value that utilizes in the picture.In the coding of the redundancy of utilizing time orientation, use the relevant inter-picture prediction coding of pixel value that utilizes between picture.The inter-picture prediction coding is, to becoming the object picture of coded object, be positioned at the picture (forward direction picture) in the place ahead in time with reference to relative this object picture, perhaps this object picture is positioned at the processing that the picture (back is to picture) at rear is encoded in time relatively.

Here, the forward direction picture is to show time ratio object picture picture early, on the time shaft of demonstration time of each picture of expression (below, be called and show time shaft), is positioned at the front side of object picture.The back is to show the slow picture of time ratio object picture to picture, is showing on the time shaft, is positioned at the rear side of object picture.In addition, in the following description, be called with reference to picture at the picture of the coding time institute reference of object picture.

In the inter-picture prediction coding, specifically be exactly,, to obtain prediction data for the view data of this object picture based on this momental motion compensation process by the amount of exercise for the reference picture of detected object picture.Then, the redundancy of the direction in space of the picture of the differential data of the view data by removing this prediction data and object picture is carried out the compressed encoding for the amount of information of coded object picture.

In addition, in the decoding of coded picture, the interior decoding of picture of coding in the corresponding picture is arranged, and decode between the picture of encoding between corresponding picture.Between picture the decoding in, with reference to picture between the coding time institute's reference the identical picture of picture.Just, with reference to picture Xra and the coded picture Xtg of Xrb, decode with reference to picture Xra and Xrb.

Figure 43 is the figure that expression constitutes a plurality of pictures of moving image.

In Figure 43 (a), the part of a plurality of pictures that constitute a moving image Mpt is shown, just, picture F (k)～F (k+2n-1) [k, n: integer].In each picture F (k)～F (k+2n-1), be set with demonstration time t (k)～t (k+2n-1).This each picture on the demonstration time shaft X of expression demonstration time T dis separately, like that, is arranged from the beginning early of demonstration time shown in Figure 43 (a) in order, and these pictures are divided into group by predetermined number (n opens).These picture groups are called as GOP (GroupOf Picture), become the random-access least unit for the coded data of moving image.In addition, in the following description, the picture group is also noted by abridging and is GOP.

For example, (i) individual picture group Gp (i) is made of picture F (k)～F (k+n-1).(i+1) individual picture group Gp (i+1) is made of picture F (n+k)～F (k+2n-1).

Above-mentioned each picture is divided into the picture bar (slice) that consists of a plurality of macro blocks.For example, here, macro block is that the pixel count in vertical direction and horizontal direction all is 16 rectangular area.In addition, picture F (k+1) like that, is distinguished into a plurality of picture bar SL1～SLm[m: natural number shown in Figure 43 (b)].As bar SL2 shown in Figure 43 (c), by a plurality of macro block MB1～MBr[r: natural number] constitute.

Figure 44 is the figure that is used for the coded data of account for motion image, and expression is to the encode structure of resulting stream of each picture that constitutes moving image.

Stream Smp is the coded data of a corresponding image sequence (for example moving image).This stream Smp is made of zone (common information zone) Cstr of the bit sequence that is arranged with the common information that is equivalent to title etc. and zone (GOP zone) Dgop that is arranged with the bit sequence of corresponding each GOP.In common information zone C str, include synchrodata Sstr and title Hstr for stream.In GOP region D gop, include corresponding picture group (GOP) Gp (1)～Gp (i-1), Gp (i), bit sequence Bg (1)～Bg (i-1), the Bg (i) of Gp (i+1)～Gp (I) [i, I: integer], Bg (i+1)～Bg (I).

Corresponding GOP bit sequence is made of zone (common information zone) Cgop of the bit sequence that is arranged with the common information that is equivalent to title etc. and zone (picture area) Dpct that is arranged with the bit sequence of corresponding each picture.In common information zone C gop, include synchrodata Sgop and title Hgop for GOP.In the picture area Dpct of the bit sequence Bg of corresponding picture group G (i) (i), include corresponding picture F (k '), F (k '+1), F (k '+2), F (k '+3) ..., F (k '+s) [k ', s: integer] bit sequence Bf (k '), Bf (k '+1), Bf (k '+2), Bf (k '+3) ..., Bfk '+s).Here, picture F (k '), F (k '+1), F (k '+2), F (k '+3) ..., F (k '+s) change by coded sequence and arranged picture F (the k)～F (k+n-1) that arranges by above-mentioned DISPLAY ORDER.

The bit sequence of corresponding picture is by zone (common information zone) Cpct of the bit sequence that is arranged with the common information that is equivalent to title etc. be arranged with corresponding each zone (as the bar zone) Dslc as the bit sequence of bar and constitute.In common information zone C pct, include synchrodata Spct and title Hpct for picture.For example, under the picture F (k '+1) by the arrangement (coded sequence arrangement) of scramble time order is situation by the picture F (k+1) of the arrangement (DISPLAY ORDER arrangement) that shows time sequencing, in the picture bar region D slc of the bit sequence Bf (k '+1) of corresponding picture F (k '+1), comprise corresponding above-mentioned each bit sequence Bs1～Bsm as bar SL1～SLm.

Corresponding bit sequence as bar is made of zone (common information zone) Cslc of the bit sequence that is arranged with the common information that is equivalent to title etc. and zone (macro block zone) Dmb that is arranged with the bit sequence of corresponding each macro block.In common information zone C slc, include synchrodata Sslc and title Hslc for the picture bar.For example, be under the situation of the picture F (k+1) that arranges of DISPLAY ORDER at the picture F (k '+1) that coded sequence is arranged, in the macro block region D mb of correspondence, comprise bit sequence Bm1～Bmr of corresponding above-mentioned each macro block MB1～MBr as the bit sequence Bs2 of bar SL2.

The coded data of a corresponding like this moving image (image sequence just), have by correspondence as the fluid layer of the stream Smp of this coded data, GOP layer that correspondence constitutes above-mentioned stream, the picture frame layer and being equivalent to that is equivalent to constitute the picture of above-mentioned GOP constitutes the hierarchical structure that the picture bar layer of the picture bar of above-mentioned picture is formed.

; MPEG (Moving Picture Experts Group)-1, MPEG-2, MPEG-4, ITU-T suggestion H.263, in the moving image encoding mode that H.26L waits, the picture that the picture of implementing coding in the picture is called as the I picture, implement the inter-picture prediction coding is called as P picture or B picture.

Below, the definition of I picture, P picture, B picture is described.

The I picture is not with reference to the coded picture of other picture.P picture or B picture are with reference to the coded picture of other picture.Strictly, the P picture is when each picture is encoded, and can select any one picture that the I mode is encoded and the P mode is encoded.The B picture is when each picture is encoded, and can select any one picture that the I mode is encoded, the P mode is encoded and the B mode is encoded.

Here, the I mode is encoded, and is the object piece of object picture not to be carried out the processing of encoding in the picture with reference to other picture.The P mode encode be with reference to one coded picture the object piece of object picture is carried out the processing of inter-picture prediction coding.The B mode encode be with reference to two coded picture the object piece of object picture is carried out the processing of inter-picture prediction coding.

Encoding or the encode picture of time institute's reference of B mode in above-mentioned P mode, is offscreen I picture of object or P picture, also can be positioned at the object picture the place ahead the forward direction picture and be positioned at rear back of object picture to picture.

But, in the B mode is encoded, carry out in two pictures and combination of reference three kinds of situations being arranged.Just, the situation with reference to two forward direction pictures is arranged in the B mode is encoded, after two to the situation of picture and with reference to behind a forward direction picture and one to the situation of picture.

Figure 45 is the figure of the moving image encoding mode of explanation above-mentioned MPEG etc.In Figure 45, object picture and corresponding relation with reference to picture (at the picture of the coding time institute reference of object picture) are shown.

Constitute moving image each picture F (k)～F (k+7) ..., the coding of F (k+17)～F (k+21), the picture with reference to other carries out like that shown in arrow Z.Just, being in the picture of the end side of an arrow Z, is to encode by inter-picture prediction with reference to the picture that is in the top side of this arrow.In addition, here, above-mentioned picture F (k)～F (k+7) ..., picture F (the k)～F (k+4) shown in F (k+17)～F (k+21) and Figure 43 (a) ..., F (k+n-2)～F (k+n+4) ..., F (k+2n-2), F (k+2n-1) be identical.These pictures are arranged in order from the beginning early of demonstration time on demonstration time shaft X.Picture F (k)～F (k+7) ..., demonstration time of F (k+17)～F (k+21), be time t (k)～t (k+7) ..., t (k+17)～t (k+21).The picture type of picture F (k)～F (k+7) is, I, B, B, P, B, B, P, B, and the picture type of picture F (k+17)～F (k+21) is B, P, B, B, P.

For example, from the B mode of the B picture F (k+1) of second of beginning shown in Figure 45 is encoded, with reference to the I picture F (k) of beginning and the 4th P picture F (k+3) from the outset.In addition, from the P mode of the P picture F (k+3) of the 4th of beginning shown in Figure 45 is encoded, with reference to the I picture F (k) of beginning.

In addition, although among Figure 45, during the P mode that is illustrated in the P picture is encoded with reference to the situation of forward direction picture, also can be in the P of P picture mode is encoded with reference to the back to picture.In addition, although among Figure 45, during the B mode that is illustrated in the B picture is encoded with reference to forward direction picture and back situation to picture, also can be in the B of B picture mode is encoded with reference to two forward direction pictures, perhaps with reference to after two to picture.

In addition, in MPEG-4 and the moving image encoding mode that H.26L waits, when the coding of B picture, can select the coded system of direct mode and so on.

Figure 46 is the figure that is used to illustrate the inter-picture prediction coding that is carried out with this direct mode.Shown in Figure 46 (a) in direct mode employed motion vector.

Here, picture P1, B2, B3, P4 are equivalent to picture F (k+3) shown in Figure 45～F (k+6) [k=-2], and time t (1), t (2), t (3), t (4) (t (1)＜t (2)＜t (3)＜t (4)) are the demonstration time of picture P1, B2, B3, P4.In addition, X is the demonstration time shaft that expression shows time T dis among the figure.

Below, just the situation that the piece BL3 of picture B3 encodes is described particularly with direct mode.

In the case, the object picture that becomes the encoding process object is picture B3, and becoming the object piece of the object of encoding process is piece BL3.

Then, in the predictive coding of the piece BL3 of picture B3 is handled, utilize the rear that is positioned at picture B3, the motion vector MV4 of the piece BL4 of recently coded picture P4.This piece BL4, for the relative position of picture P4, with above-mentioned BL3, equate for the relative position of picture B3.Just, like that, (x4, y4), (x3 y3) equates with coordinate for the datum mark Ob3 of the piece BL3 of the datum mark O3 of picture P3 for the coordinate of the datum mark Ob4 of the piece BL4 of the datum mark O4 of picture P4 shown in Figure 46 (b).In addition, the motion vector MV4 of piece BL4 is an employed motion vector in the predictive coding of piece BL4.The motion vector MV4 of this piece BL4, by with reference to the motion detection of piece BL4 of forward direction picture P1 obtain expression forward direction picture region R 4f P1, corresponding blocks BL4.

Then, in the piece BL3 of above-mentioned picture B3, use motion vector MV3f and the MV3b parallel, implement with reference to forward direction picture P1 and the bi-directional predictive coding of back to picture P4 with motion vector MV4.Here, motion vector MV3f is illustrated in forward direction picture region R 3f P1, corresponding blocks BL3 of the coding time institute reference of piece BL3.Motion vector MV3b is illustrated in coding time institute reference back to region R 3b picture P4, corresponding blocks BL3 of piece BL3.

, in ITU-T suggestion (AnnexU H.263++), record and narrate to some extent about the framework under the situation that a plurality of pictures are used as the candidate of reference picture.Here, preservation become with reference to the view data of the picture (candidate screen) of the candidate of picture with reference to the picture memory, be categorized between short-term picture with memory and long-term between the picture memory.Picture memory between short-term is a storage area of preserving the data of the near in time candidate screen (candidate screen nearby) of relative object picture.Picture memory between long-term is the storage area that is used to preserve the data of relative object picture candidate screen far away in time (distant place candidate screen).Specifically, above-mentioned distant place candidate screen in the quantity of the candidate screen from the object picture to this distant place candidate screen, surpasses can put aside between short-term and on the degree of picture with the quantity of the candidate screen in the memory, leaves from the object picture.

In addition, in ITU-T suggestion (AnnexU H.263++), relevant for picture between short-term with memory and long-term between the memory-aided record that utilizes method of picture, and then, also record and narrate to some extent about the method for picture being specified numbering (following also abbreviating as) with reference to numbering with reference to picture.

At first, just the designation method with reference to numbering for picture describes simply.

Figure 47 is used to illustrate the figure that a plurality of pictures that constitute moving image is specified the method for reference numbering.Figure 47 (a) is illustrated in the candidate (candidate screen) of picture of the coding time institute reference of picture P16.Figure 47 (b) is illustrated in the candidate (candidate screen) of picture of the coding time institute reference of picture B15.

In addition, picture P4, B2, B3, P7, B5, B6, P10, B8, B9, P13, B11, B12, P16, B14, B15, P19, B17, P18 shown in Figure 47 (a) changes by coded sequence and to have arranged that picture F (k+1) shown in Figure 45～F (k+17) (k=1).The arrangement of a plurality of pictures shown in Figure 47 (a) is arrangements of the picture on time shaft (scramble time axle) Y of time (scramble time) Tenc that expression is encoded to each picture.

For example, like that, just the situation that the piece enforcement P mode of P picture P16 is encoded describes shown in Figure 47 (a).

In the case, in 4 forward direction P pictures (picture P4, P7, P10, P13), with reference to the picture that is suitable for encoding.Just, above-mentioned forward direction P picture P4, P7, P10, P13 are the candidate screen that can be designated as when the P of picture P16 mode is encoded with reference to picture.On these candidate screen P4, P7, P10, P13, distribute with reference to numbering respectively.

In distribution with reference to numbering for such candidate screen, on above-mentioned scramble time axle Y, apart from the near more candidate screen of picture P16 that becomes coded object, the reference numbering that the value of being assigned with is more little.Specifically, be exactly such shown in Figure 47 (a), on picture P13, P10, P7, P4, distribute with reference to numbering [0], [1], [2], [3].In addition, the information that expression distributes each candidate screen with reference to numbering, as the parameter of motion compensation, record is in the bit sequence of the object piece of corresponding picture P16.

Then, like that, just the situation that the piece enforcement B mode of B picture B15 is encoded describes shown in Figure 47 (b).

In the case, behind 4 forward direction pictures (picture P4, P7, P10, P13) and 1 in picture (picture P16), with reference to two pictures that are suitable for encoding.Just, forward direction picture P4, P7, P10, P13 and back are the candidate screen that can be designated as when the B of picture B15 mode is encoded with reference to picture to picture P16.Behind 4 forward direction pictures and 1, become under the situation of candidate screen like this, forward direction picture P4, P7, P10, P13 distributed with reference to numbering to picture, to the back to picture P16 distribute expression it by the mark [b] of back to the candidate screen of reference.

In the distribution of carrying out for such candidate screen with reference to numbering, near more apart from the picture B15 that becomes coded object on above-mentioned scramble time axle Y to forward direction picture as candidate screen, with regard to the more little reference numbering of apportioning cost.Specifically, be exactly such shown in Figure 47 (b), on picture P13, P10, P7, P4, distribute with reference to numbering [0], [1], [2], [3].In addition, the information that expression distributes each candidate screen with reference to numbering, as the parameter of motion compensation, record is in the bit sequence of the object piece of corresponding picture B15.

Then, will advise at ITU-T being recorded and narrated in (AnnexU H.263++), with reference to the distribution method of numbering, and between short-term picture picture is memory-aided with memory and for a long time utilizes method to associate to describe.

Picture is with in the memory between short-term, and savings can be used as the candidate screen of carrying out appointment with reference to picture for the object picture in order, to the candidate screen put aside by giving in proper order to the savings of memory with reference to numbering.In addition, when the B picture was decoded, the picture of being put aside in memory was recently treated to the reference picture as the back, to other picture, carried out giving with reference to numbering in proper order with the savings to memory.

Below, just can be used as for the candidate with reference to picture of object picture and utilize the situation of 4 forward direction pictures to describe particularly.

Figure 48 is the figure of the part of expression a plurality of pictures of constituting moving image, and expression has carried out arranging (Figure 48 (a)) by DISPLAY ORDER to picture, picture has been carried out arranging the situation of (Figure 48 (b)) by coded sequence.In addition, picture P1, B2, B3, P4, B5, B6, P7, B8, B9, P10, B11, B12, P13, B14, B15, P16, B17, B18, the P19 shown in Figure 48 (a) is equivalent to picture F (k+3) shown in Figure 45～F (k+21) [k=-2].

Figure 49 is the figure with reference to the memory-aided management example of picture that is used to illustrate for the picture of such arrangement.

In Figure 49, when the coding of object picture, be kept at reference to the coded picture in the picture usefulness memory, with corresponding preserve this storage area of coded picture logical storage numbering and to this coded picture had distributed associates with reference to numbering and represent.

Here, expression picture P16, B14, B15 become the situation of object picture.Logical storage numbering (0)～(4), expression is with reference to the position in logic (storage area) in the picture usefulness memory.The value of the logical storage numbering of corresponding each storage area, in storage area, put aside to handle time picture, that be encoded (perhaps decoding) slow more, just become more little value.

Below, describe particularly.

When the coding (decoding) of picture P16, in the storage area memory-aided at the reference picture, that logical storage numbering (0)～(3) are represented, putting aside picture P13, P10, P7, P4.On this picture P13, P10, P7, P4, distribute respectively with reference to numbering [0], [1], [2], [3].

When the coding (decoding) of picture B14 and B15, in the storage area memory-aided at the reference picture, that logical storage numbering (0)～(4) are represented, putting aside picture P16, P13, P10, P7, P4.At this moment, on picture P16, distribute expression as by the mark [b] of back to the candidate screen of reference, remaining by the candidate screen P13 of forward direction reference, P10, P7, P4 on, distribute with reference to numbering [0], [1], [2], [3].

In addition, be illustrated in the information of the reference marker that is distributed on above-mentioned each candidate screen, it is the parameter of motion compensation, when the piece of object picture is encoded, will which picture in above-mentioned a plurality of candidate screen have carried out the information of using as expression, recorded and narrated in coding that should piece is listed as the reference picture.At this moment, with reference in numbering, its value is more little just distributes short more mark at this.

; in above-mentioned existing coding method, because when the piece for the B picture carried out predictive coding, I picture or P picture were designated as with reference to picture; so object picture and just elongated with reference to the distance of picture on showing time shaft (below, also be called time gap).

For example, when in the predictive coding shown in Figure 48 (b) for the piece of B picture B15, forward direction picture P13 and back are under picture P16 is designated as situation with reference to picture, as the B picture B15 of object picture be designated as with reference to the time gap Ltd between the forward direction picture P13 of picture (=t (15)-t (13)), shown in Figure 50 (a), like that, become 2 picture interval (2Pitv).

In addition, when in predictive coding shown in Figure 48 (b), for the piece of B picture B15, forward direction picture P13 and P10 are designated as under the situation with reference to picture, as the B picture B15 of object picture be designated as with reference to the time gap Ltd between the forward direction picture P10 of picture (=t (15)-t (10)), shown in Figure 50 (b), like that, become 5 picture interval (5Pitv).

Especially when between I picture and P picture, perhaps the number of the B picture that is inserted between two of adjacency P pictures becomes under the many situation, object picture and then become greatly with reference to the time gap Ltd between the picture, and this just becomes significantly low reason of code efficiency.

In addition, in above-mentioned existing coding method, have can be in the B of picture mode is encoded, to the near in time picture nearby of distance object picture with reference to a plurality of back, distribution ratio is also wanted big worth situation with reference to numbering from this object picture distant place picture far away in time.

In the case, in motion detection for the piece of object picture, because situation about being referenced from the closer in time candidate screen of object picture on the probability is many, in other words, many owing to being designated as with reference to the situation of picture apart from the closer in time candidate screen of object picture, so cause the deterioration of code efficiency.

Below, just in the B mode for the piece of B picture B15 shown in Figure 51 (a) is encoded, under the situation that picture P16 and P19 are referenced, describe particularly after two.

In the case, such shown in Figure 51 (a), press picture B2, B3, P4, B5, B6, P7, B8, B9, P10, B11, B12, P13, B14, B15, P16, B17, B18, P19 that DISPLAY ORDER is arranged, changed row to become coded sequence P7, B2, B3, P10, B5, B6, P13, B8, B9, P16, B11, B12, P19, B14, the B15 shown in Figure 51 (b).

In addition, in the case, behind 3 forward direction pictures (picture P7, P10, P13) and 2 in picture (picture P16, P19), with reference to two pictures that are suitable for encoding process.Just, forward direction picture P7, P10, P13 and back be to picture P16, P19, is the candidate screen that can be designated as when the coding of the piece of picture B15 with reference to picture.Behind 3 forward direction pictures and 2, become under the situation of candidate screen like this, forward direction picture P7, P10, P13 and back are distributed with reference to numbering to picture P16, P19 to picture.

In distribution with reference to numbering for such candidate screen, on above-mentioned scramble time axle Y, apart from the near more candidate screen of picture B15 that becomes coded object, the reference numbering that the value of being assigned with is more little.Specifically, be exactly such shown in Figure 51 (b), on picture P19, P16, P13, P10, P7, distribute with reference to numbering [0], [1], [2], [3], [4].

; in the case, showing on the time shaft X the value [1] that is assigned with apart from the near P picture P16 of object picture (picture B15) with reference to numbering; just, just cause the deterioration of code efficiency than big from value [0] with reference to numbering as the B picture B15 of object picture P picture P19 far away.

The present invention finishes in order to solve problem points as described above, purpose provides, the low dynamic image encoding method that can avoid the code efficiency that causes by the object picture with reference to the time gap length between the picture, and corresponding to the dynamic image decoding method of the low dynamic image encoding method that can avoid code efficiency like this.

In addition, the purpose of this invention is to provide, to the candidate screen that in predictive coding is handled, can be referenced, the deterioration ground that can not cause code efficiency distributes the dynamic image encoding method with reference to numbering, and corresponding to the dynamic image decoding method of the dynamic image encoding method of the deterioration that can avoid code efficiency like this.

Summary of the invention

Dynamic image encoding method related to the present invention, be that a kind of a plurality of pictures the formation moving image are divided into a plurality of respectively, dynamic image encoding method by each piece is encoded to each picture is characterized in that: comprise the coding step that the piece of the object picture that becomes coded object is carried out predictive coding with reference to coded picture; Above-mentioned coding step is when coded picture has carried out the B picture of predictive coding of this piece with reference to two at the object picture, with reference to the B picture of having encoded the piece of this object picture is carried out predictive coding.

Above-mentioned dynamic image encoding method of the present invention, it is characterized in that: above-mentioned coding step, when the object picture is the B picture, the B picture that reference has been encoded carries out predictive coding to the piece of this object picture, at the object picture is when coded picture has carried out the P picture of predictive coding of this piece with reference to one, with reference to the B picture of having encoded each piece of this object picture is not carried out predictive coding.

Above-mentioned dynamic image encoding method of the present invention, it is characterized in that: a plurality of pictures that constitute above-mentioned moving image, respectively in above-mentioned coding step as the I picture that does not carry out the coding of this piece with reference to coded picture, with reference to the coded picture P picture that carries out the predictive coding of this piece, with with reference to two coded picture arbitrary picture of B picture of carrying out the predictive coding of this piece be carried out coding, above-mentioned coding step, when the object picture is the B picture, the B picture that reference has been encoded carries out predictive coding to the piece of this object picture, and the candidate number with reference to picture of reference will encode this object picture as the B picture time, be made as below the candidate number with reference to picture of reference when this object picture encoded as the P picture.

Above-mentioned dynamic image encoding method of the present invention, it is characterized in that: a plurality of pictures that constitute above-mentioned moving image, respectively in above-mentioned coding step as the I picture that does not carry out the coding of this piece with reference to coded picture, with reference to the coded picture P picture that carries out the predictive coding of this piece, with with reference to two coded picture arbitrary picture of B picture of carrying out the predictive coding of this piece be carried out coding, above-mentioned coding step, when the object picture is the B picture, the B picture that the piece of this object picture is carried out the reference of predictive coding time institute, just this object picture and relatively this object picture showing on the time shaft at other recently I or the B picture between the P picture.

Above-mentioned dynamic image encoding method of the present invention, it is characterized in that: above-mentioned coding step, when the object picture is the B picture, the B picture that reference has been encoded carries out predictive coding to the piece of this object picture, simultaneously with the B picture of having encoded of this reference, expression shows the picture position information of the position on the time shaft, is included in by in the resulting code sequence of the coding of the picture that constitutes above-mentioned moving image.

Above-mentioned dynamic image encoding method of the present invention, it is characterized in that: above-mentioned picture position information, by the B picture of having encoded from above-mentioned object picture to time institute's reference of encoding at it, show that the distance on the time shaft is near more, the just short more code of code length is represented.

Above-mentioned dynamic image encoding method of the present invention, it is characterized in that: above-mentioned coding step, when the object picture is the B picture, the B picture that reference has been encoded carries out predictive coding to the piece of this object picture, in by the resulting code sequence of the coding of the picture that constitutes above-mentioned moving image, comprise as heading message and to be illustrated in when encoding with reference to the information of the B picture situation of having encoded as the B picture of above-mentioned object picture.

Dynamic image encoding method related to the present invention, be that a kind of a plurality of pictures the formation moving image are divided into a plurality of respectively, the dynamic image encoding method of each picture being encoded by each piece, it is characterized in that: comprise reference at least, with reference to the coded picture P picture that carries out the predictive coding of this piece, with with reference to two coded picture B pictures of carrying out the predictive coding of this piece, the coding step that the object picture that becomes coded object is carried out predictive coding; Above-mentioned coding step, be positioned at this object picture reference pictures of having encoded nearby with use, be positioned at the direct mode of motion vector of the reference block of the position relatively identical with this object piece, when encoding, with reference to coded picture according to certain rule determined as the object piece that becomes coded object of the B picture of object picture.

Above-mentioned dynamic image encoding method of the present invention is characterized in that: above-mentioned coding step when with direct mode above-mentioned object piece being encoded, with reference to being positioned near before the above-mentioned object picture, shows this object picture of time ratio first picture early.

Above-mentioned dynamic image encoding method of the present invention, it is characterized in that: the reference pictures of having encoded that comprises the said reference piece, be to show the slow backward reference P picture of the above-mentioned object picture of time ratio, above-mentioned coding step, big or small MVR based on the motion vector of said reference piece, above-mentioned backward reference P picture and second picture of the coding time institute reference of this reference block showing on the time shaft apart from TRD, above-mentioned object picture and above-mentioned first picture show on the time shaft apart from TRF, above-mentioned object picture and above-mentioned second picture show on the time shaft apart from TRB, the place ahead of obtaining above-mentioned object piece is to motion vector (MVR * TRF/TRD), with the rear to motion vector ((TRB-TRD) * MVR/TRD), and use this place ahead to carry out bi-directional predicted to motion vector to motion vector and this rear.

Above-mentioned dynamic image encoding method of the present invention, it is characterized in that: above-mentioned coding step, when above-mentioned object piece being encoded with direct mode, with reference to be positioned at above-mentioned object picture the most nearby, show this object picture of the time ratio forward direction of coding picture early, and with reference to be positioned at above-mentioned object picture the most nearby, show behind the slow coding of this object picture of time ratio to picture, carry out motion vector with above-mentioned object piece be made as 0 bi-directional predicted.

Above-mentioned dynamic image encoding method of the present invention, it is characterized in that: above-mentioned coding step, when above-mentioned object piece being encoded, economize the whereabouts prediction error information and be the image information of 0 object piece, the insertion of the code sequence of corresponding above-mentioned moving image with direct mode.

Above-mentioned dynamic image encoding method of the present invention is characterized in that: above-mentioned coding step is 0 o'clock in the prediction error information of above-mentioned object piece, economizes the image information of this object piece of whereabouts, the insertion in the code sequence of corresponding above-mentioned moving image.

Above-mentioned dynamic image encoding method of the present invention, it is characterized in that: above-mentioned coding step, picture to the candidate that becomes the picture that carries out reference when the coding of object picture, distribution is numbered with reference to picture, when the object piece being encoded, with reference to being assigned with specific picture with reference to the picture numbering with direct mode.

Above-mentioned dynamic image encoding method of the present invention, it is characterized in that: above-mentioned coding step, near the picture before the object picture, be only as under the situation with reference to the picture of the candidate of picture when the coding of object picture, when the coding of object picture, carry out in the candidate screen of reference, to near the picture that is positioned at the place ahead of this object picture beyond the picture before this object picture, distribute above-mentioned specific numbering with reference to picture.

Above-mentioned dynamic image encoding method of the present invention, it is characterized in that: above-mentioned coding step, when the coding of object picture, carry out in the candidate screen of reference, to showing this object picture of time ratio early, beyond the picture before this object picture, the candidate screen of the most close this object picture is distributed above-mentioned specific numbering with reference to picture.

Above-mentioned dynamic image encoding method of the present invention, it is characterized in that: the reference pictures of having encoded that comprises the said reference piece, be to show the slow backward reference P picture of the above-mentioned object picture of time ratio, above-mentioned coding step, when the object piece being encoded with direct mode, with reference in the coding time institute reference of said reference piece, show this object picture of time ratio first forward direction picture early.

Above-mentioned dynamic image encoding method of the present invention, it is characterized in that: above-mentioned coding step, when above-mentioned object piece being encoded with direct mode, with reference to being positioned near showing this object picture of time ratio object picture early second forward direction picture before, big or small MVR based on the motion vector of said reference piece, above-mentioned backward reference P picture and the above-mentioned first forward direction picture show on the time shaft apart from TRD, above-mentioned object picture and the above-mentioned second forward direction picture show on the time shaft apart from TRF, above-mentioned object picture and the above-mentioned first forward direction picture show on the time shaft apart from TRB, (MVR * TRF/TRD) and rear are to motion vector ((TRB-TRD) * MVR/TRD) to motion vector to obtain the place ahead of motion vector of above-mentioned object piece.

Above-mentioned dynamic image encoding method of the present invention, it is characterized in that: above-mentioned coding step, when above-mentioned object piece being encoded with direct mode, showing the above-mentioned object picture of the time ratio forward direction picture for the treatment of reference early, be not present in maintenance with reference under the situation in the memory of picture, with reference to showing the above-mentioned object picture of time ratio early, the picture of the most close this object picture.

Dynamic image encoding method related to the present invention, be that a kind of a plurality of pictures to the formation moving image are encoded respectively, generation is characterized in that: comprise the coding step of the object picture that becomes coded object being encoded with reference to the picture of having encoded the dynamic image encoding method of code sequence that should each picture; Above-mentioned coding step comprises, a plurality of to as in the candidate of the picture of the coding time institute reference of above-mentioned object picture with reference to candidate screen, the near more picture of demonstration time of its demonstration time and this coded object picture, the numbering allocation step that apportioning cost is more little with reference to the picture numbering; With will be assigned with at the picture of the coding time institute reference of above-mentioned object picture with reference to the picture numbering, be additional to the numbering additional step of above-mentioned code sequence.

Dynamic image encoding method related to the present invention, be that a kind of a plurality of pictures to the formation moving image are encoded respectively, generation is characterized in that the dynamic image encoding method of code sequence that should each picture: comprise the coding step of the object picture that becomes the encoding process object being encoded with reference to the picture of encoding process; Above-mentioned coding step is recorded and narrated in above-mentioned code sequence, represents the sign whether above-mentioned object picture uses as the candidate of reference picture for the encoding process of other later pictures of this object picture the time.

Dynamic image decoding method related to the present invention, be a kind of respectively to constituting a plurality of pictures of moving image, decode by each piece as the processing unit of this picture, to be transformed into the dynamic image decoding method of view data to code sequence that should each picture, it is characterized in that: comprise with reference to the piece of decoded picture to the object picture that becomes decoder object, carry out the decoding step of prediction decoding, above-mentioned decoding step, at the object picture is when decoded picture has been carried out the B picture of prediction decoding of this piece with reference to two, with reference to decoded B picture the piece of this object picture is carried out prediction decoding.

Above-mentioned dynamic image decoding method of the present invention, it is characterized in that: above-mentioned decoding step, when the object picture is the B picture, the decoded B picture of reference carries out prediction decoding to the piece of this object picture, at the object picture is when decoded picture has been carried out the P picture of prediction decoding of this piece with reference to one, with reference to decoded B picture each piece of this object picture is not carried out prediction decoding.

Above-mentioned dynamic image decoding method of the present invention, it is characterized in that: a plurality of pictures that constitute above-mentioned moving image, respectively in above-mentioned decoding step as the I picture that does not carry out the decoding of this piece with reference to decoded picture, with reference to one decoded picture carry out the P picture of the prediction decoding of this piece, with with reference to two decoded picture arbitrary picture of B picture of carrying out the prediction decoding of this piece be carried out decoding, above-mentioned decoding step, when the object picture is the B picture, the decoded B picture of reference carries out prediction decoding to the piece of this object picture, and the candidate number with reference to picture of reference will decode this object picture as the B picture time, be made as below the candidate number with reference to picture of reference when this object picture decoded as the P picture.

Above-mentioned dynamic image decoding method of the present invention, it is characterized in that: a plurality of pictures that constitute above-mentioned moving image, respectively in above-mentioned decoding step as the I picture that does not carry out the decoding of this piece with reference to decoded picture, with reference to one decoded picture carry out the P picture of the prediction decoding of this piece, with with reference to two decoded picture arbitrary picture of B picture of carrying out the prediction decoding of this piece be carried out decoding, above-mentioned decoding step, when the object picture is the B picture, the B picture that the piece of this object picture is carried out the reference of prediction decoding time institute, just this object picture and relatively this object picture showing on the time shaft at other recently I or the B picture between the P picture.

Above-mentioned dynamic image decoding method of the present invention, it is characterized in that: above-mentioned decoding step, when the object picture is the B picture, based on what in above-mentioned code sequence, comprised, above-mentioned decoded B picture, be illustrated in the picture position information that shows the position on the time shaft, carry out the piece of this object picture being carried out the processing of prediction decoding with reference to decoded B picture.

Above-mentioned dynamic image decoding method of the present invention, it is characterized in that: above-mentioned picture position information, by decoded B picture from above-mentioned object picture to time institute's reference of decoding at it, show that the distance on the time shaft is near more, the just short more code of code length is represented.

Above-mentioned dynamic image decoding method of the present invention, it is characterized in that: above-mentioned decoding step, when the object picture is the B picture, comprised in the code sequence based on the picture that constitutes above-mentioned moving image in correspondence, be illustrated in when encoding with reference to the heading message of the B picture situation of having encoded, carry out the piece of this object picture being carried out the processing of prediction decoding with reference to decoded B picture as the B picture of above-mentioned object picture.

Dynamic image decoding method related to the present invention, be a kind of respectively to constituting a plurality of pictures of moving image, decode by each piece of processing unit as this picture, to be transformed into the dynamic image decoding method of view data to code sequence that should each picture, it is characterized in that: comprise reference at least, with reference to one decoded picture carry out the P picture of the prediction decoding of this piece, with with reference to two decoded picture carry out the B picture of the prediction decoding of this piece, the object picture that becomes decoder object is carried out the decoding step of prediction decoding; Above-mentioned decoding step, be positioned at this object picture decoded reference pictures nearby with use, be positioned at the direct mode of motion vector of the reference block of the position relatively identical with this object piece, when decoding, with reference to decoded picture according to certain rule determined as the object piece that becomes decoder object of the B picture of object picture.

Above-mentioned dynamic image decoding method of the present invention is characterized in that: above-mentioned decoding step when with direct mode above-mentioned object piece being decoded, with reference to being positioned near before the above-mentioned object picture, shows this object picture of time ratio first picture early.

Above-mentioned dynamic image decoding method of the present invention, it is characterized in that: the decoded reference pictures that comprises the said reference piece, be to show the slow backward reference P picture of the above-mentioned object picture of time ratio, above-mentioned decoding step, big or small MVR based on the motion vector of said reference piece, above-mentioned backward reference P picture and second picture of the decoding time institute reference of this reference block showing on the time shaft apart from TRD, above-mentioned object picture and above-mentioned first picture show on the time shaft apart from TRF, above-mentioned object picture and above-mentioned second picture show on the time shaft apart from TRB, (MVR * TRF/TRD) and rear are to motion vector ((TRB-TRD) * MVR/TRD) to motion vector in the place ahead of obtaining above-mentioned object piece.

Above-mentioned dynamic image decoding method of the present invention, it is characterized in that: above-mentioned decoding step, when above-mentioned object piece being decoded with direct mode, with reference to be positioned at above-mentioned object picture the most nearby, show this object picture of the time ratio forward direction of decoding picture early, and with reference to be positioned at above-mentioned object picture the most nearby, show after the slow decoding of this object picture of time ratio to picture, carry out motion vector with above-mentioned object piece be made as 0 bi-directional predicted.

Above-mentioned dynamic image decoding method of the present invention, it is characterized in that: above-mentioned decoding step, when above-mentioned object piece being decoded with direct mode, use the motion vector of said reference piece, to not being included in the above-mentioned code sequence, prediction error information is that the image information of 0 object piece is restored.

Above-mentioned dynamic image decoding method of the present invention is characterized in that: above-mentioned decoding step, use the motion vector of said reference piece, and to not being included in the above-mentioned code sequence, prediction error information is that the image information of 0 object piece is restored.

Above-mentioned dynamic image decoding method of the present invention, it is characterized in that: when the decoding that becomes at the object picture, carry out on the picture of candidate of picture of reference, be assigned with reference to picture and number, above-mentioned decoding step, when the object piece being decoded, with reference to being assigned with specific picture with reference to the picture numbering with direct mode.

Above-mentioned dynamic image decoding method of the present invention, it is characterized in that: near the picture before the object picture, be only as under the situation with reference to the picture of candidate when the decoding of object picture, when the decoding of this object picture, carry out in the candidate screen of reference, to be positioned at the picture in the place ahead of this object picture in addition near the picture before this object picture, be assigned above-mentioned specific numbering with reference to picture, above-mentioned decoding step, when the object piece being decoded, with reference to being assigned with above-mentioned specific picture with reference to the picture numbering with direct mode.

Above-mentioned dynamic image decoding method of the present invention, it is characterized in that: above-mentioned specific numbering with reference to picture, when the decoding of object picture, carry out in the candidate screen of reference, to showing this object picture of time ratio early, beyond the picture before this object picture, the candidate screen of the most close this object picture, distribute, above-mentioned decoding step is when decoding to the object piece with direct mode, with reference to being assigned with the above-mentioned specific picture with reference to the picture numbering.

Above-mentioned dynamic image decoding method of the present invention, it is characterized in that: the decoded reference pictures that comprises the said reference piece, be to show the slow backward reference P picture of the above-mentioned object picture of time ratio, above-mentioned decoding step, when the object piece being decoded with direct mode, with reference in the decoding time institute reference of said reference piece, show the above-mentioned object picture of the time ratio first forward direction picture early.

Above-mentioned dynamic image decoding method of the present invention, it is characterized in that: above-mentioned decoding step, when above-mentioned object piece being decoded with direct mode, with reference to being positioned near showing this object picture of time ratio object picture early second forward direction picture before, big or small MVR based on the motion vector of said reference piece, above-mentioned backward reference P picture and the above-mentioned first forward direction picture show on the time shaft apart from TRD, above-mentioned object picture and the above-mentioned second forward direction picture show on the time shaft apart from TRF, above-mentioned object picture and the above-mentioned first forward direction picture show on the time shaft apart from TRB, (MVR * TRF/TRD) and rear are to motion vector ((TRB-TRD) * MVR/TRD) to motion vector to obtain the place ahead of motion vector of above-mentioned object piece.

Above-mentioned dynamic image decoding method of the present invention, it is characterized in that: above-mentioned decoding step, when above-mentioned object piece being decoded with direct mode, showing the above-mentioned object picture of the time ratio forward direction picture for the treatment of reference early, be not present in maintenance with reference under the situation in the memory of picture, with reference to showing the above-mentioned object picture of time ratio early, the picture of the most close this object picture.

Dynamic image decoding method related to the present invention, be that a kind of a plurality of pictures to the formation moving image are decoded respectively, to be transformed into the dynamic image decoding method of view data to code sequence that should each picture, it is characterized in that: comprise the decoding step of the object picture that becomes decoder object being decoded with reference to decoded picture; Above-mentioned decoding step comprises, a plurality of to as in the candidate of the picture of the decoding time institute reference of above-mentioned object picture with reference to candidate screen, the near more picture of demonstration time of its demonstration time and this decoder object picture, the numbering allocation step that apportioning cost is more little with reference to the picture numbering; With based in the code sequence of above-mentioned object picture, being added, numbering that the picture of the coding time institute reference of above-mentioned object picture is assigned with reference to picture, and in above-mentioned numbering allocation step, be assigned to reference to candidate screen with reference to picture numbering, decide the picture of the decoding time institute reference of above-mentioned object picture with reference to the picture deciding step.

Dynamic image decoding method related to the present invention, be that a kind of a plurality of pictures to the formation moving image are decoded respectively, to be transformed into the dynamic image decoding method of view data to code sequence that should each picture, it is characterized in that: comprise the decoding step of the object picture that becomes the decoding processing object being decoded with reference to the picture of decoding processing; In above-mentioned code sequence, record and narrate the sign have the above-mentioned object picture of expression for the decoding processing of other later pictures of this object picture the time, whether to use as the candidate of reference picture; In above-mentioned decoding step,, implemented the management of the object picture of decoding processing based on above-mentioned sign.

As top, according to dynamic image encoding method related to the present invention, provide a kind of a plurality of pictures that constitute moving image are divided into a plurality of respectively, dynamic image encoding method by each piece is encoded to each picture is characterized in that: comprise the coding step that the piece of the object picture that becomes coded object is carried out predictive coding with reference to coded picture; Above-mentioned coding step, at the object picture is when coded picture has carried out the B picture of predictive coding of this piece with reference to two, the B picture that reference has been encoded carries out predictive coding to the piece of this object picture, therefore, just can when the coding of B picture, use relative this B picture forward direction the most nearby with reference to picture.Thus, just can improve the precision of prediction of the motion compensation of B picture, can seek the raising of code efficiency.

According to the present invention, above-mentioned dynamic image encoding method, it is characterized in that: above-mentioned coding step, when the object picture is the B picture, the B picture that reference has been encoded carries out predictive coding to the piece of this object picture, at the object picture is when coded picture has carried out the P picture of predictive coding of this piece with reference to one, each piece of this object picture is not carried out predictive coding with reference to the B picture of having encoded, therefore, savings becomes with reference in the memory of the picture of the candidate of picture, and it is simple that the management of candidate screen just becomes.

According to the present invention, above-mentioned dynamic image encoding method, it is characterized in that: a plurality of pictures that constitute above-mentioned moving image, respectively in above-mentioned coding step as the I picture that does not carry out the coding of this piece with reference to coded picture, with reference to the coded picture P picture that carries out the predictive coding of this piece, with with reference to two coded picture arbitrary picture of B picture of carrying out the predictive coding of this piece be carried out coding, above-mentioned coding step, when the object picture is the B picture, the B picture that reference has been encoded carries out predictive coding to the piece of this object picture, and the candidate number with reference to picture of reference will encode this object picture as the B picture time, be made as below the candidate number with reference to picture of reference when this object picture encoded as the P picture, therefore, just can avoid since when the coding of B picture with reference to other B picture, and cause putting aside increase with reference to the capacity of the memory of candidate screen.

According to the present invention, above-mentioned dynamic image encoding method, it is characterized in that: a plurality of pictures that constitute above-mentioned moving image, respectively in above-mentioned coding step as the I picture that does not carry out the coding of this piece with reference to coded picture, with reference to the coded picture P picture that carries out the predictive coding of this piece, with with reference to two coded picture arbitrary picture of B picture of carrying out the predictive coding of this piece be carried out coding, above-mentioned coding step, when the object picture is the B picture, the piece of this object picture is carried out the B picture of predictive coding time institute reference, just this object picture and relatively this object picture showing on the time shaft at other recently I or the B picture between the P picture, therefore, just can improve the precision of prediction in the motion compensation of B picture, and can seek the raising of code efficiency.

According to the present invention, above-mentioned dynamic image encoding method, it is characterized in that: above-mentioned coding step, when the object picture is the B picture, the B picture that reference has been encoded carries out predictive coding to the piece of this object picture, simultaneously with the B picture of having encoded of this reference, expression shows the picture position information of the position on the time shaft, be included in by in the resulting code sequence of the coding of the picture that constitutes above-mentioned moving image, therefore, just can detect when the coding of B picture employed with reference to candidate B picture simply in the decoding side as the reference picture.

According to the present invention, above-mentioned dynamic image encoding method, it is characterized in that: above-mentioned picture position information, by the B picture of having encoded from above-mentioned object picture to time institute's reference of encoding at it, show that the distance on the time shaft is near more, code length is represented with regard to short more code, therefore, just can lower the needed size of code of being used by the candidate screen of forward direction reference of information when the decoding side is identified in the coding of B picture.

According to the present invention, above-mentioned dynamic image encoding method, it is characterized in that: above-mentioned coding step, when the object picture is the B picture, the B picture that reference has been encoded carries out predictive coding to the piece of this object picture, in by the resulting code sequence of the coding of the picture that constitutes above-mentioned moving image, comprise as heading message and to be illustrated in when encoding with reference to the information of the B picture situation of having encoded as the B picture of above-mentioned object picture, therefore, just can be when the decoding side detects coding at the B picture simply other B picture by the situation of forward direction reference.

According to dynamic image encoding method related to the present invention, provide a kind of a plurality of pictures that constitute moving image are divided into a plurality of respectively, the dynamic image encoding method of each picture being encoded by each piece, it is characterized in that: comprise reference at least, with reference to the coded picture P picture that carries out the predictive coding of this piece, with with reference to two coded picture B pictures of carrying out the predictive coding of this piece, the coding step that the object picture that becomes coded object is carried out predictive coding; Above-mentioned coding step, be positioned at this object picture reference pictures of having encoded nearby with use, be positioned at the direct mode of motion vector of the reference block of the position relatively identical with this object piece, when encoding as the object piece that becomes coded object of the B picture of object picture, with reference to coded picture according to certain rule determined, therefore, can make the forecasting efficiency optimum according to the coding situation.

According to the present invention, above-mentioned dynamic image encoding method, it is characterized in that: above-mentioned coding step, when above-mentioned object piece being encoded with direct mode, with reference to being positioned near above-mentioned object picture before, show this object picture of time ratio first picture early, therefore, the forecasting efficiency of B picture in the coding under the direct mode improved.

According to the present invention, above-mentioned dynamic image encoding method, it is characterized in that: the reference pictures of having encoded that comprises the said reference piece, be to show the slow backward reference P picture of the above-mentioned object picture of time ratio, above-mentioned coding step, big or small MVR based on the motion vector of said reference piece, above-mentioned backward reference P picture and second picture of the coding time institute reference of this reference block showing on the time shaft apart from TRD, above-mentioned object picture and above-mentioned first picture show on the time shaft apart from TRF, above-mentioned object picture and above-mentioned second picture show on the time shaft apart from TRB, the place ahead of obtaining above-mentioned object piece is to motion vector (MVR * TRF/TRD), with the rear to motion vector ((TRB-TRD) * MVR/TRD), and use this place ahead to carry out bi-directional predicted to motion vector to motion vector and this rear, therefore, just can be created on the motion vector of the object piece that uses the direct mode well from the motion vector precision of the piece beyond the object piece.

According to the present invention, above-mentioned dynamic image encoding method, it is characterized in that: above-mentioned coding step, when above-mentioned object piece being encoded with direct mode, with reference to be positioned at above-mentioned object picture the most nearby, show this object picture of the time ratio forward direction of coding picture early, and with reference to be positioned at above-mentioned object picture the most nearby, show behind the slow coding of this object picture of time ratio to picture, carry out motion vector with above-mentioned object piece be made as 0 bi-directional predicted, therefore, at the B picture in the coding under the direct mode, just do not need the calibration of motion vector to handle, can seek alleviating for the treatment of capacity.

According to the present invention, above-mentioned dynamic image encoding method, it is characterized in that: above-mentioned coding step, when above-mentioned object piece being encoded with direct mode, economize the whereabouts prediction error information and be the image information of 0 object piece, the insertion of the code sequence of corresponding above-mentioned moving image, therefore, the reduction of size of code just becomes possibility.

According to the present invention, above-mentioned dynamic image encoding method, it is characterized in that: above-mentioned coding step, prediction error information at above-mentioned object piece is 0 o'clock, the image information of province's this object piece of whereabouts, insertion in the code sequence of corresponding above-mentioned moving image, therefore, the reduction of size of code just becomes possibility.

According to the present invention, above-mentioned dynamic image encoding method, it is characterized in that: above-mentioned coding step, picture to the candidate that becomes the picture that carries out reference when the coding of object picture, distribution is numbered with reference to picture, when with direct mode the object piece being encoded, with reference to being assigned with the specific picture with reference to the picture numbering, therefore, can make the forecasting efficiency optimum according to the coding situation.

According to the present invention, above-mentioned dynamic image encoding method, it is characterized in that: above-mentioned coding step, near the picture before the object picture, be only as under the situation with reference to the picture of the candidate of picture when the coding of object picture, when the coding of object picture, carry out in the candidate screen of reference, to be positioned at the picture in the place ahead of this object picture in addition near the picture before this object picture, distribute above-mentioned specific numbering with reference to picture, therefore, the forecasting efficiency of B picture in the coding under the direct mode improved and just become possibility.

According to the present invention, above-mentioned dynamic image encoding method, it is characterized in that: above-mentioned coding step, when the coding of object picture, carry out in the candidate screen of reference, to showing this object picture of time ratio early, beyond the picture before this object picture, the candidate screen of the most close this object picture, distribute above-mentioned specific numbering with reference to picture, therefore, the forecasting efficiency of B picture in the coding under the direct mode improved just becomes possibility.

According to the present invention, above-mentioned dynamic image encoding method, it is characterized in that: the reference pictures of having encoded that comprises the said reference piece, be to show the slow backward reference P picture of the above-mentioned object picture of time ratio, above-mentioned coding step is when encoding to the object piece with direct mode, with reference in the coding time institute reference of said reference piece, show this object picture of time ratio first forward direction picture early, therefore, the forecasting efficiency of B picture in the coding under the direct mode improved just becomes possibility.

According to the present invention, above-mentioned dynamic image encoding method, it is characterized in that: above-mentioned coding step, when above-mentioned object piece being encoded with direct mode, with reference to being positioned near showing this object picture of time ratio object picture early second forward direction picture before, big or small MVR based on the motion vector of said reference piece, above-mentioned backward reference P picture and the above-mentioned first forward direction picture show on the time shaft apart from TRD, above-mentioned object picture and the above-mentioned second forward direction picture show on the time shaft apart from TRF, above-mentioned object picture and the above-mentioned first forward direction picture show on the time shaft apart from TRB, the place ahead of motion vector of obtaining above-mentioned object piece is to motion vector (MVR * TRF/TRD), with the rear to motion vector ((TRB-TRD) * MVR/TRD), therefore, just can be created on the motion vector of the object piece that uses the direct mode well from the motion vector precision of the piece beyond the object piece.

According to the present invention, above-mentioned dynamic image encoding method, it is characterized in that: above-mentioned coding step, when above-mentioned object piece being encoded,, be not present in maintenance with reference under the situation in the memory of picture showing the above-mentioned object picture of the time ratio forward direction picture for the treatment of reference early with direct mode, with reference to showing the above-mentioned object picture of time ratio early, therefore the picture of the most close this object picture, just can be avoided the forecasting efficiency of B picture in the coding under the direct mode and reduce in a large number.

According to dynamic image encoding method related to the present invention, providing a kind of encodes respectively to a plurality of pictures that constitute moving image, generation is characterized in that: comprise the coding step of the object picture that becomes coded object being encoded with reference to the picture of having encoded the dynamic image encoding method of code sequence that should each picture; Above-mentioned coding step comprises, a plurality of to as in the candidate of the picture of the coding time institute reference of above-mentioned object picture with reference to candidate screen, the near more picture of demonstration time of its demonstration time and this coded object picture, the numbering allocation step that apportioning cost is more little with reference to the picture numbering; With numbering of will being assigned with at the picture of the coding time institute reference of above-mentioned object picture with reference to picture, be additional to the numbering additional step of above-mentioned code sequence, therefore, just can be to conduct with reference to the easiest selecteed picture of close object picture in time of picture, distribute littler numbering with reference to picture, thus, just can make size of code minimum, and seek the raising of code efficiency with reference to the picture numbering.

According to dynamic image encoding method related to the present invention, providing a kind of encodes respectively to a plurality of pictures that constitute moving image, generation is characterized in that the dynamic image encoding method of code sequence that should each picture: comprise the coding step of the object picture that becomes the encoding process object being encoded with reference to the picture of encoding process; Above-mentioned coding step, in above-mentioned code sequence, record and narrate, represent the sign whether above-mentioned object picture uses as the candidate of reference picture for the encoding process of other later pictures of this object picture the time, therefore, for example, when the coding of the B picture of handling for the enforcement bi-directional predictive coding, relative this B picture is positioned at the most nearby forward direction picture to be used as the reference picture and just becomes possibility, just can improve the precision of prediction of the motion compensation of B picture, and can seek the raising of code efficiency.

According to dynamic image decoding method related to the present invention, provide a kind of respectively to constituting a plurality of pictures of moving image, decode by each piece of processing unit as this picture, to be transformed into the dynamic image decoding method of view data to code sequence that should each picture, it is characterized in that: comprise with reference to the piece of decoded picture to the object picture that becomes decoder object, carry out the decoding step of prediction decoding, above-mentioned decoding step, at the object picture is when decoded picture has been carried out the B picture of prediction decoding of this piece with reference to two, the decoded B picture of reference carries out prediction decoding to the piece of this object picture, therefore, just the B picture can be used as the candidate screen of forward direction reference and the piece of coded B picture is correctly decoded.

According to the present invention, above-mentioned dynamic image decoding method, it is characterized in that: above-mentioned decoding step, when the object picture is the B picture, the decoded B picture of reference carries out prediction decoding to the piece of this object picture, at the object picture is when decoded picture has been carried out the P picture of prediction decoding of this piece with reference to one, the decoded B picture of reference does not carry out prediction decoding to each piece of this object picture, therefore, savings becomes with reference in the memory of the picture of the candidate of picture, and it is simple that the management of candidate screen just becomes.

According to the present invention, above-mentioned dynamic image decoding method, it is characterized in that: a plurality of pictures that constitute above-mentioned moving image, respectively in above-mentioned decoding step as the I picture that does not carry out the decoding of this piece with reference to decoded picture, with reference to one decoded picture carry out the P picture of the prediction decoding of this piece, with with reference to two decoded picture arbitrary picture of B picture of carrying out the prediction decoding of this piece be carried out decoding, above-mentioned decoding step, when the object picture is the B picture, the decoded B picture of reference carries out prediction decoding to the piece of this object picture, and the candidate number with reference to picture of reference will decode this object picture as the B picture time, be made as below the candidate number with reference to picture of reference when this object picture decoded as the P picture, therefore, just can avoid since when the decoding of B picture with reference to other B picture, and cause putting aside increase with reference to the capacity of the memory of candidate screen.

According to the present invention, above-mentioned dynamic image decoding method, it is characterized in that: a plurality of pictures that constitute above-mentioned moving image, respectively in above-mentioned decoding step as the I picture that does not carry out the decoding of this piece with reference to decoded picture, with reference to one decoded picture carry out the P picture of the prediction decoding of this piece, with with reference to two decoded picture arbitrary picture of B picture of carrying out the prediction decoding of this piece be carried out decoding, above-mentioned decoding step, when the object picture is the B picture, the piece of this object picture is carried out the B picture of prediction decoding time institute reference, just this object picture and relatively this object picture showing on the time shaft at other recently I or the B picture between the P picture, therefore, just can improve the precision of prediction in the motion compensation of B picture, and can seek the raising of code efficiency.

According to the present invention, above-mentioned dynamic image decoding method, it is characterized in that: above-mentioned decoding step, when the object picture is the B picture, based on what in above-mentioned code sequence, comprised, above-mentioned decoded B picture, be illustrated in the picture position information that shows the position on the time shaft, carry out the piece of this object picture being carried out the processing of prediction decoding with reference to decoded B picture, therefore, just can correctly differentiate when the coding of B picture employed with reference to candidate B picture in the decoding side as the reference picture.

According to the present invention, above-mentioned dynamic image decoding method, it is characterized in that: above-mentioned picture position information, by the decoded B picture from above-mentioned object picture to time institute's reference of decoding at it, show that the distance on the time shaft is near more, code length is represented with regard to short more code, therefore, just can lower the needed size of code of being used by the candidate screen of forward direction reference of information when the decoding side is identified in the coding of B picture.

According to the present invention, above-mentioned dynamic image decoding method, it is characterized in that: above-mentioned decoding step, when the object picture is the B picture, comprised in the code sequence based on the picture that constitutes above-mentioned moving image in correspondence, be illustrated in when encoding with reference to the heading message of the B picture situation of having encoded as the B picture of above-mentioned object picture, carry out the piece of this object picture being carried out the processing of prediction decoding with reference to decoded B picture, therefore, just can be in handling for the prediction decoding of object piece, the B picture of reliably and promptly differentiating when the coding of B picture other is by the situation of forward direction reference.

According to dynamic image decoding method related to the present invention, provide a kind of respectively to constituting a plurality of pictures of moving image, decode by each piece of processing unit as this picture, to be transformed into the dynamic image decoding method of view data to code sequence that should each picture, it is characterized in that: comprise reference at least, with reference to one decoded picture carry out the P picture of the prediction decoding of this piece, with with reference to two decoded picture carry out the B picture of the prediction decoding of this piece, the object picture that becomes decoder object is carried out the decoding step of prediction decoding; Above-mentioned decoding step, be positioned at this object picture decoded reference pictures nearby with use, be positioned at the direct mode of motion vector of the reference block of the position relatively identical with this object piece, when decoding as the object piece that becomes decoder object of the B picture of object picture, with reference to decoded picture according to certain rule determined, therefore, just can realize corresponding to the coding/decoding method that can make the coding method of forecasting efficiency optimum according to the coding situation.

According to the present invention, above-mentioned dynamic image decoding method, it is characterized in that: above-mentioned decoding step, when above-mentioned object piece being decoded with direct mode, with reference to being positioned near above-mentioned object picture before, show this object picture of time ratio first picture early, therefore, the forecasting efficiency of B picture in the decoding under the direct mode improved.

According to the present invention, above-mentioned dynamic image decoding method, it is characterized in that: the decoded reference pictures that comprises the said reference piece, be to show the slow backward reference P picture of the above-mentioned object picture of time ratio, above-mentioned decoding step, big or small MVR based on the motion vector of said reference piece, above-mentioned backward reference P picture and second picture of the decoding time institute reference of this reference block showing on the time shaft apart from TRD, above-mentioned object picture and above-mentioned first picture show on the time shaft apart from TRF, above-mentioned object picture and above-mentioned second picture show on the time shaft apart from TRB, the place ahead of obtaining above-mentioned object piece is to motion vector (MVR * TRF/TRD), with the rear to motion vector ((TRB-TRD) * MVR/TRD), therefore, just can be created on the motion vector of the object piece that uses the direct mode well from the motion vector precision of the piece beyond the object piece.

According to the present invention, above-mentioned dynamic image decoding method, it is characterized in that: above-mentioned decoding step, when above-mentioned object piece being decoded with direct mode, with reference to be positioned at above-mentioned object picture the most nearby, show this object picture of the time ratio forward direction of decoding picture early, and with reference to be positioned at above-mentioned object picture the most nearby, show after the slow decoding of this object picture of time ratio to picture, carry out motion vector with above-mentioned object piece be made as 0 bi-directional predicted, therefore, at the B picture in the decoding under the direct mode, just do not need the calibration of motion vector to handle, can seek alleviating for the treatment of capacity.

According to the present invention, above-mentioned dynamic image decoding method, it is characterized in that: above-mentioned decoding step, when above-mentioned object piece being decoded, use the motion vector of said reference piece with direct mode, to not being included in the above-mentioned code sequence, prediction error information is that the image information of 0 object piece is restored, and therefore, just can use the motion vector of other pieces, to not being included in the code sequence, prediction error information is that 0 object piece carries out prediction decoding.

According to the present invention, above-mentioned dynamic image decoding method, it is characterized in that: above-mentioned decoding step, use the motion vector of said reference piece, to not being included in the above-mentioned code sequence, prediction error information is that the image information of 0 object piece is restored, therefore, just can use the motion vector of other pieces, to not being included in the code sequence, prediction error information is that 0 object piece carries out prediction decoding.

According to the present invention, above-mentioned dynamic image decoding method, it is characterized in that: when the decoding that becomes at the object picture, carry out on the picture of candidate of picture of reference, be assigned with reference to picture and number, above-mentioned decoding step is when decoding to the object piece with direct mode, with reference to being assigned with the specific picture with reference to the picture numbering, therefore, just can realize corresponding to the coding/decoding method that can make the coding method of forecasting efficiency optimum according to the coding situation.

According to the present invention, above-mentioned dynamic image decoding method, it is characterized in that: near the picture before the object picture, be only as under the situation with reference to the picture of candidate when the decoding of object picture, when the decoding of this object picture, carry out in the candidate screen of reference, to be positioned at the picture in the place ahead of this object picture in addition near the picture before this object picture, be assigned above-mentioned specific numbering with reference to picture, above-mentioned decoding step, when the object piece being decoded with direct mode, with reference to being assigned with the above-mentioned specific picture with reference to the picture numbering, therefore, the forecasting efficiency of B picture in the decoding under the direct mode improved just becomes possibility.

According to the present invention, above-mentioned dynamic image decoding method, it is characterized in that: above-mentioned specific numbering with reference to picture, when the decoding of object picture, carry out in the candidate screen of reference, to showing this object picture of time ratio early, beyond the picture before this object picture, the candidate screen of the most close this object picture, distribute, above-mentioned decoding step is when decoding to the object piece with direct mode, with reference to being assigned with the above-mentioned specific picture with reference to the picture numbering, therefore, the forecasting efficiency of B picture in the decoding under the direct mode improved and just become possibility.

According to the present invention, above-mentioned dynamic image decoding method, it is characterized in that: the decoded reference pictures that comprises the said reference piece, be to show the slow backward reference P picture of the above-mentioned object picture of time ratio, above-mentioned decoding step is when decoding to the object piece with direct mode, with reference in the decoding time institute reference of said reference piece, show the above-mentioned object picture of the time ratio first forward direction picture early, therefore, the forecasting efficiency of B picture in the decoding under the direct mode improved just becomes possibility.

According to the present invention, above-mentioned dynamic image decoding method, it is characterized in that: above-mentioned decoding step, when above-mentioned object piece being decoded with direct mode, with reference to being positioned near showing this object picture of time ratio object picture early second forward direction picture before, big or small MVR based on the motion vector of said reference piece, above-mentioned backward reference P picture and the above-mentioned first forward direction picture show on the time shaft apart from TRD, above-mentioned object picture and the above-mentioned second forward direction picture show on the time shaft apart from TRF, above-mentioned object picture and the above-mentioned first forward direction picture show on the time shaft apart from TRB, the place ahead of motion vector of obtaining above-mentioned object piece is to motion vector (MVR * TRF/TRD), with the rear to motion vector ((TRB-TRD) * MVR/TRD), therefore, just can be created on the motion vector of the object piece that uses the direct mode well from the motion vector precision of the piece beyond the object piece.

According to the present invention, above-mentioned dynamic image decoding method, it is characterized in that: above-mentioned decoding step, when above-mentioned object piece being decoded,, be not present in maintenance with reference under the situation in the memory of picture showing the above-mentioned object picture of the time ratio forward direction picture for the treatment of reference early with direct mode, with reference to showing the above-mentioned object picture of time ratio early, therefore the picture of the most close this object picture, just can be avoided the forecasting efficiency of B picture in the decoding under the direct mode and reduce in a large number.

According to dynamic image decoding method related to the present invention, providing a kind of decodes respectively to a plurality of pictures that constitute moving image, to be transformed into the dynamic image decoding method of view data to code sequence that should each picture, it is characterized in that: comprise the decoding step of the object picture that becomes decoder object being decoded with reference to decoded picture; Above-mentioned decoding step comprises, a plurality of to as in the candidate of the picture of the decoding time institute reference of above-mentioned object picture with reference to candidate screen, the near more picture of demonstration time of its demonstration time and this decoder object picture, the numbering allocation step that apportioning cost is more little with reference to the picture numbering; With based in the code sequence of above-mentioned object picture, being added, numbering that the picture of the coding time institute reference of above-mentioned object picture is assigned with reference to picture, reach and in above-mentioned numbering allocation step, be assigned to numbering with reference to candidate screen with reference to picture, decide the picture of the decoding time institute reference of above-mentioned object picture with reference to the picture deciding step, therefore, just can correctly decode, by distributing the littler high code sequence that coding method generated of code efficiency to the easiest to be selecteed in time near the picture of object picture with reference to the picture numbering.

According to dynamic image decoding method related to the present invention, providing a kind of decodes respectively to a plurality of pictures that constitute moving image, to be transformed into the dynamic image decoding method of view data to code sequence that should each picture, it is characterized in that: comprise the decoding step of the object picture that becomes the decoding processing object being decoded with reference to the picture of decoding processing; In above-mentioned code sequence, record and narrate the sign have the above-mentioned object picture of expression for the decoding processing of other later pictures of this object picture the time, whether to use as the candidate of reference picture, in above-mentioned decoding step, based on above-mentioned sign, implemented the management of the object picture of decoding processing, therefore, just can correctly decode, as forward direction with reference to picture, except that the P picture of having implemented the forward predictive coded processing, also use and implemented that B picture that bi-directional predictive coding handles generated, the code sequence of corresponding B picture.

Description of drawings

Fig. 1 is the block diagram that explanation utilizes the dynamic image encoding device of form of implementation 1 of the present invention.

Fig. 2 is the schematic diagram that explanation utilizes the dynamic image encoding method of form of implementation 1 of the present invention, the arrangement of the DISPLAY ORDER of Fig. 2 (a) expression picture, the arrangement of the coded sequence of Fig. 2 (b) expression picture.

Fig. 3 is the schematic diagram of the moving image decoding apparatus of explanation dynamic image encoding device of form of implementation 1 and form of implementation 2, represents the P in the diode-capacitor storage in the lump, the method for B picture.

Fig. 4 is the key diagram of form of implementation 1, the 1st example (Fig. 4 (a)) and the 2nd example (Fig. 4 (b)) of expression direct mode coding (picture B11).

Fig. 5 is the schematic diagram of form of implementation 1, the 3rd example (Fig. 5 (a)) and the 4th example (Fig. 5 (b)) of expression direct mode coding (picture B11).

Fig. 6 is the key diagram of form of implementation 1, the 5th example (Fig. 6 (a)), skipped blocks (Fig. 6 (b)) and the jump identifier (Fig. 6 (c)) of expression direct mode coding (picture B11).

Fig. 7 is the key diagram of form of implementation 1, the 1st example (Fig. 7 (a)) and the 2nd example (Fig. 7 (b)) of expression direct mode coding (picture B12).

Fig. 8 is the key diagram of form of implementation 1, the 3rd example (Fig. 8 (a)) and the 4th example (Fig. 8 (b)) of expression direct mode coding (picture B12).

Fig. 9 is the key diagram of form of implementation 1, the 1st and the 2nd example (Fig. 9 (a), Fig. 9 (b)) of the B picture more on the front of expression reference forward direction P picture the most nearby.

Figure 10 is the key diagram of form of implementation 1, and expression is not with reference to the 1st and the 2nd example (Figure 10 (a), Figure 10 (b)) of the B picture more on the front of the most nearby forward direction I picture or P picture.

Figure 11 is the key diagram of form of implementation 1 and 2, the 1st method that expression separately manages the P picture in the memory and B picture.

Figure 12 is the key diagram of form of implementation 1 and 2, the 2nd method that expression separately manages the P picture in the memory and B picture.

Figure 13 is the key diagram of form of implementation 1 and 2, the 3rd method that expression separately manages the P picture in the memory and B picture.

Figure 14 is the key diagram of form of implementation 1 and 2, the 4th method that expression separately manages the P picture in the memory and B picture.

Figure 15 is the block diagram that explanation utilizes the moving image decoding apparatus of form of implementation 2 of the present invention to use.

Figure 16 is the schematic diagram that explanation utilizes the dynamic image decoding method of form of implementation 2 of the present invention, the arrangement of the decoding order of Figure 16 (a) expression picture, the arrangement of the DISPLAY ORDER of Figure 16 (b) expression picture.

Figure 17 is the key diagram of form of implementation 2, represents bi-directional predicted decoding (picture B11).

Figure 18 is the key diagram of form of implementation 2, the 1st example (Figure 18 (a)) and the 2nd example (Figure 18 (b)) of expression direct mode decoding (picture B11).

Figure 19 is the key diagram of form of implementation 2, the 3rd example (Figure 19 (a)) and the 4th example (Figure 19 (b)) of expression direct mode decoding (picture B11).

Figure 20 is the key diagram of form of implementation 2, represents bi-directional predicted decoding (picture B12).

Figure 21 is the key diagram of form of implementation 2, the 1st example (Figure 21 (a)) and the 2nd example (Figure 21 (b)) of expression direct mode decoding (picture B12).

Figure 22 is the key diagram of form of implementation 2, the 3rd example (Figure 22 (a)) and the 4th example (Figure 22 (b)) of expression direct mode decoding (picture B12).

Figure 23 is the block diagram that explanation utilizes the dynamic image encoding device of form of implementation 3 of the present invention to use.

Figure 24 is the schematic diagram of dynamic image encoding device of explanation form of implementation 3, represents the P in the diode-capacitor storage in the lump, the method for B picture.

Figure 25 is the key diagram of above-mentioned form of implementation 3, and the situation (Figure 25 (b)) near the decoding of the situation (Figure 25 (a)) of the decoding of the B picture after the P picture and the picture be not scheduled to is not carried out in expression.

Figure 26 is the block diagram that explanation utilizes the moving image decoding apparatus of form of implementation 4 of the present invention.

Figure 27 is the block diagram that explanation utilizes the dynamic image encoding device of form of implementation 5 of the present invention.

Figure 28 is the key diagram of form of implementation 5, expression memory-aided management method of picture and the distribution method of numbering with reference to picture.

Figure 29 is the key diagram of form of implementation 5, and the picture of expression DISPLAY ORDER is arranged the picture of (Figure 29 (a)) and coded sequence and arranged (Figure 29 (b)).

Figure 30 is the key diagram of form of implementation 5, expression memory-aided management method of picture and the distribution method of numbering with reference to picture.

Figure 31 is the key diagram of form of implementation 5, expression use two systems with reference under the situation of picture numbering, the data structure of the code sequence of corresponding blocks.

Figure 32 is the block diagram that explanation utilizes the moving image decoding apparatus of form of implementation 6 of the present invention to use.

Figure 33 is the block diagram that explanation utilizes the dynamic image encoding device of form of implementation 7 of the present invention.

Figure 34 is the schematic diagram that explanation utilizes the dynamic image encoding method of form of implementation 7 of the present invention, the arrangement of the DISPLAY ORDER of Figure 34 (a) expression picture, the arrangement of the coded sequence of Figure 34 (b) expression picture.

Figure 35 is the block diagram that explanation utilizes the moving image decoding apparatus of form of implementation 8 of the present invention.

Figure 36 is the schematic diagram that explanation utilizes the dynamic image encoding method of form of implementation 7 of the present invention, the arrangement of the decoding order of Figure 36 (a) expression picture, the arrangement of the DISPLAY ORDER of Figure 36 (b) expression picture.

Figure 37 is the key diagram of form of implementation 8, the memory-aided management method of expression picture.

To be expression realize the storage medium (Figure 38 (a), Figure 38 (b)) of program of the device of each form of implementation and the figure that uses the computer system (Figure 38 (c)) of storage medium by software to Figure 38.

Figure 39 is the figure of the application example of explanation dynamic image encoding method of above-mentioned each form of implementation and dynamic image decoding method, and expression realizes the content provider system of content converting service.

Figure 40 is the figure that explanation has utilized the portable phone of the dynamic image encoding method of above-mentioned each form of implementation and dynamic image decoding method.

Figure 41 is the block diagram of the detailed structure of expression portable phone shown in Figure 40.

Figure 42 is that expression has utilized the concept map of the digital broadcasting of the dynamic image encoding device of above-mentioned each form of implementation and moving image decoding apparatus with system.

Figure 43 is the key diagram of existing dynamic image encoding method, and expression constitutes the arrangement (Figure 43 (a)) of the picture of moving image, distinguishes the picture bar (Figure 43 (b)) and the macro block (Figure 43 (c)) of picture.

Figure 44 is the figure of usefulness of the coded data of the general moving image of explanation, and expression is to the encode structure of resulting stream of each picture that constitutes moving image.

Figure 45 is the figure of the moving image encoding mode of explanation existing MPEG etc., indicated object picture and relation at the picture of the coding time institute reference of this object picture.

Figure 46 is the key diagram of existing direct mode coding, is illustrated in the motion vector (Figure 46 (a)) that uses in the direct mode and for the relative position (Figure 46 (b)) of the piece of picture.

Figure 47 is the key diagram of existing distribution method with reference to picture numbering, and expression distributes (Figure 47 (a), Figure 47 (b)) for the numbering of carrying out the candidate screen of reference when the coding of P picture, B picture.

Figure 48 is the key diagram of existing dynamic image encoding method, the arrangement (Figure 48 (a)) of the DISPLAY ORDER of the picture of expression formation moving image, and the arrangement of coded sequence (Figure 48 (b)).

Figure 49 is the key diagram of existing dynamic image encoding method, and expression is routine with reference to the memory-aided management of picture for the picture of the arrangement of above-mentioned coded sequence.

Figure 50 is the figure of the problem points of the existing inter-picture prediction coding method of expression, is illustrated in situation (Figure 50 (a)) of carrying out two-way reference and the situation (Figure 50 (b)) of two pictures being carried out the rear reference.

Figure 51 is the figure of the problem points of the existing distribution method with reference to picture numbering of expression, the arrangement (Figure 51 (b)) of the arrangement (Figure 51 (a)) of the picture of expression DISPLAY ORDER and the picture of coded sequence.

Embodiment

Below, form of implementation of the present invention is described.

(form of implementation 1)

Fig. 1 is the block diagram that explanation utilizes the dynamic image encoding device of form of implementation 1 of the present invention to use.

The dynamic image encoding device 10 of this form of implementation 1 is divided into fixing data processing unit (piece) to a plurality of pictures that constitute moving image respectively, by each piece the view data of each picture is encoded.

Promptly, this dynamic image encoding device 10, view data (input data) Id with picture that storage imports, simultaneously the input picture of the data I d that is stored by the output of each piece with memory (below, also be called frame memory) 101, to export from above-mentioned frame memory 101, become the differential data of the prediction data Pd of the view data Md of object piece of coded object and this object piece, calculus of differences unit 102 that calculates as the prediction error data PEd of object piece and the coded prediction error unit 103 that the view data Md or the prediction error data PEd of above-mentioned object piece carried out compressed encoding.In above-mentioned frame memory 101,, carry out the processing that coded sequence by picture changes the view data of the picture that row imports by DISPLAY ORDER based on the relation of the picture (with reference to picture) of object picture and its predictive coding time institute reference.

Dynamic image encoding device 10, dateout (coded data) Ed that has above-mentioned coded prediction error unit 103 expands decoding, and the predicated error decoding unit 105 of the decoding differential data PDd of object output piece, the decoding differential data PDd of this object piece of addition and the prediction data Pd of above-mentioned object piece, and the add operation unit 106 of the decoded data Dd of object output piece, with write down this decoded data Dd based on memory control signal Cd2, and with the decoded data Dd that stored as the data Rd in the candidate (candidate screen) of the picture of the coding time institute reference of object piece export with reference to picture with memory (below, also be called frame memory) 117.

Dynamic image encoding device 10, have dateout (view data of the object piece) Md based on above-mentioned frame memory 101 and dateout (data of the candidate screen) Rd of frame memory 117, the motion vector detecting unit 108 of the motion vector MV of detected object piece, with based on the motion vector MV of this object piece and dateout Md, the Rd of above-mentioned each frame memory 101,117, the coded system of decision corresponding objects piece, the mode selected cell 109 of output switch control signal Cs2 simultaneously.In above-mentioned motion vector detecting unit 108,, detect the motion detection of above-mentioned motion vector with reference to a plurality of candidate screen that can reference when the predictive coding of object piece.In addition, in aforesaid way selected cell 109,, from a plurality of coded systems, select a coded system so that code efficiency becomes optimum to above-mentioned object piece.At this moment, under inter-picture prediction is encoded selecteed situation, from selecting best picture a plurality of candidate screen of reference.

In the dynamic image encoding device 10 of this form of implementation 1, for the P picture (just, when the predictive coding of a piece, with reference to the picture of a picture of having encoded), select coded system in the picture, use the inter-picture prediction coded system of motion vector and do not use in the inter-picture prediction coded system of motion vector (just motion vector being made as 0) one.In addition, for the B picture (just, when the predictive coding of a piece, picture with reference to two pictures of having encoded), in coded system, the inter-picture prediction coded system of using forward motion vector, the inter-picture prediction coded system of using backward motion vector, the inter-picture prediction coded system of using bi-directional motion vector and the direct mode in the selection picture.In addition, in this form of implementation 1, when the piece of above-mentioned B picture being encoded, with reference to showing on the time shaft near the coded picture before the object picture with direct mode.

Dynamic image encoding device 10 has the selector switch 111 that is arranged between above-mentioned frame memory 101 and the calculus of differences unit 102, be arranged on the selector switch 112 between calculus of differences unit 102 and the coded prediction error unit 103, be arranged on the connection cut-off switch 113 between frame memory 101 and aforesaid way selected cell 109 and the motion vector detecting unit 108, be arranged on the connection cut-off switch 114 between aforesaid way selected cell 109 and the add operation unit 106, and be arranged on connection cut-off switch 115 between above-mentioned coded prediction error unit 103 and the predicated error decoding unit 105.

Dynamic image encoding device 10, the connection of controlling above-mentioned switch 113～115 by switch controlling signal Cs1 disconnects action, the coding control unit 110 that has output code generation control signal Cd1 and memory control signal Cd2 simultaneously, with generate dateout (coded data) Ed of control signal Cd1 based on code and carry out Variable Length Code coded prediction error unit 103, and output is for the code sequence generation unit 104 of the code sequence Bs of object piece.In this code sequence generation unit 104, the information of the coded system Ms that input has motion vector MV that expression detected by motion vector detecting unit 108, determined by mode selected cell 109, in code sequence Bs, include the information of expression for the motion vector MV and the coded system Ms of object piece for this object piece.

Here, above-mentioned selector switch 111 has an input terminal Ta and two lead-out terminal Tb1 and Tb2, and according to above-mentioned switch controlling signal Cs2, this input terminal Ta is connected to the side of above-mentioned two lead-out terminal Tb1, Tb2.Above-mentioned selector switch 112 has two input terminal Tc1 and Tc2 and a lead-out terminal Td, and according to above-mentioned switch controlling signal Cs2, this lead-out terminal Td is connected to the side of above-mentioned two input terminal Tc1, Tc2.In addition, by above-mentioned selector switch 111, to the view data Md of input terminal Ta input from frame memory 101 outputs, from a side lead-out terminal Tb1 to the input terminal Tc1 output of selector switch 112 view data Md from above-mentioned frame memory 101, from the opposing party's lead-out terminal Tb2 to the view data Md of calculus of differences unit 102 outputs from above-mentioned frame memory 101.By above-mentioned selector switch 112, to the view data Md of a side input terminal Tc1 input from above-mentioned frame memory 101, input terminal Tc2 to the opposing party imports by calculus of differences unit 102 resulting differential data PEd, from lead-out terminal Td, the side of this view data Md and differential data PEd is output to coded prediction error unit 103.

Then action is described.

In addition, in the explanation of each form of implementation below, the demonstration time ratio becomes the picture (object picture) of coded object and wants picture (forward direction picture) early be meant that relative object picture is positioned at the picture in the place ahead in time, perhaps also is called the picture in the place ahead that is positioned at the object picture simply.In addition, show that the picture that time ratio object picture will be slow (back is to picture) is meant that relative object picture is positioned at the picture at rear in time, perhaps also is called the picture at the rear that is positioned at the object picture simply.In addition, " on the time " such expression in the explanation of each form of implementation is below short ofly done the implication that special instruction is then represented " by showing time sequencing " in advance.

In the dynamic image encoding device 10 of form of implementation 1, input image data Id is by showing that time sequencing is imported into frame memory 101 with picture unit.

Fig. 2 (a) is the figure of the explanation order that the view data of each picture is put aside in frame memory 101.In Fig. 2 (a), ordinate is represented picture, the mark shown in the bottom right of each picture, the letter representation picture type of first character (I, P or B), the picture numbering of the numeral time sequencing that second character is later.Just, picture P1, B2, B3, P4, B5, B6, P7, B8, B9, P10, B11, B12, P13, B14, B15, P16 shown in Fig. 2 (a), be equivalent to picture F (k+3) shown in Figure 43～F (k+18) [k=-2], press DISPLAY ORDER, just arrange in order from the beginning early of demonstration time along the demonstration time shaft.

In frame memory 101, the view data of picture is put aside by the DISPLAY ORDER of picture.The view data of the picture of being put aside in this frame memory 101 is changed the order of lining up for the coding of picture from the DISPLAY ORDER of picture.Below, for the purpose of simplifying the description, the view data of picture also is called picture simply.

Just, the order with picture in frame memory 101 changes the processing of lining up coded sequence from input sequence (DISPLAY ORDER), carries out based on the reference relation in the inter-picture prediction coding.Just, carry out this and change row's processing, make when the coding of first picture also to be encoded earlier than first picture as employed second picture of reference picture.

Here, when the coding of P picture, relative coding object picture (P picture) is in nearby 3 pictures (I or P picture) in the place ahead in time, is used as the candidate screen of reference picture.In the predictive coding of the piece of P picture, from above-mentioned 3 candidate screen with reference to maximum 1.

In addition, when the coding of B picture, relatively object picture (B picture) be positioned in time 2 of the place ahead nearby picture (I or P picture), relatively the object picture be positioned in time the place ahead the most nearby the B picture and relatively the object picture be positioned at the I or the P picture at rear in time, be used as the candidate screen of reference picture.In the predictive coding of the piece of B picture, from above-mentioned 4 candidate screen with reference to maximum 2.

Specifically, picture P10, B11, B12, P13 and to should each picture, with reference to the corresponding relation of the candidate screen of picture, the arrow shown in Fig. 2 (a) is such.Just, when the coding of P picture P10, picture P1, P4, P7 are used as the candidate screen with reference to picture, and when the coding of P picture P13, picture P4, P7, P10 are used as the candidate screen with reference to picture.In addition, when the coding of B picture B11, picture P7, B9, P10, P13 are used as the candidate screen with reference to picture, and when the coding of B picture B12, picture P7, P10, B11, P13 are used as the candidate screen with reference to picture.

In addition, the order that Fig. 2 (b) expression will be from the picture P1 shown in Fig. 2 (a) to the picture of P16 changes the order of lining up the picture behind the coded sequence from DISPLAY ORDER.After changing row, picture shown in Fig. 2 (a), such shown in Fig. 2 (b), on time shaft (scramble time axle) Y of presentation code time, since the scramble time early in order, just arrange by the order of picture P4, B2, B3, P7, B5, B6, P10, B8, B9, P13, B11, B12, P16.

In frame memory 101, carried out changing the data of row's picture, since the scramble time early in order, be read out with certain data processing unit.Here, certain data processing unit is the data unit of carrying out motion compensation, specifically, is exactly the rectangular-shaped image space (macro block) of all having arranged 16 pixels in the horizontal direction with vertical direction.But in the following description, macro block also is called piece simply.

Below, the encoding process of picture P13, B11, B12 is described in order.

The encoding process of＜picture P13 〉

At first, the encoding process to picture P13 describes.

Because becoming picture (object picture) P13 of coded object is the P picture, so, carry out being positioned at the place ahead or rear 1 the unidirectional inter-picture prediction coding of coded picture in time with reference to object picture relatively as the inter-picture prediction coding of the object piece of picture P13.

In addition, in the following description, just, use the situation of the P picture in the place ahead that is positioned at the object picture to describe as with reference to picture.

Just, in the case,, used the inter-picture prediction coding of forward direction reference as the coding of picture P13.In addition, in the coding of P picture, do not use the B picture as the reference picture.Thereby, in the case,, be 3 I or the P picture in the place ahead with reference to the candidate screen of picture, specifically, be exactly picture P4, P7, P10.The coding of these candidate screen has finished when the coding of object picture, and the data of corresponding candidate screen (decoded data) Dd is put aside in frame memory 117.

In the coding of P picture, coding control unit 110 is controlled each switch by switch controlling signal Cs1, so that switch 113,114,115 becomes on-state.Read from frame memory 101, the view data Md of the macro block of corresponding picture P13 at first is imported into motion vector detecting unit 108, mode selected cell 109, calculus of differences unit 102.

Motion vector detecting unit 108 is used picture P4, the P7 that puts aside in frame memory 117, the decode image data Rd of P10, detects the motion vector MV of the macro block of picture P13.Then, detected motion vector MV is output to mode selected cell 109.In mode selected cell 109, use by the detected motion vector of motion vector detecting unit 108, the coded system of the piece of decision picture P13.Here coded system represents with what kind of method piece to be encoded.For example, as mentioned above, under the situation of P picture, the inter-picture prediction of coding, use motion vector is encoded, is not used the inter-picture prediction coding of motion vector (motion is made as 0 to be handled) in picture, determines a coded system.In the decision of coded system, generally be to select to make that encoding error is minimum coded system under the situation that the position amount that will be scheduled to comes piece is given as size of code.At this moment, under the situation of selecting the inter-picture prediction coding, from picture P4, P7, P10, select optimal one as the reference picture.

By the coded system Ms that mode selected cell 109 is determined, be output to code sequence generation unit 104.In addition, at the coded system Ms that is determined, under the situation for the coded system of reference forward direction picture, by with reference to the resulting vector of motion detection (forward motion vector) MVp of forward direction picture and this motion vector be that the information Rp of which the detected motion vector and so on reference to picture P4, P7, P10 also is output to code sequence generation unit 104.

At the coded system Ms that is determined by mode selected cell 109, under the situation of expression inter-picture prediction coded system, employed motion vector MVp in the inter-picture prediction coding, with this motion vector be the information Rp of which detected motion vector and so on reference to picture P4, P7, P10, be stored in motion vector storage unit 116.

In addition, in mode selected cell 109,, use with reference to picture with for the motion vector of object piece and carry out with the corresponding motion compensation of coded system that the object piece is determined.Resulting by this motion compensation, for the prediction data Pd of object piece, be output to calculus of differences unit 102 and add operation unit 106.

But, selecting in the picture under the situation of coded system generation forecast data Pd not in mode selected cell 109.In addition, under the situation of coded system, control so that switch 111 its input terminal Ta are connected to lead-out terminal Tb1 in having selected drawing, switch 112 its lead-out terminal Td are connected to input terminal Tc1.On the other hand, under the situation of having selected the inter-picture prediction coding, control so that switch 111 its input terminal Ta are connected to lead-out terminal Tb2, switch 112 its lead-out terminal Td are connected to input terminal Tc2.

Below, just to having selected the situation of inter-picture prediction coded system to describe as coded system Ms by mode selected cell 109.

In calculus of differences unit 102, the view data Md of the piece of input picture P13 and from the prediction data Pd of the correspondence of mode selected cell 109.Calculus of differences unit 102 calculates the view data Md of piece of picture P13 and the differential data of prediction data Pd, and this differential data is exported as prediction error data PEd.

Prediction error data PEd is imported into coded prediction error unit 103.Coded prediction error unit 103 is implemented encoding process such as frequency translation and quantification and is generated coded data Ed to the prediction error data PEd that imported.Here for example, processing such as frequency translation and quantification, with correspondence in the horizontal direction with vertical direction on all arranged the rectangular-shaped image space (sub-piece) of 8 pixels data be that the unit carries out.

The coded data Ed of 103 outputs is imported into code sequence generation unit 104 and predicated error decoding unit 105 from the coded prediction error unit.

Code sequence generation unit 104, the coded data Ed that is imported is carried out Variable Length Code generating code sequence, and then, the information of Ms such as additional movement vector MVp and coded system in this code sequence, and the heading message etc. and the generating code sequence B s that come own coding control unit 110.

At this moment, be to carry out under the situation of coded system of the place ahead reference in coded system, forward motion vector is that information (with reference to the image information) Rp of which detected motion vector with reference to picture P4, P7, P10 and so on also is affixed in the code sequence.

Then, the management method of frame memory and the information with reference to picture (with reference to image information) in the expression candidate screen are described.

Fig. 3 is illustrated in the situation that changes along with the process of time with the picture of being put aside in the memory (frame memory) 117 with reference to picture.In addition, the management of this frame memory 117 is carried out according to the memory control signal Cd2 that comes own coding control unit 110.In addition, here, frame memory 117 has the storage area (#1)～(#5) of 5 picture amounts.In each storage area, can put aside the view data of 1 picture amount.In addition, the memory cell of each picture is not limited to the zone in 1 frame memory, also can be a memory.

At first, the management method to frame memory (with reference to the picture memory) describes.

When the coding of picture P13 begins, in each storage area (#1)～(#5) of frame memory 117, maintain picture B8, P4, P7, P10, B9.Though picture B9 is not used, in order in the coding of picture B11, to be used, and remain in frame memory 117 in the coding of picture P13.Picture P13 is used as picture P4, P7, P10 to encode with reference to the candidate screen of picture.Coded picture P13 is held in the storage area (#1) that has kept picture B8.This be because, picture P4, P7, P10, B9 are used as the candidate screen with reference to picture during the coding that (comprises picture P13) after picture P13, picture B8 can not be used as with reference to picture when the later coding of picture P13.In addition, in Fig. 3, the picture shown in the circular mark is the moment of having finished at the coding of object picture, is put aside the picture (object picture) in frame memory 117 at last.

Then, to the concrete method of distributing to candidate screen with reference to the picture numbering being described as the information of reference picture.

This numbers with reference to picture, is which picture is used as the information with reference to picture in the candidate screen of reference picture when being illustrated in the coding of each piece.In other words, above-mentioned with reference to picture numbering, be the motion vector of the object piece of the expression object picture (picture P13) that becomes coded object, expression is with reference to as the information with reference to which detected motion vector of picture P4, the P7 of picture candidate, P10.And, in the distribution of reference picture numbering, use the method that begins to distribute in order numbering from the nearest in time candidate screen of distance object picture.

Specifically be exactly, when coding at the piece of object picture P13, picture P10 is designated as under the situation with reference to picture, and is then additional in the code sequence of object picture P13, and the candidate screen before 1 of indicated object picture P13 is designated as the information (with reference to picture numbering [0]) with reference to picture.When the coding at the piece of object picture P13, then additional in the code sequence of object picture P13 under the situation that picture P7 is referenced, the candidate screen before 2 of indicated object picture P13 is designated as the information (with reference to picture numbering [1]) with reference to picture.When the coding at the piece of object picture P13, then additional in the code sequence of object picture P13 under the situation that picture P4 is referenced, the candidate screen before 3 of indicated object picture P13 is designated as the information (with reference to picture numbering [2]) with reference to picture.

In addition, in Fig. 3, represent, be endowed the picture of symbol [b], when the coding of object picture, become the candidate of back to the reference picture as the reference image information.

The encoding process of＜picture B11 〉

Then the encoding process to picture B11 describes.

Because becoming the picture of coded object is picture (object picture) B11, so, carry out being positioned at the place ahead or rear 2 predictive codings between the bi-directional picture of coded picture in time with reference to object picture relatively as the inter-picture prediction coding of the object piece of picture B11.

Just as with reference to picture, the situation of using a picture (I picture, P picture or B picture) in the place ahead that is positioned at the object picture and being positioned at a picture (I picture or P picture) at the rear of object picture describes but here.

Just, in the case, with reference to picture, use relative object picture (picture B11) to be positioned at two pictures (I or P picture) nearby in time as forward direction, perhaps relative object picture is positioned at B picture the most nearby in time.In addition, to the reference picture, use relative object picture to be in the most nearby I or P picture in time as the back.Thereby, in the case,, be exactly the back picture P13 of picture P7, B9, P10 and conduct to picture as the forward direction picture for the candidate screen of picture B11 with reference to picture.

When coding at other pictures, be used as in the coding with reference to the B picture of picture, coding control unit 110 is controlled each switch by switch controlling signal Cs1 and is made switch 113,114,115 become on-state.Because picture B11 is used as with reference to picture when the coding of other pictures, so coding control unit 110 is controlled each switch by switch controlling signal Cs1 and made switch 113,114,115 become on-state.Read from frame memory 101, the view data Md of the piece of corresponding picture B11 is imported into motion vector detecting unit 108, mode selected cell 109, calculus of differences unit 102.

Motion vector detecting unit 108 is carried out for the forward motion vector of the object piece of picture B11 and the detection of backward motion vector.When the detection of this motion vector, picture P7, B9, the P10 of savings in frame memory 117 is used as the candidate screen of forward direction with reference to picture, and picture P13 is used as the back to the reference picture.The detection of backward motion vector is based on carrying out to the picture P13 of reference picture as the back.By the detected motion vector of motion vector detecting unit 108, be output to mode selected cell 109.

Mode selected cell 109 uses by the detected motion vector of motion vector detecting unit 108, the coded system of the object piece of decision picture B11.Here, the coded system of B picture, for example, in the picture coding, used forward motion vector the inter-picture prediction coding, used backward motion vector the inter-picture prediction coding, used the inter-picture prediction coding of bi-directional motion vector, and select in the direct mode.Here be to have used under the situation of inter-picture prediction coding of forward motion vector in coded system, from picture P7, B9, P10, select optimal picture as the reference picture.

Below, the processing of the piece of picture B11 being encoded with direct mode is described.

[the 1st example of direct mode coding]

The 1st example that Fig. 4 (a) expression is encoded to piece (object piece) BLa1 of picture (object picture) B11 with direct mode.In the case, the conduct that utilizes the rear be in picture B11 is with reference among picture (reference pictures) P13 of picture, is in motion vector (benchmark motion vector) MVc1 with piece (reference block) BLb1 of object piece BLa1 same position.Motion vector MVc1 is the employed motion vector when encoding of the piece BLb1 to picture P13, is stored in the motion vector storage unit 116.This motion vector MVc1 is detected with reference to picture P10, the zone C Rc1 of the corresponding blocks BLb1 of expression picture P10.Using motion vector MVd1, the MVe1 parallel with motion vector MVc1 and conduct to implement bi-directional predictive coding with reference to the selected picture P10 of picture, P13 in piece BLa1 handles.The motion vector MVd1 that when the coding of this piece BLa1, uses, and MVe1 be the forward motion vector of zone C Rd1 of the corresponding blocks BLa1 of expression picture P10, and the backward motion vector of the zone C Re1 of the corresponding blocks BLa1 of expression picture P13.

In the case, the size of establishing forward motion vector MVd1 is MVF, and the size of backward motion vector MVe1 is MVB, is obtained by (formula 1), (formula 2).

MVF=MVR * TRF/TRD... (formula 1)

MVB=(TRB-TRD) * MVR/TRD... (formula 2)

Here, establish MVF, MVB horizontal composition, the vertical composition of expressive movement vector respectively.

In addition, MVR is, the size of motion vector MVc1 (representing direction on 2 dimension spaces) by sign symbol, TRD is, object picture (picture B11) back to reference picture (picture P13) and in this back the time gap to the picture (picture P10) of the coding time institute reference of the piece BLb1 of reference picture (picture P13).TRF is, object picture (picture B11) and near preceding time gap with reference to picture (picture P10), and TRB is object picture (picture B11) and the time gap to the picture (picture P10) of the coding time institute reference of the piece BLb1 of reference picture in the back.

[the 2nd example of direct mode coding]

The 2nd example of the encoding process of using direct mode then, is described.

The 2nd example that Fig. 4 (b) expression is encoded to piece (object piece) BLa2 of picture (object picture) B11 with direct mode.

In the case, the conduct that utilizes the rear be in picture B11 is with reference among the picture P13 of picture, is in motion vector (benchmark motion vector) MVf2 with piece (reference block) BLb2 of piece BLa2 same position.Motion vector MVf2 is piece BLb2 employed motion vector when being encoded, and is stored in the motion vector storage unit 116.This motion vector MVf2 is detected with reference to picture P7, the zone C Rf2 of the corresponding blocks BLb2 of expression picture P7.In piece BLa2, implement the bi-directional predictive coding processing with reference to selected picture P10 of picture and picture P13 based on motion vector MVg2, the MVh2 parallel and conduct with motion vector MVf2.The motion vector MVg2 that when this piece BLa2 is encoded, uses, and MVh2 be the forward motion vector of zone C Rg2 of the corresponding blocks BLa2 of expression picture P10, and the backward motion vector of the zone C Rh2 of the corresponding blocks BLa2 of expression picture P13.

Motion vector MVg2 in the case, and big or small MVF, the MVB of MVh2 can be obtained by above-mentioned (formula 1), (formula 2) respectively.

Like this because in direct mode, to back when the coding of object piece BLa2 to the picture of reference, the motion vector MVf2 that is positioned at the BLb2 of the position relatively identical with this object piece calibrates, obtain forward motion vector MVg2 and backward motion vector MVh2 for the object piece, so under the selecteed situation of direct mode, just do not need to send the information of the motion vector of object piece.And, since as forward direction with reference to picture, use apart from the object picture to be positioned at the most nearby coded picture in time, so can make the forecasting efficiency raising.

[the 3rd example of direct mode coding]

The 3rd example of the encoding process of using direct mode then, is described.

The 3rd example of the processing that Fig. 5 (a) expression is encoded to piece (object piece) BLa3 of picture (object picture) B11 with direct mode.

In the case, utilize, be in motion vector (benchmark motion vector) MVc3 with the piece BLb3 of piece BLa3 same position as among back picture (reference pictures) P13 of picture B11 to the reference picture.Motion vector MVc3 is that employed motion vector when piece BLb3 is encoded is stored in the motion vector storage unit 116.This motion vector MVc3 obtains with reference to picture P7, the zone C Rc3 of the corresponding blocks BLb3 of expression picture P7.In piece BLa3, based on motion vector MVd3, the MVe3 parallel with motion vector MVc3, with at the picture of the coding time institute reference of piece BLb3 (as forward direction with reference to the selected picture P7 of picture) and, implement bi-directional predicted processing as the picture P13 of back to the reference picture.In the case, the motion vector MVd3, the MVe3 that use when object piece BLa3 is encoded are the forward motion vector of the zone C Rd3 of the corresponding blocks BLa3 of expression picture P7, and the backward motion vector of the zone C Re3 of the corresponding blocks BLa3 of expression picture P13.

Big or small MVF, the MVB of in the case motion vector MVd3, MVe3 can be obtained by following (formula 3) and top (formula 2) respectively.

MVF=MVR * TRB/TRD... (formula 3)

Here, MVR is the size of motion vector MVc3.

Like this because in the processing under the direct mode shown in Fig. 5 (a), to back when the coding of object piece to the picture of reference, the motion vector MVc3 that is positioned at the piece BLb3 of the position relatively identical with this object piece calibrates, obtain forward motion vector MVd3 and backward motion vector MVe3 for the object piece, so under the selecteed situation of direct mode, just do not need to send the information of the motion vector of object piece.

Here, when at the picture P13 of the coding time institute reference of piece BLb3 under the situation of frame memory 117 deletions, the most nearby forward direction is in time got final product with reference to picture as the forward direction in the direct mode with reference to picture P10.Processing in the direct mode in the case, identical with the processing (the 1st example) of the direct mode shown in Fig. 4 (a).

[the 4th example of direct mode coding]

The 4th example of the encoding process of using direct mode then, is described.

The 4th example of the processing that Fig. 5 (b) expression is encoded to piece (object piece) BLa4 of picture (object picture) B11 with direct mode.

In the case, in object piece BLa4, based on as forward direction with reference to picture selected the most nearby picture P10 and as the picture P13 of back to the reference picture, implement motion vector is made as 0 bi-directional predicted processing.The motion vector MVf4, the MVh4 that use when promptly in the case piece BLa4 being encoded are, expression picture P10 with the object piece BLa4 motion vector of the zone of same position (piece) CRf4 relatively, and expression picture P13 with the object piece BLa4 motion vector of the zone of same position (piece) CRh4 relatively.

Like this in the processing under the direct mode shown in Fig. 5 (b), by being made as 0 forcibly for the motion vector of object piece, under the selecteed situation of direct mode, then there is no need to send the information of the motion vector of object piece, just do not need the calibration of motion vector to handle, can seek the reduction of signal processing amount.The method also can be applied to, and for example, is not have the such situation of piece of motion vector as by the piece of intraframe coding as picture B11 the back piece that is in piece BLa4 same position in the picture P13 of reference picture.Thereby, even do not have can use direct mode to make the code efficiency raising under the situation that motion vector ground encodes being in the piece of object piece same position of back in the reference picture yet.

The processing of above-mentioned direct mode (the 1st～the 4th example), not only can be applicable to picture the demonstration time be spaced apart fixing situation, being spaced apart variable situation and also can using to demonstration time of picture.

[the 5th example of direct mode coding]

Then, the predictive coding under the direct mode of the situation of the variable spaced of demonstration time of picture is handled, described as the 5th example of the encoding process of using direct mode.

Fig. 6 (a) is the figure of the 5th example of the explanation encoding process of using direct mode, and expression is handled the processing of situation that (the 2nd example) is applied to the demonstration variable spaced of picture with the predictive coding under the direct mode.

In the case, bi-directional predictive coding for the object piece BLa5 of object picture B11 is handled, utilization is in the conduct at rear of picture B11 with reference among picture (reference pictures) P13 of picture, be in motion vector (benchmark motion vector) MVf5 with the piece BLb5 of object piece BLa5 same position, handle (the 2nd example) with the predictive coding under the direct mode shown in Fig. 4 (b) and similarly carry out.In addition, motion vector MVf5 is, employed motion vector when the piece BLb5 of picture P13 is encoded, the zone C Rf5 of the corresponding blocks BLb5 of expression picture P7.In addition, parallel for motion vector MVg5, the MVh5 of object piece with motion vector MVf5.These motion vectors MVg5, MVh5 are in addition, the forward motion vector of the zone C Rg5 of the corresponding blocks BLa5 of expression picture P10, and the backward motion vector of the zone C Rh5 of the corresponding blocks BLa5 of expression picture P13.

In the case, big or small MVF, the MVB of motion vector MVg5, MVh5 also with direct mode under processing (the 2nd example) same, can obtain by (formula 1), (formula 2) respectively.

[specific jump is handled]

Then, in the encoding process under the direct mode, the situation that specific piece is handled as skipped blocks describes.

When in the encoding process under the direct mode, the differential data of corresponding objects piece is under 0 the situation, in coded prediction error unit 103, coded data that should the object piece is not generated, do not export the code sequence of corresponding objects piece from code sequence generation unit 104.Differential data is 0 piece like this, handles as skipped blocks.

Below, specifically describe the situation that specific piece is handled as skipped blocks.

Fig. 6 (b) expression constitutes the specific picture F of moving image.

In this picture F, the value of the differential data (prediction error data) of corresponding blocks MB (r-1), MB (r) and MB (r+3) is non-0 value in the piece MB of adjacency (r-1)～MB (r+3), and the value that correspondence is positioned at the differential data (prediction error data) of piece MB (r+1) between piece MB (r) and the piece MB (r+3) and piece MB (r+2) is 0.

In the case, under direct mode, piece MB (r+1) and piece MB (r+2) handle as skipped blocks, in the code sequence Bs of corresponding moving image, do not comprise the code sequence for piece MB (r+1) and piece MB (r+2).

Fig. 6 (c) is the figure that is used for the flow structure under the situation that illustrated block MB (r+1) and piece MB (r+2) handle as skipped blocks, and expression is for the part of corresponding blocks MB (r) and the piece MB (r+3) of code sequence Bs.

Between the code sequence Bmb (r+3) of the code sequence Bmb of corresponding blocks MB (r) (r) and corresponding blocks MB (r+3), allocation list is shown in two jump identifier Sf (Sk:2) as the processed piece of skipped blocks between these pieces.In addition, between the code sequence Bmb (r) of the code sequence Bmb of corresponding blocks MB (r-1) (r-1) and corresponding blocks MB (r), allocation list is shown in the jump identifier Sf (Sk:0) that does not have between these pieces as the processed piece of skipped blocks.

In addition, the code sequence Bmb (r) of corresponding blocks MB (r) is made of Hmb of title portion and data portion Dmb, in data portion Dmb, comprises the view data that is encoded that should piece.In addition, in the Hmb of title portion, comprise the expression macro block (mb) type, just this piece is the mode sign Fm that is encoded with what kind of coded system, be illustrated in coding time institute's reference picture with reference to image information Rp, be illustrated in information Bmvf, the Bmvb of employed motion vector of when coding.Here, this piece is handled by bi-directional predictive coding and is encoded, and represents information Bmvf, the Bmvb of motion vector, is illustrated respectively in the value of employed forward motion vector, backward motion vector in the bi-directional predicted processing.In addition, corresponding other the code sequence of piece such as the code sequence Bmb (r+3) of corresponding blocks MB (r+3) also has the identical structure of code sequence Bmb (r) with corresponding blocks MB (r).

Like this, by under direct mode, be that 0 piece is handled as skipped blocks with differential data, just in code sequence, also comprise mode information and jump information that should piece, the reduction of size of code just becomes possibility.

In addition, whether piece is jumped, and can detect from the jump identifier Sf near preceding of the code sequence that is disposed at each piece.In addition, whether piece is jumped, and also can be learnt by the number information of recording and narrating the piece in the code sequence of corresponding each piece etc.

In addition, processing example under the direct mode shown in Fig. 4 (a) (the 1st example), processing example under the direct mode shown in Fig. 4 (b) (the 2nd example), in the processing example under the direct mode shown in Fig. 5 (a) (the 3rd example), also can not to be that 0 piece is all handled as skipped blocks with differential data, but with relative object picture be positioned in time near preceding picture as forward direction with reference to picture, and using size is that 0 motion vector carries out bi-directional predicted for the object piece, only under the differential data of object piece is 0 situation, this object piece is handled as skipped blocks.

So, for the selection of the coded system of object piece, generally be that to make the encoding error for certain position amount be that minimum is carried out.The coded system that is determined by mode selected cell 109 is output to code sequence generation unit 104.In addition, from the resulting prediction data of reference picture, be output to calculus of differences unit 102 and add operation unit 106 based on the coded system that is determined by mode selected cell 109.But under the selecteed situation of coding, prediction data is not exported in picture.In addition, under the selecteed situation of coding, control so that switch 111 its input terminal Ta are connected to lead-out terminal Tb1 in pass-through mode selected cell 109 pictures, switch 112 its lead-out terminal Td are connected to input terminal Tc1.Under inter-picture prediction is encoded selecteed situation, control so that switch 111 its input terminal Ta are connected to lead-out terminal Tb2, switch 112 its lead-out terminal Td are connected to input terminal Tc2.

Below, the action of the dynamic image encoding device 10 under the situation of having been selected the inter-picture prediction coding by mode selected cell 109 is described.

In calculus of differences unit 102, from mode selected cell 109 input prediction data Pd.Calculus of differences unit 102 calculates the view data of piece of corresponding picture B11 and the differential data of prediction data, and this differential data is exported as prediction error data PEd.Prediction error data PEd is imported into coded prediction error unit 103.Coded prediction error unit 103 generates coded data Ed by the prediction error data PEd that is imported is implemented encoding process such as frequency translation and quantification.The coded data Ed of 103 outputs is imported into code sequence generation unit 104 and predicated error decoding unit 105 from the coded prediction error unit.

Code sequence generation unit 104 to the coded data Ed that is imported, is implemented Variable Length Code etc., and then the information generating code sequence B s by additional movement vector and coded system etc., and exports this code sequence Bs.At this moment, be to carry out under the situation of forward direction with reference to coded system in coded system, information (with reference to the image information) Rp that is used for discerning forward motion vector and is with reference to which resulting motion vector of picture P7, B9, P10 also is affixed to code sequence Bs.

Then, use Fig. 3 to describe to the frame memory management method in the coding of picture B11 with reference to the distribution method of image information.

When the coding of picture B11 begins, in frame memory 117, maintain picture P4, P7, P10, P13, B9.Picture B11 carries out bi-directional predictive coding as the back to the candidate screen of reference with picture P13 with the candidate screen that picture P7, B9, P10 are used as the forward direction reference.The picture B11 that has encoded remains in the storage area (#2) that has kept picture P4.This is because picture P4 in the encoding process of the later picture of picture B11, does not use as the reference picture.

In the coding of this picture B11, as being used to discern forward motion vector for the object piece is addition method with reference to the information (with reference to image information) of which detected motion vector of picture P7, B9, P10, use from time apart from object picture (picture B11) nearest begin to give in order the method for numbering with reference to candidate screen.In addition, with reference to candidate screen, be when the coding of object picture, to can be used as the picture of selecting with reference to picture.

Specifically, be exactly that picture P10 is distributed with reference to picture numbering [0], picture B9 is distributed with reference to picture numbering [1], picture P7 is distributed with reference to picture numbering [2].

Thereby, when coding at the object picture with reference under the situation of picture P10, with reference to picture numbering [0] as expression with reference to the information of the candidate screen before 1 in the object picture recorded and narrated in code sequence for the object piece.Similarly, with reference under the situation of picture B9, with reference to picture numbering [1] as expression with reference to the information of the candidate screen before 2 in the object picture, recorded and narrated in code sequence for the object piece.With reference under the situation of picture P7, with reference to picture numbering [2] as expression with reference to the information of the candidate screen before 3 in the object picture recorded and narrated in code sequence for the object piece.

Here, for the distribution of the code of reference picture [0], [1], [2], for example, the value of numbering is more little, and code length carries out like this with regard to short more.

Generally, candidate screen is used as the probability with reference to picture, and the candidate screen near more in time apart from the object picture is just high more.Thereby by such allocation of codes, the motion vector that just can reduce to express the object piece is the overall code amount with reference to the resulting code of which candidate screen.

Predicated error decoding unit 105 to the coded data for the object piece of being imported, is implemented the decoding processing of re-quantization and frequency inverse conversion etc., generates the also decoding differential data PDd of object output piece.Decoding differential data PDd is by add operation unit 106 and prediction data Pd addition, and the decoded data Dd of the resulting object piece of addition is put aside frame memory 117 thus.

By same processing, carry out the encoding process of the rest block of picture B11.Then, after the processing of whole pieces of picture B11 finishes, then carry out the encoding process of picture B12.

The encoding process of＜picture B12 〉

Then the encoding process to picture B12 describes.

Because picture B12 is the B picture, so, carry out being positioned at the place ahead or rear 2 predictive codings between the bi-directional picture of coded picture in time with reference to object picture relatively as the inter-picture prediction coding of the object piece of picture B12.

But just used the situation of the inter-picture prediction coding of two-way reference to describe here, as the encoding process of picture B12.Thereby, in the case, with reference to picture, use relative object picture by showing time sequencing 2 I or P picture near at hand as forward direction, perhaps relatively the object picture by showing that time sequencing is at the most nearby B picture.To the reference picture, use relative object picture as the back by showing that time sequencing is at the most nearby I or P picture.Thereby, in the case, for picture B12 with reference to candidate screen, be exactly as the forward direction picture picture P7, P10, B11 and as the picture P13 of back to picture.

When coding at other pictures, be used as in the coding with reference to the B picture of picture, coding control unit 110 is controlled each switch and is made switch 113,114,115 become on-state.Because picture B12 is used as with reference to picture when the coding of other pictures, so coding control unit 110 is controlled each switch and made switch 113,114,115 become on-state.Thereby, to read from frame memory 101, the view data of the piece of corresponding picture B12 is imported into motion vector detecting unit 108, mode selected cell 109 and calculus of differences unit 102.

Motion vector detecting unit 108, with picture P7, P10, the B11 of savings in frame memory 117, candidate screen as the forward direction reference, with the picture P13 of savings in frame memory 117 as the back to the reference picture, carry out the forward motion vector of piece of corresponding picture B12 and the detection of backward motion vector.

Detected motion vector is output to mode selected cell 109.

Mode selected cell 109 uses by motion vector detecting unit 108 resulting motion vectors, the coded system of the piece of decision picture B12.Here, the coded system of B picture, for example, in the picture coding, used forward motion vector the inter-picture prediction coding, used backward motion vector the inter-picture prediction coding, used the inter-picture prediction coding of bi-directional motion vector, and select in the direct mode.Here be to have used under the situation of inter-picture prediction coding of forward motion vector in coded system, from picture P7, P10, B11, select optimal picture as the reference picture.

Below, the processing of the piece of picture B12 being encoded with direct mode is described.

[the 1st example of direct mode coding]

The situation that Fig. 7 (a) expression is encoded to piece (object piece) BLa5 of picture (object picture) B12 with direct mode.In the case, the conduct that utilizes the rear be in picture B12 is with reference among picture (reference pictures) P13 of picture, is in motion vector (benchmark motion vector) MVc5 with piece (reference block) BLb5 of object piece BLa5 same position.Motion vector MVc5 is piece BLb5 employed motion vector when being encoded, and is stored in the motion vector storage unit 116.Motion vector MVc5, the zone C Rc5 of the corresponding blocks BLb5 of expression picture P10.In piece BLa5, use the motion vector parallel, handle based on implementing bi-directional predictive coding as picture B11, P13 with reference to picture for piece BLa5 with motion vector MVc5.In the case, the motion vector that uses when piece BLa5 is encoded is the motion vector MVd5 of zone C Rd5 of the corresponding blocks BLa5 of expression picture B11, and the motion vector MVe5 of the zone C Re5 of the corresponding blocks BLa5 of expression picture P13.The size of in the case motion vector MVd5, MVe5 is MVF, MVB, can be obtained by above-mentioned (formula 1), (formula 2) respectively.

[the 2nd example of direct mode coding]

The 2nd example of the encoding process of using direct mode then, is described.

The situation that Fig. 7 (b) expression is encoded to piece (object piece) BLa6 of picture (object picture) B12 with direct mode.In the case, the conduct that utilizes the rear be in picture B12 is with reference among picture (reference pictures) P13 of picture, is in motion vector (benchmark motion vector) MVf6 with the piece BLb6 of piece BLa6 same position.Motion vector MVf6 is piece BLb6 employed motion vector when being encoded, and is stored in the motion vector storage unit 116.Motion vector MVf6, the zone C Rf6 of the corresponding blocks BLb6 of expression picture P7.In piece BLa6, use the motion vector parallel, based on implementing the bi-directional predictive coding processing as picture B11 and picture P13 with reference to picture with motion vector MVf6.In the case, the motion vector MVg6 that uses when piece BLa6 is encoded, and MVh6 be the motion vector of zone C Rg6 of the corresponding blocks BLa6 of expression picture B11, and the motion vector of the zone C Rh6 of the corresponding blocks BLa6 of expression picture P13.The size of in the case motion vector MVg6, MVh6 is MVF, MVB, can be obtained by above-mentioned (formula 1), (formula 2) respectively.

Like this because in direct mode, to after when the coding of object piece BLa6 to the picture of reference, the motion vector MVf6 that is positioned at the BLb6 of the position relatively identical with this object piece calibrates, obtain forward motion vector MVg6 and backward motion vector MVh6 for the object piece, so under the selecteed situation of direct mode, just do not need to send the information of the motion vector of object piece.And, since as forward direction with reference to picture, use apart from the object picture by showing that time sequencing is positioned at coded picture the most nearby, so can make the forecasting efficiency raising.

[the 3rd example of direct mode coding]

The 3rd example of the encoding process of using direct mode then, is described.

The 3rd example of the processing that Fig. 8 (a) expression is encoded to piece (object piece) BLa7 of picture (object picture) B12 with direct mode.

In the case, utilize be in picture B12 back to conduct with reference among picture (reference pictures) P13 of picture, be in motion vector (benchmark motion vector) MVc7 with piece (reference block) BLb7 of piece BLa7 same position.Motion vector MVc7 is that employed motion vector when piece BLb7 is encoded is stored in the motion vector storage unit 116.This motion vector MVc7, the zone C Rc7 of the corresponding blocks BLb7 of expression picture P7.In piece BLa7, use the motion vector parallel with motion vector MVc7, picture that will be identical, picture P7 with the picture of the coding time institute reference of piece BLb7 as forward direction with reference to picture, with picture P13 as the back to the reference picture, implement bi-directional predictive coding and handle.The motion vector MVd7, the MVe7 that use when in the case piece BLa7 being encoded are the motion vector of the zone C Rd7 of the corresponding blocks BLa7 of expression picture P7, and the motion vector of the zone C Re7 of the corresponding blocks BLa7 of expression picture P13.

Big or small MVF, the MVB of above-mentioned motion vector MVd7 and MVe7 can be obtained by above-mentioned (formula 2), (formula 3) respectively.

Here, when at the picture of the coding time institute reference of piece BLb7 under the situation of frame memory 117 deletions, the most nearby forward direction is in time got final product with reference to picture as the forward direction in the direct mode with reference to picture P10.Processing in the direct mode in the case, identical with the 1st example of direct mode.

Like this because in the processing under the direct mode shown in Fig. 8 (a), to back when the coding of object piece to the picture of reference, the motion vector MVc7 that is positioned at the piece BLb7 of the position relatively identical with this object piece calibrates, obtain forward motion vector MVd7 and backward motion vector MVe7 for the object piece, so under the selecteed situation of direct mode, just do not need to send the information of the motion vector of object piece.

[the 4th example of direct mode coding]

The 4th example of the encoding process of using direct mode then, is described.

The 4th example of the processing that Fig. 8 (b) expression is encoded to piece (object piece) BLa8 of picture (object picture) B12 with direct mode.

In the case, in object piece BLa8, based on as forward direction with reference to picture selected the most nearby picture P10 and as the picture P13 of back to the reference picture, implement motion vector is made as 0 bi-directional predicted processing.Promptly, the motion vector MVf8, the MVh8 that use when in the case piece BLa8 being encoded are, expression picture P10 with the object piece BLa8 motion vector of the zone of same position (piece) CRf8 relatively, and expression picture P13 with the object piece BLa8 motion vector of the zone of same position (piece) CRg8 relatively.

Like this in the processing under the direct mode shown in Fig. 8 (b), by being made as 0 forcibly for the motion vector of object piece, under the selecteed situation of direct mode, then there is no need to send the information of the motion vector of object piece, just do not need the calibration of motion vector to handle, can seek the reduction of signal processing amount.The method also can be applied to, and for example, is not have the such situation of piece of motion vector as by the piece of intraframe coding as picture B12 the back piece that is in piece BLa8 same position in the picture P13 of reference picture.Thereby, even do not have can use direct mode to make the code efficiency raising under the situation that motion vector ground encodes being in the piece of object piece same position of back in the reference picture yet.Processing under the direct mode of above-mentioned picture B12 (the 1st～the 4th example), not only can be applicable to picture the demonstration time be spaced apart fixing situation, to the variable situation that is spaced apart of demonstration time of picture, also can similarly use with the situation of the picture B11 shown in Fig. 6 (a).

In addition, in the encoding process under the direct mode of picture B12, same with the encoding process under the direct mode of picture B11, be under 0 the situation at the differential data of corresponding objects piece, in coded prediction error unit 103, coded data that should the object piece is not generated, does not export the code sequence of corresponding objects piece from code sequence generation unit 104.Differential data is 0 piece like this, and is same with the situation of the picture B11 shown in Fig. 6 (b), Fig. 6 (c), handles as skipped blocks.

In addition, processing example under the direct mode shown in Fig. 7 (a) (the 1st example), processing example under the direct mode shown in Fig. 7 (b) (the 2nd example), in the processing example under the direct mode shown in Fig. 8 (a) (the 3rd example), also can not to be that 0 piece is all handled as skipped blocks with differential data, but with relative object picture be positioned in time near preceding picture as forward direction with reference to picture, and using size is that 0 motion vector carries out bi-directional predicted for the object piece, only under the differential data of object piece is 0 situation, this object piece is handled as skipped blocks.

So, when by mode selected cell 109 decision during for the coded system of the object piece of picture B12, same with the encoding process of the object piece of picture B11, generate prediction data PEd for the object piece, this prediction data PEd is output to calculus of differences unit 102 and add operation unit 106.But, under the selecteed situation of in picture, encoding, from mode selected cell 109 not prediction of output data.In addition, each switch 111,112 is similarly controlled with the coding situation of picture B11 according to being which that select to encode between coding and picture in the picture by mode selected cell 109 as coded system.

Below, the action of the dynamic image encoding device 10 under the situation of having been selected the inter-picture prediction coding when the coding of picture P12 by mode selected cell 109 is described.

In the case, calculus of differences unit 102, coded prediction error unit 103, code sequence generation unit 104, predicated error decoding unit 105, add operation unit 106 and frame memory 117 and have selected the situation of inter-picture prediction coding similarly to move by mode selected cell 109 when the coding of picture P11.

But, in the case, because the candidate screen of forward direction reference is different with the situation of the coding of picture P11, so in the coded system for the object piece is when carrying out the coded system of forward direction reference, be additional to the object piece code sequence become with reference to image information that to be used to discern forward motion vector be information with reference to which resulting motion vector of picture P7, P10, B11.

In addition, during the coding of picture B12, frame memory management method and with reference to the distribution method of image information, the method during with the coding of picture B11 shown in Figure 3 is just the same.

As top, in this form of implementation 1, because when the B picture is encoded, candidate screen as the forward direction reference, except that the P picture, also use the B picture, thus as for the B picture with reference to picture, use the forward direction picture the most nearby be positioned at this B picture just to become possibility, just can improve the precision of prediction of the motion compensation of B picture, can seek the raising of code efficiency.

In form of implementation 1, B picture in the coding of P picture is not illustrated as the situation with reference to picture.By handling like this, even in the middle of decoding, produced under the wrong situation, also can restart decoding by next I or P picture from the picture that produced decoding error, fully carry out recovery from mistake.But, even in the coding of P picture with the B picture as with reference to picture, can not change by the effect of obtained other of this form of implementation yet.

In addition, in form of implementation 1, owing to will be made as 2 P pictures and 1 B picture for the candidate screen of the forward direction reference of B picture, so when with the existing situation that will be made as 3 P pictures relatively the time for the candidate of the forward direction reference of B picture, just can on quantity, change ground for the candidate screen of the forward direction reference of B picture, avoid owing to comprise in the candidate screen for the forward direction reference of B picture that the B picture causes, savings is with reference to the increase of the treating capacity of the capacity increase of the frame memory of candidate screen and motion detection.

In addition, in this form of implementation, by expression is implemented the information of inter-picture prediction encoding process with reference to forward direction B picture to the B picture, and be illustrated in this forward direction with reference to the time be information with reference to several I or P picture and several B pictures, record and narrate heading message for the code sequence that will generate, just can learn when decoding, need the frame memory of which kind of degree by the code sequence that dynamic image encoding device generated of this form of implementation.

In addition, in this form of implementation, during owing to information such as additional movement vector and coded system in code sequence, in coded system is to carry out under the situation of coded system of forward direction reference, additional to being distributed in code sequence by the candidate screen of forward direction reference, be used to discern with reference to picture with reference to image information, and then the management method of the frame memory of using according to the reference picture, to the nearest in time candidate screen of distance object picture distribute with reference to image information, represent with short code length, so just can reduce to express with reference to the code of image information, whole size of code.In addition, in the management of frame memory, for example because it doesn't matter that ground manages frame memory with the kind of picture, so can make frame memory amount minimum.

In addition, in this form of implementation 1, undertaken with reference to the management of picture with frame memory by separating P picture and B picture, it is simple and easy that the management of frame memory just becomes.

In addition, in this form of implementation, as with direct mode to the encode picture of time institute's forward direction reference of the piece of B picture, use this B picture relatively to be positioned at the most nearby picture by the time DISPLAY ORDER, just can make thus for the forecasting efficiency raising of B picture under direct mode.

In addition, in this form of implementation, when the piece of B picture being encoded with direct mode, as forward direction with reference to picture, use is the picture to the coding time institute forward direction reference of reference picture in the back, just can make thus for the forecasting efficiency of B picture under direct mode to improve.

In addition, in this form of implementation, because when the piece of B picture being encoded with direct mode, based on forward direction with reference to picture and the back to the reference picture carry out with motion vector be made as 0 bi-directional predicted, so just do not need the calibration of the motion vector under the direct mode to handle, can seek alleviating of information processing capacity.This moment in addition is not even have can use direct mode to make the code efficiency raising under the situation that motion vector ground encodes being in the piece of object piece same position of back in the reference picture yet.

In addition, in this form of implementation, because when the piece of B picture being encoded, in predicated error the information of in code sequence, not recording and narrating under 0 the situation about this object piece, so the reduction of size of code just becomes possibility for the object piece with direct mode.

In addition, although in above-mentioned form of implementation 1, illustrated that motion compensation is is unit with the image space (macro block) be made up of level 16 * vertical 16 pixels, the coding of prediction error image is being the situation that unit handles by the image space (sub-piece) that level 8 * vertical 8 pixels are formed, but the coding of motion compensation and prediction error image, the pixel count of its macro block or sub-piece also can be with shown in the form of implementation 1 different.

In addition, although in form of implementation 1, be that 2 situation is that example is illustrated with the number of continuous B picture, the number of continuous B picture also can be for more than 3.

For example, between I picture and P picture, perhaps the number of the B picture between the P picture of adjacency also can be 3 or 4.

In addition, although in form of implementation 1, coded system with the P picture is, in picture, encode, used the inter-picture prediction coding of motion vector, and do not use the inter-picture prediction coding of motion vector to select, the coded system of B picture is, in picture, encode, used the inter-picture prediction coding of forward motion vector, used the inter-picture prediction coding of backward motion vector, used the inter-picture prediction coding of bi-directional motion vector, and the situation that direct mode is selected is that example is illustrated, but the coded system of P picture or B picture also can be the mode beyond shown in the above-mentioned form of implementation 1.

For example, do not using under the situation of direct mode, just do not needing the motion vector storage unit 116 in the dynamic image encoding device 10 as the coded system of B picture.

In addition, although in form of implementation 1, the situation with reference to the candidate screen of picture that picture B11, B12 as the B picture are become when other pictures are encoded is illustrated, but when the coding of other pictures,, just there is no need to remain on reference to picture with in the memory 117 not as B picture with reference to picture.The control unit 110 of encoding is in the case controlled so that switch 114,115 disconnects.

In addition, although in form of implementation 1, to the quantity of the candidate screen of the forward direction reference in the coding of P picture is that 3 situation is illustrated, but be not limited to this, for example, in the coding of P picture, also the picture more than 2 or 4 can be used as the candidate screen of forward direction reference.

In addition, although in form of implementation 1, to the candidate screen of the forward direction reference in the coding of B picture, be that the situation of 2 P pictures and 1 B picture is illustrated, but the candidate screen of the forward direction reference in the coding of B picture is not limited to the situation of above-mentioned form of implementation 1.

For example, in the coding of B picture, also can be with 1 P picture and 2 B pictures, 2 P pictures and 2 B pictures, with picture type it doesn't matter ground will be in time the most nearby 3 pictures etc. use as the candidate screen of forward direction reference.In addition, also can not with at the B picture that shows on the time shaft the most nearby, but will show that the B picture that leave on the time shaft uses as the candidate screen of reference.In addition, when coding at the piece of B picture, with reference to after 1 to picture, only will the situation of a picture the most nearby as the candidate screen of forward direction reference under, the indicated object piece is which picture to carry out information encoded (with reference to image information) with reference to just to there is no need to record and narrate in code sequence.

In addition, although in form of implementation 1,, be illustrated with reference to the situation of the B picture in more the place ahead of the forward direction P picture the most nearby that is located at the object picture to when the coding of B picture, but when the coding of B picture, also can be with reference to the B picture in more the place ahead of the most nearby forward direction I or P picture.At this moment,, in the middle of decoding, produced under the wrong situation, also can restart decoding, fully carried out recovery from mistake by next I or P picture from the picture that produced decoding error even when the code sequence that is generated is decoded.

For example, Fig. 9 (a) and Fig. 9 (b) are when being illustrated in the coding of B picture, with reference to the figure of the situation of the B picture in more the place ahead of the forward direction P picture the most nearby that is located at the object picture.

Fig. 9 (a) expression picture is arranged and for an example of the reference relation of B picture.Just, the number of B picture of expression between the P of adjacency picture is 2 in Fig. 9 (a), is the situation of 1 P picture and 2 B pictures for the forward direction of B picture with reference to the candidate screen of the picture picture of the coding time institute reference of B picture (just).

Fig. 9 (b) expression picture is arranged and for an example of the reference relation of B picture.Just, the number of B picture of expression between the P picture is 4 in Fig. 9 (b), for the forward direction of B picture with reference to the candidate screen of picture for the situation of picture type it doesn't matter ground is positioned in time 2 pictures the most nearby of object picture.

When Figure 10 (a) and Figure 10 (b) are illustrated in the coding of B picture, not with reference to the situation of the B picture in more the place ahead of the most nearby forward direction I or P picture.

In Figure 10 (a), the number of the B picture of expression between the P picture is 2, is 1 P picture and 1 B picture for the forward direction of B picture with reference to the candidate screen of picture, and the B picture in more the place ahead of forward direction P picture the most nearby that is located at the object picture is not as the situation of above-mentioned forward direction with reference to the candidate screen of picture.

In Figure 10 (b), the number of the B picture of expression between the P picture is 4, is 1 P picture and 1 B picture for the forward direction of B picture with reference to the candidate screen of picture, and the B picture in more the place ahead of forward direction P picture the most nearby that is located at the object picture is not as the situation of above-mentioned forward direction with reference to the candidate screen of picture.

In addition, although in above-mentioned form of implementation 1, just the quantity with reference to candidate screen for the P picture is 3, candidate screen for the forward direction reference of B picture is the situation of 2 P pictures and 1 B picture, but the identical situation of frame numbers of forward direction reference was illustrated when promptly frame numbers that can reference when the coding of P picture was with coding at the B picture, but but frame numbers that can reference when the frame numbers of forward direction reference also can be than the coding at the P picture when the coding of B picture lack.

In addition, although in above-mentioned form of implementation 1, the example as the encoding process of direct mode is illustrated 4 methods, and any one in also can these methods in direct mode also can be used a plurality of methods in 4 methods.But under the situation of using a plurality of methods, preferably will represent to use the information (DM mode information) of which direct mode to record and narrate in code sequence.

For example, under the situation that spreads all over a method of the whole use of sequence, DM mode information is recorded and narrated in the title of sequence integral body, under situation to a method of each picture and selecting, DM mode information is recorded and narrated in the title of picture, selecting with block unit under the situation of a method, DM mode information is recorded and narrated in the title of picture got final product.

In addition, as the unit of selecting the processing method under the above-mentioned direct mode, except that units such as above-mentioned picture and piece, also can be the GOP (Group ofpictures) that comprises a number of frames, by a plurality of GOB that form (Group of blocks), distinguish the picture bar of picture etc.

In addition, although in form of implementation 1, as the management method of frame memory, use Fig. 3 to be illustrated, the management method of frame memory is not limited to shown in Figure 3.

Below, other the management method of frame memory is described.

At first, to becoming the 1st example under the situation that the B picture of P picture manages, use Figure 11 to describe as the employed whole picture segmentation of reference picture.

In the case, establish frame memory 117, have the P picture adds up to 6 picture amounts with storage area (#1), (#2) with storage area (#1)～(#4), B picture zone as storage area.In addition, the memory cell of each picture is not limited to the zone in the frame memory, also can be a memory.

When the coding of picture P13 begins, maintain picture P1, P4, P7, P10 at the P of frame memory 117 picture in storage area (#1)～(#4), maintain picture B8, B9 at this B picture in storage area (#1), (#2).Picture P13 is used as picture P4, P7, P10 to encode with reference to the candidate screen of picture then, and the picture P13 that maintenance has been encoded in having kept the zone (#1) of picture P1.This is because picture P1 can not be used as with reference to picture when the coding of the later picture of picture P13.

In the case, distribute to picture P4, the P7 as candidate screen, the method for P10 with reference to image information, with method shown in Figure 3 similarly, to the nearest in time candidate screen of relative object picture, what apportioning cost was little numbers with reference to picture.

Just, the hithermost forward direction candidate screen of distance object picture is given with reference to picture numbering [0], distance object picture the 2nd close candidate screen is given with reference to picture numbering [1].To giving from object picture candidate screen farthest with reference to picture numbering [2].

In addition, in Figure 11,, give symbol [b], when the coding of the later picture of object picture,, give symbol [n] not as picture with reference to picture as the reference image information to being used as the picture of back to the reference picture.

Then, to becoming the 2nd example under the situation that the B picture of P picture manages, use Figure 12 to describe as the employed whole picture segmentation of reference picture.

About storage management since with the 1st its explanation of routine identical Therefore, omited shown in Figure 11.

In the case, as the addition method of reference image information, make to be kept at the P picture and preferentially to be numbered additional method with the picture in the storage area.But because in the coding of picture P13, the B picture is not used as with reference to picture, so be not numbered additional to the B picture.Thereby, picture P10 is given with reference to picture numbering [0], picture P7 is given with reference to picture numbering [1], picture P4 is given with reference to picture numbering [2].

Then, to becoming the 3rd example under the situation that the B picture of P picture manages, use Figure 13 to describe as the employed whole picture segmentation of reference picture.

About storage management since with the 1st its explanation of routine identical Therefore, omited shown in Figure 11.

In the case, as the addition method of reference image information, make to be kept at the B picture and preferentially to be numbered additional method with the picture in the storage area.But because in the coding of picture P13, the B picture is not used as with reference to picture, so be not numbered additional to the B picture.Thereby, picture P10 is given with reference to picture numbering [0], picture P7 is given with reference to picture numbering [1], picture P4 is given with reference to picture numbering [2].

Then, to becoming the 4th example under the situation that the B picture of P picture manages, use Figure 14 to describe as the employed whole picture segmentation of reference picture.

About storage management since with the 1st its explanation of routine identical Therefore, omited shown in Figure 11.

In the case, as the addition method of reference image information, use each picture to encoding, decision is to make at the P picture preferentially with the picture of being preserved in which of storage area with storage area and B picture, adds the method with reference to image information.

Specifically, for example, according to the hithermost in time kind with reference to picture of distance object picture, deciding is to make the picture of being preserved in which storage area with storage area with storage area and B picture at the P picture preferentially be numbered additional getting final product.

Because in the coding of picture P13, the B picture is not used as with reference to picture, so make the picture of being preserved in storage area at the P picture preferentially be numbered additional.Thereby, picture P10 is given with reference to picture numbering [0], picture P7 is given with reference to picture numbering [1], picture P4 is given with reference to picture numbering [2].In addition in the case, make the P picture preferentially carry out the information of giving expression, record and narrate in the title of picture with reference to the picture numbering with the picture of storage area.

In the distribution method of above-mentioned Fig. 3, Figure 11～shown in Figure 14 with reference to the picture numbering, to establish with reference to the value of picture numbering more for a short time, expression is just short more with reference to the code length of the code of picture numbering.General since relatively the object picture in time the closer to picture be used as with reference to the probability of picture high more, so by determining the code length of expression like this with reference to the code of picture numbering, just can reduce to express with reference to the code of picture numbering, whole size of code.

As top,, also can select to use in these 5 methods any one in advance although, show Fig. 3, Figure 11～5 methods shown in Figure 14 about the management method of frame memory and the distribution method of numbering with reference to picture.Also can switch a plurality of methods in these 5 methods of use.But, preferably will use the information of which method and so on for example to record and narrate as heading message switching under the situation of using a plurality of methods.

In addition, by as heading message, record and narrate 3 of expression P picture uses and carry out the inter-picture prediction information encoded with reference to candidate screen, just can learn when the code sequence Bs that the dynamic image encoding device 10 by this form of implementation 1 is generated decodes, need the frame memory of which kind of degree.These heading messages also can be recorded and narrated in the title of sequence integral body, also can record and narrate in the title of a plurality of pictures as each GOP (Group of pictures), perhaps in the title of picture.

Then, to as the coding of picture B11 the time, the management method of frame memory and with reference to the distribution method of image information, the method beyond the method shown in Figure 3 (being divided into the method that P picture and B picture manage with reference to candidate screen) describes.

At first, to the 1st example that the B picture that is divided into the P picture with reference to candidate screen manages, use Figure 11 to describe.

When the coding of picture B11 began, in frame memory 117, picture P4, P7, P10, P13 were held in P picture storage area, and B8, B9 are held in B picture storage area.Picture B11 encodes as the back picture P13 candidate screen that picture P7, B9, P10 are used as the forward direction reference to the candidate screen of reference then.The picture B11 that has encoded remains in the storage area that has kept picture P8.This is because picture B8 in the coding of the later picture of picture B11, does not use as the reference picture.

In the case, as with reference to image information, just be used to discern forward motion vector and be with reference to which of picture P7, B9, P10 and give the method for each picture with reference to the information distribution of the resulting motion vector of candidate screen, with the example of distribution method shown in Figure 3 similarly, use from order the reference candidate screen is given the method for numbering in time apart from the nearest beginning of object picture.

Just, the candidate screen (picture P10) before 1 in the object picture (picture B11) is given with reference to picture numbering [0], the candidate screen (picture B9) before 2 in the object picture is given with reference to picture numbering [1].Candidate screen (picture P7) before 3 in the object picture is given with reference to picture numbering [2[.

Then,, be divided into the 2nd example that the B picture of P picture manages, use Figure 12 to describe with reference to candidate screen to when the coding of picture B11.

In this example, about storage management since with the 1st routine identical Therefore, omited explanation illustrated in fig. 11.

In the case, as the addition method of reference image information, make to be kept at the P picture and preferentially to be numbered additional method with the picture in the storage area.Thereby, picture P10 is given with reference to picture numbering [0], picture P7 is given with reference to picture numbering [1], picture B9 is given with reference to picture numbering [2].

Then,, be divided into the 3rd example that the B picture of P picture manages, use Figure 13 to describe with reference to candidate screen to when the coding of picture B11.

In this 3rd example, about storage management since with the 1st routine identical Therefore, omited explanation illustrated in fig. 11.

In the case, as the addition method of reference image information, make to be kept at the B picture and preferentially to be numbered additional method with the picture in the storage area.Thereby, picture B9 is given with reference to picture numbering [0], picture P10 is given with reference to picture numbering [1], picture P7 is given with reference to picture numbering [2].

Then,, be divided into the 4th example that the B picture of P picture manages, use Figure 14 to describe with reference to candidate screen to when the coding of picture B11.

In this 4th example, about storage management since with the 1st routine identical Therefore, omited explanation illustrated in fig. 11.

In the case, addition method as the reference image information, use each picture to encoding, decision are to make the picture of being preserved in which zone with storage area with storage area and B picture at the P picture preferential, come additional method with reference to image information.

Specifically, for example, according to the hithermost in time kind with reference to candidate screen of the object picture that becomes coded object relatively, deciding is which memory preferentially is numbered is additional.

Because in the coding of picture B11, the hithermost in time forward direction of object picture is picture P10 with reference to picture relatively, so make the picture of being preserved in storage area at the P picture preferentially be numbered additional.

Thereby, picture P10 is given with reference to picture numbering [0], picture P7 is given with reference to picture numbering [1], picture B9 is given with reference to picture numbering [2].In addition in the case, make the P picture preferentially carry out the information of giving expression, record and narrate in the title of picture with reference to the picture numbering with the picture of storage area.

In addition, in the method (Fig. 3, Figure 11～5 methods shown in Figure 14) of when the coding of picture B11, reference picture numbering being distributed, same with the situation of the coding of picture P13, to establish with reference to the value of picture numbering more for a short time, expression is just short more with reference to the code length of the code of picture numbering.

In addition, same with the situation of the coding of P picture P13 in the coding of B picture B11, also can select to use any one in above-mentioned 5 methods in advance.Also can switch a plurality of methods in these 5 methods of use.But, preferably will use the information of which method and so on for example to record and narrate as heading message switching under the situation of using a plurality of methods.

In addition, by as heading message, record expression B picture also is used as forward direction B picture implements the inter-picture prediction encoding process with reference to candidate screen, and the candidate screen of the forward direction reference of using when the coding of B picture is, the information of 2 I or P picture and 1 B picture, just can learn when the code sequence that the dynamic image encoding device 10 by this form of implementation 1 is generated is decoded the frame memory that need have the memory capacity of which kind of degree.These heading messages also can be recorded and narrated in the title of sequence integral body, also can record and narrate in the title of a plurality of pictures as each GOP (Group of pictures), perhaps in the title of picture.

At last, to as the coding of picture B12 the time, the management method of frame memory and with reference to the distribution method of image information, the method beyond the method shown in Figure 3 (being divided into the method that P picture and B picture manage with reference to candidate screen) describes.

But, about Figure 11～the 1st example～the 3rd example shown in Figure 13, since identical with the situation of the coding of picture B11, the Therefore, omited explanation.

Therefore, about picture B12, use Figure 14 only to illustrate and be divided into the 4th example that P picture and B picture manage with reference to candidate screen.

In this 4th example, about storage management since be divided into the 1st routine identical Therefore, omited explanation that P picture and B picture manage with reference to candidate screen when the coding of picture B11.

In the case, as with reference to image information, just be used to discern forward motion vector and be with reference to which of picture P7, P10, B11 and give the method for each picture with reference to the information distribution of the resulting motion vector of candidate screen, use each picture to encoding, decision are to make the preferential method of candidate screen of being preserved in which zone with storage area with storage area and B picture at the P picture.

Specifically for example, in the coding of picture B12, according to the hithermost in time kind with reference to picture of distance object picture, deciding is to make the candidate screen of which storage area preferentially be numbered additional.

Because in the coding of picture B12, be picture B11 apart from the candidate screen of the hithermost in time forward direction reference of object picture (picture B12), so make the picture of being preserved in storage area at the B picture preferentially be numbered additional.

Thereby, picture B11 is given with reference to picture numbering [0], picture P10 is given with reference to picture numbering [1], picture P7 is given with reference to picture numbering [2].In addition in the case, make the B picture preferentially carry out the information of giving expression, record and narrate in the title of picture with reference to the picture numbering with the picture of storage area.

In addition, as heading message, same with the situation that picture B11 is encoded, record expression B picture also is used as forward direction B picture implements the inter-picture prediction encoding process with reference to candidate screen, and the candidate screen of the forward direction reference of using when the coding of B picture is, the information of 2 I or P picture and 1 B picture.

In addition, although in above-mentioned form of implementation 1, just the quantity with reference to candidate screen for the P picture is 3, candidate screen for the forward direction reference of B picture is the situation of 2 P pictures and 1 B picture, illustrated the management method of frame memory 5 examples (Fig. 3, Figure 11～Figure 14), but 5 examples of the management method of frame memory also can be applied to respectively with reference to the different situation of the quantity of candidate screen and form of implementation 1.Need not superfluous words, with reference to the quantity of candidate screen under the different situation, the capacity of frame memory is different with form of implementation 1 like this.

In addition, although in above-mentioned form of implementation 1, be illustrated in being distinguished into reference to candidate screen in the method (4 examples shown in Figure 11～Figure 14) that P picture and B picture manage frame memory, the P picture is saved in P picture storage area, the B picture is saved in the situation of B picture with storage area, but in the memory cell of savings picture, also can utilize in H.263++ picture memory between defined short-term, and picture memory for a long time.For example, have picture between short-term is utilized with storage area as the P picture with storage, the method that picture memory between long-term is utilized with storage area as the B picture.

(form of implementation 2)

Then form of implementation 2 of the present invention is described.

Figure 15 is the block diagram that explanation utilizes the moving image decoding apparatus of form of implementation 2 of the present invention to use.

The moving image decoding apparatus 20 of this form of implementation 2 is decoded to the code sequence Bs that exports from the dynamic image encoding device 10 of above-mentioned form of implementation 1.

Just, this moving image decoding apparatus 20 has, analyze the code sequence analytic unit 201 that above-mentioned code sequence Bs carries out the extraction of various data, coded data Ed from 201 outputs of this code sequence analytic unit is decoded and the predicated error decoding unit 202 of prediction of output error information PDd, with based on selecting relevant mode information (coded system) Ms output switch control signal Cs with the mode that is extracted by this code sequence analytic unit 201, export the mode decoding unit 223 of this mode information (coded system) Ms simultaneously.

Moving image decoding apparatus 20 has, preserve the decoded image data DId of institute, simultaneously with the view data of being preserved as comparable data Rd or output image data Od export with reference to picture with memory 207, based on from these data of reading with memory 207 (reference image data) Rd with reference to picture, the information of the motion vector MV that is extracted by above-mentioned code sequence analytic unit 201 and from the coded system Ms of aforesaid way decoding unit 223, the motion compensation decoding unit 205 of generation forecast data Pd, with the dateout PDd that above-mentioned prediction data Pd is added to above-mentioned predicated error decoding unit 202, the add operation unit 208 of generating solution code data Ad.

Moving image decoding apparatus 20 has, based on by 201 extracting header information of above-mentioned code sequence analytic unit Ih, control with reference to the memory control unit 204 of picture by memory control signal Cm with memory 207, be arranged on the selector switch 209 between above-mentioned predicated error decoding unit 202 and the add operation unit 208, and be arranged on this add operation unit 208 and with reference to picture with the selector switch 210 between the memory 207.

Here, above-mentioned selector switch 209 has an input terminal Te and two lead-out terminal Tf1 and Tf2, and according to above-mentioned switch controlling signal Cs, this input terminal Te is connected to the side of above-mentioned two lead-out terminal Tf1, Tf2.Above-mentioned selector switch 210 has two input terminal Tg1 and Tg2 and a lead-out terminal Th, and according to above-mentioned switch controlling signal Cs, this lead-out terminal Th is connected to the side of above-mentioned two input terminal Tg1, Tg2.In addition, by above-mentioned selector switch 209, dateout PDd to input terminal Te input predicated error decoding unit 202, from a side lead-out terminal Tf1 the input terminal Tg1 of selector switch 210 is exported the dateout PDd of above-mentioned predicated error decoding unit 202, from the opposing party's lead-out terminal Tf2 dateout PDd to the above-mentioned predicated error decoding unit 202 of add operation unit 208 outputs.By above-mentioned selector switch 210, one side's input terminal Tg1 is imported the dateout PDd of above-mentioned predicated error decoding unit 202, the opposing party's input terminal Tg2 is imported the dateout Ad of add operation unit 208, from lead-out terminal Th, the side of this dateout PDd and Ad is output to reference to picture memory 207 as decode image data DId.

In addition, moving image decoding apparatus 20 has, and storage is from the motion vector MV of motion compensation decoding unit 205, and the motion vector storage unit 226 that the motion vector MV that is stored is exported to above-mentioned motion compensation decoding unit 205.

Then action is described.

In addition, in the following description, the object picture that becomes decoder object relatively is meant that showing the picture that is positioned at the place ahead or rear on the time shaft relative object picture is in the picture at the place ahead or rear in time, perhaps also is called forward direction or back simply to picture.

In moving image decoding apparatus shown in Figure 15 20, the code sequence Bs that input is generated by the dynamic image encoding device 10 of form of implementation 1.Here, the code sequence of P picture 1 of 3 candidate screen (I or P picture) nearby that is positioned at the place ahead or rear with reference to relative P picture in time implements the inter-picture prediction coding and obtains.In addition, the code sequence of B picture be with reference to relative this B picture be arranged in the place ahead or rear 4 candidate screen (just be in time 2 I in the most nearby the place ahead or P picture, in time be in 1 B picture the most nearby and be positioned at the I or the P picture at rear in time) 2 implement the inter-picture prediction coding and obtain.Here, in 4 candidate screen, comprise other the B picture that this object B picture relatively is in the place ahead in time for the B picture of process object.

In addition, the P picture or the B picture that become process object are with reference to what kind of candidate screen to encode, and the heading message that also can be used as code sequence is recorded and narrated and judged.Thereby the coding of process object picture is with reference to what kind of picture to carry out, and just can learn that this heading message Ih is to memory control unit 204 outputs by extracting this heading message by code sequence analytic unit 201.

In the code sequence in the case, the arrangement of the coded data of corresponding picture as Figure 16 (a), becomes coded sequence.

Specifically, the coded data of the corresponding picture among the code sequence Bs is arranged by the order of picture P4, B2, B3, P7, B5, B6, P10, B8, B9, P13, B11, B12, P16, B14, B15.In other words, the arrangement of this picture becomes from the decode time axle Y of expression decode time Tdec and goes up configuration has been carried out in decode time beginning early in order to each picture arrangement (arrangement of decoding order).

In addition, Figure 16 (b), the picture that expression will be arranged by above-mentioned decoding order changes the arrangement of the picture of lining up DISPLAY ORDER.Just, shown in Figure 16 (b), the arrangement of picture B2, B3, P4, B5, B6, P7, B8, B9, P10, B11, B12, P13, B14, B15, P16 becomes from the demonstration time shaft X of expression demonstration time T dis and goes up configuration has been carried out in the beginning early of demonstration time in order to each picture arrangement (arrangement of DISPLAY ORDER).

Below, the decoding processing of picture P13, B11, B12 is described in order.

The decoding processing of＜picture P13 〉

The code sequence of picture P13 is imported into code sequence analytic unit 201.Code sequence analytic unit 201 carries out extracting from institute's input code sequence the processing of various data.Here various data are to say that the mode of carrying out selects the information of usefulness, the information (the following motion vector that also abbreviates as) of the information of presentation code mode Ms (the following coded system that also abbreviates as) and expression motion vector MV just, heading message, coded data (view data) etc.The coded system Ms that is extracted is output to mode decoding unit 203.In addition, the motion vector MV that is extracted is output to motion compensation decoding unit 205.And then the coded prediction error data Ed that is extracted by code sequence analytic unit 201 is output to predicated error decoding unit 202.

Mode decoding unit 203 based on from the coded system Ms that code sequence extracted, carries out the switching controls of switch 209 and 210.Under the situation of encoding in coded system is represented picture, control so that switch 209 its input terminal Te are connected to lead-out terminal Tf1, switch 210 its lead-out terminal Th are connected to input terminal Tg1.On the other hand, represent in coded system to control so that switch 209 its input terminal Te are connected to lead-out terminal Tf2 under the situation of inter-picture prediction coding, switch 210 its lead-out terminal Th are connected to input terminal Tg2.In addition, mode decoding unit 203 outputs to motion compensation decoding unit 205 with coded system Ms.

Below, coded system is represented the situation of inter-picture prediction coding describes.

Predicated error decoding unit 202 carries out the decoding of the coded data Ed that imported, generation forecast error information PDd.The prediction error data PDd that is generated is output to switch 209.In the case, because switch 209 its input terminal Te are connected to lead-out terminal Tf2, so prediction error data PDd is output to add operation unit 208.

Motion compensation decoding unit 205 carries out motion compensation based on the motion vector MV that is extracted by analytic unit 201 with reference to picture numbering Rp, obtains motion compensated image from the reference picture with memory 207.This motion compensated image is in the object picture, the image in the zone of corresponding decoder object piece.

Picture P13 implements picture P4, P7, P10 to encode as the candidate screen of forward direction reference, and for the decoding processing of picture P13 the time, these candidate screen are decoded and remain in reference to picture with memory 207.

Therefore, motion compensation decoding unit 205 according to reference frame numbering Rp, decides the object piece of above-mentioned picture P13, is which picture with above-mentioned picture P4, P7, P10 is as encoding with reference to picture.Then, motion compensation decoding unit 205 with memory 207, is obtained with reference to the image in the zone of the object piece in the picture correspondence from the reference picture based on motion vector as motion compensated image.

Use Fig. 3 that the situation that the time of the picture that is kept with memory 207 by the reference picture changes is described, and with reference to the determining method of picture.

With reference to picture with the control of memory 207, by memory control unit 204, based on from code sequence heading message extracted, expression P picture and B picture be what kind of to carry out carry out with reference to resulting information (with reference to image information).

As shown in Figure 3, the storage area (#1)～(#5) that has 5 picture amounts with reference to picture with memory 207.When the decoding of picture P13 begins, maintain picture B8, P4, P7, P10, B9 in memory at the reference picture.Picture P13 as decoding with reference to the candidate of picture, in the storage area that has kept picture B8, keeps the decoded pictures P13 of institute with picture P4, P7, P10 then.This be because, picture P4, P7, P10, be used as the candidate with reference to picture during the decoding of the picture that (comprises picture P13) after for picture P13, picture B8 is not used as with reference to picture during the decoding of the picture that (comprises picture P13) after for picture P13.

In addition, in Fig. 3, the picture shown in the circular mark is the moment of having finished in the decoding of object picture, is put aside in the picture (object picture) of reference picture with memory 207 at last.

In the case, the motion vector of the object piece of picture P13 is with reference to which picture to obtain, just can be according to being additional to determining with reference to image information of motion vector.

Here, specifically be exactly to number with reference to image information with reference to picture.And, to numbering for giving with reference to picture of picture P13 with reference to candidate screen.At this moment, to becoming with reference to the picture numbering that the reference candidate screen is distributed, near more in time apart from object picture (picture P13) with reference to candidate screen, value is more little numbering just.

Just, when when the object piece of picture P13 is encoded with reference under the situation of picture P10, the information (for example with reference to picture numbering [0]) that the candidate screen (picture P10) before 1 of the indicated object picture is used as with reference to picture is is just recorded and narrated in the code sequence of object piece.In addition, when when the object piece is encoded with reference under the situation of picture P7, candidate screen before 2 of the indicated object picture is used as the information (for example with reference to picture numbering [1]) with reference to picture, with reference under the situation of picture P4, candidate screen before 3 of the indicated object picture is used as the information (for example with reference to picture numbering [2]) with reference to picture, just is attached in the code sequence of object piece.

Number with reference to picture according to this, just can learn which candidate screen is used as with reference to picture when the coding of object piece.

Like this, motion compensation decoding unit 205, use motion vector and with reference to image information from the reference picture with memory 207, obtain motion compensated image, just with reference to the image in the zone of corresponding objects piece in the picture.

The motion compensated image that is generated is output to add operation unit 208 like this.

In addition, motion compensation decoding unit 205 under the situation of the decoding of carrying out the P picture, outputs to motion vector storage unit 226 with motion vector MV with reference to image information Rp.

Add operation unit 208 is with data (prediction data) Pd of prediction error data PDd and the motion compensated image generating solution code data Ad that adds up mutually.The decoded data Ad that is generated is output to reference to picture memory 207 as decode image data DId by switch 210.

As top, the piece of picture P13 is decoded in order.When whole pieces of picture P13 are decoded, carry out the decoding of picture B11.

The decoding processing of＜picture B11 〉

Because the action of code sequence analytic unit 201, mode decoding unit 203 and predicated error decoding unit 202, similarly carry out its explanation of Therefore, omited during with the decoding processing of picture P13.

Motion compensation decoding unit 205 generates moving compensating data from the information of the motion vector imported etc.Be motion vector and number from what code sequence analytic unit 201 was input to motion compensation decoding unit 205 with reference to picture.Picture B11 is by with picture P7, B9 and the P10 candidate screen as the forward direction reference, and picture P13 is handled and obtains to the predictive coding of the candidate screen of reference as the back.These have been implemented decoding processing constantly and have put aside with reference to picture with memory 207 in the decoding of object picture with reference to candidate screen.

Below, use Fig. 3 that the situation that the time of the picture that is kept with memory 207 by the reference picture changes is described, and with reference to the determining method of picture.

With reference to picture with the control of memory 207, by memory control unit 204, based on from code sequence heading message extracted, P picture and B picture are what kind of to carry out carry out with reference to the information Ih that is encoded and so on.

When the decoding of picture B11 begins, as shown in Figure 3, maintain picture P13, P4, P7, P10, B9 in memory at the reference picture.In picture B11, the candidate screen with picture P7, B9, P10 are used as the forward direction reference as then implementing decoding processing to the reference picture, in the storage area that has kept picture P4, keeps the decoded pictures B11 of institute with picture P13 then.This is because picture P4 is not used as the candidate with reference to picture when the decoding of the later picture of picture B11.

In the case, forward motion vector is with reference to which candidate screen to obtain, just can be according to being additional to determining with reference to image information of motion vector.

Just, when when the object piece of picture B11 is encoded with reference under the situation of picture P10, the information (for example with reference to picture numbering [0]) that the candidate screen (picture P10) before 1 of the indicated object picture is used as with reference to picture is is just recorded and narrated in the code sequence of object piece.In addition, when when the object piece is encoded with reference under the situation of picture B9, candidate screen before 2 of the indicated object picture is used as the information (for example with reference to picture numbering [1]) with reference to picture, with reference under the situation of picture P7, candidate screen before 3 of the indicated object picture is used as the information (for example with reference to picture numbering [2]) with reference to picture, just is attached in the code sequence of object piece.

Thereby, number with reference to picture according to this, just can learn which candidate screen is used as with reference to picture when the coding of object piece.

Motion compensation decoding unit 205 is chosen as in mode under the situation of bi-directional predicted predictive pictures coding, according to reference picture numbering, decides which picture to picture P7, B9 and P10 to carry out the forward direction reference.Then, obtain the forward motion compensation image from the reference picture with memory 207, in addition, obtain the reverse compensating images from the reference picture with memory 207 based on backward motion vector based on forward motion vector.

Then, motion compensation decoding unit 205 by the summation averaging of forward motion compensation image and reverse compensating images, generates motion compensated image.

Then, the processing of using forward direction and backward motion vector to generate motion compensated image is described.

(bi-directional predicted mode)

Figure 17 represents that the decoder object picture is picture B11, and piece (object piece) BLa01 of the decoder object that becomes picture B11 is carried out the situation of bi-directional predicted decoding.

At first, illustrate that forward direction is picture P10 with reference to picture, the back is the situation of picture P13 to the reference picture.

In the case, forward motion vector is the motion vector MVe01 of the zone C Re01 of the expression corresponding blocks BLa01 of picture P10.Backward motion vector is the motion vector MVg01 of the zone C Rg01 of the expression corresponding blocks BLa01 of picture P13.

Thereby, motion compensation decoding unit 205, from reference picture memory 207, obtain the image of the zone C Re01 among the picture P10 with reference to image as forward direction, as the image of afterwards obtaining the zone C Rg01 among the picture P13 to the reference image, the image of these two zone C Re01 and CRg01 is implemented the summation averaging of view data, obtain motion compensated image for above-mentioned object piece BLa01.

Then, illustrate that forward direction is picture B9 with reference to picture, the back is the situation of picture P13 to the reference picture.

In the case, forward motion vector is the motion vector MVf01 of the zone C Rf01 of the expression corresponding blocks BLa01 of picture B9.Backward motion vector is the motion vector MVg01 of the zone C Rg01 of the expression corresponding blocks BLa01 of picture P13.

Thereby, motion compensation decoding unit 205, from reference picture memory 207, obtain the image of the zone C Rf01 among the picture B9 with reference to image as forward direction, as the image of afterwards obtaining the zone C Rg01 among the picture P13 to the reference image, the image of these two zone C Rf01 and CRg01 is implemented the summation averaging of view data, obtain motion compensated image for above-mentioned object piece BLa01.

(direct mode)

In addition, in coded system is under the situation of direct mode, motion compensation decoding unit 205, obtain and in motion vector storage unit 226, stored, for object picture B11 back to reference picture P13, for the motion vector (benchmark motion vector) of the relative position of the picture piece identical with the object piece.Motion compensation decoding unit 205, and then use this benchmark motion vector, obtain forward direction with reference to image and back from the reference picture with memory 207 to the reference image.Then, the 205 pairs of forward directions in motion compensation decoding unit generate the motion compensated image for above-mentioned object piece with reference to image and the summation averaging of back to reference image enforcement view data.In addition, in the following description,, also be called the piece that is in specific same position of a picture simply for the piece in the relative position of picture and other pictures that specific piece in the picture equates.

Figure 18 (a) expression is with reference near the picture P10 before the picture B11, the situation (the 1st example of direct mode decoding) of the piece BLa10 of picture B11 being decoded with direct mode.

Here, the benchmark motion vector that uses in the decoding under the direct mode of piece BLa10 is, the back is to picture (reference pictures) P13 of reference when the decoding of piece BLa10, is in forward motion vector (benchmark motion vector) MVh10 with piece (reference block) BLg10 of piece BLa10 same position.This forward direction motion vector MVh10 is near the picture P10 before the picture B11, represents the motion vector of the zone C Rh10 of corresponding reference block BLg10.

In the case, in the forward motion vector MVk10 of the piece BLa10 that becomes decoder object, use above-mentioned picture P10, the zone C Rk10's of expression corresponding objects piece BLa10 with the parallel motion vector of said reference motion vector MVh10.In addition, in the backward motion vector MVi10 of the piece BLa10 that becomes decoder object, use above-mentioned picture P13, the zone C Ri10's of expression corresponding objects piece BLa10 with the parallel motion vector of said reference motion vector MVh10.

Thereby, motion compensation decoding unit 205, from reference picture memory 207, obtain the image of forward direction as forward direction with reference to image with reference to the zone C Rk10 of picture P10, obtain the image of back as the back to the reference image to the zone C Ri10 of reference picture P13, by summation averaging, obtain motion compensated image (predicted picture) for object piece BLa10 for the view data of these two images.

In the case, the size of forward motion vector MVk10 (MVF), and the size (MVB) of backward motion vector MVi10, the size (MVR) of use said reference motion vector MVh10 is obtained by above-mentioned (formula 1), (formula 2).

Here, establish horizontal composition, the vertical composition of big or small MVF, the MVB difference expressive movement vector of each motion vector.

In addition, TRD is, for the object piece BLa10 of picture B11 back to reference picture P13 and in this back the time gap to the picture P10 of the decoding time institute forward direction reference of piece (reference block) BLg10 of reference picture (reference pictures).TRF is, picture B11 and its be near the preceding time gap with reference to picture P10, and TRB is, picture B11 and with reference to the time gap of back to the picture (picture P10) of the piece BLg10 of reference picture P13.

Figure 18 (b) expression is with reference near the picture P10 before the picture B11, the situation (the 2nd example of direct mode decoding) of the piece BLa10 of picture B11 being decoded with direct mode.

In the 2nd example of this direct mode decoding, different with the 1st example of the direct mode decoding shown in Figure 18 (a), picture in the decoding time institute forward direction reference of reference block (just for object piece back to the reference picture, with the piece of object piece same position) becomes picture P7.

Just, the benchmark motion vector that uses in the decoding under the direct mode of piece BLa20 is, the back is in the forward motion vector MVh20 with the piece BLg20 of piece BLa20 same position to the picture P13 of reference when the decoding of piece BLa20.This forward direction motion vector MVh20 is the picture P7 that is positioned at the place ahead of object picture B11, represents the motion vector of the zone C Rh20 of corresponding reference block BLg20.

In the case, in the forward motion vector MVk20 of the piece BLa20 that becomes decoder object, use above-mentioned picture P10, the zone C Rk20's of expression corresponding objects piece BLa20 with the parallel motion vector of said reference motion vector MVh20.In addition, in the backward motion vector MVi20 of the piece BLa20 that becomes decoder object, use above-mentioned picture P13, the zone C Ri20's of expression corresponding objects piece BLa20 with the parallel motion vector of said reference motion vector MVh20.

Thereby, motion compensation decoding unit 205, from reference picture memory 207, obtain the image of forward direction as forward direction with reference to image with reference to the zone C Rk20 of picture P10, obtain the image of back as the back to the reference image to the zone C Ri20 of reference picture P13, by summation averaging, obtain motion compensated image (predicted picture) for object piece BLa20 for the view data of these two images.

The size of forward motion vector MVk20 in the case (MVF), and the size (MVB) of backward motion vector MVi20, use the size (MVR) of said reference motion vector MVh20, same with the 1st example of above-mentioned direct mode decoding, obtain by above-mentioned (formula 1), (formula 2).

Figure 19 (a) expression is with reference to than the picture P7 that also is positioned at the place ahead near the picture P10 before the picture B11, the situation (the 3rd example of direct mode decoding) of the piece BLa30 of picture B11 being decoded with direct mode.

In the 3rd example of this direct mode decoding, different with the 1st example of the direct mode decoding shown in Figure 18 (a) and Figure 18 (b) with the 2nd example, picture in the decoding time institute forward direction reference of object piece, not near the picture before the object picture, but at the picture of the decoding time institute forward direction reference of the reference block (with the piece of object piece same position) of reference pictures.Here, reference pictures be when the decoding of object piece the back to the picture of reference.

Just, the benchmark motion vector that uses in the decoding under the direct mode of piece BLa30 is, the back is in the forward motion vector MVh30 with the piece BLg30 of piece BLa30 same position to the picture P13 of reference when the decoding of piece BLa30.This forward direction motion vector MVh30 is the picture P7 that is positioned at the place ahead of object picture B11, represents the motion vector of the zone C Rh30 of corresponding reference block BLg30.

In the case, in the forward motion vector MVk30 of the piece BLa30 that becomes decoder object, use above-mentioned picture P7, the zone C Rk30's of expression corresponding objects piece BLa30 with the parallel motion vector of said reference motion vector MVh30.In addition, in the backward motion vector MVi30 of the piece BLa30 that becomes decoder object, use above-mentioned picture P13, the zone C Ri30's of expression corresponding objects piece BLa30 with the parallel motion vector of said reference motion vector MVh30.

Thereby, motion compensation decoding unit 205, from reference picture memory 207, obtain the image of forward direction as forward direction with reference to image with reference to the zone C Rk30 of picture P7, obtain the image of back as the back to the reference image to the zone C Ri30 of reference picture P13, by summation averaging, obtain motion compensated image (predicted picture) for object piece BLa30 for the view data of these two images.

The size of forward motion vector MVk30 in the case (MVF), and the size (MVB) of backward motion vector MVi30, the size (MVR) of use said reference motion vector MVh30 is obtained by above-mentioned (formula 1), (formula 2).

In addition, here, when at the picture of the decoding time institute reference of piece BLg30 under the situation of reference picture with memory 207 deletions, the forward direction picture P10 that is arranged in is in time the most nearby got final product with reference to picture as the forward direction of the 3rd example of direct mode decoding.Processing in the 3rd example of direct mode decoding in the case, identical with the 1st example of direct mode decoding.

It is 0 motion vector that size is used in Figure 19 (b) expression, the situation (the 4th example that direct mode is decoded) of the piece BLa40 of picture B11 being decoded with direct mode.

In the 4th example of this direct mode decoding, the 1st example of the decoding of the direct mode shown in Figure 18 (a) and Figure 18 (b) and the size of the benchmark motion vector in the 2nd example are made as 0.

In the case, in the forward motion vector MVk40 and backward motion vector MVi40 of the piece BLa40 that becomes decoder object, the use size is 0 motion vector.

Just, above-mentioned forward motion vector MVk40, expression picture P10's, be positioned at object piece BLa40 same position, with zone (piece) CRk40 of the same size of object piece.In addition, above-mentioned backward motion vector MVi40, expression picture P13's, be positioned at object piece BLa40 same position, with zone (piece) CRi40 of the same size of object piece.

Thereby, motion compensation decoding unit 205, from reference picture memory 207, obtain the image of forward direction as forward direction with reference to image with reference to zone (piece) CRk40 of picture P10, obtain the image of back as the back to the reference image to the zone C Ri40 of reference picture P13, by summation averaging, obtain motion compensated image (predicted picture) for object piece BLa40 for the view data of these two images.The method also can be applied to, and for example, is not have the such situation of piece of motion vector as by the piece of intraframe coding as picture B11 the back piece that is in piece BLa40 same position in the picture P13 of reference picture.

The data of the motion compensated image that is generated are to 208 outputs of add operation unit like this.In add operation unit 208, the prediction error data imported and the data of motion compensated image are added up mutually, generate the data of decoded picture.The data of the decoded picture that is generated are output to reference to picture memory 207 by switch 210, and decoded picture is put aside this with reference to picture memory 207.

Memory control unit 204, based on from code sequence heading message extracted, P picture and B picture are what kind of to carry out with reference to the information Ih that is encoded and so on, carry out with reference to the control of picture with memory 207.

As top, the piece of picture B11 is decoded in order.When whole pieces of picture B11 are decoded, carry out the decoding of picture B12.

In addition, in the decoding of above-mentioned B picture, the situation that specific piece is handled as skipped blocks is arranged, below, the decoding of skipped blocks is described simply.

In the decoding processing of the code sequence of being imported, when by the jump identifier in this code sequence, recorded and narrated and number information of piece etc., distinguished that specific is used as under the situation that skipped blocks handles, carry out motion compensation with direct mode, just the predicted picture of corresponding objects piece obtains.

For example, such shown in Fig. 6 (b), under the situation that the piece MB (r) of picture B11 and the piece MB (r+1) between the piece MB (r+1) and piece MB (r+2) are handled as skipped blocks, in moving image decoding apparatus 20, as the jump identifier Sf that detects by code sequence analytic unit 201 among the code sequence Bs, when this jump identifier Sf was imported into mode decoding unit 223,223 pairs of motion compensation decoding unit of mode decoding unit send instruction made it carry out motion compensation with direct mode.

So, in motion compensation decoding unit 205, as described above, based on as forward direction with reference to the forward direction of image with reference to picture P10's, with as the image of the piece of the piece same position of skipped blocks and as the back to the reference image, with the image of the piece of the piece same position of handling as skipped blocks, obtain the predicted picture of piece MB (r+1) and MB (r+2), and the data of predicted picture are outputed to add operation unit 208.In addition, predicated error decoding unit 202, as the differential data of the piece that is treated to skipped blocks, output valve is 0 data.In the add operation unit, because the differential data of the piece of handling as skipped blocks is 0, so the data of the predicted picture of piece MB (r+1) and MB (r+2), the data that are used as the decoded picture of piece MB (r+1) and MB (r+2) output to reference to picture memory 207.

In addition, there is following situation, processing example under the direct mode shown in Figure 18 (a) (the 1st example), processing example under the direct mode shown in Figure 18 (b) (the 2nd example), in the processing example under the direct mode shown in 19 (a) (the 3rd example), not to be that 0 piece is all handled as skipped blocks with differential data, but with relative object picture be positioned in time near preceding picture as forward direction with reference to picture, and using size is that 0 motion vector carries out bi-directional predicted for the object piece, only under the differential data of object piece is 0 situation, this object piece is handled as skipped blocks.

Under these circumstances, when the jump identifier from code sequence Bs etc. learns that specific piece is skipped blocks, motion compensation process, by will be in time near preceding with reference to picture as forward direction with reference to picture, motion is 0 bi-directional predicted carrying out.

The decoding processing of＜picture B12 〉

Because the action of code sequence analytic unit 201, mode decoding unit 203 and predicated error decoding unit 202, similarly carry out its explanation of Therefore, omited during with the decoding processing of picture P10.

Motion compensation decoding unit 205 generates motion-compensated image data from the information of the motion vector imported etc.That be input to motion compensation decoding unit 205 is motion vector MV and with reference to picture numbering Rp.Picture B12 is with picture P7, P10 and the B11 candidate screen as the forward direction reference, and picture P13 is implemented encoding process as the back to the candidate screen of reference.In addition, these candidate screen are decoded constantly and put aside with reference to picture with memory 207 in the decoding of object picture.

In addition, the situation that the time of the picture that is kept with memory 207 by the reference picture changes, and with reference to the determining method of picture, the method with using Fig. 3 during the decoding of illustrated picture B11 is identical.

In the presentation code mode is under the situation of bi-directional predictive coding mode, and motion compensation decoding unit 205 according to reference picture numbering, decides which picture to picture P7, P10 and B11 to carry out the forward direction reference.Then, forward direction obtained with reference to image from the reference picture with memory 207 based on forward motion vector in motion compensation decoding unit 205, in addition, obtains back to reference image from the reference picture with memory 207 based on backward motion vector.Then, motion compensation decoding unit 205 by forward direction is implemented the summation averaging of view data with reference to image and back to the reference image, generates the motion compensated image for the object piece.

(bi-directional predicted mode)

Figure 20 represents that the decoder object picture is picture B12, and piece (object piece) BLa02 of the decoder object that becomes picture B12 is carried out the situation of bi-directional predicted decoding.

At first, illustrate that forward direction is picture B11 with reference to picture, the back is the situation of picture P13 to the reference picture.

In the case, forward motion vector is the motion vector MVe02 of the zone C Re02 of the expression corresponding blocks BLa02 of picture B11.Backward motion vector is the motion vector MVg02 of the zone C Rg02 of the expression corresponding blocks BLa02 of picture P13.

Thereby, motion compensation decoding unit 205, from reference picture memory 207, obtain the image of the zone C Re02 among the picture B11 with reference to image as forward direction, as the image of afterwards obtaining the zone C Rg02 among the picture P13 to the reference image, the image of these two zone C Re02 and CRg02 is implemented the summation averaging of view data, obtain motion compensated image for above-mentioned object piece BLa02.

Then, illustrate that forward direction is picture P10 with reference to picture, the back is the situation of picture P13 to the reference picture.

In the case, forward motion vector is the motion vector MVf02 of the zone C Rf02 of the expression corresponding blocks BLa02 of picture P10.Backward motion vector is the motion vector MVg02 of the zone C Rg02 of the expression corresponding blocks BLa02 of picture P13.

Thereby, motion compensation decoding unit 205, from reference picture memory 207, obtain the image of the zone C Rf02 among the picture P10 with reference to image as forward direction, as the image of afterwards obtaining the zone C Rg02 among the picture P13 to the reference image, the image of these two zone C Rf02 and CRg02 is implemented the summation averaging of view data, obtain motion compensated image for above-mentioned object piece BLa02.

(direct mode)

In addition, in coded system is under the situation of direct mode, motion compensation decoding unit 205, obtain and in motion vector storage unit 226, stored, for the motion vector (benchmark motion vector) of the back reference block (piece that relative position is identical with the object piece) of object picture B12 to reference picture P13.Motion compensation decoding unit 205, and then use this benchmark motion vector, obtain forward direction with reference to image and back from the reference picture with memory 207 to the reference image.Then, the 205 pairs of forward directions in motion compensation decoding unit generate the motion compensated image for above-mentioned object piece with reference to image and the summation averaging of back to reference image enforcement view data.

Figure 21 (a) expression is with reference near the picture B11 before the picture B12, the situation (the 1st example of direct mode decoding) of the piece BLa50 of picture B12 being decoded with direct mode.

Here, the benchmark motion vector that uses in the decoding under the direct mode of piece BLa50 is that the back is to the forward motion vector MVj50 of the reference block (being in the piece BLg50 with piece BLa50 same position) of the picture P13 of reference when the decoding of piece BLa50.This forward direction motion vector MVj50 is the place ahead picture P10 nearby that is positioned at picture B11, represents the motion vector of the zone C Rj50 of corresponding reference block BLg50.

In the case, in the forward motion vector MVk50 of the piece BLa50 that becomes decoder object, use above-mentioned picture B11, the zone C Rk50's of expression corresponding objects piece BLa50 with the parallel motion vector of said reference motion vector MVj50.In addition, in the backward motion vector MVi50 of the piece BLa50 that becomes decoder object, use above-mentioned picture P13, the zone C Ri50's of expression corresponding objects piece BLa50 with the parallel motion vector of said reference motion vector MVj50.

Thereby, motion compensation decoding unit 205, from reference picture memory 207, obtain the image of forward direction as forward direction with reference to image with reference to the zone C Rk50 of picture B11, obtain the image of back as the back to the reference image to the zone C Ri50 of reference picture P13, by summation averaging, obtain motion compensated image (predicted picture) for object piece BLa50 for the view data of these two images.

In the case, the size of forward motion vector MVk50 (MVF), and the size (MVB) of backward motion vector MVi50, the size (MVR) of use said reference motion vector MVj50 is obtained by above-mentioned (formula 1), (formula 2).

Here, establish horizontal composition, the vertical composition of big or small MVF, the MVB difference expressive movement vector of each motion vector.

Figure 21 (b) expression is with reference to the picture B11 in the place ahead of picture B12, the situation (the 2nd example of direct mode decoding) of the piece BLa60 of picture B12 being decoded with direct mode.

In the 2nd example of this direct mode decoding, different with the 1st example of the direct mode decoding shown in Figure 21 (a), picture in the decoding time institute forward direction reference of reference block (just for object piece back to the reference picture, with the piece of object piece same position) becomes picture P7.

Just, the benchmark motion vector that uses in the decoding under the direct mode of piece BLa60 is that the back is to the forward motion vector MVj60 of the reference block (being in the piece BLg60 with piece BLa60 same position) of the picture P13 of reference when the decoding of piece BLa60.This forward direction motion vector MVj60 is the picture P7 that is positioned at the place ahead of object picture B12, represents the motion vector of the zone C Rj60 of corresponding reference block BLg60.

In the case, in the forward motion vector MVk60 of the piece BLa60 that becomes decoder object, use above-mentioned picture B11, the zone C Rk60's of expression corresponding objects piece BLa60 with the parallel motion vector of said reference motion vector MVj60.In addition, in the backward motion vector MVi60 of the piece BLa60 that becomes decoder object, use above-mentioned picture P13, the zone C Ri60's of expression corresponding objects piece BLa60 with the parallel motion vector of said reference motion vector MVj60.

Thereby, motion compensation decoding unit 205, from reference picture memory 207, obtain the image of forward direction as forward direction with reference to image with reference to the zone C Rk60 of picture B11, obtain the image of back as the back to the reference image to the zone C Ri60 of reference picture P13, by summation averaging, obtain motion compensated image (predicted picture) for object piece BLa60 for the view data of these two images.

The size of forward motion vector MVk60 in the case (MVF), and the size (MVB) of backward motion vector MVi60, use the size (MVR) of said reference motion vector MVj60, same with the 1st example of above-mentioned direct mode decoding, obtain by above-mentioned (formula 1), (formula 2).

Figure 22 (a) expression is with reference to than the picture P7 that more is positioned at the place ahead at the forward direction picture P10 the most nearby of picture B12, the situation (the 3rd example of direct mode decoding) of the piece BLa70 of picture B12 being decoded with direct mode.

In the 3rd example of this direct mode decoding, different with the 1st example of the direct mode decoding shown in Figure 21 (a) and Figure 21 (b) with the 2nd example, picture in the decoding time institute forward direction reference of object piece, not near the picture before the object picture, but at the picture of the decoding time institute forward direction reference of the reference block of reference pictures.Here, reference pictures be when the decoding of object piece the back to the picture of reference.

Just, the benchmark motion vector that uses in the decoding under the direct mode of piece BLa70 is that the back is to the forward motion vector MVj70 of reference block (being in the piece with the piece BLa70 same position) BLg70 of the picture P13 of reference when the decoding of piece BLa70.This forward direction motion vector MVj70 is the picture P7 that is positioned at the place ahead of object picture B12, represents the motion vector of the zone C Rj70 of corresponding reference block BLg70.

In the case, in the forward motion vector MVk70 of the piece BLa70 that becomes decoder object, use above-mentioned picture P7, the zone C Rk70's of expression corresponding objects piece BLa70 with the parallel motion vector of said reference motion vector MVj70.In addition, in the backward motion vector MVi70 of the piece BLa70 that becomes decoder object, use above-mentioned picture P13, the zone C Ri70's of expression corresponding objects piece BLa70 with the parallel motion vector of said reference motion vector MVj70.

Thereby, motion compensation decoding unit 205, from reference picture memory 207, obtain the image of forward direction as forward direction with reference to image with reference to the zone C Rk70 of picture P7, obtain the image of back as the back to the reference image to the zone C Ri70 of reference picture P13, by summation averaging, obtain motion compensated image (predicted picture) for object piece BLa70 for the view data of these two images.

The size of forward motion vector MVk70 in the case (MVF), and the size (MVB) of backward motion vector MVi70, the size (MVR) of use said reference motion vector MVj70 is obtained by above-mentioned (formula 1), (formula 2).

In addition, here, when at the picture of the decoding time institute reference of piece BLg70 under the situation of reference picture with memory 207 deletions, the forward direction picture P10 that is arranged in is in time the most nearby got final product with reference to picture as the forward direction of the 3rd example of direct mode decoding.Processing in the 3rd example of direct mode decoding in the case, identical with the 1st example of direct mode decoding.

It is 0 motion vector that size is used in Figure 22 (b) expression, the situation (the 4th example that direct mode is decoded) of the piece BLa80 of picture B12 being decoded with direct mode.

In the 4th example of this direct mode decoding, the 1st example of the decoding of the direct mode shown in Figure 21 (a) and Figure 21 (b) and the size of the benchmark motion vector in the 2nd example are made as 0.

In the case, in the forward motion vector MVk80 and backward motion vector MVi80 of the piece BLa80 that becomes decoder object, the use size is 0 motion vector.

Just, above-mentioned forward motion vector MVk80, expression picture B11's, be positioned at object piece BLa80 same position, with zone (piece) CRk80 of the same size of object piece.In addition, above-mentioned backward motion vector MVi80, expression picture P13's, be positioned at object piece BLa80 same position, with zone (piece) CRi80 of the same size of object piece.

Thereby, motion compensation decoding unit 205, from reference picture memory 207, obtain the image of forward direction as forward direction with reference to image with reference to zone (piece) CRk80 of picture B11, obtain the image of back as the back to the reference image to the zone C Ri80 of reference picture P13, by summation averaging, obtain motion compensated image (predicted picture) for object piece BLa80 for the view data of these two images.The method also can be applied to, and for example, is not have the such situation of piece of motion vector as by the piece of intraframe coding as picture B12 the back piece that is in piece BLa80 same position in the picture P13 of reference picture.

The data of the motion compensated image that is generated are output to add operation unit 208 like this.Add operation unit 208 is with the data of the prediction error data imported and the motion compensated image generating solution sign indicating number view data of adding up mutually.The decode image data that is generated is output to reference to picture memory 207 by switch 210.

Like this, the piece of picture B12 is implemented decoding processing in order.The view data of each picture that is kept in memory 207 at the reference picture is rearranged the back in chronological order and exports as output image data Od.

Then, arranged by the decode time order like that shown in Figure 16 (a), the picture that picture B12 is later is according to picture type, by decoding with the same processing of above-mentioned picture P13, B11, B12.In addition, Figure 16 (b) expression is by the arrangement of the picture that shows row that time sequencing changes.

In addition, in the decoding processing of the code sequence of being imported, when by the jump identifier in this code sequence, recorded and narrated and number information of piece etc., distinguished that specific is used as under the situation that skipped blocks handles, similarly carry out motion compensation with direct mode with the situation of the decoding of picture B11, just the predicted picture of corresponding objects piece obtains.

Like this because in the moving image decoding apparatus 20 of this form of implementation 2, when the decoding of the piece of B picture, candidate screen as the forward direction reference is used the B picture of decoding with the P picture of decoding, based on to being comprised in should the code sequence of decoder object piece, be illustrated in the information (with reference to picture numbering) of candidate screen of the coding time institute forward direction reference of this piece, generation is for the predicted picture of this object piece, so just can be to the B picture is correctly decoded as the piece of the coded B picture of the candidate screen of forward direction reference.

In addition, because in moving image decoding apparatus 20, under the situation that the decoder object piece of B picture is encoded with direct mode, based on decoded P picture, motion vector with the piece of this decoder object piece same position, calculate the motion vector of decoder object piece, so just there is no need to be able to from the coding side-draw information of the motion vector of the coded piece of direct mode in the decoding side.

In addition, because in moving image decoding apparatus 20, based on what in code sequence, comprised as heading message, the information of used candidate screen when being illustrated in the coding of P picture and B picture, manage the data of the decoded picture of being put aside in memory at the reference picture, for example, in the moment that the decoding processing of a picture has been finished, delete the data that in the later decoding processing of this picture, can not be used as successively, so just can efficient utilize the picture memory well with reference to the picture of picture.

In addition, when the decoding of the piece of P picture, which picture in the candidate screen is used as with reference to picture, just, the motion vector of decoder object piece is with reference to which candidate screen to obtain, just can determining with reference to image information from be attached to motion vector information.

In addition, when the decoding of the piece of B picture, which picture in the candidate screen of forward direction reference is used as with reference to picture, just, the forward motion vector of decoder object piece, be to obtain with reference to which candidate screen, just can determining from be attached to motion vector information with reference to image information.

In addition, although in this form of implementation 2, just for one of a plurality of coded systems of B picture for the situation of direct mode is illustrated, also can not use direct mode as the coded system of B picture.In the case, the motion vector storage unit 226 that does not just need moving image decoding apparatus 20.

In addition, in this form of implementation 2, as direct mode, be that example is illustrated specifically with 4 methods (the 4th example shown in the 3rd example shown in the 2nd example shown in the 1st example shown in Figure 18 (a) and Figure 21 (a), Figure 18 (b) and Figure 21 (b), Figure 19 (a) and Figure 22 (a), Figure 19 (b) and Figure 22 (b) just), in decoding device, use and in code device, decode as the corresponding method of the used method of direct mode.Specifically, using as direct mode under the situation of a plurality of methods, use is recorded and narrated in code sequence, and expression has used the information of which kind of method to decode as concrete direct mode.

At this moment, the action of motion compensation decoding unit 205 just changes according to this information.For example, add under the situation of this information at block unit with motion compensation, use which method in above-mentioned 4 concrete grammars coded by mode decoding unit 223 decision as direct mode, and the concrete grammar of the direct mode that determined is sent to motion compensation decoding unit 205.Then, motion compensation decoding unit 205, which is used in above-mentioned 4 methods according to the concrete grammar as direct mode, carries out suitable motion compensated prediction decoding processing.

In addition, the information (DM mode information) that is used and so in which method of concrete grammar as direct mode, record and narrate title in sequence integral body, GOP title, picture title or in the bar title situation under, to each sequence integral body, GOP, picture or picture bar, DM mode information is sent to motion compensation decoding unit 205 from code sequence analytic unit 201, the action of motion compensation decoding unit 205 is changed gets final product.

In addition, although in this form of implementation 2, to 2 B pictures between I picture and the P picture or the situation between the P picture of adjacency be illustrated, the number of continuous B picture also can be other value, for example 3 or 4.

In addition, although in this form of implementation 2, be that 3 situation is illustrated just for the quantity of the candidate screen of the forward direction reference of P picture, it also can be other value.

In addition, although in this form of implementation 2, be that the situation of 2 I or P picture and 1 B picture is illustrated just in the candidate screen of the decoding time institute forward direction reference of B picture, the candidate screen in the decoding time institute forward direction reference of B picture is not limited to this.

In addition, although in this form of implementation 2, just as the method that when the decoding of picture P13, picture B11 and picture B12, the reference picture is managed with memory, as shown in Figure 3, be illustrated being used as with reference to the P picture of the candidate of picture and the method that the B picture manages in the lump, but with reference to the memory-aided management method of picture, also can be 4 the illustrated methods of use Figure 11～Figure 14 in form of implementation 1, just, will be used as the method that the whole picture segmentation with reference to the candidate of picture become P picture and B picture to manage.

In the case, with reference to picture with memory 207, the zone that just has 6 picture amounts as storage area, just, the P picture with memory (#1)～(#4), B picture with memory (#1) and (#2).In addition, these 6 storage areas are not limited to be formed on 1 with reference to the situation in the picture usefulness memory, also can be that 6 storage areas independently constitute with memory with reference to picture by 1 respectively.

In addition, as shown in Figure 14, when using each picture of encoding in the coding side, which preferentially adds under the situation of the method for numbering with reference to picture with storage area to determine to make the P picture to use storage area and B picture, in moving image decoding apparatus, just can be illustrated in information in the code sequence that is in preferential storage area in above-mentioned two storage areas, be identified in the picture that is used as in the candidate screen with reference to picture simply based on reference picture numbering by use.

For example, be under the situation of picture B11 at the decoder object picture owing to be picture P10 with reference to picture apart from the hithermost in time forward direction of this object picture, so that be kept at the P picture and preferentially be numbered additional with the picture in the memory.Thereby, when the coding of the object piece of picture B11, in the code sequence of object piece as heading message, it is additional with reference to picture numbering [0] under picture P10 is used as with reference to the situation of picture, additional with reference to picture numbering [1] under picture P7 is used as with reference to the situation of picture, additional with reference to picture numbering [2] under picture B9 is used as with reference to the situation of picture.Thereby, in moving image decoding apparatus, just can learn which candidate screen is used as with reference to picture when the coding of object piece according to reference picture numbering.

In the case, because expression makes the memory-aided candidate screen of P picture preferentially be numbered additional information, be used as heading message and be included in the code sequence, so just can more easily discern by utilizing this information with reference to picture.

In addition, be under the situation of picture B12 at the decoder object picture owing to be picture B11 with reference to picture apart from the hithermost in time forward direction of this object picture, so that be kept at the B picture and preferentially be numbered additional with the picture in the memory.Thereby, when the coding of the object piece of picture B12, in the code sequence of object piece as heading message, it is additional with reference to picture numbering [0] under picture B11 is used as with reference to the situation of picture, additional with reference to picture numbering [1] under picture P10 is used as with reference to the situation of picture, additional with reference to picture numbering [2] under picture P7 is used as with reference to the situation of picture.Thereby, in moving image decoding apparatus, just can learn which candidate screen is used as with reference to picture when the coding of object piece according to reference picture numbering.

In the case, because expression makes the memory-aided candidate screen of B picture preferentially be numbered additional information, be used as heading message and be included in the code sequence, so just can more easily discern by utilizing this information with reference to picture.

In addition, in the coding side,, use is arranged in that (situation of a selected in advance method among Fig. 3, Figure 11～Figure 14) is perhaps switched the situation of using a plurality of methods in 5 methods in above-mentioned 5 methods as the memory-aided management method of reference picture.For example, switching under the situation that above-mentioned a plurality of methods manage with memory the reference picture, in moving image decoding apparatus, just can be based in code sequence, being recorded and narrated, expression has been used the information of which management method to each picture, decides with reference to picture and numbers.

In addition, although in above-mentioned form of implementation 2, just the quantity with reference to candidate screen for the P picture is 3, candidate screen for the forward direction reference of B picture is the situation of 2 P pictures and 1 B picture, 5 examples with reference to the memory-aided management method of picture (Fig. 3, Figure 11～Figure 14), but also can be applied to respectively with reference to the different situation of the quantity of candidate screen and form of implementation 2 with reference to 5 examples of the memory-aided management method of picture have been described.Need not superfluous words, with reference to the quantity of candidate screen under the different situation, different with form of implementation 2 like this with reference to the memory-aided capacity of picture.

In addition, although in above-mentioned form of implementation 2, be illustrated in being distinguished into reference to candidate screen in the method (4 examples shown in Figure 11～Figure 14) that P picture and B picture manage with memory the reference picture, the P picture is saved in P picture storage area, the B picture is saved in the situation of B picture with storage area, but in the memory cell of savings picture, also can utilize in H.263++ picture memory between defined short-term, and picture memory for a long time.For example, have picture between short-term is utilized with storage area as the P picture with storage, the method that picture memory between long-term is utilized with storage area as the B picture.

(form of implementation 3)

Figure 23 is the block diagram that explanation utilizes the dynamic image encoding device of form of implementation 3 of the present invention.

The dynamic image encoding device 30 of this form of implementation 3, can be according to control signal from the outside, to distribute the method for numbering to candidate screen with reference to picture, switch to according to the method (default allocation method) of being undertaken by the rule of initial setting with reference to the distribution of picture numbering, with utilize the default allocation method that candidate screen is distributed to number with reference to picture, and then, according to coding situation any one to the adaptation distribution method that changes with reference to picture numbering of being distributed with adapting to.

Just, the action of the dynamic image encoding device 10 that an action form of the dynamic image encoding device 30 of this form of implementation 3 is a form of implementation 1, in other words, the dynamic image encoding device 30 of form of implementation 3, selecting under situation of default allocation method as its distribution method, then carrying out the processing same with the dynamic image encoding device 10 of form of implementation 1 with reference to picture numbering.

Below, describe particularly.

The dynamic image encoding device 30 of this form of implementation 3, coding control unit 110 in the dynamic image encoding device 10 of replacement form of implementation 1, purchase according to control signal Cont from the outside, to distribute the method for numbering to candidate screen with reference to picture, switch to according to candidate screen being distributed the method (default allocation method) of numbering with reference to picture by the rule of initial setting, utilize the default allocation method that candidate screen is distributed the 1st step with reference to the picture numbering with comprising, with any one coding control unit 130 of the method (adaptation distribution method) of the 2nd step that changes with reference to the picture numbering of distributing to candidate screen to utilizing the default allocation method with adapting to.

In addition, coding control unit 130 has, by each coded object picture to a plurality of with reference to candidate screen, detect respectively as detecting unit (not shown) with reference to the code efficiency under the picture situation, according to by the detected code efficiency of this detecting unit, change numbering for each candidate screen of utilizing the default allocation method to set with reference to picture.

Specifically, 130 pairs of control units of coding utilize the value with reference to the picture numbering of each candidate screen that the default allocation method sets, so that for object picture a plurality of with reference to candidate screen in, as high more, more little with reference to the value of picture numbering with reference to the code efficiency of the object picture under the picture situation.

Then, mode selected cell 139, in direct mode, as for the forward direction of object piece with reference to picture, the picture and selecting that will be endowed with reference to picture numbering [0] is that forward direction is with reference to picture.In addition, mode selected cell 139, the predictive coding mode beyond direct mode in for example bi-directional predicted mode, carries out from the processing of a plurality of candidate screen selections with reference to picture according to code efficiency.

The structure of other of the dynamic image encoding device 30 of this form of implementation 3, identical with in the dynamic image encoding device 10 of form of implementation 1.

Then action is described.

In this dynamic image encoding device 30, at the control signal Cont of basis from the outside, as the method with reference to the picture numbering of distributing for candidate screen, under the selecteed situation of default allocation method, the action of dynamic image encoding device 30, identical with the action of the dynamic image encoding device 10 of form of implementation 1.

In addition, at the control signal Cont of basis from the outside, as the method with reference to the picture numbering of distributing for candidate screen, adapt under the selecteed situation of distribution method, in this dynamic image encoding device 30, the dynamic image encoding device 10 by the 1st step and form of implementation 1 similarly carries out the distribution with reference to the picture numbering.

Then, adapting under the selecteed situation of distribution method, in this dynamic image encoding device 30, by the 2nd step, to utilizing changing that the default allocation method distributed with reference to the picture numbering with adapting to.

Below, to adapting under the selecteed situation of distribution method, the concrete distribution method of numbering with reference to picture describes, but in this explanation, establishing the object picture is picture B12.

At first, in the 1st step, as shown in Figure 3, the candidate screen of forward direction reference is distributed with reference to the picture numbering, so that more little with reference to the value of picture numbering apart from the near more candidate screen of object picture.Just, be assigned with reference to picture numbering [1], be assigned with reference to picture numbering [0], be assigned with reference to picture numbering [2] with reference to picture P10 with reference to picture P7 with reference to picture B11.

Then, such as shown in figure 24 in the 2nd step, with reference to picture P10 be altered to [0] with reference to picture numbering [1], be altered to [1] with reference to picture B11 with reference to picture numbering [0].

The rewriting with reference to the picture numbering is like this carried out based on code efficiency each object picture.In addition, dynamic image encoding device 30 will be represented according to external control signal Cont, be which the information of setting the default allocation method and adapting to distribution method is inserted in the code sequence as heading message as distribution method.Setting under the situation that adapts to distribution method in addition, the information of how to carry out with reference to the distribution of picture numbering also is inserted in the code sequence as heading message.

Like this in this form of implementation 3, just can be according to code efficiency, will under direct mode, should carry out the forward direction reference candidate screen be made as [0] with reference to the picture numbering.

Just, in form of implementation 1, since apart from the object picture nearest in time with reference to candidate screen, what the value of giving was little numbers with reference to picture, so in direct mode, can only be with reference to the nearest in time picture B11 of distance object picture B12, but in this form of implementation 3, if code efficiency improves, then can forward direction with reference to the picture beyond the nearest in time picture B11 of distance object picture B12.

In addition, in the case, owing to the picture that this picture B12 carries out reference with direct mode can be made as P10 rather than B11, so just there is no need picture B11 is decoded.Thereby, just can shown in Figure 25 (a), not decode like that and handle near the B picture ground after the P picture, just can under the unwanted situation of picture B11, seek the high speed of decoding processing.In addition, even owing to also can decode because of the data shortcoming that transmits picture B11 such as mistake, so can make the reliability raising of decoding.

Like this, if can at random give with reference to picture numbering, determine the picture that carries out reference under direct mode, then the picture ground of can not decode predetermined like that shown in Figure 25 (a) is handled with having a mind.

And then no matter the what state of 2 B pictures arranged as this form of implementation 3 between the P picture, as Figure 25 (b) though shown in like that under the situation that 3 B pictures are arranged between the P picture, also can not encode picture ground predetermined and handle, when picture that the user does not want in advance under the situation that the coding side is learnt, just can omit such picture with the reduction in processing time in seeking to decode.

In the reference relation shown in Figure 25 (b), can not carry out the decoding of other pictures even picture B3 is not decoded yet.

Just, in the distribution method of form of implementation 1, since picture B4 under direct mode with reference to picture B3, so for decoded picture B4 just need decode to picture B3, but can at random be set in the picture that carries out reference under the direct mode as this form of implementation 3, the decoding of picture B3 just becomes and there is no need thus.

And then, in this form of implementation 3, owing to carry out giving with reference to the picture numbering so that give numbering of more little value with reference to picture apart from the near more candidate screen of object picture, and based under the reference picture numbering decision direct mode with reference to picture, so can improve code efficiency by the shortening of motion vector, can accomplish reduction in processing time simultaneously.

In addition, in the decoding side, because when with direct mode the object piece being handled, the forward direction of giving with reference to picture numbering [0] is used as with reference to picture at once with reference to candidate screen, so just can shorten the time of decoding.

In addition,, be rewritten into the candidate screen of [0] with reference to the picture numbering based on code efficiency decision although in above-mentioned form of implementation 3, the also picture of easy reference, numbering with reference to picture of for example nearest in time P picture is made as [0].

In addition, although in above-mentioned form of implementation 3, will carry out the picture of reference with direct mode, being made as the picture that is numbered [0] with reference to picture is illustrated, but be not limited to this, also can encode to learning the information of carrying out the situation of reference with direct mode, and, when direct mode, decode based on the information of under this direct mode, carrying out reference.

(form of implementation 4)

Figure 26 is the block diagram that explanation utilizes the moving image decoding apparatus of form of implementation 4 of the present invention.

The moving image decoding apparatus 40 of this form of implementation 4, reception is from the code sequence of the dynamic image encoding device 30 of form of implementation 3, based on what in this code sequence, comprised, expression is carried out information (distribution method indication information) with reference to the distribution of picture numbering with which of above-mentioned default allocation method and above-mentioned adaptation distribution method, carries out the decoding processing of each picture.

Just, the action of the moving image decoding apparatus 20 that an action form of the moving image decoding apparatus 40 of this form of implementation 4 is a form of implementation 2, in other words, the moving image decoding apparatus 40 of form of implementation 4, using as the distribution method of numbering under the situation of default allocation method with reference to picture, the then action of moving image decoding apparatus 40, identical with the moving image decoding apparatus 20 of form of implementation 2.

Below, describe particularly.

The moving image decoding apparatus 40 of this form of implementation 4, memory control unit 204 in the moving image decoding apparatus 20 of replacement form of implementation 2, purchase based in code sequence as the distribution method indication information that heading message comprised, carry out and above-mentioned default allocation method and adapt to the memory control unit 244 of management of any one corresponding memory of distribution method.

The structure of other of the moving image decoding apparatus 40 of this form of implementation 4, identical with in the moving image decoding apparatus 20 of form of implementation 2.

Then action is described.

This moving image decoding apparatus 40, carry out with in from the code sequence of dynamic image encoding device 30 as distribution method indication information corresponding action that heading message comprised.

Just, this moving image decoding apparatus 40, under the situation of the distribution method that is selected as in coding side default allocation method numbering with reference to picture, just, in code sequence, comprise under the situation of expression default allocation method selecteed information, with similarly moving of the moving image decoding apparatus 20 of form of implementation 2.

In addition, this moving image decoding apparatus 40 is under the situation of the distribution method that is selected as in coding lateral adaptation distribution method numbering with reference to picture, just, in code sequence, comprise under the situation of the selecteed information of expression adaptation distribution method, carry out and adaptation distribution method corresponding action.In the case, because the information of how to carry out with reference to the distribution of picture numbering also is included in the code sequence as heading message, so be that carry out with reference to the distribution of numbering on the basis with this information.Below, the action that adapts under the selecteed situation of distribution method is described.

The rewriting with reference to candidate screen in each picture area is carried out in each with in the memory 207, such as shown in figure 24 at the reference picture, as to press object picture processing.

Specifically, be under the situation of picture B12 at the decoder object picture, for as the decoding processing that changes the picture B12 of object piece, select to carry out from candidate screen with reference to picture according to the heading message of object piece.

For example, coded system at the object piece is under the situation of bi-directional predicted mode, the decoding processing of object piece is, as forward direction with reference to picture from candidate screen P10, B11, P7, select to give with in the heading message of object piece, comprised with reference to the identical picture of numbering with reference to picture of picture numbering.Here, being numbered under the situation of [1] in the heading message that is contained in the object piece with reference to picture, then as forward direction with reference to picture and selecting candidate screen B11.Then, the bi-directional predicted decoding processing of object piece, as forward direction with reference to picture with reference to candidate screen B11, as the back carry out with reference to picture P13 to the reference picture.

In addition, coded system at the object piece is under the situation of direct mode, the decoding processing of object piece is, as forward direction with reference to picture from candidate screen P7, P10, B9, be endowed the picture (picture P10 just) that is numbered [0] with reference to picture with reference to picture and selecting as forward direction.Then, the decoding processing of object piece, as forward direction with reference to picture with reference to candidate screen P10, as the back carry out with reference to picture P13 to the reference picture.

Like this in this form of implementation 4, owing to utilize with reference to picture memory 207, carry out the management of memory as shown in figure 24 like that, just, value as each candidate screen with reference to the picture numbering, use has been changed the value with reference to picture numbering of being distributed by the default allocation method according to the coding situation and has been carried out, so just can realize corresponding to according to code efficiency, rewrites the coding/decoding method of the coding method of numbering with reference to picture of candidate screen.

Just, in form of implementation 2, since apart from the object picture nearest in time with reference to candidate screen, what the value of giving was little numbers with reference to picture, so in direct mode, can only be with reference to the nearest in time picture B11 of distance object picture B12, but in this form of implementation 4, can forward direction with reference to the picture beyond the nearest in time picture B11 of distance object picture B12.

In addition, in the case, be made as P10 rather than B11 owing to carry out the picture of reference the piece of picture B12 can be decoded the time under direct mode, so just there is no need picture B11 is decoded.Thereby, just can shown in Figure 25 (a), not decode like that and handle near the B picture ground after the P picture, just can under the unwanted situation of picture B11, seek the high speed of decoding processing.In addition, even owing to also can decode because of the data shortcoming that transmits picture B11 such as mistake, so can make the reliability raising of decoding.

Like this, if can be made as value arbitrarily according to the value that the coding situation will be distributed to reference to candidate screen with reference to the picture numbering, with with having a mind the decision under direct mode, carry out reference picture, then the picture ground of can not decode predetermined like that shown in Figure 25 (a) is handled.

And then no matter the what state of 2 B pictures arranged as this form of implementation 4 between the P picture, as Figure 25 (b) though shown in like that under the situation that 3 B pictures are arranged between the P picture, also can not encode picture ground predetermined and handle, when picture that the user does not want in advance under the situation that the coding side is learnt, just can omit such picture with the reduction in processing time in seeking to decode.

In the reference relation shown in Figure 25 (b), can not carry out the decoding of other pictures even picture B3 is not decoded yet.

Just, because in form of implementation 2, because picture B4 decodes with reference to picture B3 under direct mode, so just need decode to picture B3, but as this form of implementation 4, when in the coding side, carry out under the situation that the picture of reference at random set the decoding of just can not want picture B3 with direct mode.

In addition, in the decoding side, because when with direct mode the object piece being handled, the forward direction of giving with reference to picture numbering [0] is used as with reference to picture at once with reference to candidate screen, so just can shorten the time of decoding.

In addition,, be illustrated in the numbering of P picture or when decoding not with reference to the situation of B picture although in above-mentioned each form of implementation 1～4, also can be with reference to the B picture when the numbering of P picture or decoding.

In addition,, the situation based on the time gap between the demonstration Time Calculation picture of each picture is shown, also can obtains time gap between picture based on the information beyond the demonstration time equal time of each picture although in above-mentioned each form of implementation 1～4.

For example, also can set the Counter Value that just increases progressively whenever picture is processed, based on the time gap between this Counter Value calculating picture to each picture.

For example, in for the video flowing of a content and audio stream, all comprise under the situation of temporal information, because the unit of temporal information is tiny, video information and audio-frequency information are managed so that the processing that does not have deviation synchronously of two information and remarkable based on temporal information, by managing, consider that the synchronous management for video information and audio-frequency information just becomes simple by the arrangement of Counter Value to above-mentioned each picture.

In addition, although in above-mentioned each form of implementation 1～4, illustrate data processing unit, for example, make the heading message of GOP and picture etc. and data portion not discretely, be included in situation about transmitting in the code sequence of corresponding each data processing unit, transmit but they are separated with different stream.

For example, also can be under the situation that data units of transfer such as stream being distinguished into packet transmits, the title portion of corresponding above-mentioned picture and data portion are separated transmitted.In the case, also there are title portion and data portion not to be included in situation in the same stream.But, in the data of having used packet transmit, even the order that title portion and data portion transmit is discontinuous, also just corresponding title portion transmits with different packets with data portion, the corresponding title portion and the corresponding relation of data portion are kept by the heading message of packet etc., in fact with to be included in the situation in the bit stream identical.

And then, although in above-mentioned each form of implementation 1～4, above-mentionedly number with reference to picture, a plurality of information that are referenced with reference to which picture in the candidate screen are used during as the coding that is identified in the object piece, but this also can be used as demonstration with reference to the picture numbering and uses with reference to the information of the position of candidate screen for a plurality of forward directions of the object picture of the object that becomes encoding process or decoding processing.Just, because distribution method with reference to the picture numbering in above-mentioned form of implementation 1 and 2, perhaps in form of implementation 3 and 4 the default allocation method, above-mentioned a plurality of forward directions are given apart from more little the numbering with reference to picture of the near more value of object picture with reference to candidate screen, so just can be according to distributing to the size with reference to the value of picture numbering of each forward direction with reference to candidate screen, detect the position of each forward direction with reference to candidate screen, just, detect each forward direction with reference to candidate screen, whole forward directions with reference to picture in, be which near picture of distance object picture.

In addition, also can in the code sequence of corresponding moving image,, comprise expression and constitute each picture of moving image at the position identification information that shows the position on the time shaft with numbering differently of the relative position of representing each such forward direction candidate screen with reference to picture.This position identification information is different with the temporal information of demonstration time of expression picture, is the information of determining the relative position of each picture.

In addition, although in above-mentioned each form of implementation 1～4, be illustrated under the direct mode as reference pictures, use when the piece that becomes the coding or the object picture of decoder object is decoded the back to the situation of the picture of reference (for the object picture back) to the reference picture, but under direct mode as reference pictures, also can use back to reference to the offscreen picture of having handled for the object picture, for example, at the be encoded picture of time institute's forward direction reference of the piece of object picture.

(form of implementation 5)

Figure 27 is the block diagram that explanation utilizes the dynamic image encoding device of form of implementation 5 of the present invention to use.

The dynamic image encoding device 50 of this form of implementation 5, the candidate screen of when the coding of P picture and B picture, carrying out the forward direction reference, and different for the coded system of B picture with the dynamic image encoding device 10 of above-mentioned form of implementation 1.

Just, the dynamic image encoding device 50 of this form of implementation 5, the coding control unit 110 and the mode selected cell 109 of replacement form of implementation 1 have the coding control unit 150 and the mode selected cell 159 that carry out the action different with them.

Specifically, the coding control unit 150 of the dynamic image encoding device 50 of form of implementation 5, to the reference picture control with memory 117 so that, when the coding of P picture, 4 pictures (I or P picture) that are positioned at this P picture the place ahead are used as the candidate screen of forward direction reference, when the coding of B picture, be positioned at this B picture the place ahead 4 pictures (I or P picture), be positioned at this B picture the most nearby 1 forward direction B picture and 1 I or the P picture at rear be used as candidate screen.

In addition, the mode selected cell 159 of the dynamic image encoding device 50 of form of implementation 5, when the coding of the piece of P picture, coded system as the object piece, in picture, encode, use the inter-picture prediction coding of motion vector, do not use in the inter-picture prediction coding of motion vector (motion is made as 0 to be handled) and select one, when the coding of the piece of B picture, as the coded system of object piece, in picture, encode, use the inter-picture prediction coding of forward motion vector, use the inter-picture prediction coding of backward motion vector, and select one in the inter-picture prediction of use forward motion vector and the backward motion vector coding.Just, the mode selected cell 159 of the dynamic image encoding device 50 of this form of implementation 5, mode selected cell 109 with the dynamic image encoding device 10 of form of implementation 1, only do not using difference on the direct mode this point, thereby, this dynamic image encoding device 50 does not have the motion vector storage unit 116 of dynamic image encoding device 10.

In addition, the dynamic image encoding device 50 of this form of implementation 5, the part beyond coding control unit 150 and the mode selected cell 159, identical with in the dynamic image encoding device 10 of form of implementation 1.

Then action is described.

The input picture is by showing that time sequencing is imported into input picture memory 101 with picture unit.Shown in Figure 29 (a), like that, import picture memory 101 here, by showing that time sequencing each picture P0, B1, B2, P3, B4, B5, P6, B7, B8, P9, B10, B11, P12, B13, B14, P15, B16, B17, P18 are imported into.

At each picture that the input picture is imported in memory 101, such shown in Figure 29 (b), changed row by coded sequence.To the row that changes of coded sequence, carry out based on the reference relation in the inter-picture prediction coding.Just, carry out the row that changes of the picture of importing,, encode earlier than the 1st picture so that when the coding of the 1st picture, be used as the 2nd picture with reference to the candidate of picture.

Here, when the coding of P picture, 4 pictures (I or P picture) nearby that are in its place ahead in time are used as the candidate with reference to picture.In addition, when the coding of B picture, be in 4 pictures (I or P picture) in its place ahead nearby in time, be in 1 B picture the most nearby in its place ahead and be in the I the most nearby at rear or the P picture is used as candidate with reference to picture in time.

Carried out changing each picture of row in memory 101 at the input picture, be read out by the unit of each motion compensation.Here, the unit of motion compensation, for level 16 * vertical 16 pixel sizes, just pixel being arranged in rectangular rectangular area, the pixel count of horizontal direction and the pixel count of vertical direction are the zone (macro block) of 16 pixels.But in the following description, macro block abbreviates piece as.

Below, the encoding process of picture P15, B13, B14 is described in order.

The encoding process of＜picture P15 〉

Because picture P15 is the P picture, so this picture is implemented to use the inter-picture prediction coding of forward direction reference.In addition, in the coding of P picture, the B picture is not used as with reference to picture.

Figure 28 represents with reference to the situation of picture with the management of the picture in the memory 117.

For example, in the coding zero hour of picture P15, with in the memory 117, on the storage area that has distributed the logical storage numbering, from the little beginning of the value of logical storage numbering in order, savings has picture P12, B11, P9, P3 at the reference picture.These pictures, coding finishes, and in the view data that the reference picture is put aside in memory 117, is by 50 decoded image data of dynamic image encoding device.Below, for the purpose of simplifying the description, will in memory, put aside the picture of its view data, the picture that also abbreviates as in memory to be put aside.

To put aside at the reference picture with memory 117 with reference to candidate screen, by the control of coding control unit 150, carry out giving with reference to the picture numbering.The numbering of this moment is given, and is not by the coded sequence of picture but the time sequencing when showing is carried out.In detail, be exactly in chronological order to new with reference to candidate screen, just the order of Xian Shiing slow with reference to candidate screen, what apportioning cost was less numbers with reference to picture.But, when the coding of P picture, the B picture is not carried out giving with reference to the picture numbering.In addition, when the coding of B picture, in chronological order to up-to-date with reference to candidate screen, the symbol [b] that distributes expression to handle to the reference picture as the back.

When according to such determining method with reference to the picture numbering, such as shown in figure 28, for picture P12, P9, P6, P3 with reference to the picture numbering, be respectively [0], [1], [2], [3], picture B11 is not distributed with reference to picture numbers.

So, when the coding of P picture, coding control unit 150 is controlled so that switch 113,114,115 becomes connection each switch.The piece of the picture P15 that is read with memory 101 from the input picture at first is imported into motion vector detecting unit 108, mode selected cell 159, calculus of differences unit 102.

In motion vector detecting unit 108, to put aside in the reference picture with in the picture of memory 117, picture P12, the P9, P6, the P3 that are endowed with reference to the picture numbering use as the reference candidate screen, the piece of picture P15 are carried out the detection of motion vector.In the case, the detection of motion vector is carried out with reference to candidate screen by selection is optimal from picture P12, P9, P6, P3.Detected motion vector is to mode selected cell 159 and 104 outputs of code sequence generation unit.In addition, motion vector is the information Rp with reference to which resulting motion vector of picture P12, P9, P6, P3 and so on, promptly also mode selected cell 159 is exported with reference to the picture numbering.

In mode selected cell 159, use by the detected motion vector of motion vector detecting unit 108, the coded system of the piece of decision picture P15.Here said coded system, expression with what kind of method is encoded to piece.For example, to the piece of P picture,, select coding in the picture as coded system, use motion vector the inter-picture prediction coding, do not use in the inter-picture prediction coding of motion vector (motion is made as 0 to be handled).The selection of coded system generally is to make that encoding error is that minimum is carried out under predetermined position amount.

Coded system Ms by mode selected cell 159 is determined exports code sequence generation unit 104.In addition, be to carry out under the situation of coded system of forward direction reference in the coded system that is determined, with reference to the picture numbering also to 104 outputs of code sequence generation unit.

In addition, the resulting predicted picture Pd of coded system based on by 159 decisions of mode selected cell is output to calculus of differences unit 102 and add operation unit 106.But, under having selected the situation of encoding in the picture, not prediction of output image Pd.In addition, under the situation of having been selected to encode in the picture by mode selected cell 159, control so that switch 111 its input terminal Ta are connected to lead-out terminal Tb1, switch 112 its lead-out terminal Td are connected to input terminal Tc1.Under the situation of having selected the inter-picture prediction coding, control so that switch 111 its input terminal Ta are connected to lead-out terminal Tb2, switch 112 its lead-out terminal Td are connected to input terminal Tc2.

Below, just selected the situation of inter-picture prediction coding to describe by mode selected cell 159.But, because the action of in the case calculus of differences unit 102, coded prediction error unit 103, code sequence generation unit 104 and predicated error decoding unit 105 is identical with form of implementation 1, so its explanation is omitted.

About picture P15, when the encoding process of whole pieces finishes, in coding control unit 150, carry out for the logical storage numbering of the picture of being put aside in memory 117 at the reference picture and the renewal of numbering with reference to picture.

Just, because the picture P15 that encoded, by showing that time sequencing is all newer than which picture of being put aside in memory 117 at the reference picture, is set the storage area that logical storage is numbered (0) so picture P15 just is saved in.Then, the logical storage numbering with reference to the storage area of picture of having put aside other just increases progressively 1.And then, because next coded object picture is the picture B13 as the B picture, picture B11 is also carried out giving with reference to the picture numbering.Thus, in the storage area that is set logical storage numbering (0)～(5), preserve picture P15, P12, B11, P9, P6, P3 respectively, picture P12, B11, P9, P6, P3 are given respectively with reference to picture numbering [0], [1], [2], [3], [4].In addition, be the B picture owing to become the picture of next coded object, so, replace, distribute expression to be used as the symbol [b] that handle to the reference picture back with reference to the picture numbering to being stored in the picture P15 of logical storage numbering 0.

The encoding process of＜picture B13 〉

Because picture B13 is the B picture, so use the inter-picture prediction coding of two-way reference.In the case,, use in time nearby 4 I or P picture and the most nearby 1 B picture in time,, use the I or the P picture that are in time the most nearby as the candidate screen of back to reference as the candidate screen of forward direction reference.Thereby, be picture P12, B11, P9, P6, P3 just for the candidate screen of the forward direction reference of picture B13, in addition, be picture P15 just for the back candidate screen of picture B13 to reference.These are put aside in the reference picture with in the memory 117 with reference to candidate screen.With reference to candidate screen, such as shown in figure 28 to these, the assignment logic memory is numbered and is numbered with reference to picture.

When the coding of B picture, coding control unit 150 is controlled so that switch 113,114,115 becomes connection each switch.Thereby the piece of the picture B13 that is read with memory 101 from the input picture is imported into motion vector detecting unit 108, mode selected cell 109, calculus of differences unit 102.

In motion vector detecting unit 108, the candidate screen that is used as the forward direction reference in the reference picture with picture P12, B11 in the memory 117, P9, P6, P3 will be put aside, with picture P15 as the back to the candidate screen of reference, carry out the forward motion vector of piece of picture B13 and the detection of backward motion vector.In the case, the detection of forward motion vector, by from picture P12, B11, P9, P6, P3 with optimal picture and selecting for to carry out with reference to picture.Detected motion vector is to mode selected cell 159 and 104 outputs of code sequence generation unit.In addition, forward motion vector is which the information Rp of motion vector and so on reference to picture P12, B11, P9, P6, P3, promptly with reference to the picture numbering also to 159 outputs of mode selected cell.

Then, the action of mode selected cell 159, calculus of differences unit 102, code sequence generation unit 104 and predicated error decoding unit 105 is similarly carried out during with the coding of picture P15.

When the processing of the whole pieces among the picture B13 finishes,, carry out for the logical storage numbering of the picture of being put aside in memory 117 at the reference picture and the renewal of numbering with reference to picture by the control of coding control unit 150.

Just, because picture B13, by show time sequencing than the picture P15 that is put aside in memory 117 at the reference picture also preceding, also newer than the picture P12 that is put aside in memory 117 at the reference picture, so just being saved in, picture B13 is set the storage area that logical storage is numbered (1).In addition, so owing to be not used as deleted in the encoding process of picture B11 picture afterwards with reference to picture.At this moment, represent that the information that picture B11 is deleted with memory from the reference picture is output to code sequence generation unit 104 as control signal Cs1.Code sequence is recorded and narrated and outputed to code sequence generation unit 104 with this information as heading message.In addition, the logical storage of the storage area of corresponding picture P12 numbering just increases progressively 1.

Next coded object picture is the picture B14 as the B picture.Thereby the picture of being put aside in the storage area of counterlogic memory numbering (0) is used as the back to the reference picture, the picture beyond it is distributed number with reference to picture.Thus, in the storage area of counterlogic memory numbering (0)～(5), preserve picture P15, B13, P12, P9, P6, P3 respectively, picture B13, P12, P9, P6, P3 are given respectively with reference to picture numbering [0], [1], [2], [3], [4].

The encoding process of＜picture B14 〉

Because picture B14 is the B picture, so use the inter-picture prediction coding of two-way reference.For picture B14 with reference to picture in, use picture B13, P12, P9, P6, P3 as forward direction with reference to picture, use picture P15 as the back to the reference picture.In the processing of B picture, coding control unit 150 is controlled so that switch 113,114,115 becomes connection each switch.Thereby the piece of the picture B14 that is read with memory 101 from the input picture is imported into motion vector detecting unit 108, mode selected cell 159, calculus of differences unit 102.

In motion vector detecting unit 108, the candidate screen that is used as the forward direction reference in the reference picture with picture B13, P12 in the memory 117, P9, P6, P3 will be put aside, with picture P15 as the back to the candidate screen of reference, carry out the forward motion vector of piece of picture B14 and the detection of backward motion vector.In the case, the detection of forward motion vector is by becoming to carry out with reference to picture with optimal picture and selecting from picture B13, P12, P9, P6, P3.Detected motion vector is output to mode selected cell 159 and 104 outputs of code sequence generation unit.In addition, forward motion vector is the information Rp with reference to which resulting motion vector of picture B13, P12, P9, P6, P3 and so on, promptly also is output to mode selected cell 159 with reference to the picture numbering.

Then, the action of mode selected cell 159, calculus of differences unit 102, code sequence generation unit 104, predicated error decoding unit 105 and add operation unit 106 is similarly carried out during with the coding of picture P15 substantially.

When the processing of the whole pieces among the picture B14 finishes,, carry out for the logical storage numbering of the picture of being put aside in memory 117 at the reference picture and the renewal of numbering with reference to picture by the control of coding control unit 150.

Just, because picture B14, by show time sequencing than the picture P15 that is put aside in memory 117 at the reference picture also preceding, also newer than the picture B13 that is put aside in memory 117 at the reference picture, so just being saved in, picture B14 is set the storage area that logical storage is numbered (1).In addition, so owing to be not used as deleted in the encoding process of picture B13 picture afterwards with reference to picture.At this moment, represent that the information that picture B13 is deleted with memory from the reference picture is output to code sequence generation unit 104 as control signal Cs1.Code sequence is recorded and narrated and outputed to code sequence generation unit 104 with this information as heading message.

Next coded object picture is the picture P18 as the P picture.Thereby offscreen picture distribution is numbered with reference to picture to B.Thus, in the storage area of logical storage numbering (0)～(5), preserve picture P15, B14, P12, P9, P6 respectively, picture P15, B14, P12, P9, P6 are given respectively with reference to picture numbering [0], [1], [2], [3].

Like this in this form of implementation 5, because in a plurality of candidate screen for the forward direction reference of coded object picture, its demonstration time slow more with regard to apportioning cost more little with reference to picture numbering (forward motion vector that just is used for the identifying object piece is with reference to the resulting information of which candidate screen), so conduct is with reference to the easiest selecteed picture of picture, with regard to littler the numbering with reference to picture of apportioning cost in candidate screen.Thus, just can make size of code minimum, and can seek the raising of code efficiency for reference picture numbering.

Below, to the effect of this form of implementation 5, be that the situation that other B picture is used for carrying out with reference to candidate screen is an example with coding for the B picture, simultaneously existing problem points is described particularly.

For example the picture to moving image is arranged as the content shown in Figure 29 (a), and the forward direction when the object picture is encoded uses the situation of 4 P pictures and 1 B picture to describe with reference to candidate screen.

Figure 30 represents the management example with reference to the picture in the picture usefulness memory in the case.In addition, in this memory, candidate screen is preserved by coded sequence.

When the coding of picture P15, begin as the candidate screen savings picture B11, P12, P9, P6, P3 are arranged in order from the little storage area of logical storage numbering in memory at the reference picture.In addition to these candidate screen, distribute respectively with reference to picture numbering [0], [1], [2, [3], [4].Thereby, to can not being assigned with reference to picture and numbering when the coding of P picture as B picture (here being picture B11) with reference to picture.For this reason, produce numbering of can not being used, cause the deterioration of code efficiency with reference to picture.

In addition, when the coding of picture B13, with in the memory, picture P15, B11, P12, P9, P6, P3 are arranged by logical number order savings at the reference picture.The symbol [b] that distributes expression to use to the reference picture to picture P15 then as the back, to remaining picture, distribute respectively with reference to picture numbering [0], [1], [2, [3], [4].Thereby from as the picture B13 of coded object picture B11 far away in time, than apart from the near in time picture P12 of this picture B13, the value of being assigned with is also wanted little numbering with reference to picture.General under the situation of motion detection, owing to be used as with reference to the situation of picture many from the near in time candidate screen of object picture on the probability, so the value with reference to the picture numbering of picture B11 that ought be far away in time becomes, than near picture P12 in time with reference to the also little value of picture numbering the time, so cause the deterioration of code efficiency.

And then, when the coding of picture B14, with in the memory, picture B13, P15, B11, P12, P9, P6 are arranged by logical number order savings at the reference picture.The symbol [b] that distributes expression to use to the reference picture to picture B13 then as the back, to remaining picture, distribute respectively with reference to picture numbering [0], [1], [2, [3], [4].Thereby, should be used as the picture P15 of back to picture B14 originally to the reference picture, but be used as the candidate screen of forward direction reference.And script but is used as the back to the reference picture to the picture B13 that picture B14 should be used as the candidate of forward direction reference.The result correctly encodes and just becomes difficult.In addition, when the coding of picture B14, then be present in reference to picture with in the memory as the picture B11 that is not used as with reference to the picture of picture.

Relative therewith, in form of implementation 5 of the present invention, such as shown in figure 28, owing to use in the memory at the reference picture, press DISPLAY ORDER preserve for the object picture with reference to candidate screen, in the candidate screen of forward direction reference, its demonstration time slow more with regard to more little the numbering of apportioning cost with reference to picture, so in candidate screen,, just distribute littler numbering with reference to picture as with reference to the easiest selecteed picture of picture.Thus, just can make size of code minimum, can and seek the raising of code efficiency for reference picture numbering.

In addition, when the coding of P picture,,, further improve code efficiency so just can avoid the generation with reference to the picture numbering that can not be used because the B picture is not carried out with reference to giving that picture is numbered.

In addition, when the coding of B picture, owing to the picture in the storage area that the logical storage that is kept at the respective value minimum is numbered, do not distribute with reference to numbering with picture, and with this picture as the back use to the reference picture, so when the predictive coding of B picture, just can avoid and but to be used as the situation of forward direction to the P of reference picture in the back with reference to picture.

In addition, because when the reference picture becomes the picture that is not used as with reference to picture with memory deletion, in code sequence, record and narrate expression and carried out the information of deletion, so just can be in the decoding side, detect from the reference picture and delete, in the decoding processing of the later picture of decoder object picture, be not used as picture with reference to picture with memory.

In addition, although in above-mentioned form of implementation 5, illustrated that motion compensation is a unit with the image space of being made up of level 16 * vertical 16 pixels (macro block), the coding of prediction error image is being the situation that unit handles by the image space (sub-piece) that level 8 * vertical 8 pixels are formed, but as the macro block of the unit of the coding of motion compensation and prediction error image or the pixel count of sub-piece, also can be with above-mentioned different.

In addition, although in above-mentioned form of implementation 5, be that 2 situation is that example is illustrated with the number of continuous B picture, the number of above-mentioned continuous B picture also can be other number.

In addition, although in above-mentioned form of implementation 5, be that 4 situation is illustrated to quantity in the candidate screen of the coding time institute forward direction reference of P picture, it also can be other value.

In addition, although in above-mentioned form of implementation 5,, be that the situation of 4 P pictures and 1 B picture is illustrated to candidate screen in the coding time institute forward direction reference of B picture, be not limited to these pictures for the candidate screen of the forward direction reference of B picture.

In addition, although in above-mentioned form of implementation 5, to becoming coded object, the situation that each picture of formation moving image is used as with reference to picture when the coding of other later pictures of this each picture is illustrated, but become coded object, a plurality of pictures of moving image also can comprise the picture that is not used as with reference to picture.In the case, by not putting aside the picture that is not used as with reference to picture in memory, just obtain the effect same with above-mentioned form of implementation 5 at the reference picture.

In addition, although in above-mentioned form of implementation 5, illustrated coding for the B picture be with other B picture as carrying out situation with reference to candidate screen, can be not do not carry out for the coding of B picture with reference to other B picture yet.In the case, by not putting aside the B picture in memory,, just can obtain the effect same with above-mentioned form of implementation 5 even perhaps also distribute with reference to the picture numbering under these circumstances according to the demonstration time sequencing of picture at the reference picture.

In addition,, just distribute the situation with reference to picture numbering of 1 system to be illustrated although in above-mentioned form of implementation 5, also can be respectively to the place ahead to, rear to distributing numbering of different system with reference to picture.

In addition, although in the candidate screen of forward direction reference, its demonstration time slow more with regard to more little the numbering of apportioning cost with reference to picture, but if conduct is with reference to the easiest selecteed picture of picture in candidate screen, with regard to the littler method of apportioning cost, then be not limited to situation illustrated in above-mentioned form of implementation with reference to the picture numbering.

In addition, Figure 31 is the corresponding concept map that has distributed with reference to the structure (form of image coding signal) of the code sequence of the picture of picture numbering of expression.The code signal Pt of 1 picture amount includes the heading message Hp that comprised and the data portion Dp after this in picture beginning.In heading message Hp, include control signal (RPSL).The coded data (code sequence) that in data portion Dp, includes corresponding each piece in addition.

For example, code sequence BLx is the code sequence with the coded piece of coded system in the picture, and code sequence BLy is the code sequence with the coded piece of the inter-picture prediction coded system beyond the coded system in the picture.

In the code sequence BLx of piece, include heading message Hbx, about the information Prx of coded system and the image information Dbx that is encoded.In the code sequence BLy of piece, include heading message Hby, about the information Pry of coded system, the 1st with reference to picture numbering Rld1, the 2nd with reference to picture numbering Rld2, the 1st motion vector MV1, the 2nd motion vector MV2 and the image information Dby that is encoded.Here, just can judge by the information Pry relevant with coded system be to use the 1st, the 2nd with reference to picture numbering Rld1, Rld2 which.

Here, parameter picture numbering Rld1 at first, is that forward direction is preferentially given to the reference candidate screen back relatively with reference to candidate screen.Parameter picture numbering Rld2 is that the back is preferentially given with reference to candidate screen to the relative forward direction of reference candidate screen.

(form of implementation 6)

Figure 32 is the block diagram that explanation utilizes the moving image decoding apparatus of form of implementation 6 of the present invention to use.

The moving image decoding apparatus 60 of this form of implementation 6 is decoded to the code sequence Bs that exports from the dynamic image encoding device 50 of above-mentioned form of implementation 5.

The moving image decoding apparatus 60 of this form of implementation 6, the candidate screen of when the decoding of P picture and B picture, carrying out the forward direction reference, and different for the coded system of B picture with the moving image decoding apparatus 20 of above-mentioned form of implementation 2.

Just, the moving image decoding apparatus 60 of this form of implementation 6, the memory control unit 204 and the mode decoding unit 223 of replacement form of implementation 2 have the memory control unit 264 and the mode decoding unit 263 that carry out the action different with them.

Specifically, the memory control unit 264 of the moving image decoding apparatus 60 of form of implementation 6, to the reference picture control with memory 207 so that, when the decoding of P picture, 4 pictures (I or P picture) that are positioned at this P picture the place ahead are used as the candidate screen of forward direction reference, when the decoding of B picture, be positioned at this B picture the place ahead 4 pictures (I or P picture), be positioned at this B picture the most nearby 1 forward direction B picture and 1 I or the P picture at rear be used as candidate screen.

In addition, the mode decoding unit 263 of the moving image decoding apparatus 60 of form of implementation 6, when the decoding of the piece of P picture, coded system as the object piece, in picture, decode, use the inter-picture prediction decoding of motion vector, do not use in the inter-picture prediction decoding of motion vector (motion is made as 0 to be handled) and select one, when the decoding of the piece of B picture, as the coded system of object piece, in picture, decode, use the inter-picture prediction decoding of forward motion vector, use the inter-picture prediction decoding of backward motion vector, and select one in the decoding of the inter-picture prediction of use forward motion vector and backward motion vector.

Just, the mode decoding unit 263 of the moving image decoding apparatus 60 of this form of implementation 6, mode decoding unit 223 with the moving image decoding apparatus 20 of form of implementation 2, only do not using difference on the decoding processing this point of corresponding direct mode, thereby, this moving image decoding apparatus 60 does not have the motion vector storage unit 226 of moving image decoding apparatus 20.

In addition, the moving image decoding apparatus 60 of form of implementation 6, the part beyond memory control unit 264 and the mode decoding unit 263, identical with in the moving image decoding apparatus 20 of form of implementation 2.

Then action is described.

Be located in the moving image decoding apparatus shown in Figure 32 60, input is from the code sequence Bs of dynamic image encoding device 50 outputs of form of implementation 5.Here, the P picture is to be in 4 I nearby in its place ahead or P picture in time as carry out the inter-picture prediction coding with reference to candidate screen.In addition, here the B picture be be in 4 P pictures, 1 forward direction B picture in its place ahead the most nearby in time and be in the I the most nearby at its rear in time or the P picture as encoding with reference to candidate screen.

Be located in the case, the order of the picture in the code sequence is as Figure 29 (b).

Below, the decoding processing of picture P15, B13, B14 is described in order.

The decoding processing of＜picture P15 〉

The code sequence of picture P15 is imported into code sequence analytic unit 201.Extract various data by code sequence analytic unit 201 from institute's input code sequence.Here various data are to say the information of coded system and motion vector etc.The information that the mode that is extracted is selected (coded system) Ms is output to mode decoding unit 263.In addition, the motion vector MV that is extracted is output to motion compensation decoding unit 205.And then coded prediction error data Ed is to 202 outputs of predicated error decoding unit.

By mode decoding unit 263,, carry out the control of switch 209 and 210 with reference to from the coded system Ms that code sequence extracted.Under the situation of encoding in coded system is picture, control so that switch 209 its input terminal Te are connected to lead-out terminal Tf1, switch 210 its lead-out terminal Th are connected to input terminal Tg1.On the other hand, be under the situation of inter-picture prediction coding in coded system, control so that switch 209 its input terminal Te are connected to lead-out terminal Tf2, switch 210 its lead-out terminal Th are connected to input terminal Tg2.

In addition, mode decoding unit 263 also outputs to motion compensation decoding unit 205 with coded system Ms.

Below, be that the situation that inter-picture prediction is encoded describes to coded system.

Predicated error decoding unit 202 carries out the decoding of the coded data Ed that imported, generation forecast error information PDd.The prediction error data PDd that is generated is output to switch 209.In the case, because switch 209 its input terminal Te are connected to lead-out terminal Tf2, so prediction error data PDd is output to add operation unit 208.

Motion compensation decoding unit 205 according to the information of the motion vector of being imported etc., generates motion compensated image.Be input to the information of motion compensation decoding unit 205, for motion vector MV with reference to picture numbering Rp.Motion compensation decoding unit 205 based on these information, is obtained motion compensated image (predicted picture) from the reference picture with memory 207.Picture P15 is that picture P12, P9, P6, P3 are encoded as the candidate of reference picture, and these pictures are decoded and remain in reference to picture with memory 207.

Figure 28 is illustrated in reference to picture with the picture of being put aside in the memory 207.Such as shown in figure 28, when the decoding of picture P15, the reference picture with memory 207 in savings picture P12, B11, P9, P6, P3 arranged.

Memory control unit 264 is carried out giving with reference to the picture numbering to what put aside in memory 207 at the reference picture with reference to candidate screen.This gives with reference to the picture numbering, carries out so that little the numbering with reference to picture of up-to-date picture value of being endowed based on the demonstration time sequencing of picture.And, when the decoding of P picture, the B picture is not carried out giving with reference to the picture numbering.Thereby, be respectively [0], [1], [2], [3] for numbering of picture P12, P9, P6, P3 with reference to picture, picture B11 is not distributed with reference to picture number.

Motion compensation decoding unit 205, according to reference picture numbering, deciding when the coding of object piece is which picture with reference to picture P12, P9, P6, P3.Then, motion compensation decoding unit 205 based on determined with reference to picture and motion vector,, obtain predicted picture (prediction data Pd) and generate motion compensated image (predicted picture) with memory 207 from the reference picture.The motion compensated image that is generated is output to add operation unit 208 like this.

By add operation unit 208, with prediction error image and the motion compensated image the imported generating solution sign indicating number image (data Ad) of adding up mutually.The decoded picture that is generated outputs to reference to picture memory 207 by switch 210.

As top, when whole macro blocks of picture P15 were decoded, memory control unit 264 carried out for the logical storage numbering of the picture of being put aside in memory 207 at the reference picture with reference to the renewal of picture numbering.

At this moment, because picture P15, by showing that time sequencing is all newer than which picture of being put aside in memory 207 at the reference picture, is set the storage area that logical storage is numbered (0) so picture P15 just is saved in.Then, the logical storage numbering of storage area of correspondence being preserved other candidate screen increases progressively 1.

In addition, because next decoder object picture is picture B13, so picture B11 is carried out giving with reference to the picture numbering.Thus, in the storage area that is set logical storage numbering (0)～(5), preserve picture P15, P12, B11, P9, P6, P3 respectively, picture P12, B11, P9, P6, P3 are given respectively with reference to picture numbering [0], [1], [2], [3], [4].

The decoding processing of＜picture B13 〉

Because the action of code sequence analytic unit 201, mode decoding unit 203 and predicated error decoding unit 202, same during with the decoding processing of picture P15, so the omission of their action specification.

Motion compensation decoding unit 205 generates moving compensating data from the information of the motion vector imported etc.The information that is input to motion compensation decoding unit 205 is motion vector and numbers with reference to picture.Picture B11 is used as picture P12, B11, P9, P6, P3 the candidate screen of forward direction reference, picture P15 is encoded to the candidate screen of reference as the back, in the decoding of picture B13 constantly, these candidate screen are decoded and remain in reference to picture with memory 207.

In coded system is under the situation of forward prediction or the decoding of bi-directional predicted predictive pictures, motion compensation decoding unit 205, according to reference picture numbering, decide when the coding of picture B13, which candidate screen of picture P12, B11, P9, P6, P3 is carried out the forward direction reference.Then, motion compensation decoding unit 205 is obtained forward motion compensation image from the reference picture with memory 207 with reference to picture and forward motion vector based on what determine.In addition, be that motion compensation decoding unit 205 is obtained reverse compensating images from the reference picture with memory 207 with reference to picture and backward motion vector based on what determine under the situation of bi-directional predicted predictive pictures coding or back forecast in coded system.Then, motion compensation decoding unit 205 uses forward motion compensation image and reverse compensating images, generates motion compensated image (predictive picture).

The motion compensated image that is generated is output to add operation unit 208 like this.Add operation unit 208 is with prediction error image and the motion compensated image the imported generating solution sign indicating number image of adding up mutually.The decoded picture that is generated outputs to reference to picture memory 207 by switch 210.

As top, when whole pieces of picture B13 were decoded, memory control unit 264 carried out for the logical storage numbering of the picture of being put aside in memory 207 at the reference picture with reference to the renewal of picture numbering.Because picture B13, by showing that time sequencing is also more forward than the picture P15 that is put aside in memory 207 at the reference picture, also newer than the picture P12 that is put aside in memory 207 at the reference picture, so just being saved in, picture B13 is set the storage area that logical storage is numbered (1).

In addition because in code sequence, record and narrate have expression with picture B11 from the information of reference picture, so 264 pairs of memory control units are controlled with memory so that picture B11 is deleted from reference picture usefulness memory 207 with reference to picture with the memory deletion.In addition, the logical storage numbering with reference to the storage area of candidate screen P12 of preserving other is increased progressively 1.Thus, in the storage area that is set logical storage numbering (0)～(5), preserve picture P15, B13, P12, P9, P6, P3 respectively, picture B13, P12, P9, P6, P3 are given respectively with reference to picture numbering [0], [1], [2], [3], [4].

The decoding processing of＜picture B14 〉

Because the action of code sequence analytic unit 201, mode decoding unit 203 and predicated error decoding unit 202, same during with the decoding processing of picture P15, so the omission of their action specification.

Motion compensation decoding unit 205 generates moving compensating data from the information of the motion vector imported etc.The information that is input to motion compensation decoding unit 205 is motion vector and numbers with reference to picture.Picture B14 is used as picture B13, P12, P9, P6, P3 the candidate screen of forward direction reference, picture P15 is encoded to the candidate screen of reference as the back, in the decoding of picture B14 constantly, these candidate screen are decoded and remain in reference to picture with memory 207.

Be chosen as in mode under the situation of forward prediction or bi-directional predicted predictive pictures coding, motion compensation decoding unit 205, according to reference picture numbering, decide when the coding of picture B14, which picture of picture B13, P12, P9, P6, P3 is by the forward direction reference.Then, motion compensation decoding unit 205 is obtained forward motion compensation image from the reference picture with memory 207 with reference to picture and forward motion vector based on what determine.In addition, be that motion compensation decoding unit 205 is obtained reverse compensating images from the reference picture with memory 207 with reference to picture and backward motion vector based on what determine under the situation of predictive pictures coding of bi-directional predicted or back forecast in coded system.Then, motion compensation decoding unit 205 uses forward motion compensation image and reverse compensating images, generates motion compensated image.

The motion compensated image that is generated is output to add operation unit 208 like this.By add operation unit 208, with prediction error image and the motion compensated image the imported generating solution sign indicating number image of adding up mutually.The decoded picture that is generated outputs to reference to picture memory 207 by switch 210.

As top, when the processing of the whole pieces among the picture B14 finishes,, carry out for the logical storage numbering of the candidate screen of being put aside in memory 207 at the reference picture and the renewal of numbering with reference to picture by memory control unit 264.Because picture B14, by showing that time sequencing is also more forward than the picture P15 that is put aside in memory 207 at the reference picture, also newer than the picture B13 that is put aside in memory 207 at the reference picture, so just being saved in, picture B14 is set the storage area that logical storage is numbered (1).In addition, owing in code sequence, record and narrate the information that has expression that picture B13 is deleted with memory from the reference picture, picture B13 is deleted with memory 207 from the reference picture so 264 pairs of these memories of memory control unit are controlled.

In addition, next decoder object picture is the picture P18 as the P picture.Thereby offscreen picture distribution is numbered with reference to picture to B.Thus, in the storage area that is set logical storage numbering (0)～(5), preserve picture P15, B14, P12, P9, P6, P3 respectively, picture P15, P12, P9, P6 are given respectively with reference to picture numbering [0], [1], [2], [3].

In addition,, institute's decoded pictures is exported as output image with memory 207 from the reference picture by the demonstration time sequencing.

Below, each picture is by decoding with the corresponding same processing of picture type.

Like this in this form of implementation 6, because in a plurality of candidate screen for the forward direction reference of decoder object picture, its demonstration time slow more with regard to apportioning cost more little with reference to picture numbering (forward motion vector that just is used for the identifying object piece is with reference to the resulting information of which candidate screen), and based on numbering of in the code sequence of object picture, being comprised with reference to picture, decision is with reference to picture from above-mentioned a plurality of candidate screen, so conduct is with reference to the easiest selecteed picture of picture, with regard to littler the numbering with reference to picture of apportioning cost in candidate screen.Thus, just can make size of code minimum with reference to the picture numbering, and can be to correctly decoding by the resulting code sequence of the high coding method of code efficiency.

In addition, when the decoding of P picture, because the B picture is not carried out with reference to giving that picture is numbered, thus the generation with reference to the picture numbering that can not be used just can be avoided, and can be to correctly decoding by the resulting code sequence of the high coding method of code efficiency.

In addition, when the decoding of B picture, because the picture that will in the storage area of the minimum logical storage numbering of the value of being set, be preserved, handle to the reference picture as the back, this picture is not carried out distribution with reference to picture numbering, so when the predictive coding of B picture, just can avoid the P picture and be used as the situation of forward direction, and can be to correctly decoding by the resulting code sequence of the high coding method of code efficiency with reference to picture.

And then, owing to become the information that is not used as with reference to the picture of picture and recorded and narrated under the situation of code sequence deleting with memory from the reference picture, delete with reference to picture, so just can effectively utilize with memory from the reference picture based on this information with reference to the picture memory.

In addition, although in above-mentioned form of implementation 6, as the arrangement of a plurality of pictures that constitute moving image, the arrangement of the picture of 2 B pictures between the P of adjacency picture is shown, but the number of the B picture between the P of adjacency picture also can be other value, for example, 3 or 4.

In addition, although in above-mentioned form of implementation 6, be that 4 situation is illustrated just for the quantity of the candidate screen of the forward direction reference of P picture, it also can be other value.

In addition, although in above-mentioned form of implementation 6,, be that the situation of 4 P pictures and 1 B picture is illustrated just for the candidate screen of the forward direction reference of B picture, but, also can be 4 forward direction P pictures and 1 offscreen picture of forward direction B as candidate screen for the forward direction reference of B picture.

In addition, although in above-mentioned form of implementation 6, to becoming decoder object, the situation that each picture of formation moving image is used as with reference to picture when the decoding of other later pictures of this each picture is illustrated, but become decoder object, a plurality of pictures of moving image also can comprise the picture that is not used as with reference to picture.In the case, by not putting aside the picture that is not used as with reference to picture in memory, just obtain the effect same with above-mentioned form of implementation 6 at the reference picture.

In addition, although in above-mentioned form of implementation 6, the decoding that the B picture has been described be with other B picture as carrying out situation with reference to candidate screen, can be not do not carry out for the decoding of B picture with reference to other B picture yet.In the case, by not putting aside the B picture in memory,, just can obtain the effect same with above-mentioned form of implementation 6 even perhaps also distribute with reference to the picture numbering under these circumstances according to the demonstration time sequencing of picture at the reference picture.

And then, although in above-mentioned form of implementation 6, for the purpose of simplifying the description, to being used to manage memory with reference to candidate screen, with being used for decoded picture is not illustrated with memory with reference to picture as 1 by the memory that DISPLAY ORDER changes row and output with making any distinction between, but moving image decoding apparatus 60 also can have respectively and is used to manage with reference to the diode-capacitor storage of candidate screen and is used for decoded picture is changed row's memory by what DISPLAY ORDER changed row and output.

In the case, diode-capacitor storage is controlled by memory control unit 264, outputs to motion compensation decoding unit 205 with reference to candidate screen.In addition, change the decoded picture image that row's memory will be arranged by decoding order, change row and output successively by DISPLAY ORDER.

In addition, although in above-mentioned form of implementation 6, show by 1 rule and give situation with reference to the distribution of picture numbering for candidate screen, just be numbered the situation of 1 system with reference to picture, but as numbering with reference to picture, also can as illustrated in the enforcement form 5, use numbering of 2 systems with reference to picture.

(form of implementation 7)

Figure 33 is the block diagram that explanation utilizes the dynamic image encoding device of form of implementation 7 of the present invention to use.

The dynamic image encoding device 70 of this form of implementation 7, the candidate screen of when the coding of P picture and B picture, carrying out the forward direction reference, and different for the coded system of B picture with the dynamic image encoding device 10 of above-mentioned form of implementation 1.

Just, the dynamic image encoding device 70 of this form of implementation 7, the coding control unit 110 and the mode selected cell 109 of replacement form of implementation 1 have the coding control unit 170 and the mode selected cell 179 that carry out the action different with them.

Specifically, the coding control unit 170 of the dynamic image encoding device 70 of form of implementation 7, to the reference picture control with memory 117 so that, when the coding of P picture, 3 pictures (I or P picture) that are positioned at this P picture the place ahead are used as the candidate screen of forward direction reference, when the coding of B picture, be positioned at this B picture the place ahead 2 pictures (I or P picture), be positioned at this B picture the most nearby 1 forward direction B picture and 1 I or the P picture at rear be used as candidate screen.But, be set in the B picture of relative coding object picture and do not carry out reference in more the place ahead of the I in the most nearby the place ahead or P picture.

Above-mentioned coding control unit 170, according to control signal Cd code sequence generation unit 104 is controlled so that, the sign whether the indicated object picture is referenced for the encoding process of the later picture of this object picture the time is inserted in the code sequence of corresponding objects picture.Specifically, be exactly code sequence generation unit 104 controlled by control signal Cd so that, be illustrated in decoding and the time data of object picture should be put aside the reference picture with the information in the memory 117, and represent that it should put aside during information append in the code sequence.

In addition, the mode selected cell 179 of the dynamic image encoding device 70 of form of implementation 7, when the coding of the piece of P picture, coded system as the object piece, in picture, encode, use the inter-picture prediction coding of motion vector, do not use in the inter-picture prediction coding of motion vector (motion is made as 0 to be handled) and select one, when the coding of the piece of B picture, as the coded system of object piece, in picture, encode, use the inter-picture prediction coding of forward motion vector, use the inter-picture prediction coding of backward motion vector, and select one in the inter-picture prediction of use forward motion vector and the backward motion vector coding.Just, the mode selected cell 179 of the dynamic image encoding device 70 of this form of implementation 7, mode selected cell 109 with the dynamic image encoding device 10 of form of implementation 1, only do not using difference on the direct mode this point, thereby, this dynamic image encoding device 70 does not have the motion vector storage unit 116 of dynamic image encoding device 10.And, other structures of the dynamic image encoding device 70 of form of implementation 7, all with the dynamic image encoding device 10 of form of implementation 1 in identical.

In addition, the dynamic image encoding device 70 of this form of implementation 7, dynamic image encoding device 50 with form of implementation 5, code sequence generation unit 104 is controlled so that, the sign whether the indicated object picture is referenced for the encoding process of the later picture of this object picture the time is inserted in the code sequence of corresponding objects picture different on this point.In addition, the dynamic image encoding device 70 of form of implementation 7, also different in the candidate screen of the coding time institute reference of P picture and B picture with the dynamic image encoding device 50 of above-mentioned form of implementation 5.And, other points in the dynamic image encoding device 70 of this form of implementation 7, all the dynamic image encoding device 50 with form of implementation 5 is identical.

Then action is described.

Input image data Id is imported into input picture memory 101 with picture unit in chronological order.

Figure 34 (a) is illustrated in the order of input picture with the picture of being imported in the memory 101.

With such shown in Figure 34 (a) in the memory 101, each picture begins to import in order from picture P1 at the input picture.Here, picture P1, P4, P7, P10, P13, P16, P19, P22 are the P pictures, and picture B2, B3, B5, B6, B8, B9, B11, B12, B14, B15, B17, B18, B20, B21 are the B pictures.

Here, when the coding of P picture, this P picture 3 pictures (I or P picture) nearby of being in the place ahead in time are used as the candidate with reference to picture relatively.In addition, when the coding of B picture, this B picture is in the I the most nearby at 2 pictures (I or P picture) in its place ahead nearby, 1 the B picture the most nearby that is in the place ahead and rear or P picture in time and is used as candidate with reference to picture relatively.But the B picture in the I that is set in the most nearby the place ahead or more the place ahead of P picture does not carry out reference.In addition, when the coding of I picture, not with reference to other picture.

The data I d of each picture of being imported in memory 101 at the input picture changes row by coded sequence.The data of following picture just simply slightly are designated as picture.

Just, the order of picture is changed the row that changes who lines up coded sequence from input sequence handle, carry out based on the reference relation in the inter-picture prediction encoding process.Change during row handles at this, to each picture change row so that, when the coding of the 1st picture, be used as the 2nd picture with reference to the candidate of picture, also formerly encode than the 1st picture.

Specifically, each picture from picture P10 to P13 and with reference to the corresponding relation of candidate screen, the arrow shown in Figure 34 (a) is such.Just, when the coding of P picture P10, picture P1, P4, P7 are referenced, and when the coding of P picture P13, picture P4, P7, P10 are referenced.In addition, when the coding of B picture B11, picture P7, P10, P13 are referenced, and when the coding of B picture B12, picture P7, P10, B11, P13 are referenced.

In addition, Figure 34 (b) expression has carried out changing the order of the picture behind the row to the picture from the picture B2 shown in Figure 34 (a) to P22.After changing row, each picture is arranged by the order of P4, B2, B3, P7, B5, B6, P10, B8, B9, P13, B11, B12, P16, B14, B15, P19, B17, B18, P22.

Carried out changing each picture of row in memory 101 at the input picture, pressed as certain data processing unit, the data unit of carrying out motion compensation is read out.Here, establish the data unit of carrying out motion compensation and be, with the corresponding data unit of rectangular image space (macro block) of all having arranged 16 pixels in the horizontal direction with vertical direction.Following macro block also abbreviates piece as.

Below, the encoding process of picture P13, B11, B12 is described in order.

The encoding process of＜picture P13 〉

Because picture P13 is the P picture, so use the inter-picture prediction coding of forward direction reference as the encoding process of picture P13.In the case be 3 I or the P picture that relative coding object picture is positioned at the place ahead with reference to candidate screen, specifically be exactly picture P4, P7, P10.These are with reference to candidate screen, and encoding process finishes, and corresponding decode image data Dd is put aside in reference picture memory 117.

In the encoding process of P picture, coding control unit 170 is controlled so that switch 113,114,115 becomes connection each switch.

The corresponding data M d of piece with the picture P13 that is read with memory 101 from the input picture at first is imported into motion vector detecting unit 108, mode selected cell 179, calculus of differences unit 102.

In motion vector detecting unit 108, use as the data of reference candidate screen with picture P4, the P7 of memory 117, the decode image data Rd of P10 putting aside in the reference picture, carry out the detection of motion vector MV of the piece of picture P13.In the case, the detection of motion vector is carried out with reference to picture by selection is optimal from picture P4, P7, P10.Detected motion vector MV is output to mode selected cell 179 and code sequence generation unit 104.In addition, motion vector MV is the information (with reference to image information) of which detected motion vector with reference to picture P4, P7, P10 and so on, also is output to mode selected cell 179.

In mode selected cell 179, use by the detected motion vector of motion vector detecting unit 108, the coded system of the piece of decision picture P13.

Specifically, be exactly under the situation of P picture, the inter-picture prediction of coding, use motion vector is encoded, is not used the inter-picture prediction coding of motion vector (motion is made as 0 to be handled) in picture, and decision with which method is encoded.In the decision of coded system, generally be to select to make that encoding error is minimum method under the situation that the position amount that will be scheduled to comes piece is given as size of code.

By the coded system Ms that mode selected cell 179 is determined, be output to code sequence generation unit 104.In addition, at the coded system Ms that is determined is to carry out under the situation of coded system of forward direction reference, forward motion vector is the information (with reference to image information) of which detected motion vector with reference to picture P4, P7, P10 and so on, also to 104 outputs of code sequence generation unit.

In addition, accordingly with reference to the resulting predicted image data Pd of picture, be output to calculus of differences unit 102 and add operation unit 106 from the coded system Ms that determined with mode selected cell 179.But, under having selected the situation of encoding in the picture, do not export above-mentioned predicted image data Pd.In addition, switch 111 under the situation of having selected to encode in the picture and 112 control and form of implementation 5 are similarly carried out.

Below, just by mode selected cell 179 as coding mode selection the situation of inter-picture prediction coding describe.

In the case, the action of calculus of differences unit 102, coded prediction error unit 103, code sequence generation unit 104 and predicated error decoding unit 105 and coding control unit 170 is similarly carried out with form of implementation 5.

But in this form of implementation 7, as the heading message of picture P13, additional representation picture P13 carries out information encoded with 3 I or the P picture in the place ahead as the reference candidate screen.In addition,, the decoded data Dd of corresponding picture P13 should be put aside the reference picture when decoding with the information (sign) in the memory 117 when the coding of other pictures, also be added as the heading message of picture P13 so be illustrated in because picture P13 is referenced.And then, expression picture P13 should be put aside the reference picture with during in the memory 117 for the information when the decoding of picture P22, add as the heading message of picture P13.

In addition, as the expression above-mentioned should put aside during method, the temporal information of with good grounds picture P22 (for example, the temporal positional information of picture numbering etc., decode time information, show temporal information etc.) method represented, the method for representing according to information during from picture P13 to picture P22 (for example frame numbers etc.) etc.These heading messages, remove the heading message of picture unit, beyond just recording and narrating, also can be used as the heading message of sequence integral body and the heading message of number frame units (for example the Group of pictures in the MPEG mode etc.) and record and narrate as the heading message of coded object picture.

In addition, in coded system for each piece of picture P13, under the situation for the coded system of carrying out the forward direction reference, forward motion vector is for also being affixed in the code sequence with reference to the information (with reference to image information) of detected motion vector of candidate screen and so on reference to which of picture P4, P7, P10.For example, motion vector be with reference to the resulting situation of picture P10 under, the P picture before 1 of presentation code object picture just appends in the code sequence for the information (with reference to the picture numbering) with reference to picture.Motion vector be with reference to the resulting situation of picture P7 under, the P picture before 2 of presentation code object picture just appends in the code sequence for the information (with reference to the picture numbering) with reference to picture.Motion vector be with reference to the resulting situation of picture P4 under, the P picture before 3 of presentation code object picture just appends in the code sequence for the information (with reference to the picture numbering) with reference to picture.For example, can be with reference to picture by the picture before 1 of reference picture numbering [0] indicated object picture, by the picture before 2 of reference picture numbering [1] indicated object picture be with reference to picture, and the picture of being numbered by the reference picture before 3 of [2] indicated object picture is with reference to picture.

In addition, as heading message, record and narrate expression P picture and use 3 to carry out the inter-picture prediction information encoded with reference to candidate screen.

By same processing, carry out handling for the remaining macroblock encoding of picture P13.Then, when the whole macroblock encoding processing for picture P13 finishes, then carry out the encoding process of picture B11.

The encoding process of＜picture B11 〉

Because picture B11 is the B picture, so use the inter-picture prediction coding of two-way reference as the encoding process of picture B11.In the case with reference to image, use apart from 2 approaching in time pictures of coded object picture (I or P picture) as the candidate screen of forward direction reference, immediate in time 1 B picture uses apart from immediate in time I of coded object picture or P picture to the candidate screen of reference as the back.But do not carry out being positioned at above its I the most nearby or the processing of the B picture of P picture with reference to relative coding object picture.

Thereby, use picture P7, P10 as forward direction with reference to picture for picture B11, use picture P13 as the back to the reference picture.Because in the processing of the 1st B picture of continuous B picture, this B picture of the 1st is used as with reference to picture when the coding of other B picture, so coding control unit 170 is controlled so that switch 113,114,115 becomes connection each switch.Therefore, the corresponding view data Md of piece with the picture B11 that is read with memory 101 from the input picture is imported into motion vector detecting unit 108, mode selected cell 179, calculus of differences unit 102.

Motion vector detecting unit 108, use as the candidate screen of forward direction reference putting aside in picture P7, the P10 of reference picture with memory 117, use to the reference picture as the back putting aside, carry out the detection of forward motion vector and the backward motion vector corresponding with the piece of picture B11 in the picture P13 of reference picture with memory 117.In the case, the detection of forward motion vector is carried out with reference to picture by selection is optimal from picture P7, P10.Detected motion vector is to mode selected cell 179 and 104 outputs of code sequence generation unit.In addition, forward motion vector is the information (with reference to image information) of which detected motion vector with reference to picture P7, P10 and so on, also to 179 outputs of mode selected cell.

Mode selected cell 179 uses by the detected motion vector of motion vector detecting unit 108, the piece corresponding coding manner of decision and picture B11.Here, the coded system of B picture, for example in the picture coded system, use forward motion vector the inter-picture prediction coded system, use the inter-picture prediction coded system of backward motion vector and use the inter-picture prediction coded system of bi-directional motion vector to select.In the selection of this coded system, also as described above, use that encoding error is the general like this method of minimum under the situation that the position amount that will be scheduled to comes piece is given as size of code.

By the coded system that mode selected cell 179 is determined, be output to code sequence generation unit 104.In addition, accordingly with reference to the resulting predicted image data Pd of picture, be output to calculus of differences unit 102 and add operation unit 106 from the coded system that determined with mode selected cell 179.But, under having selected the situation of encoding in the picture, not prediction of output view data Pd.In addition, under the situation of having been selected to encode in the picture by mode selected cell 179, switch 111 and 112 is similarly controlled during with the coding of above-mentioned picture P13.

Below, the situation of having been selected the inter-picture prediction coding by mode selected cell 179 is described.

In the case, the action of calculus of differences unit 102, coded prediction error unit 103, code sequence generation unit 104 and predicated error decoding unit 105 and coding control unit 170 is similarly carried out with form of implementation 5.

At this moment, be to carry out under the situation of coded system of forward direction reference in coded system, forward motion vector also is affixed in the code sequence for the information (with reference to image information) with reference to which detected motion vector of picture P7, P10 and so on.For example, under the situation of reference picture P10, be exactly before 1 of presentation code object picture candidate screen for reference to picture with reference to image information, under the situation of reference picture P7, be exactly before 2 of presentation code object picture candidate screen for reference to picture with reference to image information.For example, can be with reference to picture by the candidate screen before 1 of reference picture numbering [0] indicated object picture, the candidate screen of being numbered by the reference picture before 1 of [1] indicated object picture is with reference to picture.

In addition, in the case, the B picture of presentation code object be with the B picture in the place ahead also as the information of implementing the inter-picture prediction encoding process with reference to picture, do not advance additional as heading message.In addition, the place ahead of the B picture of presentation code object be the information of 2 I or P picture and 1 B picture with reference to candidate screen, add as heading message.And then expression with reference to than the I in relative coding object B picture the place ahead the most nearby or the information of the B picture that the P picture is positioned at the place ahead more, is not advanced additional as heading message.

Thus, when the code sequence Bs that the dynamic image encoding device 70 by this form of implementation is generated decodes, just can know the memory capacity that need have which kind of degree with reference to the picture memory.These heading messages, remove the heading message of picture unit, beyond just recording and narrating, also can be used as the heading message of sequence integral body and the heading message of number frame units (for example the Group of pictures in the MPEG mode etc.) and record and narrate as the heading message of coded object picture.

And then owing to picture B11 is used as with reference to picture when the coding of the picture at its rear, so should will put aside with reference to the information of picture to decode image data Dd that should picture B11 with memory 117 and so in when decoding, and be illustrated in reference to picture with should put aside in the memory 117 these data Dd during for the information when the decoding of picture B12 finishes, add as heading message respectively.Just become simple and easy with reference to picture with storage management during decoding processing thus.

By same processing, when remaining encoding process for picture B11 finishes, then carry out the encoding process of picture B12.

The encoding process of＜picture B12 〉

Because picture B12 is the B picture, so use the inter-picture prediction coding of two-way reference as the encoding process of picture B12.Use nearby 2 I or P picture in time as the candidate screen of in the case forward direction reference apart from coded object picture B12, apart from this coded object picture B12 the most nearby B picture in time, in addition, use apart from this coded object picture B12 to the candidate screen of reference as the back and be in the most nearby I or P picture in time.Just, specifically, be picture P7, P10, B11 for the candidate screen of the forward direction reference of picture B12, be picture P13 for the back of picture B12 to the reference picture.

Since picture B12 for the coding of other pictures the time not as with reference to picture, so coding control unit 170 according to control signal Cs1 each switch is controlled so that switch 113 becomes connection, and switch 114,115 becomes disconnection.Therefore, the corresponding view data Md of piece with the picture B12 that is read with memory 101 from the input picture is imported into motion vector detecting unit 108, mode selected cell 179, calculus of differences unit 102.

Motion vector detecting unit 108, use picture P7, P10, the B11 of memory 117 to be used as forward direction with putting aside with reference to picture in the reference picture, use the picture P13 of memory 117 to be used as the back with putting aside, carry out the detection of forward motion vector and the backward motion vector corresponding with the piece of picture B12 to the reference picture in the reference picture.

In the case, the detection of forward motion vector is carried out with reference to picture by selection is optimal from picture P7, P10, B11.Detected motion vector MV is output to mode selected cell 179 and code sequence generation unit 104.In addition, forward motion vector is the information (with reference to image information) of which detected motion vector with reference to picture P7, P10, B11 and so on, also to 179 outputs of mode selected cell.

Mode selected cell 179 uses by the detected motion vector of motion vector detecting unit 108, the piece corresponding coding manner of decision and picture B12.Here, the coded system of B picture, for example in the picture coded system, use forward motion vector the inter-picture prediction coded system, use the inter-picture prediction coded system of backward motion vector and use the inter-picture prediction coded system of bi-directional motion vector to select.

Coded system Ms by mode selected cell 179 is determined exports code sequence generation unit 104.In addition, accordingly with reference to the resulting predicted image data Pd of picture, be output to calculus of differences unit 102 and add operation unit 106 from the coded system that determined with mode selected cell 179.But, under having selected the situation of encoding in the picture, not prediction of output view data Pd.

In addition, under the situation of having been selected to encode in the picture by mode selected cell 179, switch 111 and 112 is similarly controlled during with the coding of above-mentioned picture P13.

Below, the situation of having been selected the inter-picture prediction coding by mode selected cell 179 is described.

In the case, the action of calculus of differences unit 102, coded prediction error unit 103, code sequence generation unit 104 and predicated error decoding unit 105 and coding control unit 170 is similarly carried out with form of implementation 5.

At this moment, be to carry out under the situation of coded system of forward direction reference in coded system, forward motion vector also is affixed in the code sequence for the information (with reference to image information) with reference to which detected motion vector of picture P7, P10, B11 and so on.

In addition, as heading message, presentation code object B picture B12 is an information of the B picture B11 in its place ahead also being implemented the inter-picture prediction encoding process as the candidate of reference picture, and the candidate screen of expression forward direction reference is that the information of 2 I or P picture and 1 B picture is is also recorded and narrated.

And then as heading message, expression picture B12 is not used as when the encoding process of the picture at its rear and adds with reference to the information of picture.

Thus, just can judge easily that the decode image data Dd of corresponding picture B12 does not need to put aside with reference to the picture memory when decoding, memory-aided management just becomes simple and easy with reference to picture.

These heading messages, remove the heading message of picture unit, beyond just recording and narrating, also can be used as the heading message of sequence integral body and the heading message of number frame units (for example the Group of pictures in the MPEG mode etc.) and record and narrate as the heading message of coded object picture.

By same processing, carry out the remaining encoding process of picture B12.

Then, each picture corresponding view data later with above-mentioned picture B12 by corresponding with picture type, encoded with above-mentioned same processing.For example, P picture and picture P13 similarly handle, and the 1st B picture (picture B14, B17 etc.) of continuous B picture is similarly handled with picture B11.The 2nd B picture (picture B15, B18 etc.) of continuous in addition B picture is similarly handled with picture B12.

Like this, in the dynamic image encoding device 70 of this form of implementation 7, because when the B picture being encoded as the coded object picture, candidate screen as the forward direction reference, beyond the P picture, also use the B picture, so with reference to picture, just can utilize the forward direction the most nearby that is positioned at the coded object picture with reference to picture as forward direction.Thus, just can improve precision of prediction, can seek the raising of code efficiency for the motion compensation of B picture.

And, because when the B picture being encoded as the coded object picture, as heading message, this coded object picture of additional representation (during decoding) when the coding of other pictures, whether be used as information with reference to picture, and then, as heading message, additional representation (during decoding) when the coding of this coded object picture at other pictures is used as under the situation with reference to the information of picture, this coded object picture should be put aside with reference to picture the information during memory-aided, so when the code sequence Bs that exports from the dynamic image encoding device of this form of implementation 7 is decoded, what just can know simply when decoding at picture savings picture in the memory, till when arriving during perhaps should putting aside, simplifying with storage management in the time of can making decoding with reference to picture.

In addition, although in above-mentioned form of implementation 7, at the B of coded object picture with other B picture as implementing under the situation of encoding process with reference to picture, this situation is recorded and narrated as the heading message of the B picture of coded object, but this heading message, except that recording and narrating as the heading message of picture unit, the heading message that also can be used as the heading message of sequence integral body and several picture unit (for example the Group of pictures in the MPEG mode etc.) is recorded and narrated.

In addition, although in this form of implementation 7, illustrated that motion compensation is is that unit carries out with the macro block of being made up of 16 pixels (horizontal direction) * 16 pixels (vertical direction), the encoding process of prediction error image data is to be unit with the piece of being made up of 4 pixels (horizontal direction) * 4 pixels (vertical direction), be the situation that unit handles perhaps with the piece of forming by 8 pixels (horizontal direction) * 8 pixels (vertical direction), but the encoding process of motion compensation and prediction error image data, also the image space that can form with the pixel of the number different with these units is that unit carries out.

In addition, although in this form of implementation 7, with the coded system of P picture is coded system in the picture, use the inter-picture prediction coded system of motion vector, and 1 coded system of inter-picture prediction coding mode selection of not using motion vector, the coded system of B picture is a coded system in the picture, use the inter-picture prediction coded system of forward motion vector, use the inter-picture prediction coded system of backward motion vector, use the situation of 1 coded system of inter-picture prediction coding mode selection of bi-directional motion vector to be illustrated as example, but select the method for the coded system of P picture and B picture, be not limited to form of implementation 7.

In addition, although in this form of implementation 7, be illustrated between I picture and the P picture, and the image sequence that inserts 2 B pictures between the P picture of adjacency, but image sequence also can be between I picture and P picture, and the numbers beyond inserting 2 between the P picture of adjacency, for example 3 or 4 s' B picture.

In addition, although in this form of implementation 7, be that 3 situation is illustrated to the frame numbers that is used as the candidate screen of forward direction reference when the coding of P picture, it also can be other value.

In addition, although in this form of implementation 7, to when the coding of B picture as the candidate screen of forward direction reference, use the situation of 2 P pictures and 1 B picture to be illustrated, but, also can use P picture and B picture with above-mentioned form of implementation 7 different numbers as the candidate screen of the forward direction reference when the coding of B picture.For example, as candidate screen, can use 1 P picture and 2 B pictures, 2 P pictures and 2 B pictures or it doesn't matter that ground is positioned in time near 3 pictures of coded object picture with picture type for the forward direction reference of B picture.

Here, when the coding at the B picture, only will be positioned near 1 picture of this B picture as with reference under the such situation of picture, the information (with reference to image information) that piece with reference to which picture is encoded and so on does not just need to record and narrate in code sequence.

In addition, although in this form of implementation 7, to when the coding of B picture, the B picture that is positioned at the place ahead more than the forward direction I or the P picture that are positioned near this B picture, be not illustrated as situation with reference to picture, but when the coding of B picture, also can be positioned at the B picture in the place ahead more, be used as with reference to picture than the forward direction P picture the most nearby that is positioned at this B picture.

(form of implementation 8)

Then form of implementation 8 of the present invention is described.

Figure 35 is the block diagram that explanation utilizes the moving image decoding apparatus of form of implementation 8 of the present invention to use.

The moving image decoding apparatus 80 of this form of implementation 8 is decoded to the code sequence Bs that exports from the dynamic image encoding device 70 of above-mentioned form of implementation 7.

The moving image decoding apparatus 80 of this form of implementation 8, the candidate screen of when the decoding of P picture and B picture, carrying out the forward direction reference, and different for the coded system of B picture with the moving image decoding apparatus 20 of above-mentioned form of implementation 2.

Just, the moving image decoding apparatus 80 of this form of implementation 8, the memory control unit 204 and the mode decoding unit 223 of replacement form of implementation 2 have the memory control unit 284 and the mode decoding unit 283 that carry out the action different with them.

Specifically, the memory control unit 284 of the moving image decoding apparatus 80 of form of implementation 8, to the reference picture control with memory 207 so that, when the decoding of P picture, 3 pictures (I or P picture) that are positioned at this P picture the place ahead are used as the candidate screen of forward direction reference, when the decoding of B picture, be positioned at this B picture the place ahead 2 pictures (I or P picture), be positioned at this B picture the most nearby 1 forward direction B picture and 1 I or the P picture at rear be used as candidate screen.But be set in relative decoder object and do not carry out reference at the I in its place ahead the most nearby or the B picture more on the front of P picture.

Above-mentioned memory control unit 284, based on what in the code sequence of corresponding objects picture, inserted, represent whether this object picture carries out reference for the encoding process of the later picture of this object picture time the sign, according to control signal Cm to reference to controlling with picture memory 207.

Specifically, in the code sequence of answering the object picture, comprise and be illustrated in decoding and the time data of object picture should be put aside with reference to the information (sign) of picture with memory 207, and represent that it should put aside during information.

In addition, the mode decoding unit 283 of the moving image decoding apparatus 80 of form of implementation 8, when the decoding of the piece of P picture, coded system as the object piece, in picture, decode, use the inter-picture prediction decoding of motion vector, do not use in the inter-picture prediction decoding of motion vector (motion is made as 0 to be handled) and select one, when the decoding of the piece of B picture, as the coded system of object piece, in picture, decode, use the inter-picture prediction decoding of forward motion vector, use the inter-picture prediction decoding of backward motion vector, and select one in the decoding of the inter-picture prediction of use forward motion vector and backward motion vector.Just, the mode decoding unit 283 of the moving image decoding apparatus 80 of this form of implementation 8, mode decoding unit 223 with the moving image decoding apparatus 20 of form of implementation 2, only do not using difference on the decoding processing this point of corresponding direct mode, thereby, this moving image decoding apparatus 80 does not have the motion vector storage unit 226 of moving image decoding apparatus 20.And, other structures of the moving image decoding apparatus 80 of form of implementation 8, identical with in the moving image decoding apparatus 20 of form of implementation 2.

In addition, the moving image decoding apparatus 80 of this form of implementation 8, moving image decoding apparatus 60 with form of implementation 6,284 pairs of code sequence generation units 104 of memory control unit control so that, the sign that whether this object picture is referenced when being illustrated in the encoding process for the later picture of object picture is inserted into different on this point in should the code sequence of object picture.In addition in the moving image decoding apparatus 80 of form of implementation 8, also different with the moving image decoding apparatus 60 of above-mentioned form of implementation 6 in the candidate screen of the decoding time institute reference of P picture and B picture.And, other structures in the moving image decoding apparatus 80 of this form of implementation 8 are identical with the moving image decoding apparatus 60 of form of implementation 6.

Then action is described.

Be located in the moving image decoding apparatus 80 of this form of implementation 8 the code sequence Bs that input is generated by the dynamic image encoding device 70 of above-mentioned form of implementation 7.

Here, when the decoding of P picture, 3 pictures (I or P picture) nearby that relative this P picture are in time the place ahead use as the candidate of reference picture.In addition, when the decoding of B picture, 1 I or the P picture that relative this B picture are in time 2 pictures (I or P picture) in the place ahead nearby, 1 the B picture the most nearby that is in the place ahead and rear use as the candidate of reference picture.But when being provided in a side of the decoding of B picture, being positioned at the I that is in the place ahead the most nearby in time or the B picture more on the front of P picture and not carrying out reference.In addition, when the decoding of I picture, not with reference to other picture.

In addition, in the decoding processing of P picture and B picture, which picture is used as with reference to picture in candidate screen, records and narrates in advance as the heading message Ih of code sequence Bs, and this heading message is extracted by code sequence analytic unit 201.

This heading message Ih is output to memory control unit 284 then.In addition, establish this heading message, record and narrate as the heading message of the heading message of sequence integral body, number picture unit (for example the Group of pictures in the MPEF mode etc.), the heading message of picture unit.

Be input to the order of the picture among the code sequence Bs of moving image decoding apparatus 80 of this form of implementation 8, shown in Figure 36 (a), like that, be the decoding order of picture.Below, the decoding processing of picture P13, B11, B12 is described in order particularly.

The decoding processing of＜picture P13 〉

When the code sequence of corresponding picture P13 was imported into code sequence analytic unit 201, code sequence analytic unit 201 extracted various data from institute's input code sequence.Here various data are to say with mode to select the information of relevant information (coded system) Ms, motion vector MV and above-mentioned heading message Ih etc.The coded system Ms that is extracted is output to mode decoding unit 283.In addition, the motion vector MV that is extracted is output to motion compensation decoding unit 205.And then the coded data Ed that is extracted by code sequence analytic unit 201 is output to predicated error decoding unit 202.

Mode decoding unit 283 based on the information of selecting from the mode that code sequence extracted (coded system) Ms, is controlled switch 209 and 210.Coded system Ms is the situation of coded system in the picture, and coded system Ms is the control of 209 and 210 under the situation of inter-picture prediction coded system, similarly carries out with above-mentioned form of implementation 6.

In addition, mode decoding unit 283 also also outputs to motion compensation decoding unit 205 with coded system Ms.Below, be that the situation of inter-picture prediction coded system describes to selection mode.

In the case, because the action of predicated error decoding unit 202, motion compensation decoding unit 205, add operation unit 208 is same with form of implementation 6, so its explanation is omitted.

Figure 37 represents keeping the situation that the time of the picture of data changes with memory 207 by the reference picture.

When the decoding of picture P13 begins, keeping picture B8, P7, P10 in the region R 1 of memory 207, R2, R3 at the reference picture.In picture P13, picture P7, P10 as implementing decoding processing with reference to the candidate of picture, are kept picture P13 in the storage area R1 that has kept picture B8 then.The rewriting with reference to the view data of each picture in the picture usefulness memory is like this carried out based on the heading message of each picture that is added in code sequence.This heading message is expression, use in the memory 207 at the reference picture, picture P7 finishes Shi Douying up to the decoding processing of picture P13 and keeps, picture P10 finishes Shi Douying up to the decoding processing of picture P16 and keeps, and picture B8 finishes the information that Shi Douying keeps up to the decoding processing of picture B9.

In other words owing to can judge that picture B8 no longer needs in the decoding of the later picture of picture P13, so keep picture B8 with reference to picture storage area R1, P13 is rewritten by picture.

In addition, owing to heading message, recording and narrating and representing that picture P13 finishes Shi Douying up to the decoding of picture P19 and remains in reference to picture with the information in the memory, so be maintained at least so far with reference to picture with in the memory as picture P13.

As top, the piece of picture P13 is decoded in order.Whole when decoded when the coded data of the piece of corresponding picture P13, beginning is for the decoding processing of picture B11.

The decoding processing of＜picture B11 〉

The action of code sequence analytic unit 201, mode decoding unit 203 and predicated error decoding unit 202, identical during with the decoding processing of picture P13, so their action specification is omitted.

Motion compensation decoding unit 205 according to the information of the motion vector of being imported etc., generates motion-compensated image data Pd.Just, the information that is input to motion compensation decoding unit 205 is, with the motion vector MV of corresponding above-mentioned picture B11 with reference to the relevant information of picture numbering.Picture B11 carries out reference as forward direction with reference to picture with picture P10, picture P13 is carried out reference as the back to the reference picture implement encoding process.Thereby when the decoding of picture B11, these candidate screen P10, P13 have been implemented decoding processing, and corresponding decode image data DId is held in reference to picture memory 207.

In coded system is under the situation of bi-directional predicted predictive pictures coded system, motion compensation decoding unit 205, information based on forward motion vector, obtain forward direction with reference to image from the reference picture with memory 207, based on the information of backward motion vector, obtain the back to the reference image with memory 207 from the reference picture.Then, motion compensation decoding unit 205 generates motion compensated image by forward direction is carried out summation averaging with reference to image and back to the reference image.The data Pd of the motion compensated image that is generated is output to add operation unit 208 like this.

Add up the prediction error image data PDd that is imported mutually with motion-compensated image data Pd in add operation unit 208, output addition view data Ad.The addition view data Ad that is generated is output to reference to picture memory 207 by switch 210 as decode image data DId.

With memory control unit 284, based on as the heading message of code sequence, expression P picture and B picture are the information what kind of candidate screen to implement encoding process with reference to, carry out with reference to the control of picture with memory 207 by the reference picture.

Figure 37 represents the situation that changes in time with the savings state of the picture in the memory 207 with reference to picture.

When the decoding of picture B11 begins, keeping picture P13, P7, P10 in memory 207 at the reference picture.In picture B11, picture P10, P13 as implementing decoding processing with reference to picture, are kept picture B11 in the storage area R2 that has kept picture P7 then.The rewriting with reference to the view data of each picture in the picture usefulness memory is like this carried out based on the heading message of each picture that is added in code sequence.This heading message is expression, use in the memory 207 at the reference picture, picture P7 finishes Shi Douying up to the decoding processing of picture P13 and keeps, picture P10 finishes Shi Douying up to the decoding processing of picture P16 and keeps, and picture P13 finishes the information that Shi Douying keeps up to the decoding processing of picture P19.

In other words, owing to can judge that picture P7 no longer needs when the decoding of the later picture of picture P13,, keep picture B11 just keeping picture using among the storage area R2 of P7 with reference to picture.

In addition, because heading message as picture B11, recording and narrating and representing that picture B11 finishes Shi Douying up to the decoding of picture B12 and remains in reference to the information in the picture usefulness memory 207, so so far at least, picture B11 is maintained at reference to picture with in the memory 207.

As top, the coded data of the piece of corresponding picture B11 is decoded in order.Whole when decoded when the coded data of the piece of corresponding picture B11, carry out the decoding of picture B12.

The decoding processing of＜picture B12 〉

The action of above-mentioned code sequence analytic unit 201, mode decoding unit 203 and predicated error decoding unit 202, identical during with the decoding processing of picture P13, so their action specification is omitted.

Motion compensation decoding unit 205 according to the information of the motion vector of being imported etc., generates motion-compensated image data Pd.Just, the information that is input to motion compensation decoding unit 205 is, the motion vector of corresponding above-mentioned picture B12 and number with reference to picture.Picture B12 uses as forward direction picture P10 and B11 with reference to the candidate of picture, picture P13 is carried out reference as the back to the reference picture implement encoding process.These candidate screen P10, B11, P13 have been implemented decoding processing, and corresponding decode image data is held in reference to picture memory 207.

In coded system is under the situation of bi-directional predictive coding mode, motion compensation decoding unit 205, decide picture B12 which picture of picture P10, B11 is implemented encoding process as forward direction with reference to picture according to reference picture numbering, then, based on the information of forward motion vector, obtain forward direction with reference to image with memory 207 from the reference picture.In addition, the back based on the information of backward motion vector, is obtained to the reference image from the reference picture with memory 207 in motion compensation decoding unit 205.Then, by forward direction is carried out summation averaging with reference to image and back to the reference image, generate motion compensated image.The data Pd of the motion compensated image that is generated is to 208 outputs of add operation unit like this.

By add operation unit 208, the prediction error image data PDd that is imported is added up mutually output addition view data Ad with motion-compensated image data Pd.The addition view data Ad that is generated is output to reference to picture memory 207 by switch 210 as decode image data DId.

Memory control unit 284, based on from code sequence heading message extracted, what kind of P picture and B picture be to use implement the information of encoding process and so on reference to picture, carries out with reference to the control of picture with memory 207.

Figure 37 represents the situation that changes in time with the hold mode of the picture in the memory 207 with reference to picture.When the decoding processing of picture B12 begins, keeping picture P13, B11, P10 in memory 207 at the reference picture.Then in picture B12, with picture P13, B11, P10 as implementing decoding processing with reference to candidate screen.Here, because picture B12 is not used as heading message as the information with reference to picture and so on and records and narrates when the decoding of other pictures, so the decoded data of picture B12 does not just remain on reference to picture and uses in the memory 207, intactly exports as output image data Od.

As top, the coded data of the piece of corresponding picture B12 is decoded in order.Remain in reference to the decode image data of picture with each picture in the memory 207, and do not put aside in the reference picture with the decode image data in the memory, like that, handle by showing that time sequencing is implemented to reset shown in Figure 36 (b), Od exports as output image data.

Below, each picture by the processing same with the picture of above-mentioned each picture type, is implemented the decoding processing of coded data according to picture type.

That is, P picture and picture P13 similarly implement coded data is carried out process of decoding, and the 1st B picture (picture B14, B17 etc.) of continuous B picture is implemented and the same decoding processing of picture B11.The 2nd B picture (picture B15, B18 etc.) of continuous in addition B picture is implemented and the same decoding processing of picture B12.

Like this, in the moving image decoding apparatus 80 of this form of implementation 8, because when decoding B picture, the B picture is used as with reference to candidate screen, so, just can when coding B picture,, except that the P picture, also use the resulting code sequence of encoding process of B picture correctly to decode to by candidate screen as the forward direction reference.In addition, because this moment, what kind of use is to use implement the information of encoding process and so on reference to picture from the resulting P picture of code sequence and B picture, carries out with reference to the memory-aided control of picture, so memory-aided effective utilization just becomes possibility with reference to picture.Just, be used as view data when making decoding processing afterwards in advance with reference to the picture of picture, remain on reference to picture with in the memory, and be not used as view data in order during afterwards decoding processing of deletion with reference to the picture of picture, just can effectively utilize with reference to the picture memory.

In addition, although in this form of implementation 8, the corresponding code sequence that disposes the image sequence of 2 B pictures between the P of adjacency picture is shown, the number of the B picture between the P of adjacency picture is not limited to 2, for example also can be 3 or 4.

In addition, although in this form of implementation 8, when being illustrated in the decoding processing of P picture, using the situation of 2 pictures, the quantity of carrying out the forward direction candidate screen of reference when the decoding processing of P picture as the candidate screen of forward direction reference also can be quantity beyond 2.

In addition, although in this form of implementation 8, candidate screen as the forward direction reference has been described when the decoding of B picture, use 1 P picture and 1 B picture, and than relative decoder object B picture be positioned in time the most nearby I or the P picture be positioned at the place ahead more the B picture as situation with reference to picture, but the picture that when the decoding processing of B picture, uses as the reference candidate screen, also can be with shown in the above-mentioned form of implementation 8 different.In addition, when the decoding processing of B picture, also can be as with reference to picture than I or the P picture B picture that is positioned at the place ahead more that relative decoder object B picture is positioned at the most in time.

In addition,, the decode image data that is not used as with reference to the picture of picture has been described when the decoding of other pictures, has not put aside, it is put aside in the memory-aided situation of reference picture although in this form of implementation 8.

For example, handle than the decoding processing of each picture to want also how much delay is carried out under such situation, just the decode image data of each picture need be put aside with reference to the picture memory in the output of the decode image data that makes each picture.In the case, the reference picture with memory on, the zone different with the storage area of putting aside as the decode image data of reference candidate screen is set, and savings does not get final product as the decode image data with reference to the picture of picture in this zone.In the case, increase with reference to the memory-aided memory capacity of picture, same with reference to memory-aided management method of picture and above-mentioned form of implementation 8, can realize utilizing easy method with reference to the picture storage management.

In addition, although in above-mentioned form of implementation 2,4,6,8, the situation that whole pictures are used as with reference to candidate screen is illustrated, and not necessarily will be limited to whole pictures and be used as with reference to candidate screen.

When describing simply, usually in moving image decoding apparatus, no matter implemented that decoded pictures is used as or as with reference to candidate screen, in case be stored in decoding buffer storage (decoded frame memory) afterwards, this decoded picture just read successively and shown from this decoding buffer storage.

In this form of implementation 2,4,6,8, the situation that whole pictures are used as with reference to candidate screen is illustrated, thereby, in these forms of implementation, illustrate decoded picture all be stored in storage as with reference to the picture of candidate screen with reference to the picture memory, afterwards, decoded picture from the reference picture with memory by the situation of reading successively and showing.

But as described above, being not limited to, decoded picture all is used as with reference to candidate screen.Thereby, also can make decoded picture, in case be stored in not only storage not as picture with reference to candidate screen, but also storage is as with reference to the decoding buffer storage (decoded frame memory) of the picture of candidate screen afterwards, this decoded picture just read successively and shown from this decoding buffer storage.

In addition, although in above-mentioned each form of implementation, the situation that is realized dynamic image encoding device or moving image decoding apparatus by hardware is shown, these devices also can be realized by software.In the case, record the data storage medium of floppy disc etc. by the program that will be used to carry out encoding process shown in above-mentioned each form of implementation or decoding processing in advance, independently realizing that simply above-mentioned dynamic image encoding device or moving image decoding apparatus just become possibility in the computer system.

Figure 38 is used to illustrate that the moving image encoding that carries out above-mentioned form of implementation 1,3,5,7 is handled or the figure of the computer system that the moving picture decoding of form of implementation 2,4,6,8 is handled.

Figure 38 (a) be illustrated in use in the computer system as the floppy disc of the storage medium of program, the outward appearance of seeing from the front, cross section structure and floppy disc main body, the example of the physical format of Figure 38 (b) expression floppy disc main body.

Floppy disc FD is built in above-mentioned disk main body D in the shell F, and on the surface of this disk main body D, concentric circles ground inwardly forms a plurality of magnetic track Tr from periphery in week, and each magnetic track is divided into 16 sector Se along angle direction.Thereby, in having preserved the floppy disc FD of said procedure, be used for carrying out the program that above-mentioned moving image encoding is handled or moving picture decoding is handled and just be recorded in the storage area that on above-mentioned disk main body D, is distributed.

In addition, Figure 38 (c) expression is used for carrying out at floppy disc FD the structure of the record-playback of said procedure.Under situation about said procedure being recorded among the floppy disc FD, from computer system Csys said procedure is written to floppy disc FD by the floppy disc starter.In addition, program in utilization is recorded in floppy disc FD is constructed in computer system under the situation of above-mentioned dynamic image encoding device or moving image decoding apparatus, by floppy disk driver FDD computer system Csys is read and be sent to said procedure from floppy disc FD.

In addition, although in the above description, be that example is enumerated with the floppy disc as recording medium, use CD also can similarly utilize the moving image encoding of software to handle or the moving picture decoding processing with the situation of using above-mentioned floppy disc.In addition, recording medium is not limited to this, also can be CD-ROM, storage card, ROM cassette tape etc., as long as can logging program, can similarly be undertaken also under the situation of using these data carriers that moving image encoding is handled or moving picture decoding is handled with the situation of using above-mentioned floppy disc by computer system.

And then below, to the application example of dynamic image encoding method shown in the above-mentioned form of implementation and dynamic image decoding method and use its system to describe.

Figure 39 is the integrally-built block diagram that expression realizes the content provider system 1100 of content converting service.

The district that provides of communication service is divided into the zone (unit) of desired size, is respectively arranged with the base station 1107～1110 as fixed radio station in each unit.

In this content provider system 1100, for example, by Internet Service Provider 1102, telephone network 1104 and base station 1107～1110, each equipment such as portable phone 1200 of computer 1111, PDA (personal digital assistant) 1112, camera 1113, portable phone 1114, band camera is connected to the Internet 1101.

But, be not limited to content provider system 1100 and comprise all a plurality of equipment shown in Figure 39, also can comprise the part of a plurality of equipment shown in Figure 39.In addition, each equipment also can be directly connected to telephone network 1104 not by the base station 1107～1110 as fixed radio station.

Here, camera 1113 is the equipment that digital camera etc. can carry out the motion picture photography.In addition, portable phone is the portable telephone of PDC (Personal Digital Communication) mode, CDMA (Code Division Multiple Access) mode or GSM (Global System for Mobile Communications) mode, perhaps also can be PHS (Personal Handyphone System) etc., arbitrary mode.

In addition, streaming server 1103, by base station 1109, telephone network 1104 is connected with camera 1113 in advance, and in this system, use camera 1113 can carry out the on-site delivery based on the data of the encoding process of user's transmission.The encoding process of captured data both can be by camera 1113, and also the server that can be handled by the transmission of carrying out data etc. carries out.In addition, take resulting moving picture data by 1116 pairs of moving images of camera and also can send to streaming server 1103 by computer 1111.Camera 1116 is the equipment that digital camera etc. can be taken still frame, motion picture.In the case, the coding of moving picture data is undertaken all can by which of camera 1116, computer 1111.In addition, encoding process is undertaken by the LSI1117 that computer 1111 and camera 1116 have.

In addition, the also software that image encoding/decoding is used is kept in the savings medium (CD-ROM, floppy disc, hard disc etc.) as the recording medium that can be read by computer 1111 grades.And then moving picture data also can be sent by the portable phone 1200 of band camera.This moving picture data is the data of the coded processing of LSI that had by portable phone 1200.

In this content provider system 1100, the content that the user takes by camera 1113, camera 1116 etc. (for example, taken the video image at music scene etc.), similarly carry out sending to streaming server 1103 from camera after the encoding process with above-mentioned form of implementation, on the other hand, from streaming server 1103, the client computer that request is arranged banishd the foregoing data send.

As client computer, have and to decode computer 1111, PDA1112, camera 1113, portable phone 1114 etc. to the data of above-mentioned coded processing.

In such content provider system 1100, can receive and reproduce data encoded at client-side, and then by receiving the decode in real time at client-side, and reproduce, then can also realize personal broadcasting.

In the coding of each equipment that constitutes this system, decoding, use dynamic image encoding device or the moving image decoding apparatus shown in above-mentioned each form of implementation to get final product.

As the one example portable phone is described.

Figure 40 is the figure that the portable phone 1200 of dynamic image encoding method illustrated in above-mentioned form of implementation and dynamic image decoding method is used in expression.

This portable phone 1200 has, be used for and base station 1110 between the transmitting-receiving electric wave antenna 1201, but the camera unit 1203 of capture video images such as CCD camera, still frame shows by the captured video image of camera unit 1203, by the display unit 1202 of the LCD of the data of video image that antenna 1201 received etc. etc.

In addition, portable phone 1200 has, the main unit 1204 of a plurality of operation keyss is installed, be used to carry out the voice-output unit 1208 of the loud speaker etc. of voice output, be used to carry out the voice-input unit 1205 of the microphone etc. of phonetic entry, the recording medium 1207 of the data that are used to preserve data, the data of motion picture or the data of still frame etc., the data encoded of the data of captured motion picture or still frame, the mail that received or decoded is used for recording medium 1207 to be installed to the receptacle unit 1206 of portable phone 1200.

Here, recording medium 1207 has been preserved a kind of flash memory element of EEPROM (Electrically ErasableProgrammable Read Only Memory) as electrically rewritable and the nonvolatile memory that can wipe in the plastic casing of SD card etc.

And then, use Figure 41 that portable phone 1200 is at length described.

Portable phone 1200 has the main control unit 1241 that each parts of the main unit of purchase display unit 1202 and operation keys 1204 are controlled with being all together.

Portable phone 1200 in addition, have power circuit unit 1240, operation Input Control Element 1234, image encoding unit 1242, camera interface unit 1233, LCD (LiquidCrystal Display) control unit 1232, picture decoding unit 1239, demultiplex unit 1238, record-playback unit 1237, adjust demodulator circuit unit 1236 and Audio Processing Unit 1235.Each parts of portable phone 1200 are connected with each other by synchronous bus 1250.

Power circuit unit 1240, when the operation by the user became end of conversation and power key on-state, by the electrical power to each parts supply battery pack, but the portable phone 1200 of startup band digital camera was an operate condition.

In portable phone 1200, carry out the action of each parts by the control of the main control unit 1241 formed by CPU, ROM and RAM etc.Just, in portable phone 1200, when the voice call mode,, be transformed into digital voice data by Audio Processing Unit 1235 by to the resulting voice signal of the phonetic entry of voice-input unit 1205.Digital voice data is implemented the frequency spectrum diffusion processing by adjusting demodulator circuit unit 1236, and then implements digitaltoanalogconversions by transmission circuit unit 1231 and handle and frequency conversion process, sends by antenna 1201.

In portable phone 1200, the received signal that is received by antenna 1201 when the voice call mode is by amplification and implement frequency conversion process and the analog-to-digital conversion processing in addition.Received signal and then, implement the frequency spectrum counter diffusions and handle by adjusting demodulator circuit unit 1236, be transformed into analog voice signal by Audio Processing Unit 1235, this signal is exported by voice-output unit 1208.

And then, in portable phone 1200, when at data communication mode under the situation of send Email, the text data of the Email that the operation of the operation keys 1204 by main unit is imported sends to main control unit 1241 by operation Input Control Element 1234.Main control unit 1241, each parts is controlled so that by adjusting the processing of the 1236 pairs of text datas enforcement in demodulator circuit unit frequency spectrum diffusion, implemented to send to base station 1110 by antenna 1201 after digitaltoanalogconversions processing and the frequency conversion process by transmission circuit unit 1231.

In portable phone 1200, when at data communication mode, send under the situation of view data, supply to image encoding unit 1242 by camera unit 1203 captured view data by camera interface unit 1233.In addition, in portable phone 1200, under the situation that does not send view data, also can will directly be shown to display unit 1202 by the shooting acquired image data of camera unit 1203 by camera interface unit 1233 and LCD control unit 1232.

The image encoding unit 1242 illustrated dynamic image encoding device in above-mentioned each form of implementation of purchasing, this image encoding unit 1242, by dynamic image encoding method the view data of being supplied with from camera unit 1203 is carried out compressed encoding and be transformed into coded image data, send to demultiplex unit 1238 by above-mentioned form of implementation.In addition, meanwhile portable phone 1200 voice that will be input to voice-input unit 1205 in photography by camera unit 1203 send to demultiplex unit 1238 by Audio Processing Unit 1235 as the speech data of numeral.

Demultiplex unit 1238 carries out demultiplexing to the coded image datas of 1242 supplies from the image encoding unit and the speech data of supplying with from Audio Processing Unit 1235 in a predetermined manner.The resulting demultiplexing data of its result are implemented the frequency spectrum diffusion processing by adjusting demodulator circuit unit 1236, and then implement digitaltoanalogconversions by transmission circuit unit 1231 and handle and frequency conversion process, send by antenna 1201.

In addition, in portable phone 1200, when at data communication mode, be received under the data conditions of the middle motion pictures files that link such as homepage, by antenna 1201 from the base station 1110 received signals that receive, implement frequency spectrum counter diffusion processing by adjusting demodulator circuit unit 1236, the resultant demultiplexing data of its result send to demultiplex unit 1238.

In addition, when the demultiplexing data that received by antenna 1201 are decoded, demultiplex unit 1238, by the demultiplexing data being decomposed the coding stream that is divided into view data and the coding stream of speech data, by synchronous bus 1250 this coded image data is supplied with picture decoding unit 1239 and simultaneously this speech data is supplied with Audio Processing Unit 1235.

Then, purchase and utilize the moving image decoding apparatus of form of implementation of the present invention in picture decoding unit 1239.Picture decoding unit 1239, by with coding/decoding method corresponding to the coding method of the form of implementation of the invention described above, the coding stream of view data decoded generates the reproducing motion pictures data, and by LCD control unit 1223 it is supplied with display unit 1202.Thus, carry out the demonstration of the moving picture data that in the motion pictures files that for example homepage linked, comprised.Meanwhile Audio Processing Unit 1235, after speech data is transformed into analog voice signal it supplied with voice-output unit 1208.Thus, carry out the reproduction of the speech data that in the motion pictures files that for example homepage linked, comprised.

In addition, can use the dynamic image encoding method of each form of implementation of the invention described above and the system of dynamic image decoding method, and in the example that is limited to the foregoing feed system.

For example, utilize the digital broadcasting of satellite, surface wave to become topic recently, the picture coding device of above-mentioned form of implementation or picture decoding apparatus also can be applied to the digital broadcasting system as shown in figure 42 like that.

Specifically, the coding stream of 1409 video image informations sends to the satellite 1410 of communication satellite or broadcasting satellite etc. by radio communication from the broadcasting station.When in broadcasting satellite 1410, when receiving the coding stream of above-mentioned video image information, the electric wave of output broadcasting usefulness, this electric wave is received by the antenna 1406 of the family that holds the satellite broadcasting receiving equipment.For example, in the device of television set (receiver) 1401 or set-top box (STB) 1407 etc., coding stream is decoded, and video image information reproduces.

In addition, on as the coding stream of the savings medium 1402 of the CD of recording medium and DVD etc. and the transcriber of decoding, also the moving image decoding apparatus shown in the above-mentioned form of implementation can be installed in reading and recording.

In the case, the video image signal that is reproduced is shown in monitor 1404.In addition, also can consider following structure: mounted movable picture decoding apparatus in the set-top box 1407 of the antenna 1406 that is connected to cable 1405 that closed-circuit television uses or the broadcasting of satellite/terrestrial ripple, reproduced by the output of 1408 pairs of these moving image decoding apparatus of monitor of television set.In the case, moving image decoding apparatus also can not be contained in set-top box, but be contained in the television set.In addition, also can in automobile 1412,, on the display unit such as the auto navigation 1413 in being equipped on automobile 1412 motion picture be reproduced from received signals such as satellite 1410 or base stations 1107 with antenna 1411.

And then, also can encode to picture signal, and record recording medium by the dynamic image encoding device shown in the above-mentioned form of implementation.

In the tape deck of object lesson, have picture signal record to the DVD register of DVD dish 1421 with the register 1420 of picture signal record to the magnetic disk recorder of hard disc etc.And then picture signal, also can record SD card 1422.In addition, the moving image decoding apparatus shown in the above-mentioned form of implementation if register 1420 is purchased then can pass through register 1420, and the picture signal that is write down in DVD dish 1421 and SD card 1422 is reproduced, and is shown by monitor 1408.

In addition, structure as auto navigation 1413, consider that example is in the structure of portable phone shown in Figure 41, have camera unit 1203, camera interface unit 1233, image encoding unit 1242 part in addition, computer 1111 and television set (receiver) 1401 etc. are considered same situation.

In addition, in the terminal of above-mentioned portable phone 1114 grades, consider except that having both receiving type terminals of coder-decoder only have the transmission terminal of encoder, only have 3 kinds of installation forms of the receiving terminal of decoder.

Like this, in above-mentioned any device systems, dynamic image encoding method shown in the above-mentioned form of implementation or dynamic image decoding method can be used, just effect illustrated in above-mentioned form of implementation can be obtained by such processing.

And then, need not superfluous words, form of implementation of the present invention and application example thereof are not limited to shown in this specification.

The possibility of utilizing on the industry

Dynamic image encoding method and moving picture decoding related to the present invention as top Method, when becoming coding or the object picture of decoder object and be the B picture, as for The object picture with reference to picture, can use the forward direction the most nearby that is positioned at this object picture to draw Face can improve the precision of prediction of the motion compensation of B picture, and seeks carrying of code efficiency Height, transmit or the Data processing of storing moving image data of great use.

Claims (1)

1. a dynamic image decoding method to decoding to generate the view data corresponding to each picture with the corresponding code string of a plurality of pictures that constitutes moving image, is characterized in that,

Have: decoding step, when decoding as the object picture of decoder object, only utilize the I the decoding schema piece of above-mentioned object picture is not decoded that each piece of above-mentioned object picture is decoded, or utilize not the I decoding schema of the piece of above-mentioned object picture being decoded and each piece of above-mentioned object picture is decoded with reference to an a kind of decoding schema that has come piece to above-mentioned object picture to carry out in the P decoding schema of prediction decoding through the picture of decoding processing with reference to other picture with reference to other picture;

According to be included in the above-mentioned code string, whether be illustrated in when other picture after the above-mentioned object picture carried out decoding processing this object picture as the candidate screen information of candidate with reference to picture, the above-mentioned object picture that is subjected to decoding processing is kept at reference to picture with in the memory and manage with reference to picture as candidate;

Carry out at piece under the above-mentioned P decoding schema of prediction decoding above-mentioned object picture, according to be included in the above-mentioned code string with reference to image information, from as above-mentioned candidate with reference to picture be kept at above-mentioned with reference to picture with specifying a picture the memory and in the picture that manages, come to carry out prediction decoding with reference to a picture of above-mentioned appointment to above-mentioned.

Images