US20050002459A1

US20050002459A1 - Method for determining display order of VOPs in decoder end of MPEG image system and device for executing the same

Info

Publication number: US20050002459A1
Application number: US10/614,409
Authority: US
Inventors: Chin-Long Lin; Ren-Yuh Wang
Original assignee: Protocom Technology Corp
Current assignee: SigmaTel LLC
Priority date: 2003-07-04
Filing date: 2003-07-04
Publication date: 2005-01-06
Also published as: US8379730B2; US20090175342A1

Abstract

The invention generally relates to image processing and, more particularly, to display order of video object planes (VOPs) of images. The method according to a preferred embodiment of the invention primarily comprises the steps of arranging a first queue of a plurality of cells with a first order, providing a second queue of a single cell storing an order number, decoding the incoming video object planes (VOPs), determining whether the incoming VOPs are intra coded (I-VOPs), determining whether the incoming VOPs are predictive coded (P-VOPs), determining whether the incoming VOPs are bidirectional predictive coded (B-VOPs), and registering one of the plurality of cells of the first queue with a VOP incoming order for the incoming VOPs that are I-VOPs or B-VOPs.

Description

BACKGROUND OF THE INVENTION

1. Field of the Invention
The invention generally relates to image processing and, more particularly, to display order of video object planes (VOPs) of images.
2. Description of the Related Art
Moving Picture Experts Group (MPEG) standards are in widespread use in the art of video and digital imaging. MPEG is the international committee that developed international standards (such as MPEG-1, MPEG-2 and MPEG-4) that made interactive video on CD-Rom and digital TV possible. In an MPEG image system, an image frame is constructed using video object planes or VOPs. In general, a frame is formed by a large amount of pixels generally including 8 bits, 16 bits, or 32 bits. For a frame with a size of 640×480 pixels where each pixel has 8 bits, there are a total 640×480×8 bits in the frame. If the image should be displayed with a rate of 60 frames per second, then there are 640×480×8×60 bits (about 147 Mbits) of data to be displayed in one second.
VOPs include three types, namely, intra coded or I-VOPs, predictive coded or P-VOPs, and bidirectional predictive coded or B-VOPs. For I-VOP, encoding and compression are performed using a single VOP. For P-VOP, encoding and compression of a VOP are performed in reference to the corresponding I-VOP. For B-VOP, encoding and compression of a VOP are performed in reference to the corresponding I-VOP and P-VOP. In the encoding order, the P-VOP must be encoded and compressed before encoding the B-VOP such that the B-VOP can utilize the information of the P-VOP. The order of encoding VOPs is consequently different from the order of display.
The orders of encoding and display may not be as sophisticated as desired in meeting systems and scalability requirements in the art. Shortcomings are inherent in the art if encoding and display orders are improperly managed and constructed, which often negatively affect system and imaging performance. Insufficient memory or losses of VOPs in transmission further exacerbate these problems in the art.
There is thus a general need in the art for an efficient and optimal method and system of MPEG image processing overcoming at least the aforementioned shortcomings in the art. A further need exists in the art for a method and system of managing and arranging the order incoming VOPs in optimally displaying the decoding VOPs in an MPEG image system. In particular, a method and system for determining display order of VOPs in the decoder end of an MPEG image system overcoming at least the shortcomings in the art over loss of VOPs in transmission and insufficient memory.

SUMMARY OF THE INVENTION

The invention advantageously provides a method for determining display order of VOPs in the decoder end of an MPEG image system and a device of executing the same, where the incoming VOPs are reordered so that the VOPs can be accordingly displayed. The invention advantageously overcomes at least the aforementioned shortcomings in the art, and more particularly, the problems of insufficient memory or loss of VOPs in transmission.
A preferred embodiment of the invention provides a method for determining the display order of VOPs in the decoder end of an MPEG image system. The decoding end has a decoder for decoding incoming VOPs. A control logic unit has a memory for storing decoded VOPs for display. A first queue has a plurality of cells, and a second queue has one cell. The plurality of cells of the first queue is arranged with a first order to be read by a pointer for display. The method according to this particular embodiment of the invention primarily comprises the steps of arranging a first queue of a plurality of cells with a first order, providing a second queue of a single cell storing an order number, decoding the incoming video object planes (VOPs), determining whether the incoming VOPs are intra coded (I-VOPs), determining whether the incoming VOPs are predictive coded (P-VOPs), determining whether the incoming VOPs are bidirectional predictive coded (B-VOPs), and registering one of the plurality of cells of the first queue with a VOP incoming order for the incoming VOPs that are I-VOPs or B-VOPs.
The method according to the invention can further comprise the step of determining whether the single cell of the second queue is null. The method according to the invention can also include the step of registering one of the plurality of cells of the first queue next to one of the registered cells with the stored order number for the incoming VOPs that are P-VOPs if the single cell of the second queue is not null. The method according to the invention can further include the step of registering one of the plurality of cells of the first queue next to one of the registered cells with the stored order number for the incoming VOPs that are not I-VOPs and B-VOPs if the single cell of the second queue is not null. Moreover, the method according to the invention can include the step of registering the single cell of the second queue with the incoming VOP order for the incoming VOPs that are P-VOPs. The method of according to further embodiments of the invention can include the step of reading the decoded incoming VOPs according to the first order, or the step of indicating whether any of the plurality of cells in the first queue is registered, or the step of indicating whether the single cell of the second queue is registered.
Another preferred embodiment of the invention advantageously provides an image processing device for determining a display order of incoming video object planes (VOPs) in an image processing system entering into a decoder according to an encoding order. The image processing device according to this particular embodiment primarily comprises control logic forming a VOP display order in response to the incoming VOPs and according to the encoding order, a VOP detector determining whether the incoming VOPs are intra coded (I-VOPs), predictive coded (P-VOPs), or bidirectional predictive coded (B-VOPs), and a counter counting a number of the incoming VOPs in response to the encoding order. Another embodiment of the image processing device according to the invention can further include a first queue of a plurality of cells numbered with a first order, and a second queue of a single cell storing an order number. The image processing device according to other embodiments of the invention can also include a reader reading the incoming VOPs according to the first order, or at least one register registering one of the plurality of cells of the first queue with a VOP incoming order for the incoming VOPs that are I-VOPs and B-VOPs, or a flag indicating whether any of the plurality of cells in the first queue and the single cell of the second queue is registered, or an auxiliary VOP management unit providing parameters for dropping any of the incoming VOPs or for indicating memory sufficiency for storing the incoming VOPs. Furthermore, one or more of the plurality of cells of the first queue next to one of the registered cells in the at least one register can be registered with the stored order number for the incoming VOPs that are P-VOPs if the single cell of the second queue is not null. Moreover, one or more of the plurality of cells of the first queue next to one of the registered cells in the at least one register can be registered with the stored order number for the incoming VOPs that are not I-VOPs and B-VOPs if the single cell of the second queue is not null. Further according to the invention, the single cell of the second queue can be registered with the incoming VOP order for the incoming VOPs that are P-VOPs.
Yet another preferred embodiment of the invention advantageously provides an image processing system for determining a display order of incoming video object planes (VOPs). The image processing system according to this particular embodiment primarily comprises a decoder decoding and decompressing incoming video object planes (VOPs) entering the decoder according to an encoding order, control logic forming a VOP display order in response to the incoming VOPs and according to the encoding order, a VOP detector determining whether the incoming VOPs are intra coded (I-VOPs), predictive coded (P-VOPs), or bidirectional predictive coded (B-VOPs), and a counter counting a number of the incoming VOPs in response to the encoding order. Another embodiment of the image processing system according to the invention can further include a first queue of a plurality of cells numbered with a first order, and a second queue of a single cell storing an order number. Yet another embodiment of the image processing system according to the invention can also include a memory storing the incoming decoded VOPs, such as random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM) or flash memory. The image processing system according to other embodiments of the invention can also include a reader reading the incoming VOPs according to the first order, or at least one register registering one of the plurality of cells of the first queue with a VOP incoming order for the incoming VOPs that are I-VOPs and B-VOPs, or a flag indicating whether any of the plurality of cells in the first queue and the single cell of the second queue is registered, or an auxiliary VOP management unit providing parameters for dropping any of the incoming VOPs or for indicating memory sufficiency for storing the incoming VOPs. Furthermore, one or more of the plurality of cells of the first queue next to one of the registered cells in the at least one register can be registered with the stored order number for the incoming VOPs that are P-VOPs if the single cell of the second queue is not null. Moreover, one or more of the plurality of cells of the first queue next to one of the registered cells in the at least one register can be registered with the stored order number for the incoming VOPs that are not I-VOPs and B-VOPs if the single cell of the second queue is not null. Further according to the invention, the single cell of the second queue can be registered with the incoming VOP order for the incoming VOPs that are P-VOPs.

BRIEF DESCRIPTION OF THE DRAWINGS

Other features and advantages of the present invention will become apparent by way of the following detailed description of the preferred but non-limiting embodiments. The description is made with reference to the accompanied drawings (not necessarily drawn to scale) in which:
FIG. 1 is a block diagram exemplarily illustrating a preferred embodiment of the system and device according to the invention;
FIG. 2 is a flow diagram illustrating the process steps of the method according to a preferred embodiment of the invention;
FIG. 3 is an exemplary truth table of the method according to a particular embodiment of the invention; and
FIG. 4 is an exemplary evolution table of the method according to a particular embodiment of the decoding process according to the invention.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

The methodology introduced here is to write a series of VOPs into DRAM in the decoding order and read it back in the display order.
At the encoding end, a first VOP (Video Object Plane) is “Intra”-encoded and compressed to get an I-VOP. Then the I-VOP is decompressed to get a decompressed I-VOP, which is utilized as an reference VOP in encoding the next P-VOP. However, this decompressed I-VOP has little difference from the original non-encoded and non-compressed VOP since the first compressed process has lost some bits due to the similarity in the compressing processes. Thereby, when it is decompressed, these lost bits cannot be reconstructed and thus to some extent, a distortion is induced. However, from the viewpoint of visual sense, this distortion will not effect the view and be detected by the eyes of the viewer. Then the encoding end takes the third VOP and then predicatively encodes and compresses the third VOP with reference to the former decompressed I-VOP as to obtain a P-VOP. Then, the P-VOP is decompressed to get a decompressed P-VOP (a first P-VOP). Likewise, this decompressed P-VOP has little distortion from the original uncompressed third VOP. The distortion in the decompressed P-VOP is larger than that of the decompressed I-VOP for reason of the multiple effects of the distortions from the decompressed I-VOP and P-VOP. Then, the encoding end takes the second VOP for encoding and compression with reference to the decompressed I-VOP and P-VOP so as to form a bidirectional-VOP (a first B-VOP). These VOPs are transferred from the encoding end to the decoding end sequentially. Namely, the transferring order is the first VOP (I-VOP), the third VOP (P-VOP) and the second VOP (B-VOP). It should be noted that the transferring order is not the actual image display order. This is because the B-VOP needs the message of a later VOP so that the encoding end must encode and compress the third VOP in advance, causing the transferring order is not identical to the actual image display order.
Then the encoding end encodes and compressed the fifth VOP for get a second P-VOP with reference to the first P-VOP (similarly, it is decompressed). Then the decoding end takes the fourth VOP to encode and compress the VOP with reference to the first and second P-VOPs (similarly, they are decompressed).
Namely, in encoding and compressing a P-VOP, the former I-VOP (in the initial end of the sequence) or a former P-VOP is used as a reference. In encoding and compressing the B-VOP, the former I-VOP and P-VOP or the former two P-VOPs are utilized as references. As a consequence, if the incoming VOPs are numbered in time with the order of VOP1, VOP2, VOP3, VOP4, VOP5, VOP6, VOP7, etc, then the encoding order (i.e. , image frame transferring order) are sequentially VOP1 (an I-VOP), VOP3 (a P-VOP), VOP2 (a B-VOP), VOP5 (a P-VOP), VOP4 (a B-VOP), VOP7 (a P-VOP), VOP6 (a B-VOP), etc. The process is repeated until an admitted distortion threshold is over. Then the sequence is re-initialized, i.e., an incoming VOP is encoded and compressed as an I-VOP and the same process is repeated so as to get a sequence of I-VOP, P-VOP, B-VOP, P-VOP, B-VOP, P-VOP, B-VOP, etc.
MPEG allow multiple B-VOPs to be formed between an I-VOP and a P-VOP or between two P-VOPs. In that, each B-VOP is encoded and compressed with the former I-VOP (or P-VOP) and a latter P-VOP. In the above example of the VOP order, the encoding order (image frame transferring order) is sequentially VOP1 (an I-VOP), VOP4 (a P-VOP), VOP2 (a B-VOP), VOP3 (a B-VOP), VOP7 (a, P-VOP), VOP5 (a B-VOP), VOP6 (a B-VOP), etc. It is seen that the P-VOP must be encoded in advance for being used in encoding the two B-VOPs.
It is apparent that more B-VOPs can be formed between two P-VOPs, but the more the B-VOPs, the larger the distortion of the encoded VOP. However, the way of encoding VOPs into I-VOPs, P-VOPs, and B-VOPs are helpful in the reduction of transmission bits. In general, the total bits of a P-VOP are only one tenth of an I-VOP and a B-VOP is several tenth of the P-VOP. Thereby, the compression by I-VOP, P-VOP, and B-VOP may greatly reduce the transmission bit number. However, for high-resolution images, if the images are not greatly compressed, it is almost impossible to display the images in real time since the bits to be transferred are too large to be transmitted and processed effectively.
It is seen from the above description that the VOP transmission order is not the same as the image frame display order. Thereby, as these VOPs are to be displayed, they must be reordered to the original image frame display order.
In the decoding end; the incoming encoded and compressed VOPs are firstly decoded according to the receiving order (namely, the transmission order). Then, they are stored to a memory (for example, a DRAM) for displaying.
In general, a decompressed VOP possibly occupies a memory space of 5 Mbytes (this data is closely related to the solution of the image), while in most of the currently used display system, the display frame rate per second is about 30 (frames/sec). Therefore, it is apparent that the DRAM is insufficient to store sufficient VOPs for display. As a consequence, it is necessary to effectively program the DRAM and determine a method to define the relations of the VOPs in the DRAM and VOPs to be displayed. As described above, the VOPs encoding order (transfer order) is not the same as that the display order, but the decoding end, the decoder decodes the VOPs according to the receiving sequence, i.e., based on the transfer order.

The way of using one B-VOP for each one P-VOP as illustrated above is employed as an example for describing the method of the invention. In this case, the transferring order is sequentially VOP1 (an I-VOP), VOP3 (a P-VOP), VOP2 (a B-VOP), VOP5 (a P-VOP), VOP4 (a B-VOP), VOP7 (a P-VOP), VOP6 (a B-VOP), etc., but the display order is sequentially VOP1, VOP2, VOP3, VOP4, VOP5, VOP6, VOP7 . . . as illustrated in the following Table 1.



	Transferring order
	(encoding order, decoding order)	Display order

	VOP1	VOP1
	VOP3	VOP2
	VOP2	VOP3
	VOP5	VOP4
	VOP4	VOP5
	VOP7	VOP6
	VOP6	VOP7
	. . .	. . .

FIG. 1 is a block diagram exemplarily illustrating a preferred embodiment of the system and device according to the invention. A decoder 100 is used to decode the incoming VOPs from the receiver (not shown), which serves to receive the VOP from the transmitting end. A control logic unit 300 includes the control logic of the invention and defines two queues, which are a read_VOP_queue 311 and a P_queue 301. The read_VOP_queue 311 contains a number of cells 313 with each cell having a respective flag 312. Each cell in the read_VOP_queue 311 is used to indicate the display order of the corresponding VOPs stored in the memory. The flag 312 serves to indicate the condition of the cell 313, for example, a flag of 1 indicates that the cell 313 of the read_VOP_queue 311 is active and a flag of 0 indicates that the cell 313 of the read_VOP_queue 311 is inactive. Thereby, the pointer is unnecessary to be pointed to an inactive cell. Thereby, the control logic unit 300 has a P_queue 301. The P_queue 301 has only one cell, which stores the condition of an incoming P-VOP. Likewise, the P_queue 301 has a flag 302 for showing the activity of the P_queue 301. That is, for example, a flag of 1 indicates that the P_queue 301 is active and a flag of 0 indicates that the P_queue 301 is inactive. The control logic unit 300 generates a Current_read_VOP_point 331 not shown and a Next_read_VOP_point 332 not shown. The Current_read_VOP_point 331 indicates the VOP is to be read now and the Next_read_VOP_point is to be read at the next stage. Thereby, the display end can know the VOPs to be read.
The control logic unit 300 further comprises a memory. In this embodiment, a DRAM 321 is used as an example of the memory, while other memory suitable for this object can be used in the invention. The DRAM has a finite capacity of storing some VOPs, for example, eight VOPs. Since the capacity of the DRAM is finite, the VOPs stored are also finite.
A VOP type detector 200 serves to detect the type of an incoming VOP, which is indicated in the header of the VOP bit stream. The VOP type detector outputs a dec_wr_VOP_type, which indicates the type of the incoming VOP.
A counter 210 serves to count the number of the incoming VOP so as to be used as a reference number in processing the incoming VOPs.
An auxiliary VOP management unit 220 serves to provide some parameters which are helpful in decision making of the display order. The auxiliary VOP management unit gets three parameters from the incoming data stream. The first one is a drop_frame_decision parameter 221 which decides whether it is necessary to determine that a decoded VOP must be dropped out in response to a condition that the memory space is insufficient to store a complete frame. Generally, the auxiliary VOP management unit makes this decision immediately after one VOP is being written into the DRAM. Thereby, only at the end of deciding a VOP, the drop_frame_decision is active, otherwise it is inactive. If the DRAM is full of data (which can be known from the drop_frame_strobe described in the following), then drop_frame_decision parameter 221 gives a message that the incoming decoded VOP must be dropped since no memory space is available for storing this VOP. However, if the DRAM has sufficient space to store the incoming VOP, the drop_frame_decision 221 is inactive. The second parameter given by the auxiliary VOP management unit is a drop_frame_strobe parameter 222. The drop_frame_strobe parameter indicates the condition of the memory of the control logic unit. For example, if the memory is full, then the drop_frame_strobe is set as 1 which indicates that no VOP can be written into the VOP. On the other hand if the memory has a sufficient space for storing another VOP, then the drop_frame_strobe is set as 0 and thereby, the incoming VOP does not need to be dropped. Therefore, the drop_frame_decision decides whether a VOP needs to be dropped by the value of the drop_frame_strobe and takes an action to drop or write the incoming decoded VOP accordingly. The third parameters given by the auxiliary VOP management unit is a read_VOP_end parameter 223 which indicates that no VOP will be sent to the drop_frame_decision and thus the last one VOP stored in the DRAM must be displaced once more for avoiding the no image frame to be displayed in the display screen. Thereby, the read_VOP_end has a function which is opposite to the drop_frame_decision.
The logic of the invention is that if an incoming decoded VOP is an I-VOP or a B-VOP, then the VOP is stored in the DRAM, and a designated cell in the read_VOP_queue will store the encoding order of incoming VOP and the flag of the cell shows it's active by setting the flag to be 1. If the incoming VOP is a P-VOP, then the VOP is stored in the DRAM, and the cell of the P_queue will store the order of the P-VOP until the next P-VOP is stored in the DRAM or no P-VOP enters into the decoding end when the decoding end predicts that one P-VOP should enter into the decoding end according to the transfer sequence logic known in the decoding end. As the next P-VOP is stored in the DRAM or no P-VOP enters into the decoding end, the indication in the cell of the P-VOP is transferred into the read_VOP_queue to be as a number of the display order. Thereby, the display order can be got by logic.
FIG. 2 is a flow diagram illustrating the process steps of the method according to a preferred embodiment of the invention. The process is started at step 500 and initiated at step 501. In step 501, the VOP type detector 200 determines whether the drop_frame_decision is 1 (namely, the clock is at the end of decoding an incoming VOP). If not, i.e., the decoder 100 is now decoding a VOP, then process is repeated until the system finds that the clock is at the end of decoding a VOP. If so, the process enters into step 502. In step 502, the auxiliary VOP management unit 220 determines whether the drop_frame_strobe is equal to 1. If so, it represents that the memory space is full, i.e., no new VOP can be written into the memory. Then the process enters into step 503. At step 503, the VOP type detector 200 determines whether the incoming VOP is a P-VOP. If not, the process returns to step 501 for determining whether other incoming VOP needs to be dropped, otherwise the process enters into step 504. In step 504, the control logic unit 300 determines whether the P_queue has been set. If so, step 505 is performed, that is, the P_queue is cleared and the original setting value in the P_queue is transferred to read_VOP_queue. Otherwise, the process returns to step 501 for waiting the end of decoding an incoming VOP. If in step 502, the drop_frame_strobe is not set, then it represents that the incoming decoded VOP can be stored in the memory and then be displayed. The process then enters into step 506, where the VOP type detector 200 determines the type of incoming VOP. If the incoming VOP is an I-VOP, it represents that the incoming I-VOP must be written into the read_VOP_queue and the original data in the P_queue is transferred to the read_VOP_queue. Step 507 is then performed, in which the control logic unit 300 checks whether the P_queue has been set. If so, the P_queue is set as 0 (inactive), the content originally stored in the P_queue is written to the read_VOP_queue and the number of the encoding order of the B-VOP is written into the read_VOP_queue (step 508). If in step 507, the content of P_queue is null, only the number of the encoding order of the B-VOP is written into the read_VOP_queue (step 509). If in step 506, the incoming VOP is a P-VOP, then the control logic unit 300 determines whether the content of the P_queue is not null (step 510). If so, the P_queue is stored with the number of the encoding order of the P-VOP. The content originally stored in the P_queue is written to the read_VOP_queue and sets the related flags in the P_queue and read_VOP_queue (step 511). If in step 510, the content of the P_queue is null, then only the number of the encoding order of the P-VOP is written to the read_VOP_queue and set the related flag (step 512). If in step 506, the incoming VOP is a B-VOP, then the number of the encoding order of the B-VOP is written into the read_VOP_queue (step 513).
FIG. 3 is an exemplary truth table of the method according to a particular embodiment of the invention. At first, the decoder decodes an incoming frame, which is for example, an I-VOP. Then the first cell in the read_VOP_queue is set as 0 (R[0]=0) which shows the encoding order of the incoming VOP. The P_queue has no action. Then the second incoming VOP is a P-VOP. Thereby, the P_queue is active (Yes) to illustrate a P-VOP is now at standby condition. Although the P-VOP is stored in the DRAM, the read_VOP_queue has no message about the P-VOP. That is to say that this P-VOP is currently not in the display order. In the fourth line of Table, a B-VOP is decoded and transferred to the DRAM, then the second cell in the read_VOP_queue is set as 2 (R[1]=2), which is the order of this B-VOP in the transferring sequence. Next another B-VOP enters into the decoding end. The same result is obtained so that (R[2]=3). Next in the sixth line of Table, it is illustrated that another P-VOP enters into the decoding end. Thereby, the P_queue will be active. Namely, the P_queue will send the former order number stored in the P_queue to the read_VOP_queue, causing the R[4]=1 (which is the incoming order of the first P-VOP), while the order number of the second P-VOP is stored in the cell of the P-VOP for waiting for the next incoming P-VOP. See the next line, it is illustrated that a B-VOP enters into the decoding end, and the system decides to drop this B-VOP. Thus the read_VOP_queue and P_queue are unchanged. The same process is executed for the conditions illustrated in the following lines in Table 1 and the results are illustrated in the table.
FIG. 4 is an exemplary evolution table of the method according to a particular embodiment of the decoding process according to the invention. For the example illustrated in the first line of the table, it is shown that there is no incoming VOP, and thus the conditions for the output side are remained-unchanged and same as the former ones.
For the example illustrated in the second line of the table in FIG. 3, the type of the incoming VOP is an I-VOP (or a B-VOP), as illustrated in the third column of the input side. The drop_frame_strobe is 1, that is, the incoming VOP will not be displayed. Thus the read_VOP_queue and the flag thereof are the same as the former ones since no VOP will be added to the DRAM and thus the read_VOP_queue does not need to do anything.
For the case illustrated in the third line of the table, it is illustrated that the incoming VOP is a P-VOP, but the system decides not to display this VOP due to the space in the memory being insufficient to store the incoming VOP. Thereby, it is shown that in the output side, the P_queue and flag thereof remains unchanged since the incoming P-VOP will not be displayed.
For the case illustrated in fourth line of the table; it is illustrated that the incoming VOP is a P-VOP and the system decides not to store it. Then, in the output end, it is shown that the P_queue and the flag thereof remain unchanged, but the read_VOP_queue and the flag thereof are changed since the data in the P_queue is written to the read_VOP_queue.
Although the invention has been described with reference to the preferred embodiments, it will be understood that the invention is not limited to the details described thereof. Substitutions and modifications have been suggested in the foregoing description, and others will occur to those of ordinary skill in the art. In particular, the process steps of the method according to the invention will include methods having substantially the same process steps as the method of the invention to achieve substantially the same result. Therefore, all such substitutions and modifications are intended to be within the scope of the invention as defined in the appended claims and their equivalents.

Claims

1. A method for determining a display order of incoming video object planes (VOPs) in an image processing system, the method comprising the steps of:

(a) arranging a first queue of a plurality of cells with a first order;

(b) providing a second queue of a single cell storing an order number;

(c) decoding said incoming video object planes (VOPs);

(d) determining whether said incoming VOPs are intra coded (I-VOPs);

(e) determining whether said incoming VOPs are predictive coded (P-VOPs);

(f) determining whether said incoming VOPs are bidirectional predictive coded (B-VOPs);

(g) registering one of said cells of said first queue with a VOP incoming order for said incoming VOPs that are I-VOPs; and

(h) registering one of said cells of said first queue with a VOP incoming order for said incoming VOPs that are B-VOPs.

2. The method of claim 1 further comprising the step of determining whether said single cell of said second queue is null.

3. The method of claim 2 further comprising the step of registering one of said cells of said first queue next to one of said registered cells in steps (g) and (h) with said stored order number for said incoming VOPs that are P-VOPs if said single cell of said second queue is not null.

4. The method of claim 2 further comprising the step of registering one of said cells of said first queue next to one of said registered cells in steps (g) and (h) with said stored order number for said incoming VOPs that are not I-VOPs and B-VOPs if said single cell of said second queue is not null.

5. The method of claim 1 further comprising the step of registering said single cell of said second queue with said incoming VOP order for said incoming VOPs that are P-VOPs.

6. The method of claim 1 further comprising the step of reading said decoded incoming VOPs according to said first order.

7. The method of claim 1 further comprising the step of indicating whether any of said cells in said first queue is registered.

8. The method of claim 1 further comprising the step of indicating whether said single cell of said second queue is registered.

9. An image processing device for determining a display order of incoming video object planes (VOPs) in an image processing system entering into a decoder according to an encoding order, the image processing device comprising:

control logic forming a VOP display order in response to said incoming VOPs and according to said encoding order;

a VOP detector determining whether said incoming VOPs are intra coded (I-VOPs), predictive coded (P-VOPs), or bidirectional predictive coded (B-VOPs); and

a counter counting a number of said incoming VOPs in response to said encoding order.

10. The device of claim 9 further comprising:

a first queue of a plurality of cells numbered with a first order; and

a second queue of a single cell storing an order number.

11. The device of claim 10 further comprising a reader reading said incoming VOPs according to said first order.

12. The device of claim 10 further comprising at least one register registering one of said cells of said first queue with a VOP incoming order for said incoming VOPs that are I-VOPs and B-VOPs.

13. The device of claim 12 wherein one of said cells of said first queue next to one of said registered cells in said at least one register is registered with said stored order number for said incoming VOPs that are P-VOPs if said single cell of said second queue is not null.

14. The device of claim 12 wherein one of said cells of said first queue next to one of said registered cells in said at least one register is registered with said stored order number for said incoming VOPs that are not I-VOPs and B-VOPs if said single cell of said second queue is not null.

15. The device of claim 10 wherein said single cell of said second queue is registered with said incoming VOP order for said incoming VOPs that are P-VOPs.

16. The device of claim 9 further comprising a flag indicating whether any of said cells in said first queue and said single cell of said second queue is registered.

17. The device of claim 9 further comprising an auxiliary VOP management unit providing parameters for dropping any of said incoming VOPs.

18. The device of claim 9 further comprising an auxiliary VOP management unit providing parameters for indicating memory sufficiency for storing said incoming VOPs.

19. An image processing system comprising:

a decoder decoding and decompressing incoming video object planes (VOPs) entering said decoder according to an encoding order;

20. The system of claim 19 further comprising a memory storing said incoming decoded VOPs.

21. The system of claim 20, said memory further comprising random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM) and flash memory.

22. The system of claim 19 further comprising:

a first queue of a plurality of cells numbered with a first order; and

a second queue of a single cell storing an order number.

23. The system of claim 22 further comprising a reader reading said decoded incoming VOPs according to said first order.

24. The system of claim 22 further comprising at least one register registering one of said cells of said first queue with a VOP incoming order for said incoming VOPs that are I-VOPs and B-VOPs.

25. The system of claim 24 wherein one of said cells of said first queue next to one of said registered cells in said at least one register is registered with said stored order number for said incoming VOPs that are P-VOPs if said single cell of said second queue is not null.

26. The system of claim 24 wherein one of said cells of said first queue next to one of said registered cells in said at least one register is registered with said stored order number for said incoming VOPs that are not I-VOPs and B-VOPs if said single cell of said second queue is not null.

27. The system of claim 22 wherein said single cell of said second queue is registered with said incoming VOP order for said incoming VOPs that are P-VOPs.

28. The system of claim 19 further comprising a flag indicating whether any of said cells in said first queue and said single cell of said second queue is registered.

29. The system of claim 19 further comprising an auxiliary VOP management unit providing parameters for dropping any of said incoming VOPs.

30. The system of claim 19 further comprising an auxiliary VOP management unit providing parameters for indicating memory sufficiency for storing said incoming VOPs.