USRE40469E1 - Apparatus and method for interpolating binary pictures, using context probability table - Google Patents

Apparatus and method for interpolating binary pictures, using context probability table Download PDF

Info

Publication number
USRE40469E1
USRE40469E1 US10/944,542 US94454204A USRE40469E US RE40469 E1 USRE40469 E1 US RE40469E1 US 94454204 A US94454204 A US 94454204A US RE40469 E USRE40469 E US RE40469E
Authority
US
United States
Prior art keywords
block
context
pixels
value
probability
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
US10/944,542
Inventor
Jong-Deuk Kim
Hae-Kwang Kim
Joo-Hee Moon
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Pantech Inc
Original Assignee
Hyundai Curitel Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hyundai Curitel Co Ltd filed Critical Hyundai Curitel Co Ltd
Priority to US10/944,542 priority Critical patent/USRE40469E1/en
Application granted granted Critical
Publication of USRE40469E1 publication Critical patent/USRE40469E1/en
Assigned to PANTECH CO., LTD. reassignment PANTECH CO., LTD. MERGER (SEE DOCUMENT FOR DETAILS). Assignors: PANTECH & CURITEL COMMUNICATIONS INC.
Assigned to PANTECH & CURITEL COMMUNICATIONS INC. reassignment PANTECH & CURITEL COMMUNICATIONS INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: CURITEL COMMUNICATIONS INC.
Assigned to CURITEL COMMUNICATIONS INC. reassignment CURITEL COMMUNICATIONS INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: HYUNDAI CURITEL, INC.
Assigned to PANTECH INC. reassignment PANTECH INC. DE-MERGER Assignors: PANTECH CO., LTD.
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/23412Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformation in the plane of the image
    • G06T3/40Scaling the whole image or part thereof
    • G06T3/4007Interpolation-based scaling, e.g. bilinear interpolation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365Multiplexing of several video streams

Definitions

  • the present invention relates to an interpolation of binary pictures, and more particularly, to an apparatus and method for interpolating binary picture information based on a context probable table, namely, by employing a context probable value of a context based-arithmetic encoding.
  • P 1 a value of pixel A most neighboring to P 1 is multiplied by 2, then added to the rest known pixels, B, C and D, and then if its sum is more than 2, P 1 becomes as ‘1’, if not, P 1 is as ‘0’.
  • P 2 , P 3 and P 4 a value of pixel B, C or D most neighboring to P 2 , P 3 or P 4 is respectively multiplied by 2, then each of the multiplied values is added to the rest known pixels and then if its sum is more than 2, it becomes as ‘1’, if not, P 1 is as ‘0’.
  • Such linear interpolating method is to interpolate the picture information by considering the number of the interior and exterior pixels of four pixels adjacent to a coding pixel and multiplying its nearest pixel by 2.
  • a correlation in such linear interpolating method is not accurate.
  • using a statistical method capable of characterizing numerically the correlation among respective pixels is a method for performing more accurate interpolation, in case that a functional relation representing such correlation can not be defined.
  • a probability which pixels of a coding binary picture can have a value of ‘0’ or ‘1’ may be gotten by using pixels neighboring to a coding pixel. Namely, in case the coding pixel is ‘0’, a probability that a current pixel may be ‘0’ is experimentally gotten according to a distribution of the neighboring pixels. The arithmetic encoding is performed by employing such probability.
  • FIGS. 2 (a) and 2 (b) show one embodiment of context templates.
  • the probable values are in general floating values between 0 and 1, but there is much difficulty to process the floating values between 0 and 1 by using only software and hardware.
  • the floating values between 0 and 1 are thus normalized to integer values, then used. Namely, the values between 0 and 1 are normalized to integer values between 1 and 65535.
  • the number of arrayals constituting the probable table is decided by the number of pixels constituting a context template. If the number of pixels constituting the context template is N, the number of probable values is as 2 N .
  • each of templates is constructed by 7 pixels, the number of the probable values thus is 128.
  • the probable table on the ISO/IEC WG11 VM 8.0 it has the number of 256 for the probable values. Therefore, the first number of 128, context indexes from 0 to 127, is for the probable values of horizontal context template, and the rest number of 128, context indexes from 128 to 255, is for the probable values of vertical context template.
  • the context index C in FIG. 2 (a) is 45, it is thus read an index value 45 on the probable table for the calculated context index.
  • the scalable_shape_intra[45] may become the probable value for the above-mentioned context.
  • Such probable value is previously decided and commonly stored at coding and decoding apparatuses, and coding data using coded probable value is transmitted to the decoding apparatus.
  • the decoding apparatus decodes the probable value for the received data.
  • the context probable table used in the CAE in a case of utilizing the context probable table used in the CAE, more accurate interpolation can be achieved than a conventional linear interpolation method.
  • the context probable table used in the CAE coding method when many experimental pictures have the same contexts for respective contexts, the number of cases that its pixels are as the interior and the exterior of an object, is checked in order to get a probability for which each of the contexts is as the interior of the object.
  • the probable table is made not only including the number of pixels as the interior of object and pixels as the exterior of object, in adjacent pixels, but also including information for positions and a correlation. That is, the method for using such context probable table is to interpolate more accurately than the method for using only the number of pixels as the interior and exterior of the object of neighboring pixels.
  • the present invention is directed to an apparatus and method for interpolating binary picture information that substantially obviates one or more of the limitations and disadvantages of the related art.
  • An object of the present invention is to provide an apparatus and method for interpolating binary picture information by using a context probable table, which is capable of together considering a distance between pixels, positions of pixels and a sort of neighboring pixels through a use of the context probable table of the CAE.
  • binary picture information is divided into blocks of a given size and a bordering on the divided blocks is executed by using its adjacent blocks.
  • a corresponding block belongs to the uppermost or leftmost block of the inputted binary picture information
  • the uppermost row or the leftmost column of the corresponding block is copied and a bordering on it is performed.
  • a context template is constructed by employing pixels neighboring to coding pixels of a corresponding block. Values of indexes are also gained through a use of the constructed template, and a probability for the indexes is read on a probable table.
  • Probability as the exterior of an object and the interior of object is gained from the read probability, and its two values are compared with each other. If the probability as the interior of object is more than that of the exterior of object, an interpolation is performed with the interior value of object. If the probability as the exterior of object is more than that of the interior of object, an interpolation is performed with the exterior value of object.
  • FIG. 1 shows an explanation diagram providing a linear interpolation process applied in an up-sampling of binary picture information.
  • FIGS. 2 (a) and 2 (b) represent one embodiment of a context template applied to the binary picture information.
  • FIG. 3 sets forth the construction for one preferred embodiment of an inventive interpolating apparatus.
  • FIG. 4 depicts a method for bordering pixels of a neighboring block in order for constructing a context of pixels corresponding to the leftmost column and the uppermost row of a current block.
  • FIG. 5 offers a method for bordering a block positioned on the uppermost or leftmost side of a binary picture.
  • FIG. 6 illustrates the construction for one embodiment of a bordering sector in accordance with the present invention.
  • FIG. 7 presents one embodiment of an inventive horizontal and vertical interpolating sector.
  • FIGS. 8 (a) and 8 (b) are explanatory diagrams showing horizontal and vertical interpolation processes.
  • FIG. 9 indicates a flow chart providing an interpolating method in the invention.
  • FIG. 10 is a flow chart showing an inventive bordering process.
  • FIG. 11 presents a flow chart for horizontal and vertical interpolating processes in the present invention.
  • FIG. 3 shows one embodiment with the construction of an inventive interpolating apparatus.
  • a block dividing sector 31 divides binary picture information into blocks of a given size, e.g., 16 ⁇ 16, 8 ⁇ 8, etc.
  • a bordering sector 32 executes a bordering on blocks outputted from the block dividing sector 31 .
  • a horizontal interpolating sector 33 horizontally interpolates pixels of the blocks outputted from the bordering sector 32 .
  • a vertical interpolating sector 34 vertically interpolates pixels of the blocks outputted from the horizontal interpolating sector 33 .
  • Binary picture information of an object is divided into blocks of a given size in the block dividing sector 31 . These blocks are bordered with columns and rows of blocks adjacent to its left, upper and upper-left sides in the bordering sector 32 .
  • a context template is constructed with pixels neighboring to an interpolating pixel as shown in FIGS. 2 (a) and 2 (b), and its context indexes are calculated.
  • Such context template is presented on the VM of the ISO/IEC WG11.
  • the horizontal and vertical contexts for respective pixels are constructed, and context indexes C are computed.
  • context indexes C are computed.
  • pixels adjacent to a current pixel form a context like the above, there may be constructed 2 7 kinds of contexts according to a distribution of pixel values constituting the context.
  • a context is constructed as shown in FIGS. 2 (a) and 2 (b), and a value of context index is gotten through the above-mentioned expression (1), and a probable value Pi corresponding to the index is read on a context probable table.
  • a probable value is a probability for the interior of an object, and according to a size of the value, ‘0’ indicating the exterior of object or ‘1’ indicating the interior of object is selected.
  • a context template for outermost pixels positioned on the left and upper sides of a current block can not be constructed as shown in FIGS. 2 (a) and 2 (b).
  • the leftmost column is interpolated in the horizontal interpolating process, there are no pixels corresponding to C 0 , C 3 and C 5 of FIG. 2 (a), and when the uppermost row is interpolated, there are no pixels corresponding to C 0 , C 1 and C 2 of FIG. 2 (a).
  • the vertical interpolating process also, for the leftmost column there are no pixels corresponding to C 0 , C 3 and C 4 of FIG. 2 (b), and when the uppermost row is interpolated, there are no pixels corresponding to C 0 , C 1 and C 2 of FIG. 2 (b).
  • a bordering should be done before the interpolation.
  • pixel values of corresponding positions in an adjacent block are brought and the brought pixel values construct such required pixels, and such a process is said as, a bordering.
  • the pixels in the adjacent block are bordered on the current block as shown in FIG. 4 . Since blocks positioned on the outermost side of an inputted binary picture have not neighboring blocks, its own leftmost column and uppermost row are copied on the right and left sides in executing the bordering.
  • a top border 42 is made with the lowermost row of a top block 45 neighboring to the upper side of the current block 41
  • a left border 43 is made with the rightmost column of a left block 47 adjacent to the left of the current block 41 .
  • a corner border 44 is constructed with the rightmost-lowermost pixel value near to the top-left side of the current block 41 .
  • FIG. 5 there is illustrated a method for bordering a block positioned on the uppermost or leftmost side of the binary picture. If the current block is the uppermost block, a pixel value of a top block can not be used for the bordering as afore-mentioned since a block does not exist on the top side.
  • a top border 52 is constructed by copying the uppermost row of a current block 51 , which represents pixels known before an up-sampling and shown in a checkered type on a second row of FIG. 5 .
  • pixels for unknown values 521 , 521 , . . . among pixels for known values 522 , 522 , . . . are constructed by copying the known pixels 522 , 522 . . . positioned on its right or left side.
  • a left border 53 is constructed by utilizing known pixels before an up-sampling, which are presented as a checkered type in FIG. 5 , on the leftmost column of the current block 51 , which are pixels known before the up-sampling and shown in a checkered type on a second column of FIG. 5 .
  • Pixels for unknown values 531 , 531 , . . . among pixels for known values 532 , 532 , . . . are constructed by copying the known values of pixels 532 , 532 . . . positioned on its top or lower side.
  • the corner border may be determined as a value of ‘0’ or ‘1’.
  • a context template for the rightmost and lowermost pixels of the current block can not be formed as shown in FIGS. 2 (a) and 2 (b). Namely, there are no pixels corresponding to C 5 and C 6 of FIG. 2 (a) in case the lowermost row is interpolated in a horizontal interpolating process. In a vertical interpolating process, there are no pixels corresponding to C 2 and C 6 of FIG. 2 (b) in case the rightmost row is interpolated. In this case, but, the bordering is not executed, a voluntary value is determined by a software, to thereby construct a context template, in a context calculating part 71 mentioned later.
  • FIG. 6 provides one embodiment with the construction of an inventive bordering sector.
  • a block position detecting part 61 receives an address of a current block 41 from the inputted binary picture and detects a position of the current block 41 .
  • a copy part 62 receives the position of current block outputted from the block position detecting part 61 and borders on the top, top-left and left side of the current block 41 in a block of a given size.
  • a memory 63 stores blocks from the copy part 62 and outputs blocks 45 , 46 , 47 adjacent to the current block 41 to the copy part 62 .
  • the block position detecting part 61 receives addresses of pixels constituting the block inputted to the copy part 62 , detects a position of the current block and outputs its position signal to the copy part 62 .
  • the copy part 62 detects by the inputted position signal whether or not a block position of the currently inputted binary picture belongs to the uppermost or leftmost block.
  • the uppermost row or the leftmost column of the current block is copied on its left or top, to thereby perform the bordering.
  • the bordering is executed by copying pixels positioned on its right and left or its upper and lower sides as aforesaid.
  • the top border 42 is made with the lowermost row of the top block 45 neighboring to the upper side of the current block 41
  • the left border 43 is made with the rightmost column of the left block 47 adjacent to the left of the current block 41
  • the corner border 44 is constructed with the rightmost-lowermost pixel value near to the top-left side of the current block 41 . Under such a bordered state, the horizontal and vertical interpolations are done.
  • FIG. 7 sets forth one embodiment of an inventive horizontal or vertical interpolating sector.
  • a shape context calculating part 71 receives the bordered block from the bordering sector 32 , constructs a horizontal context shown in FIG. 2 (a) for each of the pixels, and calculates context indexes.
  • a probable table referring part 72 receives the context indexes from the context calculating part 71 , reads probable values Pi corresponding to the indexes on a context probable table stored previously, and inputs the read values.
  • a shape probability detecting part 74 detects whether or not the object interior probable value Pi read in the probable table referring part 72 is more than 1 ⁇ 2 of probable maximum value.
  • An interior/exterior interpolating part 75 interpolates binary information into the interior or exterior of an object in response to a detection signal outputted from the probability detecting part 74 .
  • the construction of the horizontal interpolating sector 33 is equally applied to the vertical interpolating sector 34 .
  • the context calculating part 71 constructs the horizontal context shown in FIG. 2 (a) and gets context indexes.
  • the context calculating part 71 constructs the vertical context shown in FIG. 2 (b) and gets indexes.
  • a block bordered in the housing sector 32 is inputted to the context calculating part 71 , and the horizontal context shown in FIG. 2 (a) is therein constructed for respective pixels constituting the current block, and then context indexes C are calculated.
  • the context calculating part 71 copies neighboring pixels or determines voluntary values through the software, for parts that there do not exist pixels, in constructing the context template shown in FIGS. 2 (a) and 2 (b).
  • the context sample template is constructed by such a process in the context calculating part 71 , to then get context indexes.
  • the probable table referring part 72 reads and inputs the probable value Pi that the current pixel may be the interior of object, from the portable table stored according to the context indexes.
  • the probability detecting part 74 compares the object interior probable value Pi read by the probable table referring part 72 with 1 ⁇ 2 of the maximum probable value, and outputs a signal for interpolating with the object interior value to the interior/exterior interpolating part 75 in case that the object interior probable value Pi is more than 1 ⁇ 2 of the maximum probable value. In case that the objct interior probable value Pi is less than 1 ⁇ 2 of the maximum probable value, the probability detecting part 74 outputs a signal for interpolating with the object exterior value to the interior/exterior interpolating part 75 .
  • the interior/exterior interpolating part 75 interpolates the binary picture information into the interior or exterior of the object in response to a detection signal for interpolating with the interior or exterior value.
  • FIG. 8 (a) depicts a block of 8 ⁇ 8 completed in a horizontal interpolating process.
  • Pixels shown in oblique lines in FIG. 8 (a) are known previously before an interpolation, a context template of FIG. 2 (a) for pixels shown in checkered design in FIG. 8 (a) is made to get context indexes, a probable value for an object interior is gotten from a probable table by using the context indexes and interpolated into the interior or exterior of the object.
  • the horizontal context template of FIG. 2 (a) from a pixel positioned on a second row and first column of the current block 51 is made, then the interpolation process is done successively in the right direction from that to an eighth row and seventh column of the current block 51 . Interpolating from a pixel positioned on the top and left side like this has a reason why an order of a coding and decoding on pictures is executed from the left and upper side, thus pixel values of blocks on the upper and left side are known previously.
  • pixels of checkered design in FIG. 8 (b) pixels on first, third, fifth and seventh rows, are interpolated in the vertical interpolating process.
  • the context template of FIG. 2 (b) is constructed and the interpolation process is done successively in the right direction, from a pixel positioned on a first row and first column of the current block 51 to a pixel of the first row and second column, . . . , a pixel of the first row and eighth column, a pixel of a third row and first column, . . . , a pixel of a seventh row and eighth column.
  • Such interpolation in the right direction from the leftmost side of the current block is not only for a reason why the coding and decoding order of pictures is performed from the left and top side but also for a reason why the context template of FIG. 2 (b) is constructed by using pixels positioned on the left side of the current pixel X.
  • FIG. 9 offers a flow chart showing an inventive interpolating method.
  • a step ST 901 binary picture information is divided into blocks of a given size, e.g., 16 ⁇ 16, 8 ⁇ 8, etc., and bordering blocks 52 , 53 are bordered on the top and left sides of respective blocks 51 .
  • a horizontal interpolation process is performed for pixels constituting the bordered block.
  • a vertical interpolating process is executed for blocks completed in the horizontal interpolation process.
  • FIG. 10 is a flow chart providing a bordering process in accordance with the present invention.
  • a step ST 101 the binary picture information is divided into blocks of a given size, e.g., 8 ⁇ 8, etc.
  • a current block is extended in a given size. For instance, a block of 8 ⁇ 8 is extended into a block of 16 ⁇ 16, by selecting one pixel among 2 ⁇ 2 for pixels having known its value such as the blocks 41 , 51 of FIGS. 4 and 5 aforesaid.
  • a step ST 103 it is detected whether or not one block is the uppermost block of the binary picture information. If it is the uppermost block, in a step ST 104 the uppermost row of the current block is bordered on the top of the current block.
  • a step ST 105 the lowermost row of a block neighboring to the upper side of the current block is bordered on the top of the current block.
  • a step ST 106 it is detected whether or not the current block is positioned on the leftmost side of the binary picture. In case the current block is positioned on the leftmost side, in a step 107 the leftmost column of the current block is bordered on the left of the current block. In case the current block is not positioned on the leftmost side, in a step 108 the rightmost column in the left neighboring block of the current block is bordered on the left of the current block. In a step 109 , a pixel on the rightmost and lowermost side of a block positioned on the top and left side of the current block is bordered on a corner of the top and left side of the current block.
  • FIG. 11 illustrates a flow chart showing horizontal and vertical interpolating processes in the invention.
  • a step ST 111 for respective pixels constituting the block bordered through a bordering process, the context template shown in FIG. 2 (a) is made and context indexes are calculated.
  • the context template shown in FIG. 2 (b) is used.
  • a step ST 112 a probable value within an object, stored in the probable table referring part 72 , is read and inputs the read values thereto by using the context indexes gotten in the step ST 111 .
  • the probable table referring part 72 is used.
  • it is detected whether or not the probable value Pi is more than 1 ⁇ 2 of the maximum probable value.
  • a case that the probable value for the object interior, Pi, is more than 1 ⁇ 2 of the maximum probable value represents that the probable value for the object interior, Pi, is more than the probable value for the object exterior, Po. If the probable value for the object interior, Pi, is more than 1 ⁇ 2 of the maximum probable value, in a step ST 115 a value of the current pixel is determined as ‘1’ and this value is given as a pixel value of the object interior. If the probable value for the object interior, Pi, is less than 1 ⁇ 2 of the maximum probable value, in a step ST 114 a value of the current pixel is determined as ‘0’ and this value is given as a pixel value of the object exterior.
  • the invention was applied to a case of dividing picture information into blocks of a given size.
  • the present invention can be also performed by extracting a video object plane (VOP) and applying the context index calculation, a computation of a probable value, a comparison of the probable values and exterior/interior interpolation processes thereto, for pixels constituting the VOP.
  • the unit for an interpolation may be a frame unit, a VOP unit, or a macro block (MB) unit.
  • the practical field in employing the present invention has an MPEG-4 scalable binary picture information coding.
  • an interpolation process for changing the base layer to a picture of a size such as that in an enhancement is done. Since a CAE is utilized in coding the enhancement layer at this time, the probable table for respective contexts are arranged. Accordingly, in case that the same contexts used for the scalable coding in the interpolation process are employed, there is no need to make separately the probable tables since the same probable table can be utilized in the interpolation.
  • a context template is made with its adjacent pixels, its context probable value is obtained, and probable values for the object interior and the object exterior are compared with each other.
  • the binary picture information is then interpolated by a value provided from a case of more probable value as its comparison result, to thereby achieve an accurate interpolation.

Abstract

A context probable table of context template is employed in order to interpolate binary picture information. The context template for respective pixels making up the binary picture information is made, and probabilities for the interior of an object and the exterior of the object on its context indexes are obtained from the context probable table arranged previously. The probabilities for the interior and exterior of the object are compared with each other and the binary picture information is interpolated with a value having more probability.

Description

BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to an interpolation of binary pictures, and more particularly, to an apparatus and method for interpolating binary picture information based on a context probable table, namely, by employing a context probable value of a context based-arithmetic encoding.
2. Discussion of Related Art
There is some difference between an original picture and a picture down-sampled and up-sampled after the down-sampling in case that the binary picture information is down sampled and then up sampled in performing a loss coding for picture information for the sake of a compression of binary picture information. Thus, in a process of the loss coding a picture of down-sampled small size is coded and a decoder decodes the picture of the small size to thereby perform an up-sampling for the picture in an original size. The loss coding is executed like this through the down and up sampling process. In the up-sampling process, a binary picture block of 4×4 or 8×8 having a low resolution is converted into a sampled binary picture block of 16×16 having a high resolution, by applying an interpolation to the up-sampling process.
There is presented a linear interpolating method, as a regularity of the existed interpolation process, in the Verification Model (VM) 8.0 described on WG11 under the ISO/IEC. In such linear interpolation method, in case the interior of an object is as ‘1’ and the exterior of the object is as ‘0’, and also in case that A, B, C and D in FIG. 1 are as known values, values of P1, P2, P3 and P4 should be decided. The P1, P2, P3 and P4 in FIG. 1 are pixels to be interpolated.
In such process, the values of P1, P2, P3 and P4 are decided by the following method.
    • P1: if (2*A+B+C+D>2) then ‘1’ else ‘0’
    • P2: if (A+2*+B+C+D>2) then ‘1’ else ‘0’
    • P3: if (A+b+2*C+D>2) the ‘1’ else ‘0’
    • P4: if (A+B+C+2*D>2) then ‘1’ else ‘0’
That is to say, in P1, a value of pixel A most neighboring to P1 is multiplied by 2, then added to the rest known pixels, B, C and D, and then if its sum is more than 2, P1 becomes as ‘1’, if not, P1 is as ‘0’. In P1, P2, P3 and P4, a value of pixel B, C or D most neighboring to P2, P3 or P4 is respectively multiplied by 2, then each of the multiplied values is added to the rest known pixels and then if its sum is more than 2, it becomes as ‘1’, if not, P1 is as ‘0’.
In such conventional linear interpolation method, among pixels neighboring to an interpolating pixel, the number of pixels such as the interior of an object is compared to the number of pixels such as the exterior of the object, it is decided according to more number in the comparison result whether or not it is the interior of the object or the exterior of the object. In order to use more accurate method, there is provided a method that nearer pixel more influences upon the interpolating pixel according to an additional value based on a distance between the interpolating pixel and referring adjacent pixels.
Such linear interpolating method is to interpolate the picture information by considering the number of the interior and exterior pixels of four pixels adjacent to a coding pixel and multiplying its nearest pixel by 2. A correlation in such linear interpolating method is not accurate. Thus, considering that the correlation among pixels of neighboring natural pictures is high, using a statistical method capable of characterizing numerically the correlation among respective pixels is a method for performing more accurate interpolation, in case that a functional relation representing such correlation can not be defined.
In the context-based arithmetic encoding, a probability which pixels of a coding binary picture can have a value of ‘0’ or ‘1’, may be gotten by using pixels neighboring to a coding pixel. Namely, in case the coding pixel is ‘0’, a probability that a current pixel may be ‘0’ is experimentally gotten according to a distribution of the neighboring pixels. The arithmetic encoding is performed by employing such probability.
In order to get probable value of current pixels through a use of adjacent pixels, it is constructed context templates for deciding what adjacent pixels at which positions are used, to thereby get the probable values for the respective context templates.
FIGS. 2(a) and 2(b) show one embodiment of context templates.
Supposing in FIG. 2(a) that parts of oblique lines are pixels for unknown values and checkered parts are ‘1’ in its value, values of context indexes Cs may be obtained by the following, e.g., C = C 6 * 2 6 + C 5 * 2 5 + C 4 * 2 4 + C 3 * 2 3 + C 2 * 2 2 + C 1 * 2 1 + C 0 * 2 0 = 0 * 2 6 + 1 * 2 5 + 0 * 2 4 + 1 * 2 3 + 1 * 2 2 + 0 * 2 1 + 1 * 2 0 = 45
The probable values are in general floating values between 0 and 1, but there is much difficulty to process the floating values between 0 and 1 by using only software and hardware. The floating values between 0 and 1 are thus normalized to integer values, then used. Namely, the values between 0 and 1 are normalized to integer values between 1 and 65535. The number of arrayals constituting the probable table is decided by the number of pixels constituting a context template. If the number of pixels constituting the context template is N, the number of probable values is as 2N. In horizontal and vertical contexts used for scalable binary picture information, as shown in FIGS. 2(a) and 2(b), each of templates is constructed by 7 pixels, the number of the probable values thus is 128. Meanwhile, referring to the probable table on the ISO/IEC WG11 VM 8.0, it has the number of 256 for the probable values. Therefore, the first number of 128, context indexes from 0 to 127, is for the probable values of horizontal context template, and the rest number of 128, context indexes from 128 to 255, is for the probable values of vertical context template.
Accordingly, as a calculating result by the aforementioned expression, the context index C in FIG. 2(a) is 45, it is thus read an index value 45 on the probable table for the calculated context index. Namely, the probable table is constructed such as scalable_shape_intra[256]={65476, 64428, . . . , 2412, 35} on the ISO/IEC WG11 VM 8.0, and in reading the probable values, values between 0 and 127 are used in the horizontal interpolation and then values between 128 and 255 are used in the vertical scanning. In such a case, the scalable_shape_intra[45] may become the probable value for the above-mentioned context. For such a value, when the value is read from the probable table of VM 8.0 presented on ISO/IEC WG11, the value becomes ‘22794’. Since ‘22794’ is the probable value for a probability of the exterior of an object, a probable value for the interior of object becomes ‘65535−22794=42741’.
Such probable value is previously decided and commonly stored at coding and decoding apparatuses, and coding data using coded probable value is transmitted to the decoding apparatus. The decoding apparatus decodes the probable value for the received data.
As afore-mentioned, in a case of utilizing the context probable table used in the CAE, more accurate interpolation can be achieved than a conventional linear interpolation method. In using the context probable table used in the CAE coding method, when many experimental pictures have the same contexts for respective contexts, the number of cases that its pixels are as the interior and the exterior of an object, is checked in order to get a probability for which each of the contexts is as the interior of the object. In such context probable table, thus, the probable table is made not only including the number of pixels as the interior of object and pixels as the exterior of object, in adjacent pixels, but also including information for positions and a correlation. That is, the method for using such context probable table is to interpolate more accurately than the method for using only the number of pixels as the interior and exterior of the object of neighboring pixels.
SUMMARY OF THE INVENTION
Accordingly, the present invention is directed to an apparatus and method for interpolating binary picture information that substantially obviates one or more of the limitations and disadvantages of the related art.
An object of the present invention is to provide an apparatus and method for interpolating binary picture information by using a context probable table, which is capable of together considering a distance between pixels, positions of pixels and a sort of neighboring pixels through a use of the context probable table of the CAE.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure as illustrated in the written description and claims hereof, as well as the appended drawings.
To achieve these and other advantages, and in accordance with the purpose of the present invention as embodied and broadly described, binary picture information is divided into blocks of a given size and a bordering on the divided blocks is executed by using its adjacent blocks. In case that a corresponding block belongs to the uppermost or leftmost block of the inputted binary picture information, the uppermost row or the leftmost column of the corresponding block is copied and a bordering on it is performed. A context template is constructed by employing pixels neighboring to coding pixels of a corresponding block. Values of indexes are also gained through a use of the constructed template, and a probability for the indexes is read on a probable table. Probability as the exterior of an object and the interior of object is gained from the read probability, and its two values are compared with each other. If the probability as the interior of object is more than that of the exterior of object, an interpolation is performed with the interior value of object. If the probability as the exterior of object is more than that of the interior of object, an interpolation is performed with the exterior value of object.
It is to be understood that both the forgoing general description and the following detailed description are exemplary and explanatory detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.
BRIEF DESCRIPTION OF THE ATTACHED DRAWINGS
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.
In the drawings:
FIG. 1 shows an explanation diagram providing a linear interpolation process applied in an up-sampling of binary picture information.
FIGS. 2(a) and 2(b) represent one embodiment of a context template applied to the binary picture information.
FIG. 3 sets forth the construction for one preferred embodiment of an inventive interpolating apparatus.
FIG. 4 depicts a method for bordering pixels of a neighboring block in order for constructing a context of pixels corresponding to the leftmost column and the uppermost row of a current block.
FIG. 5 offers a method for bordering a block positioned on the uppermost or leftmost side of a binary picture.
FIG. 6 illustrates the construction for one embodiment of a bordering sector in accordance with the present invention.
FIG. 7 presents one embodiment of an inventive horizontal and vertical interpolating sector.
FIGS. 8(a) and 8(b) are explanatory diagrams showing horizontal and vertical interpolation processes.
FIG. 9 indicates a flow chart providing an interpolating method in the invention.
FIG. 10 is a flow chart showing an inventive bordering process.
FIG. 11 presents a flow chart for horizontal and vertical interpolating processes in the present invention.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENT
Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.
FIG. 3 shows one embodiment with the construction of an inventive interpolating apparatus.
A block dividing sector 31 divides binary picture information into blocks of a given size, e.g., 16×16, 8×8, etc. A bordering sector 32 executes a bordering on blocks outputted from the block dividing sector 31. A horizontal interpolating sector 33 horizontally interpolates pixels of the blocks outputted from the bordering sector 32. A vertical interpolating sector 34 vertically interpolates pixels of the blocks outputted from the horizontal interpolating sector 33.
Binary picture information of an object is divided into blocks of a given size in the block dividing sector 31. These blocks are bordered with columns and rows of blocks adjacent to its left, upper and upper-left sides in the bordering sector 32. In an interpolating process, a context template is constructed with pixels neighboring to an interpolating pixel as shown in FIGS. 2(a) and 2(b), and its context indexes are calculated. Such context template is presented on the VM of the ISO/IEC WG11.
As shown in FIGS. 2(a) and 2(b), the horizontal and vertical contexts for respective pixels are constructed, and context indexes C are computed. In case pixels adjacent to a current pixel form a context like the above, there may be constructed 27 kinds of contexts according to a distribution of pixel values constituting the context.
The 27 kinds of contexts and its probable values constituting respective contexts correspond with each other in one to one by the indexes C gained by the following expression (1). C = 6 i = 0 C i · 2 j ( 1 )
In a process for gaining a probable value, it is progressed that a context is constructed as shown in FIGS. 2(a) and 2(b), and a value of context index is gotten through the above-mentioned expression (1), and a probable value Pi corresponding to the index is read on a context probable table. Such a probable value is a probability for the interior of an object, and according to a size of the value, ‘0’ indicating the exterior of object or ‘1’ indicating the interior of object is selected.
In the context template constructing process as the above, a context template for outermost pixels positioned on the left and upper sides of a current block can not be constructed as shown in FIGS. 2(a) and 2(b). In other words, when the leftmost column is interpolated in the horizontal interpolating process, there are no pixels corresponding to C0, C3 and C5 of FIG. 2(a), and when the uppermost row is interpolated, there are no pixels corresponding to C0, C1 and C2 of FIG. 2(a). In the vertical interpolating process, also, for the leftmost column there are no pixels corresponding to C0, C3 and C4 of FIG. 2(b), and when the uppermost row is interpolated, there are no pixels corresponding to C0, C1 and C2 of FIG. 2(b).
Thus, in order to interpolate pixels corresponding to the leftmost column and uppermost row of a current block, a bordering should be done before the interpolation. As shown in FIG. 4, pixel values of corresponding positions in an adjacent block are brought and the brought pixel values construct such required pixels, and such a process is said as, a bordering.
In order to construct a context of pixels corresponding to the leftmost column and uppermost row of a current block, the pixels in the adjacent block are bordered on the current block as shown in FIG. 4. Since blocks positioned on the outermost side of an inputted binary picture have not neighboring blocks, its own leftmost column and uppermost row are copied on the right and left sides in executing the bordering.
The bordering process is described more in detail as follows.
First, in case the current block 41 is not the uppermost block and the leftmost block of binary picture, namely, in case blocks on its upper and left sides exist, a top border 42 is made with the lowermost row of a top block 45 neighboring to the upper side of the current block 41, and a left border 43 is made with the rightmost column of a left block 47 adjacent to the left of the current block 41. A corner border 44 is constructed with the rightmost-lowermost pixel value near to the top-left side of the current block 41.
Next, in other case, namely, in case a current block 41 is the uppermost or leftmost block of the inputted binary picture, referring to FIG. 5 there is illustrated a method for bordering a block positioned on the uppermost or leftmost side of the binary picture. If the current block is the uppermost block, a pixel value of a top block can not be used for the bordering as afore-mentioned since a block does not exist on the top side.
A top border 52 is constructed by copying the uppermost row of a current block 51, which represents pixels known before an up-sampling and shown in a checkered type on a second row of FIG. 5. On the copied top border 52, pixels for unknown values 521, 521, . . . among pixels for known values 522, 522, . . . are constructed by copying the known pixels 522, 522 . . . positioned on its right or left side.
If the current block is the leftmost block of the inputted binary picture, a left border 53 is constructed by utilizing known pixels before an up-sampling, which are presented as a checkered type in FIG. 5, on the leftmost column of the current block 51, which are pixels known before the up-sampling and shown in a checkered type on a second column of FIG. 5. Pixels for unknown values 531, 531, . . . among pixels for known values 532, 532, . . . are constructed by copying the known values of pixels 532, 532 . . . positioned on its top or lower side. Like this, in case the current block is the leftmost or uppermost side of the inputted binary picture, the corner border may be determined as a value of ‘0’ or ‘1’.
Meanwhile, in case pixels on the rightmost column of the current block or on its lowermost side are interpolated, a context template for the rightmost and lowermost pixels of the current block can not be formed as shown in FIGS. 2(a) and 2(b). Namely, there are no pixels corresponding to C5 and C6 of FIG. 2(a) in case the lowermost row is interpolated in a horizontal interpolating process. In a vertical interpolating process, there are no pixels corresponding to C2 and C6 of FIG. 2(b) in case the rightmost row is interpolated. In this case, but, the bordering is not executed, a voluntary value is determined by a software, to thereby construct a context template, in a context calculating part 71 mentioned later.
FIG. 6 provides one embodiment with the construction of an inventive bordering sector.
A block position detecting part 61 receives an address of a current block 41 from the inputted binary picture and detects a position of the current block 41. A copy part 62 receives the position of current block outputted from the block position detecting part 61 and borders on the top, top-left and left side of the current block 41 in a block of a given size. A memory 63 stores blocks from the copy part 62 and outputs blocks 45, 46, 47 adjacent to the current block 41 to the copy part 62.
The block position detecting part 61 receives addresses of pixels constituting the block inputted to the copy part 62, detects a position of the current block and outputs its position signal to the copy part 62. The copy part 62 detects by the inputted position signal whether or not a block position of the currently inputted binary picture belongs to the uppermost or leftmost block.
As its detection result, in case it corresponds to the uppermost or leftmost block, the uppermost row or the leftmost column of the current block is copied on its left or top, to thereby perform the bordering. For pixels for unknown values, namely, pixels before an up-sampling, 521, 521, . . . , 531, 531, . . . , on the uppermost row or the leftmost column, the bordering is executed by copying pixels positioned on its right and left or its upper and lower sides as aforesaid.
If the current block does not correspond to the uppermost or leftmost block, as above-mentioned the top border 42 is made with the lowermost row of the top block 45 neighboring to the upper side of the current block 41, and the left border 43 is made with the rightmost column of the left block 47 adjacent to the left of the current block 41. The corner border 44 is constructed with the rightmost-lowermost pixel value near to the top-left side of the current block 41. Under such a bordered state, the horizontal and vertical interpolations are done.
FIG. 7 sets forth one embodiment of an inventive horizontal or vertical interpolating sector.
A shape context calculating part 71 receives the bordered block from the bordering sector 32, constructs a horizontal context shown in FIG. 2(a) for each of the pixels, and calculates context indexes. A probable table referring part 72 receives the context indexes from the context calculating part 71, reads probable values Pi corresponding to the indexes on a context probable table stored previously, and inputs the read values. A shape probability detecting part 74 detects whether or not the object interior probable value Pi read in the probable table referring part 72 is more than ½ of probable maximum value. An interior/exterior interpolating part 75 interpolates binary information into the interior or exterior of an object in response to a detection signal outputted from the probability detecting part 74.
The construction of the horizontal interpolating sector 33 is equally applied to the vertical interpolating sector 34. In the horizontal interpolating sector 33, the context calculating part 71 constructs the horizontal context shown in FIG. 2(a) and gets context indexes. In the vertical interpolatng sector 34, the context calculating part 71 constructs the vertical context shown in FIG. 2(b) and gets indexes.
A block bordered in the housing sector 32 is inputted to the context calculating part 71, and the horizontal context shown in FIG. 2(a) is therein constructed for respective pixels constituting the current block, and then context indexes C are calculated.
By the way, in case that the context template shown in FIG. 2(a) is constructed in order to horizontally interpolate the rightmost column of the current block, an eighth column of the current block 51 shown in FIG. 5, and in case that the context template shown in FIG. 2(a) is constructed in order to horizontally interpolate the lowermost row of the current block, an eighth row of the current block 51 shown in FIG. 5, there are no pixels corresponding to C5 and C6. In the vertical interpolation, also, in case the context template for the rightmost column of the current block 51 is constructed, there are no pixels corresponding to C2 and C6 of FIG. 2(b).
However, the bordering for the rightmost column and the lowermost row of the current block 51 is not executed in the bordering sector 32, thus, the context calculating part 71 copies neighboring pixels or determines voluntary values through the software, for parts that there do not exist pixels, in constructing the context template shown in FIGS. 2(a) and 2(b). The context sample template is constructed by such a process in the context calculating part 71, to then get context indexes.
The probable table referring part 72 reads and inputs the probable value Pi that the current pixel may be the interior of object, from the portable table stored according to the context indexes. The probability detecting part 74 compares the object interior probable value Pi read by the probable table referring part 72 with ½ of the maximum probable value, and outputs a signal for interpolating with the object interior value to the interior/exterior interpolating part 75 in case that the object interior probable value Pi is more than ½ of the maximum probable value. In case that the objct interior probable value Pi is less than ½ of the maximum probable value, the probability detecting part 74 outputs a signal for interpolating with the object exterior value to the interior/exterior interpolating part 75. The interior/exterior interpolating part 75 interpolates the binary picture information into the interior or exterior of the object in response to a detection signal for interpolating with the interior or exterior value.
FIG. 8(a) depicts a block of 8×8 completed in a horizontal interpolating process.
Pixels shown in oblique lines in FIG. 8(a) are known previously before an interpolation, a context template of FIG. 2(a) for pixels shown in checkered design in FIG. 8(a) is made to get context indexes, a probable value for an object interior is gotten from a probable table by using the context indexes and interpolated into the interior or exterior of the object. In the horizontal interpolating process, the horizontal context template of FIG. 2(a) from a pixel positioned on a second row and first column of the current block 51 is made, then the interpolation process is done successively in the right direction from that to an eighth row and seventh column of the current block 51. Interpolating from a pixel positioned on the top and left side like this has a reason why an order of a coding and decoding on pictures is executed from the left and upper side, thus pixel values of blocks on the upper and left side are known previously.
When the pixels of checkered design are gotten in the horizontal interpolating process in FIG. 8(a), pixels of checkered design in FIG. 8(b), pixels on first, third, fifth and seventh rows, are interpolated in the vertical interpolating process. In the vertical interpolating process, the context template of FIG. 2(b) is constructed and the interpolation process is done successively in the right direction, from a pixel positioned on a first row and first column of the current block 51 to a pixel of the first row and second column, . . . , a pixel of the first row and eighth column, a pixel of a third row and first column, . . . , a pixel of a seventh row and eighth column.
Such interpolation in the right direction from the leftmost side of the current block is not only for a reason why the coding and decoding order of pictures is performed from the left and top side but also for a reason why the context template of FIG. 2(b) is constructed by using pixels positioned on the left side of the current pixel X.
FIG. 9 offers a flow chart showing an inventive interpolating method.
In a step ST901, binary picture information is divided into blocks of a given size, e.g., 16×16, 8×8, etc., and bordering blocks 52, 53 are bordered on the top and left sides of respective blocks 51. In a step ST902, a horizontal interpolation process is performed for pixels constituting the bordered block. In a step ST903, a vertical interpolating process is executed for blocks completed in the horizontal interpolation process. Herewith, it is not always necessary to execute the horizontal interpolation process first surely, and there is not much difference even though the vertical interpolation first and the vertical interpolation next are done.
FIG. 10 is a flow chart providing a bordering process in accordance with the present invention.
In a step ST101, the binary picture information is divided into blocks of a given size, e.g., 8×8, etc. In a step ST102, a current block is extended in a given size. For instance, a block of 8×8 is extended into a block of 16×16, by selecting one pixel among 2×2 for pixels having known its value such as the blocks 41, 51 of FIGS. 4 and 5 aforesaid. In a step ST103, it is detected whether or not one block is the uppermost block of the binary picture information. If it is the uppermost block, in a step ST104 the uppermost row of the current block is bordered on the top of the current block. If it is not the uppermost block, in a step ST105 the lowermost row of a block neighboring to the upper side of the current block is bordered on the top of the current block. In a step ST106, it is detected whether or not the current block is positioned on the leftmost side of the binary picture. In case the current block is positioned on the leftmost side, in a step 107 the leftmost column of the current block is bordered on the left of the current block. In case the current block is not positioned on the leftmost side, in a step 108 the rightmost column in the left neighboring block of the current block is bordered on the left of the current block. In a step 109, a pixel on the rightmost and lowermost side of a block positioned on the top and left side of the current block is bordered on a corner of the top and left side of the current block.
FIG. 11 illustrates a flow chart showing horizontal and vertical interpolating processes in the invention.
In a step ST111, for respective pixels constituting the block bordered through a bordering process, the context template shown in FIG. 2(a) is made and context indexes are calculated. In a case of the vertical interpolation, the context template shown in FIG. 2(b) is used. In a step ST112, a probable value within an object, stored in the probable table referring part 72, is read and inputs the read values thereto by using the context indexes gotten in the step ST111. In a case of the vertical interpolation, the probable table referring part 72 is used. In a step ST113, it is detected whether or not the probable value Pi is more than ½ of the maximum probable value. Herewith, a case that the probable value for the object interior, Pi, is more than ½ of the maximum probable value, represents that the probable value for the object interior, Pi, is more than the probable value for the object exterior, Po. If the probable value for the object interior, Pi, is more than ½ of the maximum probable value, in a step ST115 a value of the current pixel is determined as ‘1’ and this value is given as a pixel value of the object interior. If the probable value for the object interior, Pi, is less than ½ of the maximum probable value, in a step ST114 a value of the current pixel is determined as ‘0’ and this value is given as a pixel value of the object exterior.
In a description of the present invention as aforementioned, the invention was applied to a case of dividing picture information into blocks of a given size. Meantime, the present invention can be also performed by extracting a video object plane (VOP) and applying the context index calculation, a computation of a probable value, a comparison of the probable values and exterior/interior interpolation processes thereto, for pixels constituting the VOP. Further, the unit for an interpolation may be a frame unit, a VOP unit, or a macro block (MB) unit.
The practical field in employing the present invention has an MPEG-4 scalable binary picture information coding. In order to display a base layer in the MPEG-4 scalable binary picture information coding, an interpolation process for changing the base layer to a picture of a size such as that in an enhancement is done. Since a CAE is utilized in coding the enhancement layer at this time, the probable table for respective contexts are arranged. Accordingly, in case that the same contexts used for the scalable coding in the interpolation process are employed, there is no need to make separately the probable tables since the same probable table can be utilized in the interpolation.
As above-mentioned, in accordance with the present invention, for an interpolating pixel a context template is made with its adjacent pixels, its context probable value is obtained, and probable values for the object interior and the object exterior are compared with each other. The binary picture information is then interpolated by a value provided from a case of more probable value as its comparison result, to thereby achieve an accurate interpolation.
It will be apparent to those skilled in the art that various modifications and variations can be made in the binary picture information interpolating method and apparatus of the present invention without deviating from the spirit or scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.

Claims (13)

1. A method for interpolating an original picture in a frame unit (a binary picture: BAB) by using a context probability table set previously in order to reconstruct the original picture in the frame unit having low resolution as the picture having high resolution through an up-sampling, said method comprising the steps of:
dividing said original picture in the frame unit into a plurality of blocks (each having a size of 8×8 pixels);
extending each of said plurality of blocks divided to a double size;
forming a context template for an interpolating pixel in each of the extended blocks;
getting indexes of the context template to obtain a probability value indicating whether or not a pixel value is detected and obtaining the probability value of the interpolating pixel from the context probability table set previously by a use of the indexes of the context template obtained; and
deciding the interpolating pixel value (‘0’ or ‘1’) based on the context probability value obtained of the interpolating pixel.
2. The method of claim 1, wherein the context template forming step constructs the context template for a part having no pixels by copying neighboring pixels or determining a voluntary value, in case that the context template is constructed for pixels of 16 columns or 16 rows.
3. The method of claim 1, wherein said context probable table includes the probable values previously gained for all context templates and is commonly stored at coding and decoding apparatuses.
4. The method of claim 1, wherein a value of said interpolating pixel is determined as an interior pixel value if the probability value for the interior is more than that for the exterior in said context probability template of said interpolating pixel, and is determined as an exterior pixel value if the probability value for the exterior pixel is more than that for the interior therein.
5. The method of claim 1, wherein the block extending step comprises the steps of: interpolating pixels horizontally by using a horizontal context template; and after the horizontal interpolation, interpolating pixels vertically by using a vertical context template.
6. The method of claim 1, further comprising the steps of: comparing the extended block with the original picture in the frame unit and detecting the position of the block; and selectively bordering said plurality of blocks based on the detected position.
7. The method of claim 6, wherein said bordering step comprises the steps of:
copying the uppermost row of the extended block and thereby forming a top border in case that the extended block is positioned on the frame top side border of the original picture in the frame unit, and copying the values of pixels positioned on the right or left side for unknown pixels on said top border;
constructing a left border by using the leftmost column of the extended block in case that said extended block is positioned on the frame left side border of the original picture in the frame unit, and copying the values of pixels positioned on the upper or lower side for unknown pixels on said left border; and
forming the top border with the lowermost row of upper adjacent block and the left border with the rightmost column of left block neighboring to the extended block, in case that said extended block is not positioned on the frame border of the original picture in the frame unit.
8. An apparatus having block dividing means, bordering means, and horizontal and vertical interpolation means and for interpolating an original picture in a frame unit (a binary picture: BAB) by using a context probability table set previously in order to reconstruct the original picture in the frame unit having low resolution as the picture having high resolution through an up-sampling, said apparatus comprising:
said bordering means being composed of block position detecting means for detecting a position of each of the divided blocks from said block dividing means in the original picture in the frame unit, copy means for receiving the position of the divided block outputted from said block position detection means and bordering the block of a given size on the top, left and upper side and left side of the block to be bordered, and memory for storing the blocks bordered from said copy means and outputting the information on the neighboring blocks of the block to be bordered to said copy means; and
said horizontal and vertical interpolation means being composed of context calculating means for receiving the bordered blocks in said bordering means and calculating context indexes for respective pixels of the bordered blocks, probability table referring means for receiving the context indexes from said context calculating means and reading and getting probability values corresponding to the index on/from the context probability table set previously, probability detecting means for detecting whether or not the probability value read and gotten on/from said probability table referring means is more than 0.5, and interior/exterior interpolation means for interpolating a value “0” or “1” for the respective pixels on the bordered block in response to the detection result signal of said probability detecting means.
9. The apparatus of claim 8, wherein said bordering means copies 1 column and 1 row of each of the divided blocks on the left and upper side of the divided blocks, respectively and performs the boarding for the divided blocks, in case that the blocks divided in said block dividing means exist on the outermost of the original picture in the frame unit.
10. The apparatus of claim 8, wherein said copy means borders a divided block with pixel values in 8 rows of its left and top block if the divided block exists on the top and left side of the block to be bordered divided in said block dividing means, and borders the divided block with a value “0” if the divided block does not exist on the top and left side thereof.
11. The apparatus of claim 8, wherein said probability detecting means compares the probability value read and gotten from said probability table referring means with 0.5; controls so that said interior/exterior interpolation means interpolates a value “1” for the respective pixels on the bordered block, in case the probability value is more than 0.5; and controls so that said interior/exterior interpolation means interpolates a value “0” for the respective pixels on the bordered block, in case the probability value is less than 0.5.
12. An interpolating method for reconstructing a restored picture having high resolution by up-sampling a binary picture having low resolution, said method comprising the steps of:
forming context templates for target pixels to be interpolated; obtaining a context index of the context templates and a probability value of the target pixel from context probability table by using the context index of the context templates;
deciding a value for the target pixel based on the context probability.
13. The method of claim 12, further comprising the steps of:
searching a location of a target block having target pixels to be interpolated in the binary picture; and
expanding a border of the target block at the searched location.
US10/944,542 1997-07-09 2004-09-17 Apparatus and method for interpolating binary pictures, using context probability table Expired - Lifetime USRE40469E1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US10/944,542 USRE40469E1 (en) 1997-07-09 2004-09-17 Apparatus and method for interpolating binary pictures, using context probability table

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
KR19970031813 1997-07-09
US09/112,434 US6453077B1 (en) 1997-07-09 1998-07-09 Apparatus and method for interpolating binary pictures, using context probability table
US10/944,542 USRE40469E1 (en) 1997-07-09 2004-09-17 Apparatus and method for interpolating binary pictures, using context probability table

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/112,434 Reissue US6453077B1 (en) 1997-07-09 1998-07-09 Apparatus and method for interpolating binary pictures, using context probability table

Publications (1)

Publication Number Publication Date
USRE40469E1 true USRE40469E1 (en) 2008-08-26

Family

ID=19513902

Family Applications (2)

Application Number Title Priority Date Filing Date
US09/112,434 Ceased US6453077B1 (en) 1997-07-09 1998-07-09 Apparatus and method for interpolating binary pictures, using context probability table
US10/944,542 Expired - Lifetime USRE40469E1 (en) 1997-07-09 2004-09-17 Apparatus and method for interpolating binary pictures, using context probability table

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US09/112,434 Ceased US6453077B1 (en) 1997-07-09 1998-07-09 Apparatus and method for interpolating binary pictures, using context probability table

Country Status (4)

Country Link
US (2) US6453077B1 (en)
EP (1) EP0891076A3 (en)
JP (1) JP3349957B2 (en)
KR (1) KR100423719B1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1322117A1 (en) * 2001-12-06 2003-06-25 Koninklijke Philips Electronics N.V. Arithmetic coder and decoder
JP2003319391A (en) * 2002-04-26 2003-11-07 Sony Corp Encoding apparatus and method, decoding apparatus and method, recording medium, and program
JP3695451B2 (en) * 2003-05-28 2005-09-14 セイコーエプソン株式会社 Image size changing method and apparatus
US10284810B1 (en) * 2017-11-08 2019-05-07 Qualcomm Incorporated Using low-resolution frames to increase frame rate of high-resolution frames

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0625761A2 (en) 1993-05-20 1994-11-23 Canon Kabushiki Kaisha Data processing method and apparatus
JPH0795394A (en) 1993-09-20 1995-04-07 Hitachi Ltd Method and device for reducing picture
US5594813A (en) 1992-02-19 1997-01-14 Integrated Information Technology, Inc. Programmable architecture and methods for motion estimation
JPH0993440A (en) 1995-09-26 1997-04-04 Ricoh Co Ltd Multi-value image processor
US5699129A (en) 1995-10-17 1997-12-16 Zapex Technologies, Inc. Method and apparatus for motion vector determination range expansion
US5933105A (en) 1998-01-20 1999-08-03 Daewoo Electronics Co., Ltd. Context-based arithmetic encoding/decoding method and apparatus
US5960117A (en) 1996-09-12 1999-09-28 Nec Corporation Method of adaptive arithmetic encoding/decoding according to JBIG standard
US6002812A (en) 1997-07-10 1999-12-14 Samsung Electronics Co., Ltd. Interpolation method for binary image
US6823082B2 (en) * 2001-02-21 2004-11-23 Boly Media Communications, Inc. Method of compressing digital images

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR0160622B1 (en) * 1993-02-27 1999-01-15 김광호 Method and device for image compression
JP3146109B2 (en) * 1994-07-04 2001-03-12 シャープ株式会社 Binary image coding device
KR0181030B1 (en) * 1995-03-28 1999-05-01 배순훈 Apparatus for transmitting bitplane compressed by means of binary image
KR100314098B1 (en) * 1997-05-29 2001-12-12 윤종용 An interpolation method of binary shape data using an adaptive threshold by neighboring pixel values
KR100235354B1 (en) * 1997-07-09 1999-12-15 전주범 Interpolation method for reconstructing a sampled binary shape signal

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5594813A (en) 1992-02-19 1997-01-14 Integrated Information Technology, Inc. Programmable architecture and methods for motion estimation
EP0625761A2 (en) 1993-05-20 1994-11-23 Canon Kabushiki Kaisha Data processing method and apparatus
JPH06334844A (en) 1993-05-20 1994-12-02 Canon Inc Data processing method and recording device using the same
JPH0795394A (en) 1993-09-20 1995-04-07 Hitachi Ltd Method and device for reducing picture
JPH0993440A (en) 1995-09-26 1997-04-04 Ricoh Co Ltd Multi-value image processor
US5699129A (en) 1995-10-17 1997-12-16 Zapex Technologies, Inc. Method and apparatus for motion vector determination range expansion
US5960117A (en) 1996-09-12 1999-09-28 Nec Corporation Method of adaptive arithmetic encoding/decoding according to JBIG standard
US6002812A (en) 1997-07-10 1999-12-14 Samsung Electronics Co., Ltd. Interpolation method for binary image
US5933105A (en) 1998-01-20 1999-08-03 Daewoo Electronics Co., Ltd. Context-based arithmetic encoding/decoding method and apparatus
US6823082B2 (en) * 2001-02-21 2004-11-23 Boly Media Communications, Inc. Method of compressing digital images

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"MPEG-4 Video Verification model Version 7.0" Int'l Organization for Standardization-Organization Internatinale De Normalisatio, vol. N1642, Apr. 1997, pp. 1-271, XP00861690.
Bossen F et al, "A simple and efficent binary coding technique based on bitmap representation", Acoustics, Speech, and Signal Processing, 1997, 1997 IEEE Int'l Conf. on Munich Germany, pp. 3129-3132.

Also Published As

Publication number Publication date
EP0891076A3 (en) 2004-10-20
JP3349957B2 (en) 2002-11-25
KR19990013732A (en) 1999-02-25
EP0891076A2 (en) 1999-01-13
JPH1196349A (en) 1999-04-09
KR100423719B1 (en) 2004-05-20
US6453077B1 (en) 2002-09-17

Similar Documents

Publication Publication Date Title
CN111047516B (en) Image processing method, image processing device, computer equipment and storage medium
US7046850B2 (en) Image matching
CN111369581B (en) Image processing method, device, equipment and storage medium
US7043091B2 (en) Method and apparatus for increasing spatial resolution of an image
JP3284932B2 (en) Image processing device
US11715186B2 (en) Multi-image-based image enhancement method and device
JP2001086507A (en) Image coder, image coding method, image decoder, image decoding method, medium and image processor
JP2006222965A (en) Image processing method and image processor
CN111429459A (en) End-to-end joint classification medical image segmentation method and system
USRE40469E1 (en) Apparatus and method for interpolating binary pictures, using context probability table
US20100039517A1 (en) Film cadence detection
CN110136061B (en) Resolution improving method and system based on depth convolution prediction and interpolation
CN116977336A (en) Camera defect detection method, device, computer equipment and storage medium
KR970064261A (en) A contour coding method, a contour decoding method, and a recording medium recording the contour coding apparatus, the contour decoding apparatus and the method using the method
CN111753714A (en) Multidirectional natural scene text detection method based on character segmentation
US6198508B1 (en) Method of encoding picture data and apparatus therefor
US20100260435A1 (en) Edge Directed Image Processing
CN112052863B (en) Image detection method and device, computer storage medium and electronic equipment
JP3191753B2 (en) Image encoding device, image decoding device, image encoding method, image decoding method
CN113657413B (en) Method, device, equipment and medium for recognizing handwritten formula
CN116092105B (en) Method and device for analyzing table structure
US20210150788A1 (en) Media vectorization
CN114666500A (en) Information density improving method, device, electronic equipment and storage medium
CN115601234A (en) Image super-resolution reconstruction method, device and equipment and storage medium
CN117010351A (en) Processing method and device for form oblique lines, electronic equipment and storage medium

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FPAY Fee payment

Year of fee payment: 8

FEPP Fee payment procedure

Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FPAY Fee payment

Year of fee payment: 12

AS Assignment

Owner name: PANTECH INC., KOREA, REPUBLIC OF

Free format text: DE-MERGER;ASSIGNOR:PANTECH CO., LTD.;REEL/FRAME:039981/0927

Effective date: 20151022

Owner name: CURITEL COMMUNICATIONS INC., KOREA, REPUBLIC OF

Free format text: CHANGE OF NAME;ASSIGNOR:HYUNDAI CURITEL, INC.;REEL/FRAME:040149/0348

Effective date: 20020404

Owner name: PANTECH & CURITEL COMMUNICATIONS INC., KOREA, REPU

Free format text: CHANGE OF NAME;ASSIGNOR:CURITEL COMMUNICATIONS INC.;REEL/FRAME:040164/0585

Effective date: 20020802

Owner name: PANTECH CO., LTD., KOREA, REPUBLIC OF

Free format text: MERGER;ASSIGNOR:PANTECH & CURITEL COMMUNICATIONS INC.;REEL/FRAME:040414/0638

Effective date: 20091230