US20150043897A1 - Reproducing apparatus - Google Patents

Reproducing apparatus Download PDF

Info

Publication number
US20150043897A1
US20150043897A1 US14/525,849 US201414525849A US2015043897A1 US 20150043897 A1 US20150043897 A1 US 20150043897A1 US 201414525849 A US201414525849 A US 201414525849A US 2015043897 A1 US2015043897 A1 US 2015043897A1
Authority
US
United States
Prior art keywords
image data
moving image
frame
cpu
decoding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/525,849
Inventor
Yoshinobu Sato
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Priority to US14/525,849 priority Critical patent/US20150043897A1/en
Publication of US20150043897A1 publication Critical patent/US20150043897A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/80Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/804Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
    • H04N9/8042Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/00007Time or data compression or expansion
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B31/00Arrangements for the associated working of recording or reproducing apparatus with related apparatus
    • G11B31/006Arrangements for the associated working of recording or reproducing apparatus with related apparatus with video camera or receiver
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/69Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2621Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • H04N5/772Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera the recording apparatus and the television camera being placed in the same enclosure
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/907Television signal recording using static stores, e.g. storage tubes or semiconductor memories
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/223Analysis of motion using block-matching
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/254Analysis of motion involving subtraction of images
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/18Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19665Details related to the storage of video surveillance data
    • G08B13/19667Details realated to data compression, encryption or encoding, e.g. resolution modes for reducing data volume to lower transmission bandwidth or memory requirements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/80Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/804Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
    • H04N9/8042Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
    • H04N9/8047Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction using transform coding

Definitions

  • the present invention relates to a reproducing apparatus, and more specifically, enlarging processing performed when encoded image data is reproduced.
  • Video cameras for picking up image data and recording the image data as digital signals on a magnetic tape, a memory card or the like to reproduce the image data have been around for some time.
  • This type of apparatus records picked-up image data after encoding the image data by JPEG or other encoding methods.
  • Some video cameras have a function of enlarging, reducing or rotating reproduced image data to be displayed. For example, in enlarged display processing, image data reproduced from a recording medium is decoded and, a part of the decoded image data is extracted and enlarged to display a reproduced image enlarged.
  • decoded image data is stored in a memory and a part of the stored image data, corresponding to a designated area of the memory, is read out to be subjected to enlarging processing (see for example Japanese Patent Application Laid-open No. H09-44130 (corresponding U.S. Pat. No. 5,999,161)).
  • An object of the present invention is to solve the above-mentioned problem.
  • Another object of the present invention is to provide an apparatus that requires less frequent access to a memory and consumes less power during enlarging processing of encoded image data.
  • a reproducing apparatus of the present invention comprises: reproducing means for reproducing, from a recording medium, moving image data including plural frames whose information amount has been compressed by intraframe encoding; a memory for storing the moving image data reproduced by the reproducing means; decoding means for read out the frames of the moving image data from the memory and decoding the read-out data, the decoding means reading out the moving image data in succession starting from an upper end of a screen for each frame to decode the read-out moving image data; instruction means for instructing to enlarge the moving image data; enlarging area setting means for setting, for each frame of the moving image data, a partial area on which enlarging processing is to be performed; control means for controlling the decoding means in accordance with the enlarging instruction given by the instruction means, the control means stopping reading out the one frame of moving image data from the memory, which is performed by the decoding means, in case that moving image data of the partial area in the one frame of the
  • FIG. 1 is a block diagram showing the schematic structure of an embodiment of the present invention
  • FIG. 2 is a flow chart showing the flow of displaying operation according to the embodiment
  • FIG. 3 is a detailed flow chart of a stop mode (S 6 );
  • FIGS. 4A , 4 B and 4 C are diagrams showing display examples according to the embodiment.
  • FIG. 5 is a diagram showing the order of reading image data from a memory in encoding and decoding processing.
  • FIG. 1 is a block diagram showing the system structure of an image pickup apparatus according to this embodiment.
  • the image pickup apparatus of FIG. 1 is capable of picking up and recording moving image data that is made up of 30 frames of image data per second as well as reproducing a recorded moving image.
  • the apparatus can take still pictures in addition to moving images.
  • a Central Processing Unit (CPU) 100 controls the entire image pickup apparatus.
  • Denoted by 101 is an interface circuit (I/F) for the CPU 100
  • 102 denotes a recording medium such as a memory card
  • 103 denotes an interface circuit (I/F) for the recording medium 102 .
  • Reference numeral 106 denotes a Dynamic Random Access Memory (DRAM) where image data, program and the like are stored.
  • Reference numeral 104 denotes a system controller, which is engaged in sequential control, bus arbitration control, and the like.
  • Reference numeral 107 denotes an image pickup lens, and 108 denotes an image pickup element composed of a one-chip Charge-Coupled Device (CCD).
  • CCD Charge-Coupled Device
  • Denoted by 109 is an A/D conversion circuit to convert an analog signal into a digital signal.
  • Reference numeral 110 denotes a signal processing circuit and 111 , a magnification circuit to reduce or enlarge image data in a horizontal or vertical direction through thinning-out processing, linear interpolation processing, or the like.
  • Reference numeral 112 denotes a raster-block conversion circuit, which converts raster scan image data magnified by the magnification circuit 111 into block scan image data.
  • Denoted by 113 is a buffer memory for raster-block conversion. The memory 113 is used to convert raster data into block scan data.
  • Reference numeral 114 denotes a compression circuit, which employs JPEG to encode image data outputted block by block from the raster-block conversion circuit 112 and to thereby compress the amount of the data.
  • the raster-block conversion circuit 112 denotes frames of moving image data that are in raster scan order into an order of blocks having predetermined number of pixels in length and width, and outputs the converted data.
  • the compression circuit 114 encodes, when a moving image is picked up, frames of image data outputted from the raster-block conversion circuit 112 by JPEG.
  • JPEG is, as well known, an intraframe encoding method which encodes image data are using only image data in the same frame.
  • the raster-block conversion circuit 112 at this point reads out frames of image data stored in the buffer memory 113 starting from a block 501 , which is located at the upper left corner of the screen as shown in FIG. 5 .
  • the raster-block conversion circuit 112 next reads out the block to the right of the block 501 on the screen, and then continues on in this way until the rightmost block on the screen is reached. After the rightmost block is read out, blocks immediately below the current row of blocks are read out in a similar manner starting from the leftmost block.
  • a memory control circuit 105 transfers, during recording, by DMA transfer, image data outputted from the compression circuit 114 to the DRAM 106 , and transfers image data stored in the DRAM 106 via the system controller 104 and the I/F 103 to the recording medium 102 , where the transferred image is recorded.
  • the memory control circuit 105 reads out compressed image data from the recording medium 102 , transfers, by DMA transfer, the read data to the DRAM 106 via the interface circuit 103 and the system controller 104 , and transfers, by DMA transfer, the image data in the DRAM 106 to a reproduction circuit 121 , which will be described later.
  • the CPU 100 uses a predetermined program to create decoded image data through software processing in which JPEG-encoded image data is decoded.
  • the CPU 100 performs thinning-out processing and linear interpolation processing to reduce and enlarge, respectively, a decoded image.
  • the reproduction circuit 121 performs modulation, addition of synchronized signals, digital/analog conversion and the like on image data that is reproduced from the recording medium 102 and decoded, to thereby convert the reproduced and decoded data into a form suitable for display on a monitor 122 .
  • the number of pixels of an image that can be outputted to and displayed on the liquid crystal monitor 122 which serves as a display unit, is smaller than the number of pixels of the image pickup element.
  • Denoted by 123 is an operation unit, which is composed of a switch SPLAY, a switch SFWD, a switch SREV, a switch SZUP, a switch SZDOWN, and a switch SSTOP.
  • Denoted by 124 is a four-way operational key composed of a switch SUP, a switch SDOWN, a switch SRIGHT, and a switch SLEFT.
  • the switch SPLAY is a switch used to command that an image be played.
  • an image recorded on the recording medium 102 is displayed on the liquid crystal monitor.
  • the switch SFWD is a switch for playing one still image ahead
  • the switch SREV is a switch for playing one still image back.
  • the switch SZUP is a switch used to command the apparatus to enlarge an image being played
  • the switch SZDOWN is a switch used to command the apparatus to reduce in size an image being played.
  • the switch SSTOP is a switch used to command the apparatus to pause a moving image that is being played. Each time the switch SSTOP is operated, one of an instruction to resume playing a moving image and an instruction to pause playing is outputted in an alternating manner.
  • the switch SUP, the switch SDOWN, the switch SRIGHT and the switch SLEFT correspond to the upper, lower, right and left portions of the four-way operational key 124 , respectively.
  • the four-way operational key 124 is, as will be described later, effective when a reproduced image is displayed enlarged.
  • the switch SUP is a switch used to command the apparatus to scroll up over an enlarged image
  • the switch SDOWN is a switch used to command the apparatus to scroll down
  • the switch SRIGHT is a switch used to command the apparatus to scroll to the right
  • the switch SLEFT is a switch used to command the apparatus to scroll to the left.
  • FIGS. 4A to 4C are diagrams showing a reproduced image and how the image is displayed on the monitor.
  • FIG. 4A shows frames of a moving image before the image is enlarged and displayed.
  • FIG. 4B shows areas of the moving image data of FIG. 4A that are decoded and stored in the DRAM 106 to extract and enlarge a part of each frame of the moving image data.
  • FIG. 4C shows the screen of the monitor 112 which is displayed when the monitor 112 displays the moving image of FIG. 4A .
  • FIGS. 2 and 3 Described next with reference to FIGS. 2 and 3 is processing for playing a moving image.
  • a frame of moving image data before encoded has an aspect ratio of 4:3, and 1280 pixels (h) ⁇ 960 (v).
  • Such moving image data is reproduced from the recording medium 102 and is displayed on the monitor 122 , which has a resolution of 640 pixels (h) ⁇ 480 pixels (v).
  • each frame of moving image data is encoded by JPEG and, to reproduce the moving image data, data of a frame is decoded by JPEG separately from data of another frame.
  • the CPU 100 goes into a play mode when it is detected that the switch SPLAY has been turned on.
  • the CPU 100 controls the interface circuit 103 and the system controller 104 to start reading out a desired moving image file from of the recording medium 102 .
  • the image data read out from the recording medium 102 is transferred to and stored in the DRAM 106 in order.
  • step S 202 the display magnification is initialized and ⁇ 1 display magnification is set to display the whole image on the monitor 122 .
  • step S 203 the CPU 100 sets a still image stored at the head of the moving image file, and starts a timer set in accordance with a desired frame rate.
  • step S 204 a state of the switch SPLAY is judged.
  • the switch SPLAY is off, the CPU 100 ends the play mode whereas the play mode is maintained and the CPU 100 moves to the next step when the switch SPLAY is on.
  • step S 205 a state of the switch SSTOP is judged.
  • the switch SSTOP is on, the CPU 100 pauses playing a moving image and moves to step S 206 .
  • the switch SSTOP is off, the moving image is kept played and the CPU 100 moves to the next step. Stop mode processing in step S 206 will be described later.
  • step S 207 states of the zoom switches SZUP and SZDOWN, which are used to specify a display magnification, are judged. As a user operates either one of the zoom switches, the CPU 100 moves to step S 208 . In the case where neither of the switches SZUP and SZDOWN is operated, the CPU moves to step S 217 .
  • step S 217 whether the display magnification is ⁇ 1 magnification or not is judged.
  • the CPU 100 moves to step S 218 , and to step S 220 when the display magnification is ⁇ 1 magnification.
  • step S 220 the display magnification is set to ⁇ 1.
  • step S 221 the original image size, namely, 1280 pixels (h) ⁇ 960 pixels (v), is set as the size in which the image data is to be read out from the DRAM 106 in accordance with the display magnification set in step S 220 .
  • step S 222 the CPU 100 sequentially reads out, via the memory control circuit 105 , from the DRAM 106 , image data in the head frame of the moving image file set in step S 203 , and decodes the read image data.
  • the decoded image data is sequentially written in the DRAM 106 block by block via the memory control circuit 105 .
  • step S 223 whether decoding processing has been completed for one frame of image data or not is checked. In the case where decoding processing for one frame of image data has been completed, the CPU 100 moves to step S 224 .
  • step S 224 the CPU 100 changes the resolution of decoded image data from the original image size to the resolution of the monitor 122 .
  • the CPU 100 reads out stored image data from the DRAM 106 via the memory control circuit 105 and converts the resolution of the image data.
  • the display magnification is ⁇ 1
  • the original image size 1280 pixels (h) ⁇ 960 pixels (v)
  • the converted image data is sequentially written in a display area in the DRAM 106 .
  • 640 pixels (h) ⁇ 480 pixels (v) image data for display is stored in the DRAM 106 .
  • the stored image data is displayed as shown in screens 60 and 61 of FIG. 4C .
  • step S 214 whether the frame that is currently displayed is the last frame of the moving image data or not is judged. In the case where it is the last frame, the moving image play mode is ended. In the case where it is not the last frame, the CPU 100 moves to step S 215 .
  • step S 215 which frame is to receive reproduction processing next is set.
  • step S 216 the timer set in step S 203 is checked to determine whether a predetermined period of time has passed or not. In the case where the predetermined time has passed, the CPU 100 proceeds to processing the next frame of the image data.
  • steps S 204 to S 216 are repeated.
  • step S 207 the switch SZUP has been operated, and moves to step S 208 .
  • step S 208 a larger magnification is set each time the user operates the switch SZUP (to ⁇ 2 at one flick of the switch SZUP, ⁇ 4 at the next flick) whereas a smaller magnification is set each time the user operates the switch SZDOWN (to ⁇ 2 at one flick of the switch SZDOWN, ⁇ 1 at the next flick).
  • the display magnification is changed to ⁇ 2 by operating the switch SZUP while a moving image is being displayed at ⁇ 1 magnification.
  • an area of the original image is extracted in accordance with the enlarging magnification, and the extracted portion of image data is subjected to enlarging processing in accordance with the number of pixels of the monitor 122 .
  • step S 209 the size of the area to be extracted is obtained from the original image size and the magnification set in step S 208 , to set a range to be extracted for enlarged display on the original screen.
  • the size of the extracted area is set to 640 pixels (h) ⁇ 960 pixels (v) by multiplying 1280 pixels ⁇ 960 pixels by 1 ⁇ 2 in width and length, respectively.
  • the display magnification set in step S 208 is ⁇ 4
  • the size of the extracted area is set to 320 pixels (h) ⁇ 240 pixels (v) by multiplying the original image size by 1 ⁇ 4 in width and length, respectively.
  • the display magnification set in step S 208 is 2.
  • step S 210 the CPU 100 reads out one frame of stored image data from the DRAM 106 via the memory control circuit 105 , and decodes the read-out image data block by block.
  • the CPU 100 sequentially reads out one frame of image data stored in the DRAM 106 starting from a block at the upper left corner of the screen as shown in FIG. 5 , and decodes the read-out image data.
  • the decoded image data is sequentially transferred to and stored in the DRAM 106 via the memory control circuit 105 .
  • the CPU 100 After decoding processing is started in order from the upper left corner block on the screen in this way, the CPU 100 compares in step S 211 the position on the screen of the decoded image data against the extraction range set in step S 209 . The CPU 100 continues the processing of reading out encoded image data from the DRAM 106 and the processing of decoding the read-out image data until the position of the decoded image data exceeds the extraction range. When it is judged that the extraction range is exceeded, the CPU 100 moves to step S 212 .
  • step S 212 the processing of decoding encoded image data is stopped.
  • the DRAM 106 now stores image data of the range shown in 52 of FIG. 4B in a decoded state whereas image data of an area below this range on the screen remains encoded.
  • 520 indicates the extraction range set in step S 209 .
  • step S 213 the CPU 100 converts the resolution of the image data in the extracted area set in step S 209 into the resolution of the monitor 122 .
  • the CPU 100 has the memory control circuit 105 read out image data of an extraction area, specifically, image data in the extraction range 520 of FIG. 4B , from the DRAM 106 , and converts the resolution of the read image data into the resolution of the monitor 122 in accordance with a set display magnification.
  • the image data with the resolution thus converted is written in a display memory area of the DRAM 106 in order.
  • enlarged image data having 640 pixels (h) ⁇ 480 pixels (v) is stored in the display memory area of the DRAM 106 , and the stored image data is displayed as a ⁇ 2 magnification image on the monitor as shown in a screen 62 of FIG. 4C .
  • steps S 214 to S 207 are repeated to set the next frame.
  • step S 207 the CPU 100 moves to step S 217 .
  • step S 217 the display magnification is checked to judge whether it is ⁇ 1 magnification or not.
  • the CPU 100 moves to step S 218 .
  • the display magnification is judged as ⁇ 1 magnification, the CPU 100 moves to step S 220 .
  • step S 218 the CPU 100 judges states of the switches SUP, SDOWN, SRIGHT and SLEFT of the four-way operational key 124 .
  • the CPU 100 moves to step S 219 .
  • the CPU 100 moves to step S 210 .
  • the four-way operational key is not operated while the screen 62 of FIG. 4C is displayed, a screen 63 is displayed without changing the current display range.
  • steps S 210 to 218 are repeated to display the continuous frames 62 and 63 of a moving image enlarged.
  • step S 219 the CPU 100 sets a new area to be extracted for enlarged display in a direction that is designated via the switches.
  • the extraction range is moved to the left of the range 530 to set a new extraction range 540 .
  • the display screen of the monitor 122 is switched to a screen 64 of FIG. 4C .
  • steps S 210 to S 213 are repeated.
  • FIG. 3 is a flow chart showing processing of the stop mode in step S 206 .
  • step S 301 the CPU 100 initializes display settings and sets a parameter Disp to 0.
  • step S 302 the CPU 100 reads out one frame of image data stored in the DRAM 106 via the memory control circuit 105 , and decodes the read-out image data in order. The decoded image data is sequentially transferred to and stored in the DRAM 106 via the memory control circuit 105 .
  • step S 303 completion of decoding one frame of image data is waited.
  • Image data stored at this point in the DRAM 106 is as shown in a screen 55 of FIG. 4B .
  • the CPU 100 decodes all of image data of one frame, including an area of image data below the extraction range 550 for enlarged display, and stores the decoded image data in the DRAM 106 .
  • step S 304 states the zoom switches SZUP and SZDOWN, which are used to specify a display magnification.
  • step S 305 In the case where the user operates either one of the zoom switches, the CPU 100 moves to step S 305 . In the case where the user operates neither the switch SZUP nor the switch SZDOWN, the CPU 100 moves to step S 310 .
  • step S 310 the state of the display magnification is judged.
  • the CPU 100 moves to step S 311 .
  • the CPU 100 moves to step S 314 .
  • step S 311 the CPU 100 judges the states of the switches SUP, SDOWN, SRIGHT and SLEFT of the four-way operational key 124 .
  • the CPU 100 moves to step S 313 .
  • the CPU 100 moves to step S 312 .
  • step S 312 the value of the variable Disp is checked.
  • the CPU 100 moves to step S 309 .
  • the CPU 100 moves to step S 307 .
  • step S 307 the CPU 100 converts the resolution of image data in the extraction range that is stored in the DRAM 106 , in accordance with the resolution of the monitor 122 .
  • the CPU 100 reads image data in the extraction range and converts the resolution of the read image data in accordance with a set display magnification. For instance, when the display magnification is ⁇ 4, 320 pixels (h) 240 pixels (v) extraction range image data is doubled in the horizontal direction and the vertical direction each. When the display magnification is ⁇ 2, the 640 pixels (h) ⁇ 480 pixels (v) extraction range image data is outputted as it is.
  • the converted data is written in a display memory area of the DRAM 106 in order.
  • 640 pixels (h) ⁇ 480 pixels (v) image data is stored in the display memory area of the DRAM 106 .
  • the one frame of moving image data stored in the display memory area is repeatedly read out and outputted to the monitor 122 , to thereby display an enlarged image as a still image as shown in a screen 65 of FIG. 4C .
  • step S 308 the parameter Disp indicating whether a moving image or a still image is being displayed is set to 1.
  • step S 309 In the case where the user operates the switch SSTOP in step S 309 in order to cancel the pause command while playing is paused, the CPU 100 ends the stop mode to resume playing a moving image in response.
  • the CPU 100 moves to step S 304 .
  • step S 310 When it is judged in step S 310 that the display magnification is ⁇ 1 magnification, the original image size, namely, 1280 pixels (h) ⁇ 960 pixels (v), is set in step S 314 as a size in which image data is read out from the DRAM 106 .
  • step S 315 the CPU 100 converts the resolution of the decoded image data from the original image size to the resolution of the monitor 122 . Then the CPU 100 sets the parameter Disp to 1 and moves to step S 309 .
  • step S 311 In the case where an instruction made by the user to change the display position is detected by detecting in step S 311 that any one of the switches SUP, SDOWN, SRIGHT and SLEFT of the four-way operational key 124 has been operated, the CPU 100 moves to step S 313 .
  • step S 313 the CPU 100 sets moves the extraction range in a direction designated through the four-way operational key 124 . Specifically, in the case where the switch SRIGHT is operated while the screen 65 of FIG. 4C is displayed, the extraction range is changed from 550 of FIG. 4B to 560 , with the result that a screen 66 of FIG. 4C is displayed on the monitor 122 . During the change, the monitor 122 keeps displaying a still image.
  • one frame of encoded image data stored in the DRAM 106 is read out and decoded sequentially starting from an upper end of the screen in response to an enlargement command given while a moving image is played.
  • image data in an extraction range necessary in enlarged display is decoded, processing of reading out encoded image data from the DRAM 106 is ended, and decoding processing on this frame is stopped to proceed to processing of the next frame.
  • an enlarged play function can be obtained without increasing the load of the CPU even when the number of pixels per frame is increased, and at the same time, the power consumption can be reduced.
  • Another technological advantage of this embodiment is improved ease of use in pausing an enlarged moving image since the display position can be moved as processing of expanding a still image is completed.
  • the above embodiment describes a case of playing a moving image, but similar processing can be performed when a still image is to be played.
  • the expansion processing and magnification processing of a still image which are performed by the CPU in the above-described example, may be carried out by hardware.
  • the object of the present invention can also be achieved by providing a storage medium storing program codes for performing the aforesaid processes to a reproduction apparatus, reading out the program codes, by a CPU or MPU of the reproduction apparatus, from the storage medium, then executing the program.
  • the program codes read out from the storage medium realize the functions according to the embodiments, and the storage medium storing the program codes constitutes the invention.
  • the storage medium such as a floppy disk, a hard disk, an optical disk, a magneto-optical disk, CD-ROM, CD-R, a magnetic tape, a non-volatile type memory card, and ROM
  • computer network such as LAN (local area network) and WAN (wide area network)
  • LAN local area network
  • WAN wide area network
  • the present invention includes a case where an OS (operating system) or the like working on the computer performs a part or entire processes in accordance with designations of the program codes and realizes functions according to the above embodiments.
  • the present invention also includes a case where, after the program codes read from the storage medium are written in a function expansion card which is inserted into the reproduction apparatus or in a memory provided in a function expansion unit which is connected to the reproduction apparatus, CPU or the like contained in the function expansion card or unit performs a part or entire process in accordance with designations of the program codes and realizes functions of the above embodiments.
  • the storage medium stores program codes corresponding to the flowchart of FIGS. 2 and 3 described in the embodiments.

Abstract

A reproducing apparatus includes: a reproducing portion for reproducing, from a recording medium, moving image data including plural frames whose information amount has been compressed by intraframe encoding; a memory for storing the moving image data reproduced by the reproducing portion; a decoding portion for reading out the frames of the moving image data stored in the memory and decoding the read-out data, the decoding portion reading out the moving image data in succession starting from an upper end of a screen for each frame to decode the read-out moving image data; an instruction portion for instructing enlargement of the moving image data; an enlarging area setting portion for setting, for each frame of the moving image data, a partial area on which enlarging processing is to be performed; a control portion for controlling the decoding portion in accordance with the enlarging instruction, the control portion stopping reading out the one frame of moving image data from the memory, which is performed by the decoding portion, in case that moving image data of the partial area in the one frame of the moving image data is decoded; and an output portion for modifying, in accordance with the number of pixels of the display device, the moving image data of the partial area decoded, and outputting the modified image data to the display device.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is a continuation of application Ser. No. 11/185,654, filed Jul. 20, 2005, the entire disclosure of which is hereby incorporated by reference.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • The present invention relates to a reproducing apparatus, and more specifically, enlarging processing performed when encoded image data is reproduced.
  • 2. Related Background Art
  • Video cameras for picking up image data and recording the image data as digital signals on a magnetic tape, a memory card or the like to reproduce the image data have been around for some time. This type of apparatus records picked-up image data after encoding the image data by JPEG or other encoding methods.
  • Some video cameras have a function of enlarging, reducing or rotating reproduced image data to be displayed. For example, in enlarged display processing, image data reproduced from a recording medium is decoded and, a part of the decoded image data is extracted and enlarged to display a reproduced image enlarged.
  • In a known structure, decoded image data is stored in a memory and a part of the stored image data, corresponding to a designated area of the memory, is read out to be subjected to enlarging processing (see for example Japanese Patent Application Laid-open No. H09-44130 (corresponding U.S. Pat. No. 5,999,161)).
  • The structure disclosed in Japanese Patent Application Laid-open No. H09-44130 needs to decode all of reproduced image data and store in a memory in order to display an enlarged image.
  • This raises the frequency of access to the memory and, accordingly, the memory has to be accessible at high speed. The structure thus poses a problem by increasing cost and power consumption of the video camera or similar apparatus.
  • SUMMARY OF THE INVENTION
  • An object of the present invention is to solve the above-mentioned problem.
  • Another object of the present invention is to provide an apparatus that requires less frequent access to a memory and consumes less power during enlarging processing of encoded image data.
  • To achieve the above objects, according to one aspect of the present invention, a reproducing apparatus of the present invention comprises: reproducing means for reproducing, from a recording medium, moving image data including plural frames whose information amount has been compressed by intraframe encoding; a memory for storing the moving image data reproduced by the reproducing means; decoding means for read out the frames of the moving image data from the memory and decoding the read-out data, the decoding means reading out the moving image data in succession starting from an upper end of a screen for each frame to decode the read-out moving image data; instruction means for instructing to enlarge the moving image data; enlarging area setting means for setting, for each frame of the moving image data, a partial area on which enlarging processing is to be performed; control means for controlling the decoding means in accordance with the enlarging instruction given by the instruction means, the control means stopping reading out the one frame of moving image data from the memory, which is performed by the decoding means, in case that moving image data of the partial area in the one frame of the moving image data is decoded; and output means for modifying, in accordance with the number of pixels of the display device, the moving image data of the partial area decoded by the decoding means, and outputting the modified image data to the display device.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • Other objects and characteristics of the present invention than those mentioned above will become more apparent by the following detailed description of embodiments when read in conjunction with the accompanying drawings in which:
  • FIG. 1 is a block diagram showing the schematic structure of an embodiment of the present invention;
  • FIG. 2 is a flow chart showing the flow of displaying operation according to the embodiment;
  • FIG. 3 is a detailed flow chart of a stop mode (S6);
  • FIGS. 4A, 4B and 4C are diagrams showing display examples according to the embodiment; and
  • FIG. 5 is a diagram showing the order of reading image data from a memory in encoding and decoding processing.
  • DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • A detailed description will be given below on an embodiment of the present invention with reference to the accompanying drawings.
  • FIG. 1 is a block diagram showing the system structure of an image pickup apparatus according to this embodiment.
  • The image pickup apparatus of FIG. 1 is capable of picking up and recording moving image data that is made up of 30 frames of image data per second as well as reproducing a recorded moving image. The apparatus can take still pictures in addition to moving images.
  • A Central Processing Unit (CPU) 100 controls the entire image pickup apparatus. Denoted by 101 is an interface circuit (I/F) for the CPU 100, 102 denotes a recording medium such as a memory card, and 103 denotes an interface circuit (I/F) for the recording medium 102. Reference numeral 106 denotes a Dynamic Random Access Memory (DRAM) where image data, program and the like are stored. Reference numeral 104 denotes a system controller, which is engaged in sequential control, bus arbitration control, and the like. Reference numeral 107 denotes an image pickup lens, and 108 denotes an image pickup element composed of a one-chip Charge-Coupled Device (CCD).
  • Denoted by 109 is an A/D conversion circuit to convert an analog signal into a digital signal. Reference numeral 110 denotes a signal processing circuit and 111, a magnification circuit to reduce or enlarge image data in a horizontal or vertical direction through thinning-out processing, linear interpolation processing, or the like. Reference numeral 112 denotes a raster-block conversion circuit, which converts raster scan image data magnified by the magnification circuit 111 into block scan image data. Denoted by 113 is a buffer memory for raster-block conversion. The memory 113 is used to convert raster data into block scan data. Reference numeral 114 denotes a compression circuit, which employs JPEG to encode image data outputted block by block from the raster-block conversion circuit 112 and to thereby compress the amount of the data.
  • When a moving image is picked up, the raster-block conversion circuit 112 denotes frames of moving image data that are in raster scan order into an order of blocks having predetermined number of pixels in length and width, and outputs the converted data. The compression circuit 114 encodes, when a moving image is picked up, frames of image data outputted from the raster-block conversion circuit 112 by JPEG. JPEG is, as well known, an intraframe encoding method which encodes image data are using only image data in the same frame.
  • The raster-block conversion circuit 112 at this point reads out frames of image data stored in the buffer memory 113 starting from a block 501, which is located at the upper left corner of the screen as shown in FIG. 5. The raster-block conversion circuit 112 next reads out the block to the right of the block 501 on the screen, and then continues on in this way until the rightmost block on the screen is reached. After the rightmost block is read out, blocks immediately below the current row of blocks are read out in a similar manner starting from the leftmost block.
  • A memory control circuit 105 transfers, during recording, by DMA transfer, image data outputted from the compression circuit 114 to the DRAM 106, and transfers image data stored in the DRAM 106 via the system controller 104 and the I/F 103 to the recording medium 102, where the transferred image is recorded. When image data is to be reproduced, the memory control circuit 105 reads out compressed image data from the recording medium 102, transfers, by DMA transfer, the read data to the DRAM 106 via the interface circuit 103 and the system controller 104, and transfers, by DMA transfer, the image data in the DRAM 106 to a reproduction circuit 121, which will be described later.
  • The CPU 100 uses a predetermined program to create decoded image data through software processing in which JPEG-encoded image data is decoded. The CPU 100 performs thinning-out processing and linear interpolation processing to reduce and enlarge, respectively, a decoded image.
  • The reproduction circuit 121 performs modulation, addition of synchronized signals, digital/analog conversion and the like on image data that is reproduced from the recording medium 102 and decoded, to thereby convert the reproduced and decoded data into a form suitable for display on a monitor 122.
  • The number of pixels of an image that can be outputted to and displayed on the liquid crystal monitor 122, which serves as a display unit, is smaller than the number of pixels of the image pickup element.
  • Denoted by 123 is an operation unit, which is composed of a switch SPLAY, a switch SFWD, a switch SREV, a switch SZUP, a switch SZDOWN, and a switch SSTOP. Denoted by 124 is a four-way operational key composed of a switch SUP, a switch SDOWN, a switch SRIGHT, and a switch SLEFT.
  • The functions of the switches of the operation unit 123 will be described. The switch SPLAY is a switch used to command that an image be played. When the switch SPLAY is turned on, an image recorded on the recording medium 102 is displayed on the liquid crystal monitor.
  • The switch SFWD is a switch for playing one still image ahead, and the switch SREV is a switch for playing one still image back.
  • The switch SZUP is a switch used to command the apparatus to enlarge an image being played, and the switch SZDOWN is a switch used to command the apparatus to reduce in size an image being played.
  • The switch SSTOP is a switch used to command the apparatus to pause a moving image that is being played. Each time the switch SSTOP is operated, one of an instruction to resume playing a moving image and an instruction to pause playing is outputted in an alternating manner.
  • The switch SUP, the switch SDOWN, the switch SRIGHT and the switch SLEFT correspond to the upper, lower, right and left portions of the four-way operational key 124, respectively. The four-way operational key 124 is, as will be described later, effective when a reproduced image is displayed enlarged. The switch SUP is a switch used to command the apparatus to scroll up over an enlarged image, the switch SDOWN is a switch used to command the apparatus to scroll down, the switch SRIGHT is a switch used to command the apparatus to scroll to the right, and the switch SLEFT is a switch used to command the apparatus to scroll to the left.
  • FIGS. 4A to 4C are diagrams showing a reproduced image and how the image is displayed on the monitor. FIG. 4A shows frames of a moving image before the image is enlarged and displayed. FIG. 4B shows areas of the moving image data of FIG. 4A that are decoded and stored in the DRAM 106 to extract and enlarge a part of each frame of the moving image data. FIG. 4C shows the screen of the monitor 112 which is displayed when the monitor 112 displays the moving image of FIG. 4A.
  • Described next with reference to FIGS. 2 and 3 is processing for playing a moving image.
  • In this embodiment, a frame of moving image data before encoded has an aspect ratio of 4:3, and 1280 pixels (h)×960 (v). Such moving image data is reproduced from the recording medium 102 and is displayed on the monitor 122, which has a resolution of 640 pixels (h)×480 pixels (v). As has been described, each frame of moving image data is encoded by JPEG and, to reproduce the moving image data, data of a frame is decoded by JPEG separately from data of another frame.
  • The CPU 100 goes into a play mode when it is detected that the switch SPLAY has been turned on. In step S201, the CPU 100 controls the interface circuit 103 and the system controller 104 to start reading out a desired moving image file from of the recording medium 102. The image data read out from the recording medium 102 is transferred to and stored in the DRAM 106 in order.
  • In step S202, the display magnification is initialized and ×1 display magnification is set to display the whole image on the monitor 122.
  • In step S203, the CPU 100 sets a still image stored at the head of the moving image file, and starts a timer set in accordance with a desired frame rate.
  • In step S204, a state of the switch SPLAY is judged. When the switch SPLAY is off, the CPU 100 ends the play mode whereas the play mode is maintained and the CPU 100 moves to the next step when the switch SPLAY is on.
  • In step S205, a state of the switch SSTOP is judged. When the switch SSTOP is on, the CPU 100 pauses playing a moving image and moves to step S206. When the switch SSTOP is off, the moving image is kept played and the CPU 100 moves to the next step. Stop mode processing in step S206 will be described later.
  • In step S207, states of the zoom switches SZUP and SZDOWN, which are used to specify a display magnification, are judged. As a user operates either one of the zoom switches, the CPU 100 moves to step S208. In the case where neither of the switches SZUP and SZDOWN is operated, the CPU moves to step S217.
  • In step S217, whether the display magnification is ×1 magnification or not is judged. When an image is displayed enlarged, the CPU 100 moves to step S218, and to step S220 when the display magnification is ×1 magnification.
  • In step S220, the display magnification is set to ×1. In step S221, the original image size, namely, 1280 pixels (h)×960 pixels (v), is set as the size in which the image data is to be read out from the DRAM 106 in accordance with the display magnification set in step S220.
  • In step S222, the CPU 100 sequentially reads out, via the memory control circuit 105, from the DRAM 106, image data in the head frame of the moving image file set in step S203, and decodes the read image data. The decoded image data is sequentially written in the DRAM 106 block by block via the memory control circuit 105.
  • In step S223, whether decoding processing has been completed for one frame of image data or not is checked. In the case where decoding processing for one frame of image data has been completed, the CPU 100 moves to step S224.
  • In step S224, the CPU 100 changes the resolution of decoded image data from the original image size to the resolution of the monitor 122.
  • Specifically, the CPU 100 reads out stored image data from the DRAM 106 via the memory control circuit 105 and converts the resolution of the image data. When the display magnification is ×1, the original image size, 1280 pixels (h)×960 pixels (v), is reduced by ½ in width and by ½ in height. The converted image data is sequentially written in a display area in the DRAM 106. Thus 640 pixels (h)×480 pixels (v) image data for display is stored in the DRAM 106. The stored image data is displayed as shown in screens 60 and 61 of FIG. 4C.
  • In step S214, whether the frame that is currently displayed is the last frame of the moving image data or not is judged. In the case where it is the last frame, the moving image play mode is ended. In the case where it is not the last frame, the CPU 100 moves to step S215.
  • In step S215, which frame is to receive reproduction processing next is set.
  • In step S216, the timer set in step S203 is checked to determine whether a predetermined period of time has passed or not. In the case where the predetermined time has passed, the CPU 100 proceeds to processing the next frame of the image data.
  • Subsequently, steps S204 to S216 are repeated.
  • Described next is the operation of displaying a moving image that is being played enlarged. A user operates the switch SZUP for enlarged display while a moving image is being played at ×1 magnification. Then the CPU 100 judges in step S207 that the switch SZUP has been operated, and moves to step S208.
  • In step S208, a larger magnification is set each time the user operates the switch SZUP (to ×2 at one flick of the switch SZUP, ×4 at the next flick) whereas a smaller magnification is set each time the user operates the switch SZDOWN (to ×2 at one flick of the switch SZDOWN, ×1 at the next flick). In this embodiment, the display magnification is changed to ×2 by operating the switch SZUP while a moving image is being displayed at ×1 magnification.
  • In this embodiment, an area of the original image is extracted in accordance with the enlarging magnification, and the extracted portion of image data is subjected to enlarging processing in accordance with the number of pixels of the monitor 122.
  • In step S209, the size of the area to be extracted is obtained from the original image size and the magnification set in step S208, to set a range to be extracted for enlarged display on the original screen.
  • For instance, when the display magnification set in step S208 is ×2, the size of the extracted area is set to 640 pixels (h)×960 pixels (v) by multiplying 1280 pixels×960 pixels by ½ in width and length, respectively. Similarly, the display magnification set in step S208 is ×4, the size of the extracted area is set to 320 pixels (h)×240 pixels (v) by multiplying the original image size by ¼ in width and length, respectively. Here, the display magnification set in step S208 is 2.
  • In step S210, the CPU 100 reads out one frame of stored image data from the DRAM 106 via the memory control circuit 105, and decodes the read-out image data block by block. At this point, the CPU 100 sequentially reads out one frame of image data stored in the DRAM 106 starting from a block at the upper left corner of the screen as shown in FIG. 5, and decodes the read-out image data. The decoded image data is sequentially transferred to and stored in the DRAM 106 via the memory control circuit 105.
  • After decoding processing is started in order from the upper left corner block on the screen in this way, the CPU 100 compares in step S211 the position on the screen of the decoded image data against the extraction range set in step S209. The CPU 100 continues the processing of reading out encoded image data from the DRAM 106 and the processing of decoding the read-out image data until the position of the decoded image data exceeds the extraction range. When it is judged that the extraction range is exceeded, the CPU 100 moves to step S212.
  • In step S212, the processing of decoding encoded image data is stopped. As a result, the DRAM 106 now stores image data of the range shown in 52 of FIG. 4B in a decoded state whereas image data of an area below this range on the screen remains encoded. In FIG. 4B, 520 indicates the extraction range set in step S209.
  • In step S213, the CPU 100 converts the resolution of the image data in the extracted area set in step S209 into the resolution of the monitor 122.
  • In other words, the CPU 100 has the memory control circuit 105 read out image data of an extraction area, specifically, image data in the extraction range 520 of FIG. 4B, from the DRAM 106, and converts the resolution of the read image data into the resolution of the monitor 122 in accordance with a set display magnification.
  • For instance, when the display magnification is ×4, image data of 320 pixels (h)×240 pixels (v) extraction area is doubled in the horizontal direction and the vertical direction each. When the display magnification is ×2, there is no need to convert the resolution and the image data is displayed as it is since the size of the extraction range is 640 pixels (h)×480 pixels (v).
  • The image data with the resolution thus converted is written in a display memory area of the DRAM 106 in order. In this way, enlarged image data having 640 pixels (h)×480 pixels (v) is stored in the display memory area of the DRAM 106, and the stored image data is displayed as a ×2 magnification image on the monitor as shown in a screen 62 of FIG. 4C.
  • Subsequently, steps S214 to S207 are repeated to set the next frame.
  • In the case where the switches SZUP and SZDOWN are found to be off in step S207, the CPU 100 moves to step S217.
  • In step S217, the display magnification is checked to judge whether it is ×1 magnification or not. When the display magnification is judged to be larger than ×1 magnification, the CPU 100 moves to step S218. When the display magnification is judged as ×1 magnification, the CPU 100 moves to step S220.
  • In step S218, the CPU 100 judges states of the switches SUP, SDOWN, SRIGHT and SLEFT of the four-way operational key 124. When the user operates any one of the four switches to instruct the apparatus to change the display position, the CPU 100 moves to step S219. When none of the switches SUP, SDOWN, SRIGHT and SLEFT is operated, the CPU 100 moves to step S210. In the case where the four-way operational key is not operated while the screen 62 of FIG. 4C is displayed, a screen 63 is displayed without changing the current display range.
  • Subsequently, steps S210 to 218 are repeated to display the continuous frames 62 and 63 of a moving image enlarged.
  • On the other hand, when the user operates the four-way operational key 124 to change the display position while a moving image is being played enlarged, the CPU 100 checks the states of the switches SUP, SDOWN, SRIGHT and SLEFT and moves to step S219. In step S219, the CPU 100 sets a new area to be extracted for enlarged display in a direction that is designated via the switches.
  • For example, in the case where the switch SLEFT is operated while a screen 53 of FIG. 4B is displayed, the extraction range is moved to the left of the range 530 to set a new extraction range 540. As a result, the display screen of the monitor 122 is switched to a screen 64 of FIG. 4C.
  • Subsequently, steps S210 to S213 are repeated.
  • Pausing processing will be described next.
  • The user operates the switch SSTOP in step S205 to pause a moving image that is being played enlarged. This causes the CPU 100 to move into a stop mode where playing of a moving image is paused. FIG. 3 is a flow chart showing processing of the stop mode in step S206.
  • In step S301, the CPU 100 initializes display settings and sets a parameter Disp to 0. In step S302, the CPU 100 reads out one frame of image data stored in the DRAM 106 via the memory control circuit 105, and decodes the read-out image data in order. The decoded image data is sequentially transferred to and stored in the DRAM 106 via the memory control circuit 105.
  • In step S303, completion of decoding one frame of image data is waited. Image data stored at this point in the DRAM 106 is as shown in a screen 55 of FIG. 4B. In other words, when instructed to pause playing, the CPU 100 decodes all of image data of one frame, including an area of image data below the extraction range 550 for enlarged display, and stores the decoded image data in the DRAM 106.
  • When decoding one frame of image data is completed, the CPU 100 judges in step S304 states the zoom switches SZUP and SZDOWN, which are used to specify a display magnification.
  • In the case where the user operates either one of the zoom switches, the CPU 100 moves to step S305. In the case where the user operates neither the switch SZUP nor the switch SZDOWN, the CPU 100 moves to step S310.
  • In step S310, the state of the display magnification is judged. When the display magnification is judged to be larger than ×1 magnification, the CPU 100 moves to step S311. When the display magnification is judged as ×1 magnification, the CPU 100 moves to step S314.
  • In step S311, the CPU 100 judges the states of the switches SUP, SDOWN, SRIGHT and SLEFT of the four-way operational key 124. When the user operates any one of the four switches to instruct the apparatus to shift the display range, the CPU 100 moves to step S313. When none of the switches SUP, SDOWN, SRIGHT and SLEFT is operated, the CPU 100 moves to step S312.
  • In step S312, the value of the variable Disp is checked. When it is judged that a still image is being displayed at a pause command (Disp=1), the CPU 100 moves to step S309. On the other hand, when it is judged that a moving image, not a still image, is being displayed (Disp=0), the CPU 100 moves to step S307.
  • In step S307, the CPU 100 converts the resolution of image data in the extraction range that is stored in the DRAM 106, in accordance with the resolution of the monitor 122.
  • In other words, of image data stored in the DRAM 106, the CPU 100 reads image data in the extraction range and converts the resolution of the read image data in accordance with a set display magnification. For instance, when the display magnification is ×4, 320 pixels (h) 240 pixels (v) extraction range image data is doubled in the horizontal direction and the vertical direction each. When the display magnification is ×2, the 640 pixels (h)×480 pixels (v) extraction range image data is outputted as it is.
  • The converted data is written in a display memory area of the DRAM 106 in order. Thus 640 pixels (h)×480 pixels (v) image data is stored in the display memory area of the DRAM 106. While the pause playing command is effective, the one frame of moving image data stored in the display memory area is repeatedly read out and outputted to the monitor 122, to thereby display an enlarged image as a still image as shown in a screen 65 of FIG. 4C.
  • In step S308, the parameter Disp indicating whether a moving image or a still image is being displayed is set to 1.
  • In the case where the user operates the switch SSTOP in step S309 in order to cancel the pause command while playing is paused, the CPU 100 ends the stop mode to resume playing a moving image in response. When the SSTOP is off, the CPU 100 moves to step S304.
  • When it is judged in step S310 that the display magnification is ×1 magnification, the original image size, namely, 1280 pixels (h)×960 pixels (v), is set in step S314 as a size in which image data is read out from the DRAM 106.
  • In step S315, the CPU 100 converts the resolution of the decoded image data from the original image size to the resolution of the monitor 122. Then the CPU 100 sets the parameter Disp to 1 and moves to step S309.
  • In the case where an instruction made by the user to change the display position is detected by detecting in step S311 that any one of the switches SUP, SDOWN, SRIGHT and SLEFT of the four-way operational key 124 has been operated, the CPU 100 moves to step S313.
  • In step S313, the CPU 100 sets moves the extraction range in a direction designated through the four-way operational key 124. Specifically, in the case where the switch SRIGHT is operated while the screen 65 of FIG. 4C is displayed, the extraction range is changed from 550 of FIG. 4B to 560, with the result that a screen 66 of FIG. 4C is displayed on the monitor 122. During the change, the monitor 122 keeps displaying a still image.
  • As has been described, according to this embodiment, one frame of encoded image data stored in the DRAM 106 is read out and decoded sequentially starting from an upper end of the screen in response to an enlargement command given while a moving image is played. As image data in an extraction range necessary in enlarged display is decoded, processing of reading out encoded image data from the DRAM 106 is ended, and decoding processing on this frame is stopped to proceed to processing of the next frame.
  • In this way, there is no need to read out a portion of encoded image data that is unnecessary for enlarged display, from the DRAM 106, and to process decoding on this portion. Accordingly, the DRAM is accessed less frequently and the load of the CPU is thus lightened.
  • In addition, an enlarged play function can be obtained without increasing the load of the CPU even when the number of pixels per frame is increased, and at the same time, the power consumption can be reduced. Another technological advantage of this embodiment is improved ease of use in pausing an enlarged moving image since the display position can be moved as processing of expanding a still image is completed.
  • The above embodiment describes a case of playing a moving image, but similar processing can be performed when a still image is to be played.
  • The expansion processing and magnification processing of a still image, which are performed by the CPU in the above-described example, may be carried out by hardware.
  • The object of the present invention can also be achieved by providing a storage medium storing program codes for performing the aforesaid processes to a reproduction apparatus, reading out the program codes, by a CPU or MPU of the reproduction apparatus, from the storage medium, then executing the program.
  • In this case, the program codes read out from the storage medium realize the functions according to the embodiments, and the storage medium storing the program codes constitutes the invention.
  • Further, the storage medium, such as a floppy disk, a hard disk, an optical disk, a magneto-optical disk, CD-ROM, CD-R, a magnetic tape, a non-volatile type memory card, and ROM, and computer network, such as LAN (local area network) and WAN (wide area network), can be used for providing the program codes.
  • Furthermore, besides aforesaid functions according to the above embodiments are realized by executing the program codes which are read out by a CPU from the reproduction apparatus, the present invention includes a case where an OS (operating system) or the like working on the computer performs a part or entire processes in accordance with designations of the program codes and realizes functions according to the above embodiments.
  • Furthermore, the present invention also includes a case where, after the program codes read from the storage medium are written in a function expansion card which is inserted into the reproduction apparatus or in a memory provided in a function expansion unit which is connected to the reproduction apparatus, CPU or the like contained in the function expansion card or unit performs a part or entire process in accordance with designations of the program codes and realizes functions of the above embodiments.
  • In a case where the present invention is applied to the aforesaid storage medium, the storage medium stores program codes corresponding to the flowchart of FIGS. 2 and 3 described in the embodiments.
  • The present invention is not limited to the above embodiments and various changes and modifications can be made within the spirit and scope of the present invention. Therefore to apprise the public of the scope of the present invention, the following claims are made.
  • This application claims priority from Japanese Patent Application No. 2004-213788 filed Jul. 22, 2004, which is hereby incorporated by reference herein.

Claims (1)

What is claimed is:
1. A reproducing apparatus comprising:
reproducing means for reproducing, from a recording medium, moving image data including plural frames whose information amount has been compressed by intraframe encoding;
a memory for storing the moving image data reproduced by the reproducing means;
decoding means for reading out the frames of the moving image data from the memory and decoding the read data, the decoding means reading out the moving image data in succession starting from an upper end of a screen for each frame to decode the read-out moving image data;
instruction means for instructing enlargement of the moving image data;
enlarging area setting means for setting, for each frame of the moving image data, a partial area on which enlarging processing is to be performed;
control means for controlling the decoding means in accordance with the enlarging instruction given by the instruction means, the control means stopping reading out the one frame of moving image data from the memory, which is performed by the decoding means, in case that moving image data of the partial area in the one frame of the moving image data is decoded; and
output means for modifying, in accordance with the number of pixels of the display device, the moving image data of the partial area decoded by the decoding means, and outputting the modified image data to the display device.
US14/525,849 2004-07-22 2014-10-28 Reproducing apparatus Abandoned US20150043897A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/525,849 US20150043897A1 (en) 2004-07-22 2014-10-28 Reproducing apparatus

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2004213788A JP4491295B2 (en) 2004-07-22 2004-07-22 Image reproduction method and image reproduction apparatus
JP2004-213788 2004-07-22
US11/185,654 US8902256B2 (en) 2004-07-22 2005-07-20 Reproducing apparatus with a function for enlarging image data
US14/525,849 US20150043897A1 (en) 2004-07-22 2014-10-28 Reproducing apparatus

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US11/185,654 Continuation US8902256B2 (en) 2004-07-22 2005-07-20 Reproducing apparatus with a function for enlarging image data

Publications (1)

Publication Number Publication Date
US20150043897A1 true US20150043897A1 (en) 2015-02-12

Family

ID=35757090

Family Applications (2)

Application Number Title Priority Date Filing Date
US11/185,654 Expired - Fee Related US8902256B2 (en) 2004-07-22 2005-07-20 Reproducing apparatus with a function for enlarging image data
US14/525,849 Abandoned US20150043897A1 (en) 2004-07-22 2014-10-28 Reproducing apparatus

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US11/185,654 Expired - Fee Related US8902256B2 (en) 2004-07-22 2005-07-20 Reproducing apparatus with a function for enlarging image data

Country Status (2)

Country Link
US (2) US8902256B2 (en)
JP (1) JP4491295B2 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007235195A (en) * 2006-02-27 2007-09-13 Canon Inc Image recorder and image display method
JP5317415B2 (en) * 2006-03-27 2013-10-16 富士フイルム株式会社 Image output apparatus, image output method, and image output program
CN100441413C (en) * 2007-03-07 2008-12-10 深圳市润天智图像技术有限公司 Printing device capable of adjusting output resolution ratio
US7706323B2 (en) * 2007-05-02 2010-04-27 Alvarion Ltd. Wireless communications in a multi-sector network
US20120194692A1 (en) * 2011-01-31 2012-08-02 Hand Held Products, Inc. Terminal operative for display of electronic record
US20120194415A1 (en) * 2011-01-31 2012-08-02 Honeywell International Inc. Displaying an image
US9241169B2 (en) * 2013-12-17 2016-01-19 Broadcom Corporation Raster to block conversion in a compressed domain

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5311177A (en) * 1991-11-15 1994-05-10 Mitsubishi Denki Kabushiki Kaisha Code transmitting apparatus with limited carry propagation
US20020159646A1 (en) * 1997-02-14 2002-10-31 Haskell Barin Geoffry Video objects coded by keyregions
US20030051249A1 (en) * 2001-08-20 2003-03-13 Khoi Hoang System and method for data insertion (commercials) in client generic data-on-demand broadcast transmissions
US20030081130A1 (en) * 2001-10-29 2003-05-01 Cho Jae-Soo Apparatus and method for controlling a camera using a video compression algorithm
US6573907B1 (en) * 1997-07-03 2003-06-03 Obvious Technology Network distribution and management of interactive video and multi-media containers
US20030161540A1 (en) * 2001-10-30 2003-08-28 Bops, Inc. Methods and apparatus for video decoding
US20040008773A1 (en) * 2002-06-14 2004-01-15 Canon Kabushiki Kaisha Multiple image processing and synthesis using background image extraction
US20040091052A1 (en) * 2002-11-13 2004-05-13 Sony Corporation Method of real time MPEG-4 texture decoding for a multiprocessor environment
US20040258152A1 (en) * 2003-06-19 2004-12-23 Herz William S. System and method for using motion vectors for object tracking
US20050036553A1 (en) * 2003-08-14 2005-02-17 Mallinath Hatti Line address computer for calculating the line addresses of decoded video data
US20050207726A1 (en) * 2004-03-22 2005-09-22 Jui-Ming Chen Portable multimedia electronic device
US20080131072A1 (en) * 1997-05-16 2008-06-05 Shih-Fu Chang Methods and architecture for indexing and editing compressed video over the world wide web

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2877698B2 (en) 1994-08-22 1999-03-31 三洋電機株式会社 Partial extension device
JPH1118080A (en) 1997-06-20 1999-01-22 Fujitsu Ltd Method and device for decoding dynamic image
US5907374A (en) * 1997-06-30 1999-05-25 Hewlett-Packard Company Method and apparatus for processing a compressed input bitstream representing an information signal
US6636222B1 (en) * 1999-11-09 2003-10-21 Broadcom Corporation Video and graphics system with an MPEG video decoder for concurrent multi-row decoding
US6775414B1 (en) * 1999-11-19 2004-08-10 Ati International Srl Variable-length code decoder
US6747706B1 (en) * 2000-01-11 2004-06-08 International Business Machines Corporation Workflow process for managing digital broadcast program production
JP2003224846A (en) * 2002-01-29 2003-08-08 Matsushita Electric Ind Co Ltd Image processing apparatus, decoding apparatus, encoding apparatus, image processing system, image processing method, and encoding method

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5311177A (en) * 1991-11-15 1994-05-10 Mitsubishi Denki Kabushiki Kaisha Code transmitting apparatus with limited carry propagation
US20020159646A1 (en) * 1997-02-14 2002-10-31 Haskell Barin Geoffry Video objects coded by keyregions
US20080131072A1 (en) * 1997-05-16 2008-06-05 Shih-Fu Chang Methods and architecture for indexing and editing compressed video over the world wide web
US6573907B1 (en) * 1997-07-03 2003-06-03 Obvious Technology Network distribution and management of interactive video and multi-media containers
US20030051249A1 (en) * 2001-08-20 2003-03-13 Khoi Hoang System and method for data insertion (commercials) in client generic data-on-demand broadcast transmissions
US20030081130A1 (en) * 2001-10-29 2003-05-01 Cho Jae-Soo Apparatus and method for controlling a camera using a video compression algorithm
US20030161540A1 (en) * 2001-10-30 2003-08-28 Bops, Inc. Methods and apparatus for video decoding
US20040008773A1 (en) * 2002-06-14 2004-01-15 Canon Kabushiki Kaisha Multiple image processing and synthesis using background image extraction
US20040091052A1 (en) * 2002-11-13 2004-05-13 Sony Corporation Method of real time MPEG-4 texture decoding for a multiprocessor environment
US20040258152A1 (en) * 2003-06-19 2004-12-23 Herz William S. System and method for using motion vectors for object tracking
US20050036553A1 (en) * 2003-08-14 2005-02-17 Mallinath Hatti Line address computer for calculating the line addresses of decoded video data
US20050207726A1 (en) * 2004-03-22 2005-09-22 Jui-Ming Chen Portable multimedia electronic device

Also Published As

Publication number Publication date
US20060028697A1 (en) 2006-02-09
US8902256B2 (en) 2014-12-02
JP4491295B2 (en) 2010-06-30
JP2006033775A (en) 2006-02-02

Similar Documents

Publication Publication Date Title
US20150043897A1 (en) Reproducing apparatus
US8081255B2 (en) Image converting apparatus, image signal processing apparatus, camera system and image signal processing method
JP4805596B2 (en) Camera device
WO2000064154A1 (en) Imaging device and signal processing method
EP1176830A1 (en) Improved processing apparatus, image recording apparatus and image reproduction apparatus
US8107534B2 (en) Moving-image reproducing apparatus and moving-image reproducing method
JP4343765B2 (en) Recording apparatus and reproducing apparatus
JP2004015580A (en) Recorder
JP2007181164A (en) Image reproducing apparatus
KR100883119B1 (en) Method for editing of moving picture file list
US7389004B2 (en) Image processing apparatus
JP3902824B2 (en) Image processing apparatus and method
JP2004343553A (en) Image decoding display device
JPH10276402A (en) Image recorder
JPH08336113A (en) Image processing device
JP4001946B2 (en) Playback device
JP5034717B2 (en) Decoding device and decoding method
JP2007124075A (en) Image processing apparatus and method, and image recording apparatus and method
JPH10257422A (en) Image recording and reproducing device
JP2009055131A (en) Image recording device
JP3886068B2 (en) Digital imaging and recording device
JP3239099B2 (en) Still image scrolling method and still image display device
JP4364294B2 (en) Camera device
JP2003087790A (en) Image data compressing method and image data outputting device
JP4312125B2 (en) Movie playback method and movie playback device

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION