CN100493144C - Data processing apparatus and control method thereof - Google Patents

Data processing apparatus and control method thereof Download PDF

Info

Publication number
CN100493144C
CN100493144C CN 200510102448 CN200510102448A CN100493144C CN 100493144 C CN100493144 C CN 100493144C CN 200510102448 CN200510102448 CN 200510102448 CN 200510102448 A CN200510102448 A CN 200510102448A CN 100493144 C CN100493144 C CN 100493144C
Authority
CN
China
Prior art keywords
image
data
image processing
processing apparatus
view data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN 200510102448
Other languages
Chinese (zh)
Other versions
CN1747529A (en
Inventor
远藤吉之
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Publication of CN1747529A publication Critical patent/CN1747529A/en
Application granted granted Critical
Publication of CN100493144C publication Critical patent/CN100493144C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention provides a data processing apparatus and a control method thereof. The data processing apparatus includes a plurality of image processing units which execute different processes on input image data and an encoding unit which encodes the image data. A generation unit selects an image processing unit to be used from among a plurality of image processing units based on requests from a plurality of output destinations to process image data of each frame input. The selected image processing unit processes the image data in time-series and the encoding unit encodes the processed image data. Thus, a plurality of image data corresponding to requests from a plurality of output destinations are generated.

Description

Data processing equipment and control method thereof
Technical field
The present invention relates to video data and handle, particularly a kind of data processing equipment and control method thereof that is preferably applied to be undertaken the image transmission by network.
Background technology
Recent years is along with popularizing of internet, usually by WWW transmission information such as (World Wide Web (WWW)s).In this case, image sensing device occurred, it has real-time photographic images and passes through the function of network transmitted image.
On the other hand, when providing camera review to transmit service to the user, relevant for the scheme that transmits the view data that is fit to the user side environment by network.
TOHKEMY 2001-197458 communique has been described a kind of image processing apparatus, the peculiar information (γ correcting value) that it will be used for carrying out at user side the display (as CRT, the LCD etc. of PC monitor) that image shows is sent to video camera, then, according to this information, camera processes also transmits captured image.TOHKEMY 2001-197458 communique attempts show to estimate to this display optimal image, with at the user side display image.
In addition, TOHKEMY 2004-151167 communique has been described a kind of server, it receives by measuring the information that the distinctive light characteristic of each display (cellular display) obtains, characteristic according to each display (cellular display) is carried out image rectification, then, transmit processing.
In addition, the video conveyer of TOHKEMY 2003-319364 communique description once stores the image of video camera shooting into special image generation server.By the WEB server, the video conveyer will be sent to each user with the moving image that extract at a plurality of visual angles of asking by the user of the special-purpose WEB server of access to the Internet.
The distinctive information of display that the structure that TOHKEMY 2001-197458 communique is described is used for transmitting the destination sends to camera side, when utilizing this video camera photographic images, reflects this information.Yet when video camera of a plurality of user captures, this structure can only satisfy the request that user with highest priority sends.That is, do not have the user of highest priority can only watch through having user's processed images of highest priority, and must show the view data of the user's who is fit to have highest priority display.
The request of photographic images it is contemplated that the structure with a plurality of image processing section when sending in order to satisfy a plurality of users.Yet in this case, this number of processing units has limited the content that service can be provided.Increase number of processing units and can relax this restriction.Yet web camera server etc. has the function of the image taking side of video delivery system, requires them to have reduced size usually, and the number of processing units that can install within it is subjected to the restriction of the zone of substrate/chip or calorific value etc.Therefore, the problem of existence is in fact to have limited this number of processing units.
In addition, the technology of describing for TOHKEMY 2003-319364 communique stores on the server, handles and transmit the structure of this image then according to user's request according to the image with video camera, in storage and carried out transmitting this image after the predetermined process.Therefore, the problem of existence is to have remarkable deviation between the time of photographic images and the time of reproduced image.If the taking moving image, and monitor in the very important place of a plurality of real-times etc. by a plurality of users and use these moving images that then this problem is very serious at remote location.Satisfy these a kind of systems of purpose needs, this system is according to not a plurality of requests of encoding state, the not coded image from per second 30 frames of image sensing device input is handled, then, and with the various forms of request, each image and send image of encoding respectively.Therefore, the number of users that can simultaneously this image be sent to obviously is restricted.
On the other hand, can consider a kind of structure, in this structure, image to video camera output carries out certain irreversible coding processing, and be stored to server, perhaps the image transform as analog image that video camera is transmitted becomes digital signal, and is stored to server.Yet, according to this structure, to by the image that reads coded data from server and these data of decoding obtain, perhaps carry out digital-to-analogue conversion, carry out analog-to-digital image then and handle.Therefore, the problem of existence is, with handle not coded image or not the situation of changing image compare the remarkable variation of picture quality.
In addition, TOHKEMY 2004-151167 communique is confined to use the situation such as cellular limited display unit (LCD), and it can not be applied to the not display of qualified majority type.
Summary of the invention
In view of the above problems, designed the present invention, and the objective of the invention is under the situation of the size of aggrandizement apparatus not, with shortly postpone, real-time mode will send to each device according to the moving image that carries out image processing from the request of a plurality of display unit.
The data processing equipment of realizing above-mentioned purpose according to an aspect of the present invention has following structure.That is, data processing equipment according to an aspect of the present invention comprises: a plurality of image processing apparatus, be connected in parallel, and be used for the different processing of view data execution to a frame that is transfused to; First choice device is used for from the image processing apparatus of described a plurality of image processing apparatus selections as the output destination of described view data; Code device is used for view data is encoded; Second choice device, be used for selecting: to carried out the view data of handling by the image processing apparatus of selecting by described first choice device, be to encode, still handle by image processing apparatus different among described a plurality of image processing apparatus with the image processing apparatus of selecting by described first choice device by described code device; And generating apparatus, be used for according to request from a plurality of outputs destination of motion image data, make described first choice device view data of a described frame that is transfused to be outputed to different image processing apparatus by the time sequence; Make described second choice device by the time sequence selection, view data to each described frame of having carried out respectively by described different image processing apparatus handling, be processed, still be encoded by described code device by the image processing apparatus different with the image processing apparatus that it has been carried out handle; And be predetermined each during repeat from being transfused to a series of processing of beginning till the view data of one frame being encoded by described code device, generate a plurality of motion image datas that satisfy from the request of a plurality of outputs destination of described motion image data thus.
According to a further aspect in the invention, a kind of control method of data processing equipment is provided, comprise: first selects step, is used for from being connected in parallel respectively a plurality of image processing apparatus that the view data of the frame that is transfused to is carried out different processing are selected image processing apparatus as the output destination of described view data; Image processing step is used in the image processing apparatus that the described first selection step is selected, to the described view data carries out image processing that is transfused to; Second selects step, be used for selecting: to having carried out the view data of handling by the image processing apparatus of selecting in the described first selection step, be to encode, still handle by image processing apparatus different among described a plurality of image processing apparatus with the image processing apparatus of in the described first selection step, selecting by code device; Coding step is used for selecting step to select under the situation of described code device described second, and the view data of having been undertaken handling by the image processing apparatus of selecting in the described first selection step is encoded; And the generation step, according to from request, make described first to select step the view data of a described frame that is transfused to be outputed to different image processing apparatus by the time sequence as a plurality of outputs destination of motion image data; Make described second to select step by the time sequence selection, view data to each described frame of having carried out respectively by described different image processing apparatus handling, be to handle, still encode by described code device by the image processing apparatus different with the image processing apparatus that it has been carried out handle; And be predetermined each during repeat from being transfused to a series of processing of beginning till the view data of one frame being encoded by described code device, generate a plurality of motion image datas that satisfy from the request of a plurality of outputs destination of described motion image data thus.
According to the explanation of doing below in conjunction with accompanying drawing, other features and advantages of the present invention are apparent, and in institute's drawings attached, identical Reference numeral is represented same or analogous part.
Description of drawings
Introduce specification and as an illustration the accompanying drawing of the part of book show embodiments of the invention, and be used from the explanation principle of the invention with specification one.
Fig. 1 illustrates according to the hardware configuration of the image sensing device of first embodiment and system configuration;
Fig. 2 is the flow chart that illustrates according to the operation of the image sensing device of first embodiment and display unit;
Fig. 3 A～3C illustrates the demonstration example according to the display unit that is connected to network of first embodiment;
Fig. 4 is the block diagram that is shown specifically according to the image processing section of first embodiment;
Fig. 5 illustrates the built-in function according to each processing section of the image processing section of first embodiment;
Fig. 6 illustrates the built-in function according to each processing section of the image processing section of second embodiment;
Fig. 7 A, 7B illustrate the demonstration example according to the display device side that can be connected to network of second embodiment;
Fig. 8 is the block diagram that is shown specifically according to the image processing section of the 3rd embodiment;
Fig. 9 illustrates the built-in function according to each processing section of the image processing section of the 3rd embodiment;
Figure 10 is the block diagram that is shown specifically according to the image processing section of the 4th embodiment;
Figure 11 illustrates the built-in function according to each processing section of the image processing section of the 4th embodiment;
Figure 12 is the block diagram that is shown specifically according to the image processing section of the 5th embodiment;
Figure 13 illustrates the built-in function according to each processing section of the image processing section of the 5th embodiment;
Figure 14 is the block diagram that is shown specifically according to the image processing section of the 6th embodiment;
Figure 15 is the block diagram that is shown specifically according to the parallel output control part of the 6th embodiment;
Figure 16 illustrates the built-in function according to each processing section of the image processing section of the 6th embodiment;
Figure 17 is the block diagram that is shown specifically according to the image processing section of the 7th embodiment;
Figure 18 is the block diagram that is shown specifically according to the parallel output control part of the 7th embodiment; And
Figure 19 illustrates the built-in function according to each processing section of the image processing section of the 7th embodiment.
Embodiment
Now, with preferred embodiment of the present invention will be described in detail by reference to the drawing.
First embodiment
Fig. 1 illustrates the block diagram according to the structure of the image sensing device of first embodiment.In Fig. 1, image sensing device 5 is divided into 3 parts roughly: image processing section 1, image sensing part 2 and communications portion 3.Image sensing part 2 comprises: camera lens 21, to its input picture; Light-to-current inversion transducer (below be called " transducer ") 22, the light that is used for being gathered by camera lens 21 is transformed to the signal of telecommunication; And development treatment part 23, be used to the signal that develops and obtain from transducer 22.23 pairs of data (under the situation that is primary-color filter, being the data of each RGB element) from transducer 22 outputs of development treatment part are carried out brightness/color signal separation process, noise reduction process, benchmark γ treatment for correcting and color correction/color signal and are suppressed to handle.Become the 4:2:2YC data from the final dateout of the view data of development treatment part 23 output.The signal that development treatment part 23 is developed is delivered to image processing section 1, as view data.By carrying out various image processing, encoding process, image processing section 1 is transformed to coded data with this view data, and this coded data is delivered to communications portion 3.
In the communications portion 3 that realizes network service, handling property judgement part 31 is analyzed the request of 61,62, the 63 pairs of image sensing devices 5 of display unit that are connected to by network, then, process information is sent to image processing section 1 and image sensing part 2.
According to above-mentioned process information, image processing section 1 will store data buffer 424 (Fig. 4) into for the motion image data of each display unit coding.Network Control Segment 30 is handled, and for example, according to the network schemer of destination, the moving image encoding data that are input to data buffer 424 is divided into bag (packetizing), then, sends it to network interface part 32, as the transmission data.Network interface part 32 sends to data on the corresponding network 4 of pattern of pattern and this network.In addition, communications portion 3 also is provided with storage area 33, is used to store moving image and the moving image that will deliver to any user from 2 outputs of image sensing part.Network 4 can be such as the wired lan of Ethernet (registered trade mark), utilize the WLAN of expression such as IEEE802.11b or such as the public switched network of ISDN.
This embodiment has illustrated the disparate modules image processing section 1 among Fig. 1, image sensing part 2 and communications portion 3, but when utilizing hardware to construct this embodiment, does not need physics to distinguish these modules.Can realize image processing section 1, image sensing part 2 and communications portion 3 by for example independent in every way IC, perhaps with these partly integrated (for example, integrated development treatment part 23, image processing section 1 and Network Control Segments 30) on a chip.Therefore, this mode is not limited to the explanation of following examples.
In addition, according to be stored in that CPU (control unit, not shown) can read such as the program in the storage medium of ROM, carries out image processing part 1, image sensing part 2 and communications portion 3.Particularly, for image processing section 1, CPU sends instruction to the control sequence generator 400 that illustrates later.
In addition, handling property in the Network Control Segment 30 judges that part 31 judges in 1 video cycle, all contents processings whether image processing section 1 can 61,62,63 request of processes and displays device.The main software that operates on the CPU that utilizes is realized this processing.Like this, if judgement can not be finished processing in 1 video cycle, then handling property is judged request and the subsequent request of part 31 refusals in the time can not handling again.Then, refusal is notified to the unaccepted display unit of request.Then, any video image of delivering to received other display unit of request is sent to the unaccepted display unit of request.
Fig. 3 A～3C illustrates the demonstration example that can be connected to the video image in the display unit 61 to 63 of network according to this embodiment.As display unit 61 to 63, for example, can use personal computer etc.In Fig. 3 A, the moving image that Reference numeral 301 expression sends image sensing device 5 outputs to the demonstration example on the display part of display device side.Reference numeral 302 expression menu icons, it is the user interface (UI) according to user's operation demonstration, and selects this project can select the various functions of display unit.When choice menus icon 302, (for example, utilize indicating device to select), show the menu that comprises icon 303 to 305.
It is the image that shows from image sensing device 5 that image selects icon 303 to be used to select, or shows the image of being stored.According to this embodiment, image rectification icon 304 is used to select image correction process.Select image rectification icon 304 to show the menu that comprises icon 315 to 319, shown in Fig. 3 B, so that select various image rectifications (gamma correction, colour balance adjustment, contrast adjustment, Filtering Processing and look district (colorarea) selection).Scope specified icons 305 is used to specify the desired scope that will extract from image.
In Fig. 3 B, show that 310 is by selecting image rectification icon 304, by showing what 301 conversion obtained.Brightness icon 315 is used to adjust the brightness of whole display image.Colour balance icon 316 is used to adjust the colour balance of whole display image.Contrast icon 317 is used to adjust the contrast of whole display image.Filtering icon 318 is used for whole display image is carried out Filtering Processing.The look district selects icon 319 to be used to adjust the look district of whole display image.
For example, when selecting brightness icon 315, image becomes the image that comprises the user interface that is used to adjust brightness, and shown in the demonstration among Fig. 3 C 320, thereby word order is adjusted brightness.Select brightness to reduce icon 321, so that whole screen deepening; And select brightness to strengthen icon 322, so that whole screen brightens.The state of the gray scale of the whole screen of bar shaped icon 323 expressions, bar shaped icon 323 also allows the user by operating the gray scale that this bar shaped icon 323 changes whole screen gradually.Cancellation icon 324 is icons (change brightness) of representing not change brightness.It is to be used to indicate execution to change into the icon (changing into brightness) of brightness that brightness changes mandate icon 325.
Fig. 4 is shown specifically the block diagram that is included in the image processing section 1 in the image sensing device 5 according to first embodiment.
In Fig. 4, control sequence generator 400 is communicated by letter with the handling property judgement part 31 in the Network Control Segment 30, and realizes the demonstration processing of display device side request.For this reason, the each several part in 400 pairs of image processing section of control sequence generator 1 sends suitable operational order, so that repeatedly a two field picture is handled arbitrarily chronologically in 1 vertical sync period.At this, the each several part in the image processing section 1 is meant image reading DMA part 410, preceding (anterior) selector portion 411, front signal separator portion 412, image rectification operating part 413, back (posterior) selector portion 419, back demultiplexer part 420, coding decoder part 421, coding decoder DMA part 423 and working storage DMA part 422.
Frame buffer 401 is the motion image data of unit storage from 23 outputs of development treatment part with 1 frame.According to the instruction of control sequence generator part 400, image reading DMA part 410 any from frame buffer 401 or working storage 425 reads the image frame data at any visual angle.According to the instruction from control sequence generator part 400, any in the image frame data that preceding selector portion 411 is optionally exported the image frame data or the back demultiplexer part 420 of 410 outputs of image reading DMA part outputs to front signal separator portion 412.According to the instruction from control sequence generator part 400, the image frame data that front signal separator portion 412 is optionally exported preceding selector portion 411 outputs to each processing section in the image rectification operating part 413.
In image rectification operating part 413, a plurality of image correction process of parallel work-flow (414 to 418).Gamma correction part 414 is adjusted brightness (Y) signal of view data, changes the brightness of this image.Color correcting section 415 is adjusted aberration (Cb/Cr) signal of view data, changes the colour balance of image.The tint ramp of 416 pairs of view data of γ correction portion (tone curve) carries out γ to be proofreaied and correct, and changes the contrast of this image.417 pairs of view data of Filtering Processing part are carried out Filtering Processing, image are carried out profile strengthens and (unsharp masking) handled in the fuzzy sharpening of covering, to reduce code capacity.Color space transformation part 418 changes the figure place of view data, and according to the colour matrix coefficient, changes the tone of image.By selection path 426, uncorrected view data can be offered back selector portion 419.
According to the instruction that control sequence generator part 400 is sent, back selector portion 419 optionally outputs to back demultiplexer part 420 with the image frame data of the output of the processing section (414 to 418) in the image rectification operating part 413.According to the instruction that control sequence generator part 400 is sent, the image frame data that back demultiplexer part 420 is exported back selector portion 419 outputs to any in coding decoder part 421, working storage DMA part 422 or the preceding selector portion 411.
With the form such as MJPEG, MPEG2 or MPEG4, the image frame data of demultiplexer part 420 outputs is encoded after 421 pairs of the coding decoder parts.Working storage DMA part 422 transmits (DMA transmission) to working storage 425 with the image frame data of back demultiplexer part 420 outputs.Coding decoder DMA part 423 transmits (DMA transmission) to data buffer 424 with the coded data of coding decoder part 421 outputs.Data buffer 424 memory encoding decoder section 421 coded datas, according to the request of Network Control Segment 30, the data of output storage.The image frame data of working storage 425 interim storage back demultiplexer part 420 outputs.According to the instruction that control sequence generator part 400 is sent, the image frame data that is stored in the working storage 425 is handled again, perhaps once more the arbitrary region in the picture frame is carried out different image correction process.
Can also be on same IC frame buffer 401, working storage 425 and data buffer 424 be configured to monolithic (on-chip) memory.In addition, can also utilize the memory device that is positioned at outside the IC, is connected to this IC (for example, such as SDRAM (synchronous dram) of SDR (single data rate) or DDR (double data rate) etc.) to realize them.In addition, memory can also adopt various structures, for example, is arranged on the different memory spare, perhaps is arranged on the same memory device.
Fig. 5 illustrates the built-in function according to each processing section of the image processing section 1 of this embodiment.Fig. 5 illustrate to development treatment part 23 output, be stored in situation in the frame buffer 401, carry out treatment for correcting corresponding to the two field picture in 1 vertical-scan period.That is, after Fig. 5 is illustrated in and stores 1 two field picture corresponding to 1 vertical-scan period into frame buffer 401, this two field picture is carried out the situation of treatment for correcting.Yet, can also construct the present invention with basically at development treatment part 23 output frame images and carry out the mode of first treatment for correcting when beginning this two field picture write frame buffer 401.In this case, further shortened the time of delay of image processing section 1.To describe Fig. 5 in detail below.
Then, will be with reference to figure 2 explanations according to the image sensing device of first embodiment and the operation of display unit.Fig. 2 is the flow chart that is used to illustrate according to the processing of this embodiment image sensing device 5 and display unit 61,62,63 execution.This embodiment will illustrate the operation when 3 display unit all are connected on the image sensing device, but obviously, the present invention is not limited to this structure.
When display unit 61 access images sensing devices 5 and foundation communication (step S201, S221), between display unit 61 and image sensing device 5, carry out communicating by letter of configuration information, store the configuration information of display unit 61 into image sensing device 5 (step S202, S222).Configuration information comprises quantity, coded format and the transfer rate etc. of the XY pixel (can also utilize resolution to represent) of the image that display unit 61 can show.When further describing, display unit 61 sends to image sensing device 5 with the configuration information of this device.By network interface part 32, image sensing device 5 receives the transmission data.Then, image sensing device 5 sends to display unit 61 with the content (configuration information) that receives, and confirms to utilize display unit 61 whether the configuration information that receives is correct.Display unit 61 judge the content that receives whether with the content match that sends, when not having problems, display unit 61 sends the order (the OK signal among Fig. 2) that expression begins to handle.
In the image sensing device 5 that receives the expression order that begins to handle, according to the transmission data, handling property is judged the setting (step S203) of part 31 process decision charts as transducing part 2 and control sequence generator part 400.Then, handling property is judged part 31 indicating image transducing parts 2 and control sequence generator part 400 output images (step S204).After receiving this instruction, image processing section 1 beginning output image (step S205) outputs to display unit 61 by communications portion 3 and network 4 with moving image.At step S223 and S224, display unit shows output image.
According to the setting of image processing section 1 at the moving image of at first exporting, the output movement image, and do not carry out any image rectification.That is, image reading DMA part 410 reads all two field pictures corresponding to 1 vertical-scan period that are stored in the frame buffer 401, by front signal separator portion 412 its past selector portion 411 is input to image rectification operating part 413.In image rectification operating part 413, select to be used for data the past demultiplexer part 412 is directly outputed to the path 426 of back selector portion 419.In addition, the output of back demultiplexer part 420 is set, to provide it to coding decoder part 421.Handle operation by such selection,, the encoding moving pictures that does not carry out image rectification is outputed to display unit 61 by communications portion 3 and network 4.
In this embodiment, suppose that handling property judgement part 31 is positioned at the Network Control Segment 31 of communications portion 3, but the present invention is not limited thereto.For example, handling property can be judged that part 31 is arranged in the image processing section 1, perhaps it is installed as the functional block in the control sequence generator part 400 that is built in image processing section 1, the installation site is not limit.
Even when display unit 62,63 is carried out above-mentioned connection procedure, they the two do not ask to carry out image correction process, therefore, control sequence generator part 400 only needs to proceed above-mentioned Data Stream Processing.Therefore, in the present embodiment, at this moment, communications portion 3 is delivered to this 3 display unit with the one and same coding moving image.
Then, the traffic operation of display unit and image sensing device 5 will be described when user's operation display device also asks to carry out treatment for correcting.Situation when as an example, the following describes display unit 61 request and carry out treatment for correcting.
The 61 pairs of moving images that receive of display unit that receive the motion image data of image sensing device 5 output carry out decompression, make this image be presented on the screen of display unit 61 (step S223, S224).Demonstration 301 shown in Fig. 3 A is the demonstration examples when the user makes display unit 61 display menu icon 302, image are selected icon 303, image rectification icon 304 and scope specified icons 305 on moving image.For example, when the user watched this moving image and want to show it with high slightly brightness, the user selected image rectification icon 304, can make screen become demonstration 310 on Fig. 3 B like this.When the user selected brightness icon 315 on this shows, this screen became the demonstration 320 shown in Fig. 3 C.
When each selection of user and operation bar shaped icon 323 (perhaps when the user operates brightness reduction icon 321 and brightness enhancing icon 322 at every turn), display unit 61 sends to image sensing device 5 with image rectification project and correcting value.This is handled corresponding to step S225, S226, S231, S232 and S233.Receive the setting that the image sensing device 5 of this information will receive and in statu quo send to display unit 61, to confirm whether to proofread and correct the information (step S206) that receives.Display unit 61 judge the content that receives whether with the content match that sends, if no problem, then its sends the order (being the OK signal in this embodiment) that expression begins to handle.By Network Control Segment 30, the image sensing device 5 that receives the expression order that begins to handle is judged the data content that receives.When Network Control Segment 30 judges that this information is relevant with image rectification (step S207),, make image processing apparatus 1 carry out image correction process by control sequence generator 400 at step S208.
When the brightness of correcting image as mentioned above (step S231), handling property judges that part 31 judges the setting of control sequence generator part 400 according to correction project and correcting value, and about this setting, indication control sequence generator part 400.Like this, the moving image that brightness is corrected only is sent to display unit 61 (step S208).In addition, when the indication visual angle (step S232), according to indicated visual angle output image (step S209).In a second embodiment, will describe this processing in detail.In addition, when sending image control information (image output stops, image change etc.) at step S233, carry out corresponding image control at step S210.
Then, identical with the user at display unit 61 enterprising line operates, when user's request that explanation is used to change the setting of colour balance and use display unit 63 in user's request of using display unit 62 utilizes filter to carry out image rectification, the built-in function of image processing section 1.In this case, the image that colour balance need be changed sends to display unit 62, and the image that will carry out Filtering Processing sends to display unit 63.That is, need carry out institute's processing of request, obtain a plurality of images after processed, and this image is sent to each request source image.Realize the mode of this image processing and transmission process in this embodiment below with reference to Fig. 5 explanation.
Development treatment part 23 two field pictures 510 output, that carried out development treatment are write the arbitrary region A of frame buffer 401, write image 511 as the N frame.In addition, next frame image 530 is write the arbitrary region B of frame buffer 401, write image 532 as the N+1 frame.Like this, the zones of different of frame buffer 401 hocketed writes processing, and the two field picture (N-1 two field picture 512, N two field picture 531) that writes on the zone that this fashion writes processing is carried out image rectification.Carry out this control and can successfully handle the two field picture that sends with fixed intervals.In the cycle of about 1/30ms in 1 vertical-scan period, development treatment part 23 output frame development treatment images 510,530.
Control sequence generator part 400 indicating image reading DMA parts 410 read two field picture with the fast speed than development treatment part 23 output frame images at least.Promptly, when from the individual requests (different request) of the display unit of current connection when arriving (handling property judge that part 31 judge the quantity of the display unit that is connected), control sequence generator part 400 indicating image reading DMA parts 410 are reading two field picture to the speed that all requests are handled.In this embodiment, because connected 3 display unit, as shown in Figure 5, so operate in the mode that in 1 vertical-scan period, has obtained to carry out the view data after 3 kinds of treatment for correcting.To be described in more detail operation shown in Figure 5 below.Note that the instruction of sending, the operation of the each several part of the image processing section 1 that realization describes below according to control sequence generator part 400.
View data DMA part 410 reads the N-1 two field picture (frame reads and handles 513) that is stored on the area B, and selector portion 411 before it is sent to as two field picture is to carry out the gamma correction of display unit 61 requests.Preceding selector portion 411 is selected data from image reading DMA part 410, and the two field picture of importing is outputed to front signal separator portion 412.Front signal separator portion 412 outputs to gamma correction part 414 with the two field picture of input, carries out the frame gamma correction in gamma correction part 414 and handles 514.To carry out the two field picture that gamma correction handles by gamma correction part 414 and output to back selector portion 419.Back selector portion 419 will be from the carrying out of gamma correction part 414 input the two field picture handled of gamma correction output to back demultiplexer part 420.The two field picture that back demultiplexer part 420 will have been carried out the gamma correction processing outputs to coding decoder part 421.Coding decoder part 421 is carried out image encoding (frame encoding process 515) with the form of control sequence generator part 400 indications, and the frame coded image that will carry out gamma correction outputs to data buffer DMA part 423.When data buffer DMA part 423 begins to carry out frame coded image with the N-1 frame when recording processing on the data buffer 424, control sequence generator part 400 outputs to Network Control Segment 30 with the communication authorization signal of the moving image encoding data of display unit 61.According to this communication authorization signal, Network Control Segment 30 beginning and display unit 61 are stored in communicating by letter of moving image encoding data on the data buffer 424.
Control sequence generator part 400 monitors the encoding process that coding decoder part 421 is carried out.Finish when the N-1 two field picture carried out frame encoding process 515 when detecting, control sequence generator part 400 indicating image reading DMA parts 410 read N-1 two field picture 512, as the two field picture of the color correction that will carry out display unit 62 requests.Image reading DMA part 410 is carried out frames and is read and handle 516, by preceding selector portion 411 and front signal separator portion 412 two field picture that is read is input to color correcting section 415.415 pairs of these two field pictures of color correcting section carry out color correction process 517.By back selector portion 419 and back demultiplexer part 420, the two field picture that utilizes color correction process 517 to carry out color correction process is input to coding decoder part 421.Coding decoder part 421 is carried out image encoding (frame encoding process 518) with the form of control sequence generator part 400 indications, result is outputed to data buffer DMA part 423, as the frame coded image that will carry out color correction.When the frame coded image that begins to carry out to have carried out color correction when data buffer DMA part 423 recorded processing on the data buffer 424, control sequence generator part 400 outputed to Network Control Segment 30 with the communication authorization signal of the moving image encoding data of display unit 62.According to this communication authorization signal, Network Control Segment 30 beginning and display unit 62 are stored in communicating by letter of the interior moving image encoding data of data buffer 424.
Control sequence generator part 400 monitors the encoding process that coding decoder part 421 is carried out.When detecting when the frame encoding process 518 of carrying out through the two field picture of color correction finished, control sequence generator part 400 indicating image reading DMA parts 410 read N-1 two field picture 512, as the two field picture that will carry out the Filtering Processing that display unit 63 asked.Read in the processing 519 at frame, by preceding selector portion 411 and front signal separator portion 412, the N-1 two field picture 512 that image reading DMA part 410 is read is input to Filtering Processing part 417.In frame Filtering Processing 520, by back selector portion 419 and back demultiplexer part 420, the two field picture that Filtering Processing part 417 was handled is input to coding decoder part 421, as the two field picture that has carried out Filtering Processing.Coding decoder part 421 is carried out image encoding (frame coding 521) with the form of control sequence generator part 400 indications, then, result is outputed to data buffer DMA part 423, as the frame coded image that has carried out Filtering Processing.When the frame coded image that begins to carry out that Filtering Processing is crossed when data buffer DMA part 423 recorded processing on the data buffer 424, control sequence generator part 400 outputed to Network Control Segment 30 with the communication authorization signal of the moving image encoding data of display unit 63.According to this communication authorization signal, Network Control Segment 30 beginning and display unit 63 are stored in communicating by letter of the interior moving image encoding data of data buffer 424.
As mentioned above,, connect, can in 1 vertical-scan period, repeatedly carry out the processing that reads coding by image rectification from two field picture by the inside that changes image processing section 1 chronologically according to first embodiment.To this processing that each vertical-scan period (per 1 frame) repeats repeatedly to carry out, therefore, can export a plurality of continuous motion image encoding files synchronously.
In addition, according to first embodiment, storage area 33 is arranged on the inside of image sensing device 5.Therefore, not only image can be outputed to network, and can for example digital camera or the captured camera motion image of digital video camcorder carry out arbitrary image and handle to the video camera that utilizes oneself, store this image, and the arbitrary motion image is outputed to each exterior display device simultaneously by network.
Although the foregoing description has been described the situation of 3 connection destinations being carried out the correction result of different images correction that sends,, for example,, can change processing quantity according to the number of connection of image transmission destination by improving the speed of handling frequency.In addition, as the measure of saving the energy, carrying out under the situation of multiple processing under the situation of only carrying out a kind of processing and in 1 vertical-scan period, can also utilize handling property to judge the instruction that part 31 grades are sent, changing the frequency of operation of image processing section 1.Perhaps, can also be all the time with high speed processing frequencies operations image processing section 1, and in 1 vertical-scan period of not handling, stop the operation of each processing section.
Second embodiment
First embodiment has described and has connected the processing that the destination carries out same image carrying out under the situation of different images correction simultaneously to 3.In addition, first embodiment has also described carrying out a kind of image processing in each output destination, and the processing of output result, but also needs to carry out multiple image processing according to the request of display unit that is positioned at the output destination.For example, gamma correction+Filtering Processing, gamma correction+with visual angle extraction of requiring etc.Second embodiment is used to explanation to realize the structure of this Combined Processing.
Identical with the situation of first embodiment, image sensing device 5 and a plurality of display unit couple together (Fig. 1) by network.Fig. 6 illustrates the operation according to each processing section of the image processing section 1 of second embodiment.Fig. 7 A and 7B illustrate according to second embodiment can be connected to demonstration example on the display unit of network.
In Fig. 7 A, show that 901 is the UI demonstration examples when showing the entire frame image, and by range of choice specified icons 305, the frame 902 that the Crop Area is shown is presented at and shows on 901.When the position and the size of user's operation box 902, select district arbitrarily, then, select OK icon 910 with indication fixed frame position, only the moving image in the frame 902 is sent to display unit.
Identical with the situation of first embodiment, as an example, the situation that connects 3 display unit 61,62,63 is described.For example, suppose in the demonstration shown in Fig. 7 B:
Display unit 61 requests are carried out gamma correction to whole camera review (920),
Display unit 62 requests are carried out gamma correction and Filtering Processing to part camera review (921), and
Display unit 63 requests are carried out color space transformation to part camera review (922) and are handled and Filtering Processing.
In this case, handling property judges that part 31 judges the content of the image rectification that is used for the overlapping of the visual angle of being asked and is asked, and indication control sequence generator part 400 is carried out effective internal and handled.In above-mentioned example, the visual angle 921 that display unit 62 is asked is included in the visual angle 920 that display unit 61 asked, and image correction process comprises that also identical gamma correction handles.Therefore, be judged to be definite following sequence: the entire frame image is carried out image correction process one time, it is stored in the working storage 425, then, read and handle part to be processed (parts of images 921) respectively.In addition, the mode translatory movement image of multiple image rectification is carried out in display unit 63 requests with the specified portions that only the entire frame image is shown.In this case, the visual angle 922 of specified portions is included in the visual angle 920 of display unit 61, but the content difference of carrying out treatment for correcting of being asked, and therefore, handling property is judged that part 31 is judged according to respectively reading and proofreaied and correct and compress.
With reference to figure 6, describe the operation of the image processing section 1 that satisfies above-mentioned request in detail.According to the instruction that control sequence generator part 400 is sent, following each several part is carried out and is handled operation.In addition, Fig. 6 illustrates and how the N two field picture is write regional A and how the N-1 two field picture that writes area B is handled, and as shown in Figure 5, alternately regional A, B is write/read.
At first, read processing 813 by frame, image reading DMA part 410 reads whole N-1 two field picture 812.By preceding selector portion 411 and front signal separator portion 412, the two field picture that is read is input to the gamma correction part 414 of carrying out gamma correction processing 814.By back selector portion 419 and back demultiplexer part 420, will carry out the two field picture that gamma correction handles by gamma correction part 414 and be input to working storage DMA part 422 (working storage writes and handles 815).
When the two field picture that will carry out gamma correction was written to processing 815 in the working storage 425 and finishes, the execution work memory reads handled 816.That is, read the image at the visual angle 920 of being asked the two field picture of image reading DMA part 410 in being stored in working storage 425, as the gamma correction image corresponding to display unit 61.In this embodiment, display unit 61 indicated visual angles 920 are the images corresponding to entire frame.By path 426, back selector portion 419 and back demultiplexer part 420, image reading DMA part 410 is read the gamma correction image that reads from working storage 425 in the processing 816 in working storage in statu quo offer coding decoder part 421.421 pairs of gamma correction images of coding decoder part carry out encoding process 817, and then, data buffer DMA423 writes data buffer 424 with it, as coding gamma correction image.When working storage DMA part 423 began to carry out that coded image recorded the processing of data buffer 424, control sequence generator part 400 outputed to the communication authorization signal of moving image encoding data the Network Control Segment 30 of display unit 61.
Then, control sequence generator part 400 monitors the encoding process of being carried out by coding decoder part 421 817, and detects finishing of encoding process 817.Then, read the image at the visual angle 921 of being asked the two field picture of control sequence generator part 400 indicating image reading DMA parts 410 in being stored in working storage 425 corresponding to display unit 62.Like this can be from working storage 425 through reading the parts of images data at the visual angle 921 (designation area) of being asked in the two field picture of gamma correction, as the image that will carry out the Filtering Processing that display unit 62 asked corresponding to display unit 62.
By preceding selector portion 411 and front signal separator portion 412, the parts of images data that image reading DMA part 410 is read are input to Filtering Processing part 417.Therefore, to passing through gamma correction, carrying out Filtering Processing 821 corresponding to the parts of images data of the designation area that reads from working storage 425.According to display unit 62,421 pairs of coding decoder parts are carried out encoding process 822 through the parts of images data 821 of the designation area of Filtering Processing, and then, coding decoder DMA part 423 writes data buffer 424 with it.By this sequential processes, when each visual angle overlaps each other and comprise same treatment for correcting, can realize shared processing.
Then, the image processing that display unit 63 is asked is designation area to be carried out color space transformation handle and Filtering Processing, and does not comprise above-mentioned gamma correction.Therefore, read parts of images data again from N-1 two field picture 812 as processing target.Therefore, image reading DMA part 410 reads the parts of images data (designation area reads and handles 830) at the visual angle 922 of being asked corresponding to display unit 63 from N-1 two field picture 812.By preceding selector portion 411 and front signal separator portion 412, the parts of images data that read are input to color space transformation part 418, it is carried out predetermined map handle.The parts of images data that back demultiplexer part 420 was handled the color space transformation processing section once more are sent to preceding selector portion 411, and are entered into Filtering Processing part 417.Can carry out the Filtering Processing of handling as second 822 to the parts of images data like this.By back selector portion 419 and back demultiplexer part 420, color space transformation is handled and the parts of images data of Filtering Processing are input to the coding decoder part 421 of these parts of images data being carried out encoding process 834 with having carried out like this.Then, by data buffer DMA 423, with parts of images data Input Data Buffer 424.Then, by image reading DMA part 410, control sequence generator part 400 reads the scheduled volume part that is positioned at after first reading images from the image at the visual angle 922 of being asked corresponding to display unit 63 from N-1 two field picture 812, repeat above-mentioned processing.By repeating this sequential processes, can carry out multiple treatment for correcting to the two field picture of having specified a zone thereon.
The 3rd embodiment
In first embodiment and second embodiment, image processing section 1 has internal structure as shown in Figure 4, and this structure is parallel arranges each image correction process, so that the distributed image data, to carry out treatment for correcting by the appointment of demultiplexer part.Yet when adopting this structure, the data flow con-trol of being undertaken by control sequence generator part 400 becomes complicated, and may increase the processing time.
In order to address the above problem, the 3rd embodiment has illustrated the example that image rectification operating part 413 is made amendment.As shown in Figure 8, according to the 3rd embodiment, each processing section in the image rectification operating part 1001 is connected in series as streamline.Before each processing section, be provided for adding the sign processing section 1010 of parameter whether expression should be carried out the sign of each treatment for correcting and represent the amount of every kind of correction, thus reduced data current control and shorten the processing time.
Fig. 8 is the block diagram that is shown specifically according to the image processing section 1 of the 3rd embodiment.In Fig. 8, control sequence generator part 1000 is provided with the read/write district of each DMA part, and Warning Mark processing section 1010 indicates the processing of the coded system of interpolation or execution such as transform coding decoder section 421.Image rectification operating part 1001 comprises a plurality of treatment for correcting modules that connect as streamline.The sign of view data is added in selector portion 1003 judgements to, selection is from the view data of image reading DMA part 410 output or from the view data of demultiplexer 1004 outputs any, and selected view data is outputed to image rectification operating part 1001.
Demultiplexer 1004 is judged the sign that adds to from the view data of image rectification operating part 1001 outputs, and will import data and output in coding decoder part 421, working storage DMA part 422 or the selector portion 1003 any.Sign processing section 1010 is added the instruction that is used for indicating according to control sequence generator part 1000, should be proofreaied and correct the sign of which processing of operating part 1001 to the view data carries out image, and adds the parameter of the correcting value that is used to indicate specified treatment for correcting.
Gamma correction part 1011 is judged the sign that is added by sign processing section 1010, when being provided with gamma correction processing execution sign, carrying out gamma correction and handles; When this sign is not set, data are outputed to the color correction process part 1012 of back.Color correcting section 1012 is judged the sign that is added by sign processing section 1010, when being provided with the color correction process execute flag, carries out color correction process; When this sign is not set, the data of not carrying out color correction process are outputed to the γ correction portion 1013 of back.γ correction portion 1013 is judged the sign that is added by sign processing section 1010, when being provided with γ treatment for correcting execute flag, carries out the γ treatment for correcting; When this sign is not set, the data of not carrying out the γ treatment for correcting are outputed to the Filtering Processing part 1014 of back.Filtering Processing part 1014 is judged the sign that is added by sign processing section 1010, when being provided with the Filtering Processing execute flag, carries out Filtering Processing; When this sign is not set, the data of not carrying out Filtering Processing are outputed to the color space transformation part 1015 of back.Color space transformation part 1015 is judged the sign that is added by sign processing section 1010, when being provided with the color space transformation execute flag, carrying out color space transformation and handles; When this sign is not set, the data of not carrying out color space transformation are outputed to demultiplexer 1004.
Fig. 9 illustrates the built-in function according to each processing section of the image processing section 1 of the 3rd embodiment.To the built-in function that have the image processing section 1 of structure shown in Figure 8 according to the 3rd embodiment be described.The following describes the example that request that two different display unit are sent is handled.For example, suppose the request of " carry out predetermined luminance proofread and correct also show the entire frame image " and the request of " carrying out predetermined luminance proofreaies and correct; carry out Filtering Processing then and show the image of specified view angle " (yet, suppose that two requests have same gamma correction content).
Control sequence generator part 1000 judges that from handling property part 31 obtains the information about angular field of view on two different display unit and treatment for correcting content, and definite processing progress (schedule).When development treatment part 23 began to export the N two field picture in 1 vertical-scan period, control sequence generator part 1000 began the N two field picture is write a zone (regional A) of frame buffer 401.Then, respond the beginning that this writes, control sequence generator part 1000 indicating image reading DMA parts 410 read N-1 two field picture 512 from another district (area B) of frame buffer 401.Respond this instruction, image reading DMA part 410 reads N-1 two field picture (the N-1 frame reads and handles 1113).By selector portion 1003, the two field picture that reads is input to sign processing section 1010.
The instruction of sending according to control sequence generator part 1000, sign processing section 1010 will be used for indicating the sign of " only entire image being carried out the processing that gamma correction is handled; be stored to working storage 425 then " to add the place that begins of incoming frame image to, and add the parameter of expression gamma correction amount.The two field picture that has added above-mentioned sign and parameter is offered image rectification operating part 1001.At first, image rectification operating part 1001 offers gamma correction part 1011 with two field picture.The sign of the starting position of incoming frame image is added in gamma correction part 1011 check to, judges and whether carries out gamma correction, and judge when carrying out gamma correction and should partly handle which of this image.In this example, the sign expression is carried out the gamma correction processing to entire image, therefore, according to designated parameters the entire frame image is carried out gamma correction and handles (N-1 frame gamma correction handles 1114).
The two field picture that will carry out gamma correction is input to next treatment for correcting color correction process part 1012.In this example, be not provided with by sign processing section 1010 signs that add, that be used to carry out color correction process, therefore, this two field picture is not handled, and it is outputed to rearmounted γ correction-processing portion 1013.Equally, expression is not set in γ correction-processing portion 1013, Filtering Processing part 1014 and color space processing section 1015 carries out the sign of this processing, therefore, do not carry out treatment for correcting, and the two field picture that will carry out gamma correction outputs to demultiplexer part 1004.Owing to be provided with the sign of storage in the working storage 425, output to working storage DMA part 422 so demultiplexer part 1004 will have been carried out the N-1 two field picture of gamma correction.
Working storage DMA part 422 writes working storage 425 (working storage writes and handles 1115) with the two field picture of input.
Control sequence generator part 1000 monitors that these working storage write and handles 1115 finish, and writes when finishing when detecting this, and indicating image reading DMA part 410 reads the two field picture in the working storage 425.Image reading DMA part 410 reads by working storage from working storage 425 and writes processing 1115 two field pictures that write (working storage reads and handles 1116).By selector portion 1003, will read processing 1116 two field pictures that read by working storage and offer sign processing section 1010.The instruction of sending according to control sequence generator part 1000, sign processing section 1010 is added and is used to represent two field picture is carried out that coding decoder is handled and the sign that do not carry out any image correction process, then, this sign is offered image processing operating part 1001.Therefore, this two field picture is outputed to demultiplexer part 1004, and do not carry out any treatment for correcting (by all processing sections), be entered into coding decoder part 421 at image processing operating part 1001.The two field picture of 421 pairs of inputs of coding decoder part encode (encoding process 1117).
When control sequence generator part 1000 detects the encoding process 117 of having finished 421 execution of coding decoder part, begin different display unit prepare image data.At first, control sequence generator part 1000 indicating image reading DMA parts 410 are handled 1115 and are write working storage 425 and carried out extracting the two field picture of gamma correction and have the view data that handling property is judged the visual angle that part 31 is specified from writing by working storage.The image reading DMA part 410 that receives above-mentioned instruction reads image (the working storage designation area reads and handles 1120) the designation area from working storage 425.By selector portion 1003, the view data that reads is input to sign processing section 1010.
The instruction of sending according to control sequence generator part 1000, sign processing section 1010 will be used to carry out the sign that Filtering Processing and encoding and decoding handle and be used to represent that the parameter of the treating capacity of Filtering Processing adds the place that begins of designation area image 1120 to, then, provide it to image rectification operating part 1001.Because in gamma correction processing section 1011, color correction process part 1012 and γ processing section 1013 be not provided with sign, so do not handle.According to the instruction of parameter, Filtering Processing part 1014 is carried out Filtering Processing (working storage designation area Filtering Processing 1121), and result is outputed to color space transformation part 1015.Color space transformation part 1015 is not handled, and by demultiplexer part 1004, this designation area Filtering Processing image 1121 is input to coding decoder part 421, carries out encoding process in the system of appointment.
As mentioned above, each processing section judges automatically that respectively the line data of going forward side by side stream is handled by sign processing section sign and parameter that add, that be used to specify processing, thereby simplifies the judgement to handling, and has therefore shortened the processing time.
The 4th embodiment
The 3rd embodiment is connected in series each correction-processing portion in the image rectification operating part 1001 as streamline, before image rectification operating part 1001, be provided with and be used to add the sign processing section 1010 of parameter that is used to represent whether carry out the sign of each treatment for correcting and is used to represent the correcting value of every kind of correction.Utilize this structure, the 3rd embodiment is intended to the reduced data current control and shortens the processing time.Yet, partly be embedded in the part that is used to indicate processing by each correction-processing portion of suitable arrangement and at the control sequence generator, further the internal structure of simplified image processing section 1.As shown in figure 10, according to the 4th embodiment, be embedded in the function of the function that is used for each correction-processing portion in the opening/closing image rectification operating part in control sequence generator part 1200, and each correction-processing portion in the image rectification operating part 1201 are together in series as streamline.By deleted marker processing section by this way, can further save the space of chip area, and save energy.
Figure 10 is the block diagram that is shown specifically according to the image processing section 1 of the 4th embodiment.In Figure 10, control sequence generator part 1200 is carried out each DAM partly is provided with the function that reads district/write area, each correction-processing portion of opening/closing and indicates coding decoder part 421 to change the processing of coded systems.Image rectification operating part 1201 is provided with the various processing modules that connect as streamline.According to the instruction that control sequence generator part 1200 is sent, gamma correction part 1211 judges that whether carrying out gamma correction handles.According to the instruction that control sequence generator part 1200 is sent, color correcting section 1212 judges whether carry out color correction process.According to the instruction that control sequence generator part 1200 is sent, the γ correction portion judges whether carry out the γ treatment for correcting.According to the instruction that control sequence generator part 1200 is sent, color space transformation part 1214 judges that whether carrying out color space transformation handles.According to the instruction that control sequence generator part 1200 is sent, Filtering Processing part 1215 judges whether carry out Filtering Processing.When in the part 1211～1215 each when control sequence generator part 1200 receives the instruction that should not carry out processing (closing function), each part is not all handled, and these data is offered the part of back.
Figure 11 illustrates the built-in function according to each processing section of the image processing section 1 of the 4th embodiment.
In structure shown in Figure 10, with reference to Figure 11 explanation when the request that 3 display unit are sent is handled, according to the built-in function of the image processing section 1 of the 4th embodiment.
Judge the information that part 31 is sent according to handling property, the treatment step that control sequence generator part 1200 is judged about the treatment for correcting content in 3 different display unit.This embodiment will illustrate that the first display unit request gamma correction, the second display unit request color correction and the 3rd display unit request γ proofread and correct and the situation of Filtering Processing.
At first, 1211 pairs first display unit in control sequence generator part 1200 indication gamma correction processing sections are carried out gamma correction and treating capacity parameter.On the other hand, control sequence generator part 1200 indication color correction process parts 1212, γ processing section 1213, color space transformation part 1214 and Filtering Processing part 1215 are not handled, and data are sent to next processing section.When the output in 1 vertical-scan period of development treatment part 23 beginning N+1 two field pictures, beginning writes to a zone (area B) (512) of frame buffer 401.Beginning when this writes, indicating image reading DMA part 410 reads N two field picture 531 from another zone (regional A) of frame buffer 401.Image reading DMA part 410 reads N two field picture 531 (the N frame reads and handles 1333), and this N two field picture 531 is input to gamma correction part 1211.
Because gamma correction part 1211 has received from control sequence generator part 1200 and has carried out the instruction that gamma correction is handled, so, the view data of input is carried out gamma correction handle (N frame gamma correction handles 1334) according to specified parameter.Be input to the color correction process part 1212 of carrying out next treatment for correcting with utilizing N frame gamma correction to handle 1334 images that carried out gamma correction, but make operation close the instruction of (OFF) owing to receiving from control sequence generator part 1200, so image is not handled, and it is outputed to the γ correction-processing portion 1213 of back.Equally, γ correction-processing portion 1213, color space processing section 1214 and Filtering Processing part 1215 have also received the instruction that operation is closed from control sequence generator part 1200, therefore, this two field picture is outputed to coding decoder part 421, and do not carry out any processing.According to the coded system of control sequence generator part 1200 indication, 421 pairs of coding decoder parts have been carried out the image of gamma correction encode (N frame encoding process 1335).Data buffer DMA part 423 writes data buffer 424 with the coded data that obtains, and then, 30 pairs of display unit of Network Control Segment are carried out transmission process.
Detect coding decoder part 421 and finished the control sequence generator part 1200 indication color correction process parts 1212 of encoding process 1335 and carry out color correction and treating capacity parameter, so that second display unit is generated view data.In addition, control sequence generator part 1200 is also sent the instruction of the operation that is used to close other processing section (gamma correction processing section 1211, γ processing section 1213, color space transformation part 1214, Filtering Processing part 1215).Then, control sequence generator part 1200 command diagram read N two field picture 531 as reading DMA part 410 from the regional A of frame buffer 401.Image reading DMA part 410 reads N two field picture (the N frame reads and handles 1336), then, the two field picture that reads is input to gamma correction processing section 1211.
Gamma correction processing section 1211 receives the instruction that is used for shutoff operation from control sequence generator part 1200, therefore, these data is offered the color correction process part 1212 of back, and these data are not carried out any processing.Color correction process part 1212 receives the instruction that is used to carry out color correction process from control sequence generator part 1200, therefore, according to designated parameters, the view data of input is carried out color correction process (N frame color correction process 1337).The N two field picture that will carry out color correction is input to the γ correction-processing portion 1213 that the back is used to carry out treatment for correcting, but when γ correction portion 1213 receives the instruction that is used for shutoff operation from control sequence generator part 1200, therefore, output N two field picture, and do not carry out any processing.Equally, color space processing section 1214 and Filtering Processing part 1215 also receive the instruction that is used for shutoff operation from control sequence generator part 1200, thus the N two field picture is outputed to coding decoder part 421, and do not carry out various processing.According to the coded system of control sequence generator part 1200 indication, the carrying out of 421 pairs of inputs of coding decoder part the N two field picture of color correction encode (encoding process 1338), then, produce N frame coded data.Data buffer DMA part 423 writes the data buffer DMA part 423 of data buffer 424 with this N frame coded data, and then, 30 pairs of display unit of Network Control Segment are carried out transmission process.
Detect coding decoder part 421 and finished the control sequence generator part 1200 further view data that are used for the 3rd display unit that produce of encoding process.Therefore, control sequence generator part 1200 will be used to carry out instruction and the treating capacity parameter that γ proofreaies and correct and offer γ correction-processing portion 1213, and the instruction and the treating capacity parameter that will be used to carry out Filtering Processing offer Filtering Processing part 1215.The instruction that control sequence generator part 1200 will be used for shutoff operation offers other processing section (gamma correction part 1211, color correcting section 1212 and color space transformation part 1214).Then, control sequence generator part 1200 command diagram read N two field picture 531 as reading DMA part 410 from the regional A of frame buffer 401.Image reading DMA part 410 reads N two field picture (the N frame reads and handles 1340), then, the two field picture that reads is input to gamma correction part 1211.
Gamma correction part 1211 receives the instruction that is used for shutoff operation from control sequence generator part 1200, therefore, the N two field picture is input to the color correcting section 1212 of back, and this image is not carried out any processing.Equally, color correcting section 1212 also receives the instruction that is used for shutoff operation from control sequence generator part 1200, therefore, gives the γ correction portion 1213 of back with this view data, and this view data is not carried out any processing.γ correction portion 1213 receives the instruction that is used to carry out the γ treatment for correcting from control sequence generator part 1200, therefore, according to designated parameters, the view data of input is carried out γ treatment for correcting (N frame γ treatment for correcting 1341).The view data that to carry out the γ correction is input to next color space transformation part 1214 in proper order.Color space transformation part 1214 receives the instruction that is used for shutoff operation from control sequence generator part 1200, therefore, the view data of importing is outputed to Filtering Processing part 1215.
Filtering Processing part 1215 receives the instruction that is used to carry out Filtering Processing from control sequence generator part 1200, therefore, according to designated parameters, the view data of input is carried out Filtering Processing (N frame Filtering Processing 1342).The view data of Filtering Processing part 1215 outputs is input to coding decoder part 421 in proper order, then,, it is encoded according to the coded system of control sequence generator part 1200 indications.Therefore, generated N frame coded data 1343.Data buffer DMA part 423 writes data buffer 424 with this N frame coded data, and then, 30 pairs of display unit of Network Control Segment are carried out transmission process.
As mentioned above,, realize the pipeline system treatment system, can save the space of chip area, and can save energy, realize same effect with first embodiment simultaneously by optimal arrangement according to correction-processing portion.
By the structure relevant with the described working storage of the 3rd embodiment 425 is provided, the 4th embodiment can also realize the processing of extracting with the visual angle that requires.
The 5th embodiment
In the internal structure of first embodiment of image processing section 1 and second embodiment, be arranged in parallel each image correction process as shown in Figure 4, and demultiplexer part distributed image data, to carry out the treatment for correcting of appointment.In addition, in the structure of the 3rd embodiment and the 4th embodiment, each processing section is connected as streamline with the sign processing section, to carry out treatment for correcting.
By utilizing DMA by the control sequence generator, the 5th embodiment is to entering data into each correction-processing portion and buffer or control from each correction-processing portion and buffer dateout, thereby realizes same operation and effect with the foregoing description.
Figure 12 is the block diagram that is shown specifically according to the image processing section 1 of the 5th embodiment.In Figure 12, judge the instruction that part 31 is sent according to handling property, 1400 pairs of control sequence generator parts are utilized DMA to enter data into each processing section and buffer or are controlled from each processing section and buffer dateout.Data/address bus 1410 connects each processing section and buffer.The two field picture in 1 vertical-scan period of frame buffer 1411 storage development treatment parts 23 outputs, and, be connected to other processing section in the image processing section 1 by DMA interface.Working storage 1412 is to be used for the working storage that blotter is handled the view data that section processes crosses arbitrarily and is connected to other processing section in the image processing section 1 by DMA interface.The coded data of data buffer 1413 memory encoding decoder section 1425 outputs then, outputs to Network Control Segment 30 with the coded data of storing.Data buffer 1413 is connected to other processing section in the image processing section 1 by DMA interface.
By corresponding D MA interface, the gamma correction part 1420 that is included in the image rectification operating part 1414 enters data into color correcting section 1421, γ correction portion 1422 and color space transformation part 1424 and coding decoder part 1425/; Perhaps from color correcting section 1421, γ correction portion 1422 and color space transformation part 1424 and coding decoder part 1425 dateouts.DMAC part 1426 is direct memory access controllers, the priority of each DMA interface in its monitoring picture processing section 1, data I/O order and the address of passing through, according to setting, carry out dma operation or stop dma operation from control sequence generator 1400.
Figure 13 illustrates the built-in function according to each processing section of the image processing section 1 of the 5th embodiment.Will be with reference to Figure 12 and Figure 13 explanation when handling from the request of 3 display unit, the built-in function that has the image processing section 1 of said structure according to the 5th embodiment.
For first display unit, utilize DMA to transmit, control sequence generator part 1400 is that unit sequence reads the N two field picture 531 that is stored on the frame buffer 401A with the arbitrary data amount, and this N two field picture 531 is directly inputted to gamma correction part 1420.Gamma correction part 1420 processing that set in advance operation according to the instruction from control sequence generator part 1400 are the data of unit input by the DMA transmission with the arbitrary data amount, and by the DMA transmission data processed order are outputed to coding decoder part 1425.What 1425 pairs of coding decoder parts were imported is that the data of unit are encoded with the arbitrary data amount, and transmits by DMA these data are sent to data buffer part 1413.Proceed these a series of DMA and transmit, up to the processing of finishing all N two field pictures.
For second display unit, to have finished when whole N two field picture carried out encoding process 1535 detecting, control sequence generator part 1400 is handled.That is, transmit by DMA, control sequence generator part 1400 is that unit sequence reads the N two field picture 531 that is stored among the frame buffer 401A with the arbitrary data amount once more, and these data are directly inputted to color correcting section 1421.Be used to set in advance the color correcting section 1421 of operation from the instruction of controlling sequencer part 1400, to transmitting by DMA with the arbitrary data amount is that the data that unit imports are handled, and by the DMA transmission these data is outputed to coding decoder part 1425 in proper order.What 1425 pairs of coding decoder parts were imported is that the data of unit are encoded with the arbitrary data amount, and transmits by DMA these data are sent to data buffer part 1413.Proceed these a series of DMA and transmit, up to the processing of finishing whole N two field picture.
In addition, for the 3rd display unit, finished when whole N two field picture carried out encoding process 1538 detecting, control sequence generator part 1400 utilizes DMA to transmit, and is that unit sequence reads and is stored in frame buffer 401A with the arbitrary data amount.The view data that reads is directly inputted to γ correction portion 1422.Set in advance the γ correction portion 1422 of operation according to instruction from control sequence generator part 1400, to transmitting by DMA with the arbitrary data amount is that the data that unit imports are handled, and by the DMA transmission data processed order is outputed to Filtering Processing part 1423.Set in advance the Filtering Processing part 1423 of operation according to instruction from control sequence generator part 1400, to transmitting by DMA with the arbitrary data amount is that the data that unit imports are handled, and by the DMA transmission data processed order is outputed to coding decoder part 1425.1425 pairs of coding decoder parts are that imported, be that the data of unit are encoded with the arbitrary data amount, then, transmit by DMA these data be sent to data buffer part 1413.Proceed these a series of DMA and transmit, up to the processing of finishing whole N two field picture.
Each vertical-scan period is repeated above-mentioned a series of processing, the coded data that is stored in the working storage 1413 is outputed to Network Control Segment 30, thereby can export 3 different encoding moving pictures by network.
The 5th embodiment will carry out image processing under the control of DMA storage is sent to other processing section to working storage 1412 with these data, and therefore, it can also produce the view data of having carried out multiple processing.In addition, if the scope of the image data extraction appointment from be stored in working storage 1412, and provide it to coding decoder part 1425, then can obtain the coded image data that extracts with the visual angle that requires.
As mentioned above, transmit each processing section of control, can realize same effect with other embodiment by utilizing DMA.
The 6th embodiment
In first embodiment and second embodiment, image processing section 1 has as shown in Figure 4 and parallelly each image processing section to be set and to utilize the internal structure of demultiplexer part distributed image data with the treatment for correcting of carrying out appointment.In addition, the 3rd embodiment has each processing section and indicates that the processing section is connected to carry out the structure of treatment for correcting as streamline with the 4th embodiment.In addition, the 5th embodiment utilizes DMA to control each correction-processing portion, thereby, realize same operation and effect with other embodiment.
The view data that the 6th embodiment is used for reading to each correction-processing portion being provided with offers the device (parallel output control part 1610) of a plurality of correction-processing portion and coding decoder part simultaneously.This structure can realize same operation and effect with the foregoing description, and improves the correction/encoding process efficient of scheduled unit time, and when realizing same processing, has reduced the utilization rate of memory.
Figure 14 is the block diagram that is shown specifically according to the image processing section 1 of the 6th embodiment.In Figure 14, according to the instruction of judging part 31 from handling property, 1600 pairs of control sequence generator parts are utilized DMA to enter data into each processing section and buffer or are controlled from the data of each processing section and buffer output.Data/address bus 1630 connects each processing section and buffer.Utilize image importation DMA 1631, the two field picture in 1 vertical-scan period of development treatment part 23 output is input to image importation 1613, it is write frame buffer 1626.By storage control 1628, frame buffer 1626 is connected to other processing section in the image processing section 1.Working storage 1625 is to be used for interim storage through the view data of handling section processes arbitrarily and the working storage that is connected to other processing section in the image processing section 1 by storage control 1628.The coded data of data buffer 1627 memory encoding decoder section 1621 outputs is judged part 31 with the handling properties that the coded data of storing outputs in the Network Control Segment 30.Data buffer 1627 also is connected to other processing section in the image processing section 1 by storage control 1628.
By DMA 1633～1637, enter data into the gamma correction part 1614, color correcting section 1615, γ correction portion 1616, the Filtering Processing part 1617 that are included in the image rectification operating part 1640, and parallel output control part 1610 and coding decoder part 1621; Or the gamma correction part 1614 from be included in image rectification operating part 1640, color correcting section 1615, γ correction portion 1616, Filtering Processing part 1617, and parallel output control part 1610 and coding decoder part 1621 dateouts.Each DMA is respectively the direct memory access controller, according to setting from control sequence generator 1600, the priority of each DMA in its control image processing section 1, data I/O order and the address of passing through, the execution of control dma operation/stop dma operation controlling.
Parallel output control part 1610, the processing section 1614～1617 and the coding decoder part 1621 that are included in the image rectification operating part 1640 are connected to data/address bus 1630 by the independently interface 1641 that is different from the DMA connection.The DMA 1632 of parallel output control part is from working storage 1625, frame buffer 1626 and data buffer 1627 reads image data.The view data that reads is offered basis simultaneously from each processing section that selection is set of control sequence generator 1600 and a plurality of processing sections in the coding decoder part 1621.In addition, by above-mentioned stand-alone interface 1641, will offer parallel output control part 1610 by the view data that in processing section and the coding decoder part 1621 any carried out image processing.According to the setting from control sequence generator 1600, parallel output control part 1610 is delivered to a plurality of processing sections in each processing section and the coding decoder part 1621 simultaneously with view data.
Figure 15 is the block diagram that the internal structure of parallel output control part 1610 is shown.In Figure 15, input arbitration part 1821 is connected to the output 1801 to 1806 of parallel output control part DMA 1632 and processing section 1614～1617 and 1621.Output 1801 to 1806 is respectively the output of parallel output control part DMA 1632, gamma correction part 1614, color correction output 1615, γ correction output 1616, Filtering Processing part 1617 and coding decoder part 1621.Data-out port 1824 and output busy signal 1823 are connected between input arbitration part 1821 and each output 1801 to 1806.The output busy signal outputs to each output 1801 to 1806 from input arbitration part 1821.
Output arbitration part 1820 is connected to the importation 1811 to 1816 of parallel output control part DMA 1632 and each processing section 1633 to 1637.Importation 1811 to 1816 is respectively the importation of parallel output control part DMA 1632, gamma correction part 1614, color correction output 1615, γ correction output 1616, Filtering Processing part 1617 and coding decoder part 1621.Data-out port 1831 and input busy signal 1830 are connected between output arbitration part 1820 and each importation 1811 to 1816.The input busy signal outputs to arbitration part 1820 from each importation 1811 to 1816.
Data-out port 1824, output busy signal 1823, data-in port 1831 and input busy signal 1830 constitute stand-alone interface 1641 shown in Figure 14.
According to the setting from control sequence generator 1600, input arbitration part 1821 is selected the output of input data.In addition, when judgement was input to the situation of each input busy signal 1830 of exporting arbitration part 1820, input arbitration part 1821 was controlled output busy signals 1823, thereby controlled the data of each output output respectively.By input arbitration part 1821, will store storage part 1822 into from the data of data-out port 1824 inputs temporarily.By output arbitration part 1820, the data that are stored in storage part 1822 are outputed to a plurality of outputs of from the importation 1811 to 1816 that is connected to output arbitration part 1820, selecting according to from the setting of control sequence generator 1600.
Above-mentioned stand-alone interface 1641 has input port and output port structure disconnected from each other, but by carrying out time-division control, even input port and output port integrate, also can realize same function.
In addition, this parallel output control part 1610 is used for according to from control sequence generator 1600 each input/output end port of opening/closing being set.Therefore, when the quantity of importation and output increases or reduce, parallel output control part 1610 be can construct,,, itself and the quantity Matching of the port that will operate made so that by closing untapped port with the many ports of prior preparation.In addition, by a plurality of coding decoders partly being connected to output arbitration part 1820, can satisfy many network output requests.
Figure 16 illustrates the built-in function according to each processing section of the image processing section 1 of the 6th embodiment.Will be referring to figs. 14 to 16 explanation when handling from the request of 3 display unit, according to the built-in function of the image processing section with said structure 1 of the 6th embodiment.
For first display unit, utilize the transmission of parallel output control part DMA 1632,1600 inputs of control sequence generator are stored in N two field picture in the area B of frame buffer 1626 (below be called " N two field picture ") 1712.In this transport process, by DMA output 1801, the N frame data are that unit sequence is input to parallel output control part 1610 with the arbitrary data amount.Then, these data are outputed to gamma correction importation 1812 in the gamma correction part 1614 and the coding decoder importation 1816 in the coding decoder part 1621.Is that unit handles the input data according to the gamma correction part 1614 of having set operation from the instruction of control sequence generator part 1600 with the arbitrary data amount, then, transmits by DMA, and the data after handling are outputed to working storage 1625 in proper order.Having preestablished the coding decoder part 1621 of operating according to the instruction from control sequence generator part 1600, is that unit encodes with the arbitrary data amount of importing, and utilizes DMA to transmit, and this result is sent to data buffer 1627.Proceed these a series of DMA and transmit, up to finishing dealing with whole N frame reading image 1713.
Detect to have finished at control sequence generator 1600 and whole N two field picture is carried out gamma correction handle 1714 and during encoding process 1715, it begins to carry out the processing about second display unit.At first, transmit by color correcting section DMA 1634, control sequence generator 1600 is that unit sequence reads the N frame gamma correction image 1716 that is stored in the working storage 1625 with the arbitrary data amount, directly this gamma correction image is input to color correcting section 1615.Having preestablished the color correcting section 1615 of operating according to the instruction from control sequence generator part 1600, is that unit carries out color correction process 1721 to the data of utilizing DMA to transmit input with the arbitrary data amount.Color correction output 1803 orders are exported this result, and it is input to parallel output control part 1610.Control sequence generator 1600 preestablishes parallel output control part 1610, to enter data into the mode of coding decoder part 1621 and Filtering Processing part 1617.Therefore, parallel output control part 1610 is carried out and will be outputed to the processing of coding decoder part 1621 and Filtering Processing part 1617 from the data of color correction output 1803 inputs.Coding decoder part 1621 is that unit encodes 1723 to the brightness/color image correcting data with the arbitrary data amount of input, by DMA 1637, this result is sent to data buffer 1627.Proceed these a series of DMA and transmit, up to finishing dealing with whole N two field picture.
1617 pairs of brightness/color correcting images from 1615 inputs of color correction process part of Filtering Processing part are that unit carries out Filtering Processing with the arbitrary data amount, utilize DMA1637, are sent to working storage 1625 with having finished data 1722 orders of handling.With the storage that transmits to working storage 1625, as N frame brightness/color correction/Filtering Processing image 1724.Proceed these a series of DMA and transmit, up to finishing dealing with whole N frame gamma correction image 1716.
In addition, when whole N frame gamma correction image 1716 has been carried out after the color correction process, control sequence generator part 1600 detects has finished encoding process 1723 and memory writes at 1724 o'clock, and it begins to carry out the processing of the 3rd display unit.Coding decoder part DMA 1637 is that unit sequence reads the N frame brightness/color correction/Filtering Processing image 1724 (1730) that is stored in the working storage 1625 with the arbitrary data amount.The N frame brightness/color correction/Filtering Processing image 1724 that 1621 pairs of coding decoder parts read is encoded, and then, by digital coding decoder section DMA 1637, this result is sent to data buffer 1627.Proceed these a series of DMA and transmit, up to finishing dealing with whole N frame brightness/color correction/Filtering Processing image 1724.
In each vertical-scan period, a series of processing above repeating are judged part 31 with being stored in the handling property that coded datas in the data buffer 1627 output to Network Control Segment 30, thereby, can export 3 different encoding moving pictures by network.
The 6th embodiment has described a kind of situation that only has a coding decoder part 1621, but by to be connected a plurality of coding decoders with the same mode of coding decoder part 1621, can satisfy a plurality of network requests.
As mentioned above, the 6th embodiment is provided with parallel output control part 1610, and same data are delivered to a plurality of processing sections, memory and coding decoder part.Can realize same operation and effect with the foregoing description like this, improve the correction/encoding process efficient of scheduled unit time, and when realizing same processing, can reduce the utilization rate of memory.
The 7th embodiment
According to the 6th embodiment, the DMA that utilizes that image processing section 1 has as shown in figure 14 offers data the internal structure of each image correction process.The 7th embodiment adopts parallel each image correction process and the demultiplexer part of arranging that view data is distributed to the internal structure of the processing section of appointment, and it also is provided with the device that the view data that is used for reading in each correction-processing portion offers a plurality of correction-processing portion and coding decoder part simultaneously.This structure can realize same operation and effect with the 6th embodiment.
Figure 17 is the block diagram that is shown specifically according to the image processing section 1 of the 7th embodiment.In Figure 17, according to the instruction of judging part 31 from handling property, 1900 pairs in control sequence generator enters data into each processing section and buffer or controls from each processing section and buffer dateout.Frame buffer 1902 storages are by the two field picture of image importation 1901 from 1 vertical-scan period of development treatment part 23 outputs.Working storage 1925 is to be used for interim storage to handle the view data of section processes arbitrarily and write DMA 1922 and second image is read the working storage that DMA 1910 is connected to other processing section in the image processing section 1 by working storage.The coded data of data buffer 1924 memory encoding decoder section 1921 outputs is judged part 31 with the handling properties that the coded data of storing outputs in the Network Control Segment 30.
As in the 6th embodiment, utilize stand-alone interface to connect parallel output control part 1912 and gamma correction part 1914, color correcting section 1915, γ correction portion 1916 and the Filtering Processing part 1917 and the coding decoder part 1921 that are included in the image rectification operating part 1913.DMA 1910 is from working storage 1925 and frame buffer 1902 reads image data for the output of second image, this view data is delivered to simultaneously a plurality of processing sections that selection is set that utilize control sequence generator 1900.This view data is offered the processing section that a plurality of processing sections 1914 to 1917 in the unit 1913 and coding decoder part 1921 are selected.In addition, by the input/output end port of will be below describing with reference to Figure 18 (2124,2131), the view data of utilizing in processing section 1914 to 1917 and the coding decoder part 1921 any to carry out image processing is delivered to parallel output control part 1912.Parallel output control part 1912 can offer view data a plurality of processing sections of selecting according to from the setting of control sequence generator 1900 simultaneously from processing section 1914 to 1917 and coding decoder part 1921.
Figure 18 is the block diagram that is shown specifically the internal structure of parallel output control part 1912.In Figure 18, the data-out port 2124 of output 2101 to 2106 is connected respectively to data output selector switch (below be called " SW ") 2001.Output 2101 to 2106 is outputs that second image is read DMA 1910, gamma correction part 1914, color correction output 1915, γ correction output 1916, Filtering Processing part 1917 and coding decoder part 1921.In addition, the data-in port 2131 of importation 2111 to 2116 is connected to the SW2001 group.Importation 2111 to 2116 is importations that second image is read DMA 1910, gamma correction part 1914, color correction output 1915, γ correction output 1916, Filtering Processing part 1917 and coding decoder part 1921.The SW2001 group is connected respectively to each I/O part in the cross bar switch mode.Yet different with traditional cross bar switch, with an input for each output, the specified a plurality of importations of specified control sequencer 1900 are as the mode of output destination, structure SW 2001.
Figure 19 illustrates the built-in function according to each processing section of the image processing section 1 of the 7th embodiment.Utilize Figure 17 to Figure 19, the built-in function according to the image processing section 1 of the 7th embodiment is described in said structure when handling from the request of 3 display unit.
At first, 1900 pairs first display unit of control sequence generator are carried out image processing.Reading DMA 1910 by second image, is unit with the arbitrary data amount, and control sequence generator part 1900 will be stored in N frame in the frame buffer 1902 (below be called " N two field picture ") image sequence and be input to parallel output control part 1912.Parallel output control part 1912 outputs to the gamma correction importation 2112 in the gamma correction part 1914 and the coding decoder importation 2116 of coding decoder part 1921 with same data.According to the gamma correction part 1914 of having set operation from the instruction of control sequence generator 1900, be that unit handles the input data with the arbitrary data amount, then, utilize DMA1922, the data after handling are sent to working storage 1925 in proper order.In addition, according to the coding decoder part 1921 of having set operation from the instruction of control sequence generator 1900, be that unit encodes to the view data of input with the arbitrary data amount, by DMA 1923, this result is sent to data buffer part 1924.Proceed these a series of DMA and transmit, up to finishing dealing with whole N frame reading image 2013.
Whole N two field picture has been finished gamma correction handle 2014 and during encoding process 2015 when control sequence generator 1900 detects, it is handled second display unit.At first, by the second image reading DMA 1910 is the transmission of unit with the arbitrary data amount, control sequence generator part 1900 reads the N frame gamma correction image 2016 that is stored in the working storage 1925 continuously, and it is directly inputted to color correcting section 1915.According to the color correcting section 1915 of having set operation from the instruction of control sequence generator part 1900, be that the data that unit imports are carried out color correction process (2021) to utilizing DMA to transmit with the arbitrary data amount.The result of color correction output 2103 outputs is outputed to parallel output control part 1912 in proper order.
Control sequence generator 1900 preestablishes parallel output control part 1912, will output to coding decoder part 1921 and Filtering Processing part 1917 from the data of color correction output 2103.Therefore, parallel output control part 1912 will output to coding decoder importation 2116 and Filtering Processing importation 2115 from the data of color correction output 2103 inputs.Coding decoder part 1921 is that unit encodes (2023) to the data of input with the arbitrary data amount, then, by DMA 1923, these data is sent to data buffer part 1924.Proceed these a series of DMA and transmit, up to finishing dealing with whole N frame reading image 2013.
On the other hand, Filtering Processing part 1917 is that unit carries out Filtering Processing (2022) with the arbitrary data amount of input, then, by DMA 1922, be sent to working storage 1925 with having finished data (the N frame brightness/color correction/Filtering Processing image 2022) order of handling.Like this, store N frame brightness/color correction/Filtering Processing image 2024 into working storage 1925.Proceed these a series of DMA and transmit, up to finishing dealing with of whole N frame gamma correction image 2016.
In addition, when after whole N frame gamma correction image 2016 has been carried out encoding process 2023 and color correction process, control sequence generator 1900 detects memory and writes 2024 when finishing, and it begins the 3rd display unit is handled.At first, reading DMA 1910 by second image, is unit with the arbitrary data amount, and order reads the N frame brightness/color correction/Filtering Processing image 2024 (2030) that is stored in the working storage 1925, and it is sent to coding decoder part 1921.1921 pairs of coding decoder parts transmit data and encode, and then, by coding decoder part DMA 1923, coded data are sent to data buffer part 1927.Proceed these a series of DMA and transmit, up to finishing dealing with of whole N frame brightness/color correction/Filtering Processing image 2024.
Each vertical-scan period is repeated above-mentioned a series of processing, the handling properties that the coded data that is stored in data buffer 1924 outputs in the Network Control Segment 30 are judged part 31, thereby, 3 different coding moving images can be exported by network.
As mentioned above, the 7th embodiment is provided with parallel output control part 1912, therefore, same data can be delivered to a plurality of processing sections, memory and coding decoder part.Can realize same operation and effect with the foregoing description like this, improve the correction/encoding process efficient of scheduled unit time, and when realizing same processing, can reduce the utilization rate of memory.
As mentioned above, according to the foregoing description, can carry out multiple processing with time-sharing format in 1 vertical sync period, therefore, providing can be with the short image sensing device that postpones moving image is sent in real time a plurality of display unit.Particularly in the closed network that does not use the internet (closed network), therefore the influence that exists network latency to postpone hardly, is compared with the traditional images transfer system that utilizes server, can realize more real-time moving image transmission.
In addition, the image sensing device 5 of all embodiment all can be directly carries out image correction process to compression movement image not.Therefore, use the system of following server can transmit the moving image that has carried out the high quality graphic processing, the image of this server expansion compressed image or simulation process perhaps is transformed to digital signal with them, then, this image is carried out image processing.
In addition, image correction process and encoding process that the image sensing device 5 of all embodiment all can be different to a plurality of different display device applications send moving image.Therefore, can be according to the characteristic and any operation/setting of watching the user of this display unit, translatory movement image of display.
In addition, according to the content that the quantity and the request of the display unit that is connected are handled, the image sensing device 5 of all embodiment all can change the quantity of handling in 1 vertical sync period.In this case, by in the quantity of handling after a little while with lower frequency work, perhaps in the quantity of handling for a long time with higher frequency operation, can save power.
In addition, the image sensing device 5 of all embodiment all within the image sensing device or outside be provided with storage device, therefore, can be in storage basic exercise image, according to the request of exterior display device, extract any visual angle and transmit the moving image that has carried out image rectification.
The image sensing device 5 of all embodiment all can send a plurality of moving images, and need not to be installed in parallel a plurality of same processing units, has reduced substrate or area of chip, and has reduced power consumption etc., therefore, can provide the mininet video camera.
In addition, data can be offered a plurality of processing units simultaneously according to the image sensing device 5 of the 6th embodiment and the 7th embodiment, and need not, then, transmit the moving image that has carried out multiple processing, therefore, can realize power saving with low frequency more by memory.
In addition, same data can be offered a plurality of processing units according to the image sensing device 5 of the 6th embodiment and the 7th embodiment, and need not by any memory.Therefore, can easily increase the processing quantity in 1 vertical sync period, therefore, can come the translatory movement image according to more network requests.
In addition, same data can be offered a plurality of coding processing unit according to the image sensing device 5 of the 6th embodiment and the 7th embodiment, and need not by any memory.Therefore, can increase the encoding process quantity in 1 vertical sync period, therefore, can come the translatory movement image according to more network requests.
The present invention can be applied to the system by a plurality of equipment (for example, main frame, interface equipment, reader, printer etc.) formation, also can be applied to the device that is made of an equipment (for example, photocopier, facsimile machine etc.).
Owing under the situation that does not break away from the spirit and scope of the present invention, can make a lot of visibly different embodiment of the present invention, so should be appreciated that, except being defined by claim, the present invention is not limited to specific embodiment.

Claims (8)

1. data processing equipment comprises:
A plurality of image processing apparatus are connected in parallel, and are used for the different processing of view data execution to a frame that is transfused to;
First choice device is used for from the image processing apparatus of described a plurality of image processing apparatus selections as the output destination of described view data;
Code device is used for view data is encoded;
Second choice device, be used for selecting: to carried out the view data of handling by the image processing apparatus of selecting by described first choice device, be to encode, still handle by image processing apparatus different among described a plurality of image processing apparatus with the image processing apparatus of selecting by described first choice device by described code device; And
Generating apparatus is used for according to the request from a plurality of outputs destination of motion image data, makes described first choice device by the time sequence view data of a described frame that is transfused to be outputed to different image processing apparatus; Make described second choice device by the time sequence selection, view data to each described frame of having carried out respectively by described different image processing apparatus handling, be processed, still be encoded by described code device by the image processing apparatus different with the image processing apparatus that it has been carried out handle; And be predetermined each during repeat from being transfused to a series of processing of beginning till the view data of one frame being encoded by described code device, generate a plurality of motion image datas that satisfy from the request of a plurality of outputs destination of described motion image data thus.
2. data processing equipment according to claim 1 is characterized in that: further comprise dispensing device, the data behind a plurality of codings that are used for being generated by described generating apparatus send to a plurality of outputs destination of described motion image data respectively.
3. data processing equipment according to claim 1 and 2 is characterized in that: further comprise the image sensing device that is used to generate described view data.
4. data processing equipment according to claim 1, it is characterized in that: when a plurality of processing of output destination request of motion image data, described generating apparatus is carried out a series of processing, and these a series of processing comprise and will be stored into by selected image processing apparatus processed images data in the memory temporarily, handle the view data that is stored in the described memory and by the processing of described code device to being encoded by described other image processing apparatus processed images data by other image processing apparatus.
5. data processing equipment according to claim 1, it is characterized in that: described generating apparatus can be carried out a series of processing, and these a series of processing comprise and will store the processing that the view data in the memory, from be stored in described memory reads desired parts of images and acquired image data is encoded into by selected image processing apparatus processed images data temporarily.
6. according to claim 4 or 5 described data processing equipments, it is characterized in that: the view data that is stored in the described memory can be used as the view data of handling with other corresponding a series of images in output destination of motion image data.
7. data processing equipment according to claim 1 is characterized in that: in described a series of processing, by view data being sent to by the selected image processing apparatus of demultiplexer, carry out the selection of described image processing apparatus.
8. the control method of a data processing equipment comprises:
First selects step, is used for from being connected in parallel respectively a plurality of image processing apparatus that the view data of the frame that is transfused to is carried out different processing are selected image processing apparatus as the output destination of described view data;
Image processing step is used in the image processing apparatus that the described first selection step is selected, to the described view data carries out image processing that is transfused to;
Second selects step, be used for selecting: to having carried out the view data of handling by the image processing apparatus of selecting in the described first selection step, be to encode, still handle by image processing apparatus different among described a plurality of image processing apparatus with the image processing apparatus of in the described first selection step, selecting by code device;
Coding step is used for selecting step to select under the situation of described code device described second, and the view data of having been undertaken handling by the image processing apparatus of selecting in the described first selection step is encoded; And
Generate step,, make described first to select step the view data of a described frame that is transfused to be outputed to different image processing apparatus by the time sequence according to request from a plurality of outputs destination of motion image data; Make described second to select step by the time sequence selection, view data to each described frame of having carried out respectively by described different image processing apparatus handling, be to handle, still encode by described code device by the image processing apparatus different with the image processing apparatus that it has been carried out handle; And be predetermined each during repeat from being transfused to a series of processing of beginning till the view data of one frame being encoded by described code device, generate a plurality of motion image datas that satisfy from the request of a plurality of outputs destination of described motion image data thus.
CN 200510102448 2004-09-10 2005-09-09 Data processing apparatus and control method thereof Active CN100493144C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2004264595 2004-09-10
JP2004264595 2004-09-10
JP2005211532 2005-07-21

Publications (2)

Publication Number Publication Date
CN1747529A CN1747529A (en) 2006-03-15
CN100493144C true CN100493144C (en) 2009-05-27

Family

ID=36166837

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200510102448 Active CN100493144C (en) 2004-09-10 2005-09-09 Data processing apparatus and control method thereof

Country Status (1)

Country Link
CN (1) CN100493144C (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101335890B (en) * 2007-06-25 2010-11-24 华为技术有限公司 Encoding and decoding method with image output controllable, encoder and decoder
JP5189570B2 (en) * 2009-08-19 2013-04-24 株式会社キーエンス Image processing apparatus and image processing method
CN104715450A (en) * 2013-12-16 2015-06-17 方正国际软件(北京)有限公司 Method and system for extracting icons from picture
CN113132651B (en) * 2020-01-15 2023-04-11 西安诺瓦星云科技股份有限公司 Image processing method and device and display control system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1372769A (en) * 2000-03-13 2002-10-02 索尼公司 Method and apapratus for generating compact transcoding hints metadata
US20020152317A1 (en) * 2001-04-17 2002-10-17 General Instrument Corporation Multi-rate transcoder for digital streams
US20030035653A1 (en) * 2001-08-20 2003-02-20 Lyon Richard F. Storage and processing service network for unrendered image data
US20030072372A1 (en) * 2001-10-11 2003-04-17 Bo Shen Method and apparatus for a multi-user video navigation system
US20040032348A1 (en) * 2000-12-22 2004-02-19 Lai Angela C. W. Distributed on-demand media transcoding system and method
CN1484447A (en) * 2002-08-09 2004-03-24 ������������ʽ���� Canera equipment and image process method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1372769A (en) * 2000-03-13 2002-10-02 索尼公司 Method and apapratus for generating compact transcoding hints metadata
US20040032348A1 (en) * 2000-12-22 2004-02-19 Lai Angela C. W. Distributed on-demand media transcoding system and method
US20020152317A1 (en) * 2001-04-17 2002-10-17 General Instrument Corporation Multi-rate transcoder for digital streams
US20030035653A1 (en) * 2001-08-20 2003-02-20 Lyon Richard F. Storage and processing service network for unrendered image data
US20030072372A1 (en) * 2001-10-11 2003-04-17 Bo Shen Method and apparatus for a multi-user video navigation system
CN1484447A (en) * 2002-08-09 2004-03-24 ������������ʽ���� Canera equipment and image process method

Also Published As

Publication number Publication date
CN1747529A (en) 2006-03-15

Similar Documents

Publication Publication Date Title
JP4863438B2 (en) Data processing apparatus and processing method
CN1960442B (en) Image capturing apparatus and image capturing method
CN100359951C (en) Method for sending intersting digital video selected zone by selected acuity
CN100446573C (en) Implementation device in VLSI of filter for removing blocking effect based on AVS
CN106254868B (en) Code rate controlling method for video coding, apparatus and system
US20200143516A1 (en) Data processing systems
CN100565578C (en) Produce equipment and method that the picture quality of sized image is adjusted in contract drawing image and improvement
US20010017613A1 (en) Image processing system
CN102263880B (en) Image scaling method and apparatus thereof
WO1994001824A1 (en) A single chip integrated circuit system architecture for video-instruction-set-computing
JPH09231375A (en) Movement detector and its method, display controller and its method and software system
CN100493144C (en) Data processing apparatus and control method thereof
US9148564B2 (en) Image pickup apparatus, information processing system and image data processing method
JP2011010331A (en) Modular architecture having reusable front end for processing digital video data
US8081228B2 (en) Apparatus and method for processing image data
CN107333062A (en) A kind of method, system and device of Computer Vision
US7482569B2 (en) Integrated circuit device, microcomputer, and monitoring camera system
JP2004166083A (en) Encoding device and method
CN106339194A (en) Method and system for dynamically adjusting multi-device display effect
CN205408063U (en) Image compression system, separate compression system , display device
CN116913178B (en) Spliced screen linkage system and video splicing method
CN115205099A (en) Image data transmission method and device and electronic equipment
US9001267B2 (en) Method and apparatus for tightly coupled, low power image processing
CN101742316B (en) NIOS II-based video processing method
CN100525373C (en) Image processing apparatus, display device, image processing method, and image processing program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant