CN100476516C - Display device with optical input function - Google Patents

Abstract

A display device includes a plurality of scanning lines, a plurality of signal lines, a plurality of pixel circuits and sensor circuits arranged between the intersect part of the plurality of scanning lines and the plurality of signal lines, a signal line drive circuit and scanning line drive circuit which drive the plurality of pixel circuits, and a precharge circuit and sensor control circuit which drive the sensor circuits. A filter subjects image data to an interpolation process to compensate for a gradation value of an output. In a signal processing section, the area of a light receiving area is calculated and it is determined that a light source is set in contact with a display screen when the deviation value of the light receiving area to the basis area is small enough, the light receiving area accompanied with the time is small enough, or the roundness of the light receiving area is big enough.

Description

The display device of band optical input function

(1) technical field

The present invention relates to a kind of display device that has optical input function, optical input function wherein is to come input information by for example making light from the light source of light pen and so on illuminate display screen.Survey with this display device and to illuminate positional information or contact position information on the display screen that illuminates by light.More specifically, by explaining embodiment described below, the present invention promptly can be clear.

(2) background technology

Recently, liquid crystal display device is widely used as the display device of various device, such as mobile phone or notebook-PC.Liquid crystal display device disposes an array substrate-arranging the liquid crystal pixel part that comprises thin film transistor (TFT) (TFT), liquid crystal capacitor and auxiliary capacitor at a plurality of sweep traces on this substrate and the cross section between a plurality of signal wire, and the driving circuit of driven sweep line and signal wire.Yet, recently since, along with the development and the improved treatment technology of integrated circuit technique drops into practice, the part of driving circuit has also been accomplished on the substrate, and has been attempted to reduce the size and the weight of liquid crystal display device.

On the other hand, the someone proposes the used for liquid crystal display device work of arranging the contact-type area sensor with capture function on its array substrate is had the display device of optical input function.Such conventional display spare with optical input function comprises display device that disposes the liquid crystal pixel part and the photosensitive device that is formed by photodiode, and liquid crystal pixel wherein partly is arranged in the cross section between a plurality of sweep traces and a plurality of signal wire.In photosensitive device, the quantity of electric charge that is connected in the capacitor of photodiode changes according to the light quantity that photodiode received.Therefore, display device can be obtained image, because view data can form by the voltage on a plurality of capacitors of surveying the cross part office.

After display device with optical input function had been arranged, having proposed a kind of view data that is used for to be obtained under a plurality of image capture conditions by image processing operations was the method that the basis reaches the multi-grey image data (multi-gradation image data) corresponding to the exposure intensity of incident ray.

A kind of method that obtains an image at an image when coming display image by the mode between the display box that an image capture frame insertion is used to display image has been proposed again.By said method, for example, a kind of pen type light source can be by being used as the coordinate input equipment of display device with the mode of this pen type light source irradiation display screen.Propose to be used for the coordinate Calculation algorithm of above purpose or touched probe algorithm (referring to the open 2002-182839 of Japan's special permission).

(A1)

In conventional display spare with optical input function, intactly output to outsidely because have the view data of the point-like flaw that in manufacture process, causes or produce or wire flaw and be, just be necessary to carry out a Flame Image Process computing that flaw is compensated by external integrated.For the carries out image processing computing, generally require in integrated circuit, to provide the storer of the memory capacity that is equivalent to the several rows view data, therefore, become problem big, that its cost raises with regard to the scale that integrated circuit occurred.

If carry out compensation process, just be necessary only to select to use those its optical input functions not have the display device of this flaw without external integrated.Consequently, the problem that fabrication yield reduces has appearred.

(B1)

In having the display device of optical input function, for example, when coordinate is when importing with the light source irradiation of light pen and so on, occurred being difficult to determine whether the nib of light pen is in and the contacted problem of display screen, because light source is leading to all the time again.In order to address the above problem, just can consider a kind of method of determining contact/contactless state in the mode of fixing a switch on the nib and only when being in contact, light source is switched on.Yet, be difficult to realize the smooth sensation of writing in this way.

(3) summary of the invention

(A2) the purpose of this invention is to provide a kind of display device, wherein because point-like flaw or wire flaw and local part of losing is compensated, the rising of the growth of the circuit scale of external integrated and cost is suppressed, fabrication yield is improved with optical input function.

(B2) the purpose of this invention is to provide and a kind ofly have optical input function, can on need not, fix the display device that to determine light input/non-input (i.e. contact/contactless state) under the situation of a switch of determining contact/contactless state fully to light source.

(C2) the purpose of this invention is to provide a kind of display device that has optical input function, can compensate and can determine fully light input/non-input (i.e. contact/contactless state) to the part that lose the part owing to the existence of point-like flaw or wire flaw.

(A3)

According to an aspect of the present invention, a kind of display device is provided, this device comprises many sweep traces that are arranged in parallel, many are arranged in the signal wire that intersects with described multi-strip scanning line, a plurality of image element circuits that are arranged in the cross section between described multi-strip scanning line and the described many signal line, each optical sensor part that provides the mode of an optical sensor to dispose at least for the circuit of the predetermined quantity in described a plurality of image element circuits, be used for driving the pixel driving device of described a plurality of image element circuits via described multi-strip scanning line and described many signal line, the sensor drive device of control photographic department, and will convert the display device of the output processing part of view data to from the output of photographic department, wherein output processing part comprises the wave filter that the gray-scale value from the image of photosensitive device is compensated.

(B3)

According to a further aspect in the invention, a kind of display device is provided, this device comprises many sweep traces that are arranged in parallel, the signal wire that multi-hop is arranged in parallel and intersects with described a plurality of sweep traces, a plurality of display device that are arranged in the cross section between described multi-strip scanning line and the described multi-hop signal wire, a plurality of photosensitive devices that are arranged in the cross section between described multi-strip scanning line and the described many signal line, be used for driving the drive unit of described a plurality of display device with display image on display screen via described multi-strip scanning line and described multi-hop signal wire, and handle signal processing part from the photoreceptor signal of described a plurality of photosensitive devices, wherein an arithmetic processing section utilizes photoreceptor signal to derive the area information of optical receiving region on the display device when the light of launching from the light source tip is mapped on the optical displays, one determination portion falls in the area information of described optical receiving region determines when parameter preset is provided with scope that this light is input.

(C3)

In accordance with a further aspect of the present invention, provide a kind of display device that had not only comprised the device of A3 but also comprised the device of B3 again.

To partly state other purpose of the present invention and advantage at following instructions, the purpose and the advantage of part are conspicuous in instructions, perhaps can understand by putting into practice the present invention.Can realize and obtain objects and advantages of the present invention by following means of specifically noting and combination.

(4) description of drawings

The accompanying drawing that is included in the instructions and forms a part of instructions is for example understood embodiment of the present invention, and explains principle of the present invention jointly with above general remark and following detailed description.

Fig. 1 is the block scheme that shows display device external integrated according to an embodiment of the invention and array substrate;

Fig. 2 is the figure of the basic configuration example of sensor circuit in the displayed map 1;

Fig. 3 is the figure of the basic configuration example of sensor circuit and image element circuit in the displayed map 1;

Fig. 4 is the figure of the ios dhcp sample configuration IOS DHCP of sensor circuit and image element circuit in the displayed map 1;

Fig. 5 is the time continuous figure of the operation of sensor circuit and image element circuit in the key diagram 4;

Shown in Figure 6 be among Fig. 4 circuit at the figure of the operation example of each frame unit;

Shown in Figure 7 is the filter operation example of handling the output of sensor circuit among Fig. 1;

Fig. 8 is the figure of the circuit arrangement example of sensor circuit output among display process Fig. 1;

Shown in Figure 9 is the I/O example of adder circuit among Fig. 8;

Shown in Figure 10 is the I/O example of comparer among Fig. 8;

Figure 11 A is the explanatory of an example among all results of filter process of circuit in the displayed map 8 to 11D;

Shown in Figure 12 is another example of handling the circuit arrangement of the display device sensor circuit output with optical input function according to the present invention;

Figure 13 A, 13B are the figure that shows sorting circuit I/O example among Figure 12;

Figure 14 is demonstration has display device external integrated and another example that array substrate disposes of optical input function according to the present invention figure;

Figure 15 is the figure of the circuit arrangement example of sensor circuit output among display process Figure 14;

Figure 16 is the figure of another example of circuit arrangement of sensor circuit output among display process Figure 14;

Figure 17 is that demonstration is the block scheme with the input of the coordinate of the display device major part of optical input function and image input part basic configuration according to the present invention;

Figure 18 A be show when light pen 700 near and wave filter output and computing are exported during away from the display screen 130 of LCD 100 illustrative figure;

Figure 18 B be show when light pen 700 in explanatory approaching and output image data state during away from the display screen 130 of LCD 100;

Figure 18 C be display optical pen 700 be near or away from the explanatory of the state of the display screen 130 of LCD 100;

Be the illustrative figure of a case shown in Figure 19 A, 19B, the 19C, in the case with the formal grammar of chart and express the data item among Figure 18 A and the 18B and the departure between the benchmark numerical value, above data are measured over time and based on above data circularity (degree of roundness);

Figure 20 is that setting threshold α, β, γ are 1.8,0.25,0.38 and determine that the data item by Figure 18 A and 18C that contact condition obtains is satisfied the illustrative figure of fixed condition number really respectively by the data item with regard to Figure 18 A and 18C with the form of chart;

Figure 21 is the figure that circuit 509 ios dhcp sample configuration IOS DHCPs are determined in the contact of demonstration output contact mark;

Figure 22 is one and is used to illustrate the view that utilizes 3 pixel X3 pixels to reach the method example of gray level image data as a unit;

Figure 23 is one and is used to illustrate the view that reaches the method example of accurate processing signals when the light from light pen 700 nibs that are used as light source is mapped to display screen; And

Figure 24 is the arrangement plan that shows another embodiment of the present invention.

(5) embodiment

Present invention is described referring now to accompanying drawing.

In one embodiment of the invention, according to the order of from sensor circuit, reading pixel data thick divided characteristic is made an explanation.

(1) obtaining one can be to the circuit that local part of losing compensates owing to have point-like flaw or wire flaw in LCD.

(2) in this case, the increase of external integrated (signal processing part) circuit scale and the rising of circuit cost have been suppressed.

(3) obtain the high display device that has optical input function of fabrication yield.

The switch that (4) obtain a kind ofly to have optical input function, can need not to light source to be used on fixing to determine contact/contactless state i.e. the display device of definite contact/contactless state correctly.

Fig. 1 has shown an array substrate 100 that has the display device 10 of optical input function, and the signal processing part 500 of image sensing data is operated and receive, handled to the image sensing of an array of controls substrate 100.

Signal processing part 500 forms with the form of integrated circuit, and its part is represented with piece shape.

As shown in Figure 1, for example, the display device 10 that has the optical input function display device of capture function (or have) is LCD that driven by the polycrystalline SiTFT that is formed on the glass substrate.

Signal processing part 500 is an ASIC for special purpose system, digital signal processor DSP, central processing unit CPU or similar device.This one is used for carrying out various processes, for example, again on display the image in image in the display image sensing or the picked-up, in memory devices, keep relevant image or the image in the picked-up handled with the input coordinate data.Yet, in this example, omitted control the explanation of that part of display operations by signal processing part 500.

In the viewing area 110 of array substrate 100, be formed with many sweep trace X that are arranged in parallel and many and be arranged in the signal wire Y that intersects with this multi-strip scanning line X.For the ease of understanding, shown that in Fig. 1 a sweep trace X (n) and a signal line Y (m) are as representative.Be arranged in cross part office between described multi-strip scanning line X and the described many signal line Y as the image element circuit 122 of display device with as the sensor circuit 124 of photosensitive device.Among Fig. 1, shown that an image element circuit 122 and a sensor circuit 124 are as representative.

The driving circuit that drives image element circuit 122 via described multi-strip scanning line X and described many signal line Y is formed in the peripheral position of viewing area 110 of array substrate 100.This driving circuit comprises the scan line drive circuit 132 of a plurality of image element circuits 122 that drive each row unit and the signal-line driving circuit 134 of picture signal is provided to the image element circuit 122 that will drive.

Again, the control device that is used for controlling a plurality of sensor circuits 124 is arranged on the peripheral position of the viewing area 110 of array substrate 100.This control device comprise to sensor circuit 124 carry out precharge pre-charge circuit 138, for the sensor control circuit 136 of each row unit specified sensor circuit 124, make from the output of sensor circuit 124 carry out the A/D converter 140 of mould/number conversion process, from the output of A/D converter 140 receiving digital datas and corresponding data is outputed to the output processing part 150 of signal processing part 500.Output processing part 150 comprises wave filter 152 and data transport unit 154.Sensor control circuit 136 and pre-charge circuit 138 form sensor drive portion.In addition, scan line drive circuit 132 and signal-line driving circuit 134 form pixel drive section.

In array substrate 100, at first, utilization is arranged on the sensor circuit 124 at cross section 120 places, and incident intensity information is converted into simulating signal, and this simulating signal converts Digital Image Data to by the A/D converter 140 that is arranged in the array substrate 100 peripheral positions.The image sensing data output processing part 150 that the Digital Image Data utilization is arranged in the array substrate 100 peripheral positions outputs to signal processing part 500.Output processing part 150 comprises wave filter 152 and data transport unit 154.Carry out filter process and offer signal processing part 500 via data transport unit 154 in turn by wave filter 152 from the data of A/D converter 140 outputs.

In Fig. 2 and Fig. 3, demonstration be the example of image element circuit shown in the figure 122 and sensor circuit 124 basic configuration.As shown in Figure 2, utilize light pen 700 that optics is incided on the array substrate 100.Hyaline membrane 102 is coated in or is connected on the outer surface of array substrate (glass substrate) 100, is used for cover glass.Multi-strip scanning line X, many signal line Y, image element circuit 122 and sensor circuit 124 do not utilize printing technology or vapor deposition techniques to be formed on the inner surface of array substrate 100 shown in figure 2.

Be formed on PIN diode D1, D2, D3 on array substrate 100 inner surfaces and take on light activated element in the sensor circuit 124.The periphery of PIN diode D1, D2, D3 is around insulation course 103.In addition, on insulation course 103, be formed with optical screen film SH1, SH2, SH3 facing to PIN diode D1, D2, D3.

Anti-substrate 105 is arranged in and leaves array substrate 100 a certain distances.Anti-substrate 105 has a public electrode (transparency electrode) and faces array substrate 100.Liquid crystal layer 104 is seized on both sides by the arms between array substrate 100 and anti-substrate 105.Back of the body irradiation source 106 is arranged on the outer surface of anti-substrate 105.When being controlled to convenient light through anti-substrate 105, liquid crystal layer 104 and array substrate 100, the transmissive state of the light of launching from back of the body irradiation source 106 forms image at display screen.

Fig. 3 has shown the basic circuit configuration example of one of sensor circuit 124.The source electrode of switch (thin film transistor (TFT)) TR2 is connected on the signal wire Y (m).The drain electrode of switch TR2 is connected on the end of the negative electrode of photodiode PD and sensor capacitor CP.The anode of photodiode PD and the other end of sensor capacitor are connected on the ground wire that is set at predetermined potential.The grid of switch TR2 is connected on the control line CRT (n) that resets.

In sensor circuit 124, sensor capacitor CP precharge in the latter half of a certain specified level blank cycle is read computing and is finished in the first half of the specified level blank cycle of following one-period (vertical cycle after).The precharge computing utilizes pre-charge circuit 138 to finish.

If big in the light quantity that is radiated at after the precharge on the photodiode PD, the discharge quantitative change of sensor capacitor CP is big.On the other hand, if the light quantity that is radiated on the photodiode PD is little, the discharge capacity of sensor capacitor CP diminishes.In this case, doing light shield between photodiode PD and back of the body irradiation handles.Therefore, obtain sensor output by voltage in readout interval via amplifier output transducer capacitor CP.

What Fig. 4 showed is the ios dhcp sample configuration IOS DHCP of a kind of wherein a plurality of image element circuit 122 and sensor circuit 124.As shown in Figure 4, pressure-wire CS is used in a default circulation to provide a default electromotive force to the electrode of the same side of auxiliary capacitor Csk and liquid crystal LC.Gate lines G ate (n) is a gate line (it is a sweep trace that is driven by scan line drive circuit 132) that is used for connecting/cut off the driving transistors TR1 of image element circuit 122.

In addition, the control line CRT (n) that resets is one and is driven the control signal wire that forms the switch TR2 of sensor circuit 124 with connection/cut-out by sensor control circuit 136.

When switch TR2 connects, sensor capacitor CP precharge.GND represents ground wire.In addition, SFB (n) expression is used for contacting thin-film transistor T R4 sensor output control line when the electromotive force of sensor capacitor CP is read out (it is to be driven by sensor control circuit 136).

Thin film transistor (TFT) plays a part the amplifier element element.Photodiode PD makes a response to light and produces electric current corresponding to the light quantity that is sensed.Thereby the electric charge of preliminary filling on sensor capacitor CP can discharge.

Signal wire Y (m-1), Y (m), Y (m+1) are connected on signal-line driving circuit shown in Figure 1 134 and the A/D converter.In addition, power lead Cs and gate lines G ate (n) are connected on the scan line drive circuit 132 shown in Figure 1, and reset control line CRT (n), ground wire GND and sensor control line SFB (n) are connected on the sensor control circuit 136.

Fig. 5 is the time continuous figure that is used to illustrate the operation of above circuit.In above circuit, a specified level cycle in a vertical cycle (frame period) is provided with as follows.In image element circuit 122, a horizontal cycle (1H) is divided into one first blank phase, blank phase of common reverse, the phase of writing and one second blank phase.In sensor circuit, a horizontal cycle is divided into and above four period of output of quite answering period, common reverse sequential (common inversion timing) phase, blank phase and precharge phase.Be the demonstration phase period in a vertical cycle (frame period) beyond above four periods in image element circuit 122, is the image sensing phase in sensor circuit 124.

In image element circuit 122, during writing, picture signal is written to auxiliary capacitor Csk via signal wire Y (m+1) along the represented path of arrow a1.Liquid crystal LC drives to provide gray scale to show according to the voltage that appears on the capacitor Csk.

In sensor circuit 124, after the above phase that writes, transistor T R2 is switched on and capacitor CP precharge.At this moment, the approach precharge represented along arrow b1 and c1 via signal wire Y (m+1) of capacitor CP.That is, write the phase and precharge phase switches each other, signal wire Y efficiently utilizes.If at image sensing electric current was arranged in photodiode in the phase, pre-charge voltage can change.

If connect in the period of output of transistor T R4 in next frame circulation, the voltage of sensor capacitor CP is amplified by transistor T R3 and obtains via signal wire Y (m) (approach that arrow d1, e1 represent).Identical operations is carried out in horizontal pixel portion of the next one and sensor part in next horizontal cycle.Derive from the voltage time to time change of sensor capacitor CP, photodiode PD begins up to read operation with light is isolated after precharge during this period.If photodiode does not carry out light shield, read voltage to be arranged to enough low, and if the light shield time long, can obtain high voltage.Whether as a result, determine a signal is the input of carrying out with light pen 700.

Fig. 6 shows above illustrative figure to each frame unit computing.In Fig. 6, for example, show N frame and N+1 frame.The signal Processing computing of explaining with reference to Fig. 5 is to carry out in the cycle at the specified level of N frame, in the one-period of specified level in the cycle of N+1 frame, utilizes image element circuit 122 to show image, utilizes sensor circuit 124 to detect light.

Next, the filter process to the output that is used for sensor circuit 124 describes.As shown in Figure 1, after a specific sweep trace X (n) was activated, the pixel simulating signal of a row of autobiography sensor circuit 124 outputs was imported into A/D converter 140.An output of A/D converter 140 is used as Digital Image Data and is input to output processing part 150.

The illustrated filter operation of Fig. 7 is an example of device operation of the present invention.Fig. 7 has represented to be used for the parallel level time filtration treatment (rank order filtering process) of 3 * 3 adjacent pixels, comprise and be positioned at position (x, y) object pixel gray-scale value F (x, y) and on direction up and down with the gray-scale value F (x-1 of object pixel adjacent pixels, y-1), F (x, y-1), ... be rearranged according to ascending order or descending at interior 9 gray-scale values (left side of Fig. 7) altogether, and, for example, get the gray-scale value of intergrade time (intermediateorder) or r level new gray-scale value G (x, y) (the right of Fig. 7) as object pixel.Realize that the circuit of above-mentioned processing will explain below.

Fig. 8 represents to handle an example from the circuit arrangement of the output signal of sensor circuit 124.When certain bar sweep trace X (n) activation, the detected light intensity simulating signal of sensor circuit 124 outputs that links to each other with sweep trace X (n) is to A/D converter 140.A/D converter 140 comprises mould/number conversion circuit ADC and corresponds respectively to the delayed-trigger D-FF1 of signal wire.Each mould/number conversion circuit ADC will become digital signal from the analog signal conversion of sensor circuit input.Delayed-trigger D-FF1 gets the output of one-off pattern/number conversion circuit ADC by the time of presetting at each horizontal cycle.

For example, in the present embodiment, each mould/number conversion circuit ADC tackles 1 Bit data, and 1 bit pixel data of each pixel of delegation are offered among the time-delay trigger D-FF1 corresponding one.

Each adder circuit SUM3 is the circuit of an input-output data item summation when three laterally 1 bit of continuous pixels is imported there.Adder circuit SUM3 produces the output corresponding to the input value shown in the truth table of Fig. 9.

The output of each adder circuit SUM3 is imported in the series circuit of three delayed-trigger D-FF2.Delayed-trigger D-FF2 is each horizontal cycle transmits adder circuit SUM3 on preset time output.Three line outputs of adder circuit SUM3 can be kept by three delayed-trigger D-FF2.Two totalizer PL1, PL2 derive the summation of triplex row data item, and the summation of data item is taken among the delayed-trigger D-FF3 at the preset time of each horizontal cycle.

From top description, can understand, the gray-scale value of three layers of horizontal adjacent three pixel, at once and the gray-scale value summation that lists 3 * 3 pixels be taken among the time-delay trigger D-FF3 at each horizontal cycle.

Output from delayed-trigger D-FF3 is imported among the comparator C OM4.Comparator C OM4 is one 4 bit comparator, and it will compare the value of delayed-trigger D-FF3 and the level value r of appointment compares, and closes to tie up among Figure 10 about its I/O to show.The gray-scale value of object pixel can substitute with " 1 " during more than or equal to level value r in the gray-scale value summation of 3 * 3 pixels, can be alternative with " 0 " during less than this level value in summation.

As a result, for example in wave filter 152, (x, y) gray-scale value that has been converted in 3 * 3 adjacent pixels is the gray-scale value of r level maximum or minimum gradation value by ascending order or descending sort again to be illustrated in object pixel gray-scale value F among Fig. 7.That is, it means the parallel level time Filtering Processing of having carried out the r level.When view data is 1 bit, Gx, y is expressed as follows:

Therefore, in wave filter 152, (x y) can substitute with " 1 " during more than or equal to level value r in the summation of adjacent pixel values the gray-scale value F of object pixel; Summation in value can substitute with " 0 " during less than level value r.

The output line of comparator C OMP4 is to be connected to data transport unit 154.Data transport unit 154 comprises a plurality of delayed-trigger D-FF4 that link to each other with respective filter via switch HSW.Delayed-trigger D-FF4 constitutes the output data of serial to outside shift register.

At first, on the preset time at each horizontal cycle, switch HSW is arranged to on-state, and switch TSK is arranged to dissengaged positions, and transmission clock rises (or decline) once in the superincumbent cycle.Therefore, the data item of one-row pixels is retained among the time-delay trigger D-FF4.After this, switch TSK is arranged to on-state, and switch HSW is provided with dissengaged positions, and under this state, in response to transmission clock, data are transmitted successively.

What Figure 11 A represented to 11D is an example that is carried out the result of Filtering Processing by 152 pairs of adjacent 3 * 3 pixels of wave filter.When being illustrated in image among Figure 11 A and being illumination when light pen 700 and so on and being mapped on the array base palte 100 the input coordinate data, outputing to the binary picture data of signal processing part 500, is an image that obtains when not carrying out Filtering Processing.The circular white portion in the image left side is corresponding to the part of light pen 700 indications, and the white line that image the right vertical direction extends is corresponding to the wire flaw that produces owing to mould/number conversion circuit flaw.

In Figure 11 B, 11C and 11D, expression be the result's that do not obtain simultaneously of the level value r of parallel level time wave filter example.Figure 11 B is that the level value is arranged to the result that " 5 " obtain.What it showed is that parallel level time wave filter is the special case that median filter, point-like flaw and wire flaw are compensated.That Figure 11 C is the result that level value r obtains when being configured to " 9 ", and in this case, the part of light pen 700 indications and the white portion of wire flaw have been compressed (compression processing).Figure 11 D is arranged to the result that " 1 " obtains as level value r, and in this case, the part of light pen 700 indications and the wire defect areas of white are expanded (extension process).

As described above, the effect that can reach is: put can being compensated by the level value r that parallel level time filter circuit is set of flaw and line flaw, white portion can be compressed or expand.

The level value r of parallel level time filter circuit can be determined by a signal processing circuit 500 or a circuit on array base palte.Further, level value can be arranged to fix, maybe can be by utilizing circuit control and the dynamically change on signal processing circuit 500 or the array base palte 100.

Because parallel level time filter circuit is formed on the array base palte 100, the cost of signal processing part 500 rises and can be inhibited, and needn't increase its circuit scale.Further, select and use the display device with image read functions that does not have flaw to become there is no need, its fabrication yield has increased.Because parallel level time filter circuit is formed on the array base palte 100, image sensing data can be taken into effectively.

Further, because parallel level time filtering circuit forms at every signal wire, making becomes possibility to the parallel level time Filtering Processing of pixel execution in the delegation.In this case,, can utilize a clock in the horizontal cycle to finish Filtering Processing and do not need high-frequency clock.

Next, explain second embodiment of the present invention.In the circuit shown in Figure 12, parallel level time filter circuit medium filtering circuit (to adjacent 3 * 3 pixels, the level value r of parallel level time filter circuit is configured to the situation of " 5 ") in particular cases is used as wave filter 152.In this case,, can carry out identical computing, but it can be realized by utilizing the circuit arrangement of simplifying by changing the level value r of previously described parallel level time filtering circuit.Figure 12 represents the example of a circuit arrangement.

Have only the circuit pack of wave filter 152 to be different among Fig. 8 among Figure 12.Each ranking circuit SORT3 is one and arranges three input values with ascending order and with the combinational circuit of its output, and each ranking circuit SORT2 is one and arranges two input values with ascending order and with the combinational circuit of its output valve.Ranking circuit SORT3 and ranking circuit SORT2 are in response to importing output signal, shown in the truth table among Figure 13 A and Figure 13 B.

By minimum value, intermediate value and the maximal value output of the value of ranking circuit SORT3 or SORT2 ordering as shown in node S, M and the L.Level Four delayed-trigger D-FF5 reads the minimum gradation value of the triplex row in the three row neighbor gray-scale values, and maximum gradation value in the triplex row is outputed to afterbody.Similarly, delayed-trigger D-FF6 reads triplex row intermediate value gray-scale value in the three row grey scale pixel values, and intermediate value gray-scale value in the triplex row is transported to afterbody; Further, delayed-trigger D-FF7 reads the maximum gradation value of the triplex row in the three row neighbor gray-scale values, and minimum gradation value in the triplex row is outputed to afterbody.

At last, the output of the afterbody of delayed-trigger D-FF5, D-FF6 and D-FF7 is sent to ranking circuit SORT3, and the gray-scale value of intergrade is sent to data transport unit 154.The result is that the grey scale pixel value that near the gray-scale value middle rank value r of 3 * 3 pixels the object pixel is arranged to " 5 " is sent to data transfer unit 154.That is, in wave filter 152, carried out the median filter processing.

The image that is illustrated among Figure 11 B can obtain by carry out filtering operation in the medium filtering circuit.Further, as the situation of having utilized parallel level time filtering circuit, the circuit scale of signal processing part 500 can not increase, and its cost increase also can be inhibited.Further, select not have the display device that has the image read functions of flaw to become and there is no need, its fabrication yield is improved.Further, by on array base palte, forming median filter reading images detection data effectively.

Because median filter is manufactured for every signal wire, utilizing a clock in the horizontal cycle to carry out parallel processing becomes possibility, and does not need high-frequency clock.

Next, the 3rd embodiment of the present invention is described.Figure 14 is an example of present embodiment, and wherein filtering is carried out with serial mode.

In this embodiment, output processing part 150 comprises a number according to transport unit 154, and it is with the data of serial mode output triplex row pixel.The simulating signal of autobiography sensor circuit 124 outputs is converted into Digital Image Data by A/D converter 140, is imported into output processing part 150 then.In output processing part 150, the Digital Image Data that the data translator unit 154 of triplex row sends serially with filtering that output processing part 150 final stages link to each other in carry out Filtering Processing, output to the outside then.

Figure 15 represents is an example of the circuit arrangement when utilizing such as parallel level time wave filter as wave filter 152.Delayed-trigger D-FF4 constitutes a shift register, and it transmits data in response to transmission clock right direction in figure when switch TSK is in on-state.Further, delayed-trigger D-FF8 constitutes a shift register, and during switch HSW was in on-state, it transmitted data in response to transmission clock downward direction in figure.

At first, at preset time, HSW is arranged to on-state with switch in each horizontal cycle, and switch TSK is arranged to dissengaged positions, and in superincumbent cycle length, vertical transmission clock rises (decline) once.As a result, the pixel data of delegation is transmitted and is delayed trigger D-FF8 downwards and stays and hold.Meanwhile, the horizontal transmission clock rises, and once, the pixel data of delegation stays held in the time-delay trigger D-FF4 (or decline).After this, switch TSK enters on-state, and switch HSW enters dissengaged positions, therefore, data in response to the horizontal transmission clock along transmitting to the right among the figure.

That is, the data of triplex row utilize delayed-trigger D-FF4 sequentially to be transmitted in a horizontal cycle.Therefore, the processing of serial is carried out by parallel level time filtering circuit is connected to the delayed-trigger final stage.

As mentioned above, for the circuit arrangement of carrying out filtering operation continuously, the image that is illustrated in after the Filtering Processing of Figure 11 B in the 11D can be by being provided with the level value r acquisition of parallel level time wave filter.Further, except carrying out the same effect that Filtering Processing obtains as shown in Figure 8 concurrently, parallel level time filter circuit is compared with the situation of carrying out parallel processing, and its occupied zone can be done forr a short time, and ifs circuit is configured to carry out serially Filtering Processing.

The view data of triplex row can former state be exported to signal processing part 500 as three signals.In this case, be necessary parallel level time filter circuit is formed in the signal processing part 500.Yet, because do not need line memory, to the almost not influence of cost of circuit scale and signal processing part 500.Further, as the situation of parallel processing, the level value r of parallel level time filter circuit can determine with a signal processing circuit 500 or a circuit on array base palte 100.That level value r can be arranged to fix or can dynamically change.

The median filter circuit illustrates at Figure 16 as the situation of filtering circuit.In this case, also can reach same effect shown in Figure 15.

The present invention is not limited to above-mentioned embodiment, can revise by different way with concrete enforcement not break away from its technical scope.In addition, the numerous assemblies that disclosed by appropriate combination the foregoing description can be made various inventions.For example, can omit some assemblies in all components in the above-mentioned embodiment that discloses.Further, can suitably make up by the assembly that different embodiment disclosed.

Figure 17 is a block diagram of explaining the signal processing part of the light input/non-input that can correctly determine light source.Signal processing part 500 has as according to the coordinate input of the major part of the display device that has optical input function of a specific embodiment of the present invention and the basic configuration of image importation.

In Figure 17, the symbol 10 indications liquid crystal indicator that comprises pixel and optical sensor explained before.Can display image on array base palte and carry out the light input.The signal processing that symbol 500 representatives form with the integrated circuit form, what illustrate is the part block diagram of our department.That is what, illustrate is this one reads output as previously explained from sensor circuit part block diagram.

Vertical synchronizing signal Vsync, horizontal-drive signal Hsync and with synchronizing signal synchronized images data Data from array base palte 100 output.Vertical synchronizing signal Vsync and horizontal-drive signal Hsync are imported in the timing signal generation circuit 501 in the signal processing part 500, and view data Data is imported in the line memory 502.Timing signal generation circuit 501 provides synchronously for line memory 502 with synchronizing signal Hsync and writes/read the address.

The output of line memory 502 is provided for median filter 503 and compression filter 504.The elimination that median filter 503 utilizes preset regions (for example 3 * 3 pixels) data to carry out inessential part on the display screen is handled, and white portion area counting circuit 505 utilizes the output of wave filter to carry out the processing of deriving remaining area.That is, median filter 503 is eliminated data disappearance part based on pixel flaw and the noise that is in preset regions, and its output is imported into white portion area counting circuit 505, the latter and then derivation remaining area area W5 (t).

Compression filter 504 is utilized preset regions data (as 3 * 3 pixels) to carry out compression and is handled, and white portion area counting circuit 506 is derived the area W9 (t) that stays after compression is handled.Further, barycentric coordinates counting circuit 507 can utilize median filter output, area W5 (t) and coordinate information (x, y) derive use up regional centre coordinate (Xg, Yg).

The calculated example of area W is as carrying out more than or equal to the pixel quantity of white level by be verified pixel level in the statistics current region of back in the output valve from the pixel of wave filter.

After the pixel output valve from wave filter was verified, barycentric coordinates Xg can remove accumulated value with area W and obtain, and accumulated value is to obtain by the totalizer X value that adds up, and the value of X is that the coordinate information when being white level from the pixel output valve obtains.

The item of information of expression area W5 (t) and W9 (t) is imported into subtracter 508 and determines circuit 509 with contacting.The information of expression area W5 (t) also is imported into coordinate figure register 510.Can obtain the difference L (t) of area W5 (t) and W9 (t) from subtracter 508.This difference is corresponding to the length of periphery, i.e. the peripheral length of optical receiving region.Peripheral length L (t) is imported into contact and determines circuit 509.

Contact determines whether circuit 509 definite light pens (light source) are in correct input state with display screen.If light pen is in correct state, its exports and offers contact mark of coordinate figure register.

Threshold register that stays the parameter (area reference value W0, departure threshold alpha, time change threshold β and circularity threshold gamma) of holding of symbol 511 expressions from CPU (central processing unit) (CPU) 600.Above-mentioned parameter is input to contact and determines circuit 509.Further, the area information W5 (t-1) that stays held in the former frame of the next-door neighbour in the coordinate figure register 510 also is imported into contact and determines circuit 509.

As will be described, contact determines that circuit 509 utilizes each parameter and input information executable operations to handle, the output contact mark.

Promptly, contact determines that circuit 509 is area W5 (t), W9 (t) and peripheral length L (t) that a utilization obtains carrying out calculation process from the view data of LCD part, and is stored in the area W5 (t-1) of former frame of the next-door neighbour in the coordinate figure register 511 and four parameters of threshold register determine whether light source contacts the circuit of display screen.In addition, this result is written into coordinate figure register 510 as contact mark.

(Xg Yg) also is transfused to coordinate figure register 510 to barycentric coordinates.In addition, the area information W5 (t-1) that stays held in the coordinate figure register 510 next-door neighbour's former frame is imported into contact and determines circuit 509.

The signal processing 500 that forms with the integrated circuit form is the processing integrated circuit such as digital signal processor (DSP) or special IC (ASIC), it derives area information and a contact mark of indicating light source whether to be in contact condition, and contact mark is stored into coordinate figure register 511.

CPU 600 can read the data of coordinate figure register 510 to finish various processing.CPU 600 adjusts the definite computing of contact by register being read or write data.

In this example, suppose that the gray scale from the view data of LCD portion is to be arranged to (the secondary gray scale) of 1 bit.For the situation of many gradation datas, area can be handled with suitable binary processing or intensity-weighted and calculate, but computation process has not here been explained.Peripheral length L (t) calculates by following equation (2).

L(t)＝W ₅(t)-W ₉(t) (2)

Peripheral length L (t) is corresponding to the length of the periphery of optical receiving region.

Next, with reference to Figure 18 A, 18B, 18C explain when light pen 700 near or resulting filtering output and computing output when leaving the viewing area of LCD portion.Shown in Figure 18 C, suppose that light pen 700 priorities and the viewing area of LCD portion are in state (1)-(6).For example, light pen 700 utilizes light emitting diode (LED) as light source.

For example,, that is,, leave the viewing area then when the tip of light pen 700 at first contacts with the viewing area when light pen 700 is in state (1)-(6) as shown in Figure 18 C, and light pen irradiation viewing area 110, image shown in Figure 18 B obtains with the form of view data.

That is, detected white portion changes from state (1) to (6) order under the black background.Under the situation of state (5), white portion is a circle clearly, in preset range of its area.At this moment, if observe the variation of aforesaid area W5 (t), W9 (t) and L (t), the variation of area is shown in Figure 18 A.Under the situation of state (5), whole three factors diminish, and obtain preset area W0 (=230).Therefore, when obtaining above-mentioned value, will export a contact mark.What Figure 18 A showed is typical view data Data, area W5 (t), W9 (t) and peripheral length L (t) time history plot.

More clearly, time proximity and pen 700 residing approximate state that number designation (1) to (6) comes the indicating image data item to obtain have been enclosed.Number designation (1) arrives (6) to (6) corresponding to the state (1) shown in Figure 18 B, the 18C.In (5), nib moves closer to display screen at state (1); In state (6), nib leaves display screen gradually at state (5).

When state (1), optical sensor begins to respond the incident light that pen is sent, and the operative sensor circuit is made response to light and other sensor circuits do not respond, and gets really different in sensor element and sensing circuit.When state (2), response region is at core, and shows the peripheral part and the complicated shape thereof of distributing because of the angle of LED angle radiation.When state (3), the middle body of response region and peripheral part mutually near and connect together.When being similar to above-mentioned state, area W ₅(t) become maximum.When state (4), diminish from the scope of the light of pen 700, the area of response region diminishes, but pen does not also reach the contact condition with display screen.When state (5), pen 700 reaches contact condition, and area W5 (t) becomes minimum value.When state (6), pen 700 some separation have slightly obtained the image that a width of cloth is similar to state (4).After this, occur successively to the opposite process of state (4) with state (1).Just determine only input (terminal being in display screen of nib contacts) when having only state (5) in the drawings and other states are not to import (noncontact).Consequently, can be with following three definite conditions:

First condition is: expression area W ₅(t) with reference value W ₀The departure of the degree of deviation littler than specified threshold value α.In the example of Figure 18 A, when pen is placed in contact condition, area W ₅(t) being maintained at about 230 constant refers to.By (W ₅(t)-W ₀) difference absolute value divided by reference value W ₀Or the value that peripheral length L (t) obtains is as above-mentioned departure.Therefore first condition can be expressed as following equation (3) or (4),

$\frac{|W_5\left(t\right)-{\mathrm{<figure-callout\; id="0"\; label="W"\; filenames="C20051008948600351.png,C20051008948600382.png"\; state="\{\{state\}\}">W</figure-callout>}}_0|}{{\mathrm{<figure-callout\; id="0"\; label="W"\; filenames="C20051008948600351.png,C20051008948600382.png"\; state="\{\{state\}\}">W</figure-callout>}}_0}<\mathrm{\&alpha;}...\left(3\right)$

$\frac{|W_5\left(t\right)-{\mathrm{<figure-callout\; id="0"\; label="W"\; filenames="C20051008948600351.png,C20051008948600382.png"\; state="\{\{state\}\}">W</figure-callout>}}_0|}{L\left(t\right)}<\mathrm{\&alpha;}...\left(4\right)$

Be necessary to have pre-determined reference value W0 by the calibration computing.For example, when using one new, the user is pressed in the terminal maintenance of nib several seconds on the display screen at every turn, the mean value of measuring light receiving area area, and measured value is made as W ₀As selection, because the area in when contact is corresponding to the opening of pen, if as can be known, W ₀Can derive from the area of the opening of pen.Similarly, α can be by sliding it to the nib end, the peaked approximate value of measured deviation amount in above-mentioned sliding time on display screen when being pressed on the display screen.In addition,,, even can be defined as being in contact condition to the state that the nib end leaves display screen slightly, and the state that pen is not being pressed display screen is defined as being in contact condition according to user's hobby by adjusting threshold alpha.

Second condition is: area W ₅(t) amount is littler than an assign thresholds β over time.In the example of Figure 18 A, can understand, when pen keeps in touch state, area W ₅(t) time to time change not basically.With passing through area W ₅(t) detect the area W of frame with next-door neighbour's previous image ₅The absolute value of difference (t-1) is divided by area W ₅(t) or the value that obtains of peripheral length L (t) as amount over time.Therefore, second condition can be passed through equation (5) or (6) expression.

$\frac{|W_5\left(t\right)-W_5(t-1)|}{W_5\left(t\right)}<\mathrm{\&beta;}\&CenterDot;\&CenterDot;\&CenterDot;\left(5\right)$

$\frac{|W_5\left(t\right)-W_5(t-1)|}{L\left(t\right)}<\mathrm{\&beta;}\&CenterDot;\&CenterDot;\&CenterDot;\left(6\right)$

It also is possible pre-determining threshold value beta by the calibration computing.

For example, the maximal value approximate value of time dependent converted quantity is to measure when the user satisfies in first condition (fully near W0) zone when finishing clicking operation with the speed of expectation, and threshold value can utilize these to measure to determine.By adjusting threshold value beta, can click speed be set according to user's hobby.

The 3rd condition is: the roundness ratio specified threshold value γ of optical receiving region is big.In this case, circularity is a scale of expressing a zone " like toroidal ".By using area W ₅(t) with the product of 4 π divided by peripheral length L (t) square or area W ₉(t) with the product of 4 π divided by square value that obtains of peripheral length L (t) as circularity.When the approaching circle in zone, circularity is near " l "; When the zone became complexity, it diminished.

In the example in Figure 18 B, optical receiving region almost becomes circle at contact condition, and becomes complicated under contactless state.

Therefore, the 3rd condition expressed by following equation (7) and (8)

$\frac{4\mathrm{\&pi;}{W}_5\left(t\right)}{L{\left(t\right)}^2}>\mathrm{\&gamma;}...\left(7\right)$

$\frac{4\mathrm{\&pi;}{W}_9\left(t\right)}{L{\left(t\right)}^2}>\mathrm{\&gamma;}...\left(8\right)$

It also is possible pre-determining threshold gamma by the calibration computing.When pen tilted, optical receiving region became ellipse from circle, and circularity diminishes.Therefore the approximate value of minimum roundness value can remain in measurement when tilting in user's normal operating range under the contact condition when the nib end.By adjusting threshold gamma,, determine that pen is in contactless state when pen tilts to a certain degree according to user's hobby.

Figure 19 A, 19B and 19C are displayed map 18A to the curve map of the departure of the data of 18C and reference value, data in time departure and based on the circularity of these data.

Figure 19 A shows is with respect to the absolute value 3A1 of the departure of the radius of reference value W0 area W5 with respect to the absolute value 3A2 of the deviation ratio of reference value W0 area W5.Figure 19 B shows is with respect to absolute value 3A1, the varied radius 3B1 that causes when the radius of area W5 changes in time of the departure of the radius of the area W5 of reference value W0 and the deviation ratio 3B2 of area W5.

That Figure 19 C shows is the circularity 3C1 of the image after median filter is handled and the circularity 3C2 of the image after the compressed filter process.

Figure 20 shows for Figure 19 A to be arranged to 1.8,0.25 and 0.38 and carried out and contact under the situation of determining processing the satisfied fixed condition number really of data respectively to threshold alpha, β and the γ of the data item of 19C.Equation (4) (corresponding to score value " 1 "), equation (6) (corresponding to score value " 2 ") and equation (8) (corresponding to score value " 3 ") are used as definite condition.

Be appreciated that by utilizing this three conditions simultaneously,, can correctly make contact and determine based on the actual moment of being arranged to contact condition of pen.Utilize one or two condition in these three conditions to make contact and determine it is possible, still, as from Figure 19 A to 19C and Figure 20 can know and recognize that strictness is provided with threshold value and prevents wrongly determine it is necessary.Therefore, use these three conditions more desirable simultaneously.

Figure 21 shows is the example that the concrete configuration of circuit 509 is determined in the contact determining contact/noncontact and export contact mark under three kinds of conditions.Circuit 509 is by the clock operation synchronous with field frequency, and produces the contact condition of definite output whether an indication light pen is in to(for) each predefined territory element.

Equation (4), (6) and (8) are used as definite condition, and the item in the equation is done transposition and handled to eliminate dividing circuit.Therefore, import 4 π/γ and come substitution threshold γ.

In Figure 21, a plurality of multipliers, absolute difference circuit and comparer are used as combinational circuit and handle each condition concurrently.But, by shared combinational circuit and handle each condition with pipeline system to reduce circuit scale be possible.

Among Figure 21, multiplier 551 multiply by area W9 (4 π/γ).Multiplied result is retained in the delayed-trigger (D-FF) 552.The output of D-FF 552 is transfused to comparer 553, and with square the making comparisons of peripheral length L (t), just, system carries out the process of equation (8).

The absolute value that absolute difference circuit 554 is derived the difference between W5 (t-1) and the W5 (t).Absolute value is locked among the D-FF 555.The output of D-FF 555 is imported into comparer 556, and makes comparisons with β L (β and peripheral length L multiply each other), and just, system carries out the process of equation (6).

The absolute value that absolute difference circuit 557 is derived the difference between W0 and the W5 (t).Absolute value is locked among the D-FF 558.The output of D-FF 558 is imported into comparer 559, and makes comparisons with α L (α and peripheral length L multiply each other), and just, system carries out the processing of equation (4).

The output of comparer 553,556,559 is transfused to an AND (logical and) circuit 560, and the logic product of derivation is as contact mark.

The system of multiplier 561 and D-FF 562 will derive by the square value with peripheral length L (t).The system of multiplier 563 and D-FF 564 will derive the β L that L (t) and β multiply each other and obtain.The system of multiplier 565 and D-FF 566 will derive the α L that multiplies each other and obtain by with peripheral length L (t) and α.Value α and β can be stored in 511 li of threshold registers among Figure 17.Value α and β can be variables.Therefore, value α and β can be as changing the factor that Sensitivity Index obtains contact mark.

As above describe, the present invention includes a signal processing part, it handles the light transducing signal from a plurality of optical sensing means; Be an arithmetic processing section in this example, it is utilizing light detecting signal to derive the area information of the optical receiving region on the display screen when the rayed of light supply apparatus end is on display screen; With a determination portion, its area information at optical receiving region is to determine that pre-this only imports when determining that parameter is provided with within the scope.

The invention is not restricted to above-mentioned embodiment.In the explanation to Figure 17, when deriving the area information of optical receiving region, its area is to derive with the binary picture data of representing black and white., use that the pictorial data of more gray scales is arranged also is possible.That is, when the view data of optical receiving region is to take from when the image gray data are arranged, gray threshold is arranged on and extracts in the circuit.So, there is the view data of handing over high brightness can be used as the view data of optical receiving region.In addition, gray threshold can be used as variable element.

What illustrate in the A of Figure 22 and B is to utilize as 3 * 3 pixels obtain the method for gray-scale image data as a unit.Each sensor is corresponding to a pixel.The sensitivity of the sensor of each pixel is inequality, and 3 * 3 pixels as a unit, are arranged to magic square to the sensitivity of sensor.Derived 3 * 3 pixels used shown in A among Figure 22 mean value as the binary code data item of a cell block.What show in Figure 22 is nine pieces.The interior mean value of piece is set to the gray-scale value of object pixel.In the B of Figure 22, the gray scale of each pixel is identified and is shown.

Figure 23 shows is an example that reaches the method for accurate light detecting signal when being mapped on the display screen from the light as light pen 700 ends of light source.

As shown in the A of Figure 23, suppose that now light pen 700 is placed to the display screen towards LCD, din-light occurs.In addition, the shape of supposing the light that light pen 700 the sends oval spot state of length on vertically in time has been transformed into the oval spot state of length transversely, shown in the B and C of Figure 23.

The D of Figure 23 explanation be when the time from T1 when T5 is passed, din-light and the partly overlapping situation of a light.As corresponding to time T 1 to picked-up (image sensing) the view data item P1 of T5 to P5, a din-light image and a light image be in overlap condition (time T 1, T3) be in into non-overlapped state (time T 2, T4).In addition, also provide a kind of light of light pen the to close state of (time T 5).That is, a kind of oval spot or the absent variable state of laterally long spot are provided.Therefore, in the present invention, as the denoising device that the sign of operation E in Figure 23 represents, the din-light except that a light can be significantly reduced by deduct the view data that is provided with under the state that oval spot or laterally long oval spot do not occur from the view data that is provided with under the state that oval spot or laterally long oval spot occur.Said process can be carried out many gradation datas as shown in figure 22.

As shown in figure 24, Dolby circuit is equipped between LCD 100 and the line memory 502.Because other parts are identical with the circuit of Figure 17, same section adopts same numeral, and its explanation has also been omitted.The data of obtaining behind noise reduction utilize predetermined threshold value to carry out binary coding, are sent to post processing electric circuit then and carry out above-mentioned processing.

When the present invention is applied on the small-sized mobile phone, can reach significant effect.According to the present invention,, used the LCD that comprises sensor circuit as external input device.The control of sensor circuit and readout device can be simply by showing that special circuit adds a small scale in circuitry and realizes for tradition.Therefore, the present invention can easily be applied to all equipment such as small-sized mobile phone that are used to settle add-on parts if any less white space.The signal-line driving circuit of the LCD of mobile phone is to be made of monolithic IC (hereinafter being called driver IC), and often along with the circuit that is attached on the array base palte uses together.In the present invention, be used for storing by the small-capacity memory (auxilary unit) of the data of light pen input and handle light pen and import the signal processing part 500 of data and be integrated in driver IC.Signal processing part 500 can be implemented as monolithic IC, and disposes suitable with a conventional liquid crystal indicator area basically part area on the LCD panel by it is appended to as drive IC.

Further, the I/O pin of video image can and needn't additionally provide dedicated pin with the time-sharing format use between signal processing part and LCD.The vision signal that signal drive circuit from driver IC provides to the every signal line of array base palte has a blank cycle that presets.Can determine that an agreement is used for during blank cycle the data of light pen input being outputed to signal processing 500.Therefore, it is unnecessary increasing driver IC I/O number of pins, and the cost of driver IC is inhibited.Like this, device of the present invention can be realized on the basis of production procedure of traditional liquid crystal indicator not being changed greatly.Further, the present invention can utilize basically and realize with conventional liquid crystal zone area identical.

Picture position information by light pen or similar devices input is output to the outside from LCD.But image information can directly be sent to the host memory device of signal processing part 500 from auxilary unit.Consequently, the input picture (for example, the regional on the right image of input) that transmits on (demonstration) width of cloth display screen can easily be finished to the image processing operations that shows side (for example left area).

Further, in the present invention, the image information of being imported by light pen or similar devices can be transformed into voltage, and changing the voltage that comes like this can compare with threshold voltage, and the level of a recognition image can be set.In addition, for example, can for example provide a communication function between the CPU at input media (light pen) and central processing department.In this case, be equipped with communication function,, can have reached sensitivity adjustment and handle by communication.Just, can adjust parameter coefficient explained before, as α, β.This is because mobile phone is used in (for example bright place, dark place, indoor or outdoors) in the various environment, needs to adjust the input sensitivity of mobile phone.

The feature of above-mentioned device can be described below.This device comprises the multi-strip scanning line X (n) that is arranged in parallel, many signal line Y (m) with this multi-strip scanning line cross arrangement, be placed in a plurality of pixel portion 122 of the contact site between this multi-strip scanning line and the many signal line, for in the pixel portion of the predetermined number in these many pixel portion 122 each provides one optical sensor part 124 at least, drive the pixel drive part 132 of a plurality of pixel portion 122 by this multi-strip scanning line and many signal line, 134, and the sensor drive portion 136 that drives the optical sensor part, 138.In addition, this device comprises output processor 150, they each all comprise an interpolation filter that is subjected to partly to export, the gray-scale value of the image that obtains from optical sensor is compensated for optical sensor.

Above-mentioned device can be explained as follows.Device comprises arithmetic processing section 501 to 508, they are in the output that is provided with optical sensor and when being mapped on the display screen from the illumination of light source end, utilize light detecting signal to derive the area information of optical receiving region on the display screen, and a determination portion (509), it determines only input at the area of optical receiving region when a parameter preset is provided with in the scope.

Further, above-mentioned device can be explained as follows: this device comprises the multi-strip scanning line that is arranged in parallel, the many signal line of intersecting with this multi-strip scanning line that are arranged in parallel, be arranged in a plurality of display device on a plurality of crossover sites between sweep trace and the signal wire and be arranged in optical sensing means on these a plurality of crossover sites.Further, used the light source that does not send irradiates light from its end.This device is the display device that has optical input function, in the device, utilize these a plurality of display device display image on display screen, the light that is radiated on the display screen by light supply apparatus detects by a plurality of optical sensing means, and based on detected information and input information.

Further, this device comprises light receiving area domain detection device 501 to 508, and they come the optical receiving region on the display screen that light shone of probe source end based on the light detecting signal from a plurality of optical sensing means; Comprise arithmetic unit 557,558 and 559, they are by relatively the area of optical receiving region and the benchmark area value of an appointment calculate the departure of optical receiving region area to reference value; And comprising that contact determines device 565,566,559 and 560, they are determining that to the departure of reference value light supply apparatus is in during display screen contacts during less than the departure threshold value of an appointment.

Device of the present invention comprises light receiving area domain detection device 501 to 508, calculate arithmetic unit 554,555 and 556 that optical receiving region measures over time, and contact definite device 563,564,556 and 560, and contact wherein determines that device determines that when the threshold value of measuring over time less than an appointment of amount over time light supply apparatus is in during display screen contacts.

Further, device of the present invention comprises arithmetic unit 551,552 and 553, the circularity that they calculate optical receiving region based on the area and the peripheral length of optical receiving region; Comprise that contact determines device 561,562,553 and 560, they determine that when the circularity threshold value of roundness ratio appointment is big light supply apparatus is in during display screen contacts.

The present invention is not confined to above-mentioned concrete embodiment, can implement by different way by revising assembly, and not break away from technical scope of the present invention.Further, provide a plurality of assemblies in the embodiment of the above-mentioned announcement of appropriate combination, can make various inventions.For example, can omit some assemblies in all components in the embodiment shown in above-mentioned.Further, in can the appropriate combination different embodiments assembly.

Additional advantage will be that those skilled in the art expect easily with revising.Therefore, the present invention is not subjected to aspect widely to show here and the detail described and the restriction of typical embodiment at it.Therefore, can carry out various modifications, and not deviate from spirit or scope by appended claims and the general design of the determined the present invention of equivalents thereof.

Claims (12)

1. display device with optical input function is characterized in that it comprises:

Many the sweep traces that are arranged in parallel,

Many the signal wires that are arranged in parallel, they and described multi-strip scanning line intersect,

A plurality of pixel portion (122), they are disposed in the cross part office between described multi-strip scanning line and the described many signal line,

A plurality of optical sensor parts (124), they are disposed in the cross part office between described multi-strip scanning line and the described many signal line,

Pixel drive section (132,134) is used for driving described a plurality of pixel portion (122) via described multi-strip scanning line and described many signal line,

Sensor drive portion (136,138) is used to drive described optical sensor part, and

Arithmetic processing section (501-508), when the light from the light source tip was mapped on the display screen, described arithmetic processing section was provided with the output of described optical sensor part, and utilizes photoreceptor signal, derives the area information of optical receiving region on the described display screen, and

Determination portion (509) when being used for area information at described optical receiving region and falling into parameter preset scope is set, determines that described light imports.

2. the display device with optical input function as claimed in claim 1 is characterized in that, described determination portion (509) comprising:

Arithmetic unit (557,558,559) is used for specifying the area reference value to compare the area information and of described optical receiving region, and calculates its departure to described reference value; And

Device (565,566,559,560) is determined in contact, is used for to the departure of described reference value during less than the departure threshold value of an appointment, determines that described light supply apparatus is set as with described display screen to contact.

3. the display device with optical input function as claimed in claim 1 is characterized in that, described determination portion (509) comprising:

Arithmetic unit (554,555,556) is used to calculate the area departure in time of described optical receiving region; And

Device (563,564,556,560) is determined in contact, is used in time departure during less than the threshold value of the departure in time of an appointment, determines that described light supply apparatus is set as with display screen to contact.

4. the display device with optical input function as claimed in claim 1 is characterized in that, described determination portion (509) comprising:

Arithmetic unit (551,552,553) is used for area and girth based on described optical receiving region, calculates the regional circularity of described optical receiving region; And

Device (561,562,553,560) is determined in contact, is used in described circularity during greater than the circularity threshold value of an appointment, determines that described light supply apparatus is set as with display screen to contact.

5. the display device with optical input function as claimed in claim 1, it is characterized in that, the area information of described optical receiving region is a plurality of items of information, it comprises the output that utilizes median filter (503) and first area information that obtains, the second area information that obtains with the output that utilizes compression filter (504), described parameter comprises the square value of the girth of deriving based on the difference between the described first and second area information items, and multiply by described girth and the product value that obtains with variation coefficient.

6. the display device with optical input function as claimed in claim 2 is characterized in that, described area reference value is based on the area of opening portion at the tip of described light source and sets.

7. the display device with optical input function as claimed in claim 2 is characterized in that, also comprises the calibrating installation that is used for calculating in advance and storing described area reference value.

8. the display device with optical input function as claimed in claim 2 is characterized in that, also comprises the calibrating installation that is used for calculating in advance and storing described departure threshold value.

9. the display device with optical input function as claimed in claim 3 is characterized in that, also comprises the calibrating installation of the threshold value that is used for calculating in advance and store described departure in time.

10. the display device with optical input function as claimed in claim 4 is characterized in that, also comprises the calibrating installation that is used for calculating in advance and storing described circularity threshold value.

11. the display device with optical input function is characterized in that, comprising:

Many the sweep traces that are arranged in parallel,

Many signal line, they are aligned to described multi-strip scanning line and intersect,

A plurality of pixel portion (122), they are disposed in the cross part office between described multi-strip scanning line and the described many signal line,

Optical sensor part (124) wherein provides a described optical sensor part at least for each of the pixel portion (122) of predetermined quantity in described a plurality of pixel portion,

Pixel drive section (132,134) is used for driving described a plurality of pixel portion (122) via described multi-strip scanning line and described many signal line,

Sensor drive portion (136,138) is used to drive described optical sensor part,

The output processing part (150) that comprises an interpolation filter, described interpolation filter are provided with the output of described optical sensor part, and the gradation of image value that partly obtains from described optical sensor is compensated,

Arithmetic processing section (501-508) is when the light from the light source tip is mapped on the display screen, and described arithmetic processing section is provided with the output of described output processing part, and utilizes photoreceptor signal, derives the area information of optical receiving region on the described display screen, and

Determination portion (509) when being used for area information at described optical receiving region and falling into parameter preset scope is set, determines that described light imports.

12. the display device that has optical input function as claimed in claim 11, it is characterized in that, comprise that also the photoreceptor signal according to described optical sensor part generates the A/D converter (140) of Digital Image Data, described interpolation filter is provided with the output of described A/D converter (140) and is carried out a filter process, so that by ascending order or descending, rearrange with described pixel portion (122) in a gray-scale value that presets pixel portion and near the corresponding Digital Image Data item of at least one pixel portion (122) thereof, and the gray-scale value with designated order is set to the described gray-scale value that presets pixel portion (122), described determination portion (509) comprises at least with lower device (a), (b) at least one and (c)

(a) be used for the area information of described optical receiving region and the area reference value of appointment are made comparisons, and calculate its arithmetic unit (557,558,559) to the departure of described reference value, determine device (565,566,559,560) with being used for when the departure of described reference value being determined described light supply apparatus is set as with contacted contact of described display screen during less than the departure threshold value of appointment

(b) be used to calculate the arithmetic unit (554,555,556) that the area of described optical receiving region is measured over time, with be used for determining that described light supply apparatus is set as with contacted contact of described display screen when the described threshold value of measuring over time less than the amount over time of appointment and determine device (563,564,556,560)

(c) be used for the arithmetic unit (551,552,553) of the circularity that area and girth based on described optical receiving region calculate described optical receiving region, and be used for determining when described circularity that described light supply apparatus is set as with contacted contact of described display screen during greater than the circularity threshold value of appointment and determine device (561,562,553,560).

Images