WO1996010883A1

WO1996010883A1 - Compact thermal camera

Info

Publication number: WO1996010883A1
Application number: PCT/US1995/012494
Authority: WO
Inventors: Roland Andrew Wood; David Kubisiak; Thomas Michael Rezachek
Original assignee: Honeywell Inc.
Priority date: 1994-09-30
Filing date: 1995-09-28
Publication date: 1996-04-11
Also published as: IL115332A0; US5675149A

Abstract

A low-cost portable handheld still-frame thermal camera for capture of digital thermographic infrared images, having a lens assembly, a slideable linear array of uncooled 8-12νm thermal IR sensor, a slider actuation mechanism, and associated digital processing capability for calibrating and displaying and storing images captured by the camera. The sensors are thermoelectric sensors. The lens passes infrared radiation, the array is contained in an evacuated chamber, and operates at room temperature. The thermographic images may be displayed immediately or remotely or may be printed by conventional techniques.

Description

COMPACT THERMAL CAMERA

FIELD OF THE INVENTION The present invention relates to the field of photography, and in particular, to a device for digital electronic capture and processing of images in a scene emitting in the infrared (IR) region of the electromagnetic spectrum. In particular, the present invention teaches attainment of an extremely low-cost camera suitable for still-frame "instant" 8- 12um infrared (IR) photography.

BACKGROUND OF THE INVENTION Cryogenically cooled 8-12um IR cameras are commercially available, typically producing video imagery at about 30 frames per second with a scene thermal resolution of about 0.1 degrees Celsius. The 30Hz framerate is typically chosen in order to allow imagery of moving targets. These IR cameras are however too costly and heavy for many applications. Recent advances in thermal IR sensors capable of operating at room temperature have been made, exemplified by International patent application PCT/US93/05740 [T10-14288-US] (R A Wood), owned by the same assignee as the present invention and hereby incorporated by reference herein. This application teaches IR imaging techniques which use two dimensional arrays of bolometers to be demonstrated which can record IR images at video framerates of about 30Hz. These arrays of bolometers may allow lower-cost and more-compact 8-12um IR cameras to be developed in the future, again producing video imagery at about 30 frames per second with 0.1C resolution. At this time however, no 8-12um IR camera exists which is analogous to the widespread hand-held still-frame cameras used in visible

"instant" photography, i.e. a low-cost, compact, hand-held, room-temperature IR camera capable of recording still-frame IR imagery of stationary or slow-moving targets, and displaying the image to the operator with negligible delay.

A compact pushbroom IR camera using a linear thermal array was described by Wilson et al. Proc IRIS DSG Boulder, CO, August 1991. This camera contained no moving parts or digital processor. This camera was unable to produce two dimensional IR images of stationary objects except by panning the entire camera, a mode of operation unsuitable for hand-held operation. No radiometric calibration was provided in the Wilson camera.

SUMMARY OF THE INVENTION A low-cost compact hand-held uncooled IR camera suitable for recording and displaying still-frame 8-12um IR images of stationary or slow- moving targets with a sensitivity of about 0.1C. The camera uses a linear array of room temperature thermal IR sensors contained in an evacuated chamber, moved across the focal plane of a suitable IR-transmitting lens in an interval of about 1 second, by an actuator mechanism. The camera contains means for calibrating, recording and displaying the still-frame IR images with negligible time delay. The images are accurately calibrated, to show the temperature of any part of the target scene as determined by the emitted IR radiation. The images are electronically stored within the camera for later display or hard-copy printout using conventional display equipment. BRIEF DESCRIPTION OF THE DRAWINGS

Figure 1 is a perspective view depicting the main sub-components of the present invention.

Figure 2 is a simplified functional diagram, depicting the IR radiation sensitive subassembly coupled to schematically-drawn electrical components.

Figure 3 is a schematic of the camera electronics.

DESCRIPTION OF THE PREFERRED EMBODIMENT Referring to Fig.1, the camera assembly 50 of the present invention has few major subcomponents: a housing 43 supporting an IR transmitting lens 42 and field-of-view indicating device 48, sliding electronics board 41 holding the IR sensors, and a stationary electronics board 40. The sliding board slides on rails 44, with motion actuated by a stepper motor and lead screw 46. One or more linear arrays 10 of IR sensors are 11 are enclosed in the package 12, which is fitted with electrical leads 14 and IR transparent window 16. The slider motion is in a direction perpendicular to the line of the sensors 11 , and perpendicular to the optical axis of the lens 42. Each individual thermal IR sensor 11 employed in the preferred embodiment is a mosaic of four thermoelectric (TE) sensors, as described by U.S. patent 5,220,189 (Higashi and Johnson) and International patent application PCT/US94/13002 both assigned to the same assignee as the present invention and incorporated herein by reference. [T10 14139-US (Wood, Higashi and Rhodes)]. The sensor package is preferably evacuated, or filled with gas 18 having low thermal conductivity (e.g. Xenon). The TE sensors 11 respond to incident IR radiation (denoted by arrows 22) to produce electrical output signals indicative of the IR radiation impacting each discrete TE sensor 11 , as is known and understood in the art in the light of Higashi and Johnson and Wood et al cited above. The individual TE sensors 11 are sensitive to a wide range of IR radiation wavelengths, from the shortest IR wavelengths (about 1um) to wavelengths approaching the side dimensions of the individual TE sensors (tens of urn). The long wavelength limit may be extended by the use of planar micro antennas which capture longer wavelengths, as known and understood in the light of U.S. patent 4,654,622 to Wood et al., commonly assigned as the present invention and also incorporated herein by reference.

In the present embodiment the range of sensitive wavelengths is limited to those wavelengths effectively transmitted by the lens 42 and package window 16. Although those skilled in the art recognize that improved transmission coatings will increase the effective wavelengths in the future in the current embodiment, the lens is a 2" focal length germanium lens 42, with anti reflection coatings to efficiently transmit 8 to 12um wavelengths. The package window 16 is germanium, also with anti reflective coating to efficiently transmit 8 to 12um wavelengths. The electrical signals from the individual TE sensors 11 are fed to an array of integrating preamplifiers 26 and to one or more A/D converters 32. Multiplexers 28 may be interposed before or after the preamplifiers to allow the number of preamplifiers to be less than the number of TE sensors 11 in the array 10, in order to allow a tradeoff between component count, package pin count, and camera sensitivity, if so desired. In the present embodiment, twelve

8:1 multiplexers 28 are placed within the sensor package, between the 96-pixel array 10 and twelve preamplifiers 26, and a 16:1 multiplexer 53 is placed between the twelve preamplifiers 26 and a single A/D converter 32. Two of the 16:1 multiplexer input lines 35 are used to allow signals from thermistors 31 to be periodically sampled by the A/D converter 32. The A/D converters 32 have a least-significant-bit of sufficiently small size that negligible quantisation noise is introduced. The range of the A/D converters 32 are selected to allow calibration of images having both very hot and very cold targets present within the same scene. A 16-bit A/D is used in the present embodiment.

In the present embodiment, sensor signals are amplified and integrated, multiplexed and digitized using components mounted on the sliding circuit board, so that low-level sensor signals have short wiring distances, and the flexible cable carries a digital signal which cannot be corrupted by noise. If desired, to reduce the number of components required to be moved by the slider mechanism, analog sensor signals may be passed along the flexible cable, provided care is taken to ensure added electrical noise is negligible. Analog temperature signals from thermistors 31 or thermocouples or other suitable electronic sensors are sampled by the A/D converters 32 as commanded by the digital processor 36. This makes the temperature of selected subassemblies available to the digital processor 36, as required for accurate radiometric calibration of the digitized sensor signals. In the present embodiment, the temperature of one sub-assembly is measured, that of a

"reference" plate 51 of known emissivity, providing IR radiation to the sensor array at selected times. In the present embodiment, the reference plate is a stationary plate placed to one side of the lens 42 optical axis, between the lens 42 and the Ge window 16, providing calibrating thermal radiation to the sensor array 10 during the first part of its sliding motion. If desired the temperature of the reference plate 51 may be stabilized, to allow easier camera calibration. If desired, the temperature of the array may be measured instead of that of the reference plate.

The digitized signals from the A/D converters 32, and control signals from the digital processor 36, are carried on a flexible line 34 between the stationary board 40 and moving board 41. The digital processor 36 accesses memory 38, containing control programs, calibration files, and allowing image storage. Under program direction, the digital processor 36 controls the array scan mechanism 46, multiplexers 28,53, integrating preamplifiers 12 and A/D converters 32. For lowest electrical switching noise the multiplexers 28,53 may be scanned in a Gray code sequence, and digital transitions timed to occur during intervals when the integrating preamplifiers 26 are not integrating.

In the present camera, a stepper motor and lead screw 66 is used to provide the sliding action, allowing precise and repeatable slider motion under control of the digital processor without need to measure slider position. Other means of providing mechanical slider actuation mechanisms are well known, and may be used.

The electrical signals from the TE sensors 11 are closely linear with incident radiation power, and similar in magnitude, and lens 42 transmission is fairly uniform, so that good quality images are obtained in the present camera embodiment by direct representation of sensor signal amplitudes on a display device, with no sensor signal correction apart from offset compensation. However, for accurate radiometric applications, the signal amplitudes may be digitally corrected before display, to allow the radiometric temperature of the scene to be accurately determined and represented by different image brightness or colors. In the present embodiment this correction is accomplished with the digital processor 36, for each individual pixel 11 , for each slider position, by storing digital calibration data in camera memory 38. Camera calibration constants are determined by holding a plate (not shown) of known emissivity, at a range of different known temperatures over the desired target temperature range, before the lens 42 whilst operating the camera: during this calibration the digital processor 36 is programmed to use the sensor signals so obtained to calculate the required sensor calibration constants and store them in camera memory 38 for retrieval at any desired later times. Sensor signals obtained during the initial part of the sliding motion (when the sensors receive radiation from a reference plate 51 of known temperature) are used to remove global and pixel-to-pixel offsets caused by dc drifts in the electronics. A schematic of the electronics is shown in figure 3. When imaging scenes with wide temperature range, the digital processor 36 may be programmed to automatically scale the pixel signals to lie within the brightness and color values displayable on the display device used by the operator. For the digital correction and display of radiometrically accurate images, an assumed emissivity of the target may be entered into the digital processor if desired, using a data link port 39 or push buttons 55 on the camera.

The processor 36 supplies and receives serial or parallel digital data via a conventional port 39, for communication of image data and programs with external devices as desired. If desired, an insertable and removable memory device 54 (e.g. a memory card) may be incorporated in the camera, to allow storage, loading and unloading of images or programs.

If desired, a compact display device 47 may be incorporated in the camera to allow the operator to immediately view the IR image. Operator pushbuttons 55 may allow any part of the IR image to be selected with a cursor, and the digital processor 36 programmed to display calibrated scene temperatures from the selected region of the image. Digital or alphanumeric image information may be readily superimposed upon the display 52 for immediate viewing by the operator, as is known in the display art. The time required to acquire one image is about 1 second. The angular resolution of the camera is made adequate to allow useful resolution of image detail, but intentionally lower resolution than conventional cameras, so that hand held operation is possible with a one second image capture time, without camera shake degrading the image quality noticeably. In the present camera, the angular resolution is set by the 150um pixel size and the 5cm focal length lens 42, giving an angular resolution of 3 milliradians, about ten times worse than that of the human eye. To produce more pleasing image quality with a low-resolution image, the digital processor 36 may be programmed to automatically insert image pixels in each row and column between sensor data pixels, the inserted image pixels having values generally midway between sensor data pixel values. PC17US95/ 12494

- 7 -

If desired, successive images obtained from the camera may be subtracted by the digital processor 36, so that motion within the field of view may be readily detected, as desirable for perimeter surveillance applications. In a surveillance mode of operation, the slider is activated continuously, so that the scene is imaged about once every second. Successive images are digitally subtracted on a pixel-by-pixel basis, so that pixels viewing stationary objects are reduced to about the electronic noise level of the camera. Pixels viewing an object which moves, however, produce signals well above the noise level, and may be detected automatically with simple algorithms. If desired, successive images may also be averaged, to produce an image of the scene with enhanced sensitivity, allowing the exact position of any moving object to be readily determined by reference to the stationary objects in the scene.

All sub components of the camera are compact and light and robust, to allow easy transport and hand-held use of the camera. Operation is similar to a conventional still-frame camera: the camera is aimed at the scene, the focus of the lens 42 is adjusted for the proper range, and the camera is held steadily for a period of about 1 second, after which the image is displayed with negligible delay. The operator can immediately inspect images and determine the scene radiometric information. Images may be stored in camera memory 38, or removed by a removable memory device 54, or transmitted to other devices via a data link 39.

Aiming of the camera at the scene may be aided by a simple optical field-of-view indicator 48, as commonly used on photographic still-frame cameras. Focusing of the lens may be aided by conventional range finders or distance measurement devices and a calibrated focusing scale on the lens 42, as well known in still-frame photographic cameras. Alternatively, the sensor array 10 may commanded to slide to the center of the field of view, and a linescan displayed on the display 54, allowing the lens 42 to be focused to attain maximum sharpness of the features on the linescan.

During the [approximately 1 second] interval in which the camera is held steady, the digital processor 36 commands the slider mechanism 46 to slide the moveable board 41 across the focal plane of the lens 42 at a controlled rate whilst sensor signals are digitized by the digital processor 36 and stored in memory 38. For each lateral slide movement of the array 10 by a distance equal to the pixel width, the electrical signal from each pixel 11 in the array 10 is measured and stored. If desired, slower slide velocities, or multiple scans of any desired region of the scene, can be employed to allow sensitivity improvement by multiple measurement and averaging of sensor signals: in this case, a stable platform for example, a tripod mounting of the camera may be required, analogous to long exposures of visible photographic still-frame cameras. For hand-held use, scan times of not more than about 1 second are desirable, to ensure negligible image distortion caused typically by operator movement or camera shake.

The image acquisition time of 1 second is required using a single linear array of presently available sensors, if an image sensitivity of about 0.1C and an image scan of about 96 pixels is required, because presently available TE sensors with the required sensitivity have a thermal response time of about 10 milliseconds. Thus it is necessary to allow a time of about 96x10=960msec to acquire the image. If desired, as shown in Figure 3, several parallel linear arrays 7 and 9, depicted by parallel dashed lines, of sensors, disposed on the sliding electronics board 41 , may be employed rather than a single array, allowing approximately proportionately faster image acquisition times, with the penalty of added complexity and cost. If viewing scenes where reduced sensitivity is acceptable, TE sensors with faster thermal response times may be chosen, allowing approximately proportionately faster image acquisition times. Linear arrays 7 and 9 are each moved by half the width of the image area 8, defined by the rectangular solid line in figure 3.

If desired, the slider mechanism 46 may move the array 10 to the optical axis of the lens 42 and halted, allowing the camera to be used to obtain IR images of objects moving through the field of view. Examples of this are 1) IR imagery of ground targets obtained from a moving aircraft 2) IR imagery of objects moving on a conveyor belt. In the present embodiment, camera power is obtained from a small battery pack 56. For optimum battery life and lowest electrical pickup noise, individual electrical sub components are powered down during intervals when their individual function is not required. For example, electrical power is only supplied to the stepper motor 46, preamplifiers 26, A/D converters 32, digital processor 36, memory 38,54, port 39 and display 52 during those intervals when their individual respective function is required.

While various components and parts may be interchanged as taught in the preferred embodiments of the invention herein described, those skilled in the art recognize instantiations coming within the spirit and scope of the invention, as defined in the appended claims to which this patent is directed.

Claims

CLAIMS We claim

1. A hand-held still-frame camera for capturing images representative of the infrared thermal signature of a scene in the 8-12um wavelength band, comprising: a housing; a lens for focusing IR radiation from a scene at an image plane of the lens; field-of-view indicating means; a slideable linear sensor array disposed at the image plane of the lens; sliding circuit board and slider means for moving and holding the linear sensor array; a plurality of integrators, multiplexers, and A D converters coupled to the sensor array; and, a stationary circuit board electrically coupled to the sliding board by a flexible cable, and further comprising: a processor means, having associated memory storage, for control of camera operations and the calibration of thermal images with negligible delay.

2. The camera of claim 1 , wherein the lens is tuned to maximize reception of 8-12 micron wavelength bands of radiation at the image plane of the lens.

3. The camera of claim 1 , further comprising a platform means for mounted operation of the camera, and for repeated scan or slow-scan operation of the camera, and signal averaging by the processor means for improved sensitivity to received radiation in the repeated scan or slow-scan operations.

4. The camera of claim 1 , further comprising a reference plate means, having known emissivity and a pre-measured temperature, for providing thermal radiation to the sensors at selected times and allowing offset correction of the received sensor signals.

5. The camera of claim 1 , further comprising a sensor means for measuring the temperature of the sensor linear array and communicating with the processor means so that correction for temperature-induced calibration changes in the IR sensor signals may be processed.

6. The camera of claim 1 , further comprising a display means for allowing immediate or delayed operator viewing of thermal images and also for providing immediate or delayed radiometric measurement from any part of the received image.

7. The camera of claim 1 , further comprising a removable memory means for the storage and retention of IR images by an operator.

8. The camera of claim 1 , further comprising a focusing aid further comprising: a linescan display means for assisting the adjustment of the lens for optimum image sharpness.

9. The camera of claim 1 , wherein the processor means is programmed for the subtraction of alternate received image frames so that motion of elements of successive thermal images may be detected.

10. The camera of claim 1 , wherein each said individual electrical sub components reduce their consumption of electrical power when their respective individual function(s) are not required so that to associated electrical power sources are conserved.

11. The camera of claim 1 , wherein the slideable linear sensor array is halted so that images of objects moving through the field of view are stored.

12. The camera of claim 1 , further comprising a data port means for allowing digital data to be passed to and from the camera and external devices.

13. The camera of claim 1 , wherein the multiplexers switched in a Gray code sequence, and digital signals timed to occur when said integrating preamplifier are not integrating allowing low electrical switching noise.