CA2151158A1 - Autonomous prioritized image transmission - Google Patents
Autonomous prioritized image transmissionInfo
- Publication number
- CA2151158A1 CA2151158A1 CA002151158A CA2151158A CA2151158A1 CA 2151158 A1 CA2151158 A1 CA 2151158A1 CA 002151158 A CA002151158 A CA 002151158A CA 2151158 A CA2151158 A CA 2151158A CA 2151158 A1 CA2151158 A1 CA 2151158A1
- Authority
- CA
- Canada
- Prior art keywords
- target
- interest
- adjacent area
- camera system
- digital signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S3/00—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received
- G01S3/78—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received using electromagnetic waves other than radio waves
- G01S3/782—Systems for determining direction or deviation from predetermined direction
- G01S3/785—Systems for determining direction or deviation from predetermined direction using adjustment of orientation of directivity characteristics of a detector or detector system to give a desired condition of signal derived from that detector or detector system
- G01S3/786—Systems for determining direction or deviation from predetermined direction using adjustment of orientation of directivity characteristics of a detector or detector system to give a desired condition of signal derived from that detector or detector system the desired condition being maintained automatically
- G01S3/7864—T.V. type tracking systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/25—Fusion techniques
- G06F18/254—Fusion techniques of classification results, e.g. of results related to same input data
- G06F18/256—Fusion techniques of classification results, e.g. of results related to same input data of results relating to different input data, e.g. multimodal recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/255—Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
- G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
- G06V10/809—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level of classification results, e.g. where the classifiers operate on the same input data
- G06V10/811—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level of classification results, e.g. where the classifiers operate on the same input data the classifiers operating on different input data, e.g. multi-modal recognition
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
- G08B13/19608—Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19665—Details related to the storage of video surveillance data
- G08B13/19667—Details realated to data compression, encryption or encoding, e.g. resolution modes for reducing data volume to lower transmission bandwidth or memory requirements
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19695—Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Abstract
An image transmission system and method automatically to reduce the size of digital data signals transmitted from visual sensors. The system and method are completely automated and (a) use a plurality of sensors to detect targets in an area of interest, (b) direct a camera to place a target in the camera's field of view, (c) provide a digitized visual image in which the target is identified in a target box, and (d) automatically compress (or otherwise reduce the size of) a digital signal for nontarget portions of the visual image.
Description
H5955, RF122 AUTONOMOUS PRIORITIZED IMAGE TRANSMISSION
The present invention relates video tr~n~mi~ion systems, and in which video information is automatically selected for tr~n.cmi~ion.
Many automated security and observation systems include video cameras that view an area 5 of interest. Information from the video camera may be provided real-time via conventional television communication links to a display for monitoring by a human observer, and for storage on tape that may be replayed later. The human observer can identify potential targets (a "target"
being any subject that is desirably detected by the system) and manually train the camera for closer observation. In one such system, the railroad car identification system is disclosed in U.S.
10 Patent Specification No. 4,876,597.
In some situations, conventional television communications links for transmitting video information are not adequate. For example, it may be desirable to send video data via a radio transmission system with a bandwidth too narrow to accommodate the desired tr~n~mi~.~ion speeds (e.g., high frequency (HF) radio bandwidth is too narrow for conventional real-time 15 television signals.) One solution to this problem is to transmit less information by elimin~ting some of the video data. As disclosed in U.S. Patent Specification No. 5,128,776, an operator may selectively designate important portions of the video data to be transmitted with no or visually lossless compression, and other less significant portions of the data with higher compression.
However, human observers are still needed to identify the important portions of the data and the 20 camera field of view.
Where portions of a video image appear con~i~t~ntly and are of predetermined appearance and aspect, such as in a video telephone that displays a human head facing the camera, a processor may locate this predetermined portion of the video image. When the head has been located and a boundary for the video data representing the head has been identified, the processor may reduce the amount of video data being transmitted by reducing the amount of data transmitted for portions outside the boundary relative to portions inside the boundary. (See the specification of S U.S. Patent No. 4,951,140.) However, such a system will only detect targets having the predetermined appearance and aspect.
Movement may also be used to reduce the amount of image data being transmitted. That is, it is known to use moving object detectors to identify movement by comparing sequential video images. Assuming that the moving portions are of interest, the amount of data for portions 10 ofthe video image that are stationary may be reduced. (See the specification ofthe U.S. Patent No. 4,692,806.) In such systems, the moving object detector "tracks" the moving object (in other words, the least compressed portion of image data moves with the moving object). As is al~l)ar~lll, however, image data for an important portion of the image that may not be moving, or that is not moving enough to trigger the moving object detector, may be compressed; for 15 example, important image data for a target may be inadvertently compressed when the target is headed directly for the camera.
An object of the present invention to provide an image tr~n~mi.csion system and method of transmitting images and to provide a method and video image compression system that automatically detects a target in an area of interest and transmits a digital video image of the 20 target in which nontarget information in the area of interest is automatically compressed before tr~n~m1~10n.
The present invention includes a video image compression system for automatically - 215115~
H5955, RF122 detecting a target in an area of interest and transmitting a digital image of the target wherein a digital image of nonl~g~l information in the area of interest is automatically reduced in size before tr~n~mi~ion thereof comprising a target detector for searching an area of interest, said target detector detecting at least one of an acoustic, seismic, infrared, electromagnetic, trip-wire, S and visual signal related to potential targets, a system controller for evaluating whether a signal from potential targets detected by said target detector is related to a target, said system controller comprising, i) means for evaluating signals from potential targets to determine whether such signals identify a target, ii) means for determinin~ a direction to an identified target, iii) means for using the determined direction to establish a target box within which the identified target is 10 located, and iv) means for following target movement and retaining the target in said target box, a camera system that receives comm~nd~ from said system controller for moving said camera system to said target box so that said camera system has said target box in a field of view, said camera system including, a) means for automatically adjusting the field of view and focus of said camera system so that an image of said target box and a portion of an adjacent area of interest can 15 be generated by said camera system, and b) means for generating a digital signal representing said target box and said adjacent area of interest, said system controller further comprising, c) means for reducing the size of said digital signal of the adjacent area of interest that is to be transmitted, d) means for providing instructions for moving said camera system as said target box moves so that said target box is m~int~ined in said camera system field of view, and e) means for 20 designating a new adjacent area of interest uncovered by movement of said target box for tr~n~mi~ion; and means for tr~n~milting on a radio frequency said digital signal of said ta~get box and said reduced size digital signal of said adjacent area of interest.
-H5955, RF122 The invention also includes a method of automatically detecting a target in an area of interest and transmitting a digital image of the target wherein a digital image of nontarget information in the area of interest is reduced in size before tr~n~mi.~ion thereof, the method comprising the steps of:
a) searching an area of interest with an automated target detector, the target detector detecting at least one of an acoustic, seismic, infrared, electromagnetic, trip-wire, and visual signal related to a potential target;
b) upon detection of signal related to a potential target by the target detector, evaluating the detected signal in a system controller to determine whether the potential target is 10 atarget;
c) upon d~L~" ~ tion that the potential target is a target, determining in the system controller a direction to the target;
d) the system controller using the determined direction to establish a target box within which the target is located and thereafter retained by following target movement;
e) providing a signal from the system controller to a camera system for moving the camera system so that the camera system has the target box in its field of view;
f) automatically adjusting the field of view and focus of the camera system so that an image of the target box and a portion of the adjacent area of interest may be generated by the camera system;
g) generating a digital signal of the image of the target box and adjacent area of interest with the camera system;
h) reducing the size of the digital signal of the adjacent area of interest;
H5955, RF122 i) tr~n~mitting the digital signal of the target box and the reduced size signal of the adjacent area of interest;
j) providing signals from the system controller for moving the field of view of the camera system as the target box moves so that the target box is m~int~ined in the camera system S field of view; and k) tr~n~mitting the digital signal of a new adjacent area of interest uncovered by the movement of the target box.
The invention will now be described, by way of example, with reference to the accompanying drawings in which:
Figure 1 is a block diagram of an embodiment of the video image k~n~mi~sion system.
Figures 2a-2d are a series of images illustrating the sequence of operation.
Figure 3 is a block diagram of a preferred embodiment of the present invention.
In the system and method of the present invention, the size of digital data signals transmitted from visual sensors are automatically reduced. The system and method are desirably 15 completely automated and (a) use a plurality of sensors to detect targets in an area of interest, (b) direct a camera to place a target in the camera's field of view, (c) provide a digitized visual image in which the target is identified in a target box, (d) automatically compress (or otherwise reduce the size of) a digital signal for nontarget portions of the visual image, and (e) transmit background image data only once (i.e., once background data is sent, it is not re-sent unless a new camera field 20 of view is required).
With reference to Figure 1 and to Figures 2a-2d, the present invention includes a target detector 12 for locating potential targets PT, m in an area of interest Al (Figure 2a). The target _ H5955, RF122 detector 12 may include at least one, and desirably several, sensors 12, n for detecting and providing a direction to potential targets. For example, the sensors may be acoustic, seismic, infrared, electromagnetic, trip-wire, visual, and the like.
Information from the target detector 12 is provided to a system controller 14 for 5 evaluation. The system controller 14 determines whether a potential target PTi is a target T based on all information available to it. The system controller 14 evaluates and correlates information from the sensors to screen potential targets PT, m in an area of interest Al.
If a target T is identified, the system controller 14 determines the location of the target T
relative to a video camera 16 and provides comm~n(l~ to the video camera 16 so that the target 10 T is placed in the field of view A2 (Figure 2b) of the video camera 16. To this end, the system controller 14 may determine a bearing and azimuth of the target and define a target box B in which the target is located. A target box B may take any shape and size and need not be a square as illustrated in the figures. For example, target box B may be the periphery of the target T. The system controller 14 coordinates movement of the video camera 16 to place the target box B in 15 the video camera's field of view A2.
The video camera 16 is automatically adjusted so that its field of view and focus provide a useable view A3 of the target box B, such as illustrated in Figure 2c. Desirably the view A3 includes, in addition to the target box B, some of the area of interest A, adjacent the target box B to provide a view of the environment arourld the target T. This result may also be achieved by 20 enlarging the area around the target T that is encompassed by the target box B. The video camera 16 generates a signal representing the image A3 that may be digital or converted to digital in an analog-to-digital converter 18. The system controller 14 may use the digital signals from the A/D
H5955, RF122 converter 18 (or signals directly from the video camera) to coordinate movement of the video camera 16 to place the target box B in its field of view.
The digital signals are provided from the system controller 14 to a data reduction unit 20 that operates under the control of the system controller to reduce the amount of data representing 5 the image A3 that will be forwarded to a radio frequency transmitter 22 or other narrow band communications systems for tr~n.~mi~ion. The reduction unit 20 may selectively compress portions of the data, reduce the resolution of portions of the image to be transmitted, and/or not forward portions ofthe data to the transmitter 22 at all or only periodically or only when the target moves outside the current field of view of the video camera 16. Desirably the data reduction unit 10 20 reduces the amount of data representing portions of the video image outside of the target box B, although data representing the target box B may also be reduced to a lesser extent. For example, data representing the target box B may be compressed so that no image data is lost and may be sent without i."~.l~lion, while the data representing the adjacent area may be compressed and sent only once the first time it comes into the video camera field of view. The extent of data 15 reduction may be preselected, depending in part on the number and nature of the targets expected to be detected and the search environment. For example, where readily idçntifi~ble targets are to be searched in a relatively llnch:~nging background (_.IJ., ships at sea) the background may be sent only once and/or highly compressed, while in a more complex background such as a city street the background may be sent more frequently and/or compressed less.
The target T may move, and when it does, the target box B moves with it. Target movement may be determined using video camera 16 signals alone or in combination with information from the target detector 12. With reference to Figure 2d, as the target box B moves, H5955, RF122 the system controller 14 coordinates movement of the video camera 16 so that the target box B
remains in the camera's new field of view A4.
In Figure 2d when the target T moves it will uncover a previously untransmitted portion of the area of interest. This portion is new adjacent area N and data representing the area N may S be forwarded to the transmitter after det~rmin:~tion that it does not contain a new target and a~plopl;ate data reduction. The data representing the area N may be forwarded in turn or at once regardless of the status of tr~n~mi~sion of data representing the rem~ining adjacent area of interest. Once forwarded, data for the new adjacent area N is treated the same as data from the rem~ining adjacent area (e.g., periodically or not forwarded again, compressed, resolution 10 reduced).
Some targets may move enough to first cover and then uncover an adjacent area of interest for which data has already been transmitted. In this event, data for such adjacent areas need not be retransmitted. A receiving unit would recognize this (or receive a signal from the transmitting unit so indicating) and reconstruct the area from the previously transmitted data. Appropriate data 15 storage facilities may be provided.
Plural targets may be tracked and new targets may be added as they are detected, or uncovered when a previously design~tecl target moves.
The target detector 12 includes at least one of an acoustic, seismic, infrared, electromagnetic, trip-wire, and visual sensors 121 n that can detect and provide an indication of 20 direction to potential targets. Such sensors are well known and need not be discussed herein. In one embodiment of the present invention, the target detector 12 includes several sensors 12t n spaced from one another so that range to the target can be determined, although this is not H5955, RF122 required for the present invention. Sensors of diverse types are desirable so that target information can be correlated to evaluate and screen target types. For example, if only cars are to tracked, potential targets that do not have the appropriate infrared, or acoustic signal may be lgnored.
The system controller 14 and data reduction unit 20 may include components known in the art for performing the various functions discussed above. For example, the patents discussed in the Background of the Invention include components for designating and tracking a moving object, for reducing image data, and for converting signals from a video camera into digital signals. A means for de~ign~ting and tracking a moving object is also available from Alliant 10 Techsystems of 600 Second Street, NE, Hopkins, Minnesota, and is used in a preferred embodiment.
The system controller 14 may include a conventional processor and data storage for evaluating the potential targets and for coor~lin~ting its various components. Characteristics of potential targets may be stored therein so that signals from the sensors 12, n may be evaluated.
15 The controller 14 may also evaluate the periodicity of features that move, but do not correlate to signals from sensors 12l n. For example, moving trees or water may be indicated as potential targets by movement alone, and yet it is desirable to reduce the amount of data for such features.
Accordingly, where features move in a repeated pattern and do not correlate to other sensors, the system controller 14 may direct the data reduction unit 20 to reduce data for these portions of the 20 image.
The video camera 16 may be a conventional camera for providing signals related to moving images, such as a television camera, a commercial video camera and the like. The H5955, RF122 analog-to-digital converter 18 and radio frequency transmitter 22 may also be conventional.
Figure 3 may include conventional acoustic sensors 30 and infrared sensors 32 for detecting potential targets. Each type of sensor may have its own processors 34, 36 for providing information about the potential targets to system controller 38. The acoustic sensors 30 provide 5 information about prominent sound frequencies being received and directions to each, while the infrared sensors 32 indicate that signals that exceed a preselected strength have been received.
Upon indication that a potential target has been found, the controller 38 may provide instructions (_.~., pan, tilt, zoom, focus) to a camera system 40 and the infrared sensors 32 to move them to the bearings indicated by the acoustic sensors for each of the potential targets. The 10 camera system 40 and infrared sensors 32 provide images of the potential targets that are evaluated by the controller 38, along with information from the acoustic sensors 30, to determine whether they are targets. For example, if a potential target emits an acoustic ~ign~tllre that is compatible with ~ign:~tllres for known targets (stored in the controller 38), and the camera and infrared sensors provide corroborating information, the potential target may be identified as a 15 target. The controller 38 evaluates successive frames of image data to reject false alarms and to classify targets.
Once a target is ~lecign~tetl, the controller 38 tracks the image of the target (the moving target box discussed above) and provides ~pl~l;ate movement signals to the camera system 40 to keep the target in the field of view. The infrared sensors 32 may be returned to a detection 20 mode.
The video signals from the camera system 40 are provided to a compression and tr~n~mi~ion processor 42 for ~ paldlion for tr~n~mi.~ion. In response to instructions from the H5955, RF122 controller 38, the processor 42 reduces the amount of data representing the video signal in the manner discussed above (compression, resolution, tr~n~mi~ion frequency) and provides the data representing the reduced size video signal to a transmitter 44.
Multiple targets may be identified and tracked by using multiple cameras, by providing 5 a camera field of view large enough to encompass all targets, or by panning a single camera periodically to each target.
An image tr~n~mi~ion system and method automatically to reduce the size of digital data signals transmitted from visual sensors. The system and method are completely automated and (a) use a plurality of sensors to detect targets in an area of interest, (b) direct a camera to place a 10 target in the camera's field of view, (c) provide a digitized visual image in which the target is identified in a target box, and (d) automatically compress (or otherwise reduce the size of) a digital signal for nontarget portions of the visual image.
The present invention relates video tr~n~mi~ion systems, and in which video information is automatically selected for tr~n.cmi~ion.
Many automated security and observation systems include video cameras that view an area 5 of interest. Information from the video camera may be provided real-time via conventional television communication links to a display for monitoring by a human observer, and for storage on tape that may be replayed later. The human observer can identify potential targets (a "target"
being any subject that is desirably detected by the system) and manually train the camera for closer observation. In one such system, the railroad car identification system is disclosed in U.S.
10 Patent Specification No. 4,876,597.
In some situations, conventional television communications links for transmitting video information are not adequate. For example, it may be desirable to send video data via a radio transmission system with a bandwidth too narrow to accommodate the desired tr~n~mi~.~ion speeds (e.g., high frequency (HF) radio bandwidth is too narrow for conventional real-time 15 television signals.) One solution to this problem is to transmit less information by elimin~ting some of the video data. As disclosed in U.S. Patent Specification No. 5,128,776, an operator may selectively designate important portions of the video data to be transmitted with no or visually lossless compression, and other less significant portions of the data with higher compression.
However, human observers are still needed to identify the important portions of the data and the 20 camera field of view.
Where portions of a video image appear con~i~t~ntly and are of predetermined appearance and aspect, such as in a video telephone that displays a human head facing the camera, a processor may locate this predetermined portion of the video image. When the head has been located and a boundary for the video data representing the head has been identified, the processor may reduce the amount of video data being transmitted by reducing the amount of data transmitted for portions outside the boundary relative to portions inside the boundary. (See the specification of S U.S. Patent No. 4,951,140.) However, such a system will only detect targets having the predetermined appearance and aspect.
Movement may also be used to reduce the amount of image data being transmitted. That is, it is known to use moving object detectors to identify movement by comparing sequential video images. Assuming that the moving portions are of interest, the amount of data for portions 10 ofthe video image that are stationary may be reduced. (See the specification ofthe U.S. Patent No. 4,692,806.) In such systems, the moving object detector "tracks" the moving object (in other words, the least compressed portion of image data moves with the moving object). As is al~l)ar~lll, however, image data for an important portion of the image that may not be moving, or that is not moving enough to trigger the moving object detector, may be compressed; for 15 example, important image data for a target may be inadvertently compressed when the target is headed directly for the camera.
An object of the present invention to provide an image tr~n~mi.csion system and method of transmitting images and to provide a method and video image compression system that automatically detects a target in an area of interest and transmits a digital video image of the 20 target in which nontarget information in the area of interest is automatically compressed before tr~n~m1~10n.
The present invention includes a video image compression system for automatically - 215115~
H5955, RF122 detecting a target in an area of interest and transmitting a digital image of the target wherein a digital image of nonl~g~l information in the area of interest is automatically reduced in size before tr~n~mi~ion thereof comprising a target detector for searching an area of interest, said target detector detecting at least one of an acoustic, seismic, infrared, electromagnetic, trip-wire, S and visual signal related to potential targets, a system controller for evaluating whether a signal from potential targets detected by said target detector is related to a target, said system controller comprising, i) means for evaluating signals from potential targets to determine whether such signals identify a target, ii) means for determinin~ a direction to an identified target, iii) means for using the determined direction to establish a target box within which the identified target is 10 located, and iv) means for following target movement and retaining the target in said target box, a camera system that receives comm~nd~ from said system controller for moving said camera system to said target box so that said camera system has said target box in a field of view, said camera system including, a) means for automatically adjusting the field of view and focus of said camera system so that an image of said target box and a portion of an adjacent area of interest can 15 be generated by said camera system, and b) means for generating a digital signal representing said target box and said adjacent area of interest, said system controller further comprising, c) means for reducing the size of said digital signal of the adjacent area of interest that is to be transmitted, d) means for providing instructions for moving said camera system as said target box moves so that said target box is m~int~ined in said camera system field of view, and e) means for 20 designating a new adjacent area of interest uncovered by movement of said target box for tr~n~mi~ion; and means for tr~n~milting on a radio frequency said digital signal of said ta~get box and said reduced size digital signal of said adjacent area of interest.
-H5955, RF122 The invention also includes a method of automatically detecting a target in an area of interest and transmitting a digital image of the target wherein a digital image of nontarget information in the area of interest is reduced in size before tr~n~mi.~ion thereof, the method comprising the steps of:
a) searching an area of interest with an automated target detector, the target detector detecting at least one of an acoustic, seismic, infrared, electromagnetic, trip-wire, and visual signal related to a potential target;
b) upon detection of signal related to a potential target by the target detector, evaluating the detected signal in a system controller to determine whether the potential target is 10 atarget;
c) upon d~L~" ~ tion that the potential target is a target, determining in the system controller a direction to the target;
d) the system controller using the determined direction to establish a target box within which the target is located and thereafter retained by following target movement;
e) providing a signal from the system controller to a camera system for moving the camera system so that the camera system has the target box in its field of view;
f) automatically adjusting the field of view and focus of the camera system so that an image of the target box and a portion of the adjacent area of interest may be generated by the camera system;
g) generating a digital signal of the image of the target box and adjacent area of interest with the camera system;
h) reducing the size of the digital signal of the adjacent area of interest;
H5955, RF122 i) tr~n~mitting the digital signal of the target box and the reduced size signal of the adjacent area of interest;
j) providing signals from the system controller for moving the field of view of the camera system as the target box moves so that the target box is m~int~ined in the camera system S field of view; and k) tr~n~mitting the digital signal of a new adjacent area of interest uncovered by the movement of the target box.
The invention will now be described, by way of example, with reference to the accompanying drawings in which:
Figure 1 is a block diagram of an embodiment of the video image k~n~mi~sion system.
Figures 2a-2d are a series of images illustrating the sequence of operation.
Figure 3 is a block diagram of a preferred embodiment of the present invention.
In the system and method of the present invention, the size of digital data signals transmitted from visual sensors are automatically reduced. The system and method are desirably 15 completely automated and (a) use a plurality of sensors to detect targets in an area of interest, (b) direct a camera to place a target in the camera's field of view, (c) provide a digitized visual image in which the target is identified in a target box, (d) automatically compress (or otherwise reduce the size of) a digital signal for nontarget portions of the visual image, and (e) transmit background image data only once (i.e., once background data is sent, it is not re-sent unless a new camera field 20 of view is required).
With reference to Figure 1 and to Figures 2a-2d, the present invention includes a target detector 12 for locating potential targets PT, m in an area of interest Al (Figure 2a). The target _ H5955, RF122 detector 12 may include at least one, and desirably several, sensors 12, n for detecting and providing a direction to potential targets. For example, the sensors may be acoustic, seismic, infrared, electromagnetic, trip-wire, visual, and the like.
Information from the target detector 12 is provided to a system controller 14 for 5 evaluation. The system controller 14 determines whether a potential target PTi is a target T based on all information available to it. The system controller 14 evaluates and correlates information from the sensors to screen potential targets PT, m in an area of interest Al.
If a target T is identified, the system controller 14 determines the location of the target T
relative to a video camera 16 and provides comm~n(l~ to the video camera 16 so that the target 10 T is placed in the field of view A2 (Figure 2b) of the video camera 16. To this end, the system controller 14 may determine a bearing and azimuth of the target and define a target box B in which the target is located. A target box B may take any shape and size and need not be a square as illustrated in the figures. For example, target box B may be the periphery of the target T. The system controller 14 coordinates movement of the video camera 16 to place the target box B in 15 the video camera's field of view A2.
The video camera 16 is automatically adjusted so that its field of view and focus provide a useable view A3 of the target box B, such as illustrated in Figure 2c. Desirably the view A3 includes, in addition to the target box B, some of the area of interest A, adjacent the target box B to provide a view of the environment arourld the target T. This result may also be achieved by 20 enlarging the area around the target T that is encompassed by the target box B. The video camera 16 generates a signal representing the image A3 that may be digital or converted to digital in an analog-to-digital converter 18. The system controller 14 may use the digital signals from the A/D
H5955, RF122 converter 18 (or signals directly from the video camera) to coordinate movement of the video camera 16 to place the target box B in its field of view.
The digital signals are provided from the system controller 14 to a data reduction unit 20 that operates under the control of the system controller to reduce the amount of data representing 5 the image A3 that will be forwarded to a radio frequency transmitter 22 or other narrow band communications systems for tr~n.~mi~ion. The reduction unit 20 may selectively compress portions of the data, reduce the resolution of portions of the image to be transmitted, and/or not forward portions ofthe data to the transmitter 22 at all or only periodically or only when the target moves outside the current field of view of the video camera 16. Desirably the data reduction unit 10 20 reduces the amount of data representing portions of the video image outside of the target box B, although data representing the target box B may also be reduced to a lesser extent. For example, data representing the target box B may be compressed so that no image data is lost and may be sent without i."~.l~lion, while the data representing the adjacent area may be compressed and sent only once the first time it comes into the video camera field of view. The extent of data 15 reduction may be preselected, depending in part on the number and nature of the targets expected to be detected and the search environment. For example, where readily idçntifi~ble targets are to be searched in a relatively llnch:~nging background (_.IJ., ships at sea) the background may be sent only once and/or highly compressed, while in a more complex background such as a city street the background may be sent more frequently and/or compressed less.
The target T may move, and when it does, the target box B moves with it. Target movement may be determined using video camera 16 signals alone or in combination with information from the target detector 12. With reference to Figure 2d, as the target box B moves, H5955, RF122 the system controller 14 coordinates movement of the video camera 16 so that the target box B
remains in the camera's new field of view A4.
In Figure 2d when the target T moves it will uncover a previously untransmitted portion of the area of interest. This portion is new adjacent area N and data representing the area N may S be forwarded to the transmitter after det~rmin:~tion that it does not contain a new target and a~plopl;ate data reduction. The data representing the area N may be forwarded in turn or at once regardless of the status of tr~n~mi~sion of data representing the rem~ining adjacent area of interest. Once forwarded, data for the new adjacent area N is treated the same as data from the rem~ining adjacent area (e.g., periodically or not forwarded again, compressed, resolution 10 reduced).
Some targets may move enough to first cover and then uncover an adjacent area of interest for which data has already been transmitted. In this event, data for such adjacent areas need not be retransmitted. A receiving unit would recognize this (or receive a signal from the transmitting unit so indicating) and reconstruct the area from the previously transmitted data. Appropriate data 15 storage facilities may be provided.
Plural targets may be tracked and new targets may be added as they are detected, or uncovered when a previously design~tecl target moves.
The target detector 12 includes at least one of an acoustic, seismic, infrared, electromagnetic, trip-wire, and visual sensors 121 n that can detect and provide an indication of 20 direction to potential targets. Such sensors are well known and need not be discussed herein. In one embodiment of the present invention, the target detector 12 includes several sensors 12t n spaced from one another so that range to the target can be determined, although this is not H5955, RF122 required for the present invention. Sensors of diverse types are desirable so that target information can be correlated to evaluate and screen target types. For example, if only cars are to tracked, potential targets that do not have the appropriate infrared, or acoustic signal may be lgnored.
The system controller 14 and data reduction unit 20 may include components known in the art for performing the various functions discussed above. For example, the patents discussed in the Background of the Invention include components for designating and tracking a moving object, for reducing image data, and for converting signals from a video camera into digital signals. A means for de~ign~ting and tracking a moving object is also available from Alliant 10 Techsystems of 600 Second Street, NE, Hopkins, Minnesota, and is used in a preferred embodiment.
The system controller 14 may include a conventional processor and data storage for evaluating the potential targets and for coor~lin~ting its various components. Characteristics of potential targets may be stored therein so that signals from the sensors 12, n may be evaluated.
15 The controller 14 may also evaluate the periodicity of features that move, but do not correlate to signals from sensors 12l n. For example, moving trees or water may be indicated as potential targets by movement alone, and yet it is desirable to reduce the amount of data for such features.
Accordingly, where features move in a repeated pattern and do not correlate to other sensors, the system controller 14 may direct the data reduction unit 20 to reduce data for these portions of the 20 image.
The video camera 16 may be a conventional camera for providing signals related to moving images, such as a television camera, a commercial video camera and the like. The H5955, RF122 analog-to-digital converter 18 and radio frequency transmitter 22 may also be conventional.
Figure 3 may include conventional acoustic sensors 30 and infrared sensors 32 for detecting potential targets. Each type of sensor may have its own processors 34, 36 for providing information about the potential targets to system controller 38. The acoustic sensors 30 provide 5 information about prominent sound frequencies being received and directions to each, while the infrared sensors 32 indicate that signals that exceed a preselected strength have been received.
Upon indication that a potential target has been found, the controller 38 may provide instructions (_.~., pan, tilt, zoom, focus) to a camera system 40 and the infrared sensors 32 to move them to the bearings indicated by the acoustic sensors for each of the potential targets. The 10 camera system 40 and infrared sensors 32 provide images of the potential targets that are evaluated by the controller 38, along with information from the acoustic sensors 30, to determine whether they are targets. For example, if a potential target emits an acoustic ~ign~tllre that is compatible with ~ign:~tllres for known targets (stored in the controller 38), and the camera and infrared sensors provide corroborating information, the potential target may be identified as a 15 target. The controller 38 evaluates successive frames of image data to reject false alarms and to classify targets.
Once a target is ~lecign~tetl, the controller 38 tracks the image of the target (the moving target box discussed above) and provides ~pl~l;ate movement signals to the camera system 40 to keep the target in the field of view. The infrared sensors 32 may be returned to a detection 20 mode.
The video signals from the camera system 40 are provided to a compression and tr~n~mi~ion processor 42 for ~ paldlion for tr~n~mi.~ion. In response to instructions from the H5955, RF122 controller 38, the processor 42 reduces the amount of data representing the video signal in the manner discussed above (compression, resolution, tr~n~mi~ion frequency) and provides the data representing the reduced size video signal to a transmitter 44.
Multiple targets may be identified and tracked by using multiple cameras, by providing 5 a camera field of view large enough to encompass all targets, or by panning a single camera periodically to each target.
An image tr~n~mi~ion system and method automatically to reduce the size of digital data signals transmitted from visual sensors. The system and method are completely automated and (a) use a plurality of sensors to detect targets in an area of interest, (b) direct a camera to place a 10 target in the camera's field of view, (c) provide a digitized visual image in which the target is identified in a target box, and (d) automatically compress (or otherwise reduce the size of) a digital signal for nontarget portions of the visual image.
Claims (10)
1. A video image compression system for automatically detecting a target in an area of interest and transmitting a digital image of the target in which a digital image of nontarget information in the area of interest is automatically reduced in size before transmission thereof comprising a target detector for searching an area of interest, said target detector detecting at least one of an acoustic, seismic, infrared, electromagnetic, trip-wire, and visual signal related to potential targets, a system controller for evaluating whether a signal from potential targets detected by said target detector is related to a target, said system controller comprising, i) means for evaluating signals from potential targets to determine whether such signals identify a target, ii) means for determining a direction to an identified target, iii) means for using the determined direction to establish a target box within which the identified target is located, and iv) means for following target movement and retaining the target in said target box, a camera system that receives commands from said system controller for moving said camera system to said target box so that said camera system has said target box in a field of view, said camera system including, a) means for automatically adjusting the field of view and focus of said camera system so that an image of said target box and a portion of an adjacent area of interest can be generated by said camera system, and b) means for generating a digital signal representing said target box and said adjacent area of interest, said system controller further comprising, c) means for reducing the size of said digital signal of the adjacent area of interest that is to be transmitted, d) means for providing instructions for moving said camera system as said target box moves so that said target box is maintained in said camera system field of view, and e) means for designating a new adjacent area of interest uncovered by movement of said target box for transmission; and means for transmitting on a radio frequency said digital signal of said target box and said reduced size digital signal of said adjacent area of interest.
2. An image compression system as claimed in Claim 1 wherein said means for reducing the size of said digital signal comprises means for transmitting said digital signal of said adjacent area of interest periodically, and of interest when it first appears in said camera system field of view and not thereafter.
3. An image compression system as claimed in Claim 1 or 2 wherein said means for following target movement comprises means for evaluating the periodicity of moving portions of the digital image, and preferably further comprising means for compressing said digital signal representing said target box.
4. An image compression system as claimed in any of Claims 1 to 3 wherein said target detector comprises an acoustic sensor and an infrared sensor.
5. An image compression system as claimed in Claim 5 wherein said camera system comprises a video camera, and said means for evaluating potential targets comprises means for evaluating signals from said video camera, said acoustic sensor and said infrared sensor.
6. A method of automatically detecting a target in an area of interest and transmitting a digital image of the target wherein a digital image of nontarget information in the area of interest is reduced in size before transmission thereof, the method comprising the steps of:
a) searching an area of interest with an automated target detector, the target detector detecting at least one of an acoustic, seismic, infrared, electromagnetic, trip-wire, and visual signal related to a potential target;
b) upon detection of signal related to a potential target by the target detector, evaluating the detected signal in a system controller to determine whether the potential target is a target;
c) upon determination that the potential target is a target, determining; in the system controller a direction to the target;
d) the system controller using the determined direction to establish a target box within which the target is located and thereafter retained by following target movement;
e) providing a signal from the system controller to a camera system for moving the camera system so that the camera system has the target box in its field of view;
f) automatically adjusting the field of view and focus of the camera system so that an image of the target box and a portion of the adjacent area of interest may be generated by the camera system;
g) generating a digital signal of the image of the target box and adjacent area of interest with the camera system, h) reducing the size of the digital signal of the adjacent area of interest;
i) transmitting the digital signal of the target box and the reduced size signal of the adjacent area of interest;
j) providing signals from the system controller for moving the field of view of the camera system as the target box moves so that the target box is maintained in the camera system field of view; and k) transmitting the digital signal of a new adjacent area of interest uncovered by the movement of the target box.
a) searching an area of interest with an automated target detector, the target detector detecting at least one of an acoustic, seismic, infrared, electromagnetic, trip-wire, and visual signal related to a potential target;
b) upon detection of signal related to a potential target by the target detector, evaluating the detected signal in a system controller to determine whether the potential target is a target;
c) upon determination that the potential target is a target, determining; in the system controller a direction to the target;
d) the system controller using the determined direction to establish a target box within which the target is located and thereafter retained by following target movement;
e) providing a signal from the system controller to a camera system for moving the camera system so that the camera system has the target box in its field of view;
f) automatically adjusting the field of view and focus of the camera system so that an image of the target box and a portion of the adjacent area of interest may be generated by the camera system;
g) generating a digital signal of the image of the target box and adjacent area of interest with the camera system, h) reducing the size of the digital signal of the adjacent area of interest;
i) transmitting the digital signal of the target box and the reduced size signal of the adjacent area of interest;
j) providing signals from the system controller for moving the field of view of the camera system as the target box moves so that the target box is maintained in the camera system field of view; and k) transmitting the digital signal of a new adjacent area of interest uncovered by the movement of the target box.
7. A method as claimed in Claim 6 wherein multiple targets are detected and separate target boxes are established for each of the multiple targets, and the digital signal of the adjacent area of interest is transmitted periodically.
8. A method as claimed in Claim 7 wherein the digital signal of the adjacent area of interest is transmitted only the first time it appears in the camera system field of view.
9. A method as claimed in Claims 7 or 8 wherein when movement of the target box uncovers a new adjacent area of interest, the digital signal of the uncovered adjacent area of interest is transmitted immediately, and preferably the digital signal of the adjacent area of interest is compressed to a predetermined first level.
10. A method as claimed in Claim 9 wherein the digital image of the target box is compressed to a second level less than the first level, and in which the digital signal of the adjacent area of interest is transmitted only when a new adjacent area is required because of target movement.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US08/261,979 | 1994-06-17 | ||
| US08/261,979 US5521634A (en) | 1994-06-17 | 1994-06-17 | Automatic detection and prioritized image transmission system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2151158A1 true CA2151158A1 (en) | 1995-12-18 |
Family
ID=22995675
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002151158A Abandoned CA2151158A1 (en) | 1994-06-17 | 1995-06-07 | Autonomous prioritized image transmission |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US5521634A (en) |
| EP (1) | EP0689357B1 (en) |
| CA (1) | CA2151158A1 (en) |
| DE (1) | DE69516334D1 (en) |
| IL (1) | IL113896A (en) |
| ZA (1) | ZA954444B (en) |
Families Citing this family (96)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5610653A (en) * | 1992-02-07 | 1997-03-11 | Abecassis; Max | Method and system for automatically tracking a zoomed video image |
| US5903317A (en) * | 1993-02-14 | 1999-05-11 | Orad Hi-Tech Systems Ltd. | Apparatus and method for detecting, identifying and incorporating advertisements in a video |
| US5625410A (en) * | 1993-04-21 | 1997-04-29 | Kinywa Washino | Video monitoring and conferencing system |
| USRE43462E1 (en) * | 1993-04-21 | 2012-06-12 | Kinya (Ken) Washino | Video monitoring and conferencing system |
| US7843497B2 (en) * | 1994-05-31 | 2010-11-30 | Conley Gregory J | Array-camera motion picture device, and methods to produce new visual and aural effects |
| CA2155719C (en) * | 1994-11-22 | 2005-11-01 | Terry Laurence Glatt | Video surveillance system with pilot and slave cameras |
| JPH08331561A (en) * | 1995-03-30 | 1996-12-13 | Canon Inc | Image processing unit |
| US5926209A (en) * | 1995-07-14 | 1999-07-20 | Sensormatic Electronics Corporation | Video camera apparatus with compression system responsive to video camera adjustment |
| JP3774914B2 (en) * | 1995-09-27 | 2006-05-17 | ソニー株式会社 | Video equipment |
| US5706054A (en) * | 1995-12-01 | 1998-01-06 | Intel Corporation | Method and apparatus for adjusting video data to limit the effects of automatic focusing control on motion estimation video coders |
| US6314140B1 (en) * | 1995-12-28 | 2001-11-06 | Lucent Technologies Inc. | Dynamic video focus control |
| US5982418A (en) * | 1996-04-22 | 1999-11-09 | Sensormatic Electronics Corporation | Distributed video data storage in video surveillance system |
| US5999210A (en) * | 1996-05-30 | 1999-12-07 | Proteus Corporation | Military range scoring system |
| US7015945B1 (en) | 1996-07-10 | 2006-03-21 | Visilinx Inc. | Video surveillance system and method |
| US7304662B1 (en) | 1996-07-10 | 2007-12-04 | Visilinx Inc. | Video surveillance system and method |
| US6476854B1 (en) * | 1996-10-18 | 2002-11-05 | Compaq Information Technologies Group, L.P. | Video eavesdropping and reverse assembly to transmit video action to a remote console |
| US5828769A (en) * | 1996-10-23 | 1998-10-27 | Autodesk, Inc. | Method and apparatus for recognition of objects via position and orientation consensus of local image encoding |
| US5875304A (en) * | 1996-10-31 | 1999-02-23 | Sensormatic Electronics Corporation | User-settable features of an intelligent video information management system |
| US5875305A (en) * | 1996-10-31 | 1999-02-23 | Sensormatic Electronics Corporation | Video information management system which provides intelligent responses to video data content features |
| US6031573A (en) * | 1996-10-31 | 2000-02-29 | Sensormatic Electronics Corporation | Intelligent video information management system performing multiple functions in parallel |
| US5828848A (en) * | 1996-10-31 | 1998-10-27 | Sensormatic Electronics Corporation | Method and apparatus for compression and decompression of video data streams |
| US5917958A (en) * | 1996-10-31 | 1999-06-29 | Sensormatic Electronics Corporation | Distributed video data base with remote searching for image data features |
| US5907352A (en) * | 1997-02-20 | 1999-05-25 | Gilley; Terry W. | Door mountable security system |
| US5845009A (en) * | 1997-03-21 | 1998-12-01 | Autodesk, Inc. | Object tracking system using statistical modeling and geometric relationship |
| US6061055A (en) * | 1997-03-21 | 2000-05-09 | Autodesk, Inc. | Method of tracking objects with an imaging device |
| US6727938B1 (en) * | 1997-04-14 | 2004-04-27 | Robert Bosch Gmbh | Security system with maskable motion detection and camera with an adjustable field of view |
| US6069655A (en) * | 1997-08-01 | 2000-05-30 | Wells Fargo Alarm Services, Inc. | Advanced video security system |
| US6097429A (en) * | 1997-08-01 | 2000-08-01 | Esco Electronics Corporation | Site control unit for video security system |
| US6091771A (en) * | 1997-08-01 | 2000-07-18 | Wells Fargo Alarm Services, Inc. | Workstation for video security system |
| US6085152A (en) | 1997-09-19 | 2000-07-04 | Cambridge Management Advanced Systems Corporation | Apparatus and method for monitoring and reporting weather conditions |
| US6005610A (en) * | 1998-01-23 | 1999-12-21 | Lucent Technologies Inc. | Audio-visual object localization and tracking system and method therefor |
| US6937651B1 (en) * | 1998-06-29 | 2005-08-30 | Texas Instruments Incorporated | Method and apparatus for compressing image information |
| US6393056B1 (en) * | 1998-07-01 | 2002-05-21 | Texas Instruments Incorporated | Compression of information from one detector as a function of information from another detector |
| GB2362461B (en) * | 1999-02-11 | 2003-07-23 | Cardax Internat Ltd | Improvements in or relating to control and/or monitoring systems |
| US6466258B1 (en) | 1999-02-12 | 2002-10-15 | Lockheed Martin Corporation | 911 real time information communication |
| JP4243883B2 (en) * | 1999-03-15 | 2009-03-25 | フジノン株式会社 | Remote head system |
| US6633231B1 (en) * | 1999-06-07 | 2003-10-14 | Horiba, Ltd. | Communication device and auxiliary device for communication |
| US6437819B1 (en) * | 1999-06-25 | 2002-08-20 | Rohan Christopher Loveland | Automated video person tracking system |
| US6844895B1 (en) | 1999-11-15 | 2005-01-18 | Logitech Europe S.A. | Wireless intelligent host imaging, audio and data receiver |
| GB2357650A (en) * | 1999-12-23 | 2001-06-27 | Mitsubishi Electric Inf Tech | Method for tracking an area of interest in a video image, and for transmitting said area |
| US7028269B1 (en) * | 2000-01-20 | 2006-04-11 | Koninklijke Philips Electronics N.V. | Multi-modal video target acquisition and re-direction system and method |
| EP1158786A3 (en) * | 2000-05-24 | 2005-03-09 | Sony Corporation | Transmission of the region of interest of an image |
| SE522121C2 (en) * | 2000-10-04 | 2004-01-13 | Axis Ab | Method and apparatus for digital processing of frequently updated images from a camera |
| US9892606B2 (en) * | 2001-11-15 | 2018-02-13 | Avigilon Fortress Corporation | Video surveillance system employing video primitives |
| US8564661B2 (en) * | 2000-10-24 | 2013-10-22 | Objectvideo, Inc. | Video analytic rule detection system and method |
| US8711217B2 (en) | 2000-10-24 | 2014-04-29 | Objectvideo, Inc. | Video surveillance system employing video primitives |
| SE517765C2 (en) | 2000-11-16 | 2002-07-16 | Ericsson Telefon Ab L M | Registration of moving images by means of a portable communication device and an accessory device co-located with the object |
| CA2328795A1 (en) | 2000-12-19 | 2002-06-19 | Advanced Numerical Methods Ltd. | Applications and performance enhancements for detail-in-context viewing technology |
| US7424175B2 (en) | 2001-03-23 | 2008-09-09 | Objectvideo, Inc. | Video segmentation using statistical pixel modeling |
| CA2345803A1 (en) | 2001-05-03 | 2002-11-03 | Idelix Software Inc. | User interface elements for pliable display technology implementations |
| US8416266B2 (en) | 2001-05-03 | 2013-04-09 | Noregin Assetts N.V., L.L.C. | Interacting with detail-in-context presentations |
| US9760235B2 (en) * | 2001-06-12 | 2017-09-12 | Callahan Cellular L.L.C. | Lens-defined adjustment of displays |
| US7213214B2 (en) * | 2001-06-12 | 2007-05-01 | Idelix Software Inc. | Graphical user interface with zoom for detail-in-context presentations |
| US7084886B2 (en) | 2002-07-16 | 2006-08-01 | Idelix Software Inc. | Using detail-in-context lenses for accurate digital image cropping and measurement |
| KR100426174B1 (en) * | 2001-10-29 | 2004-04-06 | 삼성전자주식회사 | Method for controlling a camera using video compression algorithm |
| CA2361341A1 (en) * | 2001-11-07 | 2003-05-07 | Idelix Software Inc. | Use of detail-in-context presentation on stereoscopically paired images |
| CA2370752A1 (en) * | 2002-02-05 | 2003-08-05 | Idelix Software Inc. | Fast rendering of pyramid lens distorted raster images |
| ATE539558T1 (en) * | 2002-04-25 | 2012-01-15 | Panasonic Corp | OBJECT DETECTION DEVICE, OBJECT DETECTION SERVER AND OBJECT DETECTION METHOD |
| CA2386560A1 (en) * | 2002-05-15 | 2003-11-15 | Idelix Software Inc. | Controlling optical hardware and dynamic data viewing systems with detail-in-context viewing tools |
| US8120624B2 (en) * | 2002-07-16 | 2012-02-21 | Noregin Assets N.V. L.L.C. | Detail-in-context lenses for digital image cropping, measurement and online maps |
| CA2393887A1 (en) | 2002-07-17 | 2004-01-17 | Idelix Software Inc. | Enhancements to user interface for detail-in-context data presentation |
| US20040022447A1 (en) * | 2002-07-31 | 2004-02-05 | General Electric Company | Method and system for image compression and decompression using span of interest of an imaging sequence |
| CA2406047A1 (en) | 2002-09-30 | 2004-03-30 | Ali Solehdin | A graphical user interface for digital media and network portals using detail-in-context lenses |
| US20070097109A1 (en) * | 2005-10-18 | 2007-05-03 | Idelix Software Inc. | Method and system for generating detail-in-context presentations in client/server systems |
| CA2407383A1 (en) * | 2002-10-10 | 2004-04-10 | Idelix Software Inc. | Editing multiple layers of a presentation using detail-in-context lenses |
| CA2449888A1 (en) | 2003-11-17 | 2005-05-17 | Idelix Software Inc. | Navigating large images using detail-in-context fisheye rendering techniques |
| CA2411898A1 (en) | 2002-11-15 | 2004-05-15 | Idelix Software Inc. | A method and system for controlling access to detail-in-context presentations |
| EP1654864A4 (en) * | 2003-03-20 | 2009-05-27 | Ge Security Inc | Systems and methods for multi-stream image processing |
| GB0315007D0 (en) * | 2003-06-27 | 2003-07-30 | Roke Manor Research | An acoustic event synchronisation and characterisation system for sports |
| GB2404105A (en) * | 2003-07-03 | 2005-01-19 | Braddahead Ltd | Compressing digital images |
| US7486302B2 (en) * | 2004-04-14 | 2009-02-03 | Noregin Assets N.V., L.L.C. | Fisheye lens graphical user interfaces |
| US8106927B2 (en) | 2004-05-28 | 2012-01-31 | Noregin Assets N.V., L.L.C. | Graphical user interfaces and occlusion prevention for fisheye lenses with line segment foci |
| US9317945B2 (en) * | 2004-06-23 | 2016-04-19 | Callahan Cellular L.L.C. | Detail-in-context lenses for navigation |
| FR2872661B1 (en) * | 2004-07-05 | 2006-09-22 | Eastman Kodak Co | MULTI-RESOLUTION VIEWING METHOD AND DEVICE |
| US7714859B2 (en) | 2004-09-03 | 2010-05-11 | Shoemaker Garth B D | Occlusion reduction and magnification for multidimensional data presentations |
| US7995078B2 (en) | 2004-09-29 | 2011-08-09 | Noregin Assets, N.V., L.L.C. | Compound lenses for multi-source data presentation |
| US20060221182A1 (en) * | 2005-04-01 | 2006-10-05 | Sham John C | Security surveillance viewing and recording assembly |
| US7580036B2 (en) | 2005-04-13 | 2009-08-25 | Catherine Montagnese | Detail-in-context terrain displacement algorithm with optimizations |
| US8964029B2 (en) * | 2005-04-29 | 2015-02-24 | Chubb Protection Corporation | Method and device for consistent region of interest |
| US20070024705A1 (en) * | 2005-08-01 | 2007-02-01 | Richter Roger K | Systems and methods for video stream selection |
| US20070024706A1 (en) * | 2005-08-01 | 2007-02-01 | Brannon Robert H Jr | Systems and methods for providing high-resolution regions-of-interest |
| US8031206B2 (en) | 2005-10-12 | 2011-10-04 | Noregin Assets N.V., L.L.C. | Method and system for generating pyramid fisheye lens detail-in-context presentations |
| US7983473B2 (en) | 2006-04-11 | 2011-07-19 | Noregin Assets, N.V., L.L.C. | Transparency adjustment of a presentation |
| EP2013817A2 (en) * | 2006-04-17 | 2009-01-14 | Objectvideo, Inc. | Video segmentation using statistical pixel modeling |
| JP2008035096A (en) * | 2006-07-27 | 2008-02-14 | Sony Corp | Monitoring apparatus, monitoring method and program |
| EP1953699A1 (en) * | 2007-02-01 | 2008-08-06 | Sunvision Scientific Inc. | System and method for variable-resolution image saving |
| US9026938B2 (en) * | 2007-07-26 | 2015-05-05 | Noregin Assets N.V., L.L.C. | Dynamic detail-in-context user interface for application access and content access on electronic displays |
| US8520896B2 (en) * | 2008-05-02 | 2013-08-27 | Textron Innovations Inc. | Method and apparatus for acquiring accurate background infrared signature data on moving targets |
| US8294881B2 (en) * | 2008-08-26 | 2012-10-23 | Honeywell International Inc. | Security system using LADAR-based sensors |
| CN101771810A (en) * | 2008-12-29 | 2010-07-07 | 上海乐金广电电子有限公司 | Method and device for obtaining clear images |
| JP5521809B2 (en) | 2010-06-17 | 2014-06-18 | ソニー株式会社 | Pointing system, control device, and control method |
| US9695981B2 (en) * | 2012-04-20 | 2017-07-04 | Honeywell International Inc. | Image recognition for personal protective equipment compliance enforcement in work areas |
| US20140240511A1 (en) * | 2013-02-25 | 2014-08-28 | Xerox Corporation | Automatically focusing a spectral imaging system onto an object in a scene |
| FR3039919B1 (en) * | 2015-08-04 | 2018-01-19 | Neosensys | TRACKING A TARGET IN A CAMERAS NETWORK |
| TW201832131A (en) * | 2017-02-24 | 2018-09-01 | 小綠草股份有限公司 | Object tracking method |
| CN107844750B (en) * | 2017-10-19 | 2020-05-19 | 华中科技大学 | Water surface panoramic image target detection and identification method |
Family Cites Families (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4739401A (en) * | 1985-01-25 | 1988-04-19 | Hughes Aircraft Company | Target acquisition system and method |
| GB8518803D0 (en) * | 1985-07-25 | 1985-08-29 | Rca Corp | Locating target patterns within images |
| US4849486A (en) * | 1985-07-10 | 1989-07-18 | Nippon Oil Co., Ltd. | Polyphenylene ether resin composition |
| DE3685589T2 (en) * | 1986-03-19 | 1993-02-04 | British Broadcasting Corp | VIDEO SIGNAL PROCESSING FOR BANDWIDTH REDUCTION. |
| GB8703931D0 (en) * | 1987-02-19 | 1993-05-05 | British Aerospace | Tracking systems |
| JPS647791A (en) * | 1987-06-30 | 1989-01-11 | Nec Corp | Multiscreen video conference method and device therefor |
| US4876597A (en) * | 1987-09-04 | 1989-10-24 | Adt Security Systems, Inc. | Video observation systems |
| US4951140A (en) * | 1988-02-22 | 1990-08-21 | Kabushiki Kaisha Toshiba | Image encoding apparatus |
| US4931868A (en) * | 1988-05-31 | 1990-06-05 | Grumman Aerospace Corporation | Method and apparatus for detecting innovations in a scene |
| GB2219905A (en) * | 1988-06-17 | 1989-12-20 | Philips Electronic Associated | Target detection system |
| US4905262A (en) * | 1988-07-28 | 1990-02-27 | Tektronix, Inc. | Synchronous programmable two-stage serial/parallel counter |
| US4937878A (en) * | 1988-08-08 | 1990-06-26 | Hughes Aircraft Company | Signal processing for autonomous acquisition of objects in cluttered background |
| DE3828766C2 (en) * | 1988-08-25 | 1997-04-10 | Daimler Benz Aerospace Ag | Electro-optical system for the detection of missiles |
| US5034986A (en) * | 1989-03-01 | 1991-07-23 | Siemens Aktiengesellschaft | Method for detecting and tracking moving objects in a digital image sequence having a stationary background |
| US5128776A (en) * | 1989-06-16 | 1992-07-07 | Harris Corporation | Prioritized image transmission system and method |
| US5341439A (en) * | 1989-09-21 | 1994-08-23 | Hsu Shin Yi | System for texture-based automatic detection of man-made objects in representations of sensed natural environmental scenes |
| KR100204101B1 (en) * | 1990-03-02 | 1999-06-15 | 가나이 쓰도무 | Image processing apparatus |
| JP2828324B2 (en) * | 1990-06-21 | 1998-11-25 | 富士通株式会社 | Remote monitoring system |
| US5243418A (en) * | 1990-11-27 | 1993-09-07 | Kabushiki Kaisha Toshiba | Display monitoring system for detecting and tracking an intruder in a monitor area |
| KR940007846B1 (en) * | 1991-12-09 | 1994-08-25 | 주식회사 금성사 | Apparatus for detecting movement |
| FR2693868B1 (en) * | 1992-07-15 | 1994-10-14 | Hymatom Sa | Video surveillance device for combined field cameras and signals. |
| US5406328A (en) * | 1993-09-28 | 1995-04-11 | Hughes Aircraft Company | Adaptive track loop bandwidth reduction in cluttered scenes |
-
1994
- 1994-06-17 US US08/261,979 patent/US5521634A/en not_active Expired - Lifetime
-
1995
- 1995-05-29 IL IL113896A patent/IL113896A/en active IP Right Grant
- 1995-05-31 ZA ZA954444A patent/ZA954444B/en unknown
- 1995-06-07 CA CA002151158A patent/CA2151158A1/en not_active Abandoned
- 1995-06-13 DE DE69516334T patent/DE69516334D1/en not_active Expired - Lifetime
- 1995-06-13 EP EP95304056A patent/EP0689357B1/en not_active Expired - Lifetime
Also Published As
| Publication number | Publication date |
|---|---|
| IL113896A0 (en) | 1995-08-31 |
| EP0689357B1 (en) | 2000-04-19 |
| DE69516334D1 (en) | 2000-05-25 |
| US5521634A (en) | 1996-05-28 |
| EP0689357A1 (en) | 1995-12-27 |
| IL113896A (en) | 1998-04-05 |
| ZA954444B (en) | 1996-08-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP0689357B1 (en) | Autonomous prioritized image transmission | |
| EP1441318B1 (en) | Security system | |
| US5508736A (en) | Video signal processing apparatus for producing a composite signal for simultaneous display of data and video information | |
| US7889232B2 (en) | Method and system for surveillance of vessels | |
| JP5241720B2 (en) | Steering and safety systems for vehicles or equipment | |
| CN110097726B (en) | Method and system for monitoring target in precautionary area | |
| KR101923900B1 (en) | Multipurpose system of monitoring illegal trash dumping | |
| WO1997008896A1 (en) | Open area security system | |
| CN108449574A (en) | A kind of security detection method and system based on microwave | |
| KR102001594B1 (en) | Radar-camera fusion disaster tracking system and method for scanning invisible space | |
| KR20040105612A (en) | Change detecting method and apparatus and monitoring system using the method or apparatus | |
| US20020052708A1 (en) | Optimal image capture | |
| JPH10241062A (en) | Guard system | |
| CN111681399A (en) | Multi-dimensional three-dimensional safety prevention and control method, device and system | |
| JP3592962B2 (en) | Abnormal object monitoring device | |
| US5504520A (en) | Automatic television-camera supervisory system | |
| KR20110033599A (en) | Port watching system | |
| JPH08180276A (en) | Method and device for obstacle detection | |
| JP3985371B2 (en) | Monitoring device | |
| CN111063148A (en) | Remote night vision target video detection method | |
| KR20240021671A (en) | Suspicious object monitoring device based on false image probability | |
| CN210466625U (en) | Unmanned sea patrol ship | |
| JP2003337172A (en) | Laser radar monitoring system | |
| JP3237041B2 (en) | Underwater monitoring system | |
| CN117805912A (en) | Perimeter intrusion detection system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FZDE | Discontinued |