US20020015582A1 - Video recording apparatus and monitoring apparatus - Google Patents
Video recording apparatus and monitoring apparatus Download PDFInfo
- Publication number
- US20020015582A1 US20020015582A1 US09/918,172 US91817201A US2002015582A1 US 20020015582 A1 US20020015582 A1 US 20020015582A1 US 91817201 A US91817201 A US 91817201A US 2002015582 A1 US2002015582 A1 US 2002015582A1
- Authority
- US
- United States
- Prior art keywords
- image data
- frame rate
- video recording
- recording apparatus
- data storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims description 79
- 238000013500 data storage Methods 0.000 claims abstract description 82
- 238000013144 data compression Methods 0.000 claims abstract description 16
- 238000004364 calculation method Methods 0.000 claims description 3
- 238000001454 recorded image Methods 0.000 claims description 2
- 230000001105 regulatory effect Effects 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 6
- 230000003068 static effect Effects 0.000 description 6
- 238000000034 method Methods 0.000 description 2
- 230000002542 deteriorative effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/91—Television signal processing therefor
- H04N5/92—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N5/9201—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving the multiplexing of an additional signal and the video signal
- H04N5/9205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving the multiplexing of an additional signal and the video signal the additional signal being at least another television signal
Definitions
- the present invention relates to a video recording apparatus for recording a static image in digital data, and more particularly to a video recording apparatus for compressing a fetched static image into data and recording the data in a random accessible digital data storage medium such as a hard disk or a magneto-optic disk and a monitoring apparatus using the video recording apparatus.
- a monitoring apparatus installed in a station, a bank or various stores usually records an analog video fetched from the monitor camera in a video tape.
- a computer technology has been developed and a storage medium having a large capacity such as a hard disk, a CD-R, an MD or a DVD which can store a large volume of digital data can be provided inexpensively.
- a monitoring apparatus for recording a digital image fetched from image pick-up means such as the monitor camera in a digital data storage medium such as a hard disk has spread.
- the object can be achieved by a video recording apparatus for storing image data sequentially fetched from image pick-up means in a digital data storage medium at a predetermined frame rate, comprising frame rate calculating means for calculating the frame rate depending on a picture recording time of the image data into the digital data storage medium.
- the object can be achieved by a video recording apparatus for storing image data sequentially fetched from image pick-up means in a digital data storage medium at a predetermined frame rate, comprising frame rate calculating means for calculating the frame rate depending on a residual capacity of the digital data storage medium.
- the frame rate calculating means should calculate a frame rate by setting image data for a past predetermined time of image data fetched from the image pick-up means to be a value which can be stored in the digital data storage medium. Furthermore, the frame rate calculating means calculates a frame rate based on a value of a picture quality parameter when image data are to be compressed and stored in the digital data storage medium.
- the frame rate calculating means reads a value of a prepared table to calculate a frame rate in place of the computation, and furthermore, sets image data having a high degree of importance to have a fixed frame rate and image data having a low degree of importance to have a lower frame rate when the frame rate is equal to or lower than a predetermined value.
- data processing means for setting a data compression rate of image data having a high degree of importance to be lower than a data compression rate of image data having a low degree of importance, thereby storing the data in the digital data storage medium.
- image data are set to have a high degree of importance when an alarm is generated or a trigger input is manually carried out.
- the data processing means deletes the image data having a low degree of importance or overwrites new image data having a high degree of importance to the image data having a low degree of importance when a residual capacity of the digital data storage medium is equal to or smaller than a predetermined capacity, and the degree of importance of image data is decided based on a value of a flag added to the image data.
- the data processing means should store only image data having a high degree of importance in the digital data storage medium when a residual capacity of the digital data storage medium is equal to or smaller than a predetermined capacity.
- a storage region for storing only image data having a high degree of importance is preset to be a dedicated region for each type of an alarm.
- the object can be achieved by a monitoring apparatus comprising a monitor camera, an alarm generating device, the video recording apparatus having any of the structures described above which serves to input image data fetched from the monitor camera and an alarm fetched from the alarm generating device, and a monitor device for displaying, on a screen, the image data or image data obtained by reproducing image data stored in the digital data storage medium of the video recording apparatus.
- a frame rate for storage is dynamically changed according to a picture recording time or the residual capacity of the storage medium so that image data for a predetermined time can be stored in the storage medium. Consequently, the picture recording time can be maintained.
- the limited storage medium capacity can be utilized effectively and an important image can be stored with a high density.
- FIG. 1 is a diagram showing the structure of a monitoring apparatus using a video recording apparatus according to an embodiment of the invention
- FIG. 2 is a block diagram showing the structure of the video recording apparatus illustrated in FIG. 1, and
- FIG. 3 is a detailed block diagram showing the structure of video recording means illustrated in FIG. 2.
- FIG. 1 is a diagram showing the structure of a monitoring apparatus according to the embodiment of the invention.
- the monitoring apparatus comprises a plurality of image pick-up means (hereinafter referred to as monitor cameras) 1 a , 1 b , 1 c , provided in a plurality of places respectively, a video recording apparatus 2 for fetching a video signal sent from each of the monitor cameras 1 a , 1 b , 1 c , . . .
- a monitor device 3 for displaying the video signal on a screen and for displaying, on the screen, a video obtained by reproducing image data stored in data storage means such as a hard disk in the video recording apparatus 2 , and an alarm signal generating device 4 for sending an alarm signal to the video recording apparatus 2 .
- a plurality of alarm signal generating devices 4 (hereinafter referred to as sensors) are also provided corresponding to the monitoring places and, for example, detect the opening and closing operation of a door or a window or presence of movement, thereby sending an alarm signal to the video recording apparatus 2 .
- the video recording apparatus 2 sequentially fetches an image picked up by each of the monitor cameras 1 a , 1 b , 1 c , (a video signal) and compresses the image into data to be stored in the data storage means.
- a frame rate at which image data are to be stored is variable according to a time required for picture recording in the data storage means. For example, moreover, the image picked up by the monitor camera la installed in a place having a high degree of monitoring importance is set to be more often fetched than the image picked up by the monitor camera 1 c installed in a place having a low degree of monitoring importance and to be stored in the data storage means.
- the frame rate is increased to set one frame per second, for example, and the video signal sent from the monitor camera 1 is stored in the data storage means.
- the frame rate is reduced to set one frame per minute and the video signal is stored in the data storage means.
- the degree of monitoring importance is low when the alarm signal is not generated, the video signal is stored in the data storage means at a low frame rate.
- the degree of monitoring importance is increased. Therefore, the frame rate for the storage in the data storage means is increased.
- the frame rate is varied depending on the type of the alarm.
- the data compression rate of an image having a high degree of monitoring importance is reduced to enhance a picture quality, and the data compression rate of an image having a low degree of monitoring importance is increased to reduce the picture quality.
- a monitoring interval that is, a frame rate is dynamically changed and a data compression rate to be one of picture quality parameters is dynamically changed depending on a picture recording time and a degree of monitoring importance.
- a data compression rate to be one of picture quality parameters is dynamically changed depending on a picture recording time and a degree of monitoring importance.
- the frame rate is dynamically varied depending on the residual capacity of the data storage means, and furthermore, the data compression rate is also varied if necessary as will be described below.
- image data having a low degree of monitoring importance which are stored in the data storage means are identified through a flag attached every image data, for example, and are deleted or overwritten.
- image data having a high degree of monitoring importance are stored in the data storage means.
- the picture recording time and the residual capacity are based on a quantity of image data recorded in the data storage means. Therefore, any kinds of parameters based on the quantity of the recorded image data are applicable for setting the frame rate.
- FIG. 2 is a detailed block diagram showing the structure of the video recording apparatus 2 illustrated in FIG. 1.
- the video recording apparatus 2 comprises video input interface (IF) means 10 for fetching a video signal sent from a monitor camera 1 , alarm input interface (IF) means 11 for fetching an alarm signal sent from a sensor 4 , operation input interface (IF) means 12 for fetching an input signal through a manual input button 2 a (FIG.
- video recording means 13 for fetching a signal from the IF input means 10 , 11 and 12 and executing an arithmetic processing as will be described below in detail
- data storage means 14 for storing compressed digital image data
- video reproducing means 15 for reading the image data stored in the data storage means 14 and reproducing a video signal
- video output interface (IF) means 16 for outputting the video signal reproduced by the means 15 to a monitor device 3 .
- FIG. 3 is a detailed block diagram showing the structure of the video recording means 13 illustrated in FIG. 2.
- the video recording means 13 includes picture recording time mode changing means 20 for receiving a user operation input and changing a picture recording time (monitoring time) mode, and picture recording time mode storage means 21 for storing the picture recording time mode which is being operated and for changing the stored contents upon receipt of the output of the means 20 .
- the picture recording time mode is the same as a standard mode/triple mode to be conventionally used in a video tape (VTR), and includes a standard mode in which image data for a predetermined monitoring time are stored in the data storage means 14 , and a plurality of long time modes in which image data for a monitoring time which is predetermined times as long as the monitoring time of the standard mode (a mode in which a basic frame rate is set to 1/x (x is a predetermined number) of the standard mode, thereby storing image data having a capacity which is predetermined times as large as the capacity in the standard mode), one of which can be selected by a user.
- VTR video tape
- the video recording means 13 further includes residual picture recording time calculating means 22 for calculating a residual time required for picture recording in a picture recording time mode specified by the user, alarm control means 23 for receiving an alarm signal output from the sensor 4 through the IF input means 11 (FIG. 1), frame rate calculating means 24 which will be described below in detail, picture quality parameter changing means 25 for changing a picture quality parameter based on a result of the calculation of the means 24 or user specification, and picture quality parameter storage means 26 for storing a current picture quality parameter and changing the stored contents upon receipt of the output of the means 25 .
- the video recording means 13 further includes recalculation trigger generating means 27 for applying a recalculation trigger for frame rate calculation to the frame rate calculating means 24 , a timer 28 for interrupting the means 27 , a residual capacity timer 29 for applying a trigger to detect the residual capacity of the data storage means 14 , residual capacity detecting means 28 for detecting the residual capacity of the data storage means 14 and applying a recalculation trigger to the recalculation trigger generating means 27 upon receipt of a trigger signal from the timer 29 , and residual capacity storage means 31 for storing the residual capacity detected by the means 28 .
- the timer 28 and the timer 29 can also be shared.
- the video recording means 13 includes video input means 32 for fetching a video signal input from the monitor camera 1 , deciding whether or not the video signal is to be recorded based on an instruction sent from the frame rate calculating means 24 and outputting the video signal (image data) if the video signal is to be recorded (that is, image data which do not correspond to the frame rate calculated by the means 24 are not output and the image data are thinned so as not to be recorded in the storage means 14 ), and data processing means 33 for fetching the image data output from the means 32 , compressing the image data based on a data compression rate in the picture quality parameter stored in the picture quality parameter storage means 26 , and recording the compressed image data in the data storage means 14 .
- a value indicative of a degree of monitoring importance of the image data is added as a flag value to the image data to be recorded in the data storage means 14 by the data processing means 33 .
- the frame rate calculating means 24 recalculates a frame rate every time it receives a trigger signal for recalculation from the recalculation trigger generating means 27 . Moreover, the result of the recalculation is changed upon receipt of an alarm signal. Thus, the recalculated or changed frame rate is output to the video input means 32 and the parameter changing means 25 is fed back when the value of the picture quality parameter is to be changed based on the calculated frame rate.
- the frame rate calculating means 24 repeats the recalculation of the frame rate as described above, the frame rate becomes equal to or lower than a predetermined frame rate depending on the residual capacity of the data storage means 14 . If the frame rate is too low, the role of monitoring is not filled. In the embodiment, therefore, when the frame rate is equal to or lower than the predetermined frame rate as a result of the recalculation, the frame rate is fixed to the predetermined frame rate, and the picture quality parameter is then adjusted to lower a picture quality level.
- a monitoring image fetched from each of the monitor cameras 1 a , 1 b is stored in the data storage means 14 based on a frame rate and a data compression rate which are previously set for each degree of monitoring importance corresponding to a specified picture recording time mode.
- the frame rate and the data compression rate which are preset to be default values are determined to have such values that data for a predetermined monitoring time can be stored in the data storage means 14 based on a mean file capacity of monitoring image data or a mean alarm generating frequency.
- the storage capacity of the data storage means 14 may be read to calculate the frame rate and the picture quality parameter at each time based on the picture recording time mode.
- the frame rate calculating means 24 repeats the recalculation of a frame rate for each monitor camera or a data compression rate for each degree of monitoring importance based on the residual capacity of the data storage means 14 , the mean capacity of the stored image data and a residual time required till a predetermined monitoring time, and outputs a control instruction to the video input means 32 and the picture quality parameter changing means 25 such that monitoring image data for a predetermined monitoring time can be stored in the data storage means 14 .
- the monitoring image data having a high degree of monitoring importance are to be stored in the data storage means 14 .
- the monitoring image data having a low degree of monitoring importance which are stored in the data storage means 14 are identified based on the value of a flag added to the same image data, the image data having a low degree of monitoring importance are deleted to increase the residual capacity or the monitoring image data having a high degree of monitoring importance are overwritten to the image data having a low degree of monitoring importance.
- the above-mentioned operation is repeated by replacing the removable data storage means 14 with new data storage means.
- the video recording apparatus 2 reads the capacity, thereby setting a frame rate and a picture quality parameter at which the monitoring image data for the predetermined monitoring time can be stored in the data storage means 14 .
- the data storage means 14 In the case in which it is premised that the data storage means 14 is fixed and is not replaced, the stored data which are old in the past, that is, by the predetermined monitoring time from a current time are deleted or overwritten when new monitoring image data are fetched from the monitor camera. Consequently, monitoring image data for a past predetermined monitoring time are always stored in the data storage means 14 . In this case, the data storage means 14 is always set in a full state. Therefore, the capacity for the old stored data which can be deleted is regarded as a residual capacity so that the same operation as described above is carried out.
- the new monitoring image data having a high degree of importance are overwritten to the stored data having a low degree of importance when the residual capacity is reduced in the embodiment, only the monitoring image data having a high degree of importance can also be stored in the data storage means 14 when the residual capacity becomes constant.
- a storage region dedicated for each alarm should be assigned according to the type of an alarm and the monitoring image data should be stored in the corresponding dedicated region for each type of the alarm.
- the video recording apparatus 2 automatically stores the monitoring image data in the data storage means 14
- the data processing means 33 can also have the function of recompressing the stored data depending on a degree of importance and increasing the residual capacity in a spare time when the residual capacity is reduced.
- a part or all of the calculating process of the frame rate calculating means 24 may be carried out based on a prepared table such that a numeric value or a frame rate in the calculating process is guided to a value such as a residual recording time, a residual capacity or a picture quality parameter.
- a frame rate at which image data are to be recorded in a digital data storage medium is calculated depending on a recording time or a residual capacity. Therefore, it is possible to provide a video recording apparatus capable of storing image data for a predetermined time in the digital data storage medium even if image data having various capacities for recording are sequentially input.
Abstract
Description
- 1. Field of the Invention
- The present invention relates to a video recording apparatus for recording a static image in digital data, and more particularly to a video recording apparatus for compressing a fetched static image into data and recording the data in a random accessible digital data storage medium such as a hard disk or a magneto-optic disk and a monitoring apparatus using the video recording apparatus.
- 2. Description of the Related Art
- A monitoring apparatus installed in a station, a bank or various stores usually records an analog video fetched from the monitor camera in a video tape. In recent years, however, a computer technology has been developed and a storage medium having a large capacity such as a hard disk, a CD-R, an MD or a DVD which can store a large volume of digital data can be provided inexpensively. Thus, a monitoring apparatus for recording a digital image fetched from image pick-up means such as the monitor camera in a digital data storage medium such as a hard disk has spread.
- In the case in which a static image is to be fetched at a frame rate of one frame per second, for example, from a monitor camera installed in each of a plurality of monitoring places and is to be stored in a hard disk, even a hard disk having a large capacity is filled with monitoring data in a short time if the static image is stored as bit map data. Consequently, it is impossible to store, in the hard disk, monitoring data for a necessary monitoring time such as past 24 hours or the past week. For this reason, the static image is compressed into data and the data are stored, in the hard disk, as image data such as a JPEG (Joint Photographic Experts Group) or a GIF (Graphic Interchange Format).
- In the case in which the static image fetched from the monitor camera is to be compressed into data, a data compression rate to be one of picture quality parameters in the same image is changed so that the capacity of one image data is varied and the number of image data which can be stored in a hard disk having a fixed capacity is also varied. Furthermore, the capacity of one image data greatly fluctuates with a variation in the contents of an image. For this reason, there is generated such a situation that image data for a predetermined monitoring time cannot be stored in the hard disk having a certain fixed capacity. Consequently, there is also supposed such a situation that monitoring data cannot be recorded during the generation of an accident because the hard disk is filled.
- It is an object of the invention to provide a video recording apparatus capable of storing monitoring data for a predetermined monitoring time in a digital data storage medium and a monitoring apparatus using the video recording apparatus.
- The object can be achieved by a video recording apparatus for storing image data sequentially fetched from image pick-up means in a digital data storage medium at a predetermined frame rate, comprising frame rate calculating means for calculating the frame rate depending on a picture recording time of the image data into the digital data storage medium.
- The object can be achieved by a video recording apparatus for storing image data sequentially fetched from image pick-up means in a digital data storage medium at a predetermined frame rate, comprising frame rate calculating means for calculating the frame rate depending on a residual capacity of the digital data storage medium.
- It is preferable that the frame rate calculating means should calculate a frame rate by setting image data for a past predetermined time of image data fetched from the image pick-up means to be a value which can be stored in the digital data storage medium. Furthermore, the frame rate calculating means calculates a frame rate based on a value of a picture quality parameter when image data are to be compressed and stored in the digital data storage medium.
- When the calculated frame rate is equal to or lower than a predetermined value, moreover, the frame rate is fixed to the predetermined value to regulate the value of the picture quality parameter. In addition, the frame rate calculating means reads a value of a prepared table to calculate a frame rate in place of the computation, and furthermore, sets image data having a high degree of importance to have a fixed frame rate and image data having a low degree of importance to have a lower frame rate when the frame rate is equal to or lower than a predetermined value.
- It is more preferable that there should be provided data processing means for setting a data compression rate of image data having a high degree of importance to be lower than a data compression rate of image data having a low degree of importance, thereby storing the data in the digital data storage medium. Moreover, image data are set to have a high degree of importance when an alarm is generated or a trigger input is manually carried out. Furthermore, the data processing means deletes the image data having a low degree of importance or overwrites new image data having a high degree of importance to the image data having a low degree of importance when a residual capacity of the digital data storage medium is equal to or smaller than a predetermined capacity, and the degree of importance of image data is decided based on a value of a flag added to the image data.
- It is more preferable that the data processing means should store only image data having a high degree of importance in the digital data storage medium when a residual capacity of the digital data storage medium is equal to or smaller than a predetermined capacity. At this time, moreover, a storage region for storing only image data having a high degree of importance is preset to be a dedicated region for each type of an alarm.
- The object can be achieved by a monitoring apparatus comprising a monitor camera, an alarm generating device, the video recording apparatus having any of the structures described above which serves to input image data fetched from the monitor camera and an alarm fetched from the alarm generating device, and a monitor device for displaying, on a screen, the image data or image data obtained by reproducing image data stored in the digital data storage medium of the video recording apparatus.
- Thus, in the case in which the image data sequentially input are to be stored in the digital data storage medium, a frame rate for storage is dynamically changed according to a picture recording time or the residual capacity of the storage medium so that image data for a predetermined time can be stored in the storage medium. Consequently, the picture recording time can be maintained. At this time, if a priority is given to image data having a high degree of importance and the image data are stored with a high picture quality, the limited storage medium capacity can be utilized effectively and an important image can be stored with a high density.
- FIG. 1 is a diagram showing the structure of a monitoring apparatus using a video recording apparatus according to an embodiment of the invention,
- FIG. 2 is a block diagram showing the structure of the video recording apparatus illustrated in FIG. 1, and
- FIG. 3 is a detailed block diagram showing the structure of video recording means illustrated in FIG. 2.
- Embodiments of the invention will be described below with reference to the drawings.
- FIG. 1 is a diagram showing the structure of a monitoring apparatus according to the embodiment of the invention. The monitoring apparatus comprises a plurality of image pick-up means (hereinafter referred to as monitor cameras)1 a, 1 b, 1 c, provided in a plurality of places respectively, a
video recording apparatus 2 for fetching a video signal sent from each of themonitor cameras monitor device 3 for displaying the video signal on a screen and for displaying, on the screen, a video obtained by reproducing image data stored in data storage means such as a hard disk in thevideo recording apparatus 2, and an alarm signal generatingdevice 4 for sending an alarm signal to thevideo recording apparatus 2. A plurality of alarm signal generating devices 4 (hereinafter referred to as sensors) are also provided corresponding to the monitoring places and, for example, detect the opening and closing operation of a door or a window or presence of movement, thereby sending an alarm signal to thevideo recording apparatus 2. - The
video recording apparatus 2 sequentially fetches an image picked up by each of themonitor cameras monitor camera 1 c installed in a place having a low degree of monitoring importance and to be stored in the data storage means. - Moreover, since the degree of monitoring importance is high during day having many visitors, the frame rate is increased to set one frame per second, for example, and the video signal sent from the
monitor camera 1 is stored in the data storage means. When the degree of monitoring importance is low at night after the door is closed, the frame rate is reduced to set one frame per minute and the video signal is stored in the data storage means. Furthermore, since the degree of monitoring importance is low when the alarm signal is not generated, the video signal is stored in the data storage means at a low frame rate. When the door is opened at night so that the alarm signal is generated, the degree of monitoring importance is increased. Therefore, the frame rate for the storage in the data storage means is increased. Furthermore, in the case in which the degree of monitoring importance is varied depending on the type of the alarm signal, the frame rate is varied depending on the type of the alarm. The data compression rate of an image having a high degree of monitoring importance is reduced to enhance a picture quality, and the data compression rate of an image having a low degree of monitoring importance is increased to reduce the picture quality. - In the embodiment, thus, a monitoring interval, that is, a frame rate is dynamically changed and a data compression rate to be one of picture quality parameters is dynamically changed depending on a picture recording time and a degree of monitoring importance. On the other hand, it is necessary to store monitoring data for a predetermined monitoring time in data storage means having a fixed capacity. In the embodiment, therefore, the frame rate is dynamically varied depending on the residual capacity of the data storage means, and furthermore, the data compression rate is also varied if necessary as will be described below. Moreover, when the data storage means has no residual capacity and an image having a high degree of monitoring importance is fetched, image data having a low degree of monitoring importance which are stored in the data storage means are identified through a flag attached every image data, for example, and are deleted or overwritten. Thus, image data having a high degree of monitoring importance are stored in the data storage means.
- Not to mention, the picture recording time and the residual capacity are based on a quantity of image data recorded in the data storage means. Therefore, any kinds of parameters based on the quantity of the recorded image data are applicable for setting the frame rate.
- FIG. 2 is a detailed block diagram showing the structure of the
video recording apparatus 2 illustrated in FIG. 1. Thevideo recording apparatus 2 comprises video input interface (IF) means 10 for fetching a video signal sent from amonitor camera 1, alarm input interface (IF) means 11 for fetching an alarm signal sent from asensor 4, operation input interface (IF) means 12 for fetching an input signal through amanual input button 2 a (FIG. 1) provided on a panel of thevideo recording apparatus 2, video recording means 13 for fetching a signal from the IF input means 10, 11 and 12 and executing an arithmetic processing as will be described below in detail, data storage means 14 for storing compressed digital image data, video reproducing means 15 for reading the image data stored in the data storage means 14 and reproducing a video signal, and video output interface (IF) means 16 for outputting the video signal reproduced by themeans 15 to amonitor device 3. - FIG. 3 is a detailed block diagram showing the structure of the video recording means13 illustrated in FIG. 2. The video recording means 13 according to the embodiment includes picture recording time mode changing
means 20 for receiving a user operation input and changing a picture recording time (monitoring time) mode, and picture recording time mode storage means 21 for storing the picture recording time mode which is being operated and for changing the stored contents upon receipt of the output of themeans 20. - The picture recording time mode is the same as a standard mode/triple mode to be conventionally used in a video tape (VTR), and includes a standard mode in which image data for a predetermined monitoring time are stored in the data storage means14, and a plurality of long time modes in which image data for a monitoring time which is predetermined times as long as the monitoring time of the standard mode (a mode in which a basic frame rate is set to 1/x (x is a predetermined number) of the standard mode, thereby storing image data having a capacity which is predetermined times as large as the capacity in the standard mode), one of which can be selected by a user.
- The video recording means13 further includes residual picture recording
time calculating means 22 for calculating a residual time required for picture recording in a picture recording time mode specified by the user, alarm control means 23 for receiving an alarm signal output from thesensor 4 through the IF input means 11 (FIG. 1), frame rate calculatingmeans 24 which will be described below in detail, picture quality parameter changingmeans 25 for changing a picture quality parameter based on a result of the calculation of themeans 24 or user specification, and picture quality parameter storage means 26 for storing a current picture quality parameter and changing the stored contents upon receipt of the output of themeans 25. - The video recording means13 further includes recalculation trigger generating means 27 for applying a recalculation trigger for frame rate calculation to the frame rate calculating means 24, a
timer 28 for interrupting themeans 27, aresidual capacity timer 29 for applying a trigger to detect the residual capacity of the data storage means 14, residual capacity detecting means 28 for detecting the residual capacity of the data storage means 14 and applying a recalculation trigger to the recalculation trigger generating means 27 upon receipt of a trigger signal from thetimer 29, and residual capacity storage means 31 for storing the residual capacity detected by themeans 28. Thetimer 28 and thetimer 29 can also be shared. - Furthermore, the video recording means13 includes video input means 32 for fetching a video signal input from the
monitor camera 1, deciding whether or not the video signal is to be recorded based on an instruction sent from the frame rate calculating means 24 and outputting the video signal (image data) if the video signal is to be recorded (that is, image data which do not correspond to the frame rate calculated by themeans 24 are not output and the image data are thinned so as not to be recorded in the storage means 14), and data processing means 33 for fetching the image data output from themeans 32, compressing the image data based on a data compression rate in the picture quality parameter stored in the picture quality parameter storage means 26, and recording the compressed image data in the data storage means 14. A value indicative of a degree of monitoring importance of the image data is added as a flag value to the image data to be recorded in the data storage means 14 by the data processing means 33. - Based on the residual picture recording time calculated by the residual picture recording
time calculating means 22, the residual capacity of the data storage means 14 which is fetched from the residual capacity storage means 31 and a value of a picture quality parameter fetched from the picture quality parameter storage means 26, the frame rate calculating means 24 recalculates a frame rate every time it receives a trigger signal for recalculation from the recalculation trigger generating means 27. Moreover, the result of the recalculation is changed upon receipt of an alarm signal. Thus, the recalculated or changed frame rate is output to the video input means 32 and the parameter changing means 25 is fed back when the value of the picture quality parameter is to be changed based on the calculated frame rate. - When the frame rate calculating means24 repeats the recalculation of the frame rate as described above, the frame rate becomes equal to or lower than a predetermined frame rate depending on the residual capacity of the data storage means 14. If the frame rate is too low, the role of monitoring is not filled. In the embodiment, therefore, when the frame rate is equal to or lower than the predetermined frame rate as a result of the recalculation, the frame rate is fixed to the predetermined frame rate, and the picture quality parameter is then adjusted to lower a picture quality level.
- Moreover, when the calculated frame rate is equal to or lower than the predetermined frame rate, image data having a high degree of importance may be recorded at the predetermined frame rate and an image having a low degree of importance may be recorded at a frame rate which is much lower than the calculated frame rate. Thus, it is possible to maintain the frame rate of a picture quality having a high degree of importance without deteriorating the picture quality for each frame.
- Next, the operation of the monitoring apparatus having the structure described above will be described.
- In the case in which the
video recording apparatus 2 starts an operation in such a state that any image data are not stored in the data storage means 14, a monitoring image fetched from each of themonitor cameras - When the monitoring image data are gradually stored in the data storage means14, the frame rate calculating means 24 repeats the recalculation of a frame rate for each monitor camera or a data compression rate for each degree of monitoring importance based on the residual capacity of the data storage means 14, the mean capacity of the stored image data and a residual time required till a predetermined monitoring time, and outputs a control instruction to the video input means 32 and the picture quality parameter changing means 25 such that monitoring image data for a predetermined monitoring time can be stored in the data storage means 14.
- In the case in which an alarm signal is generated in such a state that the residual capacity of the data storage means14 is reduced, the monitoring image data having a high degree of monitoring importance are to be stored in the data storage means 14. In the embodiment, therefore, in the case in which such a situation is caused, the monitoring image data having a low degree of monitoring importance which are stored in the data storage means 14 are identified based on the value of a flag added to the same image data, the image data having a low degree of monitoring importance are deleted to increase the residual capacity or the monitoring image data having a high degree of monitoring importance are overwritten to the image data having a low degree of monitoring importance.
- In the case in which the monitoring image data for a predetermined monitoring time are thus stored in the data storage means14, the above-mentioned operation is repeated by replacing the removable data storage means 14 with new data storage means. In this case, if the capacity of the newly inserted data storage means 14 is different from that of the last data storage means 14, the
video recording apparatus 2 reads the capacity, thereby setting a frame rate and a picture quality parameter at which the monitoring image data for the predetermined monitoring time can be stored in the data storage means 14. - In the case in which it is premised that the data storage means14 is fixed and is not replaced, the stored data which are old in the past, that is, by the predetermined monitoring time from a current time are deleted or overwritten when new monitoring image data are fetched from the monitor camera. Consequently, monitoring image data for a past predetermined monitoring time are always stored in the data storage means 14. In this case, the data storage means 14 is always set in a full state. Therefore, the capacity for the old stored data which can be deleted is regarded as a residual capacity so that the same operation as described above is carried out.
- While the new monitoring image data having a high degree of importance are overwritten to the stored data having a low degree of importance when the residual capacity is reduced in the embodiment, only the monitoring image data having a high degree of importance can also be stored in the data storage means14 when the residual capacity becomes constant. In this case, it is preferable that a storage region dedicated for each alarm should be assigned according to the type of an alarm and the monitoring image data should be stored in the corresponding dedicated region for each type of the alarm.
- While the case in which the
video recording apparatus 2 automatically stores the monitoring image data in the data storage means 14 has been described in the embodiment, it is also possible to provide such a structure that an operator for monitoring themonitor device 3 manually inputs a picture recording trigger signal to record the same monitoring image data as monitoring image data having a high degree of importance in the data storage means 14 in the middle of the automatic operation of thevideo recording apparatus 2. Moreover, the data processing means 33 can also have the function of recompressing the stored data depending on a degree of importance and increasing the residual capacity in a spare time when the residual capacity is reduced. - According to the embodiment described above, it is possible to ensure the picture quality of the important monitoring image data while maintaining a picture recording time for a predetermined monitoring time, and furthermore, to reliably record the monitoring image data when an alarm is generated. Thus, it is possible to record the monitoring image data having a high degree of importance as much as possible.
- In the embodiment described above, a part or all of the calculating process of the frame rate calculating means24 may be carried out based on a prepared table such that a numeric value or a frame rate in the calculating process is guided to a value such as a residual recording time, a residual capacity or a picture quality parameter. With such a structure, a complexity can be reduced and a calculating speed can be increased.
- According to the invention, a frame rate at which image data are to be recorded in a digital data storage medium is calculated depending on a recording time or a residual capacity. Therefore, it is possible to provide a video recording apparatus capable of storing image data for a predetermined time in the digital data storage medium even if image data having various capacities for recording are sequentially input.
- While only certain embodiments of the invention have been specifically described herein, it will be apparent that numerous modifications may be made thereto without departing from the spirit and scope of the invention.
Claims (17)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2000231566A JP2002044609A (en) | 2000-07-31 | 2000-07-31 | Picture recorder and monitoring device |
JPP.2000-231566 | 2000-07-31 |
Publications (2)
Publication Number | Publication Date |
---|---|
US20020015582A1 true US20020015582A1 (en) | 2002-02-07 |
US6795642B2 US6795642B2 (en) | 2004-09-21 |
Family
ID=18724390
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/918,172 Expired - Fee Related US6795642B2 (en) | 2000-07-31 | 2001-07-30 | Video recording apparatus and monitoring apparatus |
Country Status (2)
Country | Link |
---|---|
US (1) | US6795642B2 (en) |
JP (1) | JP2002044609A (en) |
Cited By (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050018049A1 (en) * | 2003-07-22 | 2005-01-27 | Sony Corporation | Imaging apparatus, imaging system and method thereof |
US20060152636A1 (en) * | 2003-10-20 | 2006-07-13 | Matsushita Electric Industrial Co | Multimedia data recording apparatus, monitor system, and multimedia data recording method |
US20070139529A1 (en) * | 2005-06-02 | 2007-06-21 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Dual mode image capture technique |
EP1973351A1 (en) * | 2006-01-13 | 2008-09-24 | Gaintech Co. Ltd. | Monitor |
US20090046175A1 (en) * | 2007-08-17 | 2009-02-19 | Hitoshi Ozawa | Image processing apparatus, imaging apparatus, image processing method, and program |
US20130028570A1 (en) * | 2011-07-27 | 2013-01-31 | Hitachi, Ltd. | Video Recording Apparatus, Video Recording System and Video Recording Method |
US20140286620A1 (en) * | 2013-03-21 | 2014-09-25 | Panasonic Corporation | Video recording apparatus and camera recorder |
JP2016026354A (en) * | 2015-09-18 | 2016-02-12 | 株式会社ニコン | Electronic device |
US20160247484A1 (en) * | 2013-11-06 | 2016-08-25 | Huawei Device Co., Ltd. | Method for Generating Display Frame and Terminal Device |
US20160365125A1 (en) * | 2015-06-12 | 2016-12-15 | JVC Kenwood Corporation | Recording device, recording method, and non-transitory recording medium |
WO2017045418A1 (en) * | 2015-09-17 | 2017-03-23 | Tcl移动通信科技(宁波)有限公司 | Memory remaining capacity-based method and system for adjusting camera frame rate |
US20170083757A1 (en) * | 2015-09-17 | 2017-03-23 | Toyota Jidosha Kabushiki Kaisha | Lifelog recording system |
US10003762B2 (en) | 2005-04-26 | 2018-06-19 | Invention Science Fund I, Llc | Shared image devices |
US10097756B2 (en) | 2005-06-02 | 2018-10-09 | Invention Science Fund I, Llc | Enhanced video/still image correlation |
CN109379563A (en) * | 2018-10-30 | 2019-02-22 | 华南师范大学 | The method and system of monitor video data storage management |
US10255491B2 (en) | 2010-11-19 | 2019-04-09 | Nikon Corporation | Guidance system, detection device, and position assessment device |
CN112995558A (en) * | 2019-12-17 | 2021-06-18 | Tcl新技术(惠州)有限公司 | Video file storage method and device and storage medium |
CN114710674A (en) * | 2022-06-06 | 2022-07-05 | 青岛亨通建设有限公司 | Building construction monitoring data storage method |
CN116744006A (en) * | 2023-08-14 | 2023-09-12 | 光谷技术有限公司 | Video monitoring data storage method based on block chain |
Families Citing this family (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CA2344930C (en) * | 2001-04-23 | 2007-04-17 | Leitch Technology International Inc. | Data monitoring system |
JP4191398B2 (en) * | 2001-08-31 | 2008-12-03 | パナソニック株式会社 | Surveillance image recording device |
US7545434B2 (en) * | 2002-02-04 | 2009-06-09 | Hewlett-Packard Development Company, L.P. | Video camera with variable image capture rate and related methodology |
JP2003244642A (en) | 2002-02-14 | 2003-08-29 | Funai Electric Co Ltd | Digital video recorder and video recording method thereof |
GB2394851A (en) * | 2002-10-30 | 2004-05-05 | Hewlett Packard Co | A camera having a user operable control for producing a saliency signal representative of a user's interest in a scene being imaged |
GB0403556D0 (en) * | 2004-02-18 | 2004-03-24 | Visimetrics Uk Ltd | Digital closed circuit television system |
JP2007251519A (en) * | 2006-03-15 | 2007-09-27 | Fujitsu Ltd | Video data storage device and video data storage method |
JP4711137B2 (en) * | 2006-05-25 | 2011-06-29 | 日本ビクター株式会社 | Image recording device |
JP2008167101A (en) * | 2006-12-28 | 2008-07-17 | Hitachi Ltd | Video recorder for monitoring |
JP4735597B2 (en) * | 2007-04-25 | 2011-07-27 | 日本ビクター株式会社 | Image recording apparatus and image recording / reproducing apparatus |
JP2008301357A (en) | 2007-06-01 | 2008-12-11 | Fujifilm Corp | Photographing apparatus and method for controlling same |
US20110221913A1 (en) * | 2007-08-09 | 2011-09-15 | Panasonic Corporation | Recorder |
JP2009200757A (en) * | 2008-02-21 | 2009-09-03 | Fujitsu Ltd | Video data processing apparatus, program, and method |
JP5332240B2 (en) * | 2008-03-11 | 2013-11-06 | 富士通株式会社 | Drive recorder and computer program |
JP2010004331A (en) * | 2008-06-20 | 2010-01-07 | Panasonic Corp | Image recorder and image recording method |
US8594182B1 (en) * | 2009-05-18 | 2013-11-26 | Verint Systems, Inc. | Systems and methods for video rate control |
JP5091966B2 (en) * | 2010-03-23 | 2012-12-05 | 株式会社日立製作所 | Surveillance video recording apparatus, surveillance video recording method, and program |
JP5146523B2 (en) * | 2010-11-26 | 2013-02-20 | 株式会社デンソー | Vehicle behavior data recording device |
CN103024329B (en) * | 2013-01-04 | 2016-04-13 | 四川长虹电子系统有限公司 | A kind of memory management method of monitoring video |
US9805432B2 (en) | 2014-09-08 | 2017-10-31 | Nxp Usa, Inc. | Data logging system and method |
JP6520024B2 (en) * | 2014-09-09 | 2019-05-29 | フジテック株式会社 | Crime prevention and surveillance camera system and method of managing photographed image thereof |
JP6663229B2 (en) * | 2016-01-20 | 2020-03-11 | キヤノン株式会社 | Information processing apparatus, information processing method, and program |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5689442A (en) * | 1995-03-22 | 1997-11-18 | Witness Systems, Inc. | Event surveillance system |
US6226447B1 (en) * | 1995-08-18 | 2001-05-01 | Matsushita Electric Industrial Co., Ltd. | Video signal recording and reproducing apparatus |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5724475A (en) * | 1995-05-18 | 1998-03-03 | Kirsten; Jeff P. | Compressed digital video reload and playback system |
US5982418A (en) * | 1996-04-22 | 1999-11-09 | Sensormatic Electronics Corporation | Distributed video data storage in video surveillance system |
JPH09322154A (en) | 1996-05-31 | 1997-12-12 | Sony Corp | Monitor video device |
US5862342A (en) * | 1996-10-31 | 1999-01-19 | Sensormatic Electronics Corporation | Intelligent video information management system with information archiving capabilities |
JPH10228729A (en) | 1997-02-17 | 1998-08-25 | Sony Corp | Signal recording method and device therefor, signal reproducing method and device therefor and signal recording and reproducing method and device therefor |
JPH1169298A (en) | 1997-08-11 | 1999-03-09 | Secom Co Ltd | Supervisory image recorder |
JP3892143B2 (en) | 1998-04-24 | 2007-03-14 | 松下電器産業株式会社 | Image recording device |
JP3097665B2 (en) | 1998-06-19 | 2000-10-10 | 日本電気株式会社 | Time-lapse recorder with anomaly detection function |
-
2000
- 2000-07-31 JP JP2000231566A patent/JP2002044609A/en active Pending
-
2001
- 2001-07-30 US US09/918,172 patent/US6795642B2/en not_active Expired - Fee Related
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5689442A (en) * | 1995-03-22 | 1997-11-18 | Witness Systems, Inc. | Event surveillance system |
US6226447B1 (en) * | 1995-08-18 | 2001-05-01 | Matsushita Electric Industrial Co., Ltd. | Video signal recording and reproducing apparatus |
Cited By (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8144763B2 (en) * | 2003-07-22 | 2012-03-27 | Sony Corporation | Imaging apparatus, imaging system and method thereof |
US20050018049A1 (en) * | 2003-07-22 | 2005-01-27 | Sony Corporation | Imaging apparatus, imaging system and method thereof |
US20060152636A1 (en) * | 2003-10-20 | 2006-07-13 | Matsushita Electric Industrial Co | Multimedia data recording apparatus, monitor system, and multimedia data recording method |
US7609941B2 (en) | 2003-10-20 | 2009-10-27 | Panasonic Corporation | Multimedia data recording apparatus, monitor system, and multimedia data recording method |
US10003762B2 (en) | 2005-04-26 | 2018-06-19 | Invention Science Fund I, Llc | Shared image devices |
US20070139529A1 (en) * | 2005-06-02 | 2007-06-21 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Dual mode image capture technique |
US10097756B2 (en) | 2005-06-02 | 2018-10-09 | Invention Science Fund I, Llc | Enhanced video/still image correlation |
EP1973351B1 (en) * | 2006-01-13 | 2015-12-30 | Gaintech Co. Ltd. | Monitor |
EP1973351A1 (en) * | 2006-01-13 | 2008-09-24 | Gaintech Co. Ltd. | Monitor |
US20090046175A1 (en) * | 2007-08-17 | 2009-02-19 | Hitoshi Ozawa | Image processing apparatus, imaging apparatus, image processing method, and program |
US8810689B2 (en) * | 2007-08-17 | 2014-08-19 | Sony Corporation | Image processing apparatus, imaging apparatus, image processing method, and program for processing image data at a plurality of frame rates |
US10255491B2 (en) | 2010-11-19 | 2019-04-09 | Nikon Corporation | Guidance system, detection device, and position assessment device |
US20130028570A1 (en) * | 2011-07-27 | 2013-01-31 | Hitachi, Ltd. | Video Recording Apparatus, Video Recording System and Video Recording Method |
US8780203B2 (en) * | 2011-07-27 | 2014-07-15 | Hitachi, Ltd. | Video recording apparatus, video recording system and video recording method executed by video recording apparatus |
US9008488B2 (en) * | 2013-03-21 | 2015-04-14 | Panasonic Intellectual Property Management Co., Ltd. | Video recording apparatus and camera recorder |
US20140286620A1 (en) * | 2013-03-21 | 2014-09-25 | Panasonic Corporation | Video recording apparatus and camera recorder |
US20160247484A1 (en) * | 2013-11-06 | 2016-08-25 | Huawei Device Co., Ltd. | Method for Generating Display Frame and Terminal Device |
US20160365125A1 (en) * | 2015-06-12 | 2016-12-15 | JVC Kenwood Corporation | Recording device, recording method, and non-transitory recording medium |
JP2017005561A (en) * | 2015-06-12 | 2017-01-05 | 株式会社Jvcケンウッド | Recording device, recording method and recording program |
US9865307B2 (en) * | 2015-06-12 | 2018-01-09 | JVC Kenwood Corporation | Recording device, recording method, and non-transitory recording medium |
US20170083757A1 (en) * | 2015-09-17 | 2017-03-23 | Toyota Jidosha Kabushiki Kaisha | Lifelog recording system |
US20170302851A1 (en) * | 2015-09-17 | 2017-10-19 | Jrd Communication Inc. | A Method and System to Adjust the Camera Frame Rate Based on the Remaining Memory Capacity |
US10133917B2 (en) * | 2015-09-17 | 2018-11-20 | Toyota Jidosha Kabushiki Kaisha | Lifelog recording system |
WO2017045418A1 (en) * | 2015-09-17 | 2017-03-23 | Tcl移动通信科技(宁波)有限公司 | Memory remaining capacity-based method and system for adjusting camera frame rate |
JP2016026354A (en) * | 2015-09-18 | 2016-02-12 | 株式会社ニコン | Electronic device |
CN109379563A (en) * | 2018-10-30 | 2019-02-22 | 华南师范大学 | The method and system of monitor video data storage management |
CN112995558A (en) * | 2019-12-17 | 2021-06-18 | Tcl新技术(惠州)有限公司 | Video file storage method and device and storage medium |
CN114710674A (en) * | 2022-06-06 | 2022-07-05 | 青岛亨通建设有限公司 | Building construction monitoring data storage method |
CN116744006A (en) * | 2023-08-14 | 2023-09-12 | 光谷技术有限公司 | Video monitoring data storage method based on block chain |
Also Published As
Publication number | Publication date |
---|---|
US6795642B2 (en) | 2004-09-21 |
JP2002044609A (en) | 2002-02-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6795642B2 (en) | Video recording apparatus and monitoring apparatus | |
US5471239A (en) | Detecting scene changes | |
US6704434B1 (en) | Vehicle driving information storage apparatus and vehicle driving information storage method | |
JP4456675B2 (en) | Video recording / reproducing apparatus and video recording / reproducing method | |
US5583791A (en) | Recording-reproduction apparatus | |
EP0577377B1 (en) | Image processing apparatus and method | |
JP3754320B2 (en) | Image signal processing device | |
US7450823B2 (en) | Hard disk recorder and video record apparatus | |
US20060153539A1 (en) | Motion image recording device | |
US20050212927A1 (en) | Electronic camera and recording medium recording image reproduction program | |
KR100200874B1 (en) | Selective recording apparatus and method by movement detection | |
JP5536464B2 (en) | Imaging device | |
JP2001238175A (en) | Information recording and reproducing device | |
KR970006972B1 (en) | Editing system | |
US6965728B1 (en) | Digital recording apparatus | |
CN100534161C (en) | Information recording apparatus | |
JP4348683B2 (en) | Image data recording method and recording / reproducing apparatus | |
US7076103B2 (en) | Method, apparatus, and program for image data compression | |
US6731862B1 (en) | Video image edit device | |
JP4281980B2 (en) | Surveillance recording apparatus and recording parameter setting method for surveillance recording apparatus | |
JP4006663B2 (en) | Disc recording device | |
JP2001243708A (en) | Recording system, recording/reproducing system, medium and information assembly | |
JPH11126430A (en) | Information recording device and moving image recording device | |
JP3690414B2 (en) | Imaging device | |
JPH0491558A (en) | Picture storing device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MATSUMOTO, KAZUYA;TSUZUKI, KAZUHISA;UMEZAWA, MEGUMI;AND OTHERS;REEL/FRAME:012139/0157 Effective date: 20010830 |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FEPP | Fee payment procedure |
Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FEPP | Fee payment procedure |
Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
REMI | Maintenance fee reminder mailed | ||
LAPS | Lapse for failure to pay maintenance fees | ||
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20160921 |