WO2008117989A1

WO2008117989A1 - Remote monitoring system and method thereof

Info

Publication number: WO2008117989A1
Application number: PCT/KR2008/001698
Authority: WO
Inventors: Cheon Ki Jeon; Bum Su Kim; Sun Hee Lee; Seung Woo Jang; Dong Hoon Lee; Taek Soo Kim
Original assignee: Home Secu. Net. Co., Ltd.
Priority date: 2007-03-26
Filing date: 2008-03-26
Publication date: 2008-10-02
Also published as: KR100767065B1; CN101681397A

Abstract

There is provided a remote monitoring system and method which is capable of collectively monitoring and managing objects with ease and efficiency at a remote place. The remote monitoring system and method includes an integration apparatus with a monitoring function, a communication function and a video providing function which is installed in a residence of an object to be monitored. The remote monitoring system and method has an advantage of constantly monitoring motion of the object at a local control center, informing the object that the local control center attempts to confirm a video in occurrence of abnormality of the object, and then confirming the video to visually seize the presence or not of abnormality, thereby correctly seizing the presence or not of abnormality of the object based on a pattern of life of the object and minimizing possibility of trespass on the object's privacy. In addition, the remote monitoring system and method has an advantage of allowing a local control center to adjust grounds for abnormality decision according to forms of residence and life style of an object to be monitored, and extremely simplifying a configuration of the integration apparatus, thereby reducing an installation burden while allowing effective remote management reflecting situations of individual objects to be monitored.

Description

Description REMOTE MONITORING SYSTEM AND METHOD THEREOF

Technical Field

[1] The present invention relates to a remote monitoring system and method, and more particularly, to a remote monitoring system and method which is capable of collectively monitoring and managing objects with ease and efficiency at a remote place. Background Art

[2] In general, monitoring systems refer to systems for monitoring certain places through a plurality of monitoring means and taking a measure against and making later confirmation about abnormality, if found. Such monitoring systems have application to buildings, industrial settings, stores and repositories, agencies dealing in high- value items, etc. and have been recently and actively introduced into apartment complexes, even individual homes and so on. Particularly, as a kind of monitoring system, a so- called digital video recorder (DVR) has been actively introduced which has basic functions of taking a photograph of an object to be monitored, recording obtained video in a digital storage, and confirming the recorded video if desired, and additionally possibly a monitoring function through various sensors and a communication function.

[3] More additionally, such a DVR may have various select menu functions including operation monitor, sensor utilization, connection recording, camera handling (Pan/Tilt/Zoom/Control), image enlargement/edition, etc., and a function of semipermanently storing video and monitoring data in a hard disk or the like. In recent years, such a DVR has been developed as much as to retrieve stored video for every hour, date, camera and event and deliver monitor information to a remote place.

[4] Fig. 1 shows a general remote monitoring system. As shown in the figure, the general remote monitoring system includes a monitor information generating and processing unit 10 that is connected with one or more monitoring cameras and microphones and various kinds of sensors for collecting and outputting video/audio information and sensor information provided from these components, provides control signals for these components based on a control signal from the outside, and provides an alert signal to a speaker as the case may be; a remote monitoring apparatus 20 that converts the video/audio information and sensor information, which are received from the monitor information generating and processing unit 10, into digital signals to be stored, and sends out some of the stored monitor information (i.e., the video/audio information and sensor information) via a main communication network or an alternate communication network; and a center server 30 that receives the monitor information from the remote monitoring apparatus 20 via the main communication network or the alternate communication network, detects the presence or not of abnormality of a monitored object in nearly real-time, and takes a measure against the abnormality if any. The center server 30, playing a role as a control center to manage a plurality of remote monitoring apparatuses at a remote place notifies a police station and a security of the fact that there occurs abnormality if any, and/or notifies a user, who requests the object to be monitored, of the fact by means of voice or characters.

[5] Referring to Fig. 1, the remote monitoring apparatus 20 generally includes a video/ audio processor 21 that converts the video/audio signal, which is received from the monitor information generating and processing unit 10, into a digital video/audio signal; a monitor signal processor 22 that converts the sensor information, which is received from the monitor information generating and processing unit 10, into a proper digital signal and delivers control information requested by a controller 24 to the monitor information generating and processing unit 10 if necessary; a monitor information storage 23 that stores the digitized monitor information (video/audio information and sensor information); and the controller 24 that controls the video/audio processor 21, the monitor signal processor 22 and the monitor information storage 23 and provides some selected from the monitor information stored in the monitor information storage 23 to a wired communication unit 26 having a modem suitable for a variety of communication networks or a wireless communication unit 25 having communication means suitable for a variety of wireless communication networks. The wired communication unit 26 may further include local standard communication means through which a user can control the remote monitoring apparatus 20, and the video/audio processor 21 may further include video ports through which standard video signals (NTSC/PAL) can be provided to external monitor devices.

[6] The general remote monitoring apparatus 20 as configured above, that is, an apparatus which is commonly called DVR, has a tendency to become complicated and diverse in its functions, which may require high installation and maintenance costs, and thus it can be said that it is not in reason to popularize the remote monitoring apparatus.

[7] Fig. 2 is a view showing an example of a manager interface (typically an interface of a management application which is called a Central Management System that manages a plurality of DVRs) of the center server shown in Fig. 1.

[8] As shown in Fig. 2, a user interface 40 of a central control center includes a list region 42 in which name items representative of a plurality of DVR systems to be managed are listed, and a video display region 45 in which monitor video of a DVR system selected in the list region 42 is displayed. In this interface 40, as soon as an event (for example, an event by a schedule, an event by sensor situation (sensor operation, motion detection, etc) or the like) occurs, a name item of a DVR system is highlighted in a color changing or flickering manner to allow a manager to confirm the occurrence of the event. Thus, when the manager confirms the list region and selects the DVR system in which abnormality occurs, he/she can confirm the current situations delivered by the DVR system. In this course, the manager can also confirm previous situations stored in the DVR system through a remote control of the DVR system determined to have abnormality.

[9] However, in such an item list-typed management system, a specialized manager must always watch the item list and immediately cope with the event occurrence to seize trespass on or damage to an object to be monitored. In addition, such an approach imposes an increased burden on the manager with increased number of subscribers to this service. Further, since the manager can confirm any subscribers' videos, controversy over trespass on subscribers'privacy is ceaseless.

[10] Fig. 3 shows a configuration of a general remote security system to manage status of security for many subscribers. As shown in Fig. 3, this security system includes security controllers 50 and 60 (which may be also called 'main apparatus') as a core of this system, which monitor one monitor zone in interlocking with one or more sensors 51 and 52 and are connected to a center server 80 via a communication network 70 including a PSTN (Public Switched Telephone Network), an LAN (Local Area Network), etc. The center server 80 confirms whether or not the monitor (security) zone is abnormal through monitor information provided from the security controllers 50 and 60. Depending on whether or not the security zone monitored by the center server 80 is abnormal, additional follow-up measures are taken such as mobilization of relevant security staffs to the security zone, notification to the police, getting in touch with a user (subscriber), etc.

[11] Fig. 4 shows an example of a basic user interface 90 of a central controller which operates in the center server of the security system shown in Fig. 3. As shown in Fig. 4, in this user interface 90, simplified log information 92 is used to monitor several hundreds security zones and pieces of information on events (called an 'armed' state and, when the 'armed' state is released, called a 'disarmed' state) collected by a security controller are listed in a collection order in a shown log display region 91. A manager confirms these pieces of information and, if abnormality occurs continuously or sequentially in a security zone for a certain period of time, lets relevant security staffs mobilize to the security zone in order to confirm the abnormality.

[12] However, in the above-mentioned security system, if an event (or abnormality) occurs due to trouble of the security controller or sensors or external environments (for example, alien substance such as foliage, paper, vinyl and the like, a cat, a dog, a bird, etc.), man power may be wastefully utilized and it is not possible to confirm what exactly happened in the spot, with the exception of direct visit to the spot.

[13] In addition to the above-mentioned two kinds of monitoring means, there is a case where a simple Web camera is utilized as a monitoring means. In this case, however, the Web camera has a function of merely confirming a video at a desired point of time and possibly a function of sensing motion of an object and storing and transmitting a video of the sensed motion.

[14] In other words, the above-mentioned diverse monitoring systems aimed to immediately seize an exceptional situation occurring in an object to be monitored and take prompt follow-up measures to the situation. Accordingly, the ultimate purpose of the above-mentioned diverse monitoring systems is to make it possible to monitor the object or a monitor zone manlessly at a remote place even when a manager does not reside in the object or the monitor zone, and to seize an abnormal situation or a point of time when a sensor senses any motion to take prompt follow-up measures to the abnormal situation.

[15] In recent years, there have been studied effective protection measures against social negligence of people who live alone, particularly weak solitary old persons and the disabled in solitude, which is being on the rise as a big social problem. Although some of solitary old persons and disabled persons are under the care of the government and volunteer aid agencies, it is substantially difficult to make a daily visit to them to confirm their personal troubles and thus it is the actual situation that they are visited at certain intervals or receive call for their welfare.

[16] In addition, since even such minimal protection can not be given to solitary old persons and disabled persons who are below the standard, they often may suffer from disease or even die under no proper medical care and, in some cases, their death may be revealed after a long time.

[17] In addition, there is an increasing tendency for old persons to spend their declining years alone in social environments that are aging and nuclearized in family, and to live in towns of the aged or sanitariums alone.

[18] Accordingly, although there is a keen need for a system to monitor such physically weak persons, the current monitoring system has only a low level of making a periodic visit to objects and a phone call for their welfare. In addition, when the current monitoring system confirms images of residence of objects, it may give a reluctant feeling to objects due to trespass on their privacy. In addition, it is nearly impossible to directly apply the current monitoring method and system, which uses various kinds of sensors to immediately respond to an abnormal event, to the actual circumferences because it does not meet the object and operation process of an ideal monitoring system of effectively seizing conditions of objects who are constantly moving in their residence. [19] Furthermore, even with the current various monitoring systems, since a manager in a central center that operates these systems has to continue to monitor and manage abnormal situations, low-income solitary old persons and disabled persons are hardly benefited from such systems due to high installation and operating expenses. Disclosure of Invention Technical Problem

[20] It is therefore an object of the present invention to provide a novel remote monitoring system and method for constantly monitoring a solitary object in a residence, which includes an integration apparatus with a monitoring function, a communication function and a video providing function which is installed in a residence of an object to be monitored, and which is capable of constantly monitoring motion of the object at a local control center, informing the object that the local control center attempts to confirm a video in occurrence of abnormality of the object, and then confirming the video to visually seize the presence or not of abnormality, thereby correctly seizing the presence or not of abnormality of the object based on a pattern of life of the object and minimizing possibility of trespass on the object's privacy.

[21] It is another object of the present invention to provide a novel remote monitoring system and method which includes an integration apparatus including an object detecting sensor, an external sensor and a camera for video transmission by remote manipulation and which is capable of allowing a local control center, which receives a sensor signal provided from the integration apparatus via a communication network, to set abnormality situations according to a pattern of behavior of an object to be monitored, so that the local control center can adjust grounds for abnormality decision according to forms of residence and life style of the object, and extremely simplifying a configuration of the integration apparatus, thereby reducing an installation burden while allowing effective management reflecting situations of individual objects to be monitored.

[22] It is still another object of the present invention to provide a novel remote monitoring system and method which is capable of notifying a local control center manager of abnormality seized by the local control center through a separate information widow in preference to other works performed by the manager, thereby providing the manager with composure, and sending the abnormality information to a mobile terminal of the manager in the absence of the manager, thereby reducing the manager's burden.

[23] It is still another object of the present invention to provide a novel remote monitoring system and method which is capable of providing high ability to measure against abnormality of an object by installing a separate central control center that integrally manages a plurality of local control centers.

[24] It is still another object of the present invention to provide a novel remote monitoring system and method which is capable of allowing an object to ask a local control center for help in an emergency irrespective of a setting environment by adding a wired/wireless means to notify an emergency situation to an integration apparatus.

[25] It is still another object of the present invention to provide a novel remote monitoring system and method which is capable of effectively coping with an emergency situation of an object by adding a wireless receiving means to notify to an integration apparatus and combining a TV remote control, which is likely to be carried by an object, and means to select an emergency situation. Technical Solution

[26] To achieve the above objects, according to an aspect, the present invention provides a remote monitoring system including: a plurality of integration apparatuses each including a sensor unit that is installed in a residence of an object to be monitored and detects motion of the object, a camera unit added with means to allow the object to recognize actuation of the camera unit, a selecting unit through which one of a plurality of behavior states of the object including off/sleeping/action states is selected, and a communication unit; and a plurality of local control centers that are connected to the plurality of integration apparatuses, respectively, via a communication network, each local control center detecting the behavior states of a corresponding object based on signals of the sensor unit and the selecting unit provided from a corresponding integration apparatus and actuating the camera unit after informing the object of actuation of the camera unit if the behavior states of the object are out of a limited range set for the object, so that the presence or not of abnormality of the object can be seized, each of the plurality of local control centers including: a monitoring server that stores the limited range of the behavior states for each integration apparatus, based on a configuration of the sensor unit depending on an installation environment of the integration due to a structure of the residence of the object and conditions of the object, seizes the behavior states of the object based on the stored limited range of the behavior states, provides object-related information to a manager in occurrence of abnormality, and provides a video of the object conditions to the manager through the camera unit; and a database including the object-related information.

[27] Preferably, each of the plurality of integration apparatuses includes: at least one sensing means that detects behavior of the object to be monitored; a camera that acquires a video; a camera actuation indicator that indicates actuation of the camera; a sounder that processes a sound signal; a communication unit that exchanges signals with a remote place; and a controller that provides information of the sensing means through the communication unit, actuates the camera and the camera actuation indicator according to a selection from the remote place, and provides a video to the remote place through the camera. Preferably, the sensing means includes at least one selected from a group consisting of an object detecting sensor, a doorway sensor and an RFID sensor.

[28] Preferably, the sensing means further includes an internal button or means for receiving a radio signal and the controller provides information indicating emergency to the remote place via the communication unit when a signal is inputted to the controller through the internal button or the radio signal receiving means.

[29] Preferably, each of the local control center includes a monitoring server that receives a signal from each of the plurality of integration apparatus, seizes behavior of the object based on a reference value set for each of the integration apparatus, provides object-related information to a manager in occurrence of abnormality, and receives and provides a video in order to seize conditions of the object; and a database including the object-related information.

[30] Preferably, the monitoring server includes a notification means that provides abnormality occurrence information in preference to other works in occurrence of abnormality of the object, an observation means that notifies actuation of the camera and actuates the camera by remotely manipulating the integration apparatus of the object according to a selection of a manager in interlocking with the notification means and provides current situations of the sensor unit of the integration apparatus, and a character message transmission means that transmits a character message to the manager in the absence of a follow-up measure by the manager after the notification means is displayed.

[31] According to another aspect, the present invention provides a remote monitoring method of monitoring and confirming the presence or not of abnormality of an solitary object to be monitored at a remote place using an integration apparatuses including a sensor unit that includes an object detecting sensor, a camera unit added with a camera actuation indicator, and a communication unit that transmits/receives information via a communication network, and a monitoring server in interlocking with the integration apparatus, the method including: a registration step of registering the integration apparatus by storing, in the monitoring server, individual setup information depending on a configuration of the sensor unit of the integration apparatus, which is changed according to an installation environment of the integration apparatus, and the nature of the object, and identification information of the integration apparatus; an observation step of determining, by the monitoring server that received sensing information from the integration apparatus, the presence or not of abnormality of the object based on the individual setup information; a notification step of notifying, by the monitoring server, a manager of the fact that there occurs abnormality in the object in the observation step; and a confirmation step of confirming, by the monitoring server, the object with a video through the camera unit after notifying the object of the fact that the video is to be confirmed by means of the camera actuation indicator of the integration apparatus in the notification step.

[32] Preferably, the registration step includes a step of registering the kind of sensors in consideration of configuration and installation position of the sensors of the integration and a characteristic of installation location of the sensors and a situation of the object, and individually setting a decision criterion or a abnormality decision value depending on characteristics of the sensors and a physical condition of the object.

[33] Preferably, the observation step includes a step of determining decision conditions depending on the kind of sensor signals received from the integration apparatus, detecting a measurement period of the sensors, and deciding abnormality to occur if it is determined based on the detected measurement period that there is no motion of the object residing in a monitoring zone for a specified period time.

Advantageous Effects

[34] As apparent from the above description, the remote monitoring system and method including an integration apparatus with a monitoring function, a communication function and a video providing function which is installed in a residence of an object to be monitored has an advantage of constantly monitoring motion of the object at a local control center, informing the object that the local control center attempts to confirm a video in occurrence of abnormality of the object, and then confirming the video to visually seize the presence or not of abnormality, thereby correctly seizing the presence or not of abnormality of the object based on a pattern of life of the object and minimizing possibility of trespass on the object's privacy.

[35] In addition, the remote monitoring system and method including an integration apparatus including an object detecting sensor, an external sensor and a camera for video transmission by remote manipulation has an advantage of allowing a local control center, which receives a sensor signal provided from the integration apparatus via a communication network, to set abnormality situations according to a pattern of behavior of an object to be monitored, so that the local control center can adjust grounds for abnormality decision according to forms of residence and life style of the object, and extremely simplifying a configuration of the integration apparatus, thereby reducing an installation burden while allowing effective remote management reflecting situations of individual objects to be monitored.

[36] In addition, the remote monitoring system and method has an advantage of notifying a local control center manager of abnormality seized by the local control center through a separate information window in preference to other works performed by the manager, thereby providing the manager with composure, and sending the abnormality information to a mobile terminal of the manager in the absence of the manager, thereby reducing the manager's burden.

[37] In addition, the remote monitoring system and method has an advantage of providing high ability to measure against abnormality of an object by installing a separate central control center that integrally manages a plurality of local control centers, thereby correcting an error of a local control center and backing up situation information to be utilized as an evidence material later.

[38] In addition, the remote monitoring system and method has an advantage of taking a proper measure for an object to ask a local control center for help in an emergency irrespective of a setting environment by adding a wired/wireless means to notify an emergency situation to an integration apparatus.

[39] Furthermore, the remote monitoring system and method has an advantage of more simply reporting and effectively coping with an emergency situation of an object by adding a wireless receiving means to notify to an integration apparatus and combining a TV remote control, which is likely to be carried by an object, and means to select an emergency situation. Brief Description of the Drawings

[40] Fig. 1 is a block diagram showing a configuration of a general remote monitoring system.

[41] Fig. 2 is a view showing an example of a center server interface of a remote monitoring system.

[42] Fig. 3 is a view showing a configuration of a general remote security system.

[43] Fig. 4 is a view showing an example of a center server interface of a remote security system.

[44] Fig. 5 is a view showing an example of a system configuring method according to an embodiment of the present invention.

[45] Fig. 6 is a view showing an example of an installation method according to an embodiment of the present invention.

[46] Fig. 7 is a view showing an example of a system configuring method according to an embodiment of the present invention.

[47] Fig. 8 is a view showing a configuration of an integration apparatus according to another embodiment of the present invention.

[48] Fig. 9 is a block diagram showing an internal configuration of the integration apparatus shown in Fig. 8.

[49] Figs. 10 to 12 are views showing examples of an interface of a monitoring server according to still another embodiment of the present invention.

[50] Fig. 13 is a view showing an example of a setup screen for explaining an interface configuring method of a monitoring server.

[51] Fig. 14 is a flow chart showing an operation process according to an embodiment of the present invention. Mode for the Invention

[52] Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[53] Fig. 5 shows a configuration of a system for monitoring solitary old persons and disabled persons in accordance with an embodiment of the invention. As shown in the figure, this system includes a plurality of integration apparatuses 100a to lOOn each incorporating plural functions, a plurality of local control centers 120a to 120m interlocking with the plurality of integration apparatuses 100a to lOOn via a communication network 110, and a central control center 130 that integrates and manages information provided to the local control centers 120a to 120m for the whole system management.

[54] In the above configuration, the local control centers 120a to 120m are preferably installed in smaller local government offices such as village offices, district offices and so on, and the central control center 130 is preferably installed in a district office or a larger local government agency embracing plural district offices.

[55] Accordingly, one or more integration apparatuses 100a to lOOn may be connected to one local control center 120a to 120m depending on their location, and social service workers responsible for their respective areas preferably take part in installation of corresponding integration apparatuses 100a to lOOn and operation of corresponding local control centers 120a to 120m.

[56] The purpose of the shown configuration is to protect solitary old persons and disabled persons by the government. This configuration may be modified and changed within the range of purpose of monitor and protection. As one example, this configuration may be modified for use in monitoring individual residential areas in towns for the aged, sanitariums and so on. As another example, this configuration may be changed in such a manner that individuals install integration apparatuses in their desired location and monitor and protects their parents or children through their PCs, which correspond to the above-mentioned local control centers.

[57] Referring to Fig. 5, each integration apparatus (e.g., 100a) basically includes an object detecting sensor 101 for detecting motion of an object to be monitored, a camera 102 for picking up an image and transmitting the image if necessary, a camera actuation indicating unit 103 for allowing the object to recognize actuation of the camera 102 to prevent trespass on his/her privacy, a sound processor 104 for generating sound in specified situations, and a communication unit (not shown) for communicating monitor information generated in the integration apparatus 100a to the corresponding local control center (e.g., 120a) via the communication network 110.

[58] In addition to the basic configuration, the integration apparatus 100a may include additional sensors (including manual input means) to be used to analyze a pattern of behavior of the object in more detail.

[59] It should be here noted that each of the integration apparatuses 100a to lOOn is in principle configured to include functions to the minimum for the purpose of more popularization for social welfare and more effective customization of the system. In other words, in the remote monitoring system of the present invention, without providing an event generating function and a special situation deciding function through self- comprehensive judgment, the integration apparatuses 100a to lOOn provide detection information of various sensors to the respective local control centers 120a to 120m via the communication network 110, and the local control centers 120a to 120m seize the presence of abnormality of objects to be monitored based on different setup contents set in the integration apparatuses 100a to 10On, inform the objects of the presence of abnormality, and attempt to confirm videos under conditions recognizable by the objects.

[60] Accordingly, with this configuration, it is possible to achieve effective monitor on the objects with reduction of costs while preventing trespass on their privacy.

[61] Fig. 6 shows an example of a basic configuration of an integration apparatus installed in a residence of an object to be monitored. As shown in the figure, an integration apparatus 230 is installed in a main residential zone 220 in a residence 200 (a house in this case) of an object 240 to be monitored, and a sensor 235 for detecting entrance and exit of the object 240 is disposed in a doorway 225 of the main residential zone 220. It is to be understood that this may be added with more different sensors and integrated apparatuses.

[62] As shown in Fig. 6, the shown integrated apparatus 230 is connected to a monitoring server 260 of a corresponding local control center, which is operated by a manager 265, via a general-purposed communication network 250 such as Internet.

[63] The integration apparatus 230 is preferably installed depending on a form of residence after a pattern of behavior of the object 240 to be monitored is examined by the manager 265 or a competent social service worker. In addition, the integration apparatus 230 has to be registered with the monitoring server 260 to perform a customized abnormality occurrence decision setting for the integration apparatus 230 based on the pattern of behavior of the object and the installation information of the integration apparatus. In addition, for more effective management, the monitoring server 260 can be associated with an internal or external database including information on the object to be monitored (for example, personal information, medical history information, residence information, map information, emergency contact number information, etc.) and preferably manages contact numbers of a supervisor, a neighboring police station, a neighboring fire station, a neighboring public health center, a neighboring hospital, etc. for instant countermeasure.

[64] With the above configuration, explaining a method of seizing the pattern of behavior of the object 240 to be monitored, first, the object 240 comes in and out through the doorway 225 to enter the main residential zone 220 in the residence 200. If the object 240 leaves the main residential zone 220 without passing the doorway 225, the object 240 must be located in a rest room. Accordingly, when the integration apparatus 230 is installed at a location from which the main residential zone 220 can be observed as a whole and the doorway sensor 235 is further installed to detect the entrance and exit of the object 240 through the doorway 225, it is possible to know whether or not the object 240 is located in the main residential zone 220.

[65] In other words, if the doorway sensor 235 is actuated and the objection detecting sensor in the integration apparatus 230 is actuated, then it may be determined that the object 240 is located in the main residential zone 220. On the other hand, if the object detecting sensor is not actuated (i.e., detects nothing) for a certain period of time while the doorway sensor 235 is being actuated, then it may be determined that the object 240 is out of the main residential zone 220.

[66] The object detecting sensor continues to detect motion of the object 240 as long as he/she stays within a range covered by the sensor. Thus, if the object 240 is immobilized for a preset period of time without the doorway sensor 235 being actuated, then it may be determined that the object 240 lies in an abnormal situation.

[67] Accordingly, the monitoring server 260 may set the object detecting sensor of the integration apparatus 230 and the doorway sensor 235 and may set a predetermined period of time for decision on occurrence of abnormality depending on activity of the object 240.

[68] If such a setting can not distinguish between a sleeping condition and an awaking condition and thus it is required to set a standard period of time longer than sleeping hours, the integration apparatus 230 may include an additional input means to allow an operator to select patterns of life of the object 240. For example, when an input means to set off/sleeping/awake conditions is additionally provided and one of these conditions is set, more reliable judgment is possible and decision on abnormality may be varied depending on the set condition. However, even in this case, since input may be incorrect, it is preferable to set the minimum value for decision on abnormality in consideration of all possible situations. [69] Fig. 7 shows an example of a more effective system configuration. As shown in the figure, this system may employ a method of connecting integration apparatuses installed in a plurality of grouped residences 301, 302 and 303 crowded with solitary old persons and disabled persons to a communication network 330 via an Internet router 310 and a method of using wired Internet or wireless Internet (for example, mobile communication or wireless LAN) for detached houses 305 and 306. In addition, this system has an additional function to provide information such as a character message to a mobile terminal 347 of a manager of a monitoring server 340 or a related person when the manager is not in front of the monitoring server 340. Although not shown, if abnormality occurs, abnormality information may be provided to a central control server 350 in which related information is collected and stored.

[70] The central control center 350 can integrally manage a plurality of monitoring servers 340, prepare against abnormality of the monitoring server 340, aid or monitor the monitoring server 340 in the absence of or in improper response of the manager of the monitoring server 340, and acquire and store relevant information (for example, sensor information, video information, information exchanged between managers and objects, etc.)

[71] In the above configuration, the monitoring server 340 preferably builds an internal or external database with object-related information including objects' personal information, medical history information, residence information, map information, neighboring emergency contact number information, etc. In addition, the monitoring server 340 may also utilize management information of social service workers responsible for corresponding objects. In addition, the monitoring server 340 may acquire information on an object corresponding to an integration apparatus detecting or monitoring abnormality from the database and provide the acquired information to a manager so that the manager can promptly confirm information required when the abnormality occurs. Further, the monitoring server 340 may separately store contact numbers of a supervisor, a neighboring police station, a neighboring fire station, a neighboring public health center, a neighboring hospital, etc. and promptly provide information related to abnormality of an object to a relevant contact number. Moreover, if necessary, the monitoring server 340 may has a function of providing at least a portion of information on the object and video information on the abnormality to any of the above contact numbers.

[72] Fig. 8 shows a detailed configuration of an integration apparatus including basic components and some additional components. The shown integration apparatus includes an object detecting sensor 411, a camera 412, a camera actuation indicator 413 for allowing an object to recognize actuation of the camera 412, a sounder 414, an operation indicator 415 indicating an overall state of the apparatus, a communication connector 417, an external sensor connector 416, a wireless detector 418 and a wireless transmitter 420. In addition to these components, although not shown, the integration apparatus may further include an input unit to allow an object to interrupt actuation of the camera 412, an input unit through which patterns of life (for example, off/ sleeping/awake) of the object can be set, an input unit to announce an emergency, etc., and the number of external sensor connectors 416 may be increased.

[73] In more detail, the object detecting sensor 411 continues to detect motion of the object in a defined zone. The camera 412 is used to visually confirm a situation of the object through control of a corresponding local control center. The camera actuation indicator 413 is used to allow the object to recognize the actuation of the camera 412 for protection of the object's privacy. External sensors (for example, a doorway sensor, an impact sensor, an RFID sensor, etc.) may be connected to the integration apparatus via the external sensor connector 416 in order to seize a pattern of behavior of the object to confirm whether or not the object is present within a range covered by the object detecting sensor 411. The sounder 414 is used to provide an alert or exchange information related to abnormality between the object and the manager of the corresponding local control center. The wireless receiver (or detector) 418 and the wireless transmitter 420 (which may be carried by the object) are used to allow the object to ask the local control center for help by informing the local control center of emergency. The wireless receiver 418 and the wireless transmitter 420 may employ any various local area communication schemes (for example, RF, IrDA, Bluetooth, ZigBee, etc.) but may preferably employ an IrDA scheme. The wireless transmitter 420 may be a separate transmitter but may preferably be provided with the most frequently-used functions (for example, integrated TV/video/audio) incorporated in the above emergency signal providing means so that the object can use it at a range close to the object at any time. Alternatively, the wireless transmitter may be combined to a general remote control.

[74] A doorway sensor which is very inexpensive and excellent in detecting performance is preferably used as an external sensor combined with the object detecting sensor 411. Alternately, when an RFID sensor (including a receiver and an antenna) is used as the external sensor and the object always carries an RFID tag, a detection precision can be increased since it can be definitely confirmed whether or not the object lies within a range covered by the object detecting sensor 411 (that is, if the object is located in a residential zone or not).

[75] Fig. 9 is a block diagram showing an internal configuration of the integration apparatus. As shown in the figure, the integration apparatus includes a detector 432 that manages an object detecting sensor 434 detecting motion of an object and an external sensor 433 and performs a detecting function (providing an operation signal and processing a received signal), a camera 435 that is actuated if necessary, a camera actuation indicator 436 that allows the object to recognize the actuation of the camera 435, an emergency receiver 437 including a switch or a wireless receiving means, a communication unit 431 that communicates with a monitoring server of a corresponding local control center via a communication network, a sounder 438 that transmits/receive a sound signal for voice call if necessary, and a controller 430 that provides required information, which is obtained from the above components, to the monitoring server and actuates the camera actuation indicator 436, the camera 435 and the sounder 438 based on a signal from the monitoring server.

[76] The detector 432 may be connected to plural external sensors 433 and the controller

430 performs a corresponding process as well. The camera 435 and the camera actuation indicator 436 may be automatically and simultaneously actuated when they are configured to use power provided under control of the controller 430 together. It is to be understood that the controller 430 may control the camera actuation indicator 436 to be actuated in advance before the camera 435 is actuated, or the camera actuation indicator 436 and the camera 435 may be sequentially driven using various delaying means without control of the controller 430.

[77] The sounder 438 may be implemented with a simple sound providing means

(including an amplifier and a speaker) operable to announce various setup contents, abnormality or emergency under control of the controller 430. Alternatively, the sounder 438 may include a voice transmitting/receiving function (including an amplifier, a speaker and a microphone) by use of which the object talks with a manager of the local control center through the controller 430 and the communication unit 431 so that the manager can effectively confirm abnormality of the object by voice before confirmation of a video or at the same time of confirmation of the video.

[78] The controller 430 is preferably configured to process a control as simple as in order to reduce a cost burden. Accordingly, with all functions related to decision committed to the monitoring server of the connected local control center, the controller 430 may actuate the detector periodically or aperiodically and transmit resultant information to the monitoring server via the communication unit 431 periodically or aperiodically. In this case, indexes are preferably included in the resultant information to distinguish between kinds of the information, and if necessary, information collected during a specified period of time may be prepared as data to a preset format and the data may be transmitted as they are or in compression.

[79] In addition, the controller 430 may actuate the camera 435 and the camera actuation indicator 436 for transmission of video to the monitoring server based on a signal provided from the monitoring server, and if necessary, may exchange voice through the sounder 438. Besides, the controller 430 may serve as a Web server for access and information exchange.

[80] Figs. 10 to 12 show operation of an interface of a monitoring server. As shown in these figures, since the monitoring server does not always have big communication load, an ordinary personal computer may be used as a platform and a manager need not always manage plural integration apparatuses. The shown examples are interfaces of the monitoring server under the Windows environment 440 of MicroSoft, which is most commonly used.

[81] Fig. 10 shows an information window 441 in the monitoring server, which reports occurrence of abnormality in preference to works being currently performed on a platform when the abnormality occurs based on an abnormality determining criterion set for each integration apparatus while the monitoring server is receiving information from integration apparatuses. The information window 441 may be displayed not only in a simple display manner but also in a manner to attract manager's attention by adding an animation or making a sound. As shown in the figure, the information widow 441 may be provided along with information on an installation location (or other kinds of object information) of an integration apparatus detecting abnormality. If the manager does not take a follow-up measure for the information window 441 for a specified period of time, relevant information may be delivered to diverse concerned persons including the manager in various ways (SMS, multimedia message, e-mail, etc) according to a prescribed schedule.

[82] Fig. 11 shows an example of an interface provided when the manager manipulates an input means to display interworking information after recognizing the information window 441 shown in Fig. 10. As shown in Fig. 11, the shown interface includes an observation window 442 containing an area to visually confirm an object and an area to confirm states of sensors of an integration apparatus and object-related information.

[83] The manager seizes the states of sensors of the integration apparatus in an automatic or manual manner to classify the kind of abnormality. This example shows that an object detecting sensor detects nothing for 12 hours and 30 minutes, external sensor 1 (doorway sensor) detects entrance of the object, and an emergency notifying means is not manipulated by the object. Accordingly, the manager decides that the object is located in a residential zone without significant motion for a long time and then confirms the presence or not of abnormality. If a voice call is possible, the manager pushes a call button to confirm the presence or not of abnormality. If the presence or not of abnormality is not confirmed through the voice call, the manager works the camera to confirm the presence or not of abnormality through a video. If it is confirmed that abnormality occurs, the manager may take a follow-up measure by reporting relevant contents to concerned contact numbers managed by the manager.

[84] Fig. 12 shows that, when the observation window 442 is displayed as it is decided that abnormality occur, the emergency notifying means was manipulated while other sensors show no significant change. In this case, the manager attempts to make a voice call with the object and, if there is no voice calling means or a situation can not be seized even through the voice calling, confirms the object through a video. If the video shows a normal state of the object or it is reported to the manager that the object manipulates the emergency notifying means wrongly, the manager may release such a situation.

[85] Fig. 13 shows an example of a registration screen when an integration apparatus is registered in the monitoring server. As shown in the figure, an integration apparatus is physically recognized using an address or the like of the integration apparatus, and then the number and kind of sensors are selected based on configuration and installation method of the sensors of the integration apparatus. Although it is illustrated in this example that two kinds of external sensors are registered, the number of sensors to be registered may be random.

[86] If an object detecting sensor, two door sensors and an emergency notifying means were installed, these devices and their kinds are selected in respective setting areas 513 to 516 as shown in Fig. 13. The manager defines an abnormal situation in compliance with a pattern of behavior of the object depending on a period of time for which the object detecting sensor detects nothing. If means to indicate states (off/sleeping/movement) of the object is added, the abnormal situation may be differently set (for example, manual time selection, automatic time addition/subtraction according to situation, etc.) depending on values set for the states. Grounds for judgment about abnormality depending on the number and kind of sensors may be automatically generated and combination of abnormality may be manually determined. In addition, a zone 510 to display video information may be optionally configured depending on the presence of a camera, address information of the object may be inputted into an address information zone 511 or may be acquired from a pre- configured database and connected to the zone 511. In addition, personal information of the object may be also inputted into a personal information zone 512 or may be acquired from the pre-configured database and connected to the zone 512. More preferably, the address information is interlocked with map information and the personal information is interlocked with information on medical history of the object and information on concerned contact numbers. In addition, required functions may be chosen by buttons. In this example, a talk button 517 for talk with the object and a report button 518 for prompt report are selected. Further, a button for informing the object of video use, a button for transmission of information, etc. may be separately provided.

[87] The configuration of the interface shown in Fig. 13 may be modified in various ways to accomplish the same purpose. The embodiments of the present invention provide means for setting individual abnormality judgment criterions based on natures of objects and configuration and installation structures of integration apparatuses and cover all kinds of interfaces to compare received information and setup information in a monitoring server other than the integration apparatuses to seize abnormality.

[88] Fig. 14 is a flow chart illustrating a monitoring process according to an embodiment of the present invention. Fig. 14 shows a monitoring process when an integration apparatus is first registered in a monitoring server and then the integration apparatus provides information from various sensors to the monitoring server in actual operation.

[89] First, in a state where an object to be monitored is not present in a monitoring zone, if an external sensor (for example, a doorway sensor) detects motion of the object, it is determined that the object enters the monitoring zone and a monitor state switches to a state in which the object enters the monitoring zone. Of course, for more precise determination, there may be further added a step of detecting actuation of an object detecting sensor for a specified period of time after the external sensor detects the motion of the object, so that entrance/exit of the object in/from the monitoring zone can be actually seized.

[90] If it is determined through this procedure that the object is present in the monitoring zone, information on object motion (or periodical information on motion within a specified period of time) detected by the object detecting sensor is provided to the monitoring server, and the monitoring server resets a timer based on the information. If there is no object motion, the timer is counted. If there is no object motion for a predetermined period of time, the manager is informed of occurrence of abnormality, informs the object of actuation of a camera according to the occurrence of abnormality, and confirms a video picked up by the camera.

[91] If abnormality is seized through the video, the manager takes a follow-up measure against the abnormality. If it is confirmed that there occurs no abnormality through the video, the situation is ended. The video may be stored to prove this process later.

[92] The above-described process is illustrated in the simplest form. However, the process may be modified in various ways by combinations of the above-described technical constitutions and operations. For example, judgment based on the states of the sensors may be made in parallel, different judgment criterions may be applied depending on different kinds of inputs, and abnormality may be seized using voice in preference to video.

[93] As apparent from the above description, with the inexpensive integration apparatus and the monitoring server of the present invention as configured above, it is possible to manage objects to be monitored, such as solitary old persons and disabled persons, at remote places without making a direct visit to the objects, which may result in significant decrease of manager's burden due to decreased number of direct visits to the objects. In addition, the objects can live their own life more safely and always feel themselves under protection. [94]

Claims

[1] A remote monitoring system comprising: a plurality of integration apparatuses each including a sensor unit that is installed in a residence of an object to be monitored and detects motion of the object, a camera unit added with means to allow the object to recognize actuation of the camera unit, a selecting unit through which one of a plurality of behavior states of the object including off/sleeping/action states is selected, and a communication unit; and a plurality of local control centers that are connected to the plurality of integration apparatuses, respectively, via a communication network, each local control center detecting the behavior states of a corresponding object based on signals of the sensor unit and the selecting unit provided from a corresponding integration apparatus and actuating the camera unit after informing the object of actuation of the camera unit if the behavior states of the object are out of a limited range set for the object, so that the presence or not of abnormality of the object can be seized, wherein each of the plurality of local control centers includes: a monitoring server that stores the limited range of the behavior states for each integration apparatus, based on a configuration of the sensor unit depending on an installation environment of the integration due to a structure of the residence of the object and conditions of the object, seizes the behavior states of the object based on the stored limited range of the behavior states, provides object-related information to a manager in occurrence of abnormality, and provides a video of the object conditions to the manager through the camera unit; and a database including the object-related information.

[2] The remote monitoring system according to Claim 1, further comprising a central control center that integrally manages the plurality of local control centers.

[3] The remote monitoring system according to Claim 1, wherein each of the plurality of integration apparatuses includes: at least one sensing means that detects behavior of the object to be monitored; a camera that acquires a video; a camera actuation indicator that indicates actuation of the camera; a sounder that processes a sound signal; a communication unit that exchanges signals with a remote place; and a controller that provides information of the sensing means through the communication unit, actuates the camera and the camera actuation indicator according to a selection from the remote place, and provides a video to the remote place through the camera.

[4] The remote monitoring system according to Claim 3, wherein the sensing means includes at least one selected from a group consisting of an object detecting sensor, a doorway sensor and an RFID sensor.

[5] The remote monitoring system according to Claim 3, wherein the sensing means further includes means for receiving a radio signal and the controller determines that the object is under an emergency situation when the radio signal is inputted to the controller through the radio signal receiving means, provides information indicating emergency to the remote place via the communication unit, and further includes remote control means that is carried by the object and informs the radio signal receiving means of the emergency situation.

[6] The remote monitoring system according to Claim 5, wherein the remote control means further includes a TV remote control function or at least means combined to any TV remote control.

[7] The remote monitoring system according to Claim 3, wherein the controller manages voice exchange between the local control center and the object using the sounder and the communication unit.

[8] The remote monitoring system according to Claim 1, wherein the monitoring server includes a notification means that provides abnormality occurrence information in preference to other works in occurrence of abnormality of the object, an observation means that notifies actuation of the camera and actuates the camera by remotely manipulating the integration apparatus of the object according to a selection of a manager in interlocking with the notification means and provides current situations of the sensor unit of the integration apparatus, and a character message transmission means that transmits a character message to the manager in the absence of a follow-up measure by the manager after the notification means is displayed.

[9] The remote monitoring system according to Claim 1, wherein the monitoring server includes a custom setting means that selects and sets the kind of signal of the sensor unit to be received from the integration apparatus and a decision criterion depending on the kind of signal, based on an installation location of the integration apparatus, a configuration of the sensor unit, a residence environment of the object to be monitored, and a pattern of behavior of the object to be monitored.

[10] The remote monitoring system according to Claim 1, wherein the monitoring server further includes means for exchanging voice with the integration apparatus.

[11] The remote monitoring system according to Claim 1, wherein the monitoring server a reporting means for acquiring and displaying object-related information from the database in occurrence of abnormality and reporting the abnormality occurrence situation to concerned persons according to a setting.

[12] The remote monitoring system according to Claim 1, wherein the monitoring server further includes means for storing a received video.

[13] The remote monitoring system according to Claim 1, wherein the monitoring server further includes means for transmitting at least a portion of the object- related information and video information acquired from the database to concerned contact numbers in occurrence of abnormality according to a selection of a manager.

[14] The remote monitoring system according to Claim 1, wherein the object-related information includes at least a portion of object's personal information, medical history information, residence information, map information, and neighboring emergency contact number information, and the concerned contact numbers include at least one of contact numbers of a supervisor, a neighboring police station, a neighboring fire station, a neighboring public health center and a neighboring hospital.

[15] A remote monitoring method of monitoring and confirming the presence or not of abnormality of an solitary object to be monitored at a remote place using an integration apparatuses including a sensor unit that includes an object detecting sensor, a camera unit added with a camera actuation indicator, and a communication unit that transmits/receives information via a communication network, and a monitoring server in interlocking with the integration apparatus, comprising: a registration step of registering the integration apparatus by storing, in the monitoring server, individual setup information depending on a configuration of the sensor unit of the integration apparatus, which is changed according to an installation environment of the integration apparatus, and the nature of the object, and identification information of the integration apparatus; an observation step of determining, by the monitoring server that received sensing information from the integration apparatus, the presence or not of abnormality of the object based on the individual setup information; a notification step of notifying, by the monitoring server, a manager of the fact that there occurs abnormality in the object in the observation step; and a confirmation step of confirming, by the monitoring server, the object with a video through the camera unit after notifying the object of the fact that the video is to be confirmed by means of the camera actuation indicator of the integration apparatus in the notification step.

[16] The remote monitoring method according to Claim 15, wherein the registration step includes a step of registering the kind of sensors in consideration of configuration and installation position of the sensors of the integration and a characteristic of installation location of the sensors and a situation of the object, and individually setting a decision criterion or a abnormality decision value depending on characteristics of the sensors and a physical condition of the object.

[17] The remote monitoring method according to Claim 15, wherein the observation step includes a step of determining decision conditions depending on the kind of sensor signals received from the integration apparatus, detecting a measurement period of the sensors, and deciding abnormality to occur if it is determined based on the detected measurement period that there is no motion of the object residing in a monitoring zone for a specified period time.

[18] The remote monitoring method according to Claim 17, wherein the observation step includes a step of deciding abnormality to occur if a signal received through means that is added to the integration apparatus for notifying emergency is detected.

[19] The remote monitoring method according to Claim 17, wherein the observation step includes a step of receiving a signal provided through an input unit that is added to the integration apparatus for setting a pattern of behavior of the object and changing the abnormality decision conditions based on the received signal.

[20] The remote monitoring method according to Claim 15, wherein the notification step includes a step of notifying the abnormality of the object in preference to other works performed by the monitoring server.

[21] The remote monitoring method according to Claim 15, wherein the notification step includes a step of transmitting information corresponding to the notification to preset concerned contact numbers if there is no follow-up measure for a specified period of time after the notification.

[22] The remote monitoring method according to Claim 21, wherein the step of transmitting information corresponding to the notification further includes a step of transmitting a character message to mobile terminals of concerned persons including the manager.

[23] The remote monitoring method according to Claim 15, wherein the confirmation step further includes a step of confirming the presence or not of abnormality by voice through a voice exchange means added to the integration apparatus.

[24] The remote monitoring method according to Claim 15, wherein the confirmation step further includes a step of storing contents of the video confirmation.

[25] The remote monitoring method according to Claim 15, wherein the confirmation step further includes a step of acquiring the object-related information from a preset database according to a selection of a manager who confirmed the video and transmitting the acquired information to preset concerned contact numbers according to a selection of the manager.