WO2016032235A1

WO2016032235A1 - System and method for monitoring inside and outside of home using image movement detection of wall-pad

Info

Publication number: WO2016032235A1
Application number: PCT/KR2015/008939
Authority: WO
Inventors: 최용식
Original assignee: 주식회사 경동원
Priority date: 2014-08-29
Filing date: 2015-08-26
Publication date: 2016-03-03

Abstract

The present invention relates to a system for monitoring an inside and outside of home using image movement detection, which comprises a wall-pad for analyzing an image acquired through a camera built-in a door phone, a lobby phone, or a wall-pad, or a CCTV to detect object movement, generating a movement event to transmit the generated movement event to a push server, requesting a push alarm for a movement event, which can be received by an external terminal, from the push server, and, when the external terminal having identified the push alarm has accessed to an IP address, providing the image to the accessed external terminal. Therefore, even though a user is in any position inside and outside of the home, the user can monitor the inside and the outside of the home in real time using a possessed terminal.

Description

Indoor and outdoor monitoring system and method using image motion detection of wall pad

The present invention relates to an indoor and outdoor monitoring system and method, and more particularly, the wall pad analyzes an image received from a camera and transmits an alarm message to an external terminal that a user carries when there is a movement. The present invention relates to an indoor and outdoor monitoring system and method using the image motion detection of the wall pad, which enables the user to check and receive the image photographed on the wall pad even when he is out.

Generally in the case of multi-family complexes, such as apartments, individual visitors are visited by various visitors. Visitors may be people already known by members of individual households, but many do not know.

In the case of MDUs, the monitoring of visitors is closely related to the content within the complex. However, too tight control of a co-worker or supervisor who is coming in a car for housewarming for security reasons can cause visitors a hassle or discomfort. Therefore, when such a visitor visits, there is a need for measures to ensure security monitoring without any hassle or discomfort by excluding security control by the guard room or people as much as possible.

On the other hand, some of the courier visitors for delivering cards, order items, transmission items, letters and the like are entering and exiting the complex using a vehicle. Even if there are courier visits by such courier visitors, there is a need for countermeasures for the convenience of visitors, while maintaining thorough security for crime prevention.

In the case of indoor and outdoor security and monitoring function using a conventional wall pad, it operates by recognizing the occurrence of external intrusion through a sensor or a contact signal installed outside the terminal. However, there is a problem that if there is no sensor installed on the outside, the security function is lost, and additional costs are incurred when additional sensors are installed. In addition, when receiving a detector signal, a detection notification is notified to the user through a short message (SMS) or a voice notification of a public pay phone network (PSTN), and an additional cost is incurred. There was also the inconvenience of having to check a specific website or operate a home automation device.

[Preceding technical literature]

[Patent Documents]

(Patent Document 1) Korean Laid-Open Patent Publication No. 10-2011-0108883

The present invention has been made in view of the above-described circumstances, and analyzes a plurality of images acquired from the wall pad to detect motion in the image, transmit a push alarm message for the generated motion event to an external terminal, and send a push alarm. When a video is requested from a received external terminal, the wall pad provides the external terminal in real time with a motion event in real time. The purpose is to provide a monitoring system and method for indoor and outdoor.

Indoor and outdoor monitoring system using the image motion detection of the wall pad of the present invention for achieving the above object, the image obtained by the built-in camera, or provided from at least one of the door phone, lobby phone, or CCTV video An input image processor for transmitting to the processor; An image motion processor configured to generate a motion event by analyzing a motion in the image received through the input image processor; A network transmitter / receiver that allows an external terminal to access an IP address registered in the DNS, connects to a push server to transmit the motion event, and transmits the requested image from the external terminal connected to the IP address; And a terminal / IP registration unit for receiving the unique information of the external terminal, requesting registration of the unique information and the unique IP address of the wall pad in the DNS, and storing the registered IP address.

Indoor and outdoor monitoring system using the image motion detection of the wall pad of the present invention for achieving the above object, through the built-in camera or CCTV of the door phone, lobby phone or wall pad is provided with a camera image of the area where the device is located, Analyzes the received video to detect object movement, generates motion event and sends it to push server, requests push alarm for motion event that can be received from external terminal to push server, and checks push alarm from external terminal. A wall pad that provides the image to a connected external terminal when the wall pad is connected to an IP address of the wall pad; A push server for receiving the movement event and generating a push alarm message for the movement event and transmitting the same to an external terminal through the Internet; An external terminal receiving the push alarm, checking the received push alarm, and receiving the image by accessing the wall pad with the IP address of the wall pad; And DNS for providing a corresponding IP address when an IP address of the wall pad is requested from the external terminal.

Indoor and outdoor monitoring method using the image motion detection of the wall pad of the present invention, a wall pad installed in the home and an external terminal connected to the wall pad via the Internet, the method for monitoring the indoor and outdoor images in the external terminal In (A) the wall pad is provided with a camera image from the built-in camera of the door phone, the lobby phone or the wall pad or the camera image from the CCTV; (B) detecting, by the wall pad, an object in the camera image and generating a motion event; (C) the wall pad transmitting the motion event to a push server connected through the Internet to request a push alarm for the motion event; (D) the push server generating a push alarm message for the movement event and transmitting it to the external terminal; (E) the external terminal receiving the push alarm message, accessing the wall pad, and requesting a corresponding image in which a motion event occurs; (F) the wall pad transmits the requested image to the external terminal.

According to the indoor and outdoor monitoring system and method using the image motion detection of the wall pad of the present invention, by transmitting the camera image of the local area where the motion occurred in the home and outdoor to an external terminal connected to the wall pad that can be connected to the Internet environment, the user Even if it is located at any location inside and outside, it is effective to monitor the surrounding area outside the home as well as the home monitoring such as babysitter or pet dog look and intruder monitoring using a portable terminal.

Another effect of the present invention is to enable real-time voice or video call with the wall pad in the external terminal capable of video monitoring, to prevent secondary damage by taking regular contact between the resident and the external external terminal holder, and necessary measures There is an effect to take.

1 is a block diagram of an indoor and outdoor monitoring system using image motion detection of a wall pad according to an embodiment of the present invention.

2 is a flowchart illustrating a process of registering external terminal unique information and wall pad unique IP address in an indoor / outdoor monitoring method using image motion detection of a wall pad according to the present invention.

3 is a flowchart illustrating a push alarm transmission and a video transmission process through a wall pad for a motion event after detecting the video motion in the indoor and outdoor monitoring method using the image motion detection of the wall pad according to the present invention.

4 is a view showing an embodiment of implementing a CCTV monitoring function of the indoor and outdoor monitoring system using the image motion detection of the wall pad of the present invention.

5 is a view showing an embodiment of implementing the security monitoring function of the wall pad of the indoor and outdoor monitoring system using the image motion detection of the wall pad of the present invention.

FIG. 6 is a block diagram of an indoor / outdoor monitoring system capable of voice and video calls using video motion detection of a wall pad according to another embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Prior to this, terms or words used in the present specification and claims should not be construed as being limited to the common or dictionary meanings, and the inventors should properly explain the concept of terms in order to best explain their own invention. Based on the principle that it can be defined, it should be interpreted as meaning and concept corresponding to the technical idea of the present invention.

Therefore, the embodiments described in the specification and the drawings shown in the drawings are only the most preferred embodiment of the present invention and do not represent all of the technical idea of the present invention, various modifications that can be replaced at the time of the present application It should be understood that there may be equivalents and variations.

Hereinafter, the indoor and outdoor monitoring system and method using the image motion detection of the wall pad of the present invention configured as described above will be described in detail.

Indoor and outdoor monitoring system using the image motion detection of the wall pad according to an embodiment of the present invention, as shown in Figure 1, includes a wall pad 200. The push server 300 may further include an external terminal 400 and a DNS 500.

The wall pad 200 may be provided with a built-in camera 210 as a home automation device provided in the home. The built-in camera 210 may acquire and store an indoor image.

In addition, the wall pad 200 may analyze the object in the image and detect the movement of the object by using the acquired image. At this time, the acquired image is not only a built-in camera of the wall pad 200, but also referring to FIG. 4, the CCTV 110, the door phone 120, or the lobby phone in the surveillance area connected to the wall pad 200 and the home network. It may also be an image acquired by the camera built in 130. That is, the wall pad 200 may be provided with a camera image in conjunction with the CCTV 110 or the door phone 120 and the lobby phone 130 in the monitoring area. In addition, the wall pad 200 may receive a camera image from all camera image acquisition apparatuses connected to the home network in addition to the CCTV 110, the door phone 120, and the lobby phone 130, but the present invention is not limited thereto. Do not.

In addition, the wall pad 200 may recognize an object in the acquired image and generate a motion event according to the movement of the object.

The wall pad 200 may request a push alarm so that the external terminal 400 receives the push alarm by transmitting a motion event of the corresponding video generated according to the movement of the object to the push server 300.

In addition, the wall pad 200 is connected to the wall pad 200 by a unique IP from the external terminal 400 that receives the push alarm message, and transmits the video to the Internet 600 when the transmission request is made for the corresponding video. Through the real-time streaming through the external terminal 400 can be transmitted. In this case, the video transmission method may adopt a download method in addition to the real time streaming method.

The wall pad 200 may include a built-in camera 210, an input image processor 220, an image motion detection processor 230, a network transmitter / receiver 240, and a terminal / IP register 250 in detail.

The built-in camera 210 may acquire an image of a specific area of the home where the wall pad 200 is located. For example, as shown in FIG. 5, when an intruder occurs in the home, an image of the intruder may be acquired.

The input image processor 220 receives camera images acquired from a plurality of CCTVs 110 interlocked with the built-in cameras of the wall pad 200, the door phone 120 and the lobby phone 130, and the wall pad 200. The image may be stored in an internal image DB, and the image may be transmitted to the image motion detection processor 230 for object recognition and motion detection in the image.

The image motion detection processor 230 analyzes an object in the image from the camera image received from the input image processor 220 using an object recognition technique. Here, the object recognition technique may use a known technique, and for example, image binarization, labeling, difference image generation technique, edge detection algorithm, etc., but this is merely an example. The invention is not limited to this. An algorithm for any one of such object recognition techniques may be programmed and stored in the image motion detection processor 230.

In addition, the video motion detection processor 230 may generate a motion event according to the analyzed object movement, and transmit the generated motion event to the push server 300 to request a push alarm to the external terminal 400. Here, the external terminal 400 receiving the push alarm request corresponds to a terminal in which unique information is registered in advance.

The network transmitter / receiver 240 allows access to the external terminal 400 through the Internet 600 with a unique IP address registered in the DNS 500 and serves to connect to the push server 300.

In addition, the network transmitter / receiver 240 may transmit the video to the external terminal 400 in real-time streaming through the Internet 600 when a request for transmission of a corresponding video in which a motion event occurs from an external terminal connected with a unique IP address. have.

The terminal / IP registration unit 250 may receive and store the unique information of the external terminal 400 in advance, and transmit the pre-stored unique information and the unique IP address of the wall pad 200 to the DNS 500 to request registration. By storing the registered IP address, when the external terminal 400 accesses the wall pad 200 with the registered unique information and IP address, connection authentication is possible.

The push server 300 receives the motion event and the unique information of the terminal from the wall pad 200 and receives a push alarm request. The push server 300 generates a push alarm message corresponding to the motion event and transmits the push alarm message to the external terminal 400. Perform. The push alarm message is preferably a message that can be received by the monitoring application installed in the external terminal 400.

External terminal 400 is basically installed in the home and outdoor monitoring application that is interlocked with the wall pad 200, and receives the push alarm message from the push server 300 through the installed monitoring application, to the wall pad 200 Access to the indoor and outdoor images stored in the wall pad 200 can be received.

Here, the external terminal 400 receives a push alarm message such as a smartphone, a phablet, etc. through an application, and provides a corresponding image in which a motion event occurs after accessing the wall pad 200 through the Internet 600. As a terminal capable of receiving, the terminal corresponds to a terminal capable of receiving an image collected on a wall pad where a motion event occurs through an application, regardless of the location where the user can access the Internet 600. The external terminal 400 may provide unique information to the wall pad 200 to distinguish each terminal.

The DNS 500 receives the unique IP address from the wall pad 200 and registers the Internet 600 connection IP address of the wall pad 200, and receives the unique information of the external terminal 400, and receives the corresponding external terminal ( By registering 400 and providing the IP address of the wall pad 200 to the registered and authenticated external terminal 400, the authentication procedure for allowing the connection of the external terminal 400 is completed.

That is, the DNS 500 queries the pre-stored unique information of the external terminal 400 when the IP address of the wall pad 200 is requested from the external terminal 400 registered with the unique information, and the external terminal with the unique information registered therein. In the case of 400, the registered IP address of the wall pad 200 is provided.

The Internet 600 is a commercial Internet network, and provides the Internet 600 communication protocol that the wall pad 200, the push server 300, the external terminal 400, and the DNS 500 can connect to the Internet 600 environment. can do.

As shown in FIG. 6, the wall pad according to another embodiment of the present invention uses a voice processor 260, a microphone 270, and a speaker 280 to enable a two-way voice call through an external terminal and the Internet 600. It may further include.

The speaker 280 may output voice data of an external terminal to the outside.

The microphone 270 receives voice data from the wall pad.

The voice processing unit 260 modulates the voice data received from the external terminal to be output through the speaker 280 or converts the voice data input to the microphone 270 to be transmitted to the external terminal.

In addition, the external terminal 400 may transmit a voice call request signal by accessing the IP address of the wall pad 200 registered in the wall pad 200, and upon accepting the voice call request from the wall pad 200, the two-way voice. Voice data may be transmitted and received through the Internet 600 to enable a call.

In addition, the external terminal 400 transmits a voice call request signal to the wall pad 200 so that the camera image can be received and the voice call after checking the push alarm in the wall pad 200, the camera collected from the wall pad 200 A video call function may be implemented to receive a video through the Internet 600 and simultaneously perform a voice over IP (VOIP) call function to make a call while viewing a camera image. As another example, the external terminal 400 requests the wall pad 200 after confirming the push alarm from the push server 300, and receives the video of the in-house resident through the built-in camera 210 of the wall pad 200 while VOIP call. A video call function may be implemented.

2 is a flowchart illustrating a procedure for registering unique information of an external terminal 400 and a unique IP address of the wall pad 200 in an indoor / outdoor monitoring method using image motion detection of a wall pad according to the present invention.

Referring to Figure 2 describes the registration process of the unique information of the external terminal 400 and the unique IP address of the wall pad 200,

First, the wall pad 200 configures the Internet 600 communication protocol through the network transmitter / receiver 240 to establish an environment accessible to the Internet 600 network (S100).

Thereafter, the wall pad 200 may receive and store basic information corresponding to the connection environment of the wall pad 200 (S102).

In addition, the wall pad 200 receives and stores the unique information of the external terminal 400 for the external terminal 400 authentication (S104). Here, the unique information may include user account information of an external terminal such as a smartphone and a tablet.

The wall pad 200 may generate a unique IP address accessible to the Internet 600, and transmit registration information and an IP address previously stored in the DNS 500 to perform registration and authentication procedures (S106).

DNS 500 may store the unique information and IP address of the external terminal 400 and complete the registration and authentication step (S108).

When the registration and authentication step is completed, the wall pad 200 allows the external terminal 400 to access the registered unique information and IP address, and thereafter, the registered IP address of the wall pad 200 is periodically It may be renewed with a new public IP address (S110).

3 is a flowchart illustrating a push alarm transmission and a video transmission process through the wall pad 200 for a motion event after detecting the video motion in the indoor and outdoor monitoring method using the image motion detection of the wall pad of the present invention.

The push alarm transmission and the image transmission process through the wall pad 200 for the motion event after detecting the image motion will be described with reference to FIG. 3.

The wall pad 200 receives a camera image from the built-in camera 210 of the door phone 120, the lobby phone 130, or the wall pad 200, or receives a camera image from the CCTV 110, and receives the provided camera image. Analyze the object to detect the movement (S200).

In addition, the wall pad 200 generates a motion event according to the detected motion and transmits the motion event to the push server 300 connected through the Internet 600 to request a push alarm for the motion event (S202). In this case, the wall pad 200 may transmit the unique information when a push alarm request is made to the push server 300.

The push server 300 receives the unique information and transmits a push alarm message to the corresponding external terminal 400 using the unique information (S204). The push alarm message may be provided in the form of a popup window. The push alarm message may include a time at which a motion event occurs, event contents, a region where an image is captured, and device information.

The external terminal 400 receives the push alarm message (S206), and inquires the IP address of the wall pad 200 to the DNS 500 (S208).

The external terminal 400 is authenticated using the pre-stored unique information of the DNS 500, and an IP address is provided to the authenticated external terminal 400 (S210).

The external terminal 400 accesses the wall pad 200 with the corresponding IP address and requests the corresponding image (S212).

The wall pad 200 transmits the requested video to the external terminal 400 in a real time streaming method (S214).

[Description of the code]

110; CCTV 120; Door phone

130; Lobby phone 200; Wall pad

210; Built-in camera 220; Input image processor

230; Image motion detection processor 240; Network Transmitter and Receiver

250; Terminal / IP registration unit 260; Voice processing unit

270; Microphone 280; speaker

300; Pushserver 400; External terminal

500; DNS 600; Internet

Claims

Receives the camera image of the area where the device is located through the built-in camera or CCTV of door phone, lobby phone or wall pad, analyzes the received video, detects object movement, generates motion event, and sends to push server, A wall pad requesting a push alarm for a motion event that can be received by an external terminal to a push server, and providing the image to a connected external terminal when the push alarm is connected to an IP address of a wall pad from the external terminal which has confirmed the push alarm;

A push server for receiving the movement event and generating a push alarm message for the movement event and transmitting the same to an external terminal through the Internet;

An external terminal receiving the push alarm, checking the received push alarm, and receiving the image by accessing the wall pad with the IP address of the wall pad; And

Indoor and outdoor monitoring system using the image motion detection of the wall pad including the DNS to provide the IP address when the IP address of the wall pad request from the external terminal.
The method of claim 1, wherein the wall pad

A built-in camera which acquires a camera image photographed in a home;

An input image processor for receiving an image from the built-in camera or CCTV of the door phone, the lobby phone, or the wall pad and transmitting the image to the image movement processor;

An image motion processor configured to generate a motion event by analyzing a motion in the image received through the input image processor;

A network transmitter / receiver that allows access of the external terminal to the IP address registered in the DNS, connects to a push server to transmit the motion event, and transmits the requested image from the external terminal connected to the IP address. ; And

A terminal / IP registration unit for receiving the unique information of the external terminal, requesting registration of the unique information and the unique IP address of the wall pad in the DNS, and storing the registered IP address;

Indoor and outdoor monitoring system using the image motion detection of the wall pad including a.
The method of claim 1, wherein the wall pad

Receives and stores the unique information of the external terminal, transmits the unique information when the push alarm request to the push server, requests a push alarm to the external terminal corresponding to the transmitted unique information, the DNS of the external terminal Sending unique information and IP address, requesting IP address authentication and registration to register the corresponding IP address, and allowing the access of the external terminal to the registered IP address. Monitoring system.
The method according to claim 1 or 2,

The external terminal may transmit a voice call request signal by accessing the wall pad, and when receiving the voice call request from the wall pad, transmit and receive voice data to enable a two-way voice call or a video call,

The wall pad

A speaker for outputting voice data of the external terminal to the outside;

A microphone receiving voice data from the wall pad;

A voice processing unit for modulating voice data of the external terminal to be output to the speaker or converting the microphone input voice data to be transmitted to the external terminal;

Indoor and outdoor monitoring system using the image motion detection of the wall pad further comprising a.
In the method for monitoring the indoor and outdoor images in the external terminal having a wall pad installed in the home and an external terminal connected to the wall pad through the Internet,

(A) the wall pad is provided with a camera image from a door phone, a lobby phone or a built-in camera of the wall pad, or a camera image from CCTV;

(B) detecting, by the wall pad, an object in the camera image and generating a motion event;

(C) the wall pad transmitting the motion event to a push server connected through the Internet to request a push alarm for the motion event;

(D) the push server generating a push alarm message for the movement event and transmitting it to the external terminal;

(E) the external terminal receiving the push alarm message, accessing the wall pad, and requesting a corresponding image in which a motion event occurs; And

(F) The indoor and outdoor monitoring method using the image motion detection of the wall pad comprising the step of transmitting the requested image to the external terminal.
The method according to claim 5, wherein before step (C)

The wall pad receiving and storing unique information of the external terminal;

Generating a wall pad unique IP address in a DNS, and transmitting the IP address and the unique information to request authentication and registration;

The DNS monitoring method of indoor and outdoor using image motion detection of the wall pad including registering the IP address and the unique information.
The method of claim 5, wherein step (D)

The wall pad transmits the unique information when a push alarm request is made to the push server;

The push server receives the unique information and transmits the push alarm message to the corresponding external terminal using the unique information, the indoor and outdoor monitoring method using the motion detection of the wall pad.
The method of claim 5, wherein in step (E)

And the external terminal accesses the wall pad using the registered wall pad IP address and requests the corresponding image in which the motion event occurs.
The method of claim 5, wherein in step (E)

The external terminal may transmit a voice call request signal by accessing the wall pad, and when the voice call request is accepted from the wall pad, the external terminal transmits and receives voice data to enable a two-way voice call or a video call. Indoor and outdoor monitoring using video motion detection.
An input image processing unit for acquiring an image through a built-in camera or transmitting an image provided from at least one of a door phone, a lobby phone, or a CCTV to an image moving processor;

An image motion processor configured to generate a motion event by analyzing a motion in the image received through the input image processor;

A network transmitter / receiver that allows an external terminal to access an IP address registered in the DNS, connects to a push server to transmit the motion event, and transmits the requested image from the external terminal connected to the IP address; And

Image of the wall pad having a wall pad including; receiving the unique information of the external terminal, requesting the registration of the unique information and the unique IP address of the wall pad in the DNS, and stores the registered IP address Indoor and outdoor monitoring system using motion detection.