Interactive and targeted monitoring service

• US 9,942,520 B2
• Filed: 12/23/2014
• Issued: 04/10/2018
• Est. Priority Date: 12/24/2013
• Status: Active Grant

• Current Assignee: KT Corporation
• Original Assignee: KT Corporation
• Inventors: Park, Chul-Hyun
• Primary Examiner(s): Kim, Hee-Yong
• Application Number:
  US14/580,700
• Publication Number:
  US 20150181171A1
• Time in Patent Office: 1,204 Days
• Field of Search: 348143
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

The disclosure is related to an interactive and targeted monitoring service. The interactive and targeted monitoring service may be provided in cooperation of a service server and a control system. The service server may perform: providing a target object recognition signal to the user equipment and the control signal in response to a service request message from the user equipment, requesting the control system to provide the interactive and target monitoring service on a target object recognized based on the target object recognition signal using the plurality of monitoring devices, performing, by the service server, a protection procedure in response to a protection request from at least one of the control system and the user equipment, and requesting, by the service server, the control system to terminate the interactive and targeted monitoring service in response to termination notification from the control system.

Claims

1. A method of providing an interactive and targeted monitoring service to user equipment by a service server that is coupled with a control system and a plurality of monitoring devices through a communication network, the method comprising:

providing, by the service server, a target object recognition signal to the user equipment and a control signal in response to a service request message from the user equipment;

requesting, by the service server, the control system to provide the interactive and target monitoring service on a target object recognized based on the target object recognition signal using the plurality of monitoring devices;

performing, by the service server, a protection procedure in response to a protection request from at least one of the control system and the user equipment; and

requesting, by the service server, the control system to terminate the interactive and targeted monitoring service in response to termination notification from the control system,

wherein the target object recognition signal is generated based on information included in the service request message from the user equipment, and the user equipment performs at least one operation based on information included in the target object recognition signal, and

wherein the target object recognition signal comprises information on at least one of a predetermined image pattern to be displayed on the user equipment, a predetermined control pattern for controlling at least one constituent element of the user equipment, and a predetermined gesture guidance for instructing the target object to make a predetermined gesture.

2. The method of claim 1, wherein the providing comprises:

receiving, by the service server, the service request message for the interactive and targeted monitoring service from the user equipment;

generating, by the service server, the target object recognition signal based on the_—

information included in the received service request message; and

transmitting, by the service server, the generated target object recognition signal to the user equipment and the control system through the communication network.

3. The method of claim 2, wherein the service request message comprises information on a location of the user equipment, a target object to monitor designated by the user equipment, a destination of the target object, a route to travel to the destination, and authentication data associated with the target object.

4. The method of claim 1, wherein the requesting of the interactive and target monitoring service comprises:

generating, by the service server, a monitoring request message to include the target object recognition signal; and

transmitting, by the service server, the generated monitoring request message to the control system through the communication network.

5. The method of claim 4, wherein the target object recognition signal included in the monitoring request message comprises information on at least one of a predetermined image pattern, a predetermined control pattern, and a predetermined gesture for identifying the target object to monitor.

6. The method of claim 4, wherein the monitoring request message includes information on a location of the user equipment, a target object to monitor designated by the user equipment, a destination of the target object, a route to travel to the destination, and authentication data associated with the target object.

7. The method of claim 1, wherein the performing comprises:

receiving a protection request message from at least one of the user equipment and the control system when an abnormal event occurs in associated with the target object; and

performing, as the protection procedure, a set of processes for protecting the target object from the abnormal event upon the receipt of the protection request.

8. The method of claim 7, wherein the set of processes comprises at least one of:

an operation of transmitting a notification message to designated persons and organizations for informing of the abnormal event;

an operation of transmitting a control signal to designated electronic devices to output a predetermined warning message; and

an operation of transmitting a control signal to the user equipment to control at least one of constituent elements of the user equipment.

9. The method of claim 1, wherein the performing comprises:

transmitting an authentication request message to the user equipment upon receipt of a protection request message from at least one of the user equipment and the service server;

verifying an abnormal event occurring at the target object based on information included in a response message received from the user equipment in response to the authentication request message and based on whether the response message is received or not; and

perform the protection procedure based on the verification result.

10. The method of claim 1, wherein the requesting of the termination comprises:

receiving a notification message for termination of an abnormal event from at least one of the user equipment and the control system; and

transmitting a removal request message to the control system for removal of the target object recognition signal registered with the target object and the user equipment.

11. The method of claim 10, wherein the transmitting a removal request message comprises:

transmitting an authentication request message to the user equipment;

receiving a response message from the user equipment in response to the authentication request message;

determining whether authentication data included in the response message is matched with one stored in connection with the user equipment; and

transmitting the removal request message to the control system only when the authentication data is matched with one stored in connection with the user equipment.

12. A method of providing an interactive and targeted monitoring service to user equipment by a control system that is coupled with a service server and a plurality of monitoring devices through a communication network, the method comprising:

receiving a monitoring request message with a target object recognition signal from the service server;

identifying the target object from unspecific objects in a service area based on information included in the target object recognition signal;

monitoring the identified target object as the interactive and monitoring service;

determining whether an abnormal event occurs in associated with the target object based on the monitoring result;

triggering a protection procedure upon the detection of the abnormal event; and

informing the service server of termination of the abnormal event,

wherein the user equipment performs at least one operation based on information included in the target object recognition signal, and

wherein the target object recognition signal comprises information on at least one of a predetermined image pattern to be displayed on the user equipment, a predetermined control pattern for controlling at least one constituent element of the user equipment, and a predetermined gesture guidance for instructing the target object to make a predetermined gesture.

13. The method of claim 12, wherein the monitoring comprises:

controlling the plurality of monitoring devices to monitor the identified target object based on the monitoring request message and the identified target object.

14. The method of claim 12, wherein the monitoring comprises:

receiving a target object recognition signal from the service server; and

registering the received target object recognition signal with user equipment requesting the interactive and targeted monitoring service.

15. The method of claim 12, wherein the determining comprises:

estimating at least one of a location, a moving speed, a moving direction, a motion range, a sound level, and brightness of the target object based on the monitoring result; and

detecting the abnormal event when at least one of estimated values is greater than a predetermined threshold.

16. The method of claim 12, wherein the determining comprises:

determining that the abnormal event occurs at least one of when the target object moves outside of the service area, when the target object deviates from a designated route, when the target object stays still for a predetermined time period, when the target object makes a predetermined signal, when the target object is attacked by other objects, when the target object falls down, when the target object starts running, when the target object is screaming, when the target object becomes unavailable to monitor, and when an abnormal event signal is received from the registered user.

17. The method of claim 12, wherein the triggering comprises:

generating a protection request message upon detection of an abnormal event based on the monitoring result; and

transmitting the generated protection request message to the service server through a communication network.

18. The method of claim 12, wherein the informing comprises:

continuously monitoring the target object after triggering the protection procedure;

determining whether the abnormal event is terminated based on the monitoring result;

generating a notification message for informing the service server of termination of the abnormal event when the abnormal event is terminated; and

transmitting the notification message to the service server through a communication network.

19. The method of claim 18, comprising:

determining that the abnormal event is terminated at least one of when the target object comes back to the service area, when the target object comes back to a designated route, when the target object becomes available to monitor, and when an abnormal event termination signal is received from the registered user.