METHOD AND APPARATUS FOR GESTURE CONTROL OF A DEVICE

• US 20170083759A1
• Filed: 09/21/2015
• Published: 03/23/2017
• Est. Priority Date: 09/21/2015
• Status: Abandoned Application

• Current Assignee: Monster & Devices Home Sp. Zoo
• Original Assignee: Monster & Devices Home Sp. Zoo
• Inventors: KOWCZ, Marcin, Jakubowski, Marek, Semegen, Mateusz
• Application Number:
  US14/859,390
• Publication Number:
  US 20170083759A1
• Time in Patent Office: Days
• CPC Class Codes: G05B 2219/35444 Gesture interface, controlled machine observes operator, executes commands
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

Method for gesture control of a device, the device comprising an opening and closing mechanism under control, the method comprising: recognizing a gesture; controlling the device based on said recognized gesture; defining an initializing zone in the area covered by the gesture recognition sensor; defining an action zone in the area covered by the gesture recognition sensor; associating said initializing zone with said action zone and said action zone with said controlled device; wherein the associated action zone is the first zone located in proximity to the controlled device and its associated initialization zone is located further away from the controlled device than the action zone; detecting a person within the initializing zone and generating an event notifying that the initialization has been executed; detecting the person'"'"'s gesture in the action zone and generating an action event reporting said detection within the respective action zone only when said notifying event has been received from the associated initializing zone; sending a control signal to the controlled device'"'"'s opening and closing mechanism when both the initialization has been executed and said action event has been generated.

Claims

1. Method for gesture control of a device, the device comprising an opening and closing mechanism under control, the method comprising the steps of:

recognizing a gesture using a gesture recognition sensor (508) having a given coverage area;

controlling the device based on said recognized gesture;

defining an initializing zone (102) in the area covered by the gesture recognition sensor;

defining an action zone (102) in the area covered by the gesture recognition sensor, wherein said action zone and the initializing zone are arranged in a non-overlapping manner;

associating (103) said initializing zone with said action zone and said action zone with said controlled device;

wherein the associated action zone is the first zone located in proximity to the controlled device and its associated initialization zone is located further away from the controlled device than the action zone;

detecting a person within the initializing zone (104) and generating an event notifying that the initialization has been executed;

detecting the person'"'"'s gesture in the action zone (105) and generating an action event reporting said detection within the respective action zone only when said notifying event has been received from the associated initializing zone (104);

sending a control signal (106) to the controlled device'"'"'s opening and closing mechanism when both the initialization has been executed and said action event has been generated.

2. The method according to claim 1 characterized in that the action zone is defined adjacent to the controlled device.

3. The method according to claim 1 characterized in that the gesture recognition sensor is a depth sensor (508).

4. The method according to claim 1 characterized in that the action zone is in proximity to the associated initializing zone.

5. The method according to claim 1 characterized in that the action zone or the initializing zone is a cubic or substantially cubic area located in a reference view of a location covered by the gesture recognition sensor.

6. The method according to claim 1 characterized in that the action event is generated when there is a sequence of gestures present, the sequence comprising:

(a) inserting a hand in the action zone, (b) awaiting a timer threshold after conditions of step (a) have been met, and (c) withdrawing the hand from the action zone.

7. The method according to claim 1 characterized in that it further comprises the step of inhibiting notification of the associated controlled device if the person stands in the action zone.

8. The method according to claim 1 characterized in that the respective initializing zone and the action zone are perpendicular to a reference plane.

9. The method according to claim 1 characterized in that the method further comprises the step of, prior to generation of the action event, verifying person'"'"'s height in order exclude control of said device by children.

10. The method according to claim 1 characterized in that the action zone has more than one associated controlled device.

11. A non-transitory computer readable medium storing computer-executable instructions that, when executed on a computer, perform all the steps of the computer-implemented method comprising:

recognizing a gesture using a gesture recognition sensor (508) having a given coverage area;

controlling the device based on said recognized gesture;

defining an initializing zone (102) in the area covered by the gesture recognition sensor;

defining an action zone (102) in the area covered by the gesture recognition sensor, wherein said action zone and the initializing zone are arranged in a non-overlapping manner;

associating (103) said initializing zone with said action zone and said action zone with said controlled device;

wherein the associated action zone is the first zone located in proximity to the controlled device and its associated initialization zone is located further away from the controlled device than the action zone;

detecting a person within the initializing zone (104) and generating an event notifying that the initialization has been executed;

detecting the person'"'"'s gesture in the action zone (105) and generating an action event reporting said detection within the respective action zone only when said notifying event has been received from the associated initializing zone (104);

sending a control signal (106) to the controlled device'"'"'s opening and closing mechanism when both the initialization has been executed and said action event has been generated.

12. System for gesture control of a device, the system comprising:

a data bus (501) communicatively coupled to a memory (504) and a controller (506);

a gesture recognition sensor (508);

a gesture recognition module (507) configured to operate according to a gesture recognition method based on input from the gesture recognition sensor (508);

a reference view memory (502) configured to store a three-dimensional scan, created with a use of the output from the depth sensor, of a location devoid of any human operator;

a zones descriptors register circuit (503) configured to store information related to definitions of at least one initializing zone and at least one action zone as well as association between the respective initializing and action zones and the controlled device;

a control signal transmission channel (505) configured to provide a signal driving the controlled device;

wherein the controller (506) is configured to execute the steps of the method comprising;

recognizing a gesture using a gesture recognition sensor (508) having a given coverage area;

controlling the device based on said recognized gesture;

defining an initializing zone (102) in the area covered by the gesture recognition sensor;

defining an action zone (102) in the area covered by the gesture recognition sensor, wherein said action zone and the initializing zone are arranged in a non-overlapping manner;

associating (103) said initializing zone with said action zone and said action zone with said controlled device;

wherein the associated action zone is the first zone located in proximity to the controlled device and its associated initialization zone is located further away from the controlled device than the action zone;

detecting a person within the initializing zone (104) and generating an event notifying that the initialization has been executed;

detecting the person'"'"'s gesture in the action zone (105) and generating an action event reporting said detection within the respective action zone only when said notifying event has been received from the associated initializing zone (104);

sending a control signal (106) to the controlled device'"'"'s opening and closing mechanism when both the initialization has been executed and said action event has been generated.