SYSTEM AND METHOD FOR DISTANT GESTURE-BASED CONTROL USING A NETWORK OF SENSORS ACROSS THE BUILDING

• US 20180052520A1
• Filed: 01/12/2017
• Published: 02/22/2018
• Est. Priority Date: 08/19/2016
• Status: Abandoned Application

• Current Assignee: Otis Elevator Company (Otis Worldwide Corp.)
• Original Assignee: Otis Elevator Company (Otis Worldwide Corp.)
• Inventors: Amores Llopis, Jaume, Finn, Alan Matthew, Hsu, Arthur
• Application Number:
  US15/404,798
• Publication Number:
  US 20180052520A1
• Time in Patent Office: Days
• CPC Class Codes: B66B 1/468 Call registering systems
• CPC Class Codes: B66B 2201/4638 Wherein the call is registered without making physical contact with the elevator system
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 10/462 Salient features, e.g. scale invariant feature transforms [SIFT]
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A gesture-based interaction system for communication with an equipment-based system includes a sensor device and a signal processing unit. The sensor device is configured to capture at least one scene of a user to monitor for at least one gesture of a plurality of possible gestures, conducted by the user, and output a captured signal. The signal processing unit includes a processor configured to execute recognition software and a storage medium configured to store pre-defined gesture data. The signal processing unit is configured to receive the captured signal, process the captured signal by at least comparing the captured signal to the pre-defined gesture data for determining if at least one gesture of the plurality of possible gestures are portrayed in the at least one scene, and output a command signal associated with the at least one gesture to the equipment-based system.

Claims

1. A gesture-based interaction system for communicating with an equipment-based system comprising:

a sensor device configured to capture at least one scene of a user to monitor for at least one gesture of a plurality of possible gestures conducted by the user and output a captured signal; and

a signal processing unit including;

a processor configured to execute recognition software,

a storage medium configured to store pre-defined gesture data, and

wherein the signal processing unit is configured to receive the captured signal, process the captured signal by at least comparing the captured signal to the pre-defined gesture data for determining if at least one gesture of the plurality of possible gestures are portrayed in the at least one scene, and output a command signal associated with the at least one gesture to the equipment-based system.

2. The gesture-based interaction system set forth in claim 1, wherein the plurality of possible gestures includes conventional sign language applied by the hearing impaired, and associated with the pre-defined gesture data.

3. The gesture-based interaction system set forth in claim 1, wherein the plurality of possible gestures includes a wake-up gesture to begin interaction, and associated with the pre-defined gesture data.

4. The gesture-based interaction system set forth in claim 3 further comprising:

a confirmation device configured to receive a confirmation signal from the signal processing unit when the wake-up gesture is received and recognized, and initiate a confirmation event to alert the user that the wake-up gesture was received and recognized.

5. The gesture-based interaction system set forth in claim 1, wherein the plurality of possible gestures includes a command gesture that is associated with the pre-defined gesture data.

6. The gesture-based interaction system set forth in claim 5 further comprising:

a display disposed proximate to the sensor device, the display being configured to receive a command interpretation signal from the signal processing unit associated with the command gesture, and display the command interpretation signal to the user.

7. The gesture-based interaction system set forth in claim 6, wherein the plurality of possible gestures includes a confirmation gesture that is associated with the pre-defined gesture data.

8. The gesture-based interaction system set forth in claim 1, wherein the sensor device includes at least one of an optical camera, a depth sensor, and an electromagnetic field sensor.

9. The gesture-based interaction system set forth in claim 7, wherein the wake-up gesture, the command gesture, and the confirmation gesture are visual gestures.

10. The gesture-based interaction system set forth in claim 9, wherein the equipment-based system is an elevator system, and the command gesture is an elevator command gesture and includes at least one of an up command gesture, a down command gesture, and a floor destination gesture.

11. A method of operating a gesture-based interaction system comprising:

performing a command gesture by a user and captured by a sensor device;

recognizing the command gesture by a signal processing unit; and

outputting a command interpretation signal associated with the command gesture to a confirmation device for confirmation by the user.

12. The method set forth in claim 11 further comprising:

performing a wake-up gesture by the user captured by the sensor device; and

acknowledging receipt of the wake-up gesture by the signal processing unit.

13. The method set forth in claim 12 further comprising:

performing a confirmation gesture by the user to confirm the command interpretation signal.

14. The method set forth in claim 13 further comprising:

recognizing the confirmation gesture by the signal processing unit by utilizing recognition software and pre-defined gesture data.

15. The method set forth in claim 13 further comprising:

recognizing the command gesture by the signal processing unit by utilizing recognition software and pre-defined gesture data.

16. The method set forth in claim 15 further comprising:

sending a command signal associated with the command gesture to an equipment-based system by the signal processing unit.

17. The method set forth in claim 12, wherein the wake-up gesture and the command gesture are visual gestures.

18. The method set forth in claim 17, wherein the sensor device includes an optical camera for capturing the visual gestures and outputting a captured signal to the signal processing unit.

19. The method set forth in claim 18, wherein the signal processing unit includes a processor and a storage medium, and the processor is configured to execute recognition software to recognize the visual gestures.