Remote control apparatus using gesture recognition

• US 7,821,541 B2
• Filed: 06/22/2007
• Issued: 10/26/2010
• Est. Priority Date: 04/05/2002
• Status: Expired due to Fees

• Current Assignee: Bruno Delean
• Original Assignee: Bruno Delean
• Inventors: Delean, Bruno
• Primary Examiner(s): Jerabek; Kelly L
• Application Number:
  US11/821,215
• Publication Number:
  US 20070252898A1
• Time in Patent Office: 1,222 Days
• Field of Search: 348/211.99, 348/211.1, 382/115, 382/118, 382/181, 382/203, 382/288
• US Class Current: 348/211.1
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 10/40 Extraction of image or video features
• CPC Class Codes: G06V 10/75 Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
• CPC Class Codes: G06V 40/107 Static hand or arm

Abstract

A video processor for recognizing gestures, including a video camera for capturing photographs of a region within the camera'"'"'s field of view, in real-time, an image processor coupled with the video camera for detecting a plurality of hand gestures from the photographs captured by the video camera, and a controller coupled with the image processor, wherein the controller can be in a dormant mode or an active mode, and wherein the controller transitions from dormant mode to active mode when the image processor detects a progression of two states within the captured photographs, the two states being (i) a closed fist and (ii) an open hand, and wherein the controller performs a programmed responsive action to an electronic device based on the hand gestures detected by the image processor when the controller is in active mode. A method and a computer-readable storage medium are also described and claimed.

Claims

1. A video processor for recognizing gestures, comprising:

a video camera for capturing photographs of a region within the camera'"'"'s field of view, in real-time;

an image processor coupled with said video camera for detecting a plurality of hand gestures from the photographs captured by said video camera; and

a controller coupled with said image processor, wherein said controller can be in a dormant mode or an active mode, and wherein said controller transitions from dormant mode to active mode when said image processor detects a progression of two states within the captured photographs, the two states being (i) a closed fist and (ii) an open hand, wherein said controller issues a command to an electronic device based on the hand gestures detected by said image processor only when said controller is in active mode, and wherein said controller transitions back to the dormant mode after issuing a command.

2. The video processor of claim 1 wherein said image processor also detects if the two states (i)-(ii) occur within pre-specified time intervals, one after the next.

3. The video processor of claim 1 wherein said image processor detects the progression of the two states (i)-(ii) based on edge filters of the captured photographs.

4. The video processor of claim 1 wherein said image processor detects the progression of the two states (i)-(ii) based on motion detection.

5. The video processor of claim 1 wherein the plurality of hand gestures includes moving a hand to the right or to the left.

6. The video processor of claim 1 wherein the plurality of hand gestures includes moving a hand up or down.

7. The video processor of claim 1 wherein the plurality of hand gestures includes moving a hand forward or backward.

8. The video processor of claim 1 wherein the command is one of a turn on/turn off command to the electronic device.

9. The video processor of claim 1 wherein the command is one of a volume up/volume down command to the electronic device.

10. The video processor of claim 1 wherein the command is one of a next channel/previous channel command to the electronic device.

11. The video processor of claim 1 wherein the action command is one of a play/pause command to the electronic device.

12. The video processor of claim 1 wherein the command is one of a fast forward/reverse play command to the electronic device.

13. The video processor of claim 1 wherein said controller transitions from active mode to dormant mode when said image processor detects a closed fist.

14. A method for recognizing gestures, comprising:

capturing photographs of a region in real-time;

detecting a plurality of hand gestures;

detecting a progression of two states within the captured photographs, in real-time, the two states being (i) a closed fist and (ii) an open hand;

transitioning from a dormant mode to an active mode after said detecting the progression of the two states;

issuing a command to an electronic device based on hand gestures detected while in the active mode; and

transitioning to the dormant mode after issuing a command.

15. The method of claim 14 wherein said detecting a progression also detects if the two states (i)-(ii) occur within pre-specified time intervals, one after the next.

16. The method of claim 14 wherein said detecting a progression detects the progression of the two states (i)-(ii) based on edge filters of the captured photographs.

17. The method of claim 14 wherein said detecting a progression detects the progression of the two states (i)-(ii) based on motion detection.

18. The method of claim 14 wherein the plurality of hand gestures includes moving a hand to the right or to the left.

19. The method of claim 14 wherein the plurality of hand gestures includes moving a hand up or down.

20. The method of claim 14 wherein the plurality of hand gestures includes moving a hand forward or backward.

21. The method of claim 14 wherein the command is one of a turn on/turn off command.

22. The method of claim 14 wherein the command is one of a volume up/volume down command.

23. The method of claim 14 wherein the command is one of a next channel/previous channel command.

24. The method of claim 14 wherein the command is one of a play/pause command.

25. The method of claim 14 wherein the command is one of a fast forward/reverse play command.

26. A computer readable storage medium storing program code for causing a computing device:

to capture photographs of a region in real-time;

to detect a plurality of hand gestures;

to detect a progression of two states within the captured photographs, in real-time, the two states being (i) a closed fist and (ii) an open hand;

to transition from a dormant mode to an active mode after said detecting the progression of the two states;

to issue a command to an electronic device-based on hand gestures detected while in the active mode; and

to transition to the dormant mode after issuing a command.