SYSTEMS AND METHODS FOR GESTURE RECOGNITION

• US 20140354540A1
• Filed: 06/02/2014
• Published: 12/04/2014
• Est. Priority Date: 06/03/2013
• Status: Abandoned Application

• Current Assignee: Khaled Barazi
• Original Assignee: Khaled Barazi
• Inventors: Barazi, Khaled
• Application Number:
  US14/293,455
• Publication Number:
  US 20140354540A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

According to various aspects, systems and methods are disclosed for the implementation of a touch-free, gesture based user interface for mobile computing systems. Aspects of the system describe components used for capturing digital video frames from a video stream using the native hardware of the mobile computing system. Further aspects of the system describe efficient object recognition and tracking components capable of recognizing the motion of a defined model object. Various aspects of the disclosed system provide systems and processes for associating the recognized motion of a model object with a gesture, as well as associating the gesture with a user interface operation.

Claims

1. A system for providing a gesture based user interface, the system comprising:

a memory;

at least one processor operatively connected to the memory;

a display device coupled to the at least one processor;

at least one native digital camera coupled to the at least one processor; and

an object tracking component executed by the at least one processor that can be configured to associate the tracking of objects with user interface operations.

2. The system of claim 1, wherein:

the at least one native digital camera can be configured to capture digital video; and

the captured digital video can be displayed with the center of the field of view captured by the at least one digital camera aligned to the center of the display device.

3. The system of claim 2, wherein the object tracking component is further configured to define a model object boundary location for display on the display device.

4. The system of claim 3, further comprising a training component configured to provide instruction to a user on placement of a model object in relation to the model object boundary location.

5. The system of claim 3, wherein the training component is configured to provide user instruction that a proper model object can be obtained by the native digital camera.

6. The system of claim 3, wherein the model object boundary location can be displayed on the display device simultaneously with the digital video.

7. The system of claim 3, wherein the object tracking component is configured to capture digital video data of a model object within the model object boundary location.

8. The system of claim 7, wherein the object tracking component is configured to define the model object from captured digital video data.

9. The system of claim 8, wherein the object tracking component is configured to identify the model object within successive video frames.

10. The system of claim 1, wherein the object tracking component is further configured to define a digital image of a model object and wherein the processor is further configured to perform edge detection on the digital image of the model object to obtain an edge image of the model object.

11. A method for performing computer user interface operations, the method comprising:

capturing a digital video;

displaying captured video on a display device;

identifying a model object within a first video frame;

tracking a model object by matching objects within successive video frames;

associating the location of a model object in successive video frames with a gesture;

associating a gesture with a user interface operation; and

executing a user interface operation.

12. The method of claim 11, wherein capturing the digital video further comprises the use of at least one native digital camera integrated into a computer to capture the digital video.

13. The method of claim 12, wherein displaying the captured digital video on the display device further comprises aligning the center of the captured video with the center of the display device.

14. The method of claim 13, wherein identifying a model object further comprises defining a model object boundary location for display on the display device.

15. The method of claim 14, wherein identifying the model object further comprises providing instruction to a user on placement of the model object in relation to the model object boundary location.

16. The method of claim 14, wherein identifying the model object further comprises displaying the model object on the display device simultaneously with the digital video.

17. The method of claim 14, wherein identifying the model object further comprises capturing digital video data of a model object within the model object boundary location.

18. The method of claim 17, wherein identifying the model object further comprises defining the model object from the captured digital video data.

19. The method of claim 11, wherein tracking the model object further comprises performing edge detection on the digital image of the model object to obtain an edge image of the model object.

20. The method of claim 19, wherein tracking the model object further comprises performing Canny edge detection on the digital image of the model object.