SYSTEM AND METHOD FOR USING A SIDE CAMERA FOR FREE SPACE GESTURE INPUTS

• US 20160195934A1
• Filed: 03/15/2016
• Published: 07/07/2016
• Est. Priority Date: 03/25/2014
• Status: Active Grant

• Current Assignee: Dell Products LP (Dell Technologies Inc.)
• Original Assignee: Dell Products LP (Dell Technologies Inc.)
• Inventors: Musgrave, Kenneth C., Aurongzeb, Deeder M.
• Granted Patent: US 9,658,699 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes

Abstract

An information handling system including a camera mounted in the side edge surface for detecting gestures by a user on a detected working surface in a gesture detecting zone next to the system and including a gesture detection system for interpreting free space gestures and initializing cursor control commands.

Claims

1. An information handling system having a free space gesture detection system comprising:

a housing;

a camera mounted in a side edge surface of the housing oriented to detect gestures by a user in a gesture detection zone next to the information handling system;

a free space gesture detection system executing instructions on a processor determining available gesture commands for a software application operating on the information handling system;

the free space gesture detection system maintaining a virtual gesture detection plane in the gesture detection zone, the virtual gesture detection plane calibrated to a location of a user'"'"'s hand on a detected working surface in the gesture detection zone; and

the processor interpreting detected gestures in the virtual gesture detection zone to correspond to cursor control commands.

2. The system of claim 1, further comprising:

the virtual gesture detection plane calibrated to a location and tilt angle of the detected working surface in the gesture detection zone.

3. The system of claim 1, further comprising:

an orientation sensor for detecting orientation of the information handling system relative to calibrating the virtual gesture detection plane to the location of the user'"'"'s hand on a detected working surface.

4. The system of claim 1, further comprising:

a second camera for detecting depth for calibration of the virtual gesture detection plane.

5. The system of claim 1, wherein the free space gesture detection system maintains the virtual gesture detection plane by sensing and adjusting depth calibration to changes in the location of the user'"'"'s hand on the detected working surface.

6. The system of claim 1, wherein the free space gesture detection system detects palm and finger elements of a user'"'"'s hand in the virtual gesture detection plane to sense virtual mouse movements.

7. The system of claim 1, wherein the free space gesture detection system detects a fingertip element of a user'"'"'s hand in the virtual gesture detection plane to sense virtual track pad input movements including virtual finger touches and drags.

8. The system of claim 1, further comprising:

a light projection system to project to a location on a detected working surface corresponding with boundaries of the virtual gesture detection plane.

9. The system of claim 1 wherein the information handling system is a laptop computer.

10. A computer-implemented a free space gesture detection method comprising:

detecting, via a side mounted camera on an information handling system, gestures by a user in a gesture detection zone next to the information handling system;

determining, via a processor executing instructions, available gesture commands for a software application operating on the information handling system;

the processor interpreting detected gestures in the virtual gesture detection zone to correspond to cursor control commands;

maintaining a virtual gesture detection plane in the gesture detection zone, the virtual gesture detection plane calibrated to a detected working surface in the gesture detection zone;

calibrating the virtual gesture detection plane to a tilt angle of the detected working surface next to the information handling system; and

interpreting detected gestures in the virtual gesture detection zone, via the processor, to correspond to cursor control commands in the software application operating on the information handling system.

11. The method of claim 10, further comprising:

calibrating the virtual gesture detection plane to a location of a user'"'"'s hand on the detected working surface in the gesture detection zone.

12. The method of claim 10, wherein maintaining the virtual gesture detection plane includes sensing and adjusting depth calibration to changes in the location of a user'"'"'s hand on the detected working surface via a second camera.

13. The method of claim 11, further comprising:

detecting orientation of the information handling system, via orientation sensors, to calibrate the virtual gesture detection plane to the location of the user'"'"'s hand relative to a tilt angle the information handling system.

14. The method of claim 10, further comprising:

detecting palm and finger elements of a user'"'"'s hand in the virtual gesture detection plane to sense virtual mouse movements including virtual finger clicks and finger scroll movement.

15. The method of claim 10, further comprising:

detecting a finger element of a user'"'"'s hand in the virtual gesture detection plane to sense virtual track pad input movements.

16. The method of claim 10, further comprising:

projecting a laser light boundary corresponding with boundaries of the virtual gesture detection plane.

17. An information handling system having a free space gesture detection system comprising:

a side mounted camera to detect gestures by a user in a gesture detection zone next to the information handling system;

a free space gesture detection system executing instructions on a processor determining a virtual gesture detection plane in the gesture detection zone;

an orientation sensor for detecting orientation of the information handling system and camera relative to a location and tilt angle of a detected work surface next to the information handling system; and

the free space gesture detection system calibrating the virtual gesture detection plane calibrated to the location of the user'"'"'s hand over the detected work surface;

the processor interpreting detected gestures in the virtual gesture detection zone to correspond to control commands for a software application operating on the information handling system.

18. The system of claim 17, wherein the free space gesture detection system detects the software application running on the information handling system and determines available gesture commands for use with the software application.

19. The system of claim 17, further comprising:

the free space gesture detection system interpreting detected gestures via a gesture classifier comparing the detected gesture with a gesture database via the processor.

20. The system of claim 17 wherein the information handling system is a tablet computer.