System and method for using a side camera for a free space gesture inputs

• US 9,317,129 B2
• Filed: 03/25/2014
• Issued: 04/19/2016
• Est. Priority Date: 03/25/2014
• Status: Active Grant

• Current Assignee: Dell Products LP (Dell Technologies Inc.)
• Original Assignee: Dell Products LP (Dell Technologies Inc.)
• Inventors: Musgrave, Kenneth C., Aurongzeb, Deeder M.
• Primary Examiner(s): Johnson, Gerald
• Application Number:
  US14/224,260
• Publication Number:
  US 20150277566A1
• Time in Patent Office: 756 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes

Abstract

An information handling system including a camera mounted in the side edge surface for detecting gestures by a user in a gesture detecting zone next to the system and including a gesture detection system for interpreting free space gestures and initializing cursor control commands.

Claims

1. An information handling system having a free space gesture detection system comprising:

a housing with a front facing surface, a back facing surface, and at least one side edge connecting the front facing surface and back facing surface;

a camera mounted in the side edge surface of the housing oriented to detect gestures by a user in a gesture detection zone next to the information handling system;

a free space gesture detection system executing instructions on a processor determining available gesture commands for a software application operating on the information handling system;

the free space gesture detection system maintaining a virtual gesture detection plane in the gesture detection zone, the virtual gesture detection plane calibrated to a location and tilt angle of a user'"'"'s hand; and

the processor interpreting detected gestures in the virtual gesture detection zone to correspond to cursor control commands in the software application operating on the information handling system.

2. The system of claim 1, further comprising:

an orientation sensor for detecting orientation of the information handling system relative to calibrating the virtual gesture detection plane to the location and angle and tilt angle of the user'"'"'s hand.

3. The system of claim 1, further comprising:

a second camera for detecting depth for calibration of the virtual gesture detection plane.

4. The system of claim 1, wherein the free space gesture detection system maintains the virtual gesture detection plane by sensing and adjusting depth and angle of tilt calibration to changes in the location and angle of the user'"'"'s hand.

5. The system of claim 1, wherein the free space gesture detection system detects palm and finger elements of a user'"'"'s hand in the virtual gesture detection plane to sense virtual mouse movements including virtual finger clicks.

6. The system of claim 1, wherein the free space gesture detection system detects a fingertip element of a user'"'"'s hand in the virtual gesture detection plane to sense virtual track pad input movements including virtual finger touches and drags.

7. The system of claim 1, wherein if the camera detects a working surface in the gesture detection zone, the free space gesture detection system maintains the virtual gesture detection plane to correspond to the working surface.

8. The system of claim 1, further comprising:

the camera includes a first two dimensional camera and a second three dimensional camera,

wherein the free space gesture detection system has a 2D mode using the first two dimensional camera when a working surface is detected in the gesture detection zone and a 3D mode when no working surface is detected.

9. The system of claim 1, further comprising:

a light projection system to project to a location corresponding with boundaries of the virtual gesture detection plane.

10. A computer-implemented a free space gesture detection method comprising:

detecting, via a side mounted camera on an information handling system, gestures by a user in a gesture detection zone next to the information handling system;

determining, via a processor executing instructions, available gesture commands for a software application operating on the information handling system;

maintaining a virtual gesture detection plane in the gesture detection zone;

calibrating the virtual gesture detection plane to a location and tilt angle of a user'"'"'s hand; and

interpreting detected gestures in the virtual gesture detection zone, via the processor, to correspond to cursor control commands in the software application operating on the information handling system.

11. The method of claim 10, wherein maintaining the virtual gesture detection plane includes sensing and adjusting depth and angle of tilt calibration to changes in the location and angle of the user'"'"'s hand via a second camera.

12. The method of claim 10, further comprising:

detecting orientation of the information handling system, via orientation sensors, to calibrate the virtual gesture detection plane to the location and angle and tilt angle of the user'"'"'s hand relative to the information handling system.

13. The method of claim 10, further comprising:

detecting palm and finger elements of a user'"'"'s hand in the virtual gesture detection plane to sense virtual mouse movements including virtual finger clicks and finger scroll movement.

14. The method of claim 10, further comprising:

detecting a finger element of a user'"'"'s hand in the virtual gesture detection plane to sense virtual track pad input movements including virtual finger touches and drags.

15. The method of claim 10, further comprising:

detecting a working surface in the gesture detection zone; and

maintaining the virtual gesture detection plane to correspond to the working surface.

16. The method of claim 10, further comprising:

projecting a laser light boundary corresponding with boundaries of the virtual gesture detection plane.

17. An information handling system having a free space gesture detection system comprising:

a side mounted camera to detect gestures by a user in a gesture detection zone next to the information handling system;

a free space gesture detection system executing instructions on a processor determining a virtual gesture detection plane in the gesture detection zone;

the free space gesture detection system calibrating the virtual gesture detection plane calibrated to a location and tilt angle of a user'"'"'s hand;

an orientation sensor for detecting orientation of the information handling system and camera relative to calibrating the virtual gesture detection plane to the location and tilt angle of the user'"'"'s hand; and

the processor interpreting detected gestures in the virtual gesture detection zone to correspond to control commands for a software application operating on the information handling system.

18. The system of claim 17, wherein the free space gesture detection system detects the software application running on the information handling system and determines available gesture commands for use with the software application.

19. The system of claim 17, further comprising:

the free space gesture detection system interpreting detected gestures via a gesture classifier comparing the detected gesture with a gesture database via the processor.

20. The system of claim 17, wherein the free space gesture detection system operates in a plurality of modes representing a plurality of gesture driven virtual I/O input devices.