System and method for using a side camera for free space gesture inputs

• US 9,823,753 B2
• Filed: 04/20/2017
• Issued: 11/21/2017
• Est. Priority Date: 03/25/2014
• Status: Active Grant

• Current Assignee: Dell Products LP (Dell Technologies Inc.)
• Original Assignee: Dell Products LP (Dell Technologies Inc.)
• Inventors: Musgrave, Kenneth C., Aurongzeb, Deeder M.
• Primary Examiner(s): Johnson, Gerald
• Application Number:
  US15/493,027
• Publication Number:
  US 20170220127A1
• Time in Patent Office: 215 Days
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes

Abstract

An information handling system including a camera mounted in the side edge surface for detecting gestures by a user on a detected working surface in a gesture detecting zone next to the system and including a gesture detection system for interpreting free space gestures and initializing cursor control commands.

Claims

1. An information handling system having a free space gesture detection system comprising:

a housing;

a camera mounted in the housing and oriented to detect gestures by a user in a gesture detection zone adjacent to the information handling system;

a free space gesture detection system executing instructions on a processor determining available gesture commands for a software application operating on the information handling system;

the free space gesture detection system detecting gestures in a virtual gesture detection plane, the virtual gesture detection plane calibrated to a location of a user'"'"'s hand on a location and tilt angle of an assigned virtual working surface; and

the processor accessing a gesture database and rating the detected gestures in the virtual gesture detection plane to correspond to a gesture classification.

2. The system of claim 1, further comprising:

the assigned virtual working surface corresponding to a location and tilt angle of a detected physical working surface in the gesture detection zone.

3. The system of claim 1, further comprising:

the assigned virtual working surface having an established location and tilt angle in space adjacent to the information handling system assigned by the free space gesture detection system in the gesture detection zone.

4. The system of claim 1, further comprising:

the detected gestures by the free space gesture detection system initializing commands corresponding to the determined gesture classification.

5. The system of claim 1, further comprising:

a second camera for detecting depth for calibration of the virtual gesture detection plane.

6. The system of claim 1, further comprising:

an orientation sensor for detecting orientation of the information handling system relative to calibrating the virtual gesture detection plane to the location of the user'"'"'s hand on the assigned virtual working surface.

7. The system of claim 6, further comprising:

a display device that may be oriented in any orientation relative to the virtual gesture detection plane and the location of the user'"'"'s hand.

8. The system of claim 1, wherein the free space gesture detection system detects palm or finger elements of a user'"'"'s hand in the virtual gesture detection plane to sense cursor control movements.

9. The system of claim 1 wherein the information handling system is a laptop computer.

10. A computer-implemented a free space gesture detection method comprising:

detecting, via camera mounted in the housing and oriented to detect gestures by a user in a gesture detection zone, gestures by a user in a gesture detection zone adjacent to the information handling system;

determining, via a processor executing instructions, available gesture commands for a software application operating on the information handling system;

detecting gestures in a virtual gesture detection plane, the virtual gesture detection plane calibrated to a location of a user'"'"'s hand on a location and tilt angle of an assigned virtual working surface; and

accessing a gesture database and rating the detected gestures in the virtual gesture detection plane to correspond to a gesture classification. to correspond to cursor control commands in the software application operating on the information handling system.

11. The method of claim 10, further comprising:

initializing commands corresponding to the determined gesture classification based on the detected gestures.

12. The method of claim 10, further comprising:

assigning an location and tilt angle in space adjacent to the information handling system in the gesture detection zone as an assigned virtual working surface.

13. The method of claim 10, wherein establishing the virtual gesture detection plane includes sensing and adjusting depth calibration to changes in the location of a user'"'"'s hand relative to the assigned virtual working surface via a second camera.

14. The method of claim 10, further comprising:

detecting orientation of the information handling system, via orientation sensors, to calibrate the virtual gesture detection plane to the location of the user'"'"'s hand relative to a tilt angle of the camera mounted in information handling system.

15. The method of claim 10, further comprising:

detecting palm and finger elements of a user'"'"'s hand in the virtual gesture detection plane to sense virtual mouse movements including virtual finger clicks and finger scroll movement.

16. The method of claim 10, further comprising:

detecting a finger element of a user'"'"'s hand in the virtual gesture detection plane to sense virtual track pad input movements.

17. An information handling system having a free space gesture detection system comprising:

a housing;

a camera mounted in a housing of the information handling system and oriented to detect gestures by a user in a gesture detection zone adjacent to the information handling system;

a free space gesture detection system executing instructions on a processor determining a virtual gesture detection plane in the gesture detection zone;

a free space gesture detection system executing instructions on a processor and detecting gestures in the virtual gesture detection plane, the virtual gesture detection plane calibrated to a location of a user'"'"'s hand on a location and tilt angle of an assigned virtual working surface assigned by the free space gesture detection system in the gesture detection zone;

an orientation sensor for detecting orientation of the information handling system and camera relative to the location and tilt angle of the assigned virtual working surface; and

the processor accessing a gesture database and rating the detected gestures in the virtual gesture detection plane to correspond to a gesture classification.

18. The system of claim 17, further comprising:

the assigned virtual working surface corresponding to a location and tilt angle of a detected physical working surface in the gesture detection zone.

19. The system of claim 17, wherein the free space gesture detection system detects the software application running on the information handling system and determines available gesture commands for use with the software application.

20. The system of claim 17, further comprising:

the free space gesture detection system interpreting detected gestures via a gesture classifier comparing the detected gesture with a gesture database via the processor.