ENHANCED CAMERA-BASED INPUT

• US 20140118249A1
• Filed: 01/08/2014
• Published: 05/01/2014
• Est. Priority Date: 07/27/2007
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Hildreth, Evan
• Granted Patent: US 10,268,339 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/03 Arrangements for converting the position or the displacement of a member into a coded form
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence

Abstract

Enhanced camera-based input, in which a detection region surrounding a user is defined in an image of the user within a scene, and a position of an object (such as a hand) within the detection region is detected. Additionally, a control (such as a key of a virtual keyboard) in a user interface is interacted with based on the detected position of the object.

Claims

1. A computer readable medium encoded with a computer program product, the computer program product comprising instructions that, when executed, operate to cause a computer to perform operations comprising:

generate an image of a user within a scene;

defining, in the image, a detection region surrounding the user, further comprising;

determining a position of a torso and a reach of an arm of the user, and

defining the detection region to exclude the torso and at least a portion of a region of the image unreachable by the arm;

detecting a position of a hand of the user within the detection region; and

interacting with a control in a user interface based on the detected position of the hand, the control comprising items aligned with a guide line defined relative to an avatar representation of the user on the user interface.