SINGLE CAMERA TRACKER

• US 20100091110A1
• Filed: 10/13/2009
• Published: 04/15/2010
• Est. Priority Date: 10/10/2008
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: GestureTek Incorporated (Winning Brands Corp.)
• Inventors: Hildreth, Evan
• Granted Patent: US 9,030,564 B2
• Time in Patent Office: Days
• US Class Current: 348/169
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A camera tracker, in which an image captured by a camera oriented to capture images across a surface is accessed. A region in which an object detected within the accessed image is positioned is determined from among multiple defined regions within a field of view of the camera. User input is determined based on the determined region and an application is controlled based on the determined user input.

Claims

1. An electronic device comprising:

a camera oriented to capture images across a surface; and

a processing unit configured to perform operations comprising;

accessing an image captured by the camera;

identifying multiple regions that are defined within a field of view of the camera and that each correspond to one interface control positioned on the surface;

determining, from among the multiple defined regions, a region in which an object detected within the accessed image is positioned;

determining user input based on the one interface control that corresponds to the determined region; and

controlling an application based on the determined user input.

2. The electronic device of claim 1 wherein determining, from among the multiple defined regions, a region in which an object detected within the accessed image is positioned comprises:

detecting an object within the accessed image;

determining a position of the detected object within the accessed image;

comparing the determined position to the multiple defined regions within the field of view of the camera; and

based on comparison results, identifying the region in which the detected object is positioned.

3. The electronic device of claim 1 wherein determining, from among the multiple defined regions, a region in which an object detected within the accessed image is positioned comprises:

segmenting the accessed image into segments that each correspond to one of the multiple defined regions;

for each of the segments, analyzing the segment to determine whether an object is present within the segment; and

in response to a determination that an object is present within a particular segment, determining that the object is positioned within a particular region that corresponds to the particular segment.

4. The electronic device of claim 3 wherein determining that the object is positioned within a particular region that corresponds to the particular segment comprises determining that the entire object is present within any portion of the particular region.

5. The electronic device of claim 3 wherein the segment is the only portion of the image analyzed to determine whether an object is present within the segment.

6. The electronic device of claim 1 further comprising a display screen configured to display a graphical user interface that includes a first user interface control displayed at a first position in the graphical user interface and a second user interface control displayed at a second position in the graphical user interface, the second position in the graphical user interface being different than the first position in the graphical user interface,

wherein the camera is oriented to capture images across a surface of the display screen,

wherein determining, from among the multiple defined regions, a region in which an object detected within the accessed image is positioned comprises determining whether an object is present within a first region of the image that corresponds to the first user interface control and determining whether an object is present within a second region of the image that corresponds to the second user interface control, and

wherein determining user input based on the one interface control that corresponds to the determined region and controlling an application based on the determined user input comprises:

in response to a determination that an object is present within the first region of the image, detecting activation of the first user interface control and triggering a first operation associated with activation of the first user interface control; and

in response to a determination that an object is present within the second region of the image, detecting activation of the second user interface control and triggering a second operation associated with activation of the second user interface control.

7. The electronic device of claim 6 wherein the processing unit is configured to perform operations further comprising controlling the display screen to size and shape the first user interface control to fit within the first region of the image and to size and shape the second user interface control to fit within the second region of the image.

8. The electronic device of claim 6:

wherein the first user interface control is a first user interface button; and

wherein detecting activation of the first user interface control and triggering the first operation associated with activation of the first user interface control comprises detecting a press of the first user interface button and triggering a first operation associated with a press of the first user interface button.

9. The electronic device of claim 6:

wherein the first user interface control is a first slider control that spans the first region of the image in a direction that intersects a field of view of the camera; and

wherein detecting activation of the first user interface control and triggering the first operation associated with activation of the first user interface control comprises;

detecting engagement of the first slider control in response to a determination that an object is present within the first region of the image;

determining a position of the object within the first region of the image along the first slider control; and

triggering a first operation that is associated with engagement of the first slider control and that uses the determined position of the object within the first region of the image along the first slider control.

10. The electronic device of claim 6 further comprising a light emitting diode oriented to direct light across the surface of the display screen in a direction that intersects the first region of the image and the second region of the image.

11. The electronic device of claim 10 wherein the light emitting diode directs light across a part of the first region of the image to define an active area in the part of the first region of the image in which the light from the light emitting diode is directed and a false area in a remainder of the first region of the image in which light from the light emitting diode is absent, the first position in the graphical user interface at which the first user interface control is displayed corresponding to the active area of the first region of the image.

12. The electronic device of claim 11 wherein determining whether an object is present within the first region of the image comprises determining whether an illuminated object is present within the first region of the image to detect objects in the active area of the first region of the image and ignore objects in the false area of the first region of the image.

13. The electronic device of claim 12 wherein the light emitting diode is a first light emitting diode configured to illuminate a first area above the display screen, further comprising a second light emitting diode oriented to direct light across the surface of the display screen and configured to illuminate a second area above the display screen that is different than the first area above the display screen illuminated by the first light emitting diode.

14. The electronic device of claim 13 wherein the second area above the display screen illuminated by the second light emitting diode defines a gesture input area and the processing unit is configured to perform operations further comprising detecting gestures within the second area based on an analysis of multiple images captured by the camera.

15. The electronic device of claim 14 wherein the processing unit is configured to perform operations further comprising:

controlling the first light emitting diode and the second light emitting diode to illuminate at alternating times in sequence with images captured by the camera, the images captured by the camera resulting in a first set of images in which the first light emitting diode is illuminated and the second light emitting diode is not illuminated and a second set of images in which the second light emitting diode is illuminated and the first light emitting diode is not illuminated;

processing the first set of images in which the first light emitting diode is illuminated and the second light emitting diode is not illuminated to detect activation of the first user interface control; and

processing the second set of images in which the first light emitting diode is not illuminated and the second light emitting diode is illuminated to detect gestures within the second area.

16. The electronic device of claim 1 wherein the processing unit is configured to perform operations further comprising ignoring portions of the image other than the multiple defined regions of the image such that objects located in portions of the image other than the multiple defined regions of the image are ignored.

17. The electronic device of claim 1:

wherein determining, from among the multiple defined regions, a region in which an object detected within the accessed image is positioned comprises detecting performance of a gesture by an object within the region of the image based on an analysis of multiple images captured by the camera; and

wherein determining user input comprises determining a user input command that corresponds to the detected gesture; and

wherein controlling an application based on the determined user input comprises triggering a first operation that corresponds to the determined user input command.

18. The electronic device of claim 17:

wherein detecting performance of a gesture by an object within the region of the image based on an analysis of multiple images captured by the camera comprises detecting performance of a swiping gesture within the region of the image and a direction of the swiping gesture; and

wherein determining a user input command that corresponds to the detected gesture comprises determining a user input command that corresponds to the swiping gesture in the determined direction of the swiping gesture.

19. At least one computer-readable storage medium encoded with executable instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:

accessing an image captured by a camera oriented to capture images across a surface;

identifying multiple regions that are defined within a field of view of the camera and that each correspond to one interface control positioned on the surface;

determining, from among the multiple defined regions, a region in which an object detected within the accessed image is positioned;

determining user input based on the one interface control that corresponds to the determined region; and

controlling an application based on the determined user input.

20. A method comprising:

accessing an image captured by a camera oriented to capture images across a surface;

identifying multiple regions that are defined within a field of view of the camera and that each correspond to one interface control positioned on the surface;

determining, from among the multiple defined regions, a region in which an object detected within the accessed image is positioned;

determining user input based on the one interface control that corresponds to the determined region; and

controlling an application based on the determined user input.