System and method for sensing a feature of an object in an interactive video display

• US 8,081,822 B1
• Filed: 05/31/2005
• Issued: 12/20/2011
• Est. Priority Date: 05/31/2005
• Status: Active Grant

• Current Assignee: Intellectual Ventures Assets 7 LLC (Intellectual Ventures LLC)
• Original Assignee: Intellectual Ventures Holding 67 LLC (Intellectual Ventures LLC)
• Inventors: Bell, Matthew T.
• Primary Examiner(s): Le, Brian Q
• Assistant Examiner(s): BEKELE, MEKONEN T
• Application Number:
  US11/142,202
• Time in Patent Office: 2,394 Days
• Field of Search: 382/181, 382/103, 382/240, 345156-158, 345/179, 345/180
• US Class Current: 382/181
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

Embodiments of the present invention include a method for processing captured image information in an interactive video display system. The method includes accessing a region of a vision image. The method further includes comparing the region of the vision image to a first orientation of a value image. The value image comprises a plurality of weighted values representing a feature to be detected. The method further includes comparing the region of the vision image to a second orientation of the value image. The method further includes determining which orientation of the value image best matches the feature to be detected to an object of the region of the vision image.

Claims

1. A method of determining an angular position of a human finger depicted in a captured image, wherein the method is configured for execution by a computing system comprising one or more computing devices, the method comprising:

accessing, by a, computing system, a first portion of a captured image, wherein the captured image comprises at least an image of a human finger;

comparing, by the computing system, the first portion of the captured image to a value image at each of a plurality of angular positions of the value image, wherein the value image comprises a plurality of regions each associated with a respective weighted value and wherein a region of the value image associated with a region of interest of the human finger is assigned a higher weighted value than other regions of the value image;

calculating, by the computing system, respective match values for each of the plurality of angular positions of the value image by multiplying pixels of the captured image and corresponding weighted values of the angular positions of the value image; and

selecting as an angular position of the image of the human finger in the captured image the angular position of the value image associated with a highest match value.

2. The method as described in claim 1, further comprising:

consecutively accessing by the computing system each of a plurality of portions of the captured image;

comparing by the computing system the plurality of portions of the captured image to each of the plurality of angular positions of the value image;

calculating by the computing system respective match values for each region of the value image for each of the plurality of angular positions of the value image; and

selecting a portion of the captured image as comprising the image of the human finger based on the calculated match values.

3. The method of claim 2, further comprising selecting as an angular position of the image of the human finger the angular position associated with the angular position of the value image associated with a highest match value.

4. The method of claim 1 wherein the captured image is a frame of a video image.

5. A computing system for processing image information, the system comprising:

a device configured to access at least a portion of an input image;

a comparer configured to;

select a pixel within the portion of the input image;

access a value image representative of a feature to be identified within the input image, wherein the value image comprises a plurality of regions each having a weighted value and wherein regions of the value image that are positioned closest to a primary portion of the feature to be identified are assigned higher weighted values; and

compare a plurality of rotational orientations of the value image to a selected area around and including the selected pixel; and

a determiner configured to determine which of the plurality of rotational orientations of the value image best matches the area around and including the selected pixel based on the comparisons performed by the comparer.

6. The computing system of claim 5, wherein the comparer is further configured to multiply respective values associated with pixels of the input image with the weighted values of the regions of respective rotational orientations of the value image and then to sum resulting products in order to generate image values for each respective rotational orientation of the value image.

7. The computing system of claim 6, wherein the determiner determines which of the plurality of rotational orientations of the value image best matches the portion of the input image based on which of the rotational orientations of the value image has a highest image value.

8. A method comprising:

comparing, by a computing system, at least a portion of an image depicting an object to different rotations of a template image representative of rotations of the object, wherein the template image comprises a plurality of regions each having a weighted value and wherein regions of the template image that are positioned closest to a primary portion of the object depicted in the image are assigned higher weighted values;

determining, by the computing system, a match score for each of the rotations of the template image by multiplying pixels of the portion of the image and corresponding weighted values of respective rotations of the template images;

determining a rotation of the template image having a highest match score; and

determining a rotational position of the object depicted in the image to be substantially a rotational position associated with the determined rotation of the template image having a highest match score.

9. The method of claim 8, wherein the object comprises a human finger, arm, leg, toe, elbow, or head.

10. The method of claim 8, wherein the object comprises an inanimate object, a baseball, a hockey stick, a ball, a fishing rod, or an object used to interact with a displayed object of an interactive display system.

11. The method of claim 8, wherein the method comprises:

determining a highest match score for each portion of the image; and

determining which portion of the image has a highest match score in order to determine which portion of the image most likely includes the object.

12. A non-transitory computer readable medium storing software instructions that are readable by a computing system, wherein the software instructions are executable on the computing system in order to cause the computing system to perform operations comprising:

accessing an image depicting an object;

comparing at least a portion of the image to two or more orientations of a value image representative of the object, wherein the value image comprises a plurality of regions each having a weighted value and wherein one or more regions of the value image that are nearest to a portion of interest of the object depicted in the image are assigned higher weighted values than other regions of the value image;

determining a match score for each of the orientations of the value image by multiplying pixels of the image with respective weighted values of the regions of the value image at different orientations;

determining an orientation of the value image having a highest match score to the portion of the image; and

determining an orientation of the object depleted in the image to be substantially the determined orientation of the value image having the highest match score.