Methods and systems for enabling depth and direction detection when interfacing with a computer program
First Claim
1. A method for detecting depth and direction when interfacing with a computer program, comprising:
- (a) capturing stereo images presented in front of one or more image capture devices, wherein each image capture device has a capture location in a coordinate space;
when a person is captured in the image, (b) identifying a human head in the image and assigning the human head a head location in the coordinate space;
(c) identifying an object held by the person in the image and assigning the object an object location in coordinate space; and
(d) identifying a relative position in coordinate space between the head location and the object location when viewed from the capture location, wherein the relative position includes a dimension of depth with respect to the coordinate space.
4 Assignments
0 Petitions
Accused Products
Abstract
A method for detecting direction when interfacing with a computer program is provided. The method includes capturing an image presented in front of an image capture device. The image capture device has a capture location in a coordinate space. When a person is captured in the image, the method includes identifying a human head in the image and assigning the human head a head location in the coordinate space. The method also includes identifying an object held by the person in the image and assigning the object an object location in coordinate space. The method further includes identifying a relative position in coordinate space between the head location and the object location when viewed from the capture location. The relative position includes a dimension of depth. The method may be practiced on a computer system, such as one used in the gaming field.
414 Citations
34 Claims
-
1. A method for detecting depth and direction when interfacing with a computer program, comprising:
-
(a) capturing stereo images presented in front of one or more image capture devices, wherein each image capture device has a capture location in a coordinate space;
when a person is captured in the image, (b) identifying a human head in the image and assigning the human head a head location in the coordinate space;
(c) identifying an object held by the person in the image and assigning the object an object location in coordinate space; and
(d) identifying a relative position in coordinate space between the head location and the object location when viewed from the capture location, wherein the relative position includes a dimension of depth with respect to the coordinate space. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A method for detecting depth and direction when interfacing with a computer program, comprising:
-
(a) capturing an image presented in front of one or more image capture devices, wherein the image capture device has a capture location in a coordinate space;
when a person is captured in the image, (b) identifying a human head in the image and assigning the human head a head location in the coordinate space;
(c) identifying an object held by the person in the image and assigning the object an object location in coordinate space;
(d) receiving at a plurality of microphones at known positions relative to the image capture device a sound signal originating from the object;
(e) identifying a relative position in coordinate space between the head location and the object location when viewed from the capture location, and the relative times of arrival of the sound signal at the microphones, wherein the relative position includes a dimension of depth with respect to the coordinate space.
-
-
21. A method for detecting pointing direction of an object directed toward a display screen that can render graphics of a computer program, comprising:
-
(a) capturing two or more stereo images presented in front of two or more image capture devices, each image capture device having a capture location in a coordinate space that is proximate to the display screen;
when a person is captured in the image, (b) identifying a first body part of the person in the image and assigning the first body part a first location in the coordinate space;
(c) identifying a second body part of the person in the image and assigning the second body part a second location in coordinate space; and
(d) identifying a relative position in coordinate space between the first location and the second location when viewed from the capture location, wherein the relative position includes a dimension of depth. - View Dependent Claims (22, 23, 25, 26, 27, 28, 29, 30, 31, 32, 33)
-
-
24. The method of 21, wherein (a)-(d) is repeated continually during execution of the computer program, and
examining a shape of the human hand during the repeating of (a)-(d) to determine particular shape changes.
-
34. A method for detecting pointing direction of an object directed toward a display screen that can render graphics of a computer program, comprising:
-
(a) capturing an image presented in front an image capture device, the image capture device having a capture location in a coordinate space that is proximate to the display screen;
when a person is captured in the image, (b) identifying a first body part of the person in the image and assigning the first body part a first location in the coordinate space;
(c) identifying a second body part of the person in the image and assigning the second body part a second location in coordinate space;
(d) receiving at a plurality of microphones at known positions relative to the image capture device a sound signal originating from the object; and
(e) identifying a relative position in coordinate space between the first location and the second location when viewed from the capture location, wherein the relative position includes a dimension of depth.
-
Specification