Selective hand occlusion over virtual projections onto physical surfaces using skeletal tracking
First Claim
1. A method of rendering images in an augmented reality system, comprising:
- capturing an image of a scene, in which a virtual object is to be displayed;
recognizing, via a computing device, a body part present in the captured image;
determining, via the computing device, and in response to the recognizing, whether the body part belongs to a first individual or a second individual;
displaying, via the computing device, the virtual object so that the virtual object appears to be located beneath the recognized body part when it is determined that the body part belongs to the first individual; and
displaying, via the computing device, the virtual object superimposed over the recognized body part of the second individual when it is determined that the body part belongs to the second individual.
1 Assignment
0 Petitions
Accused Products
Abstract
A head mounted device provides an immersive virtual or augmented reality experience for viewing data and enabling collaboration among multiple users. Rendering images in a virtual or augmented reality system may include performing operations for capturing an image of a scene in which a virtual object is to be displayed, recognizing a body part present in the captured image, and adjusting a display of the virtual object based upon the recognized body part. The rendering operations may also include capturing an image with a body mounted camera, capturing spatial data with a body mounted sensor array, recognizing objects within the captured image, determining distances to the recognized objects within the captured image, and displaying the virtual object on a head mounted display.
66 Citations
40 Claims
-
1. A method of rendering images in an augmented reality system, comprising:
-
capturing an image of a scene, in which a virtual object is to be displayed; recognizing, via a computing device, a body part present in the captured image; determining, via the computing device, and in response to the recognizing, whether the body part belongs to a first individual or a second individual; displaying, via the computing device, the virtual object so that the virtual object appears to be located beneath the recognized body part when it is determined that the body part belongs to the first individual; and displaying, via the computing device, the virtual object superimposed over the recognized body part of the second individual when it is determined that the body part belongs to the second individual. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A computing device, comprising:
-
a memory; and a processor coupled to the memory, wherein the processor is configured with processor-executable instructions to perform operations comprising; capturing an image of a scene, in which a virtual object is to be displayed; recognizing a body part present in the captured image; determining, via the computing device, and in response to the recognizing, whether the body part belongs to a first individual or a second individual; displaying, via the computing device, the virtual object so that the virtual object appears to be located beneath the recognized body part when it is determined that the body part belongs to the first individual; and displaying, via the computing device, the virtual object superimposed over the recognized body part of the second individual when it is determined that the body part belongs to the second individual. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. A computing device, comprising:
-
means for capturing an image of a scene, in which a virtual object is to be displayed means for recognizing a body part present in the image; means for determining, in response to the recognizing, whether the body part belongs to a first individual or a second individual; means for displaying the virtual object so that the virtual object appears to be located beneath the recognized body part when it is determined that the body part belongs to the first individual; and means for displaying the virtual object superimposed over the recognized body part of the second individual when it is determined that the body part belongs to the second individual. - View Dependent Claims (22, 23, 24, 25, 26, 27, 28)
-
-
29. A non-transitory computer readable storage medium having stored thereon processor-executable software instructions configured to cause a processor to perform operations for rendering images in an augmented reality system, the operations comprising:
-
capturing an image of a scene, in which a virtual object is to be displayed; recognizing a body part present in the captured image; determining and in response to the recognizing, whether the body part belongs to a first individual or a second individual; displaying the virtual object so that the virtual object appears to be located beneath the recognized body part when it is determined that the body part belongs to the first individual; and displaying the virtual object superimposed over the recognized body part of the second individual when it is determined that the body part belongs to the second individual. - View Dependent Claims (30, 31, 32, 33, 34, 35, 36)
-
-
37. A method of rendering images in an augmented reality system, comprising:
-
capturing, via a computing device, an image of a scene in which a virtual object is to be displayed; recognizing, via the computing device, a body part present in the captured image; determining, via the computing device and in response to the recognizing, whether the body part belongs to a first individual or a second individual based on at least one of an orientation of the recognized body part, a distance of the recognized body part from a body mounted camera, or a number of body parts determined to be in the captured image; displaying, via the computing device, the virtual object superimposed over the recognized body part of the second individual when it is determined that the body part belongs to the second individual; and displaying, via the computing device, the virtual object so that the virtual object appears to be located beneath the recognized body part when it is determined that the body part belongs to the first individual.
-
-
38. A computing device, comprising:
-
a memory; and a processor coupled to the memory, wherein the processor is configured with processor-executable instructions to perform operations comprising; capturing an image of a scene in which a virtual object is to be displayed; recognizing a body part present in the captured image; determining, in response to the recognizing, whether the body part belongs to a first individual or a second individual based on at least one of an orientation of the recognized body part, a distance of the recognized body part from a body mounted camera, or a number of body parts determined to be in the captured image; displaying the virtual object so that the virtual object appears to be located beneath the recognized body part when it is determined that the body part belongs to the first individual; and displaying the virtual object superimposed over the recognized body part of the second individual when it is determined that the body part belongs to the second individual.
-
-
39. A computing device, comprising:
-
means for capturing an image of a scene in which a virtual object is to be displayed; means for recognizing a body part present in the image; means for determining whether the body part belongs to a first individual or a second individual based on at least one of an orientation of the body part, a distance of the body part from a body mounted camera, or a number of body parts determined to be in the image, the means for determining configured to act in response to a recognition of the body part in the image; means for displaying the virtual object superimposed over the recognized body part of the second individual when it is determined that the body part belongs to the second individual; and means for displaying the virtual object so that the virtual object appears to be located beneath the recognized body part when it is determined that the body part belongs to the first individual.
-
-
40. A non-transitory computer readable storage medium having stored thereon processor-executable software instructions configured to cause a processor to perform operations for rendering images in an augmented reality system, the operations comprising:
-
capturing an image of a scene in which a virtual object is to be displayed; recognizing a body part present in the captured image; determining, in response to the recognizing, whether the body part belongs to a first individual or a second individual based on at least one of an orientation of the recognized body part, a distance of the recognized body part from a body mounted camera, or a number of body parts determined to be in the captured image; displaying the virtual object so that the virtual object appears to be located beneath the recognized body part when it is determined that the body part belongs to the first individual; and displaying the virtual object superimposed over the recognized body part of the second individual when it is determined that the body part belongs to the second individual.
-
Specification