MAINTAINING MULTIPLE VIEWS ON A SHARED STABLE VIRTUAL SPACE
First Claim
1. A method, comprising:
- receiving, by a head-mounted display (HMD), remote images of a remote real world scene sent by a remote device, the HMD being worn by a user and the remote device being operated by a remote user;
capturing local images of a local real world scene using the HMD;
processing, by the HMD, an augmented view for presentation on a display screen of the HMD by combining the remote images with the captured local images and one or more virtual reality objects, wherein the augmented view simulates that the user and the remote user share a space that includes the one or more virtual reality objects;
detecting an interaction of a hand with a first virtual reality object from the one or more virtual reality objects when the hand makes virtual contact in the augmented view with the first virtual reality object; and
updating the augmented view to the HMD based on the interaction of the hand with the first virtual reality object to simulate that the hand is touching or moving the first virtual reality object.
1 Assignment
0 Petitions
Accused Products
Abstract
Methods, apparatus, and computer programs for controlling a view of a virtual scene with a handheld device are presented. In one method, images of a real world scene are captured using a device. The method further includes operations for creating an augmented view for presentation on a display of the device by augmenting the images with virtual reality objects, and for detecting a hand in the images as extending into the real world scene. In addition, the method includes operations for showing the hand in the screen as detected in the images, and for generating interaction data, based on an interaction of the hand with a virtual reality object, when the hand makes virtual contact in the augmented view with the virtual reality object. The augmented view is updated based on the interaction data, which simulates on the screen that the hand is interacting with the virtual reality object.
28 Citations
20 Claims
-
1. A method, comprising:
-
receiving, by a head-mounted display (HMD), remote images of a remote real world scene sent by a remote device, the HMD being worn by a user and the remote device being operated by a remote user; capturing local images of a local real world scene using the HMD; processing, by the HMD, an augmented view for presentation on a display screen of the HMD by combining the remote images with the captured local images and one or more virtual reality objects, wherein the augmented view simulates that the user and the remote user share a space that includes the one or more virtual reality objects; detecting an interaction of a hand with a first virtual reality object from the one or more virtual reality objects when the hand makes virtual contact in the augmented view with the first virtual reality object; and updating the augmented view to the HMD based on the interaction of the hand with the first virtual reality object to simulate that the hand is touching or moving the first virtual reality object. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A head-mounted display (HMD), comprising:
-
a communications module configured to receive remote images of a remote real world scene sent by a remote device, the HMD being worn by a user and the remote device being operated by a remote user; a camera for capturing local images of a local real world scene using the HMD; and a display screen; and a processor configured to process an augmented view for presentation on the display screen by combining the remote images with the captured local images and one or more virtual reality objects, wherein the augmented view simulates that the user and the remote user share a space that includes the one or more virtual reality objects; wherein the processor detects an interaction of a hand with a first virtual reality object from the one or more virtual reality objects when the hand makes virtual contact in the augmented view with the first virtual reality object, wherein the processor updates the augmented view to the HMD based on the interaction of the hand with the first virtual reality object to simulate that the hand is touching or moving the first virtual reality object. - View Dependent Claims (14, 15, 16, 17)
-
-
18. A non-transitory computer-readable storage medium storing a computer program, the computer-readable storage medium comprising:
-
program instructions for receiving, by a head-mounted display (HMD), remote images of a remote real world scene sent by a remote device, the HMD being worn by a user and the remote device being operated by a remote user; program instructions for capturing local images of a local real world scene using the HMD; program instructions for processing, by the HMD, an augmented view for presentation on a display screen of the HMD by combining the remote images with the captured local images and one or more virtual reality objects, wherein the augmented view simulates that the user and the remote user share a space that includes the one or more virtual reality objects; program instructions for detecting an interaction of a hand with a first virtual reality object from the one or more virtual reality objects when the hand makes virtual contact in the augmented view with the first virtual reality object; and program instructions for updating the augmented view to the HMD based on the interaction of the hand with the first virtual reality object to simulate that the hand is touching or moving the first virtual reality object. - View Dependent Claims (19, 20)
-
Specification