Capture and render of panoramic virtual reality content
First Claim
1. A computer-implemented method comprising:
- defining, at a computing device, a set of images based on captured images;
receiving, at the computing device, a viewing direction associated with a user of a virtual reality (VR) head mounted display;
receiving, at the computing device, an indication of a change in the viewing direction;
in response to receiving the indication;
configuring, by the computing device, a re-projection of a portion of the set of images, the re-projection based at least in part on the changed viewing direction and a field of view associated with the captured images,converting the portion, using the re-projection, from a spherical perspective projection into a planar perspective projection to reduce vertical parallax in the portion, andgenerating, by the computing device, an updated view based on the re-projection, the updated view configured to correct distortion and provide, in the portion, stereo effects for the user of the head mounted display; and
triggering for display, in the head mounted display, the updated view including a stereo panoramic scene corresponding to the changed viewing direction.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods are described for defining a set of images based on captured images, receiving a viewing direction associated with a user of a virtual reality (VR) head mounted display, receiving an indication of a change in the viewing direction. The methods further include configuring, a re-projection of a portion of the set of images, the re-projection based at least in part on the changed viewing direction and a field of view associated with the captured images, and converting the portion from a spherical perspective projection into a planar perspective projection, rendering by the computing device and for display in the VR head mounted display, an updated view based on the re-projection, the updated view configured to correct distortion and provide stereo parallax in the portion, and providing, to the head mounted display, the updated view including a stereo panoramic scene corresponding to the changed viewing direction.
-
Citations
19 Claims
-
1. A computer-implemented method comprising:
-
defining, at a computing device, a set of images based on captured images; receiving, at the computing device, a viewing direction associated with a user of a virtual reality (VR) head mounted display; receiving, at the computing device, an indication of a change in the viewing direction; in response to receiving the indication; configuring, by the computing device, a re-projection of a portion of the set of images, the re-projection based at least in part on the changed viewing direction and a field of view associated with the captured images, converting the portion, using the re-projection, from a spherical perspective projection into a planar perspective projection to reduce vertical parallax in the portion, and generating, by the computing device, an updated view based on the re-projection, the updated view configured to correct distortion and provide, in the portion, stereo effects for the user of the head mounted display; and triggering for display, in the head mounted display, the updated view including a stereo panoramic scene corresponding to the changed viewing direction. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A computer-implemented method for capturing and generating stereo panoramic content, the method comprising:
-
rotating a camera rig in a first direction while simultaneously capturing, using a stereo pair of cameras arranged on the camera rig, a first set of images associated with a scene surrounding the camera rig; rotating the camera rig in a second direction while simultaneously capturing, using the stereo pair, a second set of images associated with the scene, the camera rig being circular and configured to move, during capture, in an arcing motion parallel to a base of the camera rig, the stereo pair placed with a viewing direction that is offset at opposite sides of a center of the base of the camera rig, the stereo pair being arranged on the camera rig at approximate human interpupillary distance apart; generating a combined set of images from the first set of images and the second set of images; performing a re-projection of a portion of the combined set of images, the re-projection based at least in part on a field of view associated with the first set of images or the second set of images; and generating, using the re-projected portion, at least one stereoscopic panorama of the scene. - View Dependent Claims (9, 10, 11, 12)
-
-
13. A computer-implemented system comprising:
-
at least one processor; memory storing instructions that, when executed by the at least one processor, cause the system to perform operations including; defining, at a computing device, a set of images based on captured images; receiving, at the computing device, a viewing direction associated with a user of a virtual reality (VR) head mounted display; receiving, at the computing device, an indication of a change in the viewing direction; in response to receiving the indication; configuring, by the computing device, a re-projection of a portion of the set of images, the re-projection based at least in part on the changed viewing direction and a field of view associated with the captured images, converting the portion, using the re-projection, from a spherical perspective projection into a planar perspective projection to reduce vertical parallax in the portion, and generating, by the computing device, an updated view based on the re-projection, the updated view configured to correct distortion and provide, in the portion, stereo effects for the user of the head mounted display; and triggering for display, in the head mounted display, the updated view including a stereo panoramic scene corresponding to the changed viewing direction. - View Dependent Claims (14, 15, 16, 17, 18, 19)
-
Specification