Adaptive control for immersive experience delivery
First Claim
1. A method for delivering video for a virtual reality or augmented reality experience, the method comprising:
- at a data store, storing video data for a virtual reality or augmented reality experience, the video data comprising a first portion having a first importance metric and a second portion having a second importance metric, the first importance metric and the second importance metric being based on viewing data, the viewing data being one of;
historical viewings of the virtual reality or augmented reality experience indicating a set of portions of the virtual reality or augmented reality experience having been viewed by more viewers than other portions of the virtual reality or augmented reality experience,ora user input being indicative of a plurality of portionscorresponding to a set of stimuli presented as a part of the virtual reality or augmented reality experience;
at a processor, receiving viewpoint data indicative of a position and/or an orientation of a viewer'"'"'s viewpoint;
at the processor, retrieving a subset of the video data from the data store, the subset comprising at least the first portion of the video data;
at the processor, using the subset to generate viewpoint video of the virtual reality or augmented reality experience, from a virtual viewpoint corresponding to the viewer'"'"'s viewpoint; and
on a display device, displaying the viewpoint video;
wherein a difference exists between the first importance metric and the second importance metric, the difference denoting that viewing of the first portion is more likely and/or preferential to viewing of the second portion;
and wherein performing one step selected from the group consisting of storing the video data, retrieving the subset, and using the subset to generate the view-point video comprises, based on the difference, expediting and/or enhancing performance of the step for the first portion, relative to the second portion.
2 Assignments
0 Petitions
Accused Products
Abstract
A combined video of a scene may be generated for applications such as virtual reality or augmented reality. In one method, a data store may store video data with a first portion having a first importance metric, and a second portion having a second importance metric, denoting that viewing of the first portion is more likely and/or preferential to viewing of the second portion. The subset may be retrieved and used to generate viewpoint video from a virtual viewpoint corresponding to a viewer'"'"'s viewpoint. The viewpoint video may be displayed on a display device. One of storing the video data, retrieving the subset, and using the subset to generate the viewpoint video may include, based on the difference between the first and second importance metrics, expediting and/or enhancing performance of the step for the first portion, relative to the second portion.
-
Citations
36 Claims
-
1. A method for delivering video for a virtual reality or augmented reality experience, the method comprising:
-
at a data store, storing video data for a virtual reality or augmented reality experience, the video data comprising a first portion having a first importance metric and a second portion having a second importance metric, the first importance metric and the second importance metric being based on viewing data, the viewing data being one of; historical viewings of the virtual reality or augmented reality experience indicating a set of portions of the virtual reality or augmented reality experience having been viewed by more viewers than other portions of the virtual reality or augmented reality experience, or a user input being indicative of a plurality of portions corresponding to a set of stimuli presented as a part of the virtual reality or augmented reality experience; at a processor, receiving viewpoint data indicative of a position and/or an orientation of a viewer'"'"'s viewpoint; at the processor, retrieving a subset of the video data from the data store, the subset comprising at least the first portion of the video data; at the processor, using the subset to generate viewpoint video of the virtual reality or augmented reality experience, from a virtual viewpoint corresponding to the viewer'"'"'s viewpoint; and on a display device, displaying the viewpoint video; wherein a difference exists between the first importance metric and the second importance metric, the difference denoting that viewing of the first portion is more likely and/or preferential to viewing of the second portion; and wherein performing one step selected from the group consisting of storing the video data, retrieving the subset, and using the subset to generate the view-point video comprises, based on the difference, expediting and/or enhancing performance of the step for the first portion, relative to the second portion. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A non-transitory computer-readable medium for delivering video for a virtual reality or augmented reality experience, comprising instructions stored thereon, that when executed by a processor, perform the steps of:
-
causing a data store to store video data for a virtual reality or augmented reality experience, the video data comprising a first portion having a first importance metric and a second portion having a second importance metric, the first importance metric and the second importance metric being based on viewing data, the viewing data being one of; historical viewings of the virtual reality or augmented reality experience indicating a set of portions of the virtual reality or augmented reality experience having been viewed by more viewers than other portions of the virtual reality or augmented reality experience, or a user input being indicative of a plurality of portions corresponding to a set of stimuli presented as a part of the virtual reality or augmented reality experience receiving viewpoint data indicative of a position and/or an orientation of a viewer'"'"'s viewpoint; retrieving a subset of the video data from the data store, the subset comprising at least the first portion of the video data; using the subset to generate viewpoint video of the virtual reality or augmented reality experience, from a virtual viewpoint corresponding to the viewer'"'"'s viewpoint; and causing a display device to display the viewpoint video; wherein a difference exists between the first importance metric and the second importance metric, the difference denoting that viewing of the first portion is more likely and/or preferential to viewing of the second portion; and wherein performing one step selected from the group consisting of storing the video data, retrieving the subset, and using the subset to generate the view-point video comprises, based on the difference, expediting and/or enhancing performance of the step for the first portion, relative to the second portion. - View Dependent Claims (16, 17, 18, 19, 20, 21, 22, 23, 24, 25)
-
-
26. A system for delivering video for a virtual reality or augmented reality experience, the system comprising:
-
a data store configured to store video data for a virtual reality or augmented reality experience, the video data comprising a first portion having a first importance metric and a second portion having a second importance metric, the first importance metric and the second importance metric being based on viewing data, the viewing data being one of; historical viewings of the virtual reality or augmented reality experience indicating a set of portions of the virtual reality or augmented reality experience having been viewed by more viewers than other portions of the virtual reality or augmented reality experience, or a user input being indicative of a plurality of portions corresponding to a set of stimuli presented as a part of the virtual reality or augmented reality experience a processor, communicatively connected to the data store, configured to; receive viewpoint data indicative of a position and/or an orientation of a viewer'"'"'s viewpoint; retrieve a subset of the video data from the data store, the subset comprising at least the first portion of the video data; and use the subset to generate viewpoint video of the virtual reality or augmented reality experience, from a virtual viewpoint corresponding to the viewer'"'"'s viewpoint; and a display device, communicatively coupled to the processor, configured to display the viewpoint video; wherein a difference exists between the first importance metric and the second importance metric, the difference denoting that viewing of the first portion is more likely and/or preferential to viewing of the second portion; and wherein the data store and/or the processor are further configured to perform one step selected from the group consisting of storing the video data, retrieving the subset, and using the subset to generate the viewpoint video by, based on the difference, expediting and/or enhancing performance of the step for the first portion, relative to the second portion. - View Dependent Claims (27, 28, 29, 30, 31, 32, 33, 34, 35, 36)
-
Specification