MIXED REALITY EXPERIENCE SHARING
First Claim
1. A mixed reality experience sharing system for presenting a textured shared world model of a physical environment, the textured shared world model including a plurality of crowd-sourced structural data items that are geo-located at the physical environment, and a plurality of crowd-sourced texture data items that are geo-located at the physical environment, the mixed reality experience sharing system comprising:
- a mixed reality experience sharing program executed by a processor of a computing device, the mixed reality experience sharing program configured to;
receive the plurality of crowd-sourced structural data items including depth information;
stitch together the plurality of crowd-sourced structural data items to generate a 3D spatial shared world model of the physical environment;
receive the plurality of crowd-sourced texture data items from a plurality of sources, each of the texture data items comprising a time-stamped image or video;
receive user input of a temporal filter parameter;
filter the plurality of crowd-sourced texture data items by the temporal filter parameter to generate a temporally-filtered subgroup of the crowd-sourced texture data items;
apply to surfaces of the 3D spatial shared world model of the physical environment the temporally-filtered subgroup of the crowd-sourced texture data items to generate the textured shared world model of the physical environment; and
provide the textured shared world model of the physical environment to a display program for display by a display device.
3 Assignments
0 Petitions
Accused Products
Abstract
Embodiments that relate to presenting a textured shared world model of a physical environment are disclosed. One embodiment includes receiving geo-located crowd-sourced structural data items of the physical environment. The structural data items are stitched together to generate a 3D spatial shared world model. Geo-located crowd-sourced texture data items are also received and include time-stamped images or video. User input of a temporal filter parameter is used to temporally filter the texture data items. The temporally-filtered texture data items are applied to surfaces of the 3D spatial shared world model to generate a textured shared world model of the physical environment. The textured shared world model is then provided for display by a display device.
64 Citations
20 Claims
-
1. A mixed reality experience sharing system for presenting a textured shared world model of a physical environment, the textured shared world model including a plurality of crowd-sourced structural data items that are geo-located at the physical environment, and a plurality of crowd-sourced texture data items that are geo-located at the physical environment, the mixed reality experience sharing system comprising:
-
a mixed reality experience sharing program executed by a processor of a computing device, the mixed reality experience sharing program configured to; receive the plurality of crowd-sourced structural data items including depth information; stitch together the plurality of crowd-sourced structural data items to generate a 3D spatial shared world model of the physical environment; receive the plurality of crowd-sourced texture data items from a plurality of sources, each of the texture data items comprising a time-stamped image or video; receive user input of a temporal filter parameter; filter the plurality of crowd-sourced texture data items by the temporal filter parameter to generate a temporally-filtered subgroup of the crowd-sourced texture data items; apply to surfaces of the 3D spatial shared world model of the physical environment the temporally-filtered subgroup of the crowd-sourced texture data items to generate the textured shared world model of the physical environment; and provide the textured shared world model of the physical environment to a display program for display by a display device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method for presenting a textured shared world model of a physical environment via a display device, the method comprising:
-
receiving a plurality of crowd-sourced structural data items that are geo-located at the physical environment and include depth information; stitching together the plurality of crowd-sourced structural data items to generate a 3D spatial shared world model of the physical environment; receiving from a plurality of sources a plurality of crowd-sourced texture data items that are geo-located at the physical environment, each of the texture data items comprising a time-stamped image or video; receiving user input of a temporal filter parameter; filtering the plurality of crowd-sourced texture data items by the temporal filter parameter to generate a temporally-filtered subgroup of the crowd-sourced texture data items; applying to surfaces of the 3D spatial shared world model of the physical environment the temporally-filtered subgroup of the crowd-sourced texture data items to generate the textured shared world model of the physical environment; and providing the textured shared world model of the physical environment to a display program for display by the display device. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A mixed reality experience sharing system for presenting a textured shared world model of a physical environment, the textured shared world model including a plurality of crowd-sourced structural data items that are geo-located at the physical environment, and a plurality of crowd-sourced texture data items that are geo-located at the physical environment, the mixed reality experience sharing system comprising:
-
a mixed reality experience sharing program executed by a processor of a computing device, the mixed reality experience sharing program configured to; receive the plurality of crowd-sourced structural data items including depth information; stitch together the plurality of crowd-sourced structural data items to generate a 3D spatial shared world model of the physical environment; receive the plurality of crowd-sourced texture data items from a plurality of sources, each of the texture data items comprising a time-stamped image or video; prioritize the plurality of crowd-sourced texture data items according to one or more priority factors; receive user input of a temporal filter parameter corresponding to a predated time that is earlier than a current time; filter the plurality of crowd-sourced texture data items by the temporal filter parameter to generate a temporally-filtered subgroup of the crowd-sourced texture data items; apply to surfaces of the 3D spatial shared world model of the physical environment the temporally-filtered subgroup of the crowd-sourced texture data items to generate the textured shared world model of the physical environment; and provide the textured shared world model of the physical environment to a display program for display by a display device.
-
Specification