Producing and consuming metadata within multi-dimensional data
First Claim
1. A computing system for producing and consuming metadata within multi-dimensional data, comprising:
- a see-through display;
a sensor system; and
a processor configured to;
in a recording phase;
receive, from a first user, a user command to generate an annotation at a location in a three dimensional environment;
receive, via the sensor system, a stream of telemetry data recording movement of the first user in the three dimensional environment;
receive a message to be recorded from the first user;
receive, from the first user, a second user command to add a stock animation at a designated point in time during the message, wherein the stock animation includes at least a direct communication animation; and
store, in memory as annotation data for the annotation, the stream of telemetry data and the message;
in a playback phase;
display, to a second user via the see-through display, a visual indicator of the annotation at the location;
receive a selection of the visual indicator by the second user;
display, to the second user via the see-through display, a simulacrum of the first user superimposed onto the three dimensional environment and animated according to the telemetry data and animated to include the stock animation at the designated point in time during the message, wherein to animate the simulacrum with the direct communication animation the simulacrum is animated to adopt a posture of directly communicating to the second user based on a position and orientation of the simulacrum relative to a position and orientation of the second user in the three dimensional environment; and
present, to the second user, the message via the animated simulacrum.
1 Assignment
0 Petitions
Accused Products
Abstract
A computing system and method for producing and consuming metadata within multi-dimensional data is provided. The computing system comprising a see-through display, a sensor system, and a processor configured to: in a recording phase, generate an annotation at a location in a three dimensional environment, receive, via the sensor system, a stream of telemetry data recording movement of a first user in the three dimensional environment, receive a message to be recorded from the first user, and store, in memory as annotation data for the annotation, the stream of telemetry data and the message, and in a playback phase, display a visual indicator of the annotation at the location, receive a selection of the visual indicator by a second user, display a simulacrum superimposed onto the three dimensional environment and animated according to the telemetry data, and present the message via the animated simulacrum.
-
Citations
18 Claims
-
1. A computing system for producing and consuming metadata within multi-dimensional data, comprising:
-
a see-through display; a sensor system; and a processor configured to; in a recording phase; receive, from a first user, a user command to generate an annotation at a location in a three dimensional environment; receive, via the sensor system, a stream of telemetry data recording movement of the first user in the three dimensional environment; receive a message to be recorded from the first user; receive, from the first user, a second user command to add a stock animation at a designated point in time during the message, wherein the stock animation includes at least a direct communication animation; and store, in memory as annotation data for the annotation, the stream of telemetry data and the message; in a playback phase; display, to a second user via the see-through display, a visual indicator of the annotation at the location; receive a selection of the visual indicator by the second user; display, to the second user via the see-through display, a simulacrum of the first user superimposed onto the three dimensional environment and animated according to the telemetry data and animated to include the stock animation at the designated point in time during the message, wherein to animate the simulacrum with the direct communication animation the simulacrum is animated to adopt a posture of directly communicating to the second user based on a position and orientation of the simulacrum relative to a position and orientation of the second user in the three dimensional environment; and present, to the second user, the message via the animated simulacrum. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method for producing and consuming metadata within multi-dimensional data, comprising:
-
in a recording phase; receiving, from a first user, a user command to generate an annotation at a location in a three dimensional environment; receiving a stream of telemetry data recording movement of the first user in the three dimensional environment; receiving a message to be recorded from the first user; receiving, from the first user, a second user command to add a stock animation at a designated point in time during the message, wherein the stock animation includes at least a direct communication animation; and storing, in memory as annotation data for the annotation, the stream of telemetry data and the message; in a playback phase; displaying, via a see-through display of a head mounted display device of a second user, a visual indicator of the annotation at the location; receiving a selection of the visual indicator by the second user via the head mounted display device; displaying, via the see-through display of the head mounted display device, a simulacrum of the first user superimposed onto the three dimensional environment and animated according to the telemetry data and animated to include the stock animation at the designated point in time during the message, wherein to animate the simulacrum with the direct communication animation the simulacrum is animated to adopt a posture of directly communicating to the second user based on a position and orientation of the simulacrum relative to a position and orientation of the second user in the three dimensional environment; and presenting the message via the animated simulacrum, via the head mounted display device. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17)
-
-
18. A computing system for producing and consuming metadata within multi-dimensional data, comprising:
-
a see-through display; a sensor system; and a processor configured to; in a recording phase; receive, from a first user, a user command to generate an annotation at a location and a point in time in a virtual scene superimposed on a three dimensional environment, the virtual scene changing over a period of time and including a visualization hologram of a multi-dimensional data set; receive, via the sensor system, a stream of telemetry data recording movement of the first user in the three dimensional environment; receive a message to be recorded from the first user; receive, from the first user, a second user command to add a stock animation at a designated point in time during the message, wherein the stock animation includes at least a direct communication animation; receive a user modification input to modify the visualization hologram or the multi-dimensional data set; and store, in memory as annotation data for the annotation, the stream of telemetry data, the message, and the user modification input; in a playback phase; display, to a second user via the see-through display, a visual indicator of the annotation at the location and the point in time in the virtual scene; receive a selection of the visual indicator by the second user; display, to the second user via the see-through display, a simulacrum of the first user superimposed onto the three dimensional environment and animated according to the telemetry data and animated to include the stock animation at the designated point in time during the message, wherein to animate the simulacrum with the direct communication animation the simulacrum is animated to adopt a posture of directly communicating to the second user based on a position and orientation of the simulacrum relative to a position and orientation of the second user in the three dimensional environment; and present, to the second user, the message and a rendering of the modification to the visualization hologram or the multi-dimensional data set in synchronization with the animated simulacrum.
-
Specification