Shared scene mesh data synchronisation
First Claim
Patent Images
1. A user device within a communication architecture, the user device comprising:
- an image capture device configured to capture image data for use in creation of a video channel defining a shared scene that includes at least one interactive object associated with a media type, the shared scene configured for viewing by and interaction with users of different user devices;
an intrinsic/extrinsic data determiner configured to determine intrinsic capture device data associated with the image capture device and extrinsic capture device data associated with the captured image data, the intrinsic capture device data and the extrinsic capture device data being separate from the image data;
a video encoder configured to encode the image data intrinsic capture device data, and the extrinsic capture device data within the shared scene for transmission to the different user devices, wherein the intrinsic capture device data and the extrinsic capture device data are encoded as one of a supplemental enhancement information (SEI) message or custom attribute values appended to image frames of the image data;
a display device configured to display a user interface that enables a user to apply at least one annotation to the shared scene by manipulating the at least one interactive object or adding an additional interactive object to the shared scene; and
a session management entity configured to generate data objects describing the at least one annotation to the shared scene and communicate the generated data objects to the different user devices to synchronize a view of the shared scene for the users of the different devices.
1 Assignment
0 Petitions
Accused Products
Abstract
A user device within a communication architecture, the user device comprising: an image capture device configured to determine image data for the creation of a video channel defining the shared scene; an intrinsic/extrinsic data determiner configured to determine intrinsic/extrinsic capture device data associated with the image capture device; and a video encoder configured to encode the image data and intrinsic/extrinsic capture device data within the video channel.
16 Citations
19 Claims
-
1. A user device within a communication architecture, the user device comprising:
-
an image capture device configured to capture image data for use in creation of a video channel defining a shared scene that includes at least one interactive object associated with a media type, the shared scene configured for viewing by and interaction with users of different user devices; an intrinsic/extrinsic data determiner configured to determine intrinsic capture device data associated with the image capture device and extrinsic capture device data associated with the captured image data, the intrinsic capture device data and the extrinsic capture device data being separate from the image data; a video encoder configured to encode the image data intrinsic capture device data, and the extrinsic capture device data within the shared scene for transmission to the different user devices, wherein the intrinsic capture device data and the extrinsic capture device data are encoded as one of a supplemental enhancement information (SEI) message or custom attribute values appended to image frames of the image data; a display device configured to display a user interface that enables a user to apply at least one annotation to the shared scene by manipulating the at least one interactive object or adding an additional interactive object to the shared scene; and a session management entity configured to generate data objects describing the at least one annotation to the shared scene and communicate the generated data objects to the different user devices to synchronize a view of the shared scene for the users of the different devices. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A user device within a communication architecture, the user device comprising:
-
a receiver configured to receive a video channel comprising image data for a shared scene determined from an image capture device, the shared scene configured for viewing by and interaction with users of different user devices and the image data comprising intrinsic capture device data associated with the image capture device and extrinsic capture device data associated with the captured image data, the intrinsic capture device data and the extrinsic capture device data being separate from the image data; a video decoder configured to extract and decode the image data, the intrinsic capture device data, and the extrinsic capture device data from the video channel, wherein the intrinsic capture device data and the extrinsic capture device data are extracted and decoded as one of a supplemental enhancement information (SEI) message appended to image frames of the image data or custom attribute values appended to image frames of the image data; a display device configured to display a user interface that enables a user to apply at least one annotation to the shared scene by manipulating the at least one interactive object or adding an additional interactive object to the shared scene; and a session management entity configured to generate data objects describing the at least one annotation to the shared scene and communicate the generated data objects to the different user devices to synchronize a view of the shared scene for the users of the different devices. - View Dependent Claims (8, 9)
-
-
10. A method implemented at a user device within a communication architecture, the method comprising:
-
determining image data from an image capture device for creation of a video channel defining a shared scene that includes at least one interactive object associated with a media type, the shared scene configured for viewing by and interaction with users of different user devices; determining intrinsic capture device data associated with the image capture device and extrinsic capture device data associated with the image data, the intrinsic capture device data and the extrinsic capture device data being separate from the image data; encoding the image data, the intrinsic capture device data, and the extrinsic capture device data within the shared scene for transmission to the different user devices, wherein the intrinsic capture device data and the extrinsic capture device data are encoded as one of a supplemental enhancement information (SEI) message appended to image frames of the image data or custom attribute values appended to image frames of the image data; displaying a user interface that enables a user to apply at least one annotation to the shared scene by manipulating the at least one interactive object or adding an additional interactive object to the shared scene; and generating data objects describing the at least one annotation to the shared scene and communicating the generated data objects to the different user devices to synchronize a view of the shared scene for the users of the different devices. - View Dependent Claims (11, 12, 13, 14, 15)
-
-
16. A method implemented at a user device within a communication architecture, the method comprising:
-
displaying a user interface that enables a user to apply at least one annotation to a shared scene by manipulating at least one interactive object or adding an additional interactive object to the shared scene; and generating data objects describing the at least one annotation to the shared scene received via a video channel and communicating the generated data objects to different user devices to synchronize a view of the shared scene for the user device and the different user devices, wherein; the video channel comprises a frame encoded video data stream, intrinsic capture device data and extrinsic capture device data are encoded as supplemental enhancement information messages in an encoded video data stream representing the shared scene received via a video channel, and extracting and decoding the image data from the video channel comprises frame decoding the encoded video data stream, and extracting the intrinsic capture device data, and the extrinsic capture device data comprises extracting and decoding the supplemental enhancement information messages from within the encoded video data stream. - View Dependent Claims (17)
-
-
18. A computer program product, the computer program product being embodied on a computer-readable storage medium and configured so as, when executed on a processor of a user device within a communication architecture, to:
-
determine image data from an image capture device for creation of a video channel defining a shared scene, the shared scene configured for viewing by and interaction with users of different user devices; determine intrinsic capture device data and extrinsic capture device data associated with the image capture device, the intrinsic capture device data and the extrinsic capture device data being separate from the image data; encode the image data, the intrinsic capture device data, and the extrinsic capture device data within the video channel for transmission to the different user devices, wherein the intrinsic capture device data and the extrinsic capture device data are encoded as one of a supplemental enhancement information (SEI) message appended to image frames of the image data or custom attribute values appended to image frames of the image data; display a user interface that enables a user to apply at least one annotation to the shared scene by manipulating the at least one interactive object or adding an additional interactive object to the shared scene; and generate data objects describing the at least one annotation to the shared scene and communicate the generated data objects to the different user devices to synchronize a view of the shared scene for the users of the different devices.
-
-
19. A computer program product, the computer program product being embodied on a computer-readable storage medium and configured so as when executed on a processor of a user device within a communication architecture, to:
-
receive a video channel comprising Image data for a shared scene that includes at least one interactive object associated with a media type, the shared scene configured for viewing by and interaction with users of different user devices, the image data captured by an image capture device, the image data captured by the image capture device being associated with intrinsic capture device data and with extrinsic capture device data, the intrinsic capture device data and the extrinsic capture device data being separate from the image data; extract and decode the image data from the video channel; extract intrinsic capture device data associated with the image capture device and extrinsic capture device data associated with the image capture device, wherein the intrinsic capture device data and the extrinsic capture device data are extracted and decoded as one of a supplemental enhancement information (SEI) message appended to image frames of the image data or custom attribute values appended to image frames of the image data; display a user interface that enables a user to apply at least one annotation to the shared scene by manipulating the at least one interactive object or adding an additional interactive object to the shared scene; and generate data objects describing the at least one annotation to the shared scene and communicate the generated data objects to the different user devices to synchronize a view of the shared scene for the users of the different devices.
-
Specification