Systems and methods for mass distribution of 3-dimensional reconstruction over network

• US 9,672,066 B2
• Filed: 02/10/2015
• Issued: 06/06/2017
• Est. Priority Date: 03/12/2014
• Status: Active Grant

• Current Assignee: Live Planet LLC
• Original Assignee: Live Planet LLC
• Inventors: Arun, Rohan Maroly kovumal
• Primary Examiner(s): ZALALEE, SULTANA MARCIA
• Application Number:
  US14/618,731
• Publication Number:
  US 20150262410A1
• Time in Patent Office: 847 Days
• CPC Class Codes: G06F 3/1438 using more than one graphics controller
• CPC Class Codes: G06F 3/1446 display composed of modules, e.g. video walls
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 9/445 Program loading or initiating bootstrapping G06F9/4401; security arrangements for program loading or initiating G06F21/57
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
• CPC Class Codes: G06F 9/5066 Algorithms for mapping a plurality of inter-dependent sub-tasks onto a plurality of physical CPUs mappping at compile time, see G06F8/451
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 17/10 Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
• CPC Class Codes: G06T 2200/16 involving adaptation to the client's capabilities
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2210/52 Parallel processing
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers

Abstract

Systems and methods are described for distributing a 3-dimensional model of a target space, including, but not limited to: determining a position of an object within a target space; encoding the position of the object as RGB values associated with at least one pixel of a base frame; and transmitting the base frame to a user device for decoding the position of the object.

Claims

1. A method comprising:

determining a position of an object within a target space;

encoding the position of the object as RGB values;

generating a base frame formed of pixels, wherein each pixel is either encoded with the RGB values corresponding to the position of the object or encoded with constant filler RGB values, and

wherein a portion of the pixels of the base frame are encoded with the RGB values corresponding to the position of the object, and the rest of the pixels are encoded with the constant filler RGB values;

and transmitting the base frame to a user device for decoding the position of the object.

2. The method of claim 1, wherein:

the target space is a 3-dimensional volume; and

the target space is defined by a plurality of vertices.

3. The method of claim 1, wherein the position of the object is defined by a vertex associated with coordinates on a 3-dimensional coordinate system.

4. The method of claim 3, wherein the encoding the position of the object as RGB values comprises:

setting a first coordinate value of the vertex to a corresponding R value;

setting a second coordinate value of the vertex to a corresponding G value; and

setting a third coordinate value of the vertex to a corresponding B value.

5. The method of claim 1, further comprising receiving a source frame from a data source, wherein the source frame is a 2-dimensional frame of a source video stream.

6. The method of claim 5, wherein the determining the position of the object within the target space comprises identifying the object on the source frame.

7. The method of claim 6, wherein the determining the position of the object within the target space further comprises identifying a reference vertex associated with the position of the object.

8. The method of claim 5, wherein the base frame is encoded from the source frame.

9. The method of claim 1, further comprising transmitting preliminary information to the user device, wherein the preliminary information comprising one or more of:

3-dimensional object textual data, and object position decoding scheme, wherein;

the 3-dimensional object textual data comprises data associated with texture of the object, and

the object position decoding scheme comprises metadata corresponding to the manner in which the position of the object is encoded into RGB values.

10. The method of claim 1, wherein all pixels of the base frame are encoded with the RGB values corresponding to the position of the object.

11. The method of claim 1, wherein at least two pixels of the base frame are encoded with the RGB values corresponding to the position of the object.

12. The method of claim 1, wherein the constant filler values are zero (0) for each of R value, G value, and B value.

13. An apparatus, comprising:

a model builder configured to;

determine a position of an object within a target space; and

encode the position of the object as RGB values;

generate a base frame formed of pixels, wherein each pixel is either encoded with the RGB values corresponding to the position of the object or encoded with constant filler RGB values, and

wherein a portion of the pixels of the base frame are encoded with the RGB values corresponding to the position of the object, and the rest of the pixels are encoded with the constant filler RGB values; and

a distribution server configured to transmit the base frame to a user device for decoding the position of the object.

14. The apparatus of claim 13, wherein:

the target space is a 3-dimensional volume; and

the target space is defined by a plurality of vertices.

15. The apparatus of claim 13, wherein the position of the object is defined by a vertex associated with coordinates on a 3-dimensional coordinate system.

16. The apparatus of claim 15, wherein the model builder encodes the position of the object as RGB values by:

setting a first coordinate value of the vertex to a corresponding R value;

setting a second coordinate value of the vertex to a corresponding G value; and

setting a third coordinate value of the vertex to a corresponding B value.

17. The apparatus of claim 13, the model builder is further configured to receive a source frame from a data source, wherein the source frame is a 2-dimensional frame of a source video stream.

18. The apparatus of claim 17, wherein the model builder determines the position of the object within the target space by identifying the object on the source frame.

19. The apparatus of claim 18, wherein the model builder determines the position of the object within the target space by further identifying a reference vertex associated with the position of the object.

20. The apparatus of claim 19, wherein the base frame is encoded from the source frame.

21. The apparatus of claim 13, the distribution server is further configured to transmit preliminary information to the user device, wherein the preliminary information comprising one or more of:

3-dimensional object textual data, and object position decoding scheme, wherein;

the 3-dimensional object textual data comprises data associated with texture of the object, and

the object position decoding scheme comprises metadata corresponding to the manner in which the position of the object is encoded into RGB values.

22. A non-transitory computer-readable storage medium storing program instructions that, when executed, causes a processor to:

determine a position of an object within a target space;

encode the position of the object as RGB values;

generate a base frame formed of pixels, wherein each pixel is either encoded with the RGB values corresponding to the position of the object or encoded with constant filler RGB values, and

wherein a portion of the pixels of the base frame are encoded with the RGB values corresponding to the position of the object, and the rest of the pixels are encoded with the constant filler RGB values; and

transmit the base frame to a user device for decoding the position of the object.

23. The non-transitory computer-readable storage medium of claim 22, wherein:

the position of the object is defined by a vertex associated with coordinates on a 3-dimensional coordinate system; and

to encode the position of the object as RGB values comprises;

to set a first coordinate value of the vertex to a corresponding R value;

to set a second coordinate value of the vertex to a corresponding G value; and

to set a third coordinate value of the vertex to a corresponding B value.