DELIVERING AND CONTROLLING STREAMING INTERACTIVE MEDIA COMPRISING RENDERED GEOMETRIC, TEXTURE AND LIGHTING DATA

• US 20130215115A1
• Filed: 09/13/2011
• Published: 08/22/2013
• Est. Priority Date: 06/30/2010
• Status: Active Grant

• Current Assignee: Primal Space Systems Inc.
• Original Assignee: Primal Space Systems Inc.
• Inventors: Jenkins, Barry Lynn
• Granted Patent: US 9,489,762 B2
• Time in Patent Office: Days
• US Class Current: 345/420
• CPC Class Codes: G06F 16/56 having vectorial format
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 2200/16 involving adaptation to the client's capabilities
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics

Abstract

In an exemplary embodiment, a method, conducted on a server, sends renderable graphics information to a client device, said graphics information including at least one set of graphics information visible from a second view region and not visible from a first view region. The method includes determining a likelihood that a viewpoint undergoes movement from said first view region to said second view region. The method further includes sending said at least one set of graphics information upon determination that the likelihood that the viewpoint undergoes movement from said first view region to said second view region is greater than a predetermined threshold, said movement determined according to a predetermined motion path.

Claims

1. :

A method, conducted on a server, of sending renderable graphics information to a client device, said graphics information including at least one set of graphics information visible from a second view region and not visible from a first view region, the method comprising;

determining a likelihood that a viewpoint undergoes movement from said first view region to said second view region; and

sending said at least one set of graphics information upon determination that the likelihood that the viewpoint undergoes movement from said first view region to said second view region is greater than a predetermined threshold, said movement determined according to a predetermined motion path.

2. :

The method according to claim 1, wherein sending said at least one set of graphics information comprises broadcasting said at least one set of graphics information to a plurality of client devices.

3. :

The method according to claim 1, wherein said at least one set of graphics information includes a set of mesh polygons or fragments of said mesh polygons visible from said second view region and not visible from said first view region, said first and second view regions having a plurality of view region vertices, said mesh polygons forming polygon meshes, said at least one set of graphics information determined from said mesh polygons or fragments of said mesh polygons visible from said second view region, and said mesh polygons or fragments of said mesh polygons visible from said second view region determined by steps of;

c1) determining at least one first-order silhouette edge of said polygon meshes, said at least one first-order silhouette edge being an edge of said polygon meshes having;

first and second polygons sharing said at least one first-order silhouette edge,

the first polygon backfacing to each view region vertex from the plurality of view region vertices of said second view region,

the second polygon front-facing to at least one view region vertex from the plurality of view region vertices of said second view region, and

the first and second polygons having a backfacing orientation with respect to each other,

c2) determining at least one supporting polygon between said second view region and said polygon meshes, said at least one supporting polygon being determined between said second view region and at least one vertex of said at least one first-order silhouette edge;

c3) constructing at least one wedge from said at least one supporting polygon, said at least one wedge extending away from said second view region beyond at least said polygon meshes;

c4) determining one or more intersections of said at least one wedge with said mesh polygons; and

c5) determining said set of said mesh polygons or fragments of said mesh polygons visible from said second view region using said determined one or more intersections of said at least one wedge with said polygon meshes.

4. The method of claim 3, wherein said renderable graphics information includes information representing procedural surfaces from which polygons can be generated.

5-43. -43. (canceled)

44. :

A method, conducted on a server, of sending renderable graphics information to a client device, said graphics information including at least one set of graphics information visible from a second view region and not visible from a first view region, said at least one set of graphics information including graphics information representing advertising, the method comprising

sending said at least one set of graphics information upon determination that the likelihood that the viewpoint moves from said first view region to said second view region is less than the predetermined threshold, said movement being determined according to the user input to said client device and upon determination that an available transmission bandwidth from said server to said client device exceeds a predetermined threshold.

45. :

The method of claim 44, wherein said targeting information includes information about age or gender of said user of said client device.

46. :

The method of claim 44, wherein said targeting information includes information indicating previous responses to advertising made by said user of said client device.

48. :

The method of claim 44, wherein said targeting information includes information about age or gender of said user of said client device.

50. :

The method according to claim 44, wherein said first set of graphics information includes a set of mesh polygons or fragments of said mesh polygons visible from said second view region and not visible from said first view region, said first and second view regions having a plurality of view region vertices, said mesh polygons forming polygon meshes, said first set of graphics information determined from said mesh polygons or fragments of said mesh polygons visible from said second view region, and said mesh polygons or fragments of said mesh polygons visible from said second view region determined by steps of;

c1) determining at least one first-order silhouette edge of said polygon meshes, said at least one first-order silhouette edge being an edge of said polygon meshes having;

first and second polygons sharing said at least one first-order silhouette edge,

the first polygon backfacing to each view region vertex from the plurality of view region vertices of said second view region,

the second polygon front-facing to at least one view region vertex from the plurality of view region vertices of said second view region, and

the first and second polygons having a backfacing orientation with respect to each other,

c2) determining at least one supporting polygon between said second view region and said polygon meshes, said at least one supporting polygon being determined between said second view region and at least one vertex of said at least one first-order silhouette edge;

c3) constructing at least one wedge from said at least one supporting polygon, said at least one wedge extending away from said second view region beyond at least said polygon meshes;

c4) determining one or more intersections of said at least one wedge with said mesh polygons; and

c5) determining said set of said mesh polygons or fragments of said mesh polygons visible from said second view region using said determined one or more intersections of said at least one wedge with said polygon meshes.

54. :

The method of claim 44, wherein said second set of graphics information representing advertising includes instructions for generating said polygon meshes.

55. :

The method of claim 44, wherein said second set of graphics information representing advertising includes parameters for constructing a parametric geometric model.

56. :

The method of claim 44, wherein said second set of graphics information representing advertising includes glyph information and parameters for constructing three dimensional symbols from said glyph information.

78. :

The method of claim 44, wherein said graphics information comprises graphics information selectable by a viewer, and further comprising the steps of;

c) receiving information from said client device, indicating a selection of said second set of graphics information representing said advertising;

d) sending, upon receiving information from said client device indicating a selection of said second set of graphics information representing said advertising, a third set of graphics information, said second and third sets of graphics information representing related products or services associated with said advertising.

81. :

The method of claim 44, wherein said graphics information comprises graphics information selectable by a viewer, and further comprising the steps of;

d) receiving information from said client device, indicating a selection of said second set of graphics information representing said advertising;

e) sending, upon receiving information from said client device indicating a selection of said second set graphics information representing said advertising, a third set of graphics information, said third set of graphics information representing an object that can be used by a client user in a modeled environment.

82. The method of claim 44, further comprising the step of:

e) charging the client user in accordance with said selection.

47. (canceled)

49. (canceled)

51-53. -53. (canceled)

57-77. -77. (canceled)

79-80. -80. (canceled)

83-87. -87. (canceled)

88. :

A method, conducted on a client device, of receiving renderable graphics information from a server, said graphics information including a first set of graphics information visible from a second view region and not visible from a first view region, the method comprising steps of;

a) determining a likelihood that a user viewpoint moves from said first view region to said second view region, said user viewpoint movement controlled by user input;

b) sending data to the server, said data representing a request for said first set of graphics information, upon determination that said likelihood is greater than a predetermined movement threshold; and

c) receiving said first set of graphics information from the server.

89. :

The method according to claim 88, wherein said first set of graphics information includes a set of mesh polygons or fragments of said mesh polygons visible from said second view region and not visible from said first view region, said first and second view regions having a plurality of view region vertices, said mesh polygons forming polygon meshes, said first set of graphics information determined from said mesh polygons or fragments of said mesh polygons visible from said second view region, and said mesh polygons or fragments of said mesh polygons visible from said second view region determined by steps of;

c1) determining at least one first-order silhouette edge of said polygon meshes, said at least one first-order silhouette edge being an edge of said polygon meshes having;

first and second polygons sharing said at least one first-order silhouette edge,

the first polygon backfacing to each view region vertex from the plurality of view region vertices of said second view region,

the second polygon front-facing to at least one view region vertex from the plurality of view region vertices of said second view region, and

the first and second polygons having a backfacing orientation with respect to each other,

c2) determining at least one supporting polygon between said second view region and said polygon meshes, said at least one supporting polygon being determined between said second view region and at least one vertex of said at least one first-order silhouette edge;

c3) constructing at least one wedge from said at least one supporting polygon, said at least one wedge extending away from said second view region beyond at least said polygon meshes;

c4) determining one or more intersections of said at least one wedge with said mesh polygons; and

c5) determining said set of said mesh polygons or fragments of said mesh polygons visible from said second view region using said determined one or more intersections of said at least one wedge with said polygon meshes.

90. :

The method of claim 89, wherein said renderable graphics information includes information representing procedural surfaces from which polygons can be generated.

93. :

The method according to claim 88, wherein step c) of receiving said at least one second set of graphics information from the server is performed upon determination that said user input to client device is detected.

94. :

The method according to claim 88, wherein step b of receiving said at least one first set of graphics information from the server is performed upon determination that said user input to client device is not detected for a predetermined period of time.

91-92. -92. (canceled)

95-334. -334. (canceled)