Dynamic modification of video content at a set-top box device

• US 9,172,943 B2
• Filed: 12/07/2010
• Issued: 10/27/2015
• Est. Priority Date: 12/07/2010
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Friedman, Lee
• Primary Examiner(s): Kelley, Christopher S
• Assistant Examiner(s): Tarko, Asmamaw G
• Application Number:
  US12/962,009
• Publication Number:
  US 20120140025A1
• Time in Patent Office: 1,785 Days
• Field of Search: 348/42
• US Class Current: 1/1
• CPC Class Codes: H04N 13/156 Mixing image signals
• CPC Class Codes: H04N 13/178 Metadata, e.g. disparity information
• CPC Class Codes: H04N 13/183 On-screen display [OSD] information, e.g. subtitles or menus
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44012 involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

A particular method includes receiving video content at a set-top box device. Scene data defining a three-dimensional scene is accessed, where the scene data includes object data defining at least one three-dimensional graphical object, and where the scene data is accessed based at least in part on information associated with the video content. The method further includes processing the object data to render the at least one three-dimensional graphical object. The rendered at least one three-dimensional graphical object is overlaid on a portion of the video content, thereby generating dynamically modified video content. The method includes sending the dynamically modified video content to a display device.

Claims

1. A method, comprising:

receiving video content at a set-top box device;

receiving scene data defining a three-dimensional scene that is distinct from the video content and that corresponds to a scene of the video content;

receiving object data defining a three-dimensional graphical object, wherein the scene data specifies physical properties to enable rendering of the three-dimensional graphical object, the physical properties indicating an effect of gravity on the three-dimensional graphical object and indicating whether the effect of gravity is to be simulated on the three-dimensional graphical object;

processing the scene data and the object data to render the three-dimensional graphical object and to overlay the rendered three-dimensional graphical object over a portion of the video content to generate dynamically modified video content;

sending the dynamically modified video content to a display device;

after sending the dynamically modified video content to the display device, receiving a user request, at the set-top box device, to animate the three-dimensional graphical object; and

in response to the user request, dynamically modifying a display characteristic of the three-dimensional graphical object.

2. The method of claim 1, wherein modifying the display characteristic of the three-dimensional graphical object includes rotating the three-dimensional graphical object.

3. The method of claim 1, wherein modifying the display characteristic of the three-dimensional graphical object includes modifying shading of the three-dimensional graphical object based partially on the scene data.

4. The method of claim 1, wherein modifying the display characteristic of the three-dimensional graphical object includes modifying a surface texture appearance of the three-dimensional graphical object based partially on the scene data.

5. The method of claim 1, wherein modifying the display characteristic of the three-dimensional graphical object includes modifying a geometry of the three-dimensional graphical object based partially on the scene data.

6. The method of claim 1, wherein modifying the display characteristic of the three-dimensional graphical object includes modifying scaling of the three-dimensional graphical object based partially on the scene data.

7. The method of claim 1, wherein modifying the display characteristic of the three-dimensional graphical object includes modifying motion characteristics of the three-dimensional graphical object based partially on the scene data.

8. The method of claim 1, wherein modifying the display characteristic of the three-dimensional graphical object includes moving the three-dimensional graphical object within a scene of the dynamically modified video content.

9. The method of claim 1, further comprising:

receiving the scene data from a remote computing device via a network before receiving the video content; and

storing the scene data at a memory of the set-top box device, wherein the scene data is accessed from the memory of the set-top box device after the portion of the video content is received.

10. The method of claim 1, further comprising receiving timing data that associates the scene data with the portion of the video content, wherein the object data is processed based on the timing data.

11. The method of claim 10, wherein the timing data is received via a first data stream and the video content is received via a second data stream that is distinct from the first data stream.

12. The method of claim 10, wherein the three-dimensional graphical object includes a user-defined object.

13. The method of claim 1, wherein the scene data is accessed by receiving a first data stream from a content provider of the video content, wherein the first data stream is distinct from a second data stream that includes the video content.

14. The method of claim 1, wherein the scene data is received from a first content provider and the video content is received from a second content provider that is distinct from the first content provider.

19. The method of claim 1, wherein the object data includes geometric information defining the three-dimensional graphical object.

15. A set-top box device, comprising:

a processor; and

a memory accessible to the processor, the memory comprising instructions that are executable by the processor to perform operations comprising;

receiving video content;

receiving scene data defining a three-dimensional scene that is distinct from the video content and that corresponds to a scene of the video content;

receiving object data defining a three-dimensional graphical object, wherein the scene data specifies physical properties to enable rendering of the three-dimensional graphical object, the physical properties indicating an effect of gravity on the three-dimensional graphical object and indicating whether the effect of gravity is to be simulated on the three-dimensional graphical object;

processing the scene data and the object data to render the three-dimensional graphical object and to overlay the rendered three-dimensional graphical object over a portion of the video content to generate dynamically modified video content;

sending the dynamically modified video content to a display device;

after sending the dynamically modified video content to the display device, receiving a user request to animate the three-dimensional graphical object; and

in response to receiving the user request, simulating motion of the three-dimensional graphical object based on the physical properties of the three-dimensional graphical object.

16. The set-top box device of claim 15, wherein the scene data further includes scaling and lighting information, wherein the scaling and lighting information is used to render the three-dimensional graphical object.

17. The set-top box device of claim 15, wherein the physical properties of the three-dimensional graphical object indicate an effect of a collision between the three-dimensional graphical object and another object.

18. A computer-readable storage device comprising instructions that, when executed by a processor, cause the processor to perform operations comprising:

receiving video content;

receiving scene data defining a three-dimensional scene that is distinct from the video content and that corresponds to a scene of the video content

receiving object data defining a three-dimensional graphical object, wherein the scene data specifies physical properties to enable rendering of the three-dimensional graphical object, the physical properties indicating an effect of gravity on the three-dimensional graphical object and indicating whether the effect of gravity is to be simulated on the three-dimensional graphical object;

processing the scene data and the object data to render the three-dimensional graphical object and to overlay the rendered three-dimensional graphical object over a portion of the video content to generate modified video content;

sending the modified video content to a display device;

after sending the modified video content to the display device, receiving a user request to animate the three-dimensional graphical object; and

in response to receiving the user request, dynamically modifying a display characteristic of the three-dimensional graphical object.