Coordinated 2-dimensional and 3-dimensional graphics processing

• US 9,317,953 B2
• Filed: 10/03/2011
• Issued: 04/19/2016
• Est. Priority Date: 01/05/2011
• Status: Active Grant

• Current Assignee: Synamedia Limited
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Gaude, Nicolas, Ruelle, Alex, Yahyaoui, Mohamed, Andrieux, Fabien, Marichez, Julien, Lengronne, Fabien
• Primary Examiner(s): Merouan, Abderrahim
• Application Number:
  US13/978,332
• Publication Number:
  US 20130293537A1
• Time in Patent Office: 1,660 Days
• US Class Current: 1/1
• CPC Class Codes: A63F 13/52 involving aspects of the displayed game scene
• CPC Class Codes: G06T 13/00 Animation
• CPC Class Codes: G06T 13/20 3D [Three Dimensional] animation
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 15/10 Geometric effects
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 17/20 Finite element generation, e.g. wire-frame surface description, tesselation
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics

Abstract

A data processing system (70) for graphics processing, including a scene manager (80). The scene manager (80) includes a scene loader (86) for receiving a description of 3 dimensional objects in a scene from a 3-dimensional modelling tool (46). The description includes first 2-dimensional frame data. The scene manager (80) has a texture image modification unit (84) for receiving second 2-dimensional frame data from a 2-dimensional rendering engine (40), and for replacing the first frame data by the second frame data. The scene manager (80) has an animation scheduler for scheduling and monitoring an animation of the scene. The system includes a display manager (96) operative to invoke the scene manager (80) to render output frames in a display buffer (100), and a scene Tenderer (88) configured for applying the 2-dimensional frame data to the 3-dimensional objects to produce textured 3-dimensional objects in the display buffer (100) and outputting the textured objects in the animation. Related apparatus and methods are also described.

Claims

1. A data processing system for graphics processing, comprising:

a scene manager implemented in a hardware processor, and comprising;

a scene loader operative to receive a scene description obtained after processing a design in a 3-dimensional authoring tool, the scene description comprising;

a description of 3 dimensional objects in the scene, first 2-dimensional frame data for the 3-dimensional objects; and

guidance information for replacing the first 2-dimensional frame data;

a texture image modification unit, operative to receive second 2-dimensional frame data rendered in a 2-dimensional frame buffer by a 2-dimensional rendering engine, the second 2-dimensional frame data being obtained after processing a design in a 2-dimensional authoring tool, and to replace the first 2-dimensional frame data by the second 2-dimensional frame data by associating coordinates of the second 2-dimensional frame data in the frame buffer to the 3-dimensional objects according to the guidance information; and

an animation scheduler operative to schedule and monitor an animation of the scene;

a display manager operative to invoke the scene manager to render output frames in a display buffer at a selected frequency of operation; and

a scene renderer configured for automatically applying the second 2-dimensional frame data to the 3-dimensional objects to produce textured 3-dimensional objects in the display buffer and outputting the textured 3-dimensional objects in the animation, wherein the scene manager is operative to define generic graphic areas in a rendering buffer and to iterate a 3-dimensional animation by storing new 2-dimensional frame data in the generic graphic areas, and accessing the new 2-dimensional frame data in respective iterations of the 3-dimensional animation.

2. The system according to claim 1, further comprising:

a video decoder; and

a video frame buffer, receiving output from the video decoder, wherein at least a portion of the second 2-dimensional frame data is provided to the texture image modification unit from the video frame buffer.

3. The system according to claim 1, further comprising a binding controller, receiving control signals from an executing computer application via an interface to the computer application, the binding controller recognizing events occurring during operation of the animation scheduler and operative to issue instructions to the scene loader and the animation scheduler responsively to the control signals and the events.

4. The system according to claim 3, wherein the control signals of the computer application comprise at least one of a first instruction to direct loading of the scene by the scene loader and a second instruction to initiate, discontinue or regulate operation of the animation.

5. The system according to claim 1, wherein the accessing of the new 2-dimensional frame data comprises the steps of:

while performing a new iteration of the 3-dimensional animation;

locking the scene renderer;

thereafter updating the rendering buffer;

after completing the step of updating the rendering buffer unlocking the scene renderer; and

rendering the 3-dimensional animation.

6. A device for graphics processing, comprising:

a receiver for first image data of a scene comprising a video stream;

a storage unit holding 2 dimensional frame data comprising the first image data and further comprising second image data output from a 2-dimensional rendering engine, the second image data being obtained after processing a design in a 2-dimensional authoring tool, the storage unit further operative to memorize a scene description being obtained after processing the design in a 3-dimensional authoring tool, the scene description comprising;

a description of 3 dimensional objects in the scene;

first 2-dimensional frame data for the 3-dimensional objects; and

guidance information for replacing the first 2-dimensional frame data;

a scene manager implemented in a hardware processor, and comprising;

a scene loader operative to access the scene description from the storage unit;

a texture image modification unit, operative to receive second 2-dimensional frame data from the storage unit, and to replace the first 2-dimensional frame data by the second 2-dimensional frame data by associating coordinates of the second 2-dimensional frame data in the storage unit to the 3-dimensional objects according to the guidance information;

an animation scheduler operative to schedule and monitor an animation of the scene;

a display manager operative to invoke the scene manager to render output frame in a display buffer at a selected frequency of operation; and

a scene renderer configured for automatically applying the second 2-dimensional frame data to the 3-dimensional objects to produce textured 3-dimensional objects and outputting the textured 3-dimensional objects in the animation, wherein the scene manager is operative to define generic graphic areas in a rendering buffer and to iterate a 3-dimensional animation by storing new 2-dimensional frame data in the generic graphic areas, and accessing the new 2-dimensional frame data in respective iterations of the 3-dimensional animation.

7. The device according to claim 6, wherein further comprising a display accepting output of the scene renderer, and wherein the receiver, the storage unit, the scene manager and the display manager are disposed in a common housing as a set-top box adapted to the display.

8. The device according to claim 6, further comprising:

a video decoder; and

a video frame buffer, receiving output from the video decoder, wherein at least a portion of the 2 dimensional frame data is provided to the texture image modification unit from the video frame buffer.

9. The device according to claim 6, further comprising a binding controller, receiving control signals from an executing computer application via an interface to the computer application, the binding controller recognizing events occurring during operation of the animation scheduler and operative to issue instructions to the scene loader and the animation scheduler responsively to the control signals and the events.

10. The device according to claim 9, wherein the control signals of the computer application comprise at least one of a first instruction to direct loading of the scene by the scene loader, and a second instruction to initiate, discontinue and regulate operation of the animation.

11. The device according to claim 6, wherein the accessing of the new 2-dimensional frame data comprises the steps of:

while performing a new iteration of the 3-dimensional animation;

locking the scene renderer;

thereafter updating the rendering buffer; and

after completing the step of updating the rendering buffer unlocking the scene renderer; and

rendering the 3-dimensional animation.

12. A method of graphics processing, comprising the steps of:

in a first process applying a 2-dimensional authoring tool to a design;

producing first data in a frame buffer from an output of the 2-dimensional authoring tool, the first data comprising 2-dimensional representations of the design;

in a second process applying a 3-dimensional authoring tool to the design to produce second data comprising a scene description of 3-dimensional objects in the design;

synchronizing the first process with the second process;

combining the first data with the second data by employing the first data to generate respective textures of the 3-dimensional objects of the scene description;

generating animations comprising the textures; and

outputting the animations for display thereof, wherein generating animations comprises;

defining generic graphic areas in a rendering buffer;

iterating a 3-dimensional animation by storing new 2-dimensional frame data in the generic graphic areas; and

accessing the new 2-dimensional frame data in respective iterations of the 3-dimensional animation.

13. The method according to claim 12, further comprising producing at least a portion of the first data by decoding a video stream.

14. The method according to claim 12, further comprising the step of executing a governing computer application to control the steps of synchronizing the first process with the second process and generating animations.

15. The method according to claim 12, wherein the accessing of the new 2-dimensional frame data is performed with a scene renderer and comprises the steps of:

while performing a new iteration of the 3-dimensional animation;

locking the scene renderer;

thereafter updating the rendering buffer;

after completing the step of updating the rendering buffer unlocking the scene renderer; and

rendering the 3-dimensional animation.