Rendering A Multiple Viewpoint Image Into A Single Frame Buffer Using Off-Screen Rendering Surfaces

• US 20090262125A1
• Filed: 04/18/2008
• Published: 10/22/2009
• Est. Priority Date: 04/18/2008
• Status: Abandoned Application

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Sellers, Graham, Swaminathan, Vasanth
• Application Number:
  US12/106,059
• Publication Number:
  US 20090262125A1
• Time in Patent Office: Days
• US Class Current: 345/581
• CPC Class Codes: H04N 13/10 Processing, recording or transmission of stereoscopic or multi-view image signals
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals

Abstract

A method and apparatus for rendering multiple viewpoint image data into a single physical frame buffer are described. One example method includes storing image data corresponding to different viewpoints on different virtual buffers, processing the image data stored on the virtual buffers, then blending the image data and storing the blended image data in a physical frame buffer. The blended image data may then be transferred to a multi-viewpoint display, such as an autostereoscopic display. Storing image data on virtual buffers may include rendering the image data into a texture using graphics library functions, such as OpenGL frame buffer object extension functions.

Claims

1. A method for rendering multiple viewpoint images, the method comprising:

storing image data corresponding to a first viewpoint in a first buffer;

storing image data corresponding to a second viewpoint in a second buffer;

processing the image data in at least one of the first and second buffers;

blending the image data corresponding to the first and second viewpoints to produce blended image data;

storing the blended image data in a third buffer; and

transferring the blended image data to a multi-viewpoint display.

2. The method of claim 1, wherein at least one of the first, second, and third buffers is RAM on a video processing card.

3. The method of claim 1, wherein storing the first and/or second viewpoint image data includes rendering the image data into a texture.

4. The method of claim 3, wherein rendering image data into a texture includes executing an OpenGL function associated with an OpenGL frame buffer object extension.

5. The method of claim 1, wherein processing the image data includes at least one of:

smoothing the image data, sharpening the image data, changing contrast of the image data, blurring the image data, and simulating an imaging artifact of a real-world camera in the image data.

6. The method of claim 1, wherein storing the first viewpoint image data includes rendering the first viewpoint image data into the third buffer and copying the first viewpoint image data to the first buffer, and

wherein storing the second viewpoint image data includes storing the second viewpoint image data in the third buffer and copying the second viewpoint image data to the second buffer.

7. The method of claim 1, wherein blending the image data includes interleaving image data in the first buffer with image data in the second buffer.

8. The method of claim 7, wherein interleaving the image data includes interleaving color components of image data in the first buffer with color components of image data in the second buffer.

9. The method of claim 1, wherein blending the image data includes filtering image data in the first and second buffers and combining the filtered image data to generate an anaglyph image.

17. A computer-readable medium having computer-executable instructions adapted to carry out the method of claim 1.

10. An apparatus comprising:

a first buffer adapted to receive image data corresponding to a first viewpoint;

a second buffer adapted to receive image data corresponding to a second viewpoint;

a programmable device adapted to blend the image data received by the first buffer with the image data received by the second buffer; and

a third buffer adapted to receive the blended image data from the programmable blending module.

11. The apparatus of claim 10, further comprising:

an image processing device adapted to process image data stored in at least one of the first and second buffers.

12. The apparatus of claim 10, wherein the first and second buffers are virtual frame buffers.

13. The apparatus of claim 10, wherein the third buffer is a physical frame buffer.

14. The apparatus of claim 10, wherein the programmable device is programmable to be compatible with a plurality of stereoscopic display types.

15. The apparatus of claim 10, wherein the programmable device is programmed to interleave image data in the first buffer with image data in the second buffer.

16. The apparatus of claim 10, wherein the programmable device is programmed to filter image data in the first and second buffers and to then combine the filtered image data to generate an anaglyph image.

18. A video device suitable for generating display data for output on a display device, the video device comprising:

memory configured to provide a plurality of virtual frame buffer sections, the virtual frame buffer sections configured to store image data corresponding to at least a first viewpoint and a second viewpoint and wherein at least a portion of the stored image data is rendered into a texture;

a programmable device configured to blend the image data associated with the first viewpoint with the image data associated with the second viewpoint, so as to produce a blended image data set;

a memory configured to provide a physical frame buffer that receives and stores the blended image data set from the programmable device; and

an interface configured to provide an operable connection to a multi-viewpoint display device for communication of the blended image data set.