Image processing system, device, method, and computer program

• US 20020080141A1
• Filed: 07/24/2001
• Published: 06/27/2002
• Est. Priority Date: 07/24/2000
• Status: Abandoned Application

• Current Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Fujita, Junichi, Imai, Masatoshi, Hihara, Daisuke
• Application Number:
  US09/912,143
• Publication Number:
  US 20020080141A1
• Time in Patent Office: Days
• US Class Current: 345/519
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 15/40 Hidden part removal

Abstract

image processing system is capable of expressing a 3-D image correctly even if semitransparent images are complicatedly mixed in the 3-D image. A plurality of image generators each generate image data including a depth distance, from a predetermined reference portion, of an image to be expressed by the image data, and color information thereof. A merger specifies, e.g. sorts, the plurality of received image data in order of the depth distance included in each of the image data and merges the color information of the image data which is for expressing a first image whose depth distance is relatively long and the color information of the image data which is for expressing a second image in an overlapping manner over the first image.

Claims

1. An image processing system comprising:

a plurality of image generators each for generating image data including a depth distance, from a predetermined reference portion, of an image to be expressed by said image data, and color information of said image; and

a merger for receiving said image data from each of the plurality of image generators,

wherein said merger specifies the plurality of received image data in order of the depth distance included in each of said image data and merges the color information of the image data which is for expressing a first image whose depth distance is relatively long and the color information of the image data which is for expressing a second image in an overlapping manner over said first image.

2. The image processing system according to claim 1, wherein said depth distance is a depth distance of a pixel from the predetermined reference portion and said color information is color information of said pixel, and wherein said merger specifies the pixels in order of the depth distance of the pixel and merges the color information of the pixels.

3. The image processing system according to claim 2, wherein each of said image data includes depth distances of a plurality of pixels and color information of said pixels, and wherein said merger specifies the pixels having the same two-dimensional coordinates in order of the depth distance of the pixel and merges the color information of the pixels having the same two-dimensional coordinates.

4. The image processing system according to claim 1, wherein said merger merges the color information of the image data having the longest depth distance and the color information of the image data having the second longest depth distance, and further merges a result of the merging and the color information of the image data having the third longest depth distance.

5. The image processing system according to claim 4, wherein said merger merges the color information of the image data having the longest depth distance and color information of background image data for expressing a background.

6. The image processing system according to claim 4, wherein the image data having the longest depth distance is background image data for expressing a background.

7. The image processing system according to claim 1, wherein said color information includes luminance values representing three primary colors and a transparency value representing semitransparency.

8. The image processing system according to claim 1, further comprising a synchronizing unit for synchronizing timings of capturing the image data from the plurality of image generators with image processing timing of the image processing system.

9. The image processing system according to claim 8, wherein said plurality of image generators, said merger and said synchronizing unit are partly or wholly comprise a logic circuit and a semiconductor memory, and said logic circuit and said semiconductor memory are mounted on a semiconductor chip.

10. An image processing device comprising:

a data capturing unit for capturing image data from each of a plurality of image generators each of which generates the image data including a depth distance, from a predetermined reference portion, of an image to be expressed by said image data, and color information of said image; and

a color information merger for specifying the plurality of captured image data in order of the depth distance included in each of said image data and merging the color information of the image data which is for expressing a first image whose depth distance is relatively long and the color information of the image data which is for expressing a second image in an overlapping manner over said first image,

wherein said data capturing unit and said color information merger are mounted on a semiconductor chip.

11. The image processing device according to claim 10, further comprising a synchronizing unit for synchronizing timings of capturing the image data from the plurality of image generators with image processing timing of the image processing device.

17. The image processing system according to claim 16, wherein at least one of said selected image generators has other image generators connected thereto over a network different from said network, and image data is also generated by said other image generators.

18. The image processing system according to claim 16, wherein said image data includes data for specifying the target merger which captures said image data.

19. The image processing system according to claim 16, further comprising a switch for storing data for specifying the image generators and said at least one merger selected by said controller to capture the image data generated by the image generators specified by said stored data and to transmit said captured image data to said at least one merger specified by said stored data.

12. An image processing device comprising:

a frame buffer for storing image data including color information of an image to be expressed by said image data;

a z-buffer for storing a depth distance of said image from a predetermined reference portion; and

a communication unit for communicating with a merger, said merger receiving said image data including said color information and said depth distance from each of a plurality of image processing devices including the subject image processing device to specify the plurality of received image data in order of the depth distance included in each of said image data and to merge the color information of the image data which is for expressing a first image whose depth distance is relatively long and the color information of the image data which is for expressing a second image in an overlapping manner over said first image,

wherein said frame buffer, said z-buffer and said communication unit are mounted on a semiconductor chip.

13. An image processing method to be executed in an image processing system including a plurality of image generators and a merger connected to the plurality of image generators, said method comprising the steps of:

causing said plurality of image generators to generate image data each including a depth distance, from a predetermined reference portion, of an image to be expressed by said image data, and color information of said image; and

causing said merger to capture said image data from each of said plurality of image generators at predetermined synchronizing timing, to specify the plurality of captured image data in order of the depth distance included in each of said image data and to merge the color information of the image data which is for expressing a first image whose depth distance is relatively long and the color information of the image data which is for expressing a second image in an overlapping manner over said first image.

14. A recording medium recorded with a computer program for causing a computer to be operated as an image processing system, the system comprising:

a plurality of image generators each for generating image data including a depth distance, from a predetermined reference portion, of an image to be expressed by said image data, and color information of said image; and

a merger for receiving said image data from each of the plurality of image generators,

wherein said merger specifies the plurality of received image data in order of the depth distance included in each of said image data and merges the color information of the image data which is for expressing a first image whose depth distance is relatively long and the color information of the image data which is for expressing a second image in an overlapping manner over said first image.

15. An image processing system comprising:

a data capturing unit for capturing, over a network, image data from each of a plurality of image generators each of which generates the image data including a depth distance, from a predetermined reference portion, of an image to be expressed by said image data, and color information of said image; and

a color information merger for specifying the plurality of captured image data in order of the depth distance included in each of said image data and merging the color information of the image data which is for expressing a first image whose depth distance is relatively long and the color information of the image data which is for expressing a second image in an overlapping manner over said first image.

16. An image processing system comprising:

a plurality of image generators each for generating image data including a depth distance, from a predetermined reference portion, of an image to be expressed by said image data, and color information of said image;

a plurality of mergers for capturing the image data generated by the plurality of image generators and merging the captured image data; and

a controller for selecting image generators and at least one merger necessary for processing from said plurality of image generators and said plurality of mergers,

wherein said plurality of image generators, said plurality of mergers and said controller are connected to one another over a network, and at least one of said plurality of mergers captures the image data from the selected image generators to specify the plurality of captured image data in order of the depth distance included in each of said image data and to merge the color information of the image data which is for expressing a first image whose depth distance is relatively long and the color information of the image data which is for expressing a second image in an overlapping manner over said first image.