Resolution enhanced 3D rendering systems and methods

• US 10,102,667 B2
• Filed: 10/20/2016
• Issued: 10/16/2018
• Est. Priority Date: 10/05/2011
• Status: Active Grant

• Current Assignee: BitAnimate, Inc.
• Original Assignee: BitAnimate, Inc.
• Inventors: Maleki, Behrooz, Sarkhosh, Sarvenaz
• Primary Examiner(s): Xiao, Ke
• Assistant Examiner(s): LIU, GORDON G
• Application Number:
  US15/298,663
• Publication Number:
  US 20170039758A1
• Time in Patent Office: 726 Days
• Field of Search: 345427
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 13/30 Image reproducers optical systems for producing stereoscopic or other three-dimensional effects G02B30/00
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses

Abstract

Systems and methods are provided for rendering 3D images or video without significantly losing resolution or increasing the resolution. The systems and methods for 3D rendering technology can work with different types of 3D data frames that include left eye image and right eye image sub-frames. The 3D data frames render 3D imagery with side-by-side (SXS), top-and-bottom (TB), and frame packing (FP), as well as others such as full high definition 3D (FHD3D), frame sequential 3D, passive 3D rendering or the like. System and methods are provided for creating inverse pixel strips, and preparing 3D images that include the inverse pixel strips. Systems and methods are provided for expanding images in a plane without significant loss of resolution.

Claims

1. A method comprising:

receiving a first pixel strip of first pixels of a first sub-frame image that is derived from a full two-dimensional (2D) format image, the first pixels having first pixel data;

receiving a second pixel strip of second pixels of a second sub-frame image that is derived from the full 2D image, one or more of the first pixels corresponding to one or more of the second pixels in a three-dimensional (3D) image rendered based on the first and second sub-frame images, the corresponding one or more first and second pixels being displaced in location with respect to each other;

inverting the second pixel strip into an inverted second pixel strip based on the displaced locations of the one or more first pixels with respect to their corresponding second pixels, the inverted second pixel strip including inverted second pixels having inverted second pixel data, wherein the inverting includes;

determining a displacement direction of a second pixel with respect to a corresponding first pixel, wherein the second pixel includes second pixel data;

determining a displacement distance of the second pixel with respect to the corresponding first pixel;

determining, based on the determined first direction, a second direction that is opposite the first direction;

determining, based on the determined displacement distance and second direction, an inverted second pixel of the inverted second pixel strip that is displaced with respect to the first pixel by the displacement distance in the second direction; and

including the second pixel data in the inverted second pixel in response to determining that the inverted second pixel is displaced with respect to the first pixel by the displacement distance in the second direction; and

rendering the 3D image to include a superimposed pixel strip that is based on the inverted second pixel strip and the first pixel strip.

2. The method of claim 1, further comprising superimposing the inverted second pixel strip with the first pixel strip to form the superimposed pixel strip, wherein superimposing the inverted second pixel strip with the first pixel strip includes superimposing the inverted second pixel data of the inverted second pixels with the first pixel data of the first pixels to generate superimposed pixel data and including the superimposed pixel data in superimposed pixels of the superimposed pixel strip.

3. The method of claim 2, further comprising:

weighting the superimposed pixel data to include more first pixel data than inverted second pixel data;

or

weighting the superimposed pixel data to include more inverted second pixel data than first pixel data.

4. The method of claim 2, further comprising deriving the superimposed pixel data (“

X”

) from the first pixel data (“

A”

) and the inverted second pixel data (“

B”

) based on the expression X=(A+B)/2.

5. The method of claim 2, further comprising deriving the superimposed pixel data (“

Y”

) from the first pixel data (“

A”

) and the inverted second pixel data (“

B”

) based on the expressions X=(A+B)/2 and Y=(X+A)/2.

6. The method of claim 2, further comprising deriving the superimposed pixel data (“

Y”

) from the first pixel data (“

A”

) and the inverted second pixel data (“

B”

) based on the expressions X=(A+B)/2 and Y=(X+B)/2.

7. The method of claim 1, wherein at least one non-transitory computer readable media is configured to store one or more instructions that, in response to being executed by at least one processor, cause a system to perform the method of claim 1.

8. A method comprising:

receiving a first pixel strip of first pixels of a first sub-frame image that is derived from a full two-dimensional (2D) format image, the first pixels having first pixel data;

receiving a second pixel strip of second pixels of a second sub-frame image that is derived from the full 2D image, one or more of the first pixels corresponding to one or more of the second pixels in a three-dimensional (3D) image rendered based on the first and second sub-frame images, the corresponding one or more first and second pixels being displaced in location with respect to each other;

inverting the second pixel strip into an inverted second pixel strip based on the displaced locations of the one or more first pixels with respect to their corresponding second pixels, the inverted second pixel strip including inverted second pixels having inverted second pixel data;

superimposing the inverted second pixel data of the inverted second pixels with the first pixel data of the first pixels to generate superimposed pixel data;

forming a superimposed pixel strip that includes superimposed pixels that include the superimposed pixel data; and

rendering the 3D image to include the superimposed pixel strip.

9. The method of claim 8, wherein the inverting includes:

determining a displacement direction of a second pixel with respect to a corresponding first pixel, wherein the second pixel includes second pixel data;

determining a displacement distance of the second pixel with respect to the corresponding first pixel;

determining, based on the determined first direction, a second direction that is opposite the first direction;

determining, based on the determined displacement distance and second direction, an inverted second pixel of the inverted second pixel strip that is displaced with respect to the first pixel by the displacement distance in the second direction; and

including the second pixel data in the inverted second pixel in response to determining that the inverted second pixel is displaced with respect to the first pixel by the displacement distance in the second direction.

10. The method of claim 8, further comprising:

weighting the superimposed pixel data to include more first pixel data than inverted second pixel data;

or weighting the superimposed pixel data to include more inverted second pixel data than first pixel data.

11. The method of claim 8, further comprising deriving the superimposed pixel data (“

X”

) from the first pixel data (“

A”

) and the inverted second pixel data (“

B”

) based on the expression X=(A+B)/2.

12. The method of claim 8, further comprising deriving the superimposed pixel data (“

Y”

) from the first pixel data (“

A”

) and the inverted second pixel data (“

B”

) based on the expressions X=(A+B)/2 and Y=(X+A)/2.

13. The method of claim 8, further comprising deriving the superimposed pixel data (“

Y”

) from the first pixel data (“

A”

) and the inverted second pixel data (“

B”

) based on the expressions X=(A+B)/2 and Y=(X+B)/2.

14. The method of claim 8, wherein at least one non-transitory computer readable media is configured to store one or more instructions that, in response to being executed by at least one processor, cause a system to perform the method of claim 8.