Parallel scaling engine for multi-view 3DTV display and method thereof

• US 20160156898A1
• Filed: 05/29/2014
• Published: 06/02/2016
• Est. Priority Date: 04/24/2014
• Status: Active Grant

• Current Assignee: Create Group of Xi'An Jiaotong University
• Original Assignee: Create Group of Xi'An Jiaotong University
• Inventors: Ren, Pengju, Liu, Geng, Yu, Jiang, Sun, Hongbin, Liu, Yuehu, ZHENG, Nanning
• Granted Patent: US 9,924,153 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403
• CPC Class Codes: H04N 13/111 Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 13/167 Synchronising or controlling image signals
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/351 for displaying simultaneously

Abstract

A parallel synchronous scaling engine for multi-view 3D display and a method thereof are provided, wherein, selection and combination calculation are provided to an interpolation pixel window, then interpolation calculation is provided to a combined interpolation pixel window of a combined view field, calculation results are directly displayed on a display terminal. That is to say, interpolation is originally provided before stereoscopic pixel rearrangement, which is now improved, in such a manner that screening and combination of pixel points is provided before interpolation calculation. According to the present invention, computation and memory resource is greatly saved. The method is suitable to be implemented by hardware, for satisfying various numbers of viewpoints and interpolation algorithm, and being compatible with multi-view 3D display with the integrated and floating-point pixel arrangement, wherein the computation resource does not need to be increased with increasing of the viewpoints.

Claims

1. A parallel synchronous scaling engine for multi-view 3D display, comprising:

a multi-channel image combining calculation module, for obtaining interpolation pixel window data, which are used during interpolation, from on-chip memory units corresponding to each sub view field, in a synchronous and parallel form; and

processing the interpolation pixel window data of each sub view field with combination calculation screening, so as to obtain interpolation pixel window data of each sub pixel of a combined view field;

wherein a result thereof is sent to a pixel rearrangement module;

the pixel rearrangement module, for generating the interpolation pixel window data of the sub pixels of the combined view field, so as to obtain an interpolation pixel window of the combined view field;

wherein a result thereof is sent to an interpolation module; and

the interpolation module, wherein according to coefficients of a corresponding interpolation algorithm, the interpolation pixel window data are interpolated for obtaining a display pixel at a corresponding position.

2. The parallel synchronous scaling engine, as recited in claim 1, wherein the interpolation module calculates all the display pixels of all images in a view field, and displays a combined image on a multi-view 3D display terminal.

3. The parallel synchronous scaling engine, as recited in claim 1, wherein during storing video data of each of the sub view fields into the on-chip memory units, control states of the sub view fields are kept identical, and each of sub view field data is synchronously written into the on-chip memory units.

4. The parallel synchronous scaling engine, as recited in claim 2, wherein the multi-view 3D display terminal is an N-viewpoint multi-view 3D display terminal with integrated or floating-point pixel arrangement;

wherein when the multi-view 3D display terminal adopts the integrated pixel arrangement, only one F_xⁿ equals to 1, and others equal to 0;

wherein when the multi-view 3D display terminal adopts the floating-point pixel arrangement, the F_xⁿ satisfy

5. A parallel synchronous interpolation method for multi-view 3D display, comprising steps of:

1) writing each of sub view field data into corresponding on-chip memory units;

2) obtaining an interpolation pixel window of each sub view field used during interpolation, from the on-chip memory units corresponding to each sub view field, by a multi-channel image combining calculation module in a synchronous and parallel form;

3) according to a physical display resolution of a multi-view 3D display terminal and a pixel arrangement requirement of a combined stereoscopic image, processing the interpolation pixel window data of each of the sub view fields with combination calculation by the multi-channel image combining calculation module, so as to obtain an interpolation pixel window of each sub pixel of a combined view field; and

connecting the interpolation pixel window of the sub pixels of the combined view field by a pixel rearrangement module, so as to obtain an interpolation pixel window of the combined view field; and

4) according to a corresponding interpolation algorithm, providing interpolation calculation to the interpolation pixel window of the combined view field by an interpolation module, for obtaining a display pixel.

6. The parallel synchronous interpolation method, as recited in claim 5, wherein the interpolation module calculates all the display pixels of all images in a view field, and real-time displays the pixels of a combined image on the multi-view 3D display terminal.

7. The parallel synchronous interpolation method, as recited in claim 6, wherein in the step 1), during storing video data of each of the sub view fields into the on-chip memory units, control states of the sub view fields are kept identical, and each of sub view field data is synchronously written into the on-chip memory units.

8. The parallel synchronous interpolation method, as recited in claim 6, wherein the multi-view 3D display terminal is an N-viewpoint multi-view 3D display terminal with integrated or floating-point pixel arrangement;

wherein when the multi-view 3D display terminal adopts the integrated pixel arrangement, there is only one F_xⁿ equaling to 1, and others equal to 0;

wherein when the multi-view 3D display terminal adopts the floating-point pixel arrangement, the F_xⁿ satisfy

9. A parallel synchronous interpolation method for multi-view 3D display, comprising steps of:

firstly, according to a stereoscopic image pixel arrangement requirement of a multi-view 3-dimensional display terminal, screening and combining an interpolation pixel window;

abandoning redundant data, then providing interpolation calculation; and

finally, directly generating display pixels of a multi-view 3D combined image.