Intelligent device with both recording and playing back 3D movies and the relevant apparatus and methods

• US 9,258,547 B2
• Filed: 05/24/2013
• Issued: 02/09/2016
• Est. Priority Date: 03/21/2012
• Status: Expired due to Fees

• Current Assignee: Laurence Chen
• Original Assignee: Laurence Chen
• Inventors: Chen, Laurence Lujun, Chen, Di (Laura), Guo, Jie, Chen, Michael Meng
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): HUNTER, MISHAWN N
• Application Number:
  US13/844,976
• Publication Number:
  US 20140348490A1
• Time in Patent Office: 991 Days
• Field of Search: 348/14.08, 348/156, 348/158, 348/633, 348/42, 348/46, 348/51, 386/224, 386/248
• US Class Current: 1/1
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/31 using parallax barriers
• CPC Class Codes: H04N 13/315 the parallax barriers being time-variant
• CPC Class Codes: H04N 13/341 using temporal multiplexing
• CPC Class Codes: H04N 13/373 for tracking forward-backward translational head movements, i.e. longitudinal movements
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 2213/001 Constructional or mechanical details

Abstract

Present invention relates to apparatus and methods for integrating both 3D video recording and 3D movies playing back together on intelligent devices or smart devices, wherein the method of the 3D movies recording can increase the view depth beyond human eye capability and the method and apparatus of 3D movies playing back provide large tolerance to eye motion and viewer is able to avoid the suffers from side effects of vertigo, headache, and eye fatigue; wherein intelligent devices is any one of cell-phone, PDA, iPhone / smartPhone, iPad, Google Glass, pocket/tablet PC, GPS, or eBook, laptop or notebook, computer, TV or iTV, etc.

Claims

1. A method for extending 3-dimensional view-depth of 3D video recording and playing back on an intelligent device to increase the view depth beyond human eye capability, comprises the following steps:

(1) producing extension for the location of one camera in camera pair for 3D video recording;

(2) integrating the said extension with the said intelligent device for both 3D video recording and playing back with extended view-depth for wider applications;

(3) recording 3D video with extended view-depth; and

(4) playing back recorded 3D video with extended view-depth;

wherein, the said intelligent device being referring to any one of cell-phone, PDA, iPhone, iPad, Google Glass, pocket PC or tablet, GPS, eBook, laptop or notebook, monitors of desktop computer, TV or iTV;

wherein, the 3D display of intelligent device with said extension for playing back being not necessarily to limit to case of glassless display, and being not necessarily to limit to the case which needs a camera for eye tracking;

wherein the (means of) recording 3D video with extended view-depth comprises at least one of;

(1) determine camera-separation in camera pair from the depth of scene using relation;

(separation of approximately 30 feet)*(camera-distance/8 cm);

(2) pulling out extension from intelligent device to a proper distance according to required camera-separation;

(3) adjusting numerical and optic focus of two cameras in camera pair simultaneously during 3D recording; and

(4) adjusting view-angles of two cameras in camera pair simultaneously during 3D recording;

wherein, data of right eye pictures and left eye pictures is stored in predetermined format such as in separate data files, alternately in one data file, in industry standard format(;

), and in predefined 3D movie format.

2. The method of claim 1, wherein the (means of) producing extension comprises at least one of :

(1) providing link by single level mechanic extension;

(2) providing link by multiple levels of mechanic extension to further increase view-depth;

(3) providing link by optical fiber extension with off-device camera;

(4) providing link by RF cable extension and RF wire extension with off-device camera; and

(5) providing link by RF wireless extension with off-device camera;

wherein the said link of extension with off-device camera and link of mechanic extension providing flexible location for one of the cameras in camera pair and providing signal connection between said camera and intelligent device.

3. The method of claim 2, wherein the next level of extension of said multiple levels of mechanic extensions being installed on a previous level extension, being able to pulled into and out from the previous level of extension, and being rotatable about one end of the previous level of extension when necessary.

4. The method of claim 1, wherein said mechanic extension together with one camera of camera pair being integrated with intelligent device, said extension being able to be pulled out from and into intelligent device and able to adjust the distance of two cameras of camera pair, and one camera of camera pair being installed at one end of said extension, the other end of said extension being fixed on said intelligent device and being rotatable when necessary.

5. The method of claim 1, wherein playing back recorded 3D video with extended view-depth comprises:

(1) providing system design for 3D display; and

(2) providing algorithms for stream control of 3D display.

6. The method of claim 5, wherein the algorithms for stream control of 3D display with extended view-depth comprises at least one of the following steps:

(1) transmitting a movie signal from 3D video source to a stream processor and controller;

(2) transmitting images signal using the stream processor and controller to image split and combination unit, and meanwhile generating a synchronized signal for releasing buffer and switching shutter;

(3) calculating picture stripe width and shutter grid stripe width from eye-tracking result and design formula using the stream processor when eye-tracking system is included;

(4) splitting the pictures of left and right eyes into stripes and combine the stripes into new left-type frames and right type frames using a split and combination unit;

(5) converting the picture format from row-by-row scan to column-by-column scan using the stream processor when directly using original left and right pictures rather than using combined pictures;

(6) storing new left-type frames and right type frames in two buffers respectively, wherein(,) during first two frames of display, the synchronize signal being properly delayed so that leaving enough time for split and combination unit to finish the job;

(7) synchronizing a signal triggering the left buffer which stores a left-type stream to release the signal stream of the left-type frame, and to display the picture of left-type frame, meanwhile, synchronize signal trigging the shutter to open shutter grid stripes for left-type frame;

(8) storing a right-type stream in the right buffer being triggered to release the signal stream of right-type frame to display the picture of type right-type frame, immediately after finishing the display of left-type frame(,);

meanwhile, shutter grid stripes for right-type frame being switched on and shutter grid stripes for left-type frame being switched off; and

(9) synchronizing the signal after the first the first two frames, and triggering left buffer, right buffer, and shutter grid stripes periodically, releasing (the) a frame stream and switching shutter grid stripes on time.

7. The method of claim 5, wherein the algorithms for re-combined 3D video pictures with extended view-depth comprises:

p*[dV+e*dL]=dE*dL;

dX=p*[(dV+dL)/dV]^e ; and

dL=n*dV*W/[dE*Np−

e*n*W];

wherein, dE stands for the distance of two eyes, dV stands for the distance between viewer and screen of shutter grids, W stands for width of display apparatus, Np stands for the total horizontal pixel number which means W=Np*pixelSeparation, n stands for number of pixels in a shutter grid stripe or in a picture stripe, p=n*pixelSeparation;

wherein, for the design of constant shutter grid stripe width, e=+1, p being the width of shutter grid stripe, and dX being the width of picture stripe;

wherein, for the design of constant picture stripe width, e=−

1, p being the width of picture stripe, and dX being the width of shutter grid stripe, ^s stands for power calculation.

8. The method of claim 5, wherein the algorithms for stream control of unsplit 3D video pictures with extended view-depth comprises at least one of the following steps:

(1) converting left-eye and right-eye pictures into column-by-column scan format from row-by-row scan format when original pictures being in row-by-row format;

(2) vertically scanning each image pixel within a picture stripe which is image pixel column line;

(3) during scanning to each picture stripe , all the corresponding shutter stripe windows on the shutter screen being always on, which means all shutter pixel lines in these windows being switched on simultaneously, all other shutter lines being switched off, until end of current image pixel line;

(4) scanning next image pixel column line and repeating until whole left eye picture being scanned; and

(5) scanning for right eye picture and repeating;

wherein, simultaneously multiple-zone-scanning being used to increase the brightness when necessary.

9. The method of claim 5, wherein the formula of system design for unsplit 3D video pictures with extended view-depth comprises:

for fixed pitch of shutter screen, determining center location of picture stripes by

xL(i)=i*pixelSeperation+[i*pixelSeperation+dE/2]*dL/dV (left eyes) ,

xR(i)=i*pixelSeperation+[i*pixelSeperation−

dE/2]*dL/dV (right eyes),

and determining width and pitch of picture stripes by

dX=hW+[hW+vR]*dL/dV;

for fixed pitch of image screen , determining center location of shutter windows by;

xL(i)=[i*pixelSeperation—

(xN+dE/2)*dL/dV]/(1+dL/dV) (left eyes),

xR(i)=[i*pixelSeperation—

(xN−

dE/2)*dL/dV]/(1+dL/dV) (right eyes),

and determining width of shutter windows by

hW=[vR*dL/dV−

p]/(1+dL/dV);

wherein, xN being the location of middle line between eyes relative to center of display screen, vR being the tolerant range for eye motion or viewer head swinging, i is the index of picture stripes or shutter windows.