Instantaneous 180-degree 3D recording and playback systems

• US 10,582,184 B2
• Filed: 12/04/2016
• Issued: 03/03/2020
• Est. Priority Date: 12/04/2016
• Status: Active Grant

• Current Assignee: Juyang Weng
• Original Assignee: Juyang Weng
• Inventors: Weng, Juyang
• Primary Examiner(s): Pandya, Sunit
• Application Number:
  US15/368,667
• Publication Number:
  US 20180160097A1
• Time in Patent Office: 1,185 Days
• Field of Search: None
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera

Abstract

The term instantaneous in this invention means that the roughly 180° horizontal visual field of view that a human senses in real time. The major novelty of the instantaneous 180° (i180°) 3D technology includes (a) a combination of multiple binocular and monocular fields of view for image acquisition, (b) a combination of binocular and monocular fields of view in content playback, (c) a multi-resolution scheme for sensing, processing, transmission, and playback, (d) a realization of physical consistency of the line of sight with minimal distortion of all projection lines between imaging and display, and (e) a method for two-way compatibility for systems with conventional binocular 3D and monocular 2D systems. In addition to applications in consumer electronics, the invention has potential applications in professional business, such as film industry, theaters, museums, advertisements, surgery, rehabilitation, and assistance to the handicapped and elderly.

Claims

1. A method for binocular recording and binocular playback, comprising:

a recording device having two cameras whose imaging process uses three fields of view—

central binocular, left monocular, and right monocular—

to form an instantaneous 180°

horizontal field of view, and two playback devices having two image displays using three fields of view—

central binocular, left monocular, and right monocular—

to form an instantaneous 180°

horizontal field of view, where a left camera corresponds to the left monocular field of view and the left view of the central binocular field of view and a right camera corresponds to the right monocular field of view and the right view of the central binocular field of view, wherein two 3D projection directions of the two cameras (or playback devices’

) intersect in 3D to give a perception of depth.

2. The binocular recording method of claim 1 wherein the two cameras are either video cameras or film recorders that record a time-varying sequence onto a recording medium.

3. The binocular recording method of claim 1 wherein the two cameras are still cameras that record two static images on a recording medium.

4. The binocular playback method of claim 1 wherein the two binocular displays are film projectors, video projectors, or TV screens that display a time-varying sequence from a recorded medium.

5. The binocular playback method of claim 1 wherein the two binocular displays are static image projectors or image displays that display a static view from a recorded medium.

6. In the recording and playback method of claim 1, if the playback device is mounted on the head of a human viewer, the part of the playback device that controls the display is mounted at the back of the head of the human viewer while a separate image display is mounted at the front of the human viewer.

7. The method of claim 1, where the 3D projection direction of each pixel of each of the two cameras of the imaging process is the same as the 3D projection direction of the corresponding pixel of the playback device, wherein the 3D projection direction of each pixel is determined by (A) for the imaging cameras, starting from the projection center (i.e. focal point) of the camera going through the center of the corresponding pixel and (B) for the playback devices, starting from the projection center (i.e. focal point) of the playback device going through the center of the corresponding pixel.

8. An apparatus for binocular recording or binocular playback, comprising:

a recording device having two cameras whose imaging process uses three fields of view—

central binocular, left monocular, and right monocular—

to form an instantaneous 180°

horizontal field of view, and two playback devices having two image displays using three fields of view—

central binocular, left monocular, and right monocular—

to form an instantaneous 180°

horizontal field of view, where a left camera corresponds to the left monocular field of view and the left view of the central binocular field of view and a right camera corresponds to the right monocular field of view and the right view of the central binocular field of view, wherein two 3D projection directions of the two cameras (or playback devices) intersect in 3D to give a perception of depth, and wherein the 3D projection direction of each pixel is determined by (A) for the imaging cameras, starting from the projection center (i.e. focal point) of the camera going through the center of the corresponding pixel and (B) for the playback devices, starting from the projection center (i.e. focal point) of the playback device going through the center of the corresponding pixel.

9. The apparatus of claim 8, wherein the 3D projection direction of each pixel during the imaging process is the same as the 3D projection direction of the corresponding pixel during the playback process.

10. A specific scheme for assigning postfixes of the names of the files that store video/images in claim 8, where a file name stem has multiple levels of postfix extensions wherein the first level is the image format, the second level is the location of the eye, and the third level is i180 or absent.