3D system including rendering with eye displacement

• US 10,277,879 B2
• Filed: 10/14/2016
• Issued: 04/30/2019
• Est. Priority Date: 11/13/2015
• Status: Active Grant

• Current Assignee: VEFXi Corporation
• Original Assignee: VEFXi Corporation
• Inventors: Peterson, Craig, Roberts, Markus, Lomov, Sergey, Muro, Manuel
• Primary Examiner(s): Young, Patricia I
• Application Number:
  US15/293,433
• Publication Number:
  US 20170142398A1
• Time in Patent Office: 928 Days
• Field of Search: 348 43
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/579 from motion
• CPC Class Codes: G06T 7/97 Determining parameters from multiple pictures depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/261 with monoscopic-to-stereoscopic image conversion
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals

Abstract

A three dimensional system including rendering with eye displacement.

Claims

1. A method for conversion of a series of two dimensional images using a processor into a series of three dimensional images comprising:

(a) said processor receiving said series of two dimensional images where each of said series of two dimensional images are from a same viewpoint, where said series of two dimensional images do not include any images from a viewpoint other than said same viewpoint;

(b) said processor processing said series of two dimensional images all of which are from said same viewpoint and do not include any images from a viewpoint other than said same viewpoint to determine a respective depth map associated with each pixel or clusters of pixels of said series of two dimensional images where all of said series of two dimensional images are from said same viewpoint, where said series of two dimensional images do not include any images from a viewpoint other than said same viewpoint;

(c) said processor processing said depth map depths to create corresponding source pixel horizontal displacements for each eye-view to be rendered for a target glasses-based or glasses-free 3D or holographic display;

(d) said processor displacing the pixels to create a fully or partially populated image for each view, wherein portions of said series of three dimensional images has an appearance of being behind a plane of a screen of said display and other portions of said series of three dimensional images has the appearance of being in front of said plane of said screen of said display, where a first depth of a first pixel of said depth map being a first distance behind of said plane of said display screen results in a first displacement of said pixel on said display, where a second depth of a second pixel of said depth map being a second distance in front of said plane of said screen of said display results in a second displacement of said pixel on said display, wherein said first depth is the same as said second depth from said plane of said screen, where said second displacement is greater than said first displacement;

(e) rendering said three dimensional images based upon said two dimensional images all of which are from the same viewpoint and do not include any images from a viewpoint other than said same viewpoint on a display; and

(f) wherein as said second depth becomes increasingly larger, wherein a second shift becomes increasingly larger in a non-linear manner.