3D system including lens modeling

• US 10,284,837 B2
• Filed: 10/14/2016
• Issued: 05/07/2019
• Est. Priority Date: 11/13/2015
• Status: Active Grant

• Current Assignee: VEFXi Corporation
• Original Assignee: VEFXi Corporation
• Inventors: Peterson, Craig
• Primary Examiner(s): Young, Patricia I
• Application Number:
  US15/293,514
• Publication Number:
  US 20170142390A1
• Time in Patent Office: 935 Days
• Field of Search: 348 43
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/261 with monoscopic-to-stereoscopic image conversion
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps

Abstract

A three dimensional system including lens modeling.

Claims

1. A method for conversion of a series of two dimensional images into a series of three dimensional images comprising:

(a) receiving said two dimensional images together with lens information indicating a lens from which said two dimensional image was captured where each of said series of two dimensional images are from a same viewpoint, where said series of two dimensional images do not include any images from a viewpoint other than said same viewpoint;

(b) processing said two dimensional images, based upon said lens information, all of which are from said same viewpoint and do not include any images from a viewpoint other than said same viewpoint to determine a depth map associated with said two dimensional images where all of said series of two dimensional images are from said same viewpoint, where said depth map is different based upon different said lens information, where neither said lens information nor said different lens information are used to determine said depth map from images other than said same viewpoint, where said series of two dimensional images do not include any images from a viewpoint other than said same viewpoint;

(c) processing said depth map to render said two dimensional images all of which are from the same viewpoint and do not include any images from a viewpoint other than said same viewpoint on a display as said three dimensional images, said processing said two dimensional images all of which are from the same viewpoint and do not include any images from a viewpoint other than said same viewpoint to determine said depth map is based upon said lens information and said processing said two dimensional images all of which are from the same viewpoint and do not include any images from a viewpoint other than said same viewpoint to render said two dimensional images on said display as said three dimensional images is based upon said lens information;

(d) rendering said processed depth map on a display;

(e) wherein said lens information is used by a displacement modifying function, that results in said processing having a smaller shift of pixels of said two dimensional images for a telephoto lens than a larger shift of pixels of said image for a wide angle lens;

(f) wherein said displacement modifying function models at least said wide angle lens and said telephoto lens.

2. The method of claim 1 where said processing said two dimensional images to determine said depth map is based upon said lens information and said processing said two dimensional images to render said two dimensional images on said display as said three dimensional images is based upon said lens information.