Systems and methods for processing image information

• US 10,114,467 B2
• Filed: 11/30/2016
• Issued: 10/30/2018
• Est. Priority Date: 11/30/2015
• Status: Active Grant

• Current Assignee: Photopotech, LLC
• Original Assignee: Photopotech, LLC
• Inventors: von Cramon, Benjamin
• Primary Examiner(s): Aghevli, Reza
• Application Number:
  US15/365,472
• Publication Number:
  US 20170154463A1
• Time in Patent Office: 699 Days
• Field of Search: None
• CPC Class Codes: G01B 11/24 for measuring contours or curvatures
• CPC Class Codes: G01S 17/89 for mapping or imaging
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/506 Illumination models
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 7/586 from multiple light sources, e.g. photometric stereo

Abstract

Paired images of substantially the same scene are captured with the same freestanding sensor. The paired images include reflected light illuminated with controlled polarization states that are different between the separate images. A first pixel value from one of the first image and the second image is subtracted from a corresponding pixel value from a remaining one of the first image and the second image. When repeated over the raster of corresponding pixels, a modified image includes an isolated representation of substantially pure specular color data. The captured images and the modified image are stored and used to generate a model. Substantially shadow-free diffuse color and specular color data are applied to texture maps of the model to generate a virtual environment where a virtual light source can be introduced and controlled to achieve desired results absent adverse effects introduced from fixed ambient light sources used in conventional source photography.

Claims

1. A method for processing image information, the method comprising:

receiving a first data set representative of a cross-polarized image of a scene, wherein subject matter is illuminated to substantially avoid shadows in the cross-polarized image to provide a diffuse surface texture;

receiving a second data set representative of a co-polarized image of substantially the same scene illuminated to substantially avoid shadows in the co-polarized image; and

performing a difference blend operation with the first data set and the second data set to provide an isolated-specular surface texture,

wherein an image-capture system applies a first illumination power to illuminate the scene in coordination with an exposure that generates the cross-polarized image,

wherein the image-capture system applies a second illumination power different from the first illumination power to illuminate the scene in coordination with a second exposure that generates the co-polarized image,

wherein an elapsed time between separate exposures that generates the cross-polarized image and the co-polarized image is controlled.

2. The method of claim 1, wherein the first data set and the second data set were captured using an image sensor supported by a freestanding chassis and wherein the image sensor is selected from a group responsive to visible light, non-visible light, multi-spectral light, and hyper-spectral light.

3. The method of claim 2, wherein the freestanding chassis is coupled to a vehicle selected from the group consisting of a land-based vehicle, an underwater vehicle, a buoyant vehicle, a lighter than air vehicle and an airborne vehicle.

4. A method for processing image information, the method comprising:

receiving a sensor orientation, the sensor orientation defining a sensor axis;

receiving a data set responsive to a cross-polarized exposure, wherein subject matter captured in the cross-polarized exposure is illuminated with light provided substantially on-axis with the sensor axis to provide a diffuse-surface texture;

using the data set and the sensor orientation to generate a UV map; and

receiving information representative of a surface geometry of the subject matter,

wherein using further includes applying color information from the data set over the surface geometry.

5. The method of claim 4, wherein the data set includes a set of exposures captured from more than one perspective of a scene and wherein members of the set of exposures are used to generate a virtual environment.

6. The method of claim 4, wherein the cross-polarized exposure is captured with an image-capture system that includes a supplemental scanner configured to produce a three-dimensional model of the subject matter.

7. The method of claim 4, wherein the image-capture system is fixed to a freestanding chassis more than three feet from subject matter in the set of exposures.

8. The method of claim 4, wherein the image-capture system is supported by a flexible elongate member selected from the group consisting of a wire, filament, rope, cable, and cord, wherein the image-capture system is more than a few feet from subject matter in the set of exposures.

9. A method for processing image information, the method comprising:

receiving a render mesh responsive to a data set generated from a cross-polarized exposure illuminated to reduce shadows in the cross-polarized exposure, the render mesh including a representation of a surface geometry;

receiving an orientation of a surface texture from the data set;

receiving the surface texture used to generate the representation of the surface geometry;

receiving at least one UV map responsive to the render mesh, the orientation of the surface texture and the surface texture used to generate the representation of the surface geometry;

generating a virtual environment from the render mesh and the at least one projection map;

receiving a preferred orientation; and

modifying the virtual environment in response to the preferred orientation.

10. The method of claim 9, wherein the cross-polarized exposure is captured with a sensor responsive to one or more of light visible by a human observer, invisible to a human, multi-spectral light, and hyper-spectral light.

11. The method of claim 9, wherein the cross-polarized exposure is captured with an image-capture system that includes a supplemental scanner and wherein the render mesh is generated by the supplemental scanner.

12. The method of claim 9, further comprising:

receiving information characterizing a virtual light source; and

modifying the virtual environment in response to the virtual light source and the preferred orientation.

13. The method of claim 12, wherein information characterizing the virtual light source includes one or more of identifying a location, a luminous flux, and a frequency range.

14. The method of claim 9, wherein the virtual environment is used in a product selected from the group consisting of an exhibit, video game, cinematic production, and a teaching aide.