METHOD AND APPARATUS FOR OBTAINING GEOMETRY INFORMATION, LIGHTING INFORMATION AND MATERIAL INFORMATION IN IMAGE MODELING SYSTEM

• US 20130063562A1
• Filed: 04/10/2012
• Published: 03/14/2013
• Est. Priority Date: 09/09/2011
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: SHIM, Hyun Jung, Kim, Do Kyoon, Lee, Seung Kyu
• Application Number:
  US13/443,158
• Publication Number:
  US 20130063562A1
• Time in Patent Office: Days
• US Class Current: 348/46
• CPC Class Codes: G01B 11/2509 Color coding
• CPC Class Codes: G01B 11/2513 with several lines being projected in more than one direction, e.g. grids, patterns
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/254 in combination with electromagnetic radiation sources for illuminating objects
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388

Abstract

A method and apparatus for obtaining geometry information, material information, and lighting information in an image modeling system are provided. Geometry information, material information, and lighting information of an object may be extracted from a single-view image captured in a predetermined light condition, by applying pixel values defined by a geometry function, a material function, and a lighting function.

Claims

1. An apparatus for obtaining geometry information, the apparatus comprising:

a processor to control one or more processor-executable units;

an optical image receiving unit to receive an image of an object receiving a plurality of pattern lights;

a frequency verifying unit to verify, from the image, a plurality of frequency bands respectively corresponding to each of the plurality of pattern lights;

a code set assigning unit to assign a plurality of code values based on at least one reflected light corresponding to each of the plurality of frequency bands, the plurality of code values being used to distinguish surface points of the object; and

a surface point acquiring unit to distinguish the surface points of the object based on the plurality of code values.

2. The apparatus of claim 1, wherein the optical image receiving unit receives reflected lights corresponding to the plurality of pattern lights that are respectively assigned to each of the plurality of frequency bands.

3. The apparatus of claim 2, wherein the reflected lights are reflected from a surface of the object receiving the plurality of pattern lights.

4. The apparatus of claim 1, further comprising:

a geometry information extracting unit to obtain geometry information of the object using the surface points.

5. The apparatus of claim 1, wherein the code set assigning unit assigns a first code value to an area in which a light reflected from a surface of the object exists, and assigns a second code value to an area in which the reflected light does not exist, among the plurality of code values.

6. A system for obtaining geometry information, the system comprising:

a light emitting unit to emit a plurality of pattern lights to an object, each of the plurality of pattern lights being respectively assigned to one of a plurality of frequency bands;

a camera unit to capture the object receiving the pattern lights emitted from the light emitting unit; and

a geometry information obtaining unit to assign a plurality of code values based on at least one reflected light corresponding to each of the pattern lights, to distinguish surface points of the object based on the plurality of code values, and to obtain geometry information of the object using the surface points, the plurality of code values being used to distinguish the surface points.

7. An apparatus for obtaining material information and lighting information, the apparatus comprising:

a processor to control one or more processor-executable units;

an optical image receiving unit to receive an image of an object, the object receiving at least one of pattern lights, a straight light, and a natural light, the pattern lights being emitted from a first lighting emitting unit, and the straight light being emitted from a second lighting emitting unit; and

a computation unit to compute at least one of a material function, an emitted lighting function, and a natural lighting function, based on the image received by the optical image receiving unit.

8. The apparatus of claim 7, wherein the optical image receiving unit comprises:

a pattern light image receiver to receive an image of an object receiving a plurality of pattern lights;

a straight light image receiver to receive an image of an object receiving a straight light; and

a natural light image receiver to receive an image of an object receiving a natural light when the pattern lights and the straight light do not exist;

9. The apparatus of claim 7, wherein a pixel value i_a of an image of an object that receives the plurality of pattern lights, a pixel value i_b of an image of an object that receives the straight light, and a pixel value i_c of an image of an object that receives the natural light are defined by the following equations:

10. The apparatus of claim 9, wherein the computation unit computes a material function, and emitted lighting functions, using the following equations:

11. The apparatus of claim 10, wherein the computation unit computes a natural lighting function, using the computed material function, the computed emitted lighting functions, and the following equation:

12. A system for obtaining material information and lighting information, the system comprising:

a first light emitting unit to emit a plurality of pattern lights to an object, the plurality of pattern lights being respectively assigned to a plurality of frequency bands;

a second light emitting unit to emit a straight light to the object, the straight light being assigned to a frequency band other than the plurality of frequency bands;

a camera unit to capture an image of the object receiving lights emitted from the first light emitting unit and the second light emitting unit, or to capture an image of the object receiving a natural light other than the lights emitted from the first light emitting unit and the second light emitting unit; and

a computation unit to compute at least one of a material function, emitted lighting functions, and a natural lighting function, based on the captured images.

13. A method of obtaining geometry information, the method comprising:

receiving an image of an object receiving a plurality of pattern lights;

verifying, from the image, a plurality of frequency bands respectively corresponding to each of the plurality of pattern lights;

assigning, by way of a processor, a plurality of code values based on at least one reflected light corresponding to each of the plurality of frequency bands, the plurality of code values being used to distinguish surface points of the object; and

distinguishing the surface points of the object based on the plurality of code values.

14. The method of claim 13, wherein the image is associated with reflected lights corresponding to the plurality of pattern lights emitted toward the object and reflected from a surface of the object.

15. The method of claim 13, further comprising obtaining geometry information of the object using the surface points.

16. The method of claim 13, wherein the assigning comprises:

assigning a first code value to an area in which a light reflected from a surface of the object exists; and

assigning a second code value to an area in which the reflected light does not exist, among the plurality of code values.

17. A non-transitory computer-readable storage medium storing computer readable code comprising a program for implementing the method of claim 13.

18. A method of obtaining material information and lighting information, the method comprising:

receiving an image of an object, the Object receiving at least one of pattern lights, a straight light, and a natural light, the pattern lights being emitted from a first lighting emitting unit, and the straight light being emitted from a second lighting emitting unit; and

computing, by way of a processor, at least one of a material function, an emitted lighting function, and a natural lighting function, based on the received image.

19. The method of claim 18, wherein a pixel value i_a of an image of an object that receives the plurality of pattern lights, a pixel value i_b of an image of an object that receives the straight light, and a pixel value i_c of an image of an object that receives the natural light are defined by the following equations:

20. The method of claim 19, wherein the computing comprises:

computing the functions (θ

,φ

) and s′

(θ

,φ

), using a difference between the pixel values i_a and i_c, and a difference between the pixel values i_b and i_c; and

computing the function ƒ

(θ

,φ

), using the computed functions s(θ

,φ

) and s′

(θ

,φ

).

21. The method of claim 19, wherein the computing comprises:

computing the functions s(θ

,φ

) and s′

(θ

,φ

), a difference between the pixel values i_a and i_c, and a difference between the pixel values i_b and i_c;

computing the function ƒ

(θ

,φ

), using the computed functions s(θ

,φ

) and s′

(θ

,φ

); and

computing the function l(θ

,φ

), using the computed function ƒ

(θ

,φ

), and the following equation;

22. A non-transitory computer-readable storage medium storing computer readable code comprising a program for implementing the method of claim 18.

23. A method of obtaining material information, the method comprising:

receiving an image of an object, the object receiving at least one of pattern lights, a straight light, and a natural light, the pattern lights being emitted from a first lighting emitting unit, and the straight light being emitted from a second lighting emitting unit; and

computing, by way of a processor, a material function, using pixel values of pixels of the received image, the pixel values being defined by a material function, an emitted lighting function, and a natural lighting function,

wherein the computing comprises;

computing emitted lighting functions, using a difference between a pixel value i_a of an image of an object that receives a plurality of pattern lights and a pixel value l_c of an image of an object that receives a natural light, and a difference between the pixel value i_c and a pixel value i_b of an image of an object that receives a straight light; and

computing the material function, using the computed emitted lighting functions.

24. A non-transitory computer-readable storage medium storing computer readable code comprising a program for implementing the method of claim 23.

25. A method of obtaining lighting information, the method comprising:

receiving an image of an object, the object receiving at least one of pattern lights, a straight light, and a natural light, the pattern lights being emitted from a first lighting emitting unit, and the straight light being emitted from a second lighting emitting unit; and

computing, by way of a processor, a lighting function, using pixel values of pixels of the received image, the pixel values being defined by a material function, an emitted lighting function, and a natural lighting function,

wherein the computing comprises;

computing emitted lighting functions, using a difference between a pixel value i_a of an image of an object that receives a plurality of pattern lights and a pixel value i_c of an image of an object that receives a natural light, and a difference between the pixel value i_c and a pixel value i_b of an image of an object that receives a straight light;

computing a material function, using the computed emitted lighting functions; and

computing a natural lighting function, using the material function, and the following equation;

26. A non-transitory computer-readable storage medium storing computer readable code comprising a program for implementing the method of claim 25.

27. An apparatus obtaining geometry information, the apparatus comprising:

a processor to control one or more processor-executable units;

an optical image receiving unit to receive an image of an object illuminated by a plurality of pattern lights emitted by a plurality of light emitting units;

a frequency verifying unit to verify, from the image, a plurality of frequency bands respectively corresponding to each of the plurality of pattern lights; and

a code set assigning unit to assign a plurality of code values based on at least one reflected light corresponding to each of the plurality of frequency bands, the plurality of code values being used to distinguish surface points of the object.

28. A method of obtaining geometry information, the method comprising:

receiving an image of an object illuminated by a plurality of pattern lights, wherein a different pattern light is respectively assigned to each of a plurality frequency bands;

verifying, from the image, the pattern lights respectively assigned to the frequency bands and classifying the frequency bands based on the pattern lights; and

assigning, by way of a processor, a plurality of code values based on at least one reflected light corresponding to each of the plurality of frequency bands, the plurality of code values being used to distinguish surface points of the object.

29. A non-transitory computer-readable storage medium storing computer readable code comprising a program for implementing the method of claim 28.