IMAGE RECONSTRUCTION

• US 20110028183A1
• Filed: 04/10/2008
• Published: 02/03/2011
• Est. Priority Date: 04/10/2008
• Status: Active Grant

• Current Assignee: Hankuk University of Foreign Studies Research and Industry-University Cooperation Foundation
• Original Assignee: Hankuk University of Foreign Studies Research and Industry-University Cooperation Foundation
• Inventors: Yun, Il Dong
• Granted Patent: US 8,537,229 B2
• Time in Patent Office: Days
• US Class Current: 455/556.1
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/586 from multiple light sources, e.g. photometric stereo
• CPC Class Codes: G06T 7/593 from stereo images

Abstract

Techniques for reconstructing an image of an object are provided. In some embodiments, an image reconstructing system includes one or more cameras, one or more light sources and an image processor. The cameras are configured to capture images of an object and the light sources are configured to irradiate the object. The image processor is configured to process the images to generate a first representation of the object and a second representation of the object, and to generate a reconstructed image of the object based on the first representation and the second representation.

Claims

1. An image reconstructing system comprising:

one or more cameras configured to capture images of an object;

one or more light sources configured to irradiate the object; and

an image processor configured to process the images to generate a first representation of the object and a second representation of the object, and to generate a reconstructed image of the object based on the first representation and the second representation.

2. The image reconstructing system of claim 1, further comprising a display configured to display the reconstructed image.

3. The image reconstructing system of claim 1, wherein the one or more cameras are configured to capture a first and a second image of the object in a first and a second camera position respectively, with the object being irradiated with a first setting of the one or more light sources.

4. The image reconstructing system of claim 3, wherein the one or more cameras are configured to capture a third and a fourth image of the object in a first and a second camera position respectively, with the object being irradiated with a second setting of the one or more light sources.

5. The image reconstructing system of claim 4, wherein the image processor includes a first processing unit configured to generate the first representation of the object based on the first and the second images.

6. The image reconstructing system of claim 5, wherein the image processor includes a second processing unit configured to generate the second representation of the object based on the first and the third images.

7. The image reconstructing system of claim 6, wherein the first processing unit is further configured to generate a third representation of the object based on the third and the fourth images, and to calculate a first reliability level based on the first and the third image and the first and the third representation.

8. The image reconstructing system of claim 7, wherein the second processing unit is further configured to calculate a second reliability level based on the first image and the second representation.

9. The image reconstructing system of claim 8, wherein the image processor includes an image reconstructing unit configured to generate the reconstructed image by using the first and the second representation and the first and the second reliability level.

10. The image reconstructing system of claim 9, wherein the image reconstructing unit performs a weighted least square minimization to the first and the second representation by using the first and the second reliability level as weights.

11. The image reconstructing system of claim 5, wherein the first processing unit performs a geometric stereo method to generate the first representation.

12. The image reconstructing system of claim 6, wherein the second processing unit performs a photometric stereo method to generate the second representation.

13. The image reconstructing system of claim 1, wherein the reconstructing system is a portable device.

14. The image reconstructing system of claim 13, wherein the reconstructing system is a cellular phone.

15. An image processor comprising:

a first processing unit configured to generate a first representation of an object based on a first set of two or more images of an object irradiated by a first setting of one or more light sources, each image captured by one or more cameras in a different camera position;

a second processing unit configured to generate a second representation of the object based on a second set of two or more images of the object, each image captured by the one or more cameras at a predetermined position by irradiating the object by a different setting of the one or more light sources; and

an image reconstructing unit configured to generate a reconstructed image based on the first and the second representation.

16. The image processor of claim 15, wherein the first processing unit is further configured to generate a third representation of the object based on a third set of two or more images of the object irradiated by a second setting of one or more light sources, each image captured by one or more cameras in a different camera position.

17. The image processor of claim 16, wherein the first processing unit calculates a first reliability level based on two images of the object irradiated by the one or more light sources having the first and the second setting, respectively and the first and the third representation.

18. The image processor of claim 15, wherein the second processing unit calculates a second reliability level based on the second representation and one of the images in the second set.

19. The image processor of claim 18, wherein the image reconstructing unit configured to generate the reconstructed image by using the first and the second reliability level.

20. The image processor of claim 19, wherein the image reconstructing unit performs a weighted least square minimization to the first and the second representation by using the first and the second reliability level as weights.

21. The image processor of claim 15, wherein the first processing unit performs a geometric stereo method to generate the first representation.

22. The image processor of claim 15, wherein the second processing unit performs a photometric stereo method to generate the second representation.

23. The image processor of claim 15, wherein the image processor is embedded in a portable device.

24. An image reconstructing method comprising:

capturing images of an object by using one or more cameras, the object irradiated by two or more settings of one or more light sources;

processing the images to generate a first representation of the object, and a second representation of the object; and

generating a reconstructed image of the object based on the first representation and the second representation.

25. The image reconstructing method of claim 24, further comprising displaying the reconstructed image.

26. The image reconstructing method of claim 24, wherein capturing images includes capturing a first and a second image of the object respectively irradiated with a first setting of the one or more light sources, each of the first and the second image captured by the one or more cameras in a first and a second position.

27. The image reconstructing method of claim 26, wherein capturing images further includes capturing a third and a fourth image of the object respectively irradiated with a second setting of the one or more light sources, each of the third and the fourth image taken by the one or more cameras in the first and the second position.

28. The image reconstructing method of claim 27, wherein processing the image includes generating the first representation based on the first and the second image, and generating the second representation based on the first and the third image.

29. The image reconstructing method of claim 28, wherein processing the image further includes generating a third representation based on the third and the fourth image.

30. The image reconstructing method of claim 29, wherein processing the image further includes calculating a first reliability level based on the first and the third representation and the first and the third image.

31. The image reconstructing method of claim 30, wherein processing the image further includes calculating a second reliability level based on the second representation and the first image.

32. The image reconstructing method of claim 31, wherein generating the reconstructed image includes generating the reconstructed image by using the first and the second reliability level.

33. The image reconstructing method of claim 32, wherein generating the reconstructed image includes performing a weighted least square minimization to the first and the second representation by using the first and the second reliability level as weights.

34. The image reconstructing method of claim 24, wherein processing images includes applying a geometric stereo method to generate the first representation of the object, and applying a photometric stereo method to generate the second representation of the object.

35. A computer-readable storage medium having stored thereon computer instructions that when executed by a computer cause the computer to perform a method for reconstructing an image, the method comprising:

capturing images of an object irradiated by two or more settings of one or more light sources by using one or more cameras;

processing the images to generate a first representation of the object, and a second representation of the object; and

generating a reconstructed image of the object based on the first representation and the second representation.

36. The computer-readable storage medium of claim 35, the method further comprises displaying the reconstructed image.

37. The computer-readable storage medium of claim 35, wherein capturing images includes capturing a first and a second image of the object respectively irradiated with a first setting of the one or more light sources, each of the first and the second image captured by the one or more cameras in a first and a second position.

38. The computer-readable storage medium of claim 37, wherein capturing images further includes capturing a third and a fourth image of the object respectively irradiated with a second setting of the one or more light sources, each of the third and the fourth image taken by the one or more cameras in the first and the second position.

39. The computer-readable storage medium of claim 38, wherein processing the image includes generating the first representation based on the first and the second image, and generating the second representation based on the first and the third image.

40. The computer-readable storage medium of claim 39, wherein processing the image further includes generating a third representation based on the third and the fourth image.

41. The computer-readable storage medium of claim 35, wherein processing images includes applying a geometric stereo method to generate the first representation of the object, and applying a photometric stereo method to generate the second representation of the object.