METHOD AND APPARATUS FOR REALISTICALLY REPRODUCING EYEBALL

• US 20120188228A1
• Filed: 11/23/2011
• Published: 07/26/2012
• Est. Priority Date: 11/24/2010
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd., University of Southern California
• Original Assignee: Samsung Electronics Co. Ltd., University of Southern California
• Inventors: Rhee, Seon Min, Kim, Do Kyoon, Ghosh, Abhijeet, RHEE, Tae Hyun, Busch, Jay, Chiang, Jan-Yuan
• Granted Patent: US 9,443,343 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/80 Shading

Abstract

Provided is a method and apparatus for realistically reproducing an eyeball that may verify and analyze a material property and a deformation property with respect to each of constituent portions of an eyeball and may render each of the constituent portions based on the analyzed priorities, thereby more realistically reproducing the eyeball.

Claims

1. A method of realistically reproducing an eyeball, the method comprising:

modeling the eyeball, by way of a processor, to a planar eyeball image;

identifying individual portions of the eyeball from the planar eyeball image; and

rendering each of the individual portions of the eyeball based on at least one of a material property and a deformation property associated with each of the respective portions of the eyeball.

2. The method of claim 1, wherein the identified individual portions of the eyeball comprise a cornea, a sclera, an iris, a pupil, a conjunctiva, and a tear film.

3. The method of claim 2, wherein the rendering comprises:

restoring a texture and a tone constant with respect to the iris; and

optically rendering the iris by employing a multi-layer structure using the texture and the tone constant with respect to the iris.

4. The method of claim 2, wherein the rendering comprises deforming a shape of the pupil based on a position of light entering the pupil, a direction of the light, and an amount of the light.

5. The method of claim 4, wherein the deforming comprises deforming a size of the pupil based on a difference between a normal vector with respect to a surface of the pupil and an incident angle of the light on the surface of the pupil.

6. The method of claim 5, wherein the deforming comprises reducing the size of the pupil when the difference between the normal vector with respect to the surface of the pupil and the incident angle of the light on the surface of the pupil is relatively small, and enlarging the size of the pupil when the difference between the normal vector with respect to the surface of the pupil and the incident angle of the light on the surface of the pupil is relatively great.

7. The method of claim 2, wherein the rendering comprises rendering the cornea by applying a refractive index of a camera ray and a refractive index of a light ray with respect to the cornea.

8. The method of claim 2, wherein the rendering comprises generating a sclera map with respect to a sclera of a target object desired to be reproduced, using multi-view images with respect to the sclera of the target object.

9. The method of claim 8, wherein the generating comprises:

capturing the multi-view images with respect to the sclera of the target object; and

generating the sclera map by stitching the captured multi-view images.

10. The method of claim 8, wherein the rendering comprises reproducing the conjunctiva based on minute blood vessels reproduced on the corneal map, information associated with minute wrinkles within the conjunctiva, and a noise pattern.

11. The method of claim 2, wherein the rendering comprises reproducing the tear film based on a thickness of the tear film and a specular reflectivity of the sclera.

12. A non-transitory computer-readable medium comprising a program for instructing a computer to perform the method of claim 1.

13. An apparatus for realistically reproducing an eyeball, the apparatus comprising:

a processor to control one or more processor-executable modules;

a modeling module to model the eyeball to a planar eyeball image;

an identification module to identify individual portions of the eyeball from the eyeball image; and

a rendering module to render each of the individual portions of the eyeball based on at least one of a material property and a deformation property associated with each of the portions of the eyeball.

14. The apparatus of claim 13, wherein the individual portions of the eyeball identified by the identification module comprise a cornea, a sclera, an iris, a pupil, a conjunctiva, and a tear film.

15. The apparatus of claim 14, wherein the rendering module comprises:

an iris rendering module to restore a texture and a tone constant with respect to the iris, and to optically render the iris by employing a multi-layer structure using the texture and the tone constant with respect to the iris.

16. The apparatus of claim 14, wherein the rendering module comprises:

a pupil deformation unit to deform a shape of the pupil based on a position of light entering the pupil, a direction of the light, and an amount of the light.

17. The apparatus of claim 14, wherein the rendering module comprises:

a cornea rendering unit to render the cornea by applying a refractive index of a camera ray and a refractive index of a light ray with respect to the cornea.

18. The apparatus of claim 14, wherein the rendering module comprises:

a sclera rendering unit to generate a sclera map with respect to a sclera of a target object desired to be reproduced, using multi-view images with respect to the sclera of the target object.

19. The apparatus of claim 18, wherein the rendering module comprises:

a conjunctiva rendering unit to reproduce the conjunctiva based on minute blood vessels reproduced on the corneal map, information associated with minute wrinkles within the conjunctiva, and a noise pattern.

20. The apparatus of claim 14, wherein the rendering module comprises:

a tear film rendering unit to express the tear film based on a thickness of the tear film and a specular reflectivity of the sclera.

21. A method of rendering an eyeball in which each individual component of the eyeball is separately rendered by way of a processor in accordance with unique properties of the individual component.

22. The method of claim 21, wherein the individual components of the eyeball comprise a cornea, a sclera, an iris, a pupil, a conjunctiva, and a tear film.

23. The method of claim 21, wherein the unique properties of the individual component comprise at least one of a material property and a deformation property associated with the individual component.

24. The method of claim 22, wherein the separate rendering of the individual components of the eyeball comprises:

restoring a texture and a tone constant of the iris and optically rendering the iris by employing a multi-layer structure using the texture and the tone constant of the iris;

deforming a shape of the pupil based on a position of light entering the pupil, a direction of the light, and an amount of the light;

rendering the cornea by applying a refractive index of a camera ray and a refractive index of a light ray with respect to the cornea;

generating a sclera map of the sclera using multi-view images of the sclera and using the multi-view images of the sclera map to generate a single combined image of the sclera;

reproducing the conjunctiva based on blood vessels reproduced on a corneal map, information associated with wrinkles within the conjunctiva, and a noise pattern; and

reproducing the tear film based on a thickness of the tear film and a specular reflectivity of the sclera.

25. A non-transitory computer-readable medium comprising a program for instructing a computer to perform the method of claim 21.

26. An apparatus for reproducing an eyeball, the apparatus comprising:

a processor to control one or more processor-executable modules;

an identification module to identify individual components of the eyeball; and

a rendering module to render each individual component of the eyeball separately in accordance with unique properties of the individual component.

27. The apparatus of claim 26, wherein the individual components of the eyeball comprise a cornea, a sclera, an iris, a pupil, a conjunctiva, and a tear film.

28. The apparatus of claim 26, wherein the unique properties of the individual component comprise at least one of a material property and a deformation property associated with the individual component.

29. The apparatus of claim 27, wherein the wherein the rendering module comprises:

an iris rendering module to restore a texture and a tone constant of the iris and optically render the iris by employing a multi-layer structure using the texture and the tone constant of the iris;

a pupil deformation module to deform a shape of the pupil based on a position of light entering the pupil, a direction of the light, and an amount of the light, and rendering the pupil;

a cornea rendering module to render the cornea by applying a refractive index of a camera ray and a refractive index of a light ray with respect to the cornea;

a sclera rendering module to generate a sclera map of the sclera using multi-view images of the sclera and using the multi-view images of the sclera map to generate a single combined image of the sclera;

a conjunctiva rendering module to reproduce the conjunctiva based on blood vessels reproduced on a corneal map, information associated with wrinkles within the conjunctiva, and a noise pattern; and

a tear film rendering module to reproduce the tear film based on a thickness of the tear film and a specular reflectivity of the sclera.