Image processing apparatus and method
First Claim
Patent Images
1. An image processing apparatus, comprising:
- a light capturing camera device configured to generate light environment information by capturing a light environment of an object;
an object capturing camera device configured to generate object information by capturing the object;
a processor; and
a modeler implemented by the processor and configured to generate a 3-dimensional (3D) model by combining the light environment information and the object information,wherein the light environment information comprises a direction of a first light source included in the light environment, a distance between the first light source and the image processing apparatus, and information of indirect lightings of a second light source,wherein the indirect lightings is reflected light emitted from the second light source,wherein the object information comprises a depth image of the object, a color image of the object, and a distance between the object and the image processing apparatus,wherein a field of view of the light capturing device does not overlap with most of a field of view of the object capturing device,wherein the field of view of the light capturing device is stationary with respect to the field of view of the object capturing device,wherein the modeler is configured to generate the 3D model by reflecting a part of the light environment information or by adding a virtual lighting,wherein the processor is configured to;
render, in response to input of a virtual object being determined as absent, with respect to the 3D model, andcomposite, in response to the virtual object being input, by matching the object information with an existing 3D model prior to rendering, andwherein a real space is constructed into the 3D model by real photographing and the virtual object is input separately from the 3D model.
1 Assignment
0 Petitions
Accused Products
Abstract
An image processing apparatus may include a light capturing unit to generate light environment information by photographing or capturing a light environment of an object, and an object capturing unit to generate object information by photographing or capturing the object. The image processing apparatus may further include a modeling unit to generate a 3-dimensional (3D) model by reflecting or combining the light environment information and the object information, and a rendering unit to render a resultant image with respect to at least one view using the 3D model.
14 Citations
16 Claims
-
1. An image processing apparatus, comprising:
-
a light capturing camera device configured to generate light environment information by capturing a light environment of an object; an object capturing camera device configured to generate object information by capturing the object; a processor; and a modeler implemented by the processor and configured to generate a 3-dimensional (3D) model by combining the light environment information and the object information, wherein the light environment information comprises a direction of a first light source included in the light environment, a distance between the first light source and the image processing apparatus, and information of indirect lightings of a second light source, wherein the indirect lightings is reflected light emitted from the second light source, wherein the object information comprises a depth image of the object, a color image of the object, and a distance between the object and the image processing apparatus, wherein a field of view of the light capturing device does not overlap with most of a field of view of the object capturing device, wherein the field of view of the light capturing device is stationary with respect to the field of view of the object capturing device, wherein the modeler is configured to generate the 3D model by reflecting a part of the light environment information or by adding a virtual lighting, wherein the processor is configured to; render, in response to input of a virtual object being determined as absent, with respect to the 3D model, and composite, in response to the virtual object being input, by matching the object information with an existing 3D model prior to rendering, and wherein a real space is constructed into the 3D model by real photographing and the virtual object is input separately from the 3D model. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. An image processing apparatus, comprising:
-
a light capturing camera device configured to generate light environment information by capturing a light environment of an object; an object capturing camera device configured to generate a color image and a depth image by capturing the object; a processor; a modeler implemented by the processor and configured to generate a 3-dimensional (3D) model by combining the light environment information and at least one object information; and a renderer implemented by the processor and configured to render at least one virtual object with the object, using the light environment information, the color image, the depth image, and the at least one object information, wherein the light capturing camera device is configured to generate the light environment information comprising a direction of a first light source included in the light environment, a distance between the first light source and the image processing apparatus, and information of indirect lightings of a second light source, wherein the indirect lightings is reflected light emitted from the second light source, wherein the object information comprises a depth image of the object, a color image of the object, and a distance between the object and the image processing apparatus, wherein a field of view of the light capturing device does not overlap with most of a field of view of the object capturing device, wherein the field of view of the light capturing device is stationary with respect to the field of view of the object capturing device, wherein the modeler is configured to generate the 3D model by reflecting a part of the light environment information or by adding a virtual lighting, wherein the processor is configured to; render, in response to input of a virtual object being determined as absent, with respect to the 3D model, and composite, in response to the virtual object being input, by matching the object information with an existing 3D model prior to rendering, and wherein a real space is constructed into the 3D model by real photographing and the virtual object is input separately from the 3D model.
-
-
10. An image processing method, comprising:
-
generating light environment information by capturing a light environment of an object by a light capturing device of an image processing apparatus; generating object information by capturing the object by an object capturing device of the image processing apparatus; generating a 3-dimensional (3D) model related to the object by combining the light environment information and the object information by a modeler of the image processing apparatus; rendering, in response to input of a virtual object being determined as absent, with respect to the 3D model; and compositing, in response to the virtual object being input, by matching the object information with an existing 3D model prior to rendering, wherein the light capturing device comprises at least one camera, and is configured to generate the light environment information comprising a direction of a first light source included in the light environment, a distance between the first light source and the image processing apparatus, and information of indirect lightings of a second light source, wherein the indirect lightings is reflected light emitted from the second light source, wherein the object information comprises a depth image of the object, a color image of the object, and a distance between the object and the image processing apparatus, wherein a field of view of the light capturing device does not overlap with most of a field of view of the object capturing device, wherein the field of view of the light capturing device is stationary with respect to the field of view of the object capturing device, wherein the generating the 3D model related to the object includes generating the 3D model by reflecting a part of the light environment information or by adding a virtual lighting, and wherein a real space is constructed into the 3D model by real photographing and the virtual object is input separately from the 3D model. - View Dependent Claims (11, 12, 13, 14, 15)
-
-
16. An image processing method, comprising:
-
generating light environment information by capturing a light environment of an object by a light capturing device of an image processing apparatus; generating a color image and a depth image by capturing the object by an object capturing device of the image processing apparatus; rendering at least one virtual object with the object, using the light environment information, the color image, the depth image, and at least one object information; rendering, in response to input of the at least one virtual object being determined as absent, with respect to a 3D model; and compositing, in response to the at least one virtual object being input, by matching the at least one object information with an existing 3D model prior to rendering, wherein the light capturing device comprises at least one camera, and is configured to generate the light environment information comprising a direction of a first light source included in the light environment, a distance between the first light source and the image processing apparatus, and information of indirect lightings of a second light source, wherein the object information comprises the depth image of the object, the color image of the object, and a distance between the object and the image processing apparatus, wherein the field of view of the light capturing device is stationary with respect to the field of view of the object capturing device, wherein a field of view of the light capturing device does not overlap with most of a field of view of the object capturing device, and wherein a real space is constructed into the 3D model by real photographing and the virtual object is input separately from the 3D model.
-
Specification