Image processing device, image processing method and program
First Claim
1. An image processing device, comprising:
- circuitry configured tostore feature data indicating a feature of appearance of an object,generate an environment map representing a position of one or more objects existing in a real space based on an input image obtained by imaging the real space using an imaging device and on the stored feature data, andgenerate an output image by erasing an erasing target object from the input image based on a position of the erasing target object being one of the one or more objects existing in the real space recorded in the input image and represented in the environment map, and based on a position of the imaging device,wherein the erasing target object is an object recorded by the imaging device in the imaging of the real space at a time of the imaging of the real space, andwherein the circuitry is further configured toestimate a position of a floor surface or a wall surface in the real space based on a position of a point on a surface of an object other than the erasing target object represented by the environment map, andgenerate a CG image based on the position of the floor surface or the wall surface in the estimated real space.
1 Assignment
0 Petitions
Accused Products
Abstract
There is provided an image processing device, including: a data storage unit storing feature data indicating a feature of appearance of an object; an environment map generating unit for generating an environment map representing a position of one or more objects existing in a real space based on an input image obtained by imaging the real space using an imaging device and the feature data stored in the data storage unit; and an output image generating unit for generating an output image obtained by erasing an erasing target object from the input image based on a position of the erasing target object specified out of objects present in the input image represented in the environment map and a position of the imaging device.
28 Citations
12 Claims
-
1. An image processing device, comprising:
-
circuitry configured to store feature data indicating a feature of appearance of an object, generate an environment map representing a position of one or more objects existing in a real space based on an input image obtained by imaging the real space using an imaging device and on the stored feature data, and generate an output image by erasing an erasing target object from the input image based on a position of the erasing target object being one of the one or more objects existing in the real space recorded in the input image and represented in the environment map, and based on a position of the imaging device, wherein the erasing target object is an object recorded by the imaging device in the imaging of the real space at a time of the imaging of the real space, and wherein the circuitry is further configured to estimate a position of a floor surface or a wall surface in the real space based on a position of a point on a surface of an object other than the erasing target object represented by the environment map, and generate a CG image based on the position of the floor surface or the wall surface in the estimated real space. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. An image processing method performed using an image processing device having a memory storing feature data indicating a feature of appearance of an object, the method comprising steps of:
-
generating an environment map representing a position of one or more objects existing in a real space based on an input image obtained by imaging the real space using an imaging device and on the feature data stored in the memory; generating an output image obtained by erasing an erasing target object from the input image based on a position in the environment map of the erasing target object being one of the one or more objects existing in the real space recorded in the input image, and based on a position of the imaging device, the erasing target object being an object recorded by the imaging device in the imaging of the real space at a time of the imaging of the real space; estimating a position of a floor surface or a wall surface in the real space based on a position of a point on a surface of an object other than the erasing target object represented by the environment map; and generating a CG image based on the position of the floor surface or the wall surface in the estimated real space.
-
-
12. A non-transitory computer readable medium having stored thereon a program that when executed by a computer causes the computer to perform a method, the method comprising:
-
storing feature data indicating a feature of appearance of an object; generating unit for generating an environment map representing a position of one or more objects existing in a real space based on an input image obtained by imaging the real space using an imaging device and on the feature data stored; generating an output image obtained by erasing an erasing target object from the input image based on a position of the erasing target object being one of the one or more objects existing in the real space recorded in the input image represented in the environment map, and based on a position of the imaging device, the erasing target object being an object recorded by the imaging device in the imaging of the real space at a time of the imaging of the real space; estimating a position of a floor surface or a wall surface in the real space based on a position of a point on a surface of an object other than the erasing target object represented by the environment map; and generating a CG image based on the position of the floor surface or the wall surface in the estimated real space.
-
Specification