Image processing apparatus, image processing method, and storage medium

• US 8,878,786 B2
• Filed: 01/11/2012
• Issued: 11/04/2014
• Est. Priority Date: 01/27/2011
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Imai, Ayato
• Primary Examiner(s): PARDO, THUY N
• Application Number:
  US13/348,300
• Publication Number:
  US 20120194433A1
• Time in Patent Office: 1,028 Days
• Field of Search: 345/7, 345/158, 345/419, 345/426, 345/427, 345/589, 345/633, 345/157, 345/165, 382/167, 351/206
• US Class Current: 345/158
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: H04N 13/279 the virtual viewpoint locations being selected by the viewers or determined by tracking
• CPC Class Codes: H04N 13/366 using viewer tracking

Abstract

There is provided an image processing apparatus comprising: an input unit configured to input object data including reflection characteristics of an object; an acquisition unit configured to acquire observation position data indicating the observation position of an observer and light source data indicating a surrounding light source around the image capture unit, on the basis of image data captured by the image capture unit; and a generation unit configured to generate image data, which image includes the object placed on the display unit, on the basis of the object data, the observation position data, and the light source data, wherein the image data indicate the image which is observed at the observation position when light from the light source is reflected by the object.

Claims

1. An image processing apparatus that performs processing for an image display apparatus having a display unit and an image capture unit, the image processing apparatus comprising:

an input unit configured to input object data including reflection characteristics of an object;

an acquisition unit configured to acquire observation position data indicating an observation position of an observer to the display unit and light source data indicating a surrounding light source around the display unit, on the basis of image data captured by the image capture unit in real time, wherein the observation position data indicating the observation position of the observer is determined by facial detection; and

a generation unit configured to generate image data, which includes the object placed on the display unit, on the basis of the object data, the observation position data, and the light source data, wherein the image data indicate the image which is observed at the observation position when light from the light source is reflected by the object.

2. The image processing apparatus according to claim 1, wherein the image capture unit is configured to capture image data, and

wherein the display unit is configured to display image data generated by the generation unit.

3. The image processing apparatus according to claim 1, wherein the reflection characteristics include information indicating reflectance corresponding to the incidence angle of light.

4. The image processing apparatus according to claim 1, wherein when a plurality of faces have been detected in the facial detection, observation position data indicating the observation position of the observer is determined on the basis of the largest face.

5. The image processing apparatus according to claim 1, wherein data indicating the surrounding light source includes the direction and intensity value of the light source.

6. The image processing apparatus according to claim 1, wherein the generation unit is further configured to correct the image data so as to cancel out the reflection of incident light at the surface of the display unit.

7. The image processing apparatus according to claim 1, wherein the display unit has been treated with non-glare processing.

8. A storage medium that holds a computer program for having a computer function as various units of the image processing apparatus according to claim 1.

9. An image processing apparatus that performs processing for an image display apparatus having a display unit and an image capture unit, the image processing apparatus comprising:

an input unit configured to input object data including reflection characteristics of an object;

an acquisition unit configured to acquire observation position data indicating an observation position of an observer to the display unit and light source data indicating a surrounding light source around the display unit, on the basis of image data captured by the image capture unit in real time; and

a generation unit configured to generate image data, which includes the object placed on the display unit, on the basis of the object data, the observation position data, and the light source data, wherein the image data indicate the image which is observed at the observation position when light from the light source is reflected by the object, wherein the generation unit is further configured to refer to the reflection characteristics, acquire reflectance corresponding to a direction going from the display unit to the light source and a direction going from the display unit to the observation position, and determine the luminance value of each pixel of the image data according to the intensity of the light source and the reflectance.

10. An image processing method for an image display apparatus having a display unit and an image capture unit, the image processing method comprising:

inputting object data including reflection characteristics of an object;

acquiring observation position data indicating an observation position of an observer to the display unit and light source data indicating a surrounding light source around the display unit, on the basis of image data captured by the image capture unit in real time, wherein the observation position data indicating the observation position of the observer is determined by facial detection; and

generating image data, which includes the object placed on the display unit, on the basis of the object data, the observation position data, and the light source data, wherein the image data indicate the image which is observed at the observation position when light from the light source is reflected by the object.