Image processing apparatus, control method thereof, and program

• US 7,764,293 B2
• Filed: 03/30/2007
• Issued: 07/27/2010
• Est. Priority Date: 04/06/2006
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Kakuta, Hiroyuki, Ohshima, Toshikazu
• Primary Examiner(s): GOOD JOHNSON, MOTILEWA
• Application Number:
  US11/693,881
• Publication Number:
  US 20070236510A1
• Time in Patent Office: 1,215 Days
• Field of Search: 345/629, 345/619, 345/633
• US Class Current: 345/619
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

An acquired real image undergoes conversion based on a first parameter to generate an image corresponding to a designated characteristic. A virtual image is generated on the basis of a second parameter to generate an image corresponding to a designated characteristic. The converted real image is composited with the generated virtual image. The composite image is displayed.

Claims

1. An image processing apparatus for simulating an eyesight of vision disorder which generates a composite image of a real image and a virtual image, comprising:

a storage unit adapted to store a first parameter and a second parameter to generate an image corresponding to an eyesight characteristic of vision disorder;

an acquisition unit adapted to acquire a real image;

a conversion unit adapted to convert the real image acquired by the acquisition unit into a real image simulating the eyesight of the vision disorder on the basis of the first parameter;

a generation means unit adapted to generate a virtual image simulating the eyesight of the vision disorder on the basis of the second parameter, the virtual image corresponding three dimensional model data;

a composition unit adapted to generate a composite image of the real image converted by the conversion unit and the virtual image generated by the generation unit; and

a display unit adapted to display the composite image by the composition unit.

2. The apparatus according to claim 1, further comprising image capturing unit for capturing an image,

wherein the acquisition unit acquires, as the real image, the image captured by the image capturing unit.

3. The apparatus according to claim 2, wherein

the storage unit further stores a third parameter corresponding to the an eyesight characteristic of the vision disorder, and

the image capturing unit captures the image on the basis of the third parameter.

4. The apparatus according to claim 1, wherein the storage unit includes a first storage unit to store the first parameter, and a second storage unit to store the second parameter.

5. The apparatus according to claim 4, further comprising a first case and a second case,

wherein the first case includes the acquisition unit, the conversion unit, and the first storage unit, and

the second case includes the generation unit, the composition unit, the display unit, and the second storage unit.

6. The apparatus according to claim 1, wherein the eyesight characteristic of the vision disorder includes low vision characteristic or defective color vision characteristic.

7. The apparatus according to claim 1, wherein the second parameter stored in the storage unit is generated on the basis of the image acquired by the acquisition unit.

8. A control method implemented by an image processing apparatus for simulating, an eyesight of vision disorder, the control method causing the image processing apparatus to generate a composite image of a real image and a virtual image, comprising steps of:

acquiring a real image;

converting the real image acquired in the acquiring step into a real image simulating the eyesight of the vision disorder on the basis of a first parameter that is stored in a storage unit of said image processing apparatus to generate an image corresponding to an eyesight characteristic of the vision disorder;

generating a virtual image simulating the eyesight of the vision disorder on the basis of a second parameter that is stored in the storage unit to generate an image corresponding to an eyesight characteristic of the vision disorder, the virtual image corresponding on the basis of three dimensional model data;

generating a composite image of the real image converted in the converting step and the virtual image generated in the generating step; and

displaying on a display device a composite image composited in the compositing step.

9. A non-transitory computer-readable storage medium having stored therein a computer program, executable by a computer, the computer program causing the computer to control an image processing apparatus for simulating an eyesight of vision disorder which generates a composite image of a real image and a virtual image, the computer program causing the computer to execute steps of:

acquiring a real image;

converting the real image acquired in the acquiring step into a real image simulating the eyesight of the vision disorder on the basis of a first parameter that is stored in a storage unit of said computer to generate an image corresponding to an eyesight characteristic of the vision disorder;

generating a virtual image simulating the eyesight of the vision disorder on the basis of a second parameter that is stored in the storage unit to generate an image corresponding to an eyesight characteristic of the vision disorder, the virtual image corresponding three dimensional model data;

generating a composite image of the real image converted in the converting step and the virtual image generated in the generating step; and

displaying on a display device a composite image composited in the compositing step.