Information processing apparatus and method

• US 9,508,147 B2
• Filed: 11/12/2012
• Issued: 11/29/2016
• Est. Priority Date: 07/11/2005
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Uchiyama, Shiji, Endo, Takaaki, Aso, Takashi
• Primary Examiner(s): VO, TUNG T
• Application Number:
  US13/674,680
• Publication Number:
  US 20130064454A1
• Time in Patent Office: 1,478 Days
• Field of Search: 348/46, 348/47, 348/49
• US Class Current: 1/1
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/20112 Image segmentation details
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 5/265 Mixing

Abstract

An index detecting section detects an index in a physical space, from a captured image obtained by an imaging apparatus. An erroneous-detection prevention processing section performs erroneous-detection prevention processing, based on information relating to image coordinates of a detected index. An image output section outputs, to a display device, an image having been subjected to the erroneous-detection prevention processing. This prevents an image displayed on the display device from being mistaken for a real index when the display device is in the field of view of the imaging apparatus.

Claims

1. An information processing apparatus comprising:

an image input unit adapted to obtain an input image of a physical space that was captured by an image capturing unit, wherein the input image includes an index to be used in processing for obtaining a position and orientation of the image capturing unit, located in the physical space, and the input image can include a display device, located in the physical space, for displaying an image generated based on the input image;

a detection unit adapted to detect the index included in the input image;

a position and orientation measuring unit adapted to obtain a position and orientation of the image capturing unit based on the index detected by the detection unit;

a generation unit adapted to generate a display image to be displayed on the display device by changing the index in the input image based on a specific image so that an index displayed on the display device is not used in the processing for obtaining the position and orientation of the image capturing unit by the position and orientation measuring unit in a case where the index displayed on the display device is included in an input image; and

an output unit adapted to cause the display device to display the display image generated by the generation unit,

wherein if the index that is changed based on the specific image is displayed on the display device and is included in the input image, the position and orientation measuring unit obtains the position and orientation of the image capturing unit without using the index that is changed based on the specific image.

2. The information processing apparatus according to claim 1, wherein the generation unit changes the index by replacing a part of a region of the index with the specific image.

3. The information processing apparatus according to claim 1, wherein a shape of the index is square.

5. The apparatus according to claim 1, wherein the image capturing unit is attached to a head mounted display.

6. The apparatus according to claim 5, further comprising:

a second generation unit configured to generate a virtual image based on the position and orientation and to generate a synthesized image generated by synthesizing the input image with the generated virtual image, and

a second output unit adapted to cause the head mounted display to display the synthesized image generated by the second generation unit, the head mounted display being separate from the display device.

4. An information processing method comprising:

obtaining an input image of a physical space that was captured by an image capturing unit, wherein the input image includes an index to be used in processing for obtaining a position and orientation of the image capturing unit, located in the physical space, and the input image can include a display device, located in the physical space, for displaying an image generated based on the input image;

detecting the index included in the input image;

obtaining a position and orientation of the image capturing unit based on the index;

generating a display image to be displayed on the display device by changing the index in the input image based on a specific image so that an index displayed on the display device is not used in the processing for obtaining the position and orientation of the image capturing unit in a case where the index displayed on the display device is included in an input image; and

causing the display device to display the generated display image,

where in if the index that is changed based on the specific image is displayed on the display device and is included in the input image, the position and orientation are obtained without using the index that is changed based on the specific image.

7. A non-transitory computer-readable medium storing a program for causing a computer to function as:

an image input unit adapted to obtain an input image of a physical space that was captured by an image capturing unit, wherein the input image includes an index to be used in processing for obtaining a position and orientation of the image capturing unit, located in the physical space, and the input image can include a display device, located in the physical space, for displaying an image generated based on the input image;

a detection unit adapted to detect the index included in the input image;

a position and orientation measuring unit adapted to obtain a position and orientation of the image capturing unit based on the index detected by the detection unit;

a generation unit adapted to generate a display image to be displayed on the display device by changing the index in the input image based on a specific image so that an index displayed on the display device is not used in the processing for obtaining the position and orientation of the image capturing unit by the position and orientation measuring unit in a case where the index displayed on the display device is included in an input image; and

an output unit adapted to cause the display device to display the display image generated by the generation unit,

wherein if the index that is changed based on the specific image is displayed on the display device and is included in the input image, the position and orientation measuring unit obtains the position and orientation of the image capturing unit without using the index that is changed based on the specific image.

8. An information processing apparatus comprising:

an image input unit adapted to obtain an input image of a physical space that was captured by an image capturing unit, wherein the input image includes an index to be used in a processing for obtaining a position and orientation of the image capturing unit, located in the physical space and the input image can include a display device for displaying an image generated based on the input image, located in the physical space;

a detection unit adapted to detect the index included in the input image;

a position and orientation measuring unit adapted to obtain a position and orientation of the image capturing unit based on the index detected by the detection unit;

a generation unit adapted to generate a display image to be displayed on the display device by synthesizing a specific image for invalidating a detected index with the index in the input image; and

an output unit adapted to cause the display device to display the display image generated by the generation unit,

where in if the index with which the specific image is synthesized, displayed on the display device is included in an input image, the position and orientation measuring unit obtains a position and orientation of the image capturing unit without using the index with which the specific image is synthesized.

9. The apparatus according to claim 8,

wherein the generation unit synthesizes the specific image with the index in the input image by overlaying the specific image on a region of the index in the input image.

10. The apparatus according to claim 8, wherein the specific image for invalidating a detected index is synthesized with a region of the index in the input image, the region being for determining a direction of the index.

11. The apparatus according to claim 8, wherein the specific image invalidates the index by making it impossible for the position and orientation measuring unit to determine a direction of the index.

12. The apparatus according to claim 8, wherein the image capturing unit is attached to a head mounted display.