Information processing apparatus and method

• US 10,140,723 B2
• Filed: 09/29/2016
• Issued: 11/27/2018
• Est. Priority Date: 07/11/2005
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Endo, Takaaki, Uchiyama, Shinji, Aso, Takashi
• Primary Examiner(s): Vo, Tung T
• Application Number:
  US15/280,872
• Publication Number:
  US 20170018072A1
• Time in Patent Office: 789 Days
• Field of Search: 348 46, 348 47, 348 49
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/20112 Image segmentation details
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 5/265 Mixing

Abstract

An index detecting section detects an index in a physical space, from a captured image obtained by an imaging apparatus. An erroneous-detection prevention processing section performs erroneous-detection prevention processing, based on information relating to image coordinates of a detected index. An image output section outputs, to a display device, an image having been subjected to the erroneous-detection prevention processing. This prevents an image displayed on the display device from being mistaken for a real index when the display device is in the field of view of the imaging apparatus.

Claims

1. An apparatus comprising:

an image input unit configured to obtain an input image of a physical space that was captured by an image capturing unit, wherein the image includes an index to be used in processing for obtaining the position and the orientation of the image capturing unit, located in the physical space and the image can include a display device for displaying an image generated based on the input image, located in the physical space;

an estimation unit configured to estimate a region including the display device in the input image based on a position of the display device in the physical space, wherein the position of the display device in the physical space is known;

a detection unit configured to detect, from the input image, the index included in the input image; and

a position and orientation measuring unit configured to obtain a position and an orientation of the image capturing unit based on the index detected from a region other than the estimated region including the display device in the input image, wherein the index in the estimated region including the display device is not used in processing for obtaining the position and the orientation of the image capturing unit.

2. The information processing apparatus according to claim 1, wherein a shape of the detected index in the physical space is rectangular.

3. The information processing apparatus according to claim 1, wherein the index includes image features within a region that are used for direction determination of the index.

4. The apparatus according to claim 1, wherein the image capturing unit is attached to a head mounted display which is different from the display device.

5. The apparatus according to claim 1, wherein the estimation unit estimates the region including the display device in the input image based on the position of the display device in the physical space and a model representing a shape of the display device.

6. A method comprising:

obtaining an input image of a physical space that was captured by an image capturing unit, wherein the image includes an index to be used in processing for obtaining the position and the orientation of the image capturing unit, located in the physical space and the image can include a display device for displaying an image generated based on the input image, located in the physical space;

estimating a region including the display device in the input image based on a position of the display device in the physical space, wherein the position of the display device in the physical space is known;

detecting, from the input image, the index included in the input image; and

obtaining a position and an orientation of the image capturing unit based on the index detected from a region other than the specified region in the input image, wherein the index in the specified region is not used in processing for obtaining the position and the orientation of the image capturing unit.

7. A non-transitory computer-readable medium storing a program for causing a computer to function as:

an image input unit configured to obtain an input image of a physical space that was captured by an image capturing unit, wherein the image includes an index to be used in processing for obtaining the position and the orientation of the image capturing unit, located in the physical space and the image can include a display device for displaying an image generated based on the input image, located in the physical space;

an estimation unit configured to estimate a region including the display device in the input image based on a position of the display device in the physical space, wherein the position of the display device in the physical space is known;

a detection unit configured to detect, from the input image, the index included in the input image; and

a position and orientation measuring unit configured to obtain a position and an orientation of the image capturing unit based on the index detected from a region other than the estimated region including the display device in the input image, wherein the index in the estimated region including the display device is not used in processing for obtaining the position and the orientation of the image capturing unit.