INFORMATION PROCESSING APPARATUS, CONTROL METHOD OF THE INFORMATION PROCESSING APPARATUS, AND STORAGE MEDIUM

• US 20150071493A1
• Filed: 08/29/2014
• Published: 03/12/2015
• Est. Priority Date: 09/11/2013
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Kenichi Ozawa, Takayuki Saitoh, Yasuhiro Kajiwara
• Inventors: SADASUE, Tamon, OZAWA, Kenichi, SAITOH, Takayuki, KAJIWARA, Yasuhiro
• Granted Patent: US 9,378,558 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 7/248 involving reference images or patches
• CPC Class Codes: G06T 7/74 involving reference images or patches

Abstract

An information processing apparatus includes a self-position/self-orientation calculation unit calculating self-position and/or self-orientation in the predetermined coordinate system based on a marker in acquired imaged image data when it is determined that the marker exists within a predetermined area and the marker is imaged in the imaged image data and based on received position information and physical amounts measured by sensors for measuring the physical amounts to be used for autonomous navigation when the marker does not exist within the predetermined area or the marker is not imaged in the imaged image data.

Claims

1. An information processing apparatus estimating at least one of self-position and self-orientation in a predetermined coordinate system, comprising:

a positioning information receiving unit configured to receive positioning information which is transmitted externally;

a received position identifying unit configured to identify a received position of the positioning information in the predetermined coordinate system based on the received positioning information;

a marker existence determination unit configured to determine whether there exists at least one of different plural markers, which are disposed in a real world, within a predetermined area where the identified received position is set as a reference thereof;

an imaged image data acquisition unit configured to acquire imaged image data by causing an imaging device to image an oriented direction of the imaging device when it is determined that the marker exists within the predetermined area;

a marker image determination unit configured to determine whether the marker is imaged in the acquired imaged image data; and

a self-position/self-orientation calculation unit configured to calculate at least one of the self-position and the self-orientation in the predetermined coordinate system,

wherein, when it is determined that the marker exists within the predetermined area and it is also determined that the marker is imaged in the imaged image data, the self-position/self-orientation calculation unit is configured to calculate at least one of the self-position and the self-orientation based on the marker in the acquired imaged image data, and

wherein, when it is determined that the marker does not exist within the predetermined area or when the marker is not imaged in the imaged image data, the self-position/self-orientation calculation unit is configured to calculate at least one of the self-position and the self-orientation based on received position information, which indicates the identified received position, and physical amounts which are measured by sensors for measuring the physical amounts to be used for autonomous navigation.

2. The information processing apparatus according to claim 1, further comprising:

a use environment determination unit configured to determine whether an error greater than or equal to a predetermined amount occurs in any of the sensors under use environment,

wherein, when it is determined that the error greater than or equal to the predetermined amount occurs in any of the sensors under the use environment, the marker existence determination unit is configured to determine whether the marker exists within the predetermined area, and

wherein, when it is determined that the error greater than or equal to the predetermined amount does not occur in any of the sensors under the use environment, the self-position/self-orientation calculation unit is configured to calculate at least one of the self-position and the self-orientation based on received position information and the physical amounts measured by the sensors.

3. The information processing apparatus according to claim 1, further comprising:

a marker identifying unit configured to, when it is determined that the marker is imaged in the imaged image data, identify the marker that is imaged therein,

wherein the self-position/self-orientation calculation unit is configured to

extract a first coordinate system transformation information of the identified marker from a first coordinate system transformation information registration list in which the first coordinate system transformation information for the markers are registered, the first coordinate system transformation information being for transforming a marker coordinate system, in which the marker is set as a reference thereof, into a world coordinate system,

calculate a second coordinate system transformation information which is for transforming an imaging coordinate system, in which an imaging direction of the imaging device is set as a reference thereof when the imaging device is caused to acquire the imaged image data, into the marker coordinate system in which the identified marker is set as a reference thereof,

calculate a third coordinate system transformation information which is for transforming the imaging coordinate system into the world coordinate system based on the extracted first coordinate system transformation information and the calculated second coordinate system transformation information,

calculate rotation angles around axes in the world coordinate system from a rotation element which is included in the calculated third coordinate system transformation information as the self-orientation in the world coordinate system, and

calculate moving distances to axis directions in the world coordinate system from a translation element which is included in the calculated third coordinate system transformation information as the self-position in the world coordinate system.

4. The information processing apparatus according to claim 3,

wherein the self-position/self-orientation calculation unit is configured to

calculate the self-orientation in the predetermined coordinate system based on the calculated rotation angles, and

calculate the self-position in the predetermined coordinate system based on the calculated moving distances.

5. The information processing apparatus according to claim 3,

wherein the marker identifying unit is configured to identify the marker that is imaged in the imaged image data by referring to a marker characteristic information registration list in which marker characteristic information indicating characteristics of the markers is registered.

6. The information processing apparatus according to claim 1,

wherein the marker existence determination unit is configured to determine whether the marker exists within the predetermined area by referring to a marker positional information registration list in which marker positional information indicating the positions of the markers in the predetermined coordinate system is registered.

7. The information processing apparatus according to claim 3,

wherein the marker identifying unit is configured to identify the marker that is imaged in the imaged image data by calculating an

an agreement rate between the marker characteristic information of the marker existing within the predetermined area among the markers and the marker characteristic information of the marker that is imaged in the imaged image data.

8. A method of controlling an information processing apparatus estimating at least one of self-position and self-orientation in a predetermined coordinate system, the method comprising:

receiving positioning information which is transmitted externally;

identifying a received position of the positioning information in the predetermined coordinate system based on the received positioning information;

determining whether there exists at least one of different plural markers, which are disposed in a real world, within a predetermined area where the identified received position is set as a reference thereof;

acquiring imaged image data by causing an imaging device to image an oriented direction of the imaging device when it is determined that the marker exists within the predetermined area;

determining whether the marker is imaged in the acquired imaged image data;

calculating, when it is determined that the marker exists within the predetermined area and it is also determined that the marker is imaged in the imaged image data, at least one of the self-position and the self-orientation based on the marker in the acquired imaged image data, and

calculating, when it is determined that the marker does not exist within the predetermined area or when the marker is not imaged in the imaged image data, at least one of the self-position and the self-orientation based on received position information, which indicates the identified received position, and physical amounts which are measured by sensors for measuring the physical amounts to be used for autonomous navigation.

9. A non-transitory storage medium storing a computer-readable program causing an information processing apparatus estimating at least one of self-position and self-orientation in a predetermined coordinate system to execute a control method comprising:

receiving positioning information which is transmitted externally;

identifying a received position of the positioning information in the predetermined coordinate system based on the received positioning information;

determining whether there exists at least one of different plural markers, which are disposed in a real world, within a predetermined area where the identified received position is set as a reference thereof;

acquiring imaged image data by causing an imaging device to image an oriented direction of the imaging device when it is determined that the marker exists within the predetermined area;

determining whether the marker is imaged in the acquired imaged image data;

calculating, when it is determined that the marker exists within the predetermined area and it is also determined that the marker is imaged in the imaged image data, at least one of the self-position and the self-orientation based on the marker in the acquired imaged image data, and

calculating, when it is determined that the marker does not exist within the predetermined area or when the marker is not imaged in the imaged image data, at least one of the self-position and the self-orientation based on received position information, which indicates the identified received position, and physical amounts which are measured by sensors for measuring the physical amounts to be used for autonomous navigation.