INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND PROGRAM

• US 20170106540A1
• Filed: 03/10/2015
• Published: 04/20/2017
• Est. Priority Date: 03/20/2014
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Watanabe, Daisuke, Okazaki, Hiroshi, Niwayama, Yutaka
• Granted Patent: US 10,456,918 B2
• Time in Patent Office: Days
• CPC Class Codes: B25J 9/1697 Vision controlled systems
• CPC Class Codes: G05B 2219/40053 Pick 3-D object from pile of objects
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2207/30164 Workpiece; Machine component
• CPC Class Codes: G06T 7/344 involving models
• CPC Class Codes: G06V 20/653 by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces

Abstract

A technique is provided, with which, even for an object which has a shape prone to be erroneously recognized and for which it is difficult to generate an initial value expected to produce a true value through fitting, it is possible to generate an appropriate initial value candidate through intuitive input and reduce erroneous recognition.

An information processing apparatus includes a model acquiring unit configured to acquire a three-dimensional shape model of a target object, a display control unit configured to cause a display unit to display the three-dimensional shape model, a setting unit configured to set first and second orientations different from each other on the basis of the three-dimensional shape model displayed in the display unit, a parameter deriving unit configured to derive a transformation parameter that transforms the first orientation into the second orientation, and a storage unit configured to store the transformation parameter.

Claims

1. An information processing apparatus comprising:

a model acquiring unit configured to acquire a three-dimensional shape model of a target object;

a display control unit configured to cause a display unit to display the three-dimensional shape model;

a setting unit configured to set a first orientation and a second orientation different from the first orientation on the basis of the three-dimensional shape model displayed in the display unit;

a parameter deriving unit configured to derive a transformation parameter that transforms the first orientation into the second orientation; and

a storage unit configured to store the transformation parameter.

2. The information processing apparatus according to claim 1, wherein the setting unit sets the first orientation and the second orientation in accordance with a user'"'"'s manipulation of the three-dimensional shape model displayed in the display unit.

3. The information processing apparatus according to claim 1, wherein the setting unit sets the first orientation and the second orientation by displaying a plurality of three-dimensional shape models in accordance with a plurality of different positions and orientations in the display unit and associating the displayed three-dimensional shape models with each other.

4. The information processing apparatus according to claim 1, further comprising:

an image acquiring unit configured to acquire an image containing the target object; and

a position and orientation deriving unit configured to derive a plurality of positions and orientations of the target object by associating the three-dimensional shape model of the target object with the image,

wherein the display unit displays the three-dimensional shape model in the plurality of derived positions and orientations; and

the setting unit sets the first orientation and the second orientation on the basis of whether the plurality of positions and orientations of the target object derived by the position and orientation deriving unit are the same.

5. The information processing apparatus according to claim 1, wherein the second orientation is obtained by rotating the first orientation 180 degrees about a predetermined axis.

6. The information processing apparatus according to claim 1, further comprising a determining unit configured to determine a specific region of the three-dimensional shape model displayed in the display unit in accordance with a user'"'"'s manipulation.

7. An information processing apparatus comprising:

an image acquiring unit configured to acquire an image containing a target object;

a model holding unit configured to hold a three-dimensional shape model of the target object;

a parameter holding unit configured to hold a transformation parameter between a first orientation of the target object and a second orientation different from the first orientation;

an approximate position and orientation acquiring unit configured to acquire an approximate position and orientation of the target object in the image; and

a deriving unit configured to derive a position and orientation of the target object in the image on the basis of the approximate position and orientation, the transformation parameter, and the three-dimensional shape model.

8. The information processing apparatus according to claim 7, further comprising:

a first fitting unit configured to perform fitting by associating the three-dimensional shape model with the target object in the image in the approximate position and orientation;

a transforming unit configured to transform a position and orientation of the three-dimensional shape model obtained after the fitting with the transformation parameter; and

a second fitting unit configured to associate the three-dimensional shape model with the target object in the position and orientation transformed by the transforming unit,

wherein the deriving unit derives the position and orientation of the target object on the basis of a result obtained by the first fitting unit and a result obtained by the second fitting unit.

9. The information processing apparatus according to claim 8, further comprising a deviation acquiring unit configured to acquire the amount of deviation of the result of the fitting performed by the first fitting unit,

wherein the transforming unit transforms the position and orientation of the three-dimensional shape model obtained after the fitting with the transformation parameter if the amount of deviation is greater than a threshold value.

10. The information processing apparatus according to claim 7, wherein the transformation parameter is derived by an information processing apparatus comprising:

an image acquiring unit configured to acquire an image containing a target object;

a model holding unit configured to hold a three-dimensional shape model of the target object;

a parameter holding unit configured to hold a transformation parameter between a first orientation of the target object and a second orientation different from the first orientation;

an approximate position and orientation acquiring unit configured to acquire an approximate position and orientation of the target object in the image; and

a deriving unit configured to derive a position and orientation of the target object in the image on the basis of the approximate position and orientation, the transformation parameter, and the three-dimensional shape model.

11. The information processing apparatus according to claim 8, wherein the first fitting unit performs fitting by associating a whole three-dimensional shape model with a target object in the image, and the second fitting unit performs fitting by associating a specific portion of the three-dimensional shape model, the specific portion being designated in advance and being part of the three-dimensional shape model, with a specific portion which is part of the target object in the image.

12. The information processing apparatus according to claim 7, further comprising a target object holding unit configured to hold the target object,

wherein the target object holding unit holds the target object on the basis of the derived position and orientation.

13. An information processing apparatus comprising:

a display control unit configured to cause a display unit to display a three-dimensional shape model of a target object;

a determining unit configured to determine a specific region of the three-dimensional shape model displayed in the display unit in accordance with a user'"'"'s manipulation; and

a storage unit configured to store the determined specific region.

14. An information processing method comprising:

a model acquiring step of acquiring a three-dimensional shape model of a target object;

a display control step of causing a display unit to display the three-dimensional shape model;

a setting step of setting a first orientation and a second orientation different from the first orientation on the basis of the three-dimensional shape model displayed in the display unit; and

a deriving step of deriving a transformation parameter that transforms the first orientation into the second orientation.

15. An information processing method comprising:

an image acquiring step of acquiring an image containing a target object;

an approximate position and orientation acquiring step of acquiring an approximate position and orientation of the target object in the image; and

a deriving step of deriving a position and orientation of the target object in the image on the basis of the approximate position and orientation, a transformation parameter between a first orientation of the target object and a second orientation different from the first orientation, and a three-dimensional shape model of the target object.

16. An information processing method comprising:

a display control step of causing a display unit to display a three-dimensional shape model of a target object;

a determining step of determining a specific region of the three-dimensional shape model displayed in the display unit in accordance with a user'"'"'s manipulation; and

a storage step of storing the determined specific region.

17. A program executed by a computer and causing the computer to function as each unit of an information processing apparatus, the apparatus comprising:

a model acquiring unit configured to acquire a three-dimensional shape model of a target object;

a display control unit configured to cause a display unit to display the three-dimensional shape model;

a setting unit configured to set a first orientation and a second orientation different from the first orientation on the basis of the three-dimensional shape model displayed in the display unit;

a parameter deriving unit configured to derive a transformation parameter that transforms the first orientation into the second orientation; and

a storage unit configured to store the transformation parameter.

18. A program executed by a computer and causing the computer to function as each unit of an information processing apparatus, the apparatus comprising:

an image acquiring unit configured to acquire an image containing a target object;

a model holding unit configured to hold a three-dimensional shape model of the target object;

a parameter holding unit configured to hold a transformation parameter between a first orientation of the target object and a second orientation different from the first orientation;

an approximate position and orientation acquiring unit configured to acquire an approximate position and orientation of the target object in the image; and

a deriving unit configured to derive a position and orientation of the target object in the image on the basis of the approximate position and orientation, the transformation parameter, and the three-dimensional shape model.

19. A program executed by a computer and causing the computer to function as each unit of an information processing apparatus, the apparatus comprising:

a display control unit configured to cause a display unit to display a three-dimensional shape model of a target object;

a determining unit configured to determine a specific region of the three-dimensional shape model displayed in the display unit in accordance with a user'"'"'s manipulation; and

a storage unit configured to store the determined specific region.