THREE-DIMENSIONAL VISUAL SENSOR

• US 20110122228A1
• Filed: 11/10/2010
• Published: 05/26/2011
• Est. Priority Date: 11/24/2009
• Status: Abandoned Application

• Current Assignee: Omron Corporation
• Original Assignee: Omron Corporation
• Inventors: Fujieda, Shiro, Takahashi, Reiji, Taneno, Atsushi, Yoshino, Masanao, Ukai, Kenichi
• Application Number:
  US12/943,565
• Publication Number:
  US 20110122228A1
• Time in Patent Office: Days
• US Class Current: 348/46
• CPC Class Codes: G01B 11/03 by measuring coordinates of points
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals

Abstract

A perspective transformation is performed to a three-dimensional model and a model coordinate system indicating a reference attitude of the three-dimensional model to produce a projection image expressing a relationship between the model and the model coordinate system, and a work screen is started up. A coordinate of an origin in the projection image and rotation angles of an X-axis, a Y-axis, and a Z-axis are displayed in work areas on the screen to accept a manipulation to change the coordinate and the rotation angles. The display of the projection image is changed by a manipulation. When an OK button located is pressed, the coordinate and rotation angle are fixed, and the model coordinate system is changed based on the coordinate and rotation angle. A coordinate of each constituent point of the three-dimensional model is transformed into a coordinate of the post-change model coordinate system.

Claims

1. A three-dimensional visual sensor comprising:

a registration unit in which a three-dimensional model is registered, a plurality of points indicating a three-dimensional shape of a model of a recognition object being expressed by a three-dimensional coordinate of a model coordinate system in the three-dimensional model, one point in the model being set to an origin in the model coordinate system;

a stereo camera that images the recognition target;

a three-dimensional measurement unit that obtains a three-dimensional coordinate in a predetermined three-dimensional coordinate system for measurement with respect to a plurality of feature points expressing the recognition target using a stereo image produced with the stereo camera;

a recognition unit that checks a set of three-dimensional coordinates obtained by the three-dimensional measurement unit with the three-dimensional model to recognize a three-dimensional coordinate corresponding to the origin of the model coordinate system and a rotation angle of the recognition target with respect to a reference attitude of the three-dimensional model indicated by the model coordinate system;

an output unit that outputs the three-dimensional coordinate and the rotation angle recognized by the recognition unit;

an acceptance unit that accepts a manipulation input to change a position or an attitude in the three-dimensional model of the model coordinate system; and

a model correcting unit that changes each of the three-dimensional coordinates constituting the three-dimensional model to a coordinate of the model coordinate system changed by the manipulation input and registers a changed three-dimensional model in the registration unit as the three-dimensional model used in the recognition unit.

2. The three-dimensional visual sensor according to claim 1, further comprising:

a perspective transformation unit that disposes the three-dimensional model after determining the position and the attitude of the model coordinate system with respect to the three-dimensional coordinate system for measurement and produces a two-dimensional projection image by performing perspective transformation to the three-dimensional model and the model coordinate system from a predetermined direction;

a display unit that displays a projection image produced through the perspective transformation processing on a monitor; and

a display changing unit that changes display of the projection image of the model coordinate system in response to the manipulation input.

3. The three-dimensional visual sensor according to claim 2,

wherein the display unit displays a three-dimensional coordinate of a point corresponding to the origin in the model coordinate system before the model coordinate system is changed by the model correcting unit on the monitor on which the projection image is displayed as the three-dimensional coordinate of the point corresponding to the origin of the model coordinate system in the projection image, and the display unit displays a rotation angle formed by a direction corresponding to each coordinate axis of the model coordinate system in the projection image and each coordinate axis of the model coordinate system before the model coordinate system is changed by the model correcting unit on the monitor on which the projection image is displayed as an attitude indicated by the model coordinate system in the projection image, and

wherein the acceptance unit accepts a manipulation to change the three-dimensional coordinate or the rotation angle displayed on the monitor.