Three-dimensional movement specifying apparatus and method and observational position and orientation changing apparatus

• US 5,561,445 A
• Filed: 11/21/1994
• Issued: 10/01/1996
• Est. Priority Date: 11/09/1992
• Status: Expired due to Term

• Current Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Kawaguchi, Toru, Miwa, Michio
• Primary Examiner(s): Hjerpe, Richard
• Assistant Examiner(s): Liang, Regina
• Application Number:
  US08/345,456
• Time in Patent Office: 680 Days
• Field of Search: 345/163, 345/164, 345/167, 345/157, 345/156
• US Class Current: 345/163
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/03549 Trackballs G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour

Abstract

A three-dimensional movement specifying apparatus consists of a track ball member, an annular ring, a first sensor for detecting the rotation of the track ball member about an X-axis, a second sensor for detecting the rotation of the track ball member about a Y-axis, a third sensor for detecting the rotation of the annular ring about a Z-axis, a secondary ball member rolling on an X-Y plane, a fourth sensor for detecting the rolling of the secondary ball member along the X-axis, a fifth sensor for detecting the rolling of the secondary ball member along the Y-axis, a central processing unit for controlling movement of a plane representing a three-dimensional position and orientation of an object according to the rotations and the rolling, and a displaying unit for displaying the plane and the object moved with the plane. The track ball member is rotated to place both a starting position of the object and a target position of the object on the plane, the secondary ball member is rolled to move straight the object placed at the starting position to the target position, and the track ball member and the annular ring are rotated to move the object to a target orientation. Therefore, the object is smoothly moved from a starting position and orientation to a target position and orientation.

Claims

1. A three-dimensional movement specifying apparatus for specifying translation movement and/or rotational movement of an object in a three-dimensional space to virtually move the object from a starting position and orientation (x0,y0,z0, α

0,β

0,γ

0) to a target position and orientation (x1,y1,z1, α

1,β

1,γ

1), comprising;

displaying means for displaying a plane representing a three-dimensional position (x,y,z) and an orientation (α

,β

,γ

) of the object and the object placed at the three-dimensional position and orientation (x,y,z, α

,β

,γ

), an X-Y-Z coordinate system in which the plane is placed on an X-Y plane specified by Z coordinates Z=0 and the object is placed at an original point being defined, a value α

denoting a rotational angle about an X-axis of the coordinate system, a value β

denoting a rotational angle about a Y-axis of the coordinate system, a value γ

denoting a rotational angle about a Z-axis of the coordinate system, and the object and the coordinate system being moved with the plane to place a fixed position of the plane at the original point of the X-Y-Z coordinate system;

first orientation specifying means having a track ball member for specifying a first rotational movement of the plane displayed by the displaying means about the X-axis and a second rotational movement of the plane about the Y-axis at one time by rotating the track ball member, the plane which represents a three-dimensional starting position (x0,y0,z0) and a starting orientation (α

0,β

0,γ

0) of the object being moved according to the first and second rotational movements to place both the three-dimensional starting position (x0,y0,z0) and a three-dimensional target position (x1,y1,z1) on the plane and being changed to the plane which represents the three-dimensional starting position (x0,y0,z0) and an intermediate orientation (α

2,β

2,γ

0) of the object, and an orientation (α

2,β

2) represented by the plane being further changed according to the first and second rotational movements to an orientation (α

1,β

1) represented by the plane by rotating the track ball member by angle of α

1-α

2 and β

1-β

2 about the X-axis and Y-axis;

position specifying means having a secondary ball member for specifying a first translation movement of the plane displayed by the displaying means along the X-axis and a second translation movement of the plane along the Y-axis at one time by rotating the secondary ball member straight, the plane which is determined by the first orientation specifying means and represents the three-dimensional starting position (x0,y0,z0) and the intermediate orientation (α

2,β

2,γ

2) of the object being moved according to the first and second translation movements and changed to the plane which represent the three-dimensional target position (x1,y1,z1) and the intermediate orientation (α

2,β

2,γ

0) of the object;

second orientation specifying means for specifying a third rotational movement of the plane displayed by the displaying means about the Z-axis, an orientation γ

0 represented by the plane being changed to an orientation γ

1 represented by the plane to change the plane which is determined by the position specifying means and represents the three-dimensional target position (x1,y1,z1) and the intermediate orientation (α

2,β

2,γ

0) of the object to the plane which represents the three-dimensional target position (x1,y1,z1) and a target orientation (α

1,β

1,γ

1) of the object in cooperation with the first orientation specifying means; and

control means for controlling the object and the plane displayed by the displaying means to place the object at the fixed position of the plane for the purpose of placing the object at the original point of the X-Y-Z coordinate system and controlling movement of the object to virtually move the object which is placed at the three-dimensional starting position (x0,y0,z0) and the starting orientation (α

0,β

0,γ

0) represented by the plane to the three-dimensional target position (x1,y1,z1) and the target orientation (α

1,β

1,γ

1) represented by the plane which is determined by specifying the first and second rotational movement, the first and second translation movements and the third rotational movement by the first orientation specifying means, the position specifying means and the second orientation specifying means.

2. An apparatus according to claim 1 in which the second orientation specifying means specifies the third rotational movement of the object by rotating a ring by an angle γ

₁ -γ

₀ about the Z-axis, the object being rotated by the angle γ

₁ -γ

₀ about the Z-axis under the control of the control means.

3. An apparatus according to claim 1 in which the first orientation specifying means additionally includes a first sensor rotating with the rotation of the track ball member about the X-axis to detect the degree of the first rotational movement specified in the first orientation specifying means, and a second sensor rotating with the rotation of the track ball member about the Y-axis to detect the degree of the second rotational movement specified in the first orientation specifying means.

4. An apparatus according to claim 2 in which the second orientation specifying means additionally includes a sensor rotating with the rotation of the ring about the Z-axis to detect the degree of the third rotational movement specified in the second orientation specifying means.

5. An apparatus according to claim 4 in which the position specifying means further includes a first sensor rotating with the roll of the ball member along the X-axis to detect the degree of the first translation movement specified in the position specifying means, and a second sensor rotating with the roll of the ball member along the Y-axis to detect the degree of the second translation movement specified in the position specifying means.

6. An apparatus according to claim 1 in which the second orientation specifying means is composed of first and second buttons, the object being clockwisely rotated on its axis by pushing the first button under the control of the control means, and the object being counterclockwisely rotated on its axis by pushing the second button under the control of the control means.

7. An apparatus according to claim 1, additionally including:

relative position and orientation storing means for storing relative position and orientation between an instructing plane and the object;

plane moving data storing means for storing pieces of moving data of the instructing plane consisting of degrees of the first, second and third rotational movements of the object specified in the first orientation specifying means and the second orientation specifying means and degrees of the first and second translation movements specified in the position specifying means, the moving data designating movements of the instructing plane;

object position and orientation calculating means for calculating the target position and orientation of the object to which the object is moved on condition that the relative position and orientation stored in the relative position and orientation storing means is maintained even though the instructing plane is moved according to the moving data stored in the plane moving data storing means, the target position and orientation of the object being obtained by adding the relative position and orientation stored in the relative position and orientation storing means and the moving data stored in the plane position and orientation storing means; and

object position and orientation storing means for storing the target position and orientation of the object calculated in the object position and orientation calculating means, the object being moved to the target position and orientation of the object stored in the object position and orientation storing means.

8. An observational position and orientation changing apparatus for changing position and orientation of an observational eye observing an object in a three-dimensional space, comprising:

displaying means for displaying a plane representing a three-dimensional position (x,y,z) of the object and the object placed at the three-dimensional position and orientation (x,y,z,α

,β

,γ

), an X-Y-Z coordinate system in which the plane is placed on an X-Y plane specified by Z coordinates Z=0 and the object is placed at an original point being defined, a value α

denoting a rotational angle about an X-axis of the coordinate system, a value β

denoting a rotational angle about a Y-axis of the coordinate system, a value γ

denoting a rotational angle about a Z-axis of the coordinate system, and the object and the coordinate system being moved with the plane to place a fixed position of the plane at the original point of the X-Y-Z coordinate system;

first orientation specifying means having a track ball member for specifying a first rotational movement of the plane displayed by the displaying means about the X-axis and a second rotational movement of the plane about the Y-axis at one time by rotating the track ball member, the plane which represents a three-dimensional starting position (x0,y0,z0) and a starting orientation (α

0,β

0,γ

0) of the object being moved according to the first and second rotational movements to place both the three-dimensional starting position (x0,y0,z0) and a three-dimensional target position (x1,y1,z1) on the plane and being changed to the plane which represents the three-dimensional starting position (x0,y0,z0) and an intermediate orientation (α

2,β

2,γ

0) of the object, and an orientation (α

2,β

2) represented by the plane being further changed according to the first and second rotational movements to an orientation (α

1,β

1) represented by the plane by rotating the track ball member by angle of α

1-α

2 and β

1-β

2 about the X-axis and Y-axis;

position specifying means having a secondary ball member for specifying a first translation movement of the plane displayed by the displaying means along the X-axis and a second translation movement of the plane along the Y-axis at one time by rotating the secondary ball member straight, the plane which is determined by the first orientation specifying means and represents the three-dimensional starting position (x0,y0,z0) and the intermediate orientation (α

2,β

2,γ

0) of the object being moved according to the first and second translation movements and changed to the plane which represent the three-dimensional target position (x1,y1,z1) and the intermediate orientation (α

2,β

2,γ

0) of the object;

second orientation specifying means for specifying a third rotational movement of the plane displayed by the displaying means about the Z-axis, an orientation γ

0 represented by the plane being changed to an orientation γ

1 represented by the plane to change the plane which is determined by the position specifying means and represents the three-dimensional target position (x1,y1,z1) and the intermediate orientation of the object to the plane which represents the three-dimensional target position (x1,y1,z1) and a target orientation (α

1,β

1,γ

1) of the object in cooperation with the first orientation specifying means;

control means for controlling the object and the plane displayed by the displaying means to place the object at the fixed position of the plane for the purpose of placing the object at the original point of the X-Y-Z coordinate system and controlling movement of the object to virtually move the object which is placed at the three-dimensional starting position (x0,y0,z0) and the starting orientation (α

1,β

1,γ

1) represented by the plane which is determined by specifying the first and second rotational movements, the first and second translation movements and the third rotational movement by the first orientation specifying means, the position specifying means and the second orientation specifying means;

object moving data storing means for storing pieces of moving data of the object consisting of degrees of the first, second and third rotational movements of the object specified by the first orientation specifying means and the second orientation specifying means and degrees of the first and second translation movements specified by the position specifying means, the moving data designating movements of the object;

relative position and orientation storing means for storing relative position and orientation between the object and the observational eye;

observational eye position and orientation calculating means for calculating a moved position and orientation of the observational eye moved with the object on condition that the relative position and orientation stored in the relative position and orientation storing means is maintained even though the object is moved according to the moving data stored in the object moving data storing means, the moved position and orientation of the observational eye being obtained by adding the relative position and orientation stored in the relative position and orientation storing means and the moving data stored in the object moving data storing means; and

observational eye position and orientation storing means for storing the moved position and orientation of the observational eye calculated in the observational eye position and orientation calculating means, the observational eye being moved to the moved position and orientation stored in the observational eye position and orientation storing means.

9. A method for specifying translation movement and/or rotational movement of an object in a three-dimensional space to virtually move the object from a starting position and orientation (x0,y0,z0, α

0,β

0,γ

0) to a target position and orientation (x1,y1,z1,α

1,β

1,γ

1), comprising the steps of;

displaying a plane representing a three-dimensional starting position (x0,y0,z0) and a starting orientation of (α

0,β

0,γ

0) of the object and the object placed at the starting position and orientation (x0,y0,z0,α

0,β

0,γ

0) on a displaying unit under control of a central processing unit of a three-dimensional movement specifying apparatus, the value α

0 denoting a rotational angle about an X-axis of a starting coordinate system in which the plane is placed on an X-Y plane specified by Z coordinates Z=0, the value β

0 denoting a rotational angle about a Y-axis of the starting coordinate system, the value γ

0 denoting a rotational angle about a Z-axis of the starting coordinate system, the three-dimensional starting position of the object being placed at an original point of the starting coordinate system on the plane, the starting orientation of the object agreeing with an orientation of the plane defined by an orientation of a line perpendicular to the plane, and the object being moved with the plane to place the object at a fixed position of the plane;

moving the plane about the X-axis and Y-axis at one time in rotational movement by rotating a track ball member of the three-dimensional movement specifying apparatus to place the three-dimensional starting position (x0,y0,z0) and a three dimensional target position (x1,y1,z1) on the plane, the plane representing the three-dimensional starting position (x0,y0,z0) and the intermediate orientation (α

2,β

2,γ

0) of the object, the value α

2 denoting a rotational angle about an X-axis of a first intermediate coordinate system in which the plane is placed on an X-Y plane specified by Z coordinates Z=0, the value β

2 denoting a rotational angle about a Y-axis of the first intermediate coordinate system, the three-dimensional starting position (x0,y0,z0) of the object being placed at an original point of the first intermediate coordinate system on the plane, and the intermediate orientation (α

2,β

2,γ

0) of the object agreeing with an orientation of the plane;

displaying the plane representing the three-dimensional starting position (x0,y0,z0) and the intermediate orientation (α

2,β

2,γ

0) of the object and the object placed at a first intermediate position and orientation x0,y0,z0, α

2,β

2,γ

0 on the displaying unit under control of the central processing unit;

moving straight the plane along the X-axis and the Y-axis of the first intermediate coordinate system at one time in translation movement by rotating a secondary ball member of the three-dimensional movement specifying apparatus to place the object moved with the plane at the three-dimensional target position (x1,y1,z1), the plane representing the three-dimensional target position (x1,y1,z1) and the intermediate orientation (α

2,β

2,γ

0) of the object, the three-dimensional target position (x1,y1,z1) of the object being placed at an original point of a second intermediate coordinate system in which the plane is placed on an X-Y plane specified by Z coordinates Z=0;

displaying the plane representing the three-dimensional target position (x1,y1,z1) and the intermediate orientation (α

2,β

2,γ

0) of the object and the object placed at a second intermediate position and orientation (x1,y1,z1,α

2,β

2,γ

0) on the displaying unit under control of the central processing unit;

moving the plane about an X-axis, a Y-axis and a Z-axis of the second intermediate coordinate system in rotational movement by rotating the track ball member and a ring of the three-dimensional movement specifying apparatus to change the intermediate orientation (α

2,β

2,γ

0); and

displaying the plane representing the three-dimensional target position (x1,y1,z1) and the target orientation (α

1,β

1,γ

1) of the object and the object placed at the target position and orientation (x1,y1,z1,α

1,β

1,γ

1) on the displaying unit under control of the central processing unit.