Instruction input device, instruction input method, program, recording medium, and integrated circuit
First Claim
1. An instruction input device which calculates a display position of a pointer to be displayed on a two-dimensional screen, based on a pointing operation of movement of a hand of a user in a three-dimensional space, the instruction input device comprising:
- a user position detection unit configured to detect a three-dimensional position of the user;
an input coordinate detection unit configured to detect, as a three-dimensional input coordinate, a coordinate indicating a three-dimensional position of the hand of the user;
a first direction detection unit configured to detect, based on a body posture of the user, a first direction which is determined with respect to a screen vertical direction and is a direction in which the user is looking;
a second direction detection unit configured to detect, based on the body posture of the user, a second direction which is determined with respect to a screen horizontal direction and is a direction in which the user is performing the pointing operation;
a gaze position calculation unit configured to calculate a gaze position of the user on the two-dimensional screen, based on the three-dimensional position of the user and the first direction;
a reference line calculation unit configured to calculate a reference line in a three-dimensional space between the user and the two-dimensional screen, based on the three-dimensional position of the user and the first direction, the reference line being a line corresponding to the gaze position;
an offset amount calculation unit configured to (i) calculate, as a reference point, a point from among a plurality of points on the reference line, the reference point being calculated such that a direction between the three-dimensional input coordinate and the reference point is parallel to the second direction, and (ii) calculate a positional relationship between the reference point and the three-dimensional input coordinate as an offset amount with respect to the gaze position in a first screen predetermined direction along the two-dimensional screen; and
a pointer display position calculation unit configured to calculate, as the display position of the pointer to be displayed on the two-dimensional screen, a position in which a distance of the first screen predetermined direction between the position and the gaze position is the offset amount on the two-dimensional screen.
2 Assignments
0 Petitions
Accused Products
Abstract
An instruction input device includes: a first direction detection unit detecting the first direction in which the user is looking; a second direction detection unit detecting a second direction in which the user is performing a pointing operation; a gaze position calculation unit calculating a gaze position of the user on the screen; a reference coordinate group calculation unit calculating a reference line in space corresponding to the gaze position and connecting the user and the screen; an offset amount calculation unit calculating a distance of the second direction between the reference line and the input coordinate indicating the user'"'"'s hand as an offset amount with respect to the gaze position; and a pointer display position calculation unit calculating a position in which a distance of the first screen predetermined direction between the position and the gaze position is the offset amount on the screen.
-
Citations
19 Claims
-
1. An instruction input device which calculates a display position of a pointer to be displayed on a two-dimensional screen, based on a pointing operation of movement of a hand of a user in a three-dimensional space, the instruction input device comprising:
-
a user position detection unit configured to detect a three-dimensional position of the user; an input coordinate detection unit configured to detect, as a three-dimensional input coordinate, a coordinate indicating a three-dimensional position of the hand of the user; a first direction detection unit configured to detect, based on a body posture of the user, a first direction which is determined with respect to a screen vertical direction and is a direction in which the user is looking; a second direction detection unit configured to detect, based on the body posture of the user, a second direction which is determined with respect to a screen horizontal direction and is a direction in which the user is performing the pointing operation; a gaze position calculation unit configured to calculate a gaze position of the user on the two-dimensional screen, based on the three-dimensional position of the user and the first direction; a reference line calculation unit configured to calculate a reference line in a three-dimensional space between the user and the two-dimensional screen, based on the three-dimensional position of the user and the first direction, the reference line being a line corresponding to the gaze position; an offset amount calculation unit configured to (i) calculate, as a reference point, a point from among a plurality of points on the reference line, the reference point being calculated such that a direction between the three-dimensional input coordinate and the reference point is parallel to the second direction, and (ii) calculate a positional relationship between the reference point and the three-dimensional input coordinate as an offset amount with respect to the gaze position in a first screen predetermined direction along the two-dimensional screen; and a pointer display position calculation unit configured to calculate, as the display position of the pointer to be displayed on the two-dimensional screen, a position in which a distance of the first screen predetermined direction between the position and the gaze position is the offset amount on the two-dimensional screen. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. An instruction input method for calculating a display position of a pointer to be displayed on a two-dimensional screen, based on a pointing operation of movement of a hand of a user in a three-dimensional space, the instruction input method comprising:
-
detecting a three-dimensional position of the user; detecting, as a three-dimensional input coordinate, a coordinate indicating a three-dimensional position of the hand of the user; detecting, based on a body posture of the user, a first direction which is determined with respect to a screen vertical direction and is a direction in which the user is looking; detecting, based on the body posture of the user, a second direction which is determined with respect to a screen horizontal direction and is a direction in which the user is performing the pointing operation; calculating a gaze position of the user on the screen, based on the three-dimensional position of the user and the first direction; calculating a reference line in a three-dimensional space between the user and the two-dimensional screen, based on the three-dimensional position of the user and the first direction, the reference line being a line corresponding to the gaze position; calculating, as a reference point, a point from among a plurality of points on the reference line, the reference point being calculated such that a direction between the three-dimensional input coordinate and the reference point is parallel to the second direction; calculating a positional relationship between the reference point and the three-dimensional input coordinate as an offset amount with respect to the gaze position in a first screen predetermined direction along the two-dimensional screen; and calculating, as a display position of the pointer to be displayed on the two-dimensional screen, a position in which a distance in the first screen predetermined direction between the position and the gaze position is the offset amount on the two-dimensional screen.
-
-
18. A non-transitory recording medium having stored thereon a program for calculating a display position of a pointer to be displayed on a two-dimensional screen, based on a pointing operation of movement of a hand of a user in a three-dimensional space, the program causing a computer to execute:
-
detecting a three-dimensional position of the user; detecting, as a three-dimensional input coordinate, a coordinate indicating a three-dimensional position of the hand of the user; detecting, based on a body posture of the user, a first direction which is determined with respect to a screen vertical direction and is a direction in which the user is looking; detecting, based on the body posture of the user, a second direction which is determined with respect to a screen horizontal direction and is a direction in which the user is performing the pointing operation; calculating a gaze position of the user on the two-dimensional screen, based on the three-dimensional position of the user and the first direction; calculating a reference line in a three-dimensional space between the user and the two-dimensional screen, based on the three-dimensional position of the user and the first direction, the reference line being a line corresponding to the gaze position; calculating, as a reference point, a point from among a plurality of points on the reference line, the reference point being calculated such that a direction between the three-dimensional input coordinate and the reference point is parallel to the second direction; calculating a positional relationship between the reference point and the three-dimensional input coordinate as an offset amount with respect to the gaze position in a first screen predetermined direction along the two-dimensional screen; and calculating, as a display position of the pointer to be displayed on the two-dimensional screen, a position in which a distance in the first screen predetermined direction between the position and the gaze position is the offset amount on the two-dimensional screen.
-
-
19. An integrated circuit which calculates a display position of a pointer to be displayed on a two-dimensional screen, based on a pointing operation of movement of a hand of a user in a three-dimensional space, the integrated circuit comprising:
-
a user position detection unit configured to detect a three-dimensional position of the user; an input coordinate detection unit configured to detect, as a three-dimensional input coordinate, a coordinate indicating a three-dimensional position of the hand of the user; a first direction detection unit configured to detect, based on a body posture of the user, a first direction which is determined with respect to a screen vertical direction and is a direction in which the user is looking; a second direction detection unit configured to detect, based on the body posture of the user, a second direction which is determined with respect to a screen horizontal direction and is a direction in which the user is performing the pointing operation; a gaze position calculation unit configured to calculate a gaze position of the user on the two-dimensional screen, based on the three-dimensional position of the user and the first direction; a reference line calculation unit configured to calculate a reference line in a three-dimensional space between the user and the two-dimensional screen, based on the three-dimensional position of the user and the first direction, the reference line being a line corresponding to the gaze position; an offset amount calculation unit configured to (i) calculate, as a reference point, a point from among a plurality of points on the reference line, the reference point being calculated such that a direction between the three-dimensional input coordinate and the reference point is parallel to the second direction, and (ii) calculate a positional relationship between the reference point and the three-dimensional input coordinate as an offset amount with respect to the gaze position in a first screen predetermined direction along the two-dimensional screen; and a pointer display position calculation unit configured to calculate, as a display position of the pointer to be displayed on the two-dimensional screen, a position in which a distance of the first screen predetermined direction between the position and the gaze position is the offset amount on the two-dimensional screen.
-
Specification