Work recognition system, work recognition device, and work recognition method
First Claim
1. A work recognition device, comprising:
- a whole-state observation time determination unit configured to determine, as a whole-state observation time, from among observation times of a plurality of first observation values generated by a speed sensor to represent respective movements of a hand of a user in chronological order, an observation time of observing a first observation value representing a predetermined movement of the hand, based on magnitudes of the plurality of first observation values and an angular difference between the plurality of first observation values; and
an observation value selection unit configured to select a second observation value corresponding to the whole-state observation time determined by the whole-state observation time determination unit, from among a plurality of second observation values generated by an imaging unit to represent respective states in work of the user in chronological order,wherein the whole-state observation time determination unit includes;
a magnitude estimation unit configured to estimate a magnitude of an acceleration that is obtained by subtracting a gravity acceleration from each of the accelerations generated by the speed sensor;
an angular difference calculation unit configured to calculate, for each of the accelerations generated by the speed sensor, an angle between (a) one acceleration at a corresponding observation time and (b) another acceleration at an observation time prior to the corresponding observation time; and
a time determination unit configured to determine, as the whole-state observation time, the corresponding observation time, when (a) a magnitude of the one acceleration which is estimated by the magnitude estimation unit and (b) the angle calculated by the angular difference calculation unit show a predetermined pattern.
2 Assignments
0 Petitions
Accused Products
Abstract
A work recognition device, which recognizes processes in a user'"'"'s work, includes a whole-state observation time determination unit that determines, as a whole-state observation time, from among observation times of chronological first observation values generated by a first sensor to represent movements of a user'"'"'s hand, an observation time of observing a first observation value representing a predetermined movement of the hand; and an observation value selection unit that selects a second observation value corresponding to the time determined by the determination unit from among chronological second observation values generated by a second sensor to represent scenes in the user'"'"'s work. Additionally, a process recognition unit specifies a process in the work, by comparing the second observation value selected by the selection unit to pieces of knowledge data associated with work processes in which the user performs predetermined movements of the hand.
10 Citations
15 Claims
-
1. A work recognition device, comprising:
-
a whole-state observation time determination unit configured to determine, as a whole-state observation time, from among observation times of a plurality of first observation values generated by a speed sensor to represent respective movements of a hand of a user in chronological order, an observation time of observing a first observation value representing a predetermined movement of the hand, based on magnitudes of the plurality of first observation values and an angular difference between the plurality of first observation values; and an observation value selection unit configured to select a second observation value corresponding to the whole-state observation time determined by the whole-state observation time determination unit, from among a plurality of second observation values generated by an imaging unit to represent respective states in work of the user in chronological order, wherein the whole-state observation time determination unit includes; a magnitude estimation unit configured to estimate a magnitude of an acceleration that is obtained by subtracting a gravity acceleration from each of the accelerations generated by the speed sensor; an angular difference calculation unit configured to calculate, for each of the accelerations generated by the speed sensor, an angle between (a) one acceleration at a corresponding observation time and (b) another acceleration at an observation time prior to the corresponding observation time; and a time determination unit configured to determine, as the whole-state observation time, the corresponding observation time, when (a) a magnitude of the one acceleration which is estimated by the magnitude estimation unit and (b) the angle calculated by the angular difference calculation unit show a predetermined pattern. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A work recognition system that recognizes processes in work performed by a user, the work recognition system comprising:
-
a speed sensor that generates, in chronological order, a plurality of first observation values representing respective movements of a hand of the user performing the work; an imaging unit configured to generate, in chronological order, a plurality of second observation values representing respective states in the work; and a work recognition device that recognizes a process in the work based on the plurality of first observation values generated in chronological order and the plurality of second observation values generated in chronological order, wherein the work recognition device includes; a whole-state observation time determination unit configured to determine, as a whole-state observation time, from among observation times of a plurality of first observation values generated in chronological order, an observation time of observing a first observation value representing a predetermined movement of the hand, based on magnitudes of the plurality of first observation values and an angular difference between the plurality of first observation values; an observation value selection unit configured to select a second observation value corresponding to the whole-state observation time determined by the whole-state observation time determination unit, from among a plurality of second observation values generated in chronological order; and a process recognition unit configured to specify a process in the work, by comparing the second observation value selected by the observation value selection unit to pieces of knowledge data associated with respective processes in the work, in each of the respective processes the user performing the predetermined movement of the hand, wherein the whole-state observation time determination unit includes; a magnitude estimation unit configured to estimate a magnitude of an acceleration that is obtained by subtracting a gravity acceleration from each of the accelerations generated by the speed sensor; an angular difference calculation unit configured to calculate, for each of the accelerations generated by the speed sensor, an angle between (a) one acceleration at a corresponding observation time and (b) another acceleration at an observation time prior to the corresponding observation time; and a time determination unit configured to determine, as the whole-state observation time, the corresponding observation time, when (a) a magnitude of the one acceleration which is estimated by the magnitude estimation unit and (b) the angle calculated by the angular difference calculation unit show a predetermined pattern.
-
-
14. A work recognition method of recognizing, by using a computer, processes in work performed by a user, the work recognition method comprising:
-
determining, as a whole-state observation time, from among observation times of a plurality of first observation values generated by a speed sensor to represent respective movements of a hand of the user in chronological order, an observation time of observing a first observation value representing a predetermined movement of the hand, based on magnitudes of the plurality of first observation values and an angular difference between the plurality of the first observation values; selecting a second observation value corresponding to the whole-state observation time determined in the determining, from among a plurality of second observation values generated by an imaging unit to represent respective states in work of the user; and specifying a process in the work, by comparing the second observation value selected in the selecting to pieces of knowledge data associated with respective processes in the work, in each of the respective processes the user performing the predetermined movement of the hand, wherein the determining step includes; estimating a magnitude of an acceleration that is obtained by subtracting a gravity acceleration from each of the accelerations generated by the speed sensor; calculating, for each of the accelerations generated by the speed sensor, an angle between (a) one acceleration at a corresponding observation time and (b) another acceleration at an observation time prior to the corresponding observation time; and determining, as the whole-state observation time, the corresponding observation time, when (a) a magnitude of the one acceleration which is estimated in the estimating and (b) the angle calculated in the calculating show a predetermined pattern.
-
-
15. A computer program which is recorded on a non-transitory computer-readable recording medium for use in a computer and is used for recognizing processes in work performed by a user, the computer program causing the computer to execute:
-
determining, as a whole-state observation time, from among observation times of a plurality of first observation values generated by a speed sensor to represent respective movements of a hand of the user in chronological order, an observation time of observing a first observation value representing a predetermined movement of the hand, based on magnitudes of the plurality of first observation values and an angular difference between the plurality of first observation values; selecting a second observation value corresponding to the whole-state observation time determined in the determining, from among a plurality of second observation values generated by an imaging unit to represent respective states in work of the user; and specifying a process in the work, by comparing the second observation value selected in the selecting to pieces of knowledge data associated with respective processes in the work, in each of the respective processes the user performing the predetermined movement of the hand, wherein the determining step includes; estimating a magnitude of an acceleration that is obtained by subtracting a gravity acceleration from each of the accelerations generated by the speed sensor; calculating, for each of the accelerations generated by the speed sensor, an angle between (a) one acceleration at a corresponding observation time and (b) another acceleration at an observation time prior to the corresponding observation time; and determining, as the whole-state observation time, the corresponding observation time, when (a) a magnitude of the one acceleration which is estimated in the estimating and (b) the angle calculated in the calculating show a predetermined pattern.
-
Specification