Exercise information display system, exercise information display method, and computer-readable storage medium having exercise information display program stored thereon

• US 9,656,119 B2
• Filed: 12/20/2013
• Issued: 05/23/2017
• Est. Priority Date: 12/27/2012
• Status: Active Grant

• Current Assignee: Casio Computer Company Limited
• Original Assignee: Casio Computer Company Limited
• Inventors: Ura, Kazuo, Sambongi, Masao
• Primary Examiner(s): Hu, Kang
• Assistant Examiner(s): Nguyen, Anh Vo V
• Application Number:
  US14/137,192
• Publication Number:
  US 20140188257A1
• Time in Patent Office: 1,250 Days
• CPC Class Codes: A63B 24/0003 Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
• CPC Class Codes: A63B 24/0062 Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance
• CPC Class Codes: A63B 71/06 Indicating or scoring devices for games or players , or for other sports activities
• CPC Class Codes: G09B 19/0038 Sports
• CPC Class Codes: G16Y 10/65 Entertainment or amusement; Sports
• CPC Class Codes: G16Y 20/40 relating to personal data, e.g. biometric data, records or preferences
• CPC Class Codes: G16Y 40/10 Detection; Monitoring

Abstract

An exercise information display system of the present invention includes a sensor device which obtains data associated with a motion status of a human body during an exercise, a data processing device which generates plural types of exercise information based on the data obtained by the sensor device, and a viewing device which displays, from among the plural types of exercise information, at least first information indicating a posture of the human body during the exercise and second information associated with the first information in a display format where the first information and the second information are displayed in conjunction with each other.

Claims

1. An exercise information display system comprising:

a sensor device which obtains data associated with a motion status of a human body during an exercise;

a data processing device which generates plural types of exercise information based on the data obtained by the sensor device; and

a viewing device which displays, from among the plural types of exercise information, at least first information indicating a posture of the human body during the exercise and second information associated with the first information in a display format where the first information and the second information are displayed in conjunction with each other,

wherein;

(i) the data processing device generates, as the first information, two maximum tilts each of which is a maximum tilt of a reference axis of a body trunk of the human body during the exercise and which are formed such that one direction where one maximum tilt is formed and a direction where the other maximum tilt is formed are opposite to each other, and the viewing device simultaneously displays two guide lines which respectively represent the two maximum tilts and an angle formed therebetween which represents a magnitude of a wobble of the body trunk, on two animations by a skeleton model which reflect the posture of the human body during the exercise and each of which corresponds to the two guide lines, such that the two guide lines are overlapped with the each of the two animations;

(ii) the data processing device generates, as the first information, a maximum upward direction position and a maximum downward direction position of a body trunk of the human body during the exercise, and the viewing device simultaneously displays two guide lines which respectively represent the maximum upward direction position and the maximum downward direction position and a distance therebetween which represents a magnitude of a wobble of the body trunk, on two animations by a skeleton model which reflect the posture of the human body during the exercise and each of which corresponds to the two guide lines, such that the two guide lines are overlapped with the each of the two animations;

(iii) the data processing device generates, as the first information, a ground reaction force received by the human body during the exercise, and the viewing device displays the ground reaction force by a vector, on an animation by a skeleton model which reflects the posture of the human body during the exercise, such that the ground reaction force is overlapped with the animation;

(iv) the data processing device generates, as the first information, a landing time of the human body during the exercise, and the viewing device displays the landing time by a vector, on an animation by a skeleton model which reflects the posture of the human body during the exercise, such that the landing time is overlapped with the animation;

(v) the data processing device generates, as the first information, two averages each of which is an average of a tilt of the human body and which are respectively obtained in different periods during the exercise, and the viewing device simultaneously displays two guide lines which respectively represent the two averages and an angle formed therebetween which represents a magnitude of a variability of the body trunk, on two animations by a skeleton model which reflect the posture of the human body during the exercise and each of which corresponds to the two guide lines, such that the two guide lines are overlapped with the each of the two animations;

or

(vi) the data processing device generates, as the first information, swings of a left or a right arm of the human body each of which is obtained in respective different periods during the exercise, and the viewing device simultaneously displays two guide lines which respectively represent the swings of the arm and an angle formed therebetween which represents a magnitude of the swings of the arm, on two animations by a skeleton model which reflect the posture of the human body during the exercise and each of which corresponds to the two guide lines, such that the two guide lines are overlapped with the each of the two animations.

2. The exercise information display system according to claim 1, wherein the data processing device has a data analyzing section which analyzes the data obtained by the sensor device regarding a plurality of items representing components of the posture of the human body during the exercise and generates the first information for each of the plurality of items based on analysis results.

3. The exercise information display system according to claim 2, wherein the data processing device generates, as the first information, an animation by a skeleton model for each of the plurality of items.

4. The exercise information display system according to claim 3, wherein the data processing device generates the animation by the skeleton model by analyzing the data for each motion element of the human body during the exercise, extracting unit images reflecting the posture, and synthesizing the unit images in time series.

5. The exercise information display system according to claim 2, wherein the data processing device generates, as the second information, a graph representing time variation of the data used for generating the first information for each of the plurality of items.

6. The exercise information display system according to claim 1, wherein the sensor device has at least an acceleration sensor which detects acceleration of the human body in triaxial directions during the exercise and outputs first sensor data, and an angular velocity sensor which detects angular velocities of the human body in triaxial directions during the exercise and outputs second sensor data, and

wherein the data processing device has an exercise information generating section which generates the first information based on the first sensor data and the second sensor data and generates the second information based on the first sensor data.

7. The exercise information display system according to claim 1, wherein the data processing device transmits the first information and the second information which are displayed in conjunction with each other to the viewing device, in response to a request from the viewing device.

8. The exercise information display system according to claim 1, wherein the sensor device, the data processing device, and the viewing device are connected to a network,

wherein the data processing device generates the plural types of exercise information based on the data obtained by the sensor device and transmitted via the network, and

wherein the viewing device displays the first information and the second information transmitted from the data processing device via the network such that the first information and the second information are displayed in conjunction with each other.

9. An exercise information display method comprising:

a step of obtaining data associated with a motion status of a human body during an exercise;

a step of generating plural types of exercise information based on the obtained data; and

a step of displaying, from among the plural types of exercise information, at least first information indicating a posture of the human body during the exercise and second information associated with the first information in a display format where the first information and the second information are displayed in conjunction with each other,

wherein;

(i) the step of generating generates, as the first information, two maximum tilts each of which is a maximum tilt of a reference axis of a body trunk of the human body during the exercise and which are formed such that one direction where one maximum tilt is formed and a direction where the other maximum tilt is formed are opposite to each other, and the step of displaying simultaneously displays two guide lines which respectively represent the two maximum tilts and an angle formed therebetween which represents a magnitude of a wobble of the body trunk, on two animations by a skeleton model which reflect the posture of the human body during the exercise and each of which corresponds to the two guide lines, such that the two guide lines are overlapped with the each of the two animations;

(ii) the step of generating generates, as the first information, a maximum upward direction position and a maximum downward direction position of a body trunk of the human body during the exercise, and the step of displaying simultaneously displays two guide lines which respectively represent the maximum upward direction position and the maximum downward direction position and a distance therebetween which represents a magnitude of a wobble of the body trunk, on two animations by a skeleton model which reflect the posture of the human body during the exercise and each of which corresponds to the two guide lines, such that the two guide lines are overlapped with the each of the two animations;

(iii) the step of generating generates, as the first information, a ground reaction force received by the human body during the exercise, and the step of displaying displays the ground reaction force by a vector, on an animation by a skeleton model which reflects the posture of the human body during the exercise, such that the ground reaction force is overlapped with the animation;

(iv) the step of generating generates, as the first information, a landing time of the human body during the exercise, and the step of displaying displays the landing time by a vector, on an animation by a skeleton model which reflects the posture of the human body during the exercise, such that the landing time is overlapped with the animation;

(v) the step of generating generates, as the first information, two averages each of which is an average of a tilt of the human body and which are respectively obtained in different periods during the exercise, and the step of displaying simultaneously displays two guide lines which respectively represent the two averages and an angle formed therebetween which represents a magnitude of a variability of the body trunk, on two animations by a skeleton model which reflect the posture of the human body during the exercise and each of which corresponds to the two guide lines, such that the two guide lines are overlapped with the each of the two animations;

or

(vi) the step of generating generates, as the first information, swings of a left or a right arm of the human body each of which is obtained in respective different periods during the exercise, and the step of displaying simultaneously displays two guide lines which respectively represent the swings of the arm and an angle formed therebetween which represents a magnitude of the swings of the body trunk arm, on two animations by a skeleton model which reflect the posture of the human body during the exercise and each of which corresponds to the two guide lines, such that the two guide lines are overlapped with the each of the two animations.

10. A non-transitory computer-readable storage medium having stored thereon an exercise information display program that is executable by a computer, the program being executable by the computer to perform functions comprising:

processing for generating plural types of exercise information based on data associated with a motion status of a human body during an exercise; and

processing for displaying, from among the plural types of exercise information, at least first information indicating a posture of the human body during the exercise and second information associated with the first information in a display format where the first information and the second information are displayed in conjunction with each other,

wherein;

(i) the processing for generating generates, as the first information, two maximum tilts each of which is a maximum tilt of a reference axis of a body trunk of the human body during the exercise and which are formed such that one direction where one maximum tilt is formed and a direction where the other maximum tilt is formed are opposite to each other, and the processing for displaying simultaneously displays two guide lines which respectively represent the two maximum tilts and an angle formed therebetween which represents a magnitude of a wobble of the body trunk, on two animations by a skeleton model which reflect the posture of the human body during the exercise and each of which corresponds to the two guide lines, such that the two guide lines are overlapped with the each of the two animations;

(ii) the processing for generating generates, as the first information, a maximum upward direction position and a maximum downward direction position of a body trunk of the human body during the exercise, and the processing for displaying simultaneously displays two guide lines which respectively represent the maximum upward direction position and the maximum downward direction position and a distance therebetween which represents a magnitude of a wobble of the body trunk, on two animations by a skeleton model which reflect the posture of the human body during the exercise and each of which corresponds to the two guide lines, such that the two guide lines are overlapped with the each of the two animations;

(iii) the processing for generating generates, as the first information, a ground reaction force received by the human body during the exercise, and the processing for displaying displays the ground reaction force by a vector, on an animation by a skeleton model which reflects the posture of the human body during the exercise, such that the ground reaction force is overlapped with the animation;

(iv) the processing for generating generates, as the first information, a landing time of the human body during the exercise, and the processing for displaying displays the landing time by a vector, on an animation by a skeleton model which reflects the posture of the human body during the exercise, such that the landing time is overlapped with the animation;

(v) the processing for generating generates, as the first information, two averages each of which is an average of a tilt of the human body and which are respectively obtained in different periods during the exercise, and the processing for displaying simultaneously displays two guide lines which respectively represent the two averages and an angle formed therebetween which represents a magnitude of a variability of the body trunk, on two animations by a skeleton model which reflect the posture of the human body during the exercise and each of which corresponds to the two guide lines, such that the two guide lines are overlapped with the each of the two animations;

or

(vi) the processing for generating generates, as the first information, swings of a left or a right arm of the human body each of which is obtained in respective different periods during the exercise, and the processing for displaying simultaneously displays two guide lines which respectively represent the swings of the arm and an angle formed therebetween which represents a magnitude of the swings of the arm, on two animations by a skeleton model which reflect the posture of the human body during the exercise and each of which corresponds to the two guide lines, such that the two guide lines are overlapped with the each of the two animations.