Information processing device, sensor device, information processing system, and storage medium

• US 10,188,324 B2
• Filed: 01/07/2014
• Issued: 01/29/2019
• Est. Priority Date: 03/22/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Matsunaga, Hideyuki, Yamashita, Kosei
• Primary Examiner(s): Kuan, John
• Application Number:
  US14/149,265
• Publication Number:
  US 20140288874A1
• Time in Patent Office: 1,848 Days
• Field of Search: None
• CPC Class Codes: A61B 5/1126 using a particular sensing technique
• CPC Class Codes: A63B 2024/0012 Comparing movements or motion sequences with a registered reference
• CPC Class Codes: A63B 2024/0037 on a target surface or at impact on the ground
• CPC Class Codes: A63B 2024/0043 Systems for locating the point of impact on a specific surface
• CPC Class Codes: A63B 2024/0056 for statistical or strategic analysis
• CPC Class Codes: A63B 2071/0647 Visualisation of executed movements
• CPC Class Codes: A63B 2071/065 Visualisation of specific exercise parameters
• CPC Class Codes: A63B 24/0003 Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
• CPC Class Codes: A63B 71/0619 Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
• CPC Class Codes: G01P 15/00 Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G09B 19/0038 Sports

Abstract

An information processing system includes processing circuitry that is configured to receive input data from a shock sensor which outputs data based on a shock on the shock sensor, and identify a target segment of time-series data that is output from a motion sensor that senses a motion of an object. The target segment includes a pre-shock portion that occurs before the shock event and a post-shock portion that occurs after the shock event, the shock event is recognized based on the data from the shock sensor.

Claims

1. An information processing system comprising:

a shock sensor;

processing circuitry configured to, for each of plural shock events,

receive input data from the shock sensor which outputs data defining a respective shock event,

receive time-series data output from a motion sensor that senses motion of an object, the shock sensor having a greater dynamic range in acceleration than the motion sensor,

set a length of a pre-shock portion of a target segment of the time-series data as a length of the longest pre-shock portion among plural predetermined motion patterns,

set a length of a post-shock portion of the target segment as a length of the longest post-shock portion among the plural predetermined motion patterns,

identify the target segment according to the defined respective shock event and the set lengths of the pre-shock portion and the post-shock portion,

identify an impact position on the object, and

identify the motion of the object as one of the plural predetermined motion patterns based on the identified target segment of the time-series data and a stored dictionary defining each of the plural predetermined motion patterns; and

a display configured to notify a user of the identified one of the plural predetermined motion patterns and display an impact position indicator on the object which is in an orientation corresponding to an actual orientation of the object at a time of impact based on the identified one of the plural predetermined motion patterns and the identified impact position.

2. The information processing system of claim 1, wherein each of the plural shock events includes an impact event including an impact on the object caused by a movement of a user.

3. The information processing system of claim 2, wherein the object is an object held by the user, and the impact event includes a collision by the object and another object.

4. The information processing system of claim 3, wherein the another object is one of a tennis ball, a golf ball, and a baseball.

5. The information processing system of claim 1, wherein the object is a part of a body of a user.

6. The information processing system of claim 1, wherein the shock sensor and the motion sensor are acceleration sensors.

7. The information processing system of claim 1, wherein the system includes the motion sensor, the motion sensor having a greater resolution of acceleration than the shock sensor.

8. The information processing system of claim 7, wherein the motion sensor being configured to detect triaxial acceleration and angular speed.

9. The information processing system of claim 7, wherein the motion sensor transmits the time-series data to the processing circuitry wirelessly.

10. The information processing system of claim 1, wherein the display is configured to display an indication of an impact position of another object on the object.

11. The information processing system of claim 1, wherein the display is configured to display at least one index value associated with an actual motion pattern of the object.

12. The information processing system of claim 1, wherein the processing circuitry is configured to identify the target segment by determining when the input data from the shock sensor exceeds a predetermined threshold, and a frequency of a signal described by the input data from the shock sensor.

13. The information processing system of claim 1, wherein the information processing system is embodied in a watch-type device, and the processing circuitry is configured by a downloadable software application to identify the target segment.

14. An information processing method comprising:

for each of plural shock events,

receiving input data from a shock sensor which is configured to output data defining a respective shock event;

receiving time-series data from a motion sensor that senses motion of an object, the shock sensor having a greater dynamic range in acceleration than the motion sensor;

setting a length of a pre-shock portion of a target segment of the time-series data as a length of the longest pre-shock portion among plural predetermined motion patterns;

setting a length of a post-shock portion of the target segment as a length of the longest post-shock portion among the plural predetermined motion patterns;

identifying with processing circuitry the target segment according to the defined respective shock event and the set lengths of the pre-shock portion and the post-shock portion;

identifying an impact position on the object;

identifying the motion of the object as one of the plural predetermined motion patterns based on the identified target segment of the time-series data and a stored dictionary defining each of the plural predetermined motion patterns; and

notifying a user, via a display, of the identified one of the plural predetermined motion patterns and displaying an impact position indicator on the object which is in an orientation corresponding to an actual orientation of the object at a time of impact based on the identified one of the plural predetermined motion patterns and the identified impact position.

15. A non-transitory computer readable storage device including instructions that when executed by a processor configure the processor to implement an information processing method, the method comprising:

receiving input data from a shock sensor which is configured to output data defining a respective shock event;

receiving time-series data from a motion sensor that senses motion of an object, the shock sensor having a greater dynamic range in acceleration than the motion sensor;

setting a length of a pre-shock portion of a target segment of the time-series data as a length of the longest pre-shock portion among plural predetermined motion patterns;

setting a length of a post-shock portion of the target segment as a length of the longest post-shock portion among the plural predetermined motion patterns;

identifying with processing circuitry the target segment according to the defined respective shock event and the set lengths of the pre-shock portion and the post-shock portion;

identifying an impact position on the object;

identifying the motion of the object as one of the plural predetermined motion patterns based on the identified target segment of the time-series data and a stored dictionary defining each of the plural predetermined motion patterns; and

notifying a user, via a display, of the identified one of the plural predetermined motion patterns and displaying an impact position indicator on the object which is in an orientation corresponding to an actual orientation of the object at a time of impact based on the identified one of the plural predetermined motion patterns and the identified impact position.