Feedback provision method, system, and analysis device

• US 10,497,277 B2
• Filed: 06/16/2015
• Issued: 12/03/2019
• Est. Priority Date: 08/28/2014
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Matsunaga, Hideyuki
• Primary Examiner(s): Deodhar, Omkar A
• Application Number:
  US15/325,248
• Publication Number:
  US 20170186335A1
• Time in Patent Office: 1,631 Days
• CPC Class Codes: A63B 2220/40 Acceleration
• CPC Class Codes: A63B 2220/72 Temperature
• CPC Class Codes: A63B 2220/75 Humidity
• CPC Class Codes: A63B 2220/803 Motion sensors
• CPC Class Codes: A63B 2220/805 Optical or opto-electronic sensors
• CPC Class Codes: A63B 2220/808 Microphones
• CPC Class Codes: A63B 2220/833 Sensors arranged on the exercise apparatus or sports implement
• CPC Class Codes: A63B 2220/89 Field sensors, e.g. radar systems
• CPC Class Codes: A63B 24/0006 Computerised comparison for qualitative assessment of motion sequences or the course of a movement
• CPC Class Codes: A63B 60/46 Measurement devices associated with golf clubs, bats, rackets or the like for measuring physical parameters relating to sporting activity, e.g. baseball bats with impact indicators or bracelets for measuring the golf swing
• CPC Class Codes: A63B 69/38 for tennis A63B61/006, A63B69/0073 and A63B69/0097 take precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G09B 19/0038 Sports

Abstract

There is provided a feedback provision method including specifying, by a processor, an action generated in a target and a generation time of the action on the basis of sensing data of the target, determining feedback to be provided in accordance with the specified action, and providing the feedback at a time corresponding to the generation time.

Claims

1. A system, comprising:

circuitry configured to;

receive sensor data;

process the sensor data to identify a first action at a first time generated at a target by recognizing a pattern of the sensor data corresponding to the first action;

identify a generation time of a second action to be generated at the target by assuming sensor data subsequent to the first time conforms to the pattern of the sensor data corresponding to the first action, the second action being to be generated after the first action, the generation time being a second time after the first time, the second time being a time at which the second action is to be generated;

determine feedback to be provided in accordance with the identified first action; and

provide at least one of vibrations and audio, that represent the determined feedback, at a timing based on the identified generation time.

2. The system of claim 1, wherein the circuitry is configured to recognize the pattern by a partial matching between the sensor data and the pattern.

3. The system of claim 1, wherein the circuitry is configured to:

identify a class of the first action; and

determine the feedback by selecting feedback from among feedback prepared for each class of the first action.

4. The system of claim 3, wherein

the class of the first action is defined in accordance with at least one of a type of the first action or a degree of skill of the first action.

5. The system of claim 3, wherein

the first action includes causing an impact upon a hitting tool, and

the class of the first action is defined in accordance with a position on the hitting tool where the impact has occurred.

6. The system of claim 1, wherein

the sensor data is provided by a sensor included in, or attached to, a first device, and

the circuitry is configured to provide the at least one of vibrations and audio by using an output device included in, or attached to, the first device.

7. The system of claim 1, wherein

the sensor data is provided by a sensor included in, or attached to, a first device, and

the circuitry is configured to provide the at least one of vibrations and audio by using an output device included in, or attached to, a second device different from the first device.

8. The system of claim 1, wherein

at a time when a picture acquired together with the sensor data is reproduced, the circuitry is configured to provide the at least one of vibrations and audio at a time corresponding to an action in the picture.

9. The system of claim 1, wherein

the at least one of vibrations and audio are generated based on sensor data acquired in the past.

10. The system of claim 9, wherein

the at least one of vibrations and audio are generated based on sensor data of a first user acquired in the past, and is provided to the first user.

11. The system of claim 9, wherein

the at least one of vibrations and audio are generated based on sensor data of a first user acquired in the past, and is provided to a second user.

12. The system of claim 9, wherein

the at least one of vibrations and audio are generated by extending the sensor data acquired in the past.

13. The system of claim 12, wherein

the at least one of vibrations and audio are generated by equalizing or amplifying a vibration waveform included in the sensor data acquired in the past.

14. The system of claim 9, wherein

the at least one of vibrations and audio are generated based on abstract information extracted from the sensor data acquired in the past.

15. The system of claim 14, wherein

the at least one of vibrations and audio express symbolic information that expresses the abstract information.

16. The system of claim 1, wherein

the system is an electronic device.

17. The system of claim 1, further comprising:

a sensor configured to capture signals and generate and output the sensor data based on the signals; and

an electronic device including the circuitry.

20. The system of claim 7, wherein

the second device is a wearable device worn by a user.

21. The system of claim 1, wherein

the circuitry is configured to identify the generation time of the second action prior to the second action actually being generated.

22. The system of claim 1, wherein

the sensor data is audio sensor data.

18. A system comprising:

a sensor device configured to;

capture signals corresponding to a target; and

generate sensor data based on the signals; and

circuitry configured to;

process the sensor data, generated by the sensor device, to identify a first action at a first time generated at the target by recognizing a pattern of the sensor data corresponding to the first action;

identify a generation time of a second action to be generated at the target by assuming sensor data subsequent to the first time conforms to the pattern of the sensor data corresponding to the first action, the second action being to be generated after the first action, the generation time being a second time after the first time, the second time being a time at which the second action is to be generated;

determine feedback to be provided in accordance with the identified first action; and

output at least one of vibrations and audio, that represents the determined feedback, at a timing based on the identified generation time.

23. The system of claim 18, wherein

the signals are audio signals, and

the sensor data is audio sensor data.

19. A non-transitory computer-readable medium including computer program instructions, which when executed by a system, cause the system to:

receive sensor data;

process the sensor data to identify a first action at a first time generated at a target by recognizing a pattern of the sensor data corresponding to the first action;

identify a generation time of a second action to be generated at the target by assuming sensor data subsequent to the first time conforms to the pattern of the sensor data corresponding to the first action, the second action being to be generated after the first action, the generation time being a second time after the first time, the second time being a time at which the second action is to be generated;

determine feedback to be provided in accordance with the identified first action; and

provide at least one of vibrations and audio, that represent the determined feedback, at a timing based on the identified generation time.

24. The non-transitory computer-readable medium of claim 19, wherein

the sensor data is audio sensor data.