INFORMATION PROCESSING DEVICE, RECORDING MEDIUM, AND INFORMATION PROCESSING METHOD

• US 20160205317A1
• Filed: 09/29/2014
• Published: 07/14/2016
• Est. Priority Date: 10/24/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: FUKASAWA, Naofumi, KIMURA, Takaomi, MATSUNAGA, Hideyuki, YAMASHITA, Kosei
• Granted Patent: US 10,070,046 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 2503/10 Athletes
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G09B 19/0038 Sports
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes

Abstract

A non-transitory computer readable storage device includes a storage medium having a downloaded application stored therein. The downloaded application has instructions that when executed by processing circuitry configure the processing circuitry to receive sensor data from a sensor. The sensor is attached to a person or attached to an item used by the person. The processing circuitry also analyzes a motion pattern in the sensor data to identify a predetermined event in the motion pattern, the predetermined event captured in an image or series of images by an image capture device.

Claims

1. A non-transitory computer readable storage device comprising:

a storage medium having an application stored therein, the application having instructions that when executed by processing circuitry configure the processing circuitry to

receive sensor data from a sensor, the sensor being attached to a person or attached to an item used by the person; and

analyze a motion pattern in the sensor data to identify a predetermined event in the motion pattern, the predetermined event captured in an image or series of images by an image capture device.

2. The non-transitory computer readable storage device of claim 1, wherein the instructions further configure the processing circuitry to generate a control signal to control an image capture process in the image capture device to select the image or series of images, wherein the item is an object.

3. The non-transitory computer readable storage device of claim 2, wherein the control signal includes an image capture start command and/or end command based on an analysis result of the motion pattern.

4. The non-transitory computer readable storage device of claim 2, wherein the instructions further configure the processing circuitry to generate the control signal with information that specifies a time that serves as an image selection reference.

5. The non-transitory computer readable storage device of claim 4, wherein the instructions further configure the processing circuitry to generate the control signal with a time adjust command to adjust a time associated with the sensor data to match an image capture time.

6. The non-transitory computer readable storage device of claim 1, wherein the instructions further configure the processing circuitry to receive images from the image capture device, wherein the item is an object.

7. The non-transitory computer readable storage device of claim 6, wherein the instructions further configure the processing circuitry to learn the motion pattern from the images received from the image capture device.

8. The non-transitory computer readable storage device of claim 4, wherein the time corresponds with a predetermined event in the motion pattern.

9. The non-transitory computer readable storage device of claim 8, wherein the predetermined event corresponds to an impact on an object by the person or the item used by the person.

10. The non-transitory computer readable storage device of claim 2, wherein the instructions further configure the processing circuitry to transmit the control signal to another device, and receive the sensor data from the another device, the another device being a smartphone or wearable computer.

11. The non-transitory computer readable storage device of claim 10, wherein the image capture device is a different device than the another device.

12. The non-transitory computer readable storage device of claim 11, wherein image capture device uploads images directly to the processing circuitry and the another device relays the sensor data to the processing circuitry.

13. The non-transitory computer readable storage device of claim 1, wherein the application is a downloaded application, and the item is an object.

14. The non-transitory computer readable storage device of claim 2, wherein the instructions further configure the processing circuitry to synchronize the sensor data with the image or series of images captured by the image capture device.

15. The non-transitory computer readable storage device of claim 1, wherein the instructions further configure the processing circuitry to detect an impact occurrence as the predetermined event and select a portion of a series of consecutive images captured before and after the impact occurrence, and the item is an object.

16. The non-transitory computer readable storage device of claim 15, wherein the instructions further configure the processing circuitry to select the portion of the series of consecutive images by skipping some images in a predetermined section of the series of consecutive images before and after the impact occurrence.

17. The non-transitory computer readable storage device of claim 16, wherein an image skipping interval increases as a temporal separation increases relative to the impact occurrence.

18. An information processing system comprising:

circuitry, the circuitry configured by computer readable instructions to receive sensor data collected by a sensor attached to a person or attached to an item used by the person; and

analyze a motion pattern in the sensor data to identify a predetermined event in the motion pattern, the predetermined event captured in an image or series of images by an image capture device.

19. The system of claim 18, wherein

the circuitry includes a first part disposed in a first device that analyzes the motion pattern, and a second part that is disposed in a second device that sends the sensor data to the first device, and

the first device and the second device being separate devices, wherein the item is an object.

20. The system of claim 19, wherein

the first device is included in one of a smartphone and a wearable computer.