Information processing device, recording medium, and information processing method

• US 10,070,046 B2
• Filed: 09/29/2014
• Issued: 09/04/2018
• Est. Priority Date: 10/24/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Kimura, Takaomi, Matsunaga, Hideyuki, Yamashita, Kosei, Fukasawa, Naofumi
• Primary Examiner(s): Berhan, Ahmed A
• Application Number:
  US14/917,201
• Publication Number:
  US 20160205317A1
• Time in Patent Office: 1,436 Days
• CPC Class Codes: A61B 2503/10 Athletes
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G09B 19/0038 Sports
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes

Abstract

A non-transitory computer readable storage device includes a storage medium having a downloaded application stored therein. The downloaded application has instructions that when executed by processing circuitry configure the processing circuitry to receive sensor data from a sensor. The sensor is attached to a person or attached to an item used by the person. The processing circuitry also analyzes a motion pattern in the sensor data to identify a predetermined event in the motion pattern, the predetermined event captured in an image or series of images by an image capture device.

Claims

1. A non-transitory computer readable storage device having computer-readable instructions of an application thereon which when executed by processing circuitry cause the processing circuitry to perform a method comprising:

receiving sensor data from a sensor, the sensor being attached to a person or attached to an item used by the person;

analyzing a motion pattern in the sensor data to identify a predetermined event in the motion pattern, the predetermined event being captured in an image or series of images by an image capture device;

generating a control signal to control an image capture process in the image capture device to select the image or series of images;

generating the control signal with information that specifies a time that serves as an image selection reference; and

selecting a portion of a series of consecutive images captured before and after the predetermined event by skipping, at unequal intervals with reference to the predetermined event, some images of the series of consecutive images before and after the predetermined event.

2. The non-transitory computer readable storage device of claim 1,

wherein the item is an object.

3. The non-transitory computer readable storage device of claim 2, wherein the control signal includes an image capture start command and/or end command based on an analysis result of the motion pattern.

4. The non-transitory computer readable storage device of claim 2, wherein the method further comprises:

transmitting the control signal to another device, and

receiving the sensor data from the another device, the another device being a smartphone or wearable computer.

5. The non-transitory computer readable storage device of claim 4, wherein the image capture device is a different device than the another device.

6. The non-transitory computer readable storage device of claim 5, wherein image capture device uploads images directly to the processing circuitry and the another device relays the sensor data to the processing circuitry.

7. The non-transitory computer readable storage device of claim 2, wherein the method further comprises:

synchronizing the sensor data with the image or series of images captured by the image capture device.

8. The non-transitory computer readable storage device of claim 1, wherein the method further comprises:

generating the control signal with a time adjust command to adjust a time associated with the sensor data to match an image capture time.

9. The non-transitory computer readable storage device of claim 1, wherein the method further comprises:

receiving images from the image capture device,

wherein the item is an object.

10. The non-transitory computer readable storage device of claim 9, wherein the method further comprises:

learning the motion pattern from the images received from the image capture device.

11. The non-transitory computer readable storage device of claim 1, wherein the time corresponds with a predetermined event in the motion pattern.

12. The non-transitory computer readable storage device of claim 11, wherein the predetermined event corresponds to an impact on an object by the person or the item used by the person.

13. The non-transitory computer readable storage device of claim 1, wherein the application is a downloaded application, and the item is an object.

14. The non-transitory computer readable storage device of claim 1, wherein the method further comprises:

detecting an impact occurrence as the predetermined event,

wherein the item is an object.

15. The non-transitory computer readable storage device of claim 14, wherein an image skipping interval increases as a temporal separation increases relative to the impact occurrence.

16. An information processing system comprising:

processing circuitry configured to

receive sensor data collected by a sensor attached to a person or attached to an item used by the person,

analyze a motion pattern in the sensor data to identify a predetermined event in the motion pattern, the predetermined event being captured in an image or series of images by an image capture device,

generate a control signal to control an image capture process in the image capture device to select the image or series of images,

generate the control signal with information that specifies a time that serves as an image selection reference, and

select a portion of a series of consecutive images captured before and after the predetermined event by skipping, at unequal intervals with reference to the predetermined event, some images of the series of consecutive images before and after the predetermined event.

17. The system of claim 16, wherein the processing circuitry is included in one of a smartphone and a wearable computer.

18. A method comprising:

receiving sensor data from a sensor, the sensor being attached to a person or attached to an item used by the person;

analyzing, via processing circuitry, a motion pattern in the sensor data to identify a predetermined event in the motion pattern, the predetermined event being captured in an image or series of images by an image capture device;

generating, via the processing circuitry, a control signal to control an image capture process in the image capture device to select the image or series of images;

generating, via the processing circuitry, the control signal with information that specifies a time that serves as an image selection reference; and

selecting a portion of a series of consecutive images captured before and after the predetermined event by skipping, at unequal intervals with reference to the predetermined event, some images of the series of consecutive images before and after the predetermined event.

19. The method of claim 18, wherein

the predetermined event corresponds to an impact of a ball with the item used by the person,

the predetermined event is associated with one image, and

the selecting does not skip images immediately before and immediately after the one image associated with the predetermined event, which corresponds to the impact of the ball with the item used by the person.