Selecting And Correlating Physical Activity Data With Image Data

• US 20120212505A1
• Filed: 02/17/2012
• Published: 08/23/2012
• Est. Priority Date: 02/17/2011
• Status: Active Grant

• Current Assignee: Nike, Inc.
• Original Assignee: Nike, Inc.
• Inventors: Burroughs, Brandon S., Hailey, Michael Benjamin
• Granted Patent: US 9,411,940 B2
• Time in Patent Office: Days
• US Class Current: 345/629
• CPC Class Codes: A63B 2225/50 Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 24/0062 Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance
• CPC Class Codes: A63B 43/00 Balls with special arrangements
• CPC Class Codes: A63B 43/06 with illuminating devices ; with reflective surfaces
• CPC Class Codes: A63B 71/0622 Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
• CPC Class Codes: G09B 19/0038 Sports
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

Example embodiments may relate systems, methods, apparatuses, and computer readable media configured to correlate image data of a user performing physical activity with data collected during the user'"'"'s performance. Data may include sensor data measuring, force, acceleration, speed, and/or processed sensor data from one or more sensors. Certain embodiments may determine whether the user is within a performance zone based on user attributes. Correlation of the image data with physical activity data may be based, at least in part, whether the user is within a performance zone.

Claims

1. A computer-implemented method comprising:

receiving physical activity data relating to the performance of a physical activity by a first user comprising data generated by or derived from a force sensor;

determining that at least a portion of the physical activity data is indicative of the first user being within a performance zone;

correlating image data captured during the first user'"'"'s performance with the physical activity data indicative of the first user being within the performance zone, such that physical activity data is matched to the image data corresponding to the timing of capture;

identifying at least a portion of physical activity data to be overlaid with the corresponding correlated image data; and

forming a single file comprising image data and the correlated physical activity data.

2. The method of claim 1, further comprising:

transmitting the single file for display on a display device.

3. The method of claim 2, wherein the correlating of the image data and the physical activity data occurs, at least in part, on a mobile terminal and the display device is a screen operatively connected to the mobile terminal.

4. The method of claim 1, further comprising:

displaying the correlated image data and at least a first portion of physical activity data on a first display device; and

displaying the correlated image data and at least a second portion of physical activity data on a second display device.

5. The method of claim 1, further comprising:

receiving a first overlay input configured to display a first portion of activity data with a corresponding portion of correlated image data; and

receiving a second overlay input configured to display a second portion of activity data with the corresponding segment of correlated image data.

6. The method of claim 1, wherein the received physical activity data includes data selected from the group consisting of:

processed data, raw data, and combinations thereof.

7. The method of claim 1, wherein the performance zone is a first performance zone comprising at least one criterion that differs from a second performance zone, the method further comprising:

identifying physical activity data to be overlaid on the corresponding correlated image data based on, at least in part, the determination that the user was in the first performance zone during the capturing of at least a portion of the activity data.

8. The method of claim 7, wherein the first performance zone comprises at least one criterion selected from the group consisting of:

a minimum height for a vertical leap, a minimum rate of acceleration, threshold force upon the force sensor, and combinations thereof.

9. The method of claim 1, wherein the image data is received from a mobile terminal and the force sensor is configured to be in operative connection with a shoe.

10. The method of claim 1, further comprising:

determining a most favorable value of a first physical activity parameter for at least one of the first user and the second user obtained during capturing of the image data; and

designating an image from the image data correlated with the physical activity data comprising the most favorable value as a representative image.

11. The method of claim 10, wherein the first physical parameter is selected from the group consisting of:

height for a vertical leap, rate of acceleration, force upon the force sensor, and combinations thereof.

12. The method of claim 1, further comprising:

from the physical data obtained during the capturing of the image data, determining the image data correlated with at least one instance of the user being in a performance zone; and

designating an image from the image data correlated with a single instance of the at least one instance of the user being in the performance zone as a representative image.

13. The method of claim 12, wherein the at least one instance comprises a plurality of instances and the method further comprises:

creating a highlight reel comprising the images associated with the user being within the single instance.

14. The method of claim 1, wherein the first user and a second user are participating in a sporting event, the method further comprising:

receiving physical activity data relating to the performance of a physical activity by the second user comprising data generated by or derived from a force sensor;

determining that at least a portion of the physical activity data is indicative of the second user being within a performance zone;

correlating image data captured during the second user'"'"'s performance with the physical activity data indicative of the second user being within the performance zone, such that physical activity data is matched to the image data corresponding to the timing of capture;

identifying at least a portion of physical activity data to be overlaid with the corresponding correlated image data of the second user; and

forming a single file comprising image data and the correlated physical activity data of the second user.

15. The method of claim 14, wherein the single file comprising the image data of the first user is the same file as the single file comprising the image data of the second user.

16. The method of claim 14, further comprising:

determining a most favorable value of a first physical activity parameter for at least one of the first user and the second user obtained during capturing of the image data; and

designating an image from the image data correlated with the physical activity data comprising the most favorable value as a representative image.

17. The method of claim 16, wherein the first physical activity parameter is selected from the group consisting of:

height for a vertical leap, rate of acceleration, force upon the force sensor, and combinations thereof.

18. The method of claim 1, further comprising:

from the physical data obtained during the capturing of the image data, determining the image data correlated with at least instance of the first user being in a performance zone; and

designating an image from the image data correlated with an instance of the at least one instance of the user being in the performance zone as a representative image.

19. The method of claim 1, wherein the at least one instance comprises a plurality of instances that the first user and the second user are within a performance zone, and the method further comprises:

creating a highlight reel comprising the images associated with the first user and the second user being within the instances.

20. A computer-implemented method comprising:

receiving physical activity data of a first user performing a physical activity during a first time frame;

determining that at least a portion of the physical activity data captured during the first time frame is indicative of the first user being within a performance zone within a first time period of the time frame, wherein the first performance zone comprises at least one criterion selected from the group consisting of;

a minimum height for a vertical leap, a minimum rate of acceleration, threshold force upon the force sensor, and combinations thereof;

correlating image data of the first user captured during the first time period with the physical activity data indicative of the first user being within the performance zone, such that physical activity data is matched to the image data corresponding to the timing of capture;

based on, at least in part, the determined performance zone, correlating image data of the first user captured for a second time period within the first time frame that is predetermined time period adjacent to the first time period, with corresponding physical activity data, such that physical activity data is matched to the image data corresponding to the timing of capture; and

identifying at least a portion of physical activity data to be overlaid with the corresponding correlated image data for the first time period and the second time period.

21. The method of claim 20, wherein the image data is obtained from a mobile terminal, the correlating of the image data and the physical activity data occurs, at least in part, on the mobile terminal, and the method further comprising:

displaying correlated image data and physical activity data on a display device of the mobile terminal.

22. The method of claim 21, further comprising:

receiving a first overlay input configured to display a first portion of activity data overlaid on first corresponding segment of correlated image data; and

receiving a second overlay input configured to display a second portion of activity data overlaid on the first corresponding segment of correlated image data.

23. The method of claim 20, wherein the performance zone is a first performance zone with at least one criterion that differs from a second performance zone, the method further comprising:

identifying physical activity data to be overlaid on the corresponding correlated image data based on, at least in part, the determination that the user was in the first performance zone during the capturing of at least a portion of the activity data.

24. The method of claim 20, wherein the physical activity data is processed data that utilizes historical data as an input.

25. The method of claim 20, wherein the image data and physical activity data is captured during a predefined segment of an athletic event comprising a plurality of users performing athletic activity, the method further comprising:

after the predefined segment of the athletic event, selecting the first user from at least a portion of the plurality of users based upon at the physical activity data; and

transmitting a first overlay input configured to cause display of a first portion of activity data overlaid on first corresponding segment of correlated image data.

26. The method of claim 20, wherein the image data and physical activity data is captured during a predefined segment of an athletic event comprising a plurality of users performing athletic activity, the method further comprising:

before the occurrence of the predefined segment, adjusting the reception of physical activity data to be received during the during the predefined segment.

27. The method of claim 20, further comprising:

determining that athletic data correlated with the image data obtained during the first time frame meets a first user-defined threshold; and

based upon the determination that data meets the first user-defined threshold, transmitting correlated data to a social networking site.

28. A non-transitory computer-readable medium comprising computer-executable instructions, that when executed by a processor, perform a computer-implemented method comprising:

receiving physical activity data of a first user performing a physical activity during a first time frame;

determining that at least a portion of the physical activity data captured during the first time frame is indicative of the first user being within a performance zone within a first time period of the time frame, wherein the first performance zone comprises at least one criterion selected from the group consisting of;

a minimum height for a vertical leap, a minimum rate of acceleration, threshold force upon the force sensor, and combinations thereof;

correlating image data of the first user captured during a first time period with the physical activity data indicative of the user being within the performance zone, such that physical activity data is matched to the image data corresponding to the timing of capture;

based on, at least in part, the determined performance zone, correlating image data of the first user captured for a second time period within the time frame that is predetermined time period adjacent to the first time period, with corresponding physical activity data, such that physical activity data is matched to the image data corresponding to the timing of capture; and

identifying at least a portion of physical activity data to be overlaid with the corresponding correlated image data for the first time period and the second time period.