Method and system for visualization of athletes

• US 9,836,863 B2
• Filed: 10/15/2012
• Issued: 12/05/2017
• Est. Priority Date: 10/15/2012
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Kennedy, Howard
• Primary Examiner(s): WALKER, JARED T
• Application Number:
  US13/651,762
• Publication Number:
  US 20140104496A1
• Time in Patent Office: 1,877 Days
• Field of Search: 348 77, 348135, 348137, 348140, 348143, 348157, 348169-172, 382106-107
• CPC Class Codes: G06T 11/206 Drawing of charts or graphs
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 23/63 by using electronic viewfinders

Abstract

A system and method for receiving positional data corresponding to stages of movement of a person within a time interval, determining from the positional data, at each stage of movement, one of: a position, an orientation, and a pose of the person, and based on the one of the position, the orientation, and the pose of the person determined for each stage of movement, generating a visualization graphic, separate from a display of the person, that illustrates one of the positions, orientations, and poses of the person at the stages of movement within the time interval.

Claims

1. A method, comprising:

receiving positional data corresponding to stages of movement of a person within a time interval, wherein the person includes a top side, a bottom side, a left side and a right side, the sides being identified relative to a center of mass of the person at a beginning of the time interval;

determining from the positional data, at each stage of movement, a position, an orientation, and a pose of the person; and

based on the position, the orientation, and the pose of the person determined for each stage of movement, generating a visualization graphic, separate from a display of the person, that includes a ribbon orientated to reflect the positions, orientations, and poses of the person at the stages of movement within the time interval, wherein the ribbon includes;

a first surface having a first pattern corresponding to one of a direction the person is facing or the left side of the person, and

a second surface having a second pattern corresponding to one of an opposite direction the person is facing or the right side of the person.

2. The method of claim 1, wherein the visualization graphic includes at least one ghost image reflecting the positions, orientations, and poses of the person at a time in the time interval.

3. The method of claim 1, wherein the determining, at each of a plurality of times within the time interval, one of a position, an orientation, and a pose of the person, comprises:

determining, based on the received positional data, a plurality of central positions of the person in a three-dimensional space, each of the plurality of central positions corresponding to one of the plurality of times;

determining, based on each the plurality of central positions, a plurality of first endpoints of the person in the three-dimensional space and a plurality of second endpoints of the person in the three-dimensional space, each of the plurality of first endpoints and each of the plurality of second endpoints corresponding to one of the central positions and one of the times.

4. The method of claim 3, wherein the generating the visualization graphic, separate from a display of the person, that illustrates the one of the positions, orientations, and poses of the person within the time interval comprises:

generating a plurality of line segments in the three-dimensional space, each of the line segments being generated between one of the plurality of first endpoints and the corresponding one of the plurality of second endpoints, each of the line segments corresponding to one of the sampling times; and

interpolating a path in the three-dimensional space representing motion of the person during the time interval, the path being interpolated between each pair of the line segments corresponding to consecutive sampling times for each stage.

5. The method of claim 4, wherein the generating the visualization graphic, separate from a display of the person, that illustrates the positions, orientations, and poses of the person within the time interval further comprises:

rendering the path into a two-dimensional view.

6. The method of claim 4, further comprising:

deflecting the ribbon from a vertical orientation proportionally to an angular rate of rotation of the person.

7. The method of claim 6, further comprising:

truncating the deflected ribbon.

8. The method of claim 1, wherein a plurality of colors are added to the visualization graphic, each of the plurality of colors representing one of a linear speed of the person, an angular speed of the person, an acceleration of the person, and an amount of rotation of the person.

9. The method of claim 3, wherein the first endpoints correspond to one of the top side and the right side of the person, and wherein the second endpoints correspond to one of the bottom side and the left side of the person.

10. The method of claim 1, wherein the positional data is received from one or more sources, and wherein the sources include one of a video camera and a sensor disposed on the person.

11. The method of claim 1, wherein generating the visualization graphic includes generating a three-dimensional object model.

12. A system, comprising:

a data source collecting positional data corresponding to stages of a movement of a person within a time interval, wherein the person includes a top side, a bottom side, a left side and a right side, the sides being identified relative to a center of mass of the person at a beginning of the time interval; and

a data server, comprising;

a data receiving module receiving the positional data;

a calculation module determining, based on the positional data at each of the stages of movement within the time interval, a position, an orientation and a pose of the person; and

a graphical processing module generating, based on the position, the orientation, and the pose of the person determined for each stage of movement a visualization graphic, separate from a display of the person, that includes a ribbon orientated to reflect the positions, the orientations and the poses of the person at the stages of movement within the time interval, wherein the visualization graphic includes;

a first having a first pattern corresponding to one of a direction the person is facing or the left side of the person, and

a second having a second pattern corresponding to one of an opposite direction the person is facing or the right side of the person.

13. The system of claim 12, wherein the calculation module determines the position, the orientation, and the pose of the person by determining, based on the received positional data, a plurality of central positions of the person in a three-dimensional space, each of the plurality of central positions corresponding to one of the plurality of times, and determining, based on each the plurality of central positions, a plurality of first endpoints of the person in the three-dimensional space and a plurality of second endpoints of the person in the three-dimensional space, each of the plurality of first endpoints and each of the plurality of second endpoints corresponding to one of the central positions and one of the times.

14. The system of claim 13, wherein the graphical processing module generates the visualization graphic by generating a plurality of line segments in the three-dimensional space, each of the line segments being generated between one of the plurality of first endpoints and the corresponding one of the plurality of second endpoints, each of the line segments corresponding to one of the sampling times, and interpolating a path in the three-dimensional space representing motion of the person during the time interval, the path being interpolated between each pair of the line segments corresponding to consecutive sampling times for each stage.

15. The system of claim 12, wherein the person is an athlete and the time interval is a duration of a sporting event.

16. The system of claim 12, wherein the positional data source comprises one of a video camera and a sensor disposed on the person.

17. The system of claim 16, wherein a two-dimensional view is a view of a video broadcast of the person during the time interval, and wherein the graphical processing module further superimposes the two-dimensional view over the video broadcast.

18. The system of claim 12, further comprising:

a broadcast server providing data relating the visualization graphic to a user terminal.

19. The system of claim 18, wherein the broadcast server provides the data by means one of a television broadcast and a data stream transmitted over a packet network.