System, method and computer program for creating two dimensional (2D) or three dimensional (3D) computer animation from video

• US 7,675,520 B2
• Filed: 12/07/2006
• Issued: 03/09/2010
• Est. Priority Date: 12/09/2005
• Status: Active Grant

• Current Assignee: Digital Steamworks
• Original Assignee: Digital Steamworks
• Inventors: Thompson, David, Deriso, Martin, Gee, Will, Taylor, Murray
• Primary Examiner(s): Nguyen; Kimbinh T
• Application Number:
  US11/635,001
• Publication Number:
  US 20070146372A1
• Time in Patent Office: 1,188 Days
• Field of Search: 345/473, 345/474, 345/619, 348/143, 707/200
• US Class Current: 345/473
• CPC Class Codes: G06T 13/00 Animation
• CPC Class Codes: G06T 13/20 3D [Three Dimensional] animation

Abstract

In an exemplary embodiment of the present invention a system, method and computer program product for creating at least a two dimensional or three dimensional (3D) datastream from a video with moving objects is disclosed. In an exemplary embodiment of the present invention, a method of creating animated objects in 2D or 3D from video, may include: receiving video information which may include a plurality of frames of digital video; receiving and adding metadata to the video information, the metadata relating to at least one object in motion in the digital video; and interpreting the metadata and the video information and generating a datastream in at least 2D. In an exemplary embodiment, 2D, 3D or more dimensional data may be used to provide an animation of the event of which the video was made. In an exemplary embodiment, a 2D or 3D gametracker, or play reviewer may be provided allowing animation of motion events captured in the video.

Claims

1. A method of creating at least two dimensional (2D) data from video, comprising:

receiving, by at least one computer, video information comprising a plurality of frames of digital video;

receiving, by the at least one computer, metadata, said metadata relating to at least one object in motion in said digital video;

creating, by the at least one computer, an animated and annotated boxes file based on said metadata;

calculating, by the at least one computer, relative blend weights for movement animations of said at least one object in motion; and

generating, by the at least one computer, at least 2D data from said animated and annotated boxes file and said relative blend weights.

2. The method according to claim 1, wherein said receiving, by the at least one computer, said metadata comprises:

receiving, by the at least one computer, said metadata from at least one of a person, an agent or a software agent.

3. The method according to claim 1, wherein said receiving said metadata comprises at least one of:

receiving discrete event information about said object in motion,

receiving ongoing event information about said object in motion,

receiving movement information,

receiving camera movement information;

receiving camera pan/rotation/location/zoom information;

receiving state information,

receiving a starting position, or

receiving an ending position.

4. The method according to claim 1, wherein said receiving said metadata comprises at least one of:

receiving discrete event information about said object in motion, or

receiving ongoing event information about said object in motion.

5. The method according to claim 1, wherein said receiving said metadata comprises at least one of:

receiving discrete event information, or

receiving a state of motion.

6. The method according to claim 5, wherein said receiving said metadata further comprises:

receiving a starting position.

7. The method according to claim 1, further comprising:

providing, by the at least one computer, for export of said at least two dimensional (2D) data.

8. The method according to claim 1, further comprising:

providing, by the at least one computer, for rendering said at least two dimensional (2D) data.

9. The method according to claim 1, further comprising:

providing, by the at least one computer, for interactive access using a multidimensional player of said at least two dimensional (2D) data.

10. The method according to claim 1, further comprising:

creating, by the at least one computer, a virtual camera and matching said virtual camera'"'"'s motion to observed motion of a camera originally capturing said video information.

11. The method according to claim 10, wherein said matching said camera motion comprises at least one of:

matching using a brute force method;

matching using a software application;

matching using a motion tracking process;

matching using an automated camera location generating process;

matching using a radio frequency identifier (RFID) capable of determining a location of said object in motion;

matching using a global positioning system (GPS) positioning system of determining a location of said object in motion;

matching using an instrumented camera metadata stream;

matching using a camera based system for determining a location of said object in motion;

or

matching using georeferencing a location of said object in motion.

12. The method according to claim 1, wherein said receiving, by the at least one computer, said video information comprises at least one of:

receiving, by the at least one computer, video footage from a single camera;

or

receiving, by the at least one computer, video footage from a plurality of cameras.

13. The method according to claim 1, wherein said receiving, by the at least one computer, said video information comprises:

receiving, by the at least one computer, sporting event video footage.

14. The method according to claim 13, wherein said receiving, by The at least one computer, said sporting event video footage comprises at least one of:

receiving, by the at least one computer, footage of at least one team of players;

receiving, by the at least one computer, team sporting event footage;

receiving, by the at least one computer, football footage;

receiving, by the at least one computer, basketball footage;

receiving, by the at least one computer, soccer footage;

receiving, by the at least one computer, hockey footage;

receiving, by the at least one computer, tennis footage;

receiving, by the at least one computer, individual sport footage;

receiving, by the at least one computer, baseball footage;

receiving, by the at least one computer, NASCAR®

racing footage;

receiving, by the at least one computer, FORMULA ONE®

racing footage;

receiving, by the at least one computer, car racing footage;

receiving, by the at least one computer, horse racing footage;

receiving, by the at least one computer, OLYMPIC®

sporting event footage;

receiving, by the at least one computer, bowling footage;

or

receiving, by the at least one computer, golf footage.

15. The method according to claim 1, wherein said receiving, by the at least one computer, said video information comprises:

receiving, by the at least one computer, football video footage comprising two opposing teams of players engaged in playing a series of plays, and

wherein said plays comprise at least one of;

an offensive play,

a defensive play, or

a special teams play.

16. The method according to claim 1, wherein said receiving, by the at least one computer, said video information comprises:

receiving, by the at least one computer, surveillance video footage.

17. The method according to claim 1, wherein said receiving, by the at least one computer, said video information comprises:

receiving, by the at least one computer, military video footage.

18. The method according to claim 1, wherein said receiving, by the at least one computer, said video information comprises:

receiving, by the at least one computer, security camera video footage.

19. The method according to claim 1, wherein said receiving, by the at least one computer, said metadata comprises:

providing, by the at least one computer, a moving object tool.

20. The method according to claim 19, wherein said providing, by the at least one computer, said moving object tool comprises at least one of:

providing, by the at least one computer, at least one directional object identifier representing said object in motion;

or

receiving, by the at least one computer, an indication of at least one of the proper location or orientation of said directional object for a given frame of said video information.

21. The method according to claim 19, wherein said providing, by the at least one computer, said moving object tool comprises at least one of:

providing, by the at least one computer, a plurality of directional object identifiers representing each of a plurality of objects in motion;

or

receiving, by the at least one computer, an indication of the proper locations and orientations of each of said directional objects for a given frame of said video information.

22. The method according to claim 21, wherein said providing, by the at least one computer, said plurality of directional object identifiers comprises:

providing, by the at least one computer, one of said plurality of directional object identifiers for at least one participant of at least one team appearing in said video information.

23. The method according to claim 22, wherein said providing, by the at least one computer, said plurality of directional object identifiers comprises:

providing, by the at least one computer, a plurality of extruded polygon directional object identifiers.

24. The method according to claim 23, wherein said providing, by the at least one computer, said plurality of extruded polygon directional object identifiers comprises:

providing, by the at least one computer, a plurality of homeplate-shaped pentagonally extruded directional object identifiers, wherein a pointed end of each of said identifiers is pointed in a direction of movement of each of said participants.

25. The method according to claim 19, wherein said providing, by the at least one computer, said moving object tool comprises at least one of:

providing, by the at least one computer, a block out tool for scrubbing said video information, or

allowing, by the at least one computer, movement of or rotation of said directional object identifiers.

26. The method according to claim 21, wherein said providing, by the at least one computer, said moving object tool comprises at least one of:

providing, by the at least one computer, a block out tool for scrubbing said video information, or

allowing, by the at least one computer, movement of or rotation of said directional object identifiers.

27. The method according to claim 21, wherein said generating, by the at least one computer, at least 2D data comprises:

selecting, by the at least one computer, from a plurality of predetermined animation objects, a selected animation object to associate with said directional object.

28. The method according to claim 26, wherein said generating, by the at least one computer, at least 2D data comprises:

selecting, by the at least one computer, from a plurality of predetermined animation objects, a selected animation object to associate with said directional object.

29. The method according to claim 21, wherein said generating, by the at least one computer, at least 2D data comprises:

replacing, by the at least one computer, said directional object with an at least 2D character object.

30. The method according to claim 28, wherein said generating, by the at least one computer, at least 2D data comprises:

replacing, by the at least one computer, said directional object with an at least 2D character object.

31. The method according to claim 19, wherein said providing, by the at least one computer, said moving object tool comprises:

providing, by the at least one computer, a ball object identifier.

32. The method according to claim 31, wherein said generating, by the at least one computer, at least 2D data comprises:

adding, by the at least one computer, a ball object.

33. The method according to claim 19, wherein said providing, by the at least one computer, said moving object tool comprises:

providing, by the at least one computer, a first down line, or

providing, by the at least one computer, a plane object identifier.

34. The method according to claim 19, wherein said providing, by the at least one computer, said moving object tool comprises:

providing, by the at least one computer, an end zone line, or

providing, by the at least one computer, a plane object identifier.

35. The method according to claim 1, wherein said generating, by the at least one computer, at least 2D data comprises:

generating, by the at least one computer, a 3D animation.

36. The method according to claim 1, wherein said generating, by the at least one computer, at least 2D data comprises:

generating, by the at least one computer, an enhanced 2D realtime animation online gametracker.

37. The method according to claim 1, wherein said generating, by the at least one computer, at least 2D data comprises:

generating, by the at least one computer, an enhanced simulated 3D realtime animation online gametracker.

38. A system of creating at least two dimensional (2D) data from video, comprising:

means for receiving video information comprising a plurality of frames of digital video;

means for receiving metadata, said metadata relating to at least one object in motion in said digital video;

means for creating an animated and annotated boxes file based on said metadata;

means for calculating relative blend weights for movement animations of said at least one object in motion; and

means for generating at least 2D data from said animated and annotated boxes file and said relative blend weights.

39. A machine-readable storage medium that provides instructions on said storage medium, which when executed by at least one computing platform, cause said at least one computing platform to perform operations creating at least two dimensional (2D) data from video, said operations comprising a method comprising:

receiving, by the at least one computing platform, video information comprising a plurality of frames of digital video;

receiving, by the at least one computing platform, metadata, said metadata relating to at least one object in motion in said digital video;

creating, by the at least one computing platform, an animated and annotated boxes file based on said metadata;

calculating, by the at least one computing platform, relative blend weights for movement animations of said at least one object in motion; and

generating, by the at least one computing platform, at least 2D data from said animated and annotated boxes file and said relative blend weights.

40. The machine-readable storage medium according to claim 39, wherein the method may further include:

providing, by the at least one computing platform, a data stream of at least 2D animation data for integration with at least one other product, said other product comprising at least one of;

an online game tracker application,

a fantasy football enhanced tracking site,

a television broadcast;

or

an online broadcast.

41. A system of creating at least two dimensional (2D) data from video data captured from a video source, comprising:

a bus adapted to receive the video data;

at least one processor coupled to said bus, wherein said at least one processor is adapted to generate and animated and annotated boxes file based on metadata relating to at least one object in motion in the video data, to calculate relative blend weights for movement animations of the at least one object in motion, and to generate at least 2D data from said animated and annotated boxes file and said relative blend weights; and

a storage device coupled to said bus, wherein said storage device is adapted to store the at least 2D data.

42. The system according to claim 41, further comprising:

a video input device coupled to the video source, wherein said video input device is coupled to said bus and adapted to receive video information comprising a plurality of frames of digital video.

43. The system according to claim 41, further comprising:

a control interface coupled to said bus, wherein said control interface is adapted to receive the metadata.

44. The system according to claim 41, further comprising:

an output device coupled to said bus, wherein said output device is adapted to display the at least 2D data.