Providing graphics in images depicting aerodynamic flows and forces

• US 8,558,883 B2
• Filed: 12/19/2007
• Issued: 10/15/2013
• Est. Priority Date: 07/27/2007
• Status: Active Grant

• Current Assignee: Sportsmedia Technology Corporation
• Original Assignee: Sportvision, Inc. (Sportsmedia Technology Corporation)
• Inventors: Cavallaro, Richard H., Alt, Alina, Elangovan, Vidya, McGuffin, James O., Heidmann, Timothy P., Halper, Reuben
• Primary Examiner(s): Nguyen, Thuong
• Application Number:
  US11/960,527
• Publication Number:
  US 20090027494A1
• Time in Patent Office: 2,127 Days
• Field of Search: 348/135, 348/169, 348/584, 348/590, 348/591, 348/157, 725/105
• US Class Current: 348/135
• CPC Class Codes: A63F 2300/663 for simulating liquid objects, e.g. water, gas, fog, snow, clouds
• CPC Class Codes: A63F 2300/6692 using special effects, generally involving post-processing, e.g. blooming
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: A63F 2300/8017 Driving on land or water; Flying
• CPC Class Codes: G06T 2207/30221 Sports video; Sports image
• CPC Class Codes: G06T 2207/30236 Traffic on road, railway or crossing
• CPC Class Codes: G06T 7/248 involving reference images or patches
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 10/751 Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
• CPC Class Codes: G06V 2201/08 Detecting or categorising vehicles
• CPC Class Codes: H04N 5/265 Mixing
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 5/2723 Insertion of virtual advertisement; Replacing advertisements physical present in the scene by virtual advertisement data processing systems or methods specially adapted for marketing G06Q30/02

Abstract

A video broadcast of a live event is enhanced by providing graphics in the video in real time to depict the fluid flow around a moving object in the event and to provide other informative graphics regarding aerodynamic forces on the object. A detailed flow field around the object is calculated before the event, on an offline basis, for different speeds of the object and different locations of other nearby objects. The fluid flow data is represented by baseline data and modification factors or adjustments which are based on the speed of the object and the locations of the other objects. During the event, the modification factors are applied to the baseline data to determine fluid flow in real time, as the event is captured on video. In an example implementation, the objects are race cars which transmit their location and/or speed to a processing facility which provides the video.

Claims

1. A method for processing image data, comprising:

obtaining an image of a live event, the image is captured by a camera and comprises a representation of an object moving in the live event;

obtaining a current speed of the object which represents a speed of the object in the live event when the image is captured;

accessing a baseline vector field which is computed from a fluid flow model of the object and which represents a fluid flow field around the object at a reference speed of the object, the fluid flow is defined by particles, each particle having a location and a velocity at the location, and for one of the particles, the velocity is initially defined at a reference speed of the object, the reference speed of the object differs from the current speed of the object;

accessing a multiplier which is based on the current speed of the object, from among a plurality of multipliers which are based on different speeds of the object;

adjusting the baseline vector field to obtain an updated vector field which represents a fluid flow field around the object at the current speed of the object, the adjusting comprises multiplying the velocity of the one of the particles by the multiplier; and

using the updated vector field, providing a graphic in the image, the graphic is positioned in the image based on the representation of the object in the image and depicts the fluid flow field around the object at the current speed of the object.

2. The method of claim 1, wherein:

the providing the graphic comprises determining a position of the representation of the object in the image, and positioning the graphic in the image based on the position of the representation of the object in the image.

3. The method of claim 1, further comprising:

determining a distance between the object and another object in the live event;

accessing a modification factor which is based on the distance between the object and the another object in the live event, from among a plurality of modification factors which are based on different distances between the object and the another object; and

based on the modification factor which is based on the distance between the object and the another object in the live event;

adjusting the baseline vector field to obtain the updated vector field.

4. The method of claim 1, wherein:

the graphic depicts fluid flow over and behind the representation of the object, at the current speed.

5. The method of claim 1, further comprising:

determining a position of the object on a track in the live event;

accessing a modification factor which is based on the position of the object on the track in the live event, from among a plurality of modification factors which are based on different positions of the object on the track; and

based on the modification factor which is based on the position of the object on the track in the live event;

adjusting the baseline vector field, to obtain the updated vector field.

6. The method of claim 1, further comprising:

determining a relative location of the object to another object in the live event;

accessing a modification factor which is based on the relative location of the object to the another object in the live event, from among a plurality of modification factors which are based on different relative locations of the object to the another object; and

based on the modification factor which is based on the relative location of the object to the another object in the live event;

adjusting the baseline vector field to obtain the updated vector field.

7. The method of claim 1, further comprising:

obtaining an additional image of the live event, the additional image is captured by the camera and comprises a representation of the object moving in the live event;

obtaining an updated current speed of the object which represents a speed of the object in the live event when the additional image is captured;

accessing a modification factor which is based on the updated current speed of the object, from among the plurality of modification factors which are based on the different speeds of the object;

based on the modification factor which is based on the updated current speed of the object;

adjusting the baseline vector field to obtain an updated adjusted vector field which represents a fluid flow field around the object at the updated current speed of the object; and

using the updated adjusted vector field, updating the graphic in the image to depict the fluid flow field around the object at the updated current speed of the object.

8. The method of claim 1, wherein:

the live event comprises a race and the object comprises a vehicle.

9. The method of claim 1, wherein:

the graphic has an appearance of smoke which is flowing past the object.

10. The method of claim 1, wherein:

the graphic comprises continuous lines which depict streams of particles.

11. The method of claim 1, wherein:

the graphic comprises shapes which have different sizes based on a flow characteristic comprising at least one of pressure, density or velocity.

12. The method of claim 1, wherein:

the graphic distinguishes areas of laminar flow from areas of turbulent flow.

13. The method of claim 1, wherein:

the graphic comprises arrows which depict localized directions of the fluid flow.

14. The method of claim 1, wherein:

the graphic uses a variable level of transparency to depict varying air pressure.

15. The method of claim 1, wherein:

the graphic is more blurred for lower flow speeds and less blurred for higher flow speeds.

16. The method of claim 1, wherein:

the graphic is color coded to the object.

17. The method of claim 1, wherein:

the baseline vector field is computed based on a shape of the object.

18. The method of claim 1, wherein:

the baseline vector field is computed based on a volume containing the object and based on a location of another object in the volume.

19. The method of claim 1, further comprising:

the baseline vector field and the plurality of modification factors are pre-computed before the live event.

20. The method of claim 1, wherein:

the baseline vector field defines velocities of particles at locations in the fluid flow field around the object at the reference speed of the object and an updated vector field which defines updated velocities of the particles at the locations in the fluid flow field around the object at the current speed of the object; and

the particles comprise particles in a volume which contains the object in the fluid flow model.

21. The method of claim 1, further comprising:

accessing baseline aerodynamic force data which indicates an aerodynamic force on the object at the reference speed of the object;

adjusting the baseline aerodynamic force data based on the current speed of the object, to provide an adjusted aerodynamic force on the object; and

providing a graphic which depicts the adjusted aerodynamic force on the object.

22. A system for processing image data, comprising:

a camera, the camera captures an image of a live event, the image comprise a representation of an object moving in the live event; and

a processing facility which receives the image, the processing facility;

obtains information regarding a current speed of the object in the live event, the current speed of the object represents a speed of the object in the live event when the image is captured;

accesses a baseline vector field which is computed from a fluid flow model of the object and which represents a fluid flow field around the object at a reference speed of the object, the fluid flow is defined by particles, each particle having a location and a velocity at the location, and for one of the particles, the velocity is initially defined at a reference speed of the object, the reference speed of the object differs from the current speed of the object;

accesses a multiplier which is based on the current speed of the object, from among a plurality of multiplier which are based on different speeds of the object;

provide an adjustment of the baseline vector field to obtain an updated vector field which represents a fluid flow field around the object at the current speed of the object, the adjustment is provided by multiplying the velocity of the one of the particles by the multiplier; and

using the updated vector field, provides a graphic in the image, the graphic is positioned in the image based on the representation of the object in the image and depicts the fluid flow around the object at the current speed of the object.

23. The system of claim 22, wherein the processing facility:

determines a distance between the object and another object in the live event; and

accesses a modification factor which is based on the distance between the object and the another object in the live event, from among a plurality of modification factors which are based on different distances between the object and the another object; and

based on the modification factor which is based on the distance between the object and the another object in the live event, adjusts the baseline vector field to obtain the updated vector field.

24. The system of claim 22, wherein the processing facility:

determines a relative location of the object to another object in the live event; and

accesses a modification factor which is based on the relative location of the object to the another object in the live event, from among a plurality of modification factors which are based on different relative locations of the object to the another object, wherein the fluid flow around the object is based on the modification factor which is based on the relative location of the another object in the live event.

25. The system of claim 22, wherein:

the baseline vector field and the plurality of multipliers are pre-computed before the live event.

26. The system of claim 22, wherein the processing facility:

accesses baseline aerodynamic force data which indicates an aerodynamic force on the object at the reference speed of the object;

adjusts the baseline aerodynamic force data based on the current speed of the object, to provide an adjusted aerodynamic force on the object; and

provides a graphic which depicts the adjusted aerodynamic force on the object.

27. A method for processing image data, comprising:

obtaining an image of a live event, the image is captured by a camera and comprises a representation of an object moving in the live event;

obtaining information indicative of a current speed of the object, the current speed of the object represents a speed of the object in the live event when the image is captured;

accessing baseline aerodynamic force data which is computed from a fluid flow model of the object and which indicates an aerodynamic force on the object at a reference speed of the object, the reference speed of the object differs from the current speed of the object;

accessing a multiplier which is based on the current speed of the object, from among a plurality of multipliers which are based on different speeds of the object;

multiplying the baseline aerodynamic force data by the multiplier to determine an adjusted aerodynamic force on the object; and

providing a video frame comprising a graphic and the image, the graphic depicts the adjusted aerodynamic force on the object.

28. The method of claim 27, further comprising:

obtaining an additional image of the live event, the additional image is captured by the camera and comprises a representation of the object moving in the live event;

obtaining an updated current speed of the object which represents a speed of the object in the live event when the additional image is captured;

accessing a multiplier which is based on the updated current speed of the object, from among the plurality of multipliers which are based on the different speeds of the object;

based on the multiplier which is based on the updated current speed of the object;

multiplying the baseline aerodynamic force data by the multiplier which is based on the updated current speed of the object to determine an updated adjusted aerodynamic force on the object; and

providing another video frame comprising an updated graphic and the least one additional image, the updated graphic depicts the updated adjusted aerodynamic force on the object.

29. The method of claim 27, wherein:

the object comprises a vehicle;

additional aerodynamic force data is obtained which indicates a change in a down force on at least one of a front and back of the vehicle; and

the graphic depicts whether the vehicle is aero-loose or aero-tight according to the change in the down force on the at least one of the front or back, respectively, of the vehicle.

30. The method of claim 27, wherein:

the object comprises a vehicle;

additional aerodynamic force data is obtained which indicates a change in aerodynamic drag of the vehicle due to the vehicle following behind another vehicle; and

the graphic depicts a change in horsepower which corresponds to the change in aerodynamic drag.

31. The method of claim 27, wherein:

the graphic depicts at least one of a side force or a down force on the object.

32. The method of claim 27, wherein:

the graphic depicts a drag force on the object.

33. The method of claim 27, wherein:

the graphic depicts a positive or negative relative drag force on the object.

34. The method of claim 27, wherein:

the baseline aerodynamic force data and the plurality of multipliers are pre-computed before the live event.

35. A system for processing image data, comprising:

a camera, the camera captures an image of a live event, the image comprise a representation of an object moving in the live event; and

a processing facility which receives the image, the processing facility;

obtains information indicative of a current speed of the object, the current speed of the object represents a speed of the object in the live event when the image is captured;

accesses baseline aerodynamic force data which is computed from a fluid flow model of the object and which indicates an aerodynamic force on the object at a reference speed of the object, the reference speed of the object differs from the current speed of the object;

accesses a multiplier which is based on the current speed of the object, from among a plurality of multipliers which are based on different speeds of the object;

multiplies the baseline aerodynamic force data by the multiplier to determine an adjusted aerodynamic force on the object; and

provides a video frame comprising a graphic and the image, the graphic depicts the adjusted aerodynamic force on the object.

36. The system of claim 35, wherein:

the object comprises a vehicle;

additional aerodynamic force data is obtained which indicates a change in a down force on at least one of a front and back of the vehicle; and

the graphic depicts whether the vehicle is aero-loose or aero-tight according to the change in the down force on the at least one of the front or back, respectively, of the vehicle.