CAMERA-BASED TRACKING AND POSITION DETERMINATION FOR SPORTING EVENTS

• US 20100026809A1
• Filed: 07/29/2009
• Published: 02/04/2010
• Est. Priority Date: 07/29/2008
• Status: Active Grant

• Current Assignee: Gerald Curry
• Original Assignee: Gerald Curry
• Inventors: Curry, Gerald
• Granted Patent: US 9,185,361 B2
• Time in Patent Office: Days
• US Class Current: 348/157
• CPC Class Codes: G06V 10/147 Details of sensors, e.g. sensor lenses fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

Position information of equipment at an event, such as a ball, one or more players, or other items in a game or sporting event, is used in selecting camera, camera shot type, camera angle, audio signals, and/or other output data for providing a multimedia presentation of the event to a viewer. The position information is used to determine the desired viewer perspective. A network of feedback robotically controlled Pan-Tilt-Zoom (PTZ), manually controlled cameras and stationary cameras work together with interpolation techniques to create a 2D video signal. The position information may also be used to access gaming rules and assist officiating of the event. The position information may be obtained through a transceiver(s), accelerometer(s), transponder(s), and/or RADAR detectable element(s) fitted into the ball, apparel or equipment of players, the players themselves, or other playing equipment associated with the game or sporting event. Other positioning methods that can be used include infrared video-based tracking systems, SONAR positioning system(s), LIDAR positioning systems, and digital signal processing (DSP) image processing techniques such as triangulation.

Claims

1. A method of computer controlled camera selection for viewing, the method comprising:

receiving camera outputs at a processor from a plurality of cameras, each of which is configured to provide a respective camera output showing respective field of view coverage of an ongoing event;

receiving position information at the processor, wherein the position information is associated with equipment at the ongoing event such that the received position information provides real time position information of the equipment;

selecting a camera output from among the received plurality of camera outputs in response to the received position information such that the selected camera output provides its respective field of view coverage of the ongoing event and producing a processor signal comprising the selected camera output; and

selecting a different camera output from among the received plurality of camera outputs in response to updated position information such that the processor signal comprises the selected different camera output.

2. The method of claim 1, further comprising upon selecting to switch from the selected camera output to the different camera output, combining the selected camera output with the different camera output.

3. The method of claim 1, further comprising switching from outputting video frames of the selected camera output at a first rate to outputting video frames of the selected camera output at a second rate in response to the updated position information, at least one of the first rate or the second rate resulting in slow motion video.

4. The method of claim 1, further comprising combining audio information with the selected camera output, wherein the audio information is chosen independently of the updated position information.

5. The method of claim 1, further comprising combining audio information with the selected camera output, wherein the audio information is chosen in response to the updated position information.

6. The method of claim 1, wherein a computer generated three dimensional environment is created using the position information, wherein the position information is associated with equipment at the ongoing event.

7. The method of claim 1, wherein at least one camera of the plurality of cameras is configured to provide three dimensional (3D) field of view coverage of the ongoing event.

8. The method of claim 1, wherein at least two of the cameras are configured at multiple vertical distances above the ongoing event.

9. The method of claim 8, wherein the at least two of the cameras are spaced contiguously at the multiple vertical distances.

10. The method of claim 1, wherein at least two of the cameras are configured at multiple radial positions arranged radially around the ongoing event substantially in the same plane.

11. The method of claim 10, wherein the at least two of the cameras are spaced contiguously at the multiple radial positions.

12. The method of claim 1, wherein at least one camera from the plurality of cameras comprises a panoramic view camera.

13. The method of claim 1, further comprising controlling at least one function of at least one camera of the plurality of cameras in response to the updated position information, the at least one function including at least one of focus, zoom, pan, or tilt.

14. The method of claim 1, further comprising controlling at least one camera of the plurality of cameras to change location relative to the ongoing event in response to the updated position information.

15. The method of claim 1, further including receiving a manual selection of camera output from among the plurality of cameras that suspends the processor from selecting a different camera output in response to the updated position information.

16. The method of claim 15, further including receiving a selection for the processor to resume selecting a different camera output in response to the updated position information.

17. The method of claim 1, wherein the processor signal comprises camera outputs from more than one camera of the plurality of camera outputs, the method further comprising:

receiving a manual selection of a single camera output from among the plurality of camera outputs of the processor signal;

suspending selecting a different camera output of the processor signal in response to the updated position information.

18. The method of claim 1, wherein the processor signal comprises camera outputs from more than one camera of the plurality of camera outputs, the method further comprising:

transmitting the processor signal to an end user viewing system for display at the end user viewing system, wherein the end user viewing system includes a user interface such that a manual selection input to the user interface identifies a single camera output from among the plurality of camera outputs of the transmitted processor signal for display at the end user viewing system.

19. The method of claim 1, wherein the selected camera output is combined with an augmented reality presentation.

20. The method of claim 1, wherein the equipment at the ongoing event includes at least one of a player, ball, puck, gaming projectile, clothing, apparel, jersey, shorts, pants, sox, shoes, hat, headband, sweatband, armband, helmet, shoulder pads, elbow pads, or shin guards.

21. The method of claim 1, wherein at least one of the plurality of cameras is mounted on a camera pole apparatus.

22. The method of claim 1, wherein one or more mirrors are used to produce at least one of the camera outputs.

23. The method of claim 1, wherein the updated position information includes rate of change of position information of the equipment.

24. A system for computer controlled camera selection for viewing, the system comprising:

a processor that is configured to receive camera outputs from a plurality of cameras, each of which is configured to provide a respective camera output showing respective field of view coverage of an ongoing event, and that is configured to receive position information, wherein the position information is associated with equipment at the ongoing event such that the received position information provides real time position information of the equipment;

wherein the processor produces a processor signal comprising a selected camera output from among the received plurality of camera outputs in response to the received position information such that the selected camera output provides its respective field of view coverage of the ongoing event, and wherein the processor selects a different camera output from among the received plurality of camera outputs in response to updated position information such that the processor signal comprises the selected different camera output.

25. The system of claim 24, wherein the processor is further configured to, upon selecting to change from the selected camera output to the different camera output, combine the selected camera output with the different camera output.

26. The system of claim 24, wherein the processor is further configured to switch from outputting video frames of the selected camera output at a first rate to outputting video frames of the selected camera output at a second rate in response to the updated position information, at least one of the first rate or the second rate resulting in slow motion video.

27. The system of claim 24, wherein the processor is further configured to combine audio information with the selected camera output, wherein the audio information is chosen independently of the updated position information.

28. The system of claim 24, wherein the processor is further configured to combine audio information with the selected camera output, wherein the audio information is chosen in response to the updated position information

29. The system of claim 24, wherein a computer generated three dimensional environment is created using the position information, wherein the position information is associated with equipment at the ongoing event.

30. The system of claim 24, wherein at least one camera of the plurality of cameras is configured to provide three dimensional (3D) field of view coverage of the ongoing event.

31. The system of claim 24, wherein at least two of the cameras are configured at multiple vertical distances above the ongoing event.

32. The system of claim 31, wherein the at least two of the cameras are spaced contiguously at the multiple vertical distances.

33. The system of claim 24, wherein at least two of the cameras are configured at multiple radial positions arranged radially around the ongoing event substantially in the same plane.

34. The system of claim 33, wherein the at least two of the cameras are spaced contiguously at the multiple radial positions.

35. The system of claim 24, wherein at least one camera from the plurality of cameras comprises a panoramic view camera.

36. The system of claim 24, wherein the processor is further configured to control at least one function of at least one camera of the plurality of cameras in response to the updated position information, the at least one function including at least one of focus, zoom, pan, or tilt.

37. The system of claim 24, wherein the processor controls at least one camera of the plurality of cameras to change location relative to the ongoing event in response to the updated position information.

38. The system of claim 24, wherein the processor receives a manual selection of camera output from among the plurality of cameras that suspends the processor from selecting a different camera output in response to the updated position information.

39. The system of claim 38, further including receiving a selection for the processor to resume selecting a different camera output in response to the updated position information.

40. The system of claim 24, wherein the processor signal comprises a signal that includes camera outputs from more than one camera of the plurality of cameras, and the system further includes a user interface of the processor that receives a manual selection of camera output from among the plurality of camera outputs and in response suspends selecting a different camera output of the processor signal in response to the updated position information.

41. The system of claim 24, wherein the processor signal comprises a signal that includes camera outputs from more than one camera of the plurality of cameras, and the system further includes a user interface that receives a user selection from an end user viewing system, the user selection identifying a single camera output from among the plurality of camera outputs comprising the processor signal such that the identified single camera output is provided for viewing at the end user viewing system.

42. The system of claim 24, wherein the processor output is combined with an augmented reality presentation.

43. The system of claim 24, wherein the equipment at the ongoing event includes at least one of a player, ball, puck, gaming projectile, clothing, apparel, jersey, shorts, pants, sox, shoes, hat, headband, sweatband, armband, helmet, shoulder pads, elbow pads, or shin guards.

44. The system of claim 24, wherein at least one of the plurality of cameras is mounted on a camera pole apparatus.

45. The system of claim 24, wherein one or more mirrors are used to produce at least one of the camera outputs.

46. The system of claim 24, wherein the updated position information includes rate of change of position information of the equipment.

47. A computer program product embodied on a computer-readable storage medium containing computer implementable instructions executable by a computer to perform a method comprising:

receiving camera outputs at a processor from a plurality of cameras, each of which is configured to provide a respective camera output showing respective field of view coverage of an ongoing event;

receiving position information at the processor, wherein the position information is associated with equipment at the ongoing event such that the received position information provides real time position information of the equipment;

selecting a camera output from among the received plurality of camera outputs in response to the received position information such that the selected camera output provides its respective field of view coverage of the ongoing event and producing a processor signal comprising the selected camera output; and

selecting a different camera output from among the received plurality of camera outputs in response to updated position information such that the processor signal comprises the selected different camera output.

48. The computer program product of claim 47, the performed method further comprising selecting to switch from the selected camera output to the different camera output, combining the selected camera output with the different camera output.

49. The computer program product of claim 47, the performed method further comprising switching from outputting video frames of the selected camera output at a first rate to outputting video frames of the selected camera output at a second rate in response to the updated position information, at least one of the first rate or the second rate resulting in slow motion video.

50. The computer program product of claim 47, the performed method further comprising combining audio information with the selected camera output, wherein the audio information is chosen independently of the updated position information.

51. The computer program product of claim 47, the performed method further comprising combining audio information with the selected camera output, wherein the audio information is chosen in response to the updated position information.

52. The computer program product of claim 47, wherein a computer generated three dimensional environment is created using the position information, wherein the position information is associated with equipment at the ongoing event.

53. The computer program product of claim 47, wherein at least one of the plurality of cameras is configured to provide three dimensional (3D) field of view coverage of the ongoing event.

54. The computer program product of claim 47, wherein at least two of the cameras are configured at multiple vertical distances above the ongoing event.

55. The computer program product of claim 54, wherein the at least two cameras are spaced contiguously at the multiple vertical distances.

56. The computer program product of claim 47, wherein at least two of the cameras are configured at multiple radial positions arranged radially around the ongoing event substantially in the same plane.

57. The computer program product of claim 56, wherein the at least two cameras are spaced contiguously at the multiple radial positions.

58. The computer program product of claim 47, wherein at least one camera from the plurality of cameras comprises a panoramic view camera.

59. The computer program product of claim 47, the performed method further comprising controlling at least one function of at least one camera of the plurality of cameras in response to the updated position information, the at least one function including at least one of focus, zoom, pan, or tilt.

60. The computer program product of claim 47, the performed method further comprising controlling at least one camera of the plurality of cameras to change location relative to the ongoing event in response to the updated position information.

61. The computer program product of claim 47, the performed method further including receiving a manual selection of camera output from among the plurality of cameras that suspends the processor from selecting a different camera output in response to the updated position information.

62. The computer program product of claim 61, the performed method further including receiving a selection for the processor to resume selecting a different camera output in response to the updated position information.

63. The computer program product of claim 47, wherein the processor signal comprises camera outputs from more than one camera of the plurality of camera outputs, the performed method further comprising:

receiving a manual selection of a single camera output from among the plurality of camera outputs of the processor signal;

suspending selecting a different camera output of the processor signal in response to the updated position information.

64. The computer program product of claim 47, wherein the processor signal comprises camera outputs from more than one camera of the plurality of camera outputs, the performed method further comprising:

transmitting the processor signal to an end user viewing system for display at the end user viewing system, wherein the end user viewing system includes a user interface such that a manual selection input to the user interface identifies a single camera output from among the plurality of camera outputs of the transmitted processor signal for display at the end user viewing system.

65. The computer program product of claim 47, wherein the processor output is combined with an augmented reality presentation.

66. The computer program product of claim 47, wherein the equipment at the ongoing event includes at least one of a player, ball, puck, gaming projectile, clothing, apparel, jersey, shorts, pants, sox, shoes, hat, headband, sweatband, armband, helmet, shoulder pads, elbow pads, or shin guards.

67. The computer program product of claim 47, wherein at least one of the plurality of cameras is mounted on a camera pole apparatus.

68. The computer program product of claim 47, wherein one or more mirrors are used to produce at least one of the camera outputs.

69. The computer program product of claim 47, wherein the updated position information includes rate of change of position information of the equipment.