Autonomous systems and methods for still and moving picture production

• US 9,848,172 B2
• Filed: 12/04/2007
• Issued: 12/19/2017
• Est. Priority Date: 12/04/2006
• Status: Active Grant

• Current Assignee: IsoLynx LLC
• Original Assignee: IsoLynx LLC
• Inventors: DeAngelis, Douglas J., Sigel, Kirk, Evansen, Edward G.
• Primary Examiner(s): Tran, Philip B
• Application Number:
  US11/950,346
• Publication Number:
  US 20080129825A1
• Time in Patent Office: 3,668 Days
• Field of Search: 348169, 3482221, 382106
• CPC Class Codes: A63B 2024/0025 Tracking the path or location of one or more users, e.g. players of a game
• CPC Class Codes: A63B 2220/836 Sensors arranged on the body of the user
• CPC Class Codes: A63B 2225/50 Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 2243/0025 Football
• CPC Class Codes: A63B 2244/18 Skating
• CPC Class Codes: A63B 2244/24 Horse riding
• CPC Class Codes: A63B 24/0021 Tracking a path or terminating locations
• CPC Class Codes: A63B 43/00 Balls with special arrangements
• CPC Class Codes: A63B 69/0028 for running, jogging or speed-walking movable endless bands A63B22/02
• CPC Class Codes: G01S 3/7865 using correlation of the live video image with a stored image
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Systems and methods facilitate autonomous image capture and/or picture production. A location unit is attached to each tracked object. An object tracking device receives location information from each location unit. A camera control device controls, based upon the location information, at least one motorized camera to capture image data of at least one tracked object.

Claims

1. An autonomous picture production system for viewing at least one object among a plurality of tracked objects, comprising:

a plurality of location units, each including a wireless transmitter for transmitting a radio-signal attached to tracked objects;

an object tracking device for triangulating location of the location units based upon the respective radio-signals, to determine location and orientation of each tracked object from at least two location units attached to each tracked object; and

a camera control device for, based on at least the location and the orientation of one of the tracked objects, selecting one of a plurality of motorized cameras and controlling the one motorized camera to capture a desired view of the one tracked object corresponding to a pre-defined viewing direction relative to the orientation of the one tracked object.

2. The system of claim 1, the camera control device further being configured to control a second one of the motorized cameras, so as to track the one tracked object and a second one of the tracked objects, to separately provide image data for each of the one tracked object and the second tracked object.

3. The system of claim 1, the camera control device being configured to control, for the one motorized camera, one or more of camera movement, camera zoom, camera shutter speed, camera resolution and camera frame rate, based upon at least one of movement, location, and orientation of the one object, to produce image data of the one object.

4. The system of claim 1, further comprising a recording device for (a) recording image data produced by the motorized cameras, (b) receiving the location of the one tracked object from the camera control device, and (c) associating the location of the tracked object with the image data as annotation data.

5. The system of claim 4, the camera control device further configured to process the location of the one tracked object to determine performance data for the one tracked object.

6. The system of claim 5, the recording device being configured to overlay the performance data onto the image data.

7. The system of claim 4, further comprising a self-organizing database capable of storing the image data and the annotation data, together with pre-defined event information.

8. The system of claim 7, wherein the system is capable of displaying or recording to the self-organizing database streamed images captured by the at least one motorized camera.

9. The system of claim 1, the camera control device being configured to select the one motorized camera further based upon at least one of (a) intervening objects that block view of the one tracked object, (b) distance from the motorized cameras to the one tracked object, and (c) predicted movement of each of the tracked objects.

10. The system of claim 9, the camera control device being further configured to prioritize views provided by two motorized cameras based upon quality of each view, the camera control device controlling each of the two motorized cameras to capture images using a highest priority field of view, the camera control device being configured to switch said selecting between the two motorized cameras according to which of the two motorized cameras provides optimal view of the one tracked object.

11. The system of claim 1, further comprising a notification device in communication with the camera control device, the notification device capable of providing a notification of an action of interest, the camera control device controlling the at least one motorized camera to capture images based upon the notification.

12. The system of claim 11, the notification device including an interface for receiving indication of an action of interest from a user.

13. The system of claim 11, the notification device capable of automatically detecting an action of interest and generating the notification in response to the action of interest.

14. The system of claim 13, wherein the notification is based on a speed of the at least one object and second one of the plurality of tracked objects approaching one another within the proximity.

15. The system of claim 13, wherein the notification is based on one of the at least one object and second one of the plurality of tracked objects leaving an operational field of the plurality of tracked objects.

16. The system of claim 11, the notification device configured to generate the notification in response to biometric information received from one or more of the tracked objects.

17. The system of claim 11, further comprising:

one or more buffers for delaying the image data;

a database control device configured to tag images in the one or more buffers in response to the notification, the notification being indicative of an earlier action of interest; and

a production control device configured to utilize the one or more buffers and the images tagged by the database control device to facilitate capture of the earlier action of interest in response to the notification.

18. The system of claim 1, further comprising a production control device in communication with the camera control device, the production control device capable of selecting image data produced by the at least one motorized camera to produce a live feed.

19. The system of claim 18, further comprising a storage device for recording the image data and associated annotation data.

20. The system of claim 19, the image data comprising a plurality of still images equally spaced in time to form a moving image when replayed.

21. The system of claim 19, the storage device comprising a database for storing the image data and the associated annotation data, the annotation data capable of facilitating retrieval of all or part of the image data from the database.

22. The system of claim 19, the storage device capable of producing a disc representative of the image data and annotation data associated with one or more of the tracked objects.

23. The system of claim 19, further comprising:

a graphical display for providing information and image data to a commentator;

a microphone for receiving commentary from the commentator;

at least one database; and

a control device for storing the image data and the commentary to the at least one database.

24. The system of claim 19, further comprising a commentary device for producing commentary for the image data, the commentary device capable of processing the annotation data with statistical information and operational data received from the production control device, to produce the commentary.

25. The system of claim 24, the commentary device comprising a voice synthesizer for generating the commentary in an audible format.

26. The system of claim 1, the object tracking device capable of determining one or more predetermined commands based upon movement of one location unit within a control zone.

27. The system of claim 26, the object tracking device capable of determining at least one of the predetermined commands from the one location unit tracing one or more letters.

28. The system of claim 1, wherein the camera control device is configured to initiate said selecting and said controlling to begin tracking of the one tracked object by the motorized cameras in response to the object tracking device determining that a location unit of the one tracked object is within or approaching a proximity of a location unit of a second one of the tracked objects.

29. The system of claim 28, wherein the camera control device is configured to select the one motorized camera at least in part based upon which of the motorized cameras has a view of the one tracked object that is not blocked by presence of an intervening object.

30. The system of claim 29, wherein the camera control device is capable of predicting when the at least one object is going to be blocked by the intervening object.

31. The system of claim 28, wherein both of the at least one object and second one of the plurality of tracked objects are event contestants.

32. The system of claim 28, wherein one of the at least one object and second one of the plurality of tracked objects is an inanimate object of variable location within an operational field of the plurality of tracked objects.

33. The system of claim 28, wherein one of the at least one object and second one of the plurality of tracked defines a control zone within an operational field of the plurality of tracked objects.

34. The system of claim 28, further comprising a display capable of generating an automatic video stream based on pre-defined event information, wherein camera control device is capable of controlling the at least one motorized camera to capture the image data based on the pre-defined event information.

35. The system of claim 34, further comprising a self-organizing database capable of storing the image data and the annotation data, together with pre-defined event information.

36. The system of claim 1, wherein the desired view is selected from the group including a front view, and a side view.

37. The system of claim 1, wherein the camera control device is capable of utilizing determined orientation information to select the one motorized camera that the at least one object is facing.

38. The system of claim 1, wherein the desired view includes the one tracked object in a pre-defined position or proportion.

39. The system of claim 38, wherein the camera control device maintains the desired view by maintaining the proportion or position of the one tracked object within a field of view of the one motorized camera.

40. The system of claim 1, the object tracking device comprising one or more transceivers configured to interact with the location units to triangulate the radio signals received from the location units so as to determine the location of each location unit.

41. A process for autonomous picture production for viewing at least one object among a plurality of tracked objects, comprising:

based upon radio-signals received from each of at least two location units attached to the one object, determining a location of each location unit;

determining location and orientation of the one object based upon the locations of the at least two location units; and

controlling a camera to capture a desired view of one of the tracked objects based on the location and orientation of the one tracked object, such that the view corresponds to a pre-defined viewing direction relative to the orientation of the one tracked object.

42. The process of claim 41, further comprising:

determining a field of view for each of two cameras for the plurality of tracked objects;

evaluating, for each field of view, whether the desired view is obscured by (a) another one of the tracked objects, (b) a static object, or (c) a dynamic object;

prioritizing each field of view, wherein priority of obscured fields of view is relatively reduced;

selecting, for each of the two cameras, one of the fields of view based upon the step of prioritizing;

controlling each of the two cameras to capture image data of the selected fields of view,

wherein the steps of determining a field of view, evaluating, prioritizing, selecting, and controlling each of the two cameras are repeated periodically to produce smooth image data of the one tracked object during movement thereof.

43. The process of claim 41, comprising:

initiating the step of controlling the camera to capture the desired view in response to a location unit of the one object being determined to be within or approaching a proximity of a location unit of a second one of the tracked objects.

44. The process of claim 41, the step of determining the location of each location unit comprising triangulating radio-signals received from each location unit by one or more transceivers, to determine the location of each location unit.

45. An autonomous picture production system, comprising:

at least two radio-signal based location units configured to be attached to a tracked object;

an object tracking device for periodically (a) determining a location of each radio-signal based location unit and (b) determining, from the location of each radio-signal based location unit, an orientation of the tracked object; and

a camera control device for, upon recognition of a trace performed by one of the location units and based upon orientation of the tracked object, selecting and controlling one of a plurality of cameras to capture a desired view, of the tracked object, that corresponds to a pre-defined viewing direction relative to the orientation of the tracked object.

46. The system of claim 45, the object tracking device comprising one or more transceivers configured to interact with each radio-signal based location unit to triangulate radio signals received from the location unit so as to determine the location of the radio-signal based location unit.