Real-time visible-talent tracking system

• US 8,587,672 B2
• Filed: 01/31/2011
• Issued: 11/19/2013
• Est. Priority Date: 01/31/2011
• Status: Active Grant

• Current Assignee: Home Box Office Incorporated (Warner Bros. Discovery, Inc.)
• Original Assignee: Home Box Office Incorporated (Warner Bros. Discovery, Inc.)
• Inventors: Wallace, Bruce Allen
• Primary Examiner(s): SELBY, GEVELL V
• Application Number:
  US13/017,510
• Publication Number:
  US 20120195574A1
• Time in Patent Office: 1,023 Days
• Field of Search: 348/208.14, 348/211.1, 348/211.2, 348/211.9, 348/222.1, 348/231.3
• US Class Current: 348/208.14
• CPC Class Codes: H04N 23/67 Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

In one embodiment, a movie set includes a motion-picture camera and a visible-talent tracking system having several elements. Based on the camera'"'"'s characteristics, items in a portion of the movie set called the view frustum will appear in focus in the film. The camera and a camera-tracking system provide camera-location, orientation, and settings information to a culling processor. The culling processor delineates the location and dimensions of the view frustum based on the received camera information. Wireless tags are attached to talent on set. A tag-locating system tracks the real-time respective locations of the wireless tags and provides real-time spatial information regarding the tags to the culling processor, which determines which tags, if any, are considered to be within the view frustum, and provides information associated with the intra-frustum tags to a track recorder for recording along with the corresponding film frames. That information is variously used after editing.

Claims

1. A system comprising:

a real-time view-frustum (RTVF) culling processor adapted to;

receive tag-associated data for each of one or more wireless tags;

receive camera information for a film segment generated by a camera;

process the received camera information to determine, for the film segment, a view frustum of the camera; and

correlate the tag-associated data with the view frustum for the film segment to generate frustum-culling information identifying one or more of the wireless tags as intra-frustum tags within the view frustum.

2. The system of claim 1, further comprising a real-time visible-talent (RTVT) metadata processor adapted to:

receive, for the film segment, the frustum-culling information from the RTVF culling processor;

generate metadata for the film segment based on the frustum-culling information; and

provide the metadata to a track recorder that records the metadata in association with the film segment.

3. The system of claim 2, wherein the metadata identifies at least one of:

(i) the intra-frustum tags and (ii) respective actors associated with the intra-frustum tags.

4. The system of claim 2, wherein the metadata includes delineation of one or more two-dimensional areas of interest for the film segment, wherein each of the one or more two-dimensional areas of interest is determined based on the position of a corresponding wireless tag.

5. The system of claim 4, wherein the metadata is generated by mapping a location for the intra-frustum tags onto the film segment based on the corresponding frustum-culling information for the film segment.

6. The system of claim 2, wherein the metadata:

identifies at least one of;

(i) the intra-frustum tags and (ii) respective actors associated with the intra-frustum tags; and

includes delineation of one or more two-dimensional areas of interest, wherein each of the one or more two-dimensional areas of interest is determined based on the position of a corresponding wireless tag.

7. The system of claim 1, wherein an object determined to be within the view frustum is determined to be within the view frustum because the object is at a location relative to the camera where the object would be recorded substantially in focus by the camera.

8. The system of claim 1, wherein the tag-associated data comprises, for a particular time and for each of one or more wireless tags, (i) an identification of the tag and (ii) spatial location coordinates for the tag.

9. The system of claim 1, wherein the camera information comprises, for the camera, time, and film segment:

(i) camera spatial position and (ii) camera spatial orientation.

10. The system of claim 9, wherein the camera information further comprises, for the camera, time, and film segment, (iii) camera focus-setting information.

11. The system of claim 1, wherein the film segment is a film frame identified by a time code, wherein the time code indicates the film frame'"'"'s location, in terms of time, within a continuum of frames of a film.

12. The system of claim 1, wherein:

the track recorder records a sequence of film segments to generate an original-footage film;

the original-footage film is edited to remove at least one film segment thereby generating a finished film; and

the finished film is processed, wherein processing includes automatically processing the metadata of a plurality of film segments of the finished film.

13. The system of claim 1, wherein:

the view frustum of the camera is defined by a hither plane and a yon plane;

the hither plane is nearer to the camera than the yon plane;

the received camera information includes at least one of T-stop and f-stop setting, which is used to determine the distances from the camera of the hither plane and the yon plane.

14. The system of claim 1, wherein:

the view frustum of the camera is part of a view cone of the camera;

the view cone of the camera is determined based on the received camera information;

the RTVF culling processor is further adapted to identify one or more of the wireless tags as both within the view cone of the camera and outside the view frustum of the camera.

15. The system of claim 1, wherein the camera is a motion-picture camera.

16. The system of claim 1, wherein the camera is a still camera.

17. A computer-implemented method comprising:

receiving tag-associated data for each of one or more wireless tags;

receiving camera information for a film segment generated by a camera;

processing the received camera information to determine, for the film segment, a view frustum of the camera; and

correlating the tag-associated data with the view frustum for the film segment to generate frustum-culling information identifying one or more of the wireless tags as intra-frustum tags within the view frustum.

18. The method of claim 17, further comprising:

receiving, for the film segment, the frustum-culling information;

generating metadata for the film segment based on the frustum-culling information; and

providing the metadata to a track recorder that records the metadata in association with the film segment.

19. The method of claim 18, wherein the metadata identifies at least one of:

(i) the intra-frustum tags and (ii) respective actors associated with the intra-frustum tags.

20. The method of claim 18, wherein the metadata includes delineation of one or more two-dimensional areas of interest for the film segment, wherein each of the one or more two-dimensional areas of interest is determined based on the position of a corresponding wireless tag.

21. The method of claim 20, further comprising generating the metadata by mapping a location for the intra-frustum tags onto the film segment based on the corresponding frustum-culling information for the film segment.

22. The method of claim 18, wherein the metadata:

identifies at least one of;

(i) the intra-frustum tags and (ii) respective actors associated with the intra-frustum tags; and

includes delineation of one or more two-dimensional areas of interest, wherein each of the one or more two-dimensional areas of interest is determined based on the position of a corresponding wireless tag.

23. The method of claim 17, wherein the tag-associated data comprises, for a particular time and for each of one or more wireless tags, (i) an identification of the tag and (ii) spatial location coordinates for the tag.

24. The method of claim 17, wherein the camera information comprises, for the camera, time, and film segment:

(i) camera spatial position and (ii) camera spatial orientation.

25. The method of claim 24, wherein the camera information comprises, for the camera, time, and film segment, (iii) camera focus-setting information.

26. The method of claim 17, further comprising:

recording a sequence of film segments to generate an original-footage film;

receiving an edited finished film generated by removing at least one film segment from the original-footage film; and

processing the finished film, wherein processing includes automatically processing the metadata of a plurality of film segments of the finished film.

27. The method of claim 26, wherein processing the finished film comprises automatically processing the metadata of the film segments of the finished film to determine, for at least one wireless tag that is an intra-frustum tag for at least one of film segments of the finished film, the total number of film segments in the finished film for which the wireless tag is an intra-frustum tag.

28. The method of claim 27, further comprising:

determining the amount of time that the wireless tag is an intra-frustum tag in the finished film; and

using the determined amount of time and a predetermined formula to determine compensation for an actor associated with the wireless tag.

29. The method of claim 27, wherein:

the metadata of at least one film segment of the finished film includes an indication of the depth of an intra-frustum tag within the view frustum for the at least one film segment;

the method further comprises using the indication of the depth in determining compensation for an actor associated with the intra-frustum tag for the at least one film segment.

30. The method of claim 26, wherein:

the metadata;

identifies at least one of;

(i) the intra-frustum tags and (ii) respective actors associated with the intra-frustum tags; and

includes delineation of one or more two-dimensional areas of interest associated with the intra-frustum tags; and

the method further comprises presenting information to a user about the respective actor associated with the intra-frustum tag in response to the user selecting the area of interest associated with the intra-frustum tag.