Producing image data in a virtual set

• US 6,396,495 B1
• Filed: 04/01/1999
• Issued: 05/28/2002
• Est. Priority Date: 04/02/1998
• Status: Expired due to Term

• Current Assignee: Autodesk, Inc.
• Original Assignee: Discreet Logic, Inc. (Autodesk, Inc.)
• Inventors: Dery, Jean-Luc, Parghi, Amit G.
• Primary Examiner(s): Nguyen, Phu K.
• Application Number:
  US09/283,918
• Time in Patent Office: 1,153 Days
• Field of Search: 345/430,426,441,435,419,428,427
• US Class Current: 345/426
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00
• CPC Class Codes: H04N 5/2224 related to virtual studio applications

Abstract

A virtual set combines real and synthesized images. The set includes a real light source (205) configured to generate a beam of light. In addition, a virtual light source is synthesized such that the real light source and the virtual light source are co-ordinated so as to appear as if originating from a common light source in the virtual set. In this way, a single light source appears to illuminate both a real and a syntheized image.

Claims

1. A virtual set in which real image data is combined with synthesised image data, including a real camera configured to generate said real image data;

a real light source configured to direct light towards real entities within the set;

synthesising means configured to synthesise virtual image data including a synthesised virtual light source;

combining means configured to combine said real data with said synthesised data; and

co-ordinating means configured to co-ordinate said real light source with said synthesised virtual light source so that said teal light and said synthesised virtual light appear as if originating from substantially the same light source.

2. A virtual set according to claim 1, including means for calibrating position transducers for said real light source.

3. A virtual set according to claim 2, wherein said calibrating means are calibrated by directing said real light source at target positions on virtual set walls.

4. A virtual set according to claim 2, wherein said position transducer calibrating means are calibrated by directing said real light source at known planar surfaces in a virtual set, including means for analysing the shape of resulting ellipses.

5. A method according to claim 1, including means for calibrating the beam angle of said real light sources.

6. A virtual set according to claim 5, wherein said means for calibrating said beam angle is configured to measure spot intensities at a plurality of spot radii.

7. A virtual set according to claim 1, including means for calibrating intensity values of the real light sources.

8. A virtual set according to claim 7, wherein said means for calibrating intensity values are configured to compare intensities against a reference background light level in the absence of said real light source.

9. A virtual set according to claim 1, including calibrating means configured to calibrate the effect of gels.

10. A virtual set according to claim 9, wherein said means for calibrating gels includes gel attenuation calibration means configured to perform calibration procedures for each component colour.

11. A virtual set according to claim 1, wherein a plurality of real light sources are provided and each of said real light sources is co-ordinated with an associated virtual light source.

12. A virtual set according to claim 1, wherein movement of a real light source is tracked to produce control data for effecting equivalent modifications to a virtual light source.

23. A method according to claim 12, wherein a plurality of real light sources are provided and each of said real light sources is co-ordinated with an associated virtual light source.

13. A method of producing image data in a virtual set, in which real image data is combined with synthesised virtual image data, comprising:

lighting a real object by means of a real light source;

synthesising the presence of a virtual light source in said virtual image data; and

co-ordinating said real light source with said virtual light source such so that said real light and said virtual light appear as originating from a substantially common light source.

14. A method according to claim 13, wherein position transducers are calibrated for said real light source.

15. A method according to claim 14, wherein said position transducers are calibrated by directing said light source at target positions on virtual set walls.

16. A method according to claim 14, wherein said position transducers are calibrated by directing said real light source at known planar surfaces in a virtual set and analysing the shape of a resulting ellipse.

17. A method according to claim 13, wherein the beam angle of said real light source is calibrated.

18. A method according to claim 17, wherein beam angle is calibrated by measuring spot intensities at a plurality of spot radii.

19. A method according to claim 13, wherein intensity values of the real light source are calibrated.

20. A method according to claim 19, wherein intensity values are compared against a reference background light level in the absence of said real light source.

21. A method according to claim 13, wherein the effect of gels are calibrated.

22. A method according to claim 21, wherein said gel attenuation calibration is performed for each component colour.

24. A method according to claim 13, wherein movement of a real light source is tracked to produce control data for effecting equivalent modifications to a virtual light source.

25. In a virtual set in which real image data is combined with synthesised virtual image data, a computer system programmed to:

generate the virtual image data including lighting effects in response to synthesised virtual light sources;

combine said virtual image data with real image data from a camera, wherein real entities are illuminated by real light sources; and

to

co-ordinate the position of associated real and virtual light sources so that virtual light and real light appear to be produced by the same light source.

26. A computer system according to claim 25, programmed to calibrate position transducers for said real light source.

27. A computer system according to claim 26, programmed to calibrate said position transducers in response to real light being directed at target positions on virtual set walls.

28. A computer system according to claim 26, programmed to calibrate said position transducers in response to real light being directed at known planar surfaces in a virtual set, wherein said computer system is programmed to analyse the shape of a resulting ellipse.

29. A computer system according to claim 25, programmed to calibrate the beam angle of a real light source.

30. A computer system according to claim 29, programmed to calibrate said beam angle by measuring spot intensities at a plurality of spot radii.

31. A computer system according to claim 25, programmed to calibrate intensity values of the real light source.

32. A computer system according to claim 31, programmed to calibrate said intensity values by comparing said intensity values against a reference background light level in the absence of the real light source.

33. A computer system according to claim 25, programmed to calibrate the effect of gels applied to said real light sources.

34. A computer system according to claim 33, programmed to perform said gel attenuation step with respect to each component colour.

35. A computer-readable medium having computer-readable instructions executable by a computer, such that said computer performs the steps of:

generating virtual image data including virtual lighting effects due to virtual light sources;

combining said virtual image data with real image data, wherein a real entity within a virtual set is illuminated by a real light source; and

co-ordinating a virtual light source with a real light source so that real lighting and virtual lighting appear as if originating from a common light source.

36. A computer-readable medium having computer-readable instructions executable by a computer according to claim 35, such that said computer calibrates position transducers for said real light source.

37. A computer-readable medium having computer-readable instructions executable by a computer according to claim 36, such that said computer calibrates said position transducers by directing said light source at target positions on virtual set walls.

38. A computer-readable medium having computer-readable instructions executable by a computer according to claim 37, such that said computer calibrates said position transducers by directing said real light source at known planar surfaces in a virtual set and analyses the shape of a resulting ellipse.

39. A computer-readable medium having computer-readable instructions executable by a computer according to claim 36, wherein said computer calibrates the beam angle of said real light source.

40. A computer-readable medium having computer-readable instructions executable by a computer according to claim 39, wherein said computer is programmed to calibrate said beam angle by measuring spot intensities at a plurality of spot radii.

41. A computer-readable medium having computer-readable instructions executable by a computer according to claim 35, programmed to calibrate intensity values of the real light source.

42. A computer-readable medium having computer-readable instructions executable by a computer according to claim 41, wherein said computer is programmed to compare said intensity values against a reference background light level produced in the absence of said real light source.

43. A computer-readable medium having computer-readable instructions executable by a computer according to claim 35, such that said computer is programmed to calibrate the effect of gels applied to the real light sources.

44. A computer-readable medium having computer-readable instructions executable by a computer, according to claim 43, wherein said computer is programmed to perform said gel attenuation calibration with respect to each component colour.

45. A computer-readable medium having computer-readable instructions executable by a computer according to claim 35, such that said computer is programmed to co-ordinate a virtual light source with a respective real light source in a virtual set having a plurality of perceived light source.

46. A computer-readable medium having computer-readable instructions executable by a computer according to claim 35, wherein said computer is programmed to receive tracking data relating to the movement of a real light source and to control data for effecting equivalent modifications to a virtual light source.