Keying system and composite image producing method

• US 6,034,740 A
• Filed: 10/29/1996
• Issued: 03/07/2000
• Est. Priority Date: 10/30/1995
• Status: Expired due to Fees

• Current Assignee: Kabushiki Kaisha Photron
• Original Assignee: Kabushiki Kaisha Photron
• Inventors: Sako, Yoshitomo, Mitsui, Kenji
• Primary Examiner(s): Lee, Michael H.
• Assistant Examiner(s): DESIR, JEAN WICEL
• Application Number:
  US08/739,274
• Time in Patent Office: 1,225 Days
• Field of Search: 348/586, 348/587, 348/592, 348/580, 348/581, 348/583, 348/239, 348/240, 348/552, 348/590, 348/591, 348/593, 348/722
• US Class Current: 348/587
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 9/75 Chroma key

Abstract

In a keying system, an image of an object is gained and a plurality of the background images each of which is obtained correspondingly to a view angle of a view point in a three-dimensional space to be imaged and a view position of the view point therein are stored on a memory device. The background image from the plurality of background images stored in the memory device is selectively read according to the view angle and the view position preliminarily defined in accordance with the image of the object. A chroma-keying composition is performed between the background image and the image of the object thereby producing a composite image.

Claims

1. A keying system comprising:

means for gaining an image of an object;

a memory device for preliminary storing a plurality of background images each being obtained correspondingly to at least one of a view angle of a view point in a three-dimensional space to be imaged and a view position of the view point therein;

a buffer memory capable of storing at least one frame of the background image thereon;

first reading means for selectively reading at least one image at a given timing from the plurality of background images stored in the memory device according to the at least one of the view angle and the view position preliminary both defined in accordance with the image of the object;

storage means for storing the at least one image read by the first reading means on the buffer memory;

means for judging whether or not the at least one of the defined angle and the defined position on the image of the object is changed within predetermined limits corresponding to a predetermined number of pixels;

second reading means for reading the at least one image stored in the buffer memory with shifting the at least one image by at least one pixel each along a direction of the change in case that the at least one of the defined angle and the defined position is changed within the predetermined limits;

third reading means for selectively reading at least one image at the given timing from the plurality of background images stored in the memory device according to the at least one of the defined angle and the defined position in case that the at least one of th e defined angle and the defined position is c hanged over the predetermined limits,

first keying-composition means for performing a keying composition between the at least one image read by the second reading means and the image of the object thereby producing a composite image; and

second keying-composition means for performing a keying composition between the at least one image read by the third reading means and the image of the object thereby producing a composite image.

2. A keying system according to claim 1, wherein each of said first and second keying-composition means has a chroma-key means performing chroma-keying composition and wherein said memory device has a disk array unit preliminarily storing the plurality of background images.

3. A keying system according to claim 2, wherein said gaining means comprises camera means having a camera for taking the image of the object lying in front of a screen for chroma-keying and having a camera head on which the camera is mounted for variably controlling at least one of an image-taking angle of the camera and an image-taking position thereof, and wherein said defined view angle corresponds to the image-taking angle of the camera at a time of taking the image and said defined view position corresponds to the image-taking position thereof at the time thereof.

4. A keying system according to claim 3, wherein said second reading means is adapted to read the at least one image stored in the buffer memory in field units.

5. A keying system according to claim 3, further comprising detecting means mounted on the camera head for detecting the at least one of the image-taking angle and the image-taking position and zoom detection means mounted on the camera for detecting a zoom position of a zoom lens thereof, wherein said control means comprises selection means for selectively reading the at least one image from the plurality of background images stored in the memory device according to the detected at least one of the image-taking angle and the image-taking position and setting means for setting an enlargement ratio or a reduction ratio for the selected at least one image according to the detected zooming position, said keying-composition means has enlargement/reduction means for performing an enlargement or reduction process of the selected at least one image according to the enlargement ratio or to the reduction ratio and said chroma keyed performs the chroma-keying composition between the enlarged or reduced at least one image and the image of the object thereby producing the composite image.

6. A keying system according to claim 4, further comprising means for displaying the composite image.

7. A keying system according to claim 1, wherein said memory device is a semiconductor memory.

8. A keying system according to claim 1, wherein said memory device is composed of a parity-checked RAID system.

9. A keying system according to claim 1, wherein each of said plurality of background images is stored in non-compressed format.

10. A keying system according to claim 1, wherein each of said plurality of the background images is stored in compressed format.

11. A keying system according to claim 4, wherein said system further comprises means for delaying a timing of the image of the object transmitted to the chroma keyed from the camera means in that a transmitting timing of the at least one image transmitted thereto from the setting means is substantially the same as the transmitting timing of the image of the object.

12. A keying system according to claim 2, wherein said gaining means comprises producing means for producing the image of the object by computer graphics processing, said image thereof corresponding to the at least one of the view angle and the view position.

13. A keying system according to claim 2, wherein said gaining means comprises an image-taking device for scanning a picture on which the object is shown so as to produce the image of the object, said image thereof corresponding to the at least one of the view angle and the view position.

14. A keying system according to claim 1, wherein:

a memory device for preliminary storing a plurality of background images each being obtained correspondingly to at least one of a view angle of a view point in a three dimensional space to be imaged and a view position of the view point therein;

camera means having a camera for taking an image of an object;

input means for inputting at least one of an image taking angle data of the camera and an image-taking position data thereof;

variable control means on which the camera is mounted for variably controlling at least one of an image-taking angle of the camera and an image-taking position thereof according to the at least one of the image-taking angle data and the image-taking position data inputted by the input means so as to take the image of the object by the camera means on the basis of the at least controlled image-taking angle and the controlled image-taking position.

15. A keying system according to claim 13, wherein said variable control means comprises a camera head on which the camera is mounted for changing the at least one of the image taking angle and the image-taking position and a camera head controller for controlling the camera head so that the at least one of the image-taking angle and the image-taking position is defined correspondingly to the at least one of the image-taking angle data and the image-taking position data.

16. A keying system according to claim 14, further comprising:

comparison means for comparing a time period (τ

1) required to variably control the at least one of the image taking angle and the image-taking position with a time period (τ

2) between at a moment at which the at least one of the taking angle data and the image-taking position data is inputted to the control means and at a moment at which the at least one image is outputted to the keying-composition means; and

adjustment means for adjusting at least one of the time period (τ

1) and the time period (τ

2) on the basis of the comparison result of the comparison means whereby the time period τ

1 becomes substantially equal to the time period τ

2.

17. A keying system according to claim 15, wherein, when the comparison means judges that the time period (τ

2) is larger than the time period (τ

1), said adjustment means is adapted to delay the variable-control timing of the variable control means according to the at least one of the image taking angle data and the image-taking position data so that the time period (τ

1) becomes substantially equal to the time period (τ

2).

18. A keying system according to claim 15, wherein, when the comparison means judges that the time period (τ

1) is larger than the time period (τ

2), wherein said adjustment means is adapted to regulate the timing of reading the at least one image from the plurality of background images stored in the memory device according to the at least one of the view angle data and the view position data so that the time period (τ

2) becomes substantially equal to the time period (τ

1).

19. A keying system comprising:

means for gaining an image of an object;

a graphics computer for producing at least one background image by computer graphics processing, said at least one background image being produced correspondingly to at least one of a view angle of a view point in a three-dimensional space to be imaged and a view position of the view point therein;

a buffer memory capable of storing at least one frame of the background image thereon;

first reading means for reading the at least one background image produced by the graphics computer at a given timing according to the at least one of the view angle and the view position preliminary both defined in accordance with the image of the object;

storage means for storing the at least one image read by the first reading means on the buffer memory;

means for judging whether or not the at least one of the defined angle and the defined position on the image of the object is changed within predetermined limits corresponding to a predetermined number of pixels;

second reading means for reading the at least one image stored in the buffer memory with shifting the at least one image by at least one pixel each along a direction of the change in case that the at least one of the defined angle and the defined position is changed within the predetermined limits;

third reading means for reading at least one background image at the given timing according to the at least one of the defined view angle and the defined view position in case that the at least one of the defined angle and the defined position is changed over the predetermined limits;

first keying-composition means for performing a keying composition between the at least one image read by the second reading means and the image of the object thereby producing a composite image; and

second keying-composition means for performing a keying composition between the at least one image read by the third reading means and the image of the object thereby producing a composite image.