System and a method for a post production object insertion in media files

• US 8,331,697 B2
• Filed: 11/06/2007
• Issued: 12/11/2012
• Est. Priority Date: 11/06/2007
• Status: Expired due to Fees

• Current Assignee: Jacob Samboursky, Uri Rotshtein
• Original Assignee: Jacob Samboursky, Uri Rotshtein
• Inventors: Samboursky, Jacob, Rotshtein, Uri
• Primary Examiner(s): Bella, Matthew
• Assistant Examiner(s): EDWARDS, PATRICK L
• Application Number:
  US11/935,888
• Publication Number:
  US 20090116754A1
• Time in Patent Office: 1,862 Days
• Field of Search: 382/219, 382/284, 382/294, 348/580, 348/584, 348/589
• US Class Current: 382/219
• CPC Class Codes: G06T 15/50 Lighting effects
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 5/2723 Insertion of virtual advertisement; Replacing advertisements physical present in the scene by virtual advertisement data processing systems or methods specially adapted for marketing G06Q30/02
• CPC Class Codes: H04N 5/275 Generation of keying signals

Abstract

Disclosed are a system and a method for a computerized automatic placement of objects in media files in post-production. Embodiments of the present invention enable the automatic placement of objects which appear in a media file, such as a digital video file. According to one embodiment of the present invention, the disclosed system and method allow the replacement of a specific pattern which appears in a given video file with a new image, in a fully transparent manner. According to embodiments of the present invention the makers of the media file place a designated pattern in the media file, such as a sticker on an object. Embodiments of the present invention enable the replacing of a new image on the designated pattern on the sticker with a new image.

Claims

1. A method for integrating new images into video frames, said method comprising:

physically attaching at least one designated pattern onto at least one-object, wherein each said designated pattern comprises a known geometrical pattern including a combination of shapes including a plurality of different colors;

providing a video frame including at least one image of said object having the pattern attached thereto;

identifying the location of the image of the object having the pattern attached thereto in the video frame at a post-production stage;

identifying visual characteristics of the image of the object by identifying visual changes between the image of the pattern over the image of the object in the video frame, said visual changes are caused by combination of the following (i) changes in the size of the pattern image in relation to the original size thereof, (ii) shading characteristics of the object image having the pattern image thereover caused due to illumination conditions, and angular positioning of the object when the frame was captured and (iii) changes between the known colors of said known pattern and the colors in the identified pattern image;

visually manipulating at least one new image, by adjusting visual characteristics of the new image according to said identified visual characteristics of said object image in said captured image; and

integrating said manipulated new image in said captured image in the identified location of said pattern image, by replacing said pattern image with said manipulated new image,

wherein said identification is enabled where the object is movable through digital video sequence;

wherein said integration is performed by using a computerized unit in post-production.

2. The method of claim 1 wherein said characteristics include the size of said designated pattern and said manipulation includes setting the size of said new image to said identified size of said designated pattern.

3. The method of claim 1 wherein said characteristics include the three-dimensional distortion of said designated pattern and said manipulation includes creating said three-dimensional distortion of said designated pattern in said new image.

4. The method of claim 1 wherein said characteristics include the lighting characteristics of said designated pattern and said manipulation includes setting the lighting characteristics of said new image to said identified lighting characteristics of said designated pattern.

5. The method of claim 1 wherein said characteristics include the partial concealment of said designated pattern and said manipulation includes the cutting of the equivalent segments out of said new image.

6. The method of claim 1 wherein said characteristics further include reflections on said designated pattern and said manipulation includes creation of said reflections on said new image.

7. The method of claim 1 further including the step of integrating said manipulations of said new image.

8. The method of claim 1 further including the step of managing said replacement of said designated pattern with said new image using a management tool.

9. The method of claim 8, wherein said management tool is configured to allow a user to manually select said new image for further manipulation and integration thereof, said selecting is enabled by allowing the user to first view each said designated pattern image of each said frame in the video sequence and selecting said new image according to each said designated pattern image.

10. The method of claim 9, wherein said management tool enables the selection of said new image in accordance with viewing conditions of said media file, said viewing conditions includes at least one of the following:

the geographic location of the viewer, the period of time of the viewing, the characteristics of the viewer, the medium through which the file is viewed.

11. The method of claim 9 wherein said integration is at least one of the following:

manual, automatic, semi-automatic.

12. The method of claim 1 wherein said designated pattern includes information indicating to the viewer that said replacement should be performed.

13. A system for integrating of a new image into a video, said system comprising:

at least one designated pattern attached onto an object in pre-production of the video, said designated pattern image comprises a known geometrical pattern including a combination of shapes including a plurality of different colors;

a module which identifies the location of said designated pattern image in said captured image;

a module which identifies visual characteristics of the image of said object by identifying visual changes between said captured image of said designated pattern and the original geometric pattern of said designated pattern, said visual changes are caused due to the combination of the following;

(i) changes in the size of the pattern image in relation to the original size thereof, (ii) illumination applied on the object when its image was captured and (iii) the view from which the object image was taken in the respective frame;

a module which manipulates said new image by adjusting at least one visual characteristic of said new image according to said identified visual characteristics of said designated pattern image; and

a module which integrates said manipulated new image in said captured image in said location of said designated pattern,

wherein said integration is performed by using a computerized unit in post-production.

14. The system of claim 13 wherein said designated pattern is designed to facilitate the distinction of said designated pattern from other patterns in said captured image.

15. The system of claim 13 wherein said designated pattern is designed to facilitate the identification of said characteristics of said designated pattern in said captured image.

16. The system of claim 13 further including an algorithm for identifying the size of said designated pattern and manipulating the size of said new image to said identified size of said designated pattern.

17. The system of claim 13 further including an algorithm for identifying the three-dimensional distortion of said designated pattern and creating said three-dimensional distortion of said designated pattern in said new image.

18. The system of claim 13 further including an algorithm for identifying the lighting characteristics of said designated pattern and setting the lighting characteristics of said new image to said identified lighting characteristics of said designated pattern.

19. The system of claim 13 further including an algorithm for identifying the partial concealment of said designated pattern and cutting the equivalent segments out of said new image.

20. The system of claim 13 further including an algorithm which allows identifying reflections on said designated pattern from said designated pattern image and said module which manipulates said new image allow creating said reflections on said new image.

21. The system of claim 13 further including a management tool for managing said replacement of said designated pattern with said new image.

22. The system of claim 21 wherein said management tool enables a user to manually select a new image.

23. The system of claim 13 further including a module for integrating said designated pattern in post production.