Television displays having selected inserted indicia

• US 5,264,933 A
• Filed: 01/28/1992
• Issued: 11/23/1993
• Est. Priority Date: 07/19/1991
• Status: Expired due to Term

• Current Assignee: Sportvision, Inc. (Sportsmedia Technology Corporation)
• Original Assignee: Princeton Electronic Billboard Incorporated
• Inventors: Leach, Martin, Rosser, Roy J.
• Primary Examiner(s): Powell, Mark R.
• Assistant Examiner(s): LEE, MICHAEL
• Application Number:
  US07/826,754
• Time in Patent Office: 665 Days
• Field of Search: 358/183, 358/182, 358/181, 358/160, 358/166, 358/22, 358/105, 358/21 R, 358/93, 358/185, 358/83, 358/84, 340/720, 340/723, 340/721, 340/725, 340/728, 340/734, 340/747, 340/703, 340/729, 382/48, 382/44-47, 382/10
• US Class Current: 348/578
• CPC Class Codes: H04N 5/2627 for providing spin image effect, 3D stop motion effect or temporal freeze effect 2D image animation in general G06T13/80
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 5/2723 Insertion of virtual advertisement; Replacing advertisements physical present in the scene by virtual advertisement data processing systems or methods specially adapted for marketing G06Q30/02

Abstract

An apparatus and method of altering video images to enable the addition of images, message, slogans or indicia in such a manner that they appear to be part of the original image as displayed. The application of the apparatus and method is particularly adapted to be used as advertising during sporting events or other events whereby an operator selects a portion of the video image display (16) such as a portion of a tennis court (12), recognizes the selected portion (17) and inserts a logo or advertising message (27) into that selected portion. The message is inserted into the selected portion of the court independent of how the scene is being panned or viewed by the television camera. The apparatus employs a pattern recognition algorithm such as the Burt Pyramid Algorithm to recognize the specific selected image portion and by means of the image processor (17, 20, 27) substitute the logo into the first image (16) to provide a display which appears as if the inserted image was actually painted on or otherwise permanently positioned on the court. Thus the inserted images are seamlessly and realistically incorporated into the original even as the original scene is moved, panned, magnified, zoomed or otherwise altered in size or perspective. The resulting composite image appears to the television viewer to be absolutely real and present at the scene.

Claims

1. Apparatus for altering a video image display to provide a substituted display of desired indicia within a preselected portion of said video image display and independent of the size or perspective of said selected portion, said size and perspective of said selected portion varying in accordance with the perspective and range of a video camera means operable to generate signals corresponding to an image viewed by said camera means, said signal causing said image to be displayed by said video image display, comprising:

means for selecting said portion of said display to be substituted, said selected portion being indicative of an identifiable segment of said televised image and said identifiable segment being subject to changes in size and perspective,

means responsive to said video image display signals for recognizing said selected portion of said display,

means for generating video signals indicative of said desired indicia to be substituted,

means responsive to said video signals indicative of said desired indicia and said video image display signals for inserting a video representation of said indicia into said video image display at said preselected portion.

2. The apparatus according to claim 1, further including:

audio processing means responsive to audio signals associated with said televised scene to alter said substituted display portion according to said audio signals.

3. The apparatus according to claim 2, wherein said display indicia is modulated according to the intensity of said audio signals, which signals exceed a given threshold.

4. The apparatus according to claim 1, wherein said means for selecting includes a light pen for outlining said portion of said display to be selected and means for storing said selected outline.

5. The apparatus according to claim 1, wherein said desired indicia includes an advertising message.

6. The apparatus according to claim 1, further including:

delay means responsive to said recognized video signal and said video signals representative of said desired indicia for showing the same on a frame-to-frame basis to enable the insertion of said indicia on a real time basis.

7. The apparatus according to claim 1, wherein said means responsive to said video signal display includes pattern recognition means responsive to said selected portion of said display to provide signals indicative of said selected portion independent of the size of said portion with respect to said display.

8. The apparatus according to claim 7, wherein said pattern recognition means includes means for performing a pyramid algorithm.

9. The apparatus according to claim 1, further including means responsive to colors present in said video display to inhibit display substitution during the presence of selected colors, whereby replaceable pixels can be substituted for non-replaceable pixels.

34. The apparatus according to claim 1 wherein said means responsive to said video image display signals for recognizing said selected portion of said display operates in response to video attributes outside the perimeter of said selected portion of said display.

38. The apparatus according to claim 1 wherein said selected portion comprises an object within said video image display and whereby a path traversed by said object from image to image is highlighted, including use of an enhanced image of said object as said inserted indicia.

39. The apparatus according to claim 1 wherein said selected portion comprises an object within said video image display and whereby the path traversed by said object from image to image is highlighted, including use of a modulated image of said object as said inserted indicia.

10. A method for altering a video image display to provide a substituted display of desired indicia within a preselected portion of said video image display and independent of the size or perspective of said selected portion, said size and perspective of said selected portion varying in accordance with the perspective and range of a video camera means operable to generate signals corresponding to an image viewed by said camera means, said signal causing said image to be displayed by said video image display, comprising the steps of:

selecting said portion of said display to be substituted, said selected portion being indicative of an identifiable segment of said televised image and said identifiable segment being subject to changes in size and perspective,

recognizing said selected portion of said display and independent of the size or perspective of said portion with respect to said display,

generating a video image of said desired indicia, and

inserting said image of said desired indicia within said recognized portion of said display on a.

11. The method according to claim 10, wherein the step of generating a video image of desired indicia includes generating a video image of an advertising format such as a manufacturer'"'"'s trademark or logo.

12. The method according to claim 11, wherein said selected portion of said display to be substituted comprises the boundaries of a sports court, with said desired indicia including enhanced replicas of said boundaries.

13. The method according to claim 10, further including the step of:

detecting the intensity of audio signals emanating from said televised scene and altering the inserted image according to said detected audio.

14. The method according to claim 10, further indicates the step of:

selectively responding to a color present in said display for inhibiting the insertion of said desired indicia within said selected portion according to the presence of said color.

15. The method according to claim 10, further including the step of:

storing said selected portion of said display in a memory prior to inserting the same into said stored selected portion.

16. The method according to claim 10, wherein the step of recognizing includes,

applying a pattern recognition algorithm to said video display after selecting said portion, wherein said algorithm is a pyramid algorithm capable of processing said displayed image enabling recognition of said selected portion independent of the size, location or orientation of the same with respect to said display on a frame-to-frame basis.

17. The method according to claim 16, wherein said algorithm is the Burt Pyramid Algorithm.

18. The method according to claim 10, wherein the step of selecting includes outlining said selected portion of said display with a light pen and

storing the outline of said light pen indicative of said selected portion.

19. The method according to claim 10, further including the step of:

modulating said inserted video image according to the sound intensity emanating from said televised scene.

20. The method according to claim 10, further including the step of:

detecting motion in said display during a frame and inhibiting said video image of said desired indicia into said display according to said detected motion.

35. The method according to claim 10 wherein the step of recognizing said selected portion of said display is responsive to video attributes outside the perimeter of said selected portion of said display.

42. The method according to claim 10 wherein said selected portion comprises an object within said video image display and whereby the path traversed by said object, from image to image, is highlighted, including use of a modulated image of said object as said inserted indicia.

43. The method according to claim 10 wherein said selected portion comprises an object within said video image display and whereby the path traversed by said object, from image to image, is highlighted, including use of an enhanced image of said object as said inserted indicia.

21. Apparatus for altering a video image display to provide a substituted display of desired indicia within a preselected portion of said video image display and independent of the size of said selected portion which size is strictly a function of the TV camera, said TV camera operable at various different perspectives employed to create said display, comprising:

means for selecting said portion of said display to be substituted,

means responsive to said video signal display for recognizing said selected portion of said display,

means for generating video signals indicative of said desired indicia to be substituted,

means responsive to said desired indicia signals and said video signal for inserting said indicia into said video image display at said preselected portion, and

audio processing means responsive to audio signals associated with the televised scene comprising said video image display to alter said substituted display portion according to said audio signals.

22. The apparatus according to claim 21 wherein said display indicia is modulated according to the intensity of said audio signals, which signals exceed a given threshold.

36. The apparatus according to claim 21 wherein said means responsive to said video image display signals for recognizing said selected portion of said display operates in response to video attributes outside the perimeter of said selected portion of said display.

23. Apparatus for altering a video image display to provide a substituted display of desired indicia within a preselected portion of said video image display and independent of the size of said selected portion which size is strictly a function of the TV camera, said TV camera operable at various different perspectives employed to create said display, comprising:

means for selecting said portion of said display to be substituted,

means responsive to said video signal display for recognizing said selected portion of said display, including pattern recognition means responsive to said selected portion of said display to provide signals indicative of said selected portion independent of the size of said portion with respect to said display, and wherein said pattern recognition means includes means for performing a pyramid algorithm,

means for generating video signals indicative of said desired indicia to be substituted,

means responsive to said desired indicia signals and said video signal for inserting said indicia into said video image display at said preselected portion.

40. The apparatus according to claim 23 wherein said selected portion comprises an object within said video image display and whereby the path traversed by said object from image to image is highlighted, including use of an enhanced image of said object as said inserted indicia.

41. The apparatus according to claim 23 wherein said selected portion comprises an object within said video image display and whereby the path traversed by said object from image to image is highlighted, including use of a modulated image of said object as said inserted indicia.

24. A method for altering a video image display to provide a substituted display of desired indicia within a preselected portion of said video image display on a frame-to-frame basis and independent of the size of said selected portion on a frame-to-frame basis which size is a function of the TV camera perspective employed to create said display, comprising the steps of:

selecting said portion of said display to be substituted,

recognizing said selected portion of said display on a frame-to-frame basis and independent of the size of said portion with respect to said display,

generating a video image of said desired indicia,

inserting said image of said desired indicia within said recognized portion of said display on a frame-to-frame basis, and

detecting the intensity of audio signals emanating from the televised scene comprising said video image display and altering the inserted image according to said detected audio.

37. The method according to claim 24 wherein the step of recognizing said selected portion of said display is responsive to video attributes outside the perimeter of said selected portion of said display.

25. A method for altering a video image display to provide a substituted display of desired indicia within a preselected portion of said video image display on a frame-to-frame basis and independent of the size of said selected portion on a frame-to-frame basis, which size is a function of the TV camera perspective employed to create said display, comprising the steps of:

selecting said portion of said display to be substituted,

recognizing said selected portion of said display on a frame-to-frame basis and independent of the size of said portion with respect to said display, whereby a pattern recognition algorithm is applied to said selected portion and wherein said algorithm is a pyramid algorithm capable of processing said displayed image enabling recognition of said selected portion independent of the size, location or orientation of the same with respect to said display on a frame-to-frame basis,

generating a video image of said desired indicia, and

inserting said image of said desired indicia within said recognized portion of said display on a frame-to-frame basis.

26. The method according to claim 25 where said algorithm is the Burt Pyramid Algorithm.

44. The method according to claim 25 wherein said selected portion comprises an object within said video image display and whereby the path traversed by said object, from image to image, is highlighted, including use of a modulated image of said object as said inserted indicia.

45. The method according to claim 25 wherein said selected portion comprise an object within said video image display and whereby the path traversed by said object, from image to image, is highlighted, including use of an enhanced image of said object as said inserted indicia.

27. A method for altering a video image display to provide a substituted display of desired indicia within a preselected portion of said video image display on a frame-to-frame basis and independent of the size of said selected portion on a frame-to-frame basis which size is a function of the TV camera perspective employed to create said display, comprising the steps of:

selecting said portion of said display to be substituted,

recognizing said selected portion of said display on a frame-to-frame basis and independent of the size of said portion with respect to said display,

generating a video image of said desired indicia,

inserting said image of said desired indicia within said recognized portion of said display on a frame-to-frame basis, and

modulating said inserted video image according to the sound intensity emanating from the televised scene comprising said video image display.

28. A method for altering a video image display to provide a substituted display of desired indicia with a preselected portion of said video image display on a frame-to-frame basis and independent of the size of said selected portion on a frame-to-frame basis which size is a function of the TV camera perspective employed to create said display, comprising the steps of:

selecting said portion of said display to be substituted,

recognizing said selected portion of said display on a frame-to-frame basis and independent of the size of said portion with respect to said display,

generating a video image of said desired indicia,

inserting said image of said desired indicia within said recognized portion of said display on a frame-to-frame basis, and

detecting motion in said display during a frame and inhibiting said video image of said desired indicia into said display according to said detected motion.

29. Apparatus for altering a video image display to provide a substituted display of desired indicia within a preselected portion of said video image display and independent of the size of said selected portion which size is strictly a function of the TV camera, said TV camera operable at various different perspectives employed to create said display, comprising:

means for selecting said portion of said display to be substituted,

means responsive to said video signal display for recognizing said selected portion of said display, including pattern recognition means responsive to said selected portion of said display to provide signals indicative of said selected portion independent of the size of said portion with respect to said display,

means for generating video signals indicative of said desired indicia to be substituted,

means responsive to said desired indicia signals and said video signal for inserting said indicia into said video image display at said preselected portion.

30. Apparatus for altering a video image display to provide a substituted display of desired indicia within a preselected portion of said video image display and independent of the size or perspective of said selected portion, said size and perspective of said selected portion varying in accordance with the perspective and range of a video camera means operable to generate video signals corresponding to an image viewed by said camera means, said video signal causing said image to be displayed by said video image display, comprising:

means for selecting said portion of said display to be substituted, said selected portion being indicative of an identifiable segment of said televised image and said identifiable segment being subject to changes in size and perspective at the frame rate of said video signal,

means responsive to video attributes outside the perimeter of said selected portion of said display for recognizing said selected portion of said display,

means for generating video signals indicative of said desired indicia to be substituted,

means responsive to said video signals indicative of said desired indicia and said video image display signals for inserting a video representation of said indicia into said video image display.

31. A method for altering a video image display to provide a substituted display of desired indicia within a preselected portion of said video image display and independent of the size or perspective of said selected portion, said size and perspective of said selected portion varying in accordance with the perspective and range of a video camera means operable to generate video signals corresponding to an image viewed by said camera means, said video signal causing said image to be displayed by said video image display, comprising the steps of:

selecting said portion of said display to be substituted, said selected portion being indicative of an identifiable segment of said televised image and said identifiable segment being subject to changes in size and perspective at the frame rate of said video signal,

recognizing said selected portion of said display at said frame rate and independent of the size or perspective of said portion with respect to said display,

generating a video image of said desired indicia, and

inserting said image of said desired indicia into an area of said display determined with respect to said recognized portion at the frame rate of said video signal.

32. Apparatus for altering a video image display to provide a substituted display of desired indicia within a preselected portion of said video image display and independent of the size or perspective of said selected portion, said size and perspective of said selected portion varying in accordance with the perspective and range of a video camera means operable to generate video signals corresponding to an image viewed by said camera means, said video signal causing said image to be displayed by said video image display, comprising:

means for selecting said portion of said display to be substituted, said selected portion being indicative of an identifiable segment of said televised image and said identifiable segment being subject to random variation in size and perspective from image to image,

means responsive to video attributes outside the perimeter of said selected portion of said display for recognizing said selected portion of said display,

means for generating video signals indicative of said desired indicia to be substituted,

means responsive to said video signals indicative of said desired indicia and said video image display signals for inserting a video representation of said indicia into said video image display.

33. A method for altering a video image display to provide a substituted display of desired indicia within a preselected portion of said video image display and independent of the size or perspective of said selected portion, said size and perspective of said selected portion varying in accordance with the perspective and range of a video camera means operable to generate video signals corresponding to an image viewed by said camera means, said video signal causing said image to be displayed by said video image display, comprising the steps of:

selecting said portion of said display to be substituted, said selected portion being indicative of an identifiable segment of said televised image and said identifiable segment being subject to random variation in size and perspective from image to image,

recognizing said selected portion of said display, said recognition being independent of the size or perspective of said portion with respect to said display,

generating a video image of said desired indicia, and

inserting said image of said desired indicia into an area of said display determined with respect to said recognized portion.