Spotlight effect in video processing and playback

• US 8,213,774 B2
• Filed: 04/25/2006
• Issued: 07/03/2012
• Est. Priority Date: 11/30/2005
• Status: Active Grant

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Broadcom Corporation (Broadcom, Inc.)
• Inventors: Relan, Sandeep Kumar, Mishra, Brajabandhu, Khare, Rajendra Kumar
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): Wendmagegn, Girumsew
• Application Number:
  US11/410,144
• Publication Number:
  US 20070121011A1
• Time in Patent Office: 2,261 Days
• Field of Search: 386/46, 386/280, 348/571, 348/576
• US Class Current: 386/280
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/25435 involving characteristics of content or additional data, e.g. video resolution or the amount of advertising
• CPC Class Codes: H04N 21/431 Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/4402 involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/442 Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk arrangements for monitoring broadcast services or broadcast-related services H04H60/29; arrangements for identifying or recognising characteristics with a direct linkage to broadcast information H04H60/35; monitoring of user activities for profile generation for accessing a video database G06F16/739; monitoring in wireless networks H04W24/00
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

Spotlighting and other special effects are applied by processing circuitry in real time to received video streams. Effects tracking may be applied to fixed regions or moving regions or objects of interest. Viewers interact via conventional remote controls and other user interfaces to set effect parameters. Other special effects employed include zooming, masking, etc. and can be used to enhance one or more spotlight effects. Televisions, set top boxes and media players house the underlying circuitry. Effects are applied to layered and non-layered video streams to form layered and combined video stream output. Video outputs also deliver effect parameters such as region of interest location along with a video stream. Such effect parameters assist in the downstream application of dynamic effects.

Claims

1. A video processing system, located at first and second premises, that operates on a first video having a single video layer, the video processing system comprising:

a communication pathway;

a video source, at the first premises, that is configured to broadcast the first video on the communication pathway;

first circuitry, at the second premises, that is configured to receive the first video via the communication pathway;

the first circuitry configured to convert the single video layer of the first video into a plurality of video layers, wherein one of the plurality of video layers of a scene omits at least one object present in another of the plurality of video layers of the scene; and

second circuitry, at the second premises, that is configured to apply an effect to at least one of the plurality of video layers.

2. The video processing system of claim 1, wherein the effect applied by the second circuitry comprises a spotlight effect.

3. The video processing system of claim 2, wherein the second circuitry is configured to generate the spotlight effect based on a parameter.

4. The video processing system of claim 3, wherein the parameter determines a shape of the spotlight effect.

5. The video processing system of claim 3, wherein the parameter determines an appearance characteristic of the spotlight effect.

6. The video processing system of claim 3, further comprising a user interface that is configured to accept input comprising the parameter.

7. The video processing system of claim 2, wherein the second circuitry is configured to apply the spotlight effect dynamically by employing tracking.

8. The video processing system of claim 1, wherein:

the first video comprises a video stream; and

the first circuitry is configured to operate on the first video as it is received.

9. The video processing system of claim 1, wherein the second circuitry comprises:

a generation unit that is configured to produce special effects; and

a mixing unit that is configured to produce a combined output video.

10. The video processing system of claim 9, further comprising a display communicatively coupled to display the combined output video.

11. The video processing system of claim 1, wherein the second circuitry is configured to apply the effect to a region of interest.

12. The video processing system of claim 1, further comprising an accounting module.

13. The video processing system of claim 12, wherein the accounting module further includes a meter configured to monitor use of the effect and the accounting module is configured to charge a user based at least in part on the amount of time the effect is used.

14. The video processing system of claim 13, wherein the accounting module is configured to charge the user based at least in part on the type of effect.

15. Video processing circuitry comprising:

a video input that is configured to receive a first, single layer of video;

a layering module, communicatively coupled to the video input, that is configured to convert the first, single layer of video to a plurality of layers of video, wherein one of the plurality of video layers of a scene omits at least one object present in another of the plurality of video layers of the scene; and

an effects processing unit that is configured to apply a video effect to one or more of the plurality of layers of video to create processed layers.

16. The video processing circuitry of claim 15, wherein the video effect comprises a spotlight effect.

17. The video processing circuitry of claim 15, further comprising a combining module that is configured to create a second, single layer of video using the processed layers.

18. The video processing circuitry of claim 15, further comprising a user interface through which the effects processing unit can be controlled.

19. The video processing circuitry of claim 15, further comprising an accounting module.

20. The video processing circuitry of claim 19, wherein the accounting module further includes a meter configured to monitor use of the video effect and wherein the accounting module is configured to charge a user based at least in part on the amount of time the video effect is used.

21. The video processing circuitry of claim 20, wherein the accounting module is configured to charge the user based at least in part on the type of effect.

22. A method of processing first video having a single layer, the method comprising:

converting the single layer of the first video to a plurality of layers, wherein one layer of the plurality of layers of a scene omits at least one object present in another layer of the plurality of layers of the scene;

applying an effect to one or more of the plurality of layers to produce processed layers; and

generating a second video having a single layer based on at least the processed layers.

23. The method of claim 22, wherein the application of the effect is based on a parameter.

24. The method of claim 23, further comprising receiving the parameter via a user input.

25. The method of claim 23, wherein the parameter comprises region of interest information.

26. The method of claim 25, wherein the region of interest information comprises tracking information.

27. The method of claim 22, further comprising monitoring use of the effect and billing a user based at least in part on the amount of time the effect is used.

28. The method of claim 27, wherein the monitoring use of the effect further includes charging the user based at least in part on the type of effect.

29. A method of applying a video effect, the method comprising:

receiving a primary video stream;

creating a plurality of video layers from the primary video stream, wherein one of the plurality of video layers of a scene omits at least one object present in another of the plurality of video layers of the scene;

receiving at least one effect parameter associated with the primary video stream;

receiving a user input; and

selectively applying the video effect to one or more of the plurality of video layers created from the primary video stream based on the user input.

30. The method of claim 29, wherein the application of the video effect is controlled by the user input.

31. The method of claim 29, wherein the at least one effect parameter comprises region of interest information.

32. The method of claim 29, further comprising:

receiving an effect video stream;

selectively combining the primary video stream and the effect video stream based on the user input; and

activating the combined primary and effect video streams.

33. The method of claim 32, wherein the application of the combination is controlled by the user input.

34. The method of claim 29, further comprising monitoring use of the video effect and billing a user based at least in part on the amount of time the video effect is used.

35. The method of claim 34, wherein the monitoring use of the video effect further includes charging the user based at least in part on the type of video effect.