Spotlight effect in video processing and playback

• US 20070121011A1
• Filed: 04/25/2006
• Published: 05/31/2007
• Est. Priority Date: 11/30/2005
• Status: Active Grant

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Broadcom Corporation (Broadcom, Inc.)
• Inventors: Khare, Rajendra, Mishra, Brajabandhu, Relan, Sandeep
• Granted Patent: US 8,213,774 B2
• Time in Patent Office: Days
• US Class Current: 348/571
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/25435 involving characteristics of content or additional data, e.g. video resolution or the amount of advertising
• CPC Class Codes: H04N 21/431 Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/4402 involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/442 Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk arrangements for monitoring broadcast services or broadcast-related services H04H60/29; arrangements for identifying or recognising characteristics with a direct linkage to broadcast information H04H60/35; monitoring of user activities for profile generation for accessing a video database G06F16/739; monitoring in wireless networks H04W24/00
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

Spotlighting and other special effects are applied by processing circuitry in real time to received video streams. Effects tracking may be applied to fixed regions or moving regions or objects of interest. Viewers interact via conventional remote controls and other user interfaces to set effect parameters. Other special effects employed include zooming, masking, etc. and can be used to enhance one or more spotlight effects. Televisions, set top boxes and media players house the underlying circuitry. Effects are applied to layered and non-layered video streams to form layered and combined video stream output. Video outputs also deliver effect parameters such as region of interest location along with a video stream. Such effect parameters assist in the downstream application of dynamic effects.

Claims

1. A video processing system, located at a first and second premises, that operates on a first video having a single video layer, the video processing system comprising:

a communication pathway;

a video source, at the first premises, that broadcasts the first video on the communication pathway;

a first circuitry, at the second premises, that receives the first video via the communication pathway;

the first circuitry converts the single video layer of the first video into a plurality of video layers; and

a second circuitry, at the second premises, that applies an effect to at least one of the plurality of video layers.

2. The video processing system of claim 1, wherein the effect applied by the second circuitry comprises a spotlight effect.

3. The video processing system of claim 1, wherein:

the first video comprising a video stream; and

the first circuitry operates on the first video as it is received.

4. The video processing system of claim 1, wherein the second circuitry comprises:

a generation unit that produces special effects; and

a mixing unit that produces a combined output video.

5. The video processing system of claim 4, further comprising a display communicatively coupled to display the combined output video.

6. The video processing system of claim 2, wherein the second circuitry generates the spotlight effect based on a parameter.

7. The video processing system of claim 6, wherein the parameter determines a shape of the spotlight effect.

8. The video processing system of claim 6, wherein the parameter determines an appearance characteristic of the spotlight effect.

9. The video processing system of claim 6, further comprising a user interface that accepts input comprising the parameter.

10. The video processing system of claim 1, wherein the second circuitry applies the effect to a region of interest.

11. The video processing system of claim 2, wherein the second circuitry applies the spotlight effect dynamically by employing tracking.

12. The video processing system of claim 1, further comprising an accounting module.

13. The video processing system of claim 12, wherein the accounting module further includes a meter to monitor use of the effect and the accounting module is configured to charge a user based at least in part on the amount of time the effect is used.

14. The video processing system of claim 13, wherein the accounting module is configured to charge a user based at least in part on the type of effect.

15. Video processing circuitry comprising:

a video input that receives a first, single layer of video;

a layering module, communicatively coupled to the video input, that converts the first, single layer of video to a plurality of layers of video; and

an effects processing unit that applies a video effect to one or more of the plurality of layers of video to create processed layers.

16. The video processing circuitry of claim 15, wherein the video effect comprising a spotlight effect.

17. The video processing circuitry of claim 15, further comprising a combining module that creates a second, single layer of video using the processed layer.

18. The video processing circuitry of claim 15, further comprising a user interface through which the effects processing unit can be controlled.

19. The video processing circuitry of claim 15, further comprising an accounting module.

20. The video processing circuitry of claim 19, wherein the accounting module further includes a meter to monitor use of the effect and wherein the accounting module is configured to charge a user based at least in part on the amount of time the effect is used.

21. The video processing circuitry of claim 20, wherein the accounting module is configured to charge a user based at least in part on the type of effect.

22. A method of processing first video having a single layer, the method comprising:

converting the single layer of the first video to a plurality of layers;

applying an effect to one or more of the plurality of layers to produce processed layers; and

generating a second video having a single layer based on at least the processed layers.

23. The method of claim 22, wherein the application of the effect is based on a parameter.

24. The method of claim 23, further comprising receiving the parameter via a user input.

25. The method of claim 23, wherein the parameter comprises region of interest information.

26. The method of claim 25, wherein the region of interest information comprising tracking information.

27. The method of claim 22, further comprising monitoring use of the effect and billing a user based at least in part on the amount of time the effect is used.

28. The method of claim 27, wherein the monitoring use of the effect further includes charging a user based at least in part on the type of effect.

29. A method of applying a video effect, the method comprising:

receiving a primary video stream;

receiving at least one effect parameter associated with the primary video stream;

receiving a user input; and

selectively applying a video effect to the primary video stream based on the user input.

30. The method of claim 29, wherein the application of the video effect is controlled by the user input.

31. The method of claim 29, further comprising creating a plurality of video layers from the primary video stream.

32. The method of claim 29, wherein at least one effect parameter comprises region of interest information.

33. The method of claim 29, further comprising activating a video effect, the method comprising:

receiving a primary video stream;

receiving an effect video stream;

receiving the user input;

selectively combining the primary video stream and the effect video stream based on the user input; and

activating the combined primary and effect video streams.

34. The method of claim 33, wherein the application of the combination is controlled by the user input.

35. The method of claim 29, further comprising monitoring use of the effect and billing a user based at least in part on the amount of time the effect is used.

36. The method of claim 35, wherein the monitoring use of the effect further includes charging a user based at least in part on the type of effect.