Apparatus and method for tuning an audiovisual system to viewer attention level

• US 9,749,550 B2
• Filed: 09/26/2013
• Issued: 08/29/2017
• Est. Priority Date: 06/02/2008
• Status: Active Grant

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: Koninklijke Philips N.V.
• Inventors: Mertens, Mark Jozef Willem
• Primary Examiner(s): Saltarelli, Dominic D
• Application Number:
  US14/037,492
• Publication Number:
  US 20140022459A1
• Time in Patent Office: 1,433 Days
• Field of Search: 725136, 725140, 725142, 725151
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: H04N 21/4398 involving reformatting operations of audio signals details of audio signal transcoding G10L19/173
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4402 involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/485 End-user interface for client configuration
• CPC Class Codes: H04N 21/4852 for modifying audio parameters, e.g. switching between mono and stereo
• CPC Class Codes: H04N 5/2625 for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect sequence generated by event triggered capturing H04N7/188
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

An audiovisual signal processing device including a signal processing unit configured to receive a video signal comprising a plurality of images; identify at least first and second video components of the video signal, the first video component relating to motion of the first video component between at least a first portion of the plurality of images and the second video component relating to a substantial lack of motion of the second video component between at least a second portion of the plurality of images; select at least one image from the second portion of the plurality of images including the second video component; and insert the first video component into a plurality of the selected at least one image to create a temporally repeating sequence of the at least one image including the first video component.

Claims

1. An audiovisual signal processing device, comprising a signal processing unit configured to

receive a video signal comprising a plurality of images representing at least a part of an original scene having at least first and second video objects, the first video object having motion between at least two of the plurality of images and the second video object having a substantial lack of motion between at least two of the plurality of images;

identify the at least first and second video objects of the plurality of images;

select at least one image from the second two of the plurality of images including the second video object; and

transform the received video signal by inserting the first video object into a plurality of the selected at least one image to create a temporally repeating sequence of the at least one image including the first and second video objects resulting in a change in the part of the original scene, wherein superposition of the first video object in the temporally repeating sequence of the at least one image varies based on the motion of the first video object.

2. The audiovisual signal processing device of claim 1, comprising a selection unit configured to select under viewer control a particular temporal part of the plurality of images to select from, for the least one image.

3. The audiovisual signal processing device of claim 2, wherein the signal processing unit is configured to process the video signal according to metadata describing different temporal subparts of the video signal.

4. The audiovisual signal processing device of claim 1, wherein the signal processing unit is configured to analyze motion in the plurality of images to identify the first and second video objects.

5. The audiovisual signal processing device of claim 1, wherein the signal processing unit is configured to stabilize the first video object in the changed part of the original scene based on determined edges of the first video object.

6. The audiovisual signal processing device of claim 1, wherein the signal processing unit is configured to stabilize the first video object in the changed part of the original scene by performing motion compensated interpolation of the first video object.

7. The audiovisual signal processing device of claim 1, wherein the signal processing unit is configured to determine scene boundaries in the plurality of images to identify the second video object.

8. The audiovisual signal processing device of claim 1, wherein the signal processing unit is configured to identify people in the plurality of images to identify the first video object.

9. The audiovisual signal processing device of claim 1, wherein the signal processing unit is configured to determine at least one of a shot interval, a scene interval, a program interval, a reportage interval, a shot type, a scene type, a program type and a reportage type of the plurality of images to select the at least one image.

10. The audiovisual signal processing device of claim 1, comprising a memory, wherein the signal processing unit is configured to detect a characteristic shot using a spatial histogram of at least a portion of the plurality of images, analyze the plurality of images to identify information of the characteristic shot and store the identifying information of the characteristic shot in the memory.

11. The audiovisual signal processing device of claim 1, wherein the signal processing unit is configured to process the video signal according to metadata describing different temporal subparts of the video signal.

12. The audiovisual signal processing device of claim 1, wherein the first and second video objects of the plurality of images are identified from at least partially overlapping portions of the plurality of images.

13. The audiovisual signal processing device of claim 1, wherein the signal processing unit is configured to identify at least a third video object of the video signal, the third video object having motion between at least two of the plurality of images and to insert the third video object into the plurality of the selected at least one image to create the temporally repeating sequence of the at least one image including the first, second and third video objects.

14. The audiovisual signal processing device of claim 13, wherein a temporal span of the first video object is different than a temporal span of the third video object and the signal processing unit is configured to retime one of the first and third video objects inserted in the temporally repeating sequence.

15. A method of processing a video signal, comprising acts of:

receiving the video signal comprising a plurality of images representing at least a part of an original scene having at least first and second video objects, the first video object having motion between at least two of the plurality of images and the second video object having a substantial lack of motion between at least two of the plurality of images;

identifying the at least first and second video objects of the plurality of images;

selecting at least one image from the plurality of images including the second video object; and

transforming the received video signal by inserting the first video object into a plurality of the selected at least one image creating a temporally repeating sequence of the at least one image including the first and second video objects resulting in a change in the part of the original scene with superposition of the first video component in the temporally repeating sequence of the at least one image varying based on the motion of the first video object.

16. A non-transitory memory medium containing instructions that when executed by a processor configure the processor to perform a method of processing a video signal, the method comprising acts of:

receiving the video signal comprising a plurality of images representing at least a part of an original scene having at least first and second video objects, the first video object having motion between at least two of the plurality of images and the second video object having a substantial lack of motion between at least two of the plurality of images;

identifying the at least first and second video objects of the plurality of images;

selecting at least one image from the plurality of images including the second video object; and

transforming the received video signal by inserting the first and second video objects into a plurality of the selected at least one image thereby creating a temporally repeating sequence of the at least one image including the first video object resulting in a change in the part of the original scene with superposition of the first video object in the temporally repeating sequence of the at least one image varying based on the motion of the first video object.