Apparatus and method for adjusting the cognitive complexity of an audiovisual content to a viewer attention level

• US 9,032,472 B2
• Filed: 05/28/2009
• Issued: 05/12/2015
• Est. Priority Date: 06/02/2008
• Status: Active Grant

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: Koninklijke Philips N.V.
• Inventors: Mertens, Mark Jozef Willem
• Primary Examiner(s): Saltarelli, Dominic D
• Application Number:
  US12/994,182
• Publication Number:
  US 20110102674A1
• Time in Patent Office: 2,175 Days
• Field of Search: 725/139, 348/564
• US Class Current: 725/139
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: H04N 21/4398 involving reformatting operations of audio signals details of audio signal transcoding G10L19/173
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4402 involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/485 End-user interface for client configuration
• CPC Class Codes: H04N 21/4852 for modifying audio parameters, e.g. switching between mono and stereo
• CPC Class Codes: H04N 5/2625 for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect sequence generated by event triggered capturing H04N7/188
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

To allow viewer to adapt audiovisual content to their attention level, the audiovisual signal processing arrangement (104, 106), comprising an audiovisual signal processing unit (104) arranged to receive from a control unit (106) at least one complexity setting value (S_Inf-c) specifying a complexity of information in an audiovisual signal, the audiovisual signal processing unit (104) being arranged to process an inputted audiovisual signal S(A, V) to decrease or increase its information complexity as determined by the complexity setting value (S_Inf-c), wherein the audiovisual signal processing unit (104) is arranged to process at least an audio component (A) of the audiovisual signal S(A, V).

Claims

1. An audiovisual signal processing apparatus, the apparatus comprising:

a receiver for receiving audiovisual signals, each signal having one or more components, wherein the one or more components include a time unit;

a processor configured

to assign a value of complexity to the received audiovisual signals based on complexity of the respective one or more components, and

to playback the received audiovisual signals in accordance with a value of viewer desired complexity by increasing or decreasing complexity of the playback of the one or more components by changing a number of words rendered in the time unit,

wherein the one or more components include an audio having a plurality of temporal parts and voice data, and the processor increasing or decreasing complexity includes changing a volume of certain of the temporal parts of the audio component and changing a spectral characteristic of the voice data component.

2. The apparatus as claimed in claim 1, further comprising a controller having a sensor and configured to enable a viewer to change the value of the viewer desired complexity upwards or downwards in discrete steps.

3. The apparatus as claimed in claim 1, wherein the one or more components include video and audio components and the video component includes a plurality of different temporal parts, and the processor is configured to assign the different temporal parts of the video component to different spatial sub-regions of an output video.

4. The apparatus as claimed in claim 3, further comprising a selector configured to enable a viewer to select a particular temporal part of the video component and assign it to a spatial sub-regions of the output video.

5. The apparatus as claimed in claim 1, further comprising an analyzer configured to determine a type of one of the received audiovisual signals from at least one of a shot interval, a scene interval, a program interval, a reportage interval, a shot type.

6. The apparatus as claimed in claim 5, wherein the analyzer is further configured to detect a characteristic shot from a spatial histogram of pictures, and store identifying information of the characteristic shot from analysis of the received audiovisual signal over a time interval of more than a day.

7. The apparatus as claimed in claim 5, wherein the analyzer is further configured to detect a relevant part of the received audiovisual signal from a characteristic speaker, and store characterizing data of a plurality of characteristic speakers.

8. The apparatus as claimed in claim 5, wherein the analyzer is further configured to process the received audiovisual signal according to metadata describing different temporal subparts of the audiovisual signal.

9. The apparatus as claimed in claim 5, wherein the analyzer is further configured to recognize a commercial program, and the processor is configured to convert the commercial program to an essential summary audiovisual signal for combining with the output video.

10. The apparatus as claimed in claim 1, further comprising an audiovisual rendering apparatus having storage for storing the received audiovisual signals.

11. The apparatus as claimed in claim 1, wherein the controller is further configured to create a temporally repeating sequence of at least one temporal part of a part of the inputted audiovisual signal selected from at least one of a spatial subregion corresponding to a subwindow or a part to be displayed on a secondary display, and to allocate different time spans to different subparts of the at least one temporal part.

12. The storage medium as claimed in claim 1, wherein increasing or decreasing complexity includes adding or deleting one or more of the components.

13. A method of changing complexity of an audiovisual signal, the method comprising acts of:

receiving the audiovisual signal having one or more components, wherein the one or more components include a time unit;

assigning a value of complexity to the received audiovisual signal based on complexity of the one or more components; and

playback the received audiovisual signal in accordance with a value of viewer desired complexity by increasing or decreasing complexity of the playback of the one or more components by changing a volume of least one of the e one or more components and changing a spectral characteristic of voice data of least one of the one or more components rendered in the time unit.

14. An audiovisual signal processing apparatus, comprising:

a controller configured to

assign at least one value of complexity specifying a complexity level of one or more components including video in an audiovisual signal, wherein the one or more components include a time unit,

decrease or increase complexity of the playback of the one or more components in response to a value of viewer desired complexity by changing a volume of least one of the one or more components and changing a spectral characteristic of voice data of least one of the one or more components rendered in the time unit, and

playback at least the video component of the audiovisual signal.

15. A non-transitory storage medium readable by a computer and encoded with programming code which when executed by a computer performs a method of changing complexity of an audiovisual signal, the method comprising acts of:

receiving the audiovisual signal including one or more components, wherein the one or more components include a time unit;

assigning a value of complexity to the received audiovisual signal based on complexity of the one or more components; and

playback the received audiovisual signal in accordance with a value of viewer desired complexity by increasing or decreasing complexity of the playback of one or more components by changing a number of words rendered in the time unit,

wherein the one or more components include parts that are superimposed on a main window, an audio having a plurality of temporal parts, and voice data, and increasing or decreasing complexity includes changing a volume of certain of the temporal parts of the audio component and changing a spectral characteristic of the voice data component.

16. An audiovisual signal processing apparatus comprising:

a receiver configured to receive audiovisual input having information;

a controller configured to

assign a value of complexity to the information,

playback the received audiovisual input in accordance with the value of complexity by increasing or decreasing complexity of playback, and

change a number of words in a time unit of the audiovisual input, a volume of certain temporal parts of an audio component of the audiovisual input, and a spectral characteristic of voice data component of the audiovisual input.

17. A non-transitory storage medium readable by a processor and encoded with programming code which when executed by a processor performs a method of changing complexity of an audiovisual signal, the method comprising acts of:

receiving the audiovisual signal including one or more components;

assigning a value of complexity to the received audiovisual signal based on complexity of the one or more components; and

playback the received audiovisual signal in accordance with a value of viewer desired complexity by increasing or decreasing complexity of the playback of one or more components,

wherein the one or more components include audio having a plurality of temporal parts, and voice data, and increasing or decreasing complexity includes changing a volume of certain of the temporal parts of the audio component, changing a spectral characteristic of the voice data component, and adding or deleting one or more of the components.