SIGNAL PROCESSING APPARATUS, SIGNAL PROCESSING METHOD AND PROGRAM

• US 20130314497A1
• Filed: 05/16/2013
• Published: 11/28/2013
• Est. Priority Date: 05/23/2012
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Tsuchida, Yuji
• Application Number:
  US13/895,437
• Publication Number:
  US 20130314497A1
• Time in Patent Office: Days
• US Class Current: 348/43
• CPC Class Codes: H04N 13/00 Stereoscopic video systems; Multi-view video systems; Details thereof
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/439 Processing of audio elementary streams
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 5/60 for the sound signals
• CPC Class Codes: H04S 2400/05 Generation or adaptation of centre channel in multi-channel audio systems
• CPC Class Codes: H04S 7/30 Control circuits for electronic adaptation of the sound field
• CPC Class Codes: H04S 7/307 Frequency adjustment, e.g. tone control H04S7/301 takes precedence

Abstract

There is provided a signal processing apparatus including a disparity mode value calculating unit calculating a mode value of disparity related to dynamic image information, a time interval extracting unit extracting a time interval suitable for cooperation of perception of an anteroposterior sense from a change in a time direction of the mode value calculated by the disparity mode value calculating unit, and a control signal generating unit generating a sound control signal to control a depth sense of sound information related to the dynamic image information in the time interval extracted by the time interval extracting unit.

Claims

1. A signal processing apparatus comprising:

a disparity mode value calculating unit calculating a mode value of disparity related to dynamic image information;

a time interval extracting unit extracting a time interval suitable for cooperation of perception of an anteroposterior sense from a change in a time direction of the mode value calculated by the disparity mode value calculating unit; and

a control signal generating unit generating a sound control signal to control a depth sense of sound information related to the dynamic image information in the time interval extracted by the time interval extracting unit.

2. The signal processing apparatus according to claim 1, wherein the time interval extracting unit detects a change in a scene structure of the dynamic image information based on the dynamic image information and the mode value calculated by the disparity mode value calculating unit, and removes a time interval in which the change is detected.

3. The signal processing apparatus according to claim 2,

wherein the scene structure change detecting unit includes a time differentiation unit performing time differentiation on the mode value calculated by the disparity mode value calculating unit, and a non-linear conversion unit performing non-linear conversion on the mode value subjected to time differentiation in the time differentiation unit, and

wherein the control signal generating unit includes a time integration unit performing time integration on the mode value subjected to non-linear conversion in the non-linear conversion unit.

4. The signal processing apparatus according to claim 3, wherein the scene structure change detecting unit further includes an initialization deciding unit initializing the time integration performed by the time integration unit, according to magnitude of an absolute value of the mode value calculated by the disparity mode value calculating unit.

5. The signal processing apparatus according to claim 1, wherein the time interval extracting unit includes a mode value reliability deciding unit evaluating a reliability of the mode value based on the dynamic image information and the mode value calculated by the disparity mode value calculating unit and removing a time interval in which the reliability of the mode value is low.

6. The signal processing apparatus according to claim 5,

wherein the mode value reliability deciding unit includes a time differentiation unit performing time differentiation on the mode value calculated by the disparity mode value calculating unit, and a non-linear conversion unit performing non-linear conversion on the mode value subjected to time differentiation in the time differentiation unit, and

wherein the control signal generating unit includes a time integration unit performing time integration on the mode value subjected to non-linear conversion in the non-linear conversion unit.

7. The signal processing apparatus according to claim 6, further comprising:

a disparity maximum value calculating unit calculating a maximum value of the disparity; and

a disparity minimum value calculating unit calculating a minimum value of the disparity,

wherein the mode value reliability deciding unit further includes an initialization deciding unit initializing the time integration performed by the time integration unit, according to at least one of magnitude of a difference between the maximum value calculated by the disparity maximum value calculating unit and the minimum value calculated by the disparity minimum value calculating unit, a time change in the maximum value and a time change in the minimum value.

8. The signal processing apparatus according to claim 7, wherein the initialization deciding unit initializes the time integration performed by the time integration unit, according to the magnitude of an absolute value of the mode value calculated by the disparity mode value calculating unit.

9. The signal processing apparatus according to claim 1, wherein the time interval extracting unit includes a sound control effect evaluating unit evaluating, based on sound information related to the dynamic image information and the mode value calculated by the disparity mode value calculating unit, an effect in a case where the sound information is controlled by the dynamic image information, and changing the sound control signal.

10. The signal processing apparatus according to claim 9,

wherein the sound control effect evaluating unit includes a time differentiation unit performing time differentiation on the mode value calculated by the disparity mode value calculating unit, and a non-linear conversion unit performing non-linear conversion on the mode value subjected to time differentiation in the time differentiation unit, and

wherein the control signal generating unit includes a time integration unit performing time integration on the mode value subjected to non-linear conversion in the non-linear conversion unit.

11. The signal processing apparatus according to claim 10, wherein the sound control effect evaluating unit further includes an initialization deciding unit initializing the time integration performed by the time integration unit, according to a difference between the mode value calculated by the disparity mode value calculating unit and a time average value of the mode value.

12. The signal processing apparatus according to claim 11, wherein the initialization deciding unit initializes the time integration performed by the time integration unit, according to magnitude of an absolute value of the mode value calculated by the disparity mode value calculating unit.

13. A signal processing method in which a signal processing apparatus performs operations of:

calculating a mode value of disparity related to dynamic image information;

extracting a time interval suitable for cooperation of perception of an anteroposterior sense from a change in a time direction of the calculated mode value; and

generating a sound control signal to control a depth sense of sound information related to the dynamic image information in the extracted time interval.

14. A program for causing a computer to function as:

a disparity mode value calculating unit calculating a mode value of disparity related to dynamic image information;

a time interval extracting unit extracting a time interval suitable for cooperation of perception of an anteroposterior sense from a change in a time direction of the mode value calculated by the disparity mode value calculating unit; and

a control signal generating unit generating a sound control signal to control a depth sense of sound information related to the dynamic image information in the time interval extracted by the time interval extracting unit.

15. A signal processing apparatus comprising:

a disparity mode value calculating unit calculating a mode value of disparity related to dynamic image information;

a time differentiation unit performing time differentiation on the mode value calculated by the disparity mode value calculating unit;

a non-linear conversion unit performing non-linear conversion on the mode value subjected to time differentiation in the time differentiation unit; and

a time integration unit performing time integration on the mode value subjected to non-linear conversion in the non-linear conversion unit.