Display device and method of outputting audio signal

• US 8,964,010 B2
• Filed: 04/28/2011
• Issued: 02/24/2015
• Est. Priority Date: 04/29/2010
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kim, Heejin, Lee, Sungkoo
• Primary Examiner(s): Kelley, Christopher S
• Assistant Examiner(s): BEASLEY, DEIRDRE L
• Application Number:
  US13/096,678
• Publication Number:
  US 20110267440A1
• Time in Patent Office: 1,398 Days
• Field of Search: 348/55, 382/154, 381/17, 381/306
• US Class Current: 348/55
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: G06T 7/97 Determining parameters from multiple pictures depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85
• CPC Class Codes: H04N 21/439 Processing of audio elementary streams
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 5/60 for the sound signals
• CPC Class Codes: H04S 2400/07 Generation or adaptation of the Low Frequency Effect [LFE] channel, e.g. distribution or signal processing
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 7/305 Electronic adaptation of stereophonic audio signals to reverberation of the listening space H04S7/301 takes precedence

Abstract

A display device receives first data for an object to be displayed at a first point in time and second data for the object to be displayed at a second point in time, the second point in time being after the first point in time. A controller determines a difference between the first and second data and controls output of an audio signal based on the difference. The difference is indicative of a change in perceived depth by a viewer.

Claims

1. A method of controlling a display device, comprising:

receiving an image signal and an audio signal, wherein the image signal comprises a previous frame object to be displayed on a display screen at a previous point in time and a current frame to be displayed on the display screen at a current point in time, the current point in time being after the previous point in time, wherein each of the previous frame and the current frame comprises left and right images;

comparing the left and right images of the previous frame to generate a disparity map for the, previous frame;

generating a first histogram from the disparity map of the previous frame;

comparing the left and right images of the current frame to generate a disparity map for the current frame;

generating a second histogram from the disparity map of the current frame;

determining a difference value between the first histogram and the second histogram; and

controlling output of the audio signal received in coorespondence with the image signal based on the difference value.

2. The method of claim 1, wherein said determining comprises:

identifying a peak position in the first histogram;

identifying a peak position in the second histogram; and

determining the difference value between the peak positions of the first and second histograms.

3. The method of claim 1, wherein said controlling comprises:

determining a setting value of at least one parameter for outputting the audio signal, wherein the parameter is one set in proportion to increase or decrease based on the difference value.

4. The method of claim 3 wherein the parameter a center level parameter, a rear level parameter, a first expansion intensity parameter or a high frequency parameter.

5. The method of claim 3, wherein the parameter is a front level parameter, a Low Frequency Effects (LFE) level parameter, a second expansion intensity parameter or a reverb part parameter.

6. The method of claim 3, further comprising:

increasing a first parameter value and decreasing a second parameter value when the difference value is in a first range; and

decreasing the first parameter value and increasing the second parameter value when the difference value is in a second range.

14. The method of claim 1, wherein the controlling comprises:

if the difference value is in a first range, controlling the output signal to produce sound that is greater in a first direction than a second direction; and

if the difference value is in a second range, controlling the output signal to produce sound that is greater in the second direction than the first direction, wherein the first direction is in a front to rear direction and the second direction is in a left to right direction relative to a display.

7. A display device comprising:

a display;

a video input to receive an image signal inputted with an audio signal, wherein the image signal comprises a previous frame to be displayed at a previous point in time and a current frame to be displayed at a current point in time, the current point in time being after the previous point in time, wherein each of the previous frame and the current frame comprises left and right images; and

a controller to compare the left and right images of the previous frame to generate a disparity map for the previous frame, to generate a first histogram from the disparity map for the previous frame, to compare the left and right images of the current frame to generate a disparity map of the current frame, to generate a second histogram from the disparity map of the current frame, to determine a difference value between the first histogram and second histogram and to control output of the audio signal received in correspondence with the image signal based on the difference value.

8. The display device of claim 7, wherein said determining comprises:

identifying a peak position in the first histogram;

identifying a peak position in the second histogram; and

determining the difference value between the peak positions of the first and second histograms.

9. The display device of claim 7, wherein the controller:

determines a setting value of at least one parameter for outputting the audio signal, wherein the parameter is one set in proportion to increase or decrease based on the difference value.

10. The display device of claim 9 wherein the parameter a center level parameter, a rear level parameter, a first expansion intensity parameter or a high frequency parameter.

11. The display device of claim 9, wherein the parameter is a front level parameter, a Low Frequency Effects (LFE) level parameter, a second expansion intensity parameter or a revert) part parameter.

12. The display device of claim 9, wherein the controller:

increases a first parameter value and decreasing a second parameter value when the difference value is in a first range; and

decreases the first parameter value and increasing the second parameter value when the difference value is in a second range.

15. The display device of claim 7, wherein the controller:

controls the output signal to produce sound that is greater in a first direction than a second direction when the difference value is in a first range; and

controls the output signal to produce sound that is greater in the second direction than the first direction when the difference value is in a second range, wherein the first direction is in a front to rear direction and the second direction is in a left to right direction relative to the display.

13. A method of controlling a display device, comprising:

receiving a previous frame to be displayed on a display screen at a previous point in time, wherein the previous frame comprises left and right images;

receiving a current frame to be displayed on the display screen at a current point in time, the current point in time being after the previous point in time, wherein the current frame comprises left and right images;

comparing the left and right images of the previous frame to generate a disparity map for the previous frame;

generating a first histogram from the disparity map of the previous frame;

comparing the left and right images of the current frame to generate a disparity map for the current frame;

generating a second histogram from the disparity map of the current frame;

determining a difference value between the first histogram and the second histogram; and

controlling output of an audio signal received in correspondence with the current frame based on the difference value.