Methods and apparatus for capturing audio signals based on a visual image

• US 8,139,793 B2
• Filed: 05/04/2006
• Issued: 03/20/2012
• Est. Priority Date: 08/27/2003
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Mao, Xiao Dong
• Primary Examiner(s): Mei, Xu
• Assistant Examiner(s): MONIKANG, GEORGE C
• Application Number:
  US11/418,989
• Publication Number:
  US 20060280312A1
• Time in Patent Office: 2,147 Days
• Field of Search: 381/58, 381/92, 381/57, 381/77, 381/122, 348/11, 348/14.08, 348/15, 345/418
• US Class Current: 381/122
• CPC Class Codes: G10L 2021/02166 Microphone arrays; Beamforming
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: H04R 29/005 Microphone arrays
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407

Abstract

In one embodiment, the methods and apparatuses detect an initial listening zone wherein the initial listening zone represents an initial area monitored for sounds; detect a view of a visual device; compare the view of the visual with the initial area of the initial listening zone; and adjust the initial listening zone and forming the adjusted listening zone having an adjusted area based on comparing the view and the initial area.

Claims

1. A method comprising:

detecting an initial listening zone wherein the initial listening zone represents an initial area monitored for sounds by at least one microphone;

detecting a view of a visual device;

comparing the view of the visual device with the initial area of the initial listening zone; and

adjusting the initial listening zone and forming an adjusted listening zone having an adjusted area monitored for sounds by at least one microphone based on comparing the view and the initial area.

2. The method according to claim 1 further comprising capturing sounds emanating from the adjusted area.

3. The method according to claim 1 further comprising capturing sounds emanating from the initial area.

4. The method according to claim 1 wherein adjusting further comprises enlarging the initial area of the initial listening zone.

5. The method according to claim 1 wherein adjusting further comprises reducing the initial area of the initial listening zone.

6. The method according to claim 1 wherein adjusting further comprises shifting a location of the initial area of the initial listening zone.

7. The method according to claim 1 wherein the initial listening zone is represented by a set of filter coefficients.

8. The method according to claim 1 wherein the adjusted listening zone is represented by a set of filter coefficients.

9. The method according to claim 1 further comprising capturing an adjusted sound from the adjusted listening zone via a microphone array.

10. The method according to claim 9 further comprising transmitting the adjusted sound.

11. The method according to claim 9 further comprising storing the adjusted sound.

12. The method according to claim 9 wherein microphone array includes more than one microphone.

13. The method according to claim 1 wherein the visual device is a still camera.

14. A method comprising:

detecting an image from a visual device;

forming a listening zone monitored by at least one microphone for sounds emanating from an area associated with the image;

capturing sounds emanating from the listening zone; and

dynamically adjusting the listening zone based on the image.

15. The method according to claim 14 wherein the initial listening zone is represented by a set of filter coefficients.

16. The method according to claim 14 wherein the adjusted listening zone is represented by a set of filter coefficients.

17. The method according to claim 14 wherein the visual device is a still camera.

18. The method according to claim 14 wherein dynamically adjusting further comprises enlarging the listening zone.

19. The method according to claim 14 wherein dynamically adjusting further comprises reducing the listening zone.

20. The method according to claim 14 wherein dynamically adjusting further comprises moving the listening zone to a different location.

21. The method according to claim 14 wherein the image is one of a plurality of images that form a video segment.

22. A system, comprising:

an area detection module configured for detecting a listening zone wherein the listening zone is to be monitored for sounds by at least one microphone;

a view detection module configured for detecting a view monitored by a visual device;

an area adjustment module configured for adjusting the listening zone monitored for sounds based on the view; and

a sound detection module configured for detecting sounds emanating from the listening zone.

23. The system according to claim 22 wherein an area associated with the listening zone is described by a set of filter coefficients.