AUDIO SOURCE LOCATOR AND TRACKER, A METHOD OF DIRECTING A CAMERA TO VIEW AN AUDIO SOURCE AND A VIDEO CONFERENCING TERMINAL

• US 20120081504A1
• Filed: 03/01/2011
• Published: 04/05/2012
• Est. Priority Date: 09/30/2010
• Status: Active Grant

• Current Assignee: RPX Corporation
• Original Assignee: Alcatel-Lucent USA, Inc. (Nokia Corporation)
• Inventors: Ng, Hock M., Sutter, Edward L. Jr., Abbot, Richard M.
• Granted Patent: US 8,754,925 B2
• Time in Patent Office: Days
• US Class Current: 348/14.08
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

An audio locating and tracking apparatus, a method of directing a camera to view an audio source, and a video conferencing terminal are disclosed herein. In one embodiment, the apparatus includes: (1) an audio source identifier configured to locate an audio source based on multimodal sensor data from at least two different types of sensors and (2) an image selector configured to automatically direct a camera to view the audio source.

Claims

1. An apparatus, comprising:

an audio source identifier configured to locate an audio source based on multimodal sensor data from at least two different types of sensors; and

an image selector configured to automatically direct a camera to view said audio source.

2. The apparatus as recited in claim 1 further comprising said camera.

3. The apparatus as recited in claim 1 further comprising said at least two different types of sensors.

4. The apparatus as recited in claim 1 wherein said at least two different types of sensors are selected from the group consisting of:

an audio sensor,

a thermal sensor, and

a range finder.

5. The apparatus as recited in claim 1 wherein said audio source identifier is further configured to locate potential audio sources based on said multimodal sensor data.

6. The apparatus as recited in claim 5 wherein said image selector is further configured to generate a map of said potential audio sources.

7. The apparatus as recited in claim 5 wherein said audio source identifier is configured to locate said potential audio sources before locating said audio source.

8. The apparatus as recited in claim 1 wherein said audio source identifier is further configured to detect movement of said audio source based on data from at least one of said at least two different types of sensors.

9. The apparatus as recited in claim 8 wherein said image selector is further configured to automatically steer said camera in response to said detected movement to track said audio source.

10. A method of directing a camera to view an audio source, comprising:

locating an audio source based on multimodal sensor data from at least two different types of sensors; and

automatically directing a camera to view said audio source.

11. The method as recited in claim 10 wherein said at least two different types of sensors are selected from the group consisting of:

an audio sensor,

a thermal sensor, and

a range finder.

12. The method as recited in claim 10 further comprising locating potential audio sources based on said multimodal sensor data.

13. The method as recited in claim 12 further comprising generating a map of said potential audio sources with respect to a location of said camera.

14. The method as recited in claim 12 wherein said locating said audio source is based on said map.

15. The method as recited in claim 10 further comprising capturing an image of said audio source employing said camera.

16. The method as recited in claim 10 further comprising detecting movement of said audio source based on data from at least one of said at least two different types of sensors and automatically steering said camera in response to said detected movement to track said audio source.

17. A video conferencing terminal, comprising:

a camera configured to capture images within a field of view; and

a audio source locator and tracker configured to locate a audio source based on multimodal sensor data from at least two different types of sensors and automatically direct said camera to view said audio source.

18. The videoconferencing terminal as recited in claim 17 further comprising said at least two different types of sensors.

19. The videoconferencing terminal as recited in claim 17 wherein said audio source locator and tracker is further configured to locate potential audio sources based on said multimodal sensor data and generate a map of said potential audio sources.

20. The videoconferencing terminal as recited in claim 17 wherein said audio source locator and tracker is further configured to track movement of said audio source based on data from at least one of said at least two different types of sensors and automatically steer said camera in response to said movement.