Smart audio and video capture systems for data processing systems

• US 9,246,543 B2
• Filed: 12/12/2011
• Issued: 01/26/2016
• Est. Priority Date: 12/12/2011
• Status: Active Grant

• Current Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Inventors: Zhou, Jiong, Kalker, Ton
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): MESA, JOSE M
• Application Number:
  US13/323,157
• Publication Number:
  US 20130147923A1
• Time in Patent Office: 1,506 Days
• Field of Search: 348/46, 348/47, 381/66
• US Class Current: 1/1
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: H04B 3/20 Reducing echo effects or singing; Opening or closing transmitting path; Conditioning for transmission in one direction or the other
• CPC Class Codes: H04N 13/20 Image signal generators
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 2007/145 Handheld terminals
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04R 2499/11 Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407

Abstract

A computation system comprising an orientation detection device configured to detect position information comprising a position and an orientation of the computation system, a multi-sensor system coupled to the orientation detection device, wherein the multi-sensor system is configured to capture environmental input data, wherein the multi-sensor system comprises at least one of an audio capturing system and a three-dimensional (3D) image capturing system, and wherein the environmental input data comprises at least one of audio and an image, and at least one signal processing component coupled to the orientation detection device and to the multi-sensor system, wherein the processor is configured to modify the captured environmental input data based on the position information.

Claims

1. A computation system comprising:

an orientation detection device configured to detect an orientation of the computation system as orientation information, wherein the orientation detection device comprises an accelerometer that indicates a rotational orientation or a tilt orientation relative to a horizontal plane;

a multi-sensor system coupled to the orientation detection device, wherein the multi-sensor system is configured to capture a three-dimensional (3D) image, wherein the multi-sensor system comprises a 3D image capturing system, wherein the 3D image capturing system comprises a camera group comprising a plurality of pairs of cameras on a same side of the computation system such that any camera pair is selectable to obtain 3D images, and wherein the 3D image capturing system is configured to;

determine the orientation of the computation system based on output of the orientation detection device; and

select a camera pair from the camera group to obtain the 3D image based on the determined orientation of the computation system; and

at least one signal processing component coupled to the orientation detection device and to the multi-sensor system, wherein the at least one signal processing component is configured to modify the captured 3D image based on the orientation information.

2. The computation system of claim 1, wherein the at least one signal processing component is configured to modify the 3D image based on the orientation information.

3. The computation system of claim 1, wherein each of the pairs of cameras are located proximate to different edges of the computation system.

4. The computation system of claim 1, wherein the 3D image capturing system is part of a tablet system, and wherein the tablet system is configured to enable at least one of video conferencing, voice calling, and a human computer interface.

11. The computation system of claim 1, wherein the 3D image capturing system is configured to filter out data from one or more pairs of cameras that are not selected to obtain the 3D image.

5. A three-dimensional (3D) video capturing system comprising:

a camera group comprising a plurality of cameras pairs on a same side of the 3D video capturing system such that any camera pair is selectable to capture a 3D image or a 3D video;

an orientation detection device, wherein the orientation detection device comprises an accelerometer configured to detect an orientation of the 3D video capturing system as orientation information, wherein the orientation information comprises at least one of a rotational orientation or a tilt orientation with respect to a horizontal plane; and

a camera configuration device coupled to the orientation detection device and the camera group, wherein the camera configuration device is configured to;

determine the orientation of the 3D video capturing system based on the orientation information detected by the orientation detection device; and

select a camera pair from the camera group to capture the 3D video or the 3D image based on the determined orientation of the 3D video capturing system.

6. The 3D video capturing system of claim 5, wherein the orientation information comprises a position of the 3D video capturing system with respect to a user.

7. The 3D video capturing system of claim 5, wherein the selected camera pair comprise two cameras located proximate to opposite edges of a tablet device.

12. The 3D video capturing system of claim 5, wherein the camera configuration device is configured to filter out captured data from one or more pairs of cameras that are not selected to capture the 3D video or the 3D image.

8. A three-dimensional (3D) video capturing method implemented on a portable device, comprising:

detecting an orientation of the portable device using an accelerometer that indicates a rotational orientation or a tilt orientation relative to a horizontal plane;

selecting a camera pair from a camera group comprising a plurality of pairs of cameras on a same side of the portable device such that each camera pair is selectable to obtain a 3D image or a 3D video, wherein the camera pair is selected from the camera group based on the orientation of the portable device; and

capturing the 3D video or the 3D image using the selected camera pair.

9. The 3D video capturing method of claim 8, further comprising:

processing the captured image using a 3D image processing scheme; and

transmitting the 3D image.

10. The 3D video capturing method of claim 8, wherein selecting the camera pair comprises filtering out data from one or more pairs of cameras that are not selected to obtain the 3D image or the 3D video.

13. A method comprising:

detecting an orientation of a portable device via an accelerometer that indicates a rotational orientation or a tilt orientation of the portable device relative to a horizontal plane, wherein the portable device comprises a camera group comprising a plurality of pairs of cameras such that each camera pair is selectable to obtain a three-dimensional (3D) image or a 3D video; and

selecting, by a processor of the portable device, a camera pair from the camera group to obtain the 3D image or the 3D video based on the detected orientation of the portable device.

14. The method of claim 13, further comprising capturing the 3D image or the 3D video with the camera pair selected based on the detected orientation of the portable device.

15. The method of claim 14, further comprising employing a signal processing component to modify the captured 3D image or the 3D video based on the detected orientation of the portable device.

16. A portable device comprising:

a camera group comprising a plurality of cameras pairs such that each camera pair is selectable to capture a three-dimensional (3D) image or a 3D video;

an accelerometer configured to indicate an orientation of the portable device based on a rotational orientation or a tilt orientation with respect to a horizontal plane; and

a processor coupled to the camera group and the accelerometer and configured to;

determine the orientation of the portable device based on the indication from the accelerometer; and

select a camera pair from the camera group to obtain the 3D image or the 3D video based on the determined orientation of the portable device.

17. The portable device of claim 16, wherein the processor is further configured to cause the pair of cameras selected based on the determined orientation of the portable device to capture the 3D image or the 3D video.

18. The portable device of claim 17, further comprising a signal processing component coupled to the processor and configured to modify the captured 3D image or the 3D video based on the determined orientation of the portable device.

19. The portable device of claim 16, wherein each of the pairs of cameras of the camera group are located proximate to different edges of the portable device.