Methods and systems for audio and video communication

• US 8,380,242 B2
• Filed: 11/02/2010
• Issued: 02/19/2013
• Est. Priority Date: 01/14/2005
• Status: Active Grant

• Current Assignee: Xueshan Technologies Inc. (Wi-LAN Inc.)
• Original Assignee: MediaTek, Inc.
• Inventors: Luo, Wan Chi, Tadanori, Hagihara, Wang, Tung-Yi
• Primary Examiner(s): Kincaid, Lester
• Assistant Examiner(s): Jama, Isaak R
• Application Number:
  US12/917,871
• Publication Number:
  US 20110043599A1
• Time in Patent Office: 840 Days
• Field of Search: 455/550.1, 455/515
• US Class Current: 455/550.1
• CPC Class Codes: G06F 1/1605 Multimedia displays, e.g. with integrated or attached speakers, cameras, microphones
• CPC Class Codes: H04N 21/4143 embedded in a Personal Computer [PC]
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/632 using a connection between clients on a wide area network, e.g. setting up a peer-to-peer communication via Internet for retrieving video segments from the hard-disk of other client devices broadcast-related systems characterised by transmission among terminal devices H04H60/80; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/148 Interfacing a video terminal to a particular transmission medium, e.g. ISDN

Abstract

Systems for audio and video communication used in a mobile electronic device are provided. An embodiment of a system comprises a display object generation unit, an acoustic object generation unit and a transport unit. The display object generation unit repeatedly generates display objects corresponding to intensity of light sensed by an image sensor module of the mobile electronic device. The acoustic object generation unit repeatedly generates acoustic objects corresponding to sound signals detected by a microphone of the mobile electronic device. The transport unit simultaneously transports the generated display and acoustic objects to a computer host when the mobile electronic device operates as a webcam.

Claims

1. A method for audio and video communication for use in an electronic device comprising a digital signal processor (DSP) coupled to a microphone, a radio frequency (RF) transceiver and a transport unit, the method comprising:

repeatedly generating a plurality of first acoustic objects corresponding to sound signals detected by the microphone and a plurality of second acoustic objects corresponding to sound signals from a remote mobile electronic device of a cellular network via the RF transceiver, when the electronic device operates as intermediate device between a cellular network and a Internet Protocol (IP) network;

mixing the first and second acoustic objects to generate a first mixed acoustic object,

receiving a plurality of third acoustic objects from a remote electronic apparatus of the IP network via the transport device coupling to a computer host of the IP network, and

mixing the first and third acoustic objects to generate a second mixed acoustic objects,

wherein the generated first mixed acoustic objects are repeatedly transmitted to the remote electronic apparatus of the IP network, and the generated second mixed acoustic objects are repeatedly transmitted to the remote mobile electronic device of the cellular network, so that a three-party call among the electronic device, the remote electronic apparatus of the IP network and the remote mobile electronic device of the cellular network is established.

2. The method as claimed in claim 1, further comprising:

using a display object generation unit, coupled to an image sensor module and the RF transceiver, and when the electronic device operates as intermediate device between the cellular network and the IP network, to repeatedly generate a plurality of display objects corresponding to intensity of light sensed by the image sensor module, and transmitting the generated display objects to the remote mobile electronic device of the cellular network via the RF transceiver.

3. The method as claimed in claim 2, wherein the display object generation unit further transmits the generated display objects to the remote electronic apparatus of the IP network via the transport device.

4. The method as claimed in claim 3, wherein the display object generation unit selects one of plurality of image/video encoders to generate the display objects contingent upon transmission ability of the transport unit.

5. The method as claimed in claim 3, wherein the display object generation unit blends content into a plurality of raw images captured by image sensors or adjusts an image parameter of the raw images to generate the display objects.

6. The method as claimed in claim 1, wherein the DSP activates the generation of the first and second mixed acoustic objects after the electronic device answers an incoming call request from the remote mobile electronic device.

7. The method as claimed in claim 1, wherein the DSP generates the first acoustic objects in a bit rate contingent upon transmission ability of the transport unit.

8. A method for audio and video communication performed by an electronic device, comprising:

repeatedly generating a plurality of first acoustic objects corresponding to sound signals detected by a microphone, and also generating a plurality of second acoustic objects corresponding to sound signals from a remote mobile electronic device of a cellular network, when the electronic device operates as intermediate device between the cellular network and an Internet Protocol (IP) network;

mixing the first and second acoustic objects to generate first mixed acoustic objects;

transporting the generated first mixed acoustic objects to a remote electronic apparatus of the IP network by a computer host coupling the electronic device;

repeatedly generating a plurality of third acoustic objects corresponding to sound signals received from a remote electronic device of the IP network, when the electronic device operates as intermediate device between the cellular network and the IP network;

mixing the first acoustic objects with the third acoustic objects to generate a second mixed acoustic objects; and

transporting the generated second mixed acoustic objects to a remote mobile electronic device of the cellular network, so that a three-party call among the electronic device, the remote electronic apparatus of the IP network and the remote mobile electronic device of the cellular network is established.

9. The method as claimed in claim 8, further comprising:

answering an incoming call request from the remote mobile electronic device, wherein the steps for generating the first, second and third acoustic objects are performed after the incoming call request is answered.

10. The method as claimed in claim 8, further comprising:

repeatedly generating a plurality of display objects corresponding to an intensity of light sensed by an image sensor module when the electronic device operates as intermediate device between the cellular network and the IP network; and

transmitting the generated display objects to the remote mobile electronic device of the cellular network.

11. The method as claimed in claim 10, further comprising transmitting the generated display objects to the remote electronic apparatus of the IP network.

12. The method as claimed in claim 11, wherein the generated display objects is transmitted to the remote electronic apparatus of the IP network via a computer host, the method further comprising selecting one of plurality of image/video encoders to generate the display objects contingent upon transmission ability between the electronic device and the computer host.

13. The method as claimed in claim 11, further comprising blending content into a plurality of raw images captured by image sensors or adjusting an image parameter of the raw images to generate the display objects.

14. The method as claimed in claim 8, wherein the first mixed acoustic objects is transmitted to the remote electronic apparatus of the IP network via a computer host, the method further comprising generating the first acoustic objects in a bit rate contingent upon transmission ability between the electronic device and the computer host.

15. A non-transitory storage medium storing a set of program instructions executable by a processing unit of an electronic device, wherein when executing the program instructions, the electronic device performs a method for audio and video communication, comprising;

repeatedly generating a plurality of first acoustic objects corresponding to sound signals detected by a microphone, and also generating a plurality of second acoustic objects corresponding to sound signals from a remote mobile electronic device of a cellular network, when the electronic device operates as intermediate device between the cellular network and an Internet Protocol (IP) network;

mixing the first and second acoustic objects to generate a first mixed acoustic objects;

transporting the generated first mixed acoustic objects to a remote electronic apparatus of the IP network by a computer host coupling the electronic device;

repeatedly generating a plurality of third acoustic objects corresponding to sound signals received from a remote electronic device of the IP network when the electronic device operates as intermediate device between the cellular network and the IP network;

mixing the first acoustic objects with the third acoustic objects to generate a second mixed acoustic objects; and

transporting the generated second mixed acoustic objects to a remote mobile electronic device of the cellular network, so that a three-party call among the electronic device, the remote electronic apparatus of the IP network and the remote mobile electronic device of the cellular network is established.

16. The storage medium as claimed in claim 15, wherein the method further comprises:

answering an incoming call request from the remote mobile electronic device, wherein the steps for generating the first, second and third acoustic objects are performed after the incoming call request is answered.

17. The storage medium as claimed in claim 15, further comprising:

repeatedly generating a plurality of display objects corresponding to intensity of light sensed by an image sensor module when the electronic device operates as intermediate device between the cellular network and the IP network; and

transmitting the generated display objects to the remote mobile electronic device of the cellular network.

18. The storage medium as claimed in claim 17, further comprising transmitting the generated display objects to the remote electronic apparatus of the IP network.