Pairing devices in conference using ultrasonic beacon and subsequent connection transfer

• US 9,538,136 B2
• Filed: 03/30/2015
• Issued: 01/03/2017
• Est. Priority Date: 10/27/2011
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Polycom Incorporated (Plantronics, Inc.)
• Inventors: Chu, Peter L., Liu, Yibo
• Primary Examiner(s): Anwah, Olisa
• Application Number:
  US14/673,491
• Publication Number:
  US 20150208035A1
• Time in Patent Office: 645 Days
• Field of Search: 348/14.01, 348/14.04, 348/14.05
• US Class Current: 1/1
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: H04M 3/568 audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A videoconferencing system has a videoconferencing unit that use portable devices as peripherals for the system. The portable devices obtain near-end audio and send the audio to the videoconferencing unit via a wireless connection. In turn, the videoconferencing unit sends the near-end audio from the loudest portable device along with near-end video to the far-end. The portable devices can control the videoconferencing unit and can initially establish the videoconference by connecting with the far-end and then transferring operations to the videoconferencing unit. To deal with acoustic coupling between the unit'"'"'s loudspeaker and the portable device'"'"'s microphone, the unit uses an echo canceller that is compensated for differences in the clocks used in the A/D and D/A converters of the loudspeaker and microphone.

Claims

1. A method implemented at a first device for conferencing the first device and a second device in a near-end environment with a far-end, comprising:

outputting, with the first device, connection information in an imperceptible acoustic beacon in the near-end environment;

connecting the first device via a near-end connection to the second device in the near-end environment by receiving a response at the first device from the second device via the near-end connection, the response being based on the second device using the output connection information requesting connection of the second device with the first device; and

taking over, with the first device, a far-end connection that the second device has with the far-end.

2. The method of claim 1, wherein the first device comprises a conferencing unit;

and wherein the second device is selected from the group consisting of a portable device, a peripheral device, a cellular telephone, a smartphone, a personal computing tablet, a personal digital assistant, a hand-held computer, a netbook computer, and a laptop computer.

3. The method of claim 1, wherein the far-end connection comprises an Ethernet connection, a Wide Area Network (WAN) connection, a wireless connection, an Internet connection, a cellular connection, a Plain Old Telephone Service (POTS) connection, or a combination thereof;

and wherein the near-end connection comprises a Local Area Network (LAN) connection, an intranet connection, a Wireless Local Area Network (WLAN) connection, a Personal Area Network (PAN) connection, a Wireless Fidelity (Wi-Fi) connection, a wireless connection, or a combination thereof.

4. The method of claim 1, wherein outputting the connection information comprises encoding the connection information in an audio signal of the acoustic beacon modulated with frequency-shift keying.

5. The method of claim 1, wherein the connection information comprises a network address of the first device encoded in the acoustic beacon.

6. The method of claim 1, wherein outputting the connection information comprises outputting the acoustic beacon with a loudspeaker of the first device, the acoustic beacon being ultrasonic.

7. The method of claim 1, further comprising capturing first audio in the near-end environment at the first device for sending to the far-end.

8. The method of claim 7, further comprising obtaining, at the first device via the near-end connection, second audio captured with the second device;

and sending, with the first device, the second audio to the far-end when the second audio has a greater level than the first audio.

9. The method of claim 1, wherein taking over, with the first device, the far-end connection of the second device to the far-end comprises obtaining, at the first device via the far-end connection, far-end audio;

and sending, with the first device, the far-end audio for output in the near-end environment.

10. The method of claim 9, wherein sending, with the first device, the far-end audio for output in the near-end environment comprises sending, via the near-end connection, the far-end audio from the first device to the second device for output at the second device.

11. The method of claim 9, wherein sending, with the first device, the far-end audio for output in the near-end environment comprises outputting the far-end audio at the first device.

12. The method of claim 9, wherein sending, with the first device, the far-end audio for output in the near-end environment comprises switching from output of the far-end audio at the second device to output at the first device.

13. The method of claim 9, further comprising cancelling the far-end audio sent from the first device for output in the near-end environment that is present in second audio obtained at the first device from the second device.

14. The method of claim 13, wherein cancelling comprises compensating for a frequency difference between a first clock of an analog-to-digital converter for a microphone of the second device and a second clock of a digital-to-analog converter for a loudspeaker of the first device.

15. The method of claim 13, wherein cancelling is performed at the first device, at the second device, or at both.

16. The method of claim 8, further comprising:

capturing, with the first device, first video for sending to the far-end;

obtaining, at the first device via the near-end connection, second video captured with the second device; and

sending, with the first device via the far-end connection, the second video to the far-end when the second audio is being sent to the far-end.

17. The method of claim 1, further comprising controlling a function at the first device in response to a control via the near-end connection from the second device.

18. The method of claim 1, further comprising sharing content via the near-end connection between the first device and the second device.

19. A first device, comprising:

a loudspeaker for outputting audio in a near-end environment;

one or more interfaces for communicatively connecting the first device with a far-end in a far-end connection and with a second device in a near-end connection; and

a processing unit communicatively connected to the loudspeaker and the one or more interfaces, the processing unit configured to;

connect with the far-end in the far-end connection;

output connection information in an imperceptible acoustic beacon in the near-end environment with the loudspeaker;

receive a response at the first device from the second device via the near-end connection to connect with the second device in the near-end connection, the response being based on the second device using the output connection information and requesting connection of the second device with the first device; and

take over a far-end connection of the second device to a far-end.

20. A method implemented at a first device for conferencing the first device and a second device in a near-end environment with a far-end, comprising:

connecting the first device in the near-end environment to the far-end with a far-end connection;

detecting, with the first device, an imperceptible acoustic beacon output by the second device in the near-end environment;

decoding, with the first device, connection information from the detected acoustic beacon;

connecting the first device with the second device via a network connection by sending a response from the first device to the second device via the near-end connection, the response using the decoded connection information and requesting connection of the first device with the second device; and

transferring the far end connection from the first device to the second device.

21. The method of claim 20, further comprising transmitting first audio captured with the first device to the second device via the network connection.

22. The method of claim 20, further comprising transmitting video captured with the first device to the second device via the network connection.

27. The method of claim 21, further comprising cancelling second audio sent from the second device for output in the near-end environment that is present in the first audio captured with the first device.

28. The method of claim 27, wherein cancelling comprises compensating for a frequency difference between a first clock of an analog-to-digital converter for a microphone of the first device and a second clock of a digital-to-analog converter for a loudspeaker of the second device.

29. The method of claim 27, wherein cancelling is performed at the first device, at the second device, or at both.

23. A first device, comprising:

a microphone for capturing first audio in a near-end environment;

one or more interfaces for communicatively connecting the first device with a far-end in a far-end connection and with a second device in a near-end connection; and

a processing unit communicatively connected to the microphone and the one or more interfaces, the processing unit configured to;

connect with the far-end in the far-end connection;

detect, with the microphone, an imperceptible acoustic beacon output by the second device in the near-end environment,

decode connection information from the detected acoustic beacon,

send a response from the first device to the second device via the near-end connection to connect with the second device via the network connection, the response being based on the decoded connection information and requesting connection of the first device with the second device, and

transfer the far-end connection from the first device to the second device.

24. The first device of claim 23, wherein the processing unit is configured to transmit the first audio captured with the first device to the second device via the network connection.

25. The first device of claim 24, wherein the processing unit is configured to cancel second audio sent from the second device for output in the near-end environment that is present in the first audio captured with the first device.

26. The first device of claim 25, wherein to cancel, the processing unit is configured to compensate for a frequency difference between a first clock of an analog-to-digital converter for the microphone of the first device and a second clock of a digital-to-analog converter for a loudspeaker of the second device.

30. A method implemented at a first device for conferencing the first device and a second device in a near-end environment with a far-end, comprising:

outputting, with the first device, connection information in an imperceptible acoustic beacon in the near-end environment;

connecting the first device via a near-end connection to the second device in the near-end environment based on the second device using the output connection information;

taking over, with the first device, a far-end connection that the second device has with the far-end by obtaining, at the first device via the far-end connection, far-end audio and sending, with the first device, the far-end audio for output in the near-end environment; and

cancelling the far-end audio sent from the first device for output in the near-end environment that is present in second audio obtained at the first device from the second device.

31. The method of claim 30, wherein outputting the connection information comprises encoding the connection information in an audio signal of the acoustic beacon modulated with frequency-shift keying.

32. The method of claim 30, wherein the connection information comprises a network address of the first device encoded in the acoustic beacon.

33. The method of claim 30, wherein outputting the connection information comprises outputting the acoustic beacon with a loudspeaker of the first device, the acoustic beacon being ultrasonic.

34. The method of claim 30, wherein connecting, with the first device via the near-end connection, the second device based on the second device using the output connection information comprises receiving a response at the first device from the second device via the near-end connection, the response requesting connection of the second device with the first device.

35. The method of claim 30, further comprising capturing first audio in the near-end environment at the first device for sending to the far-end.

36. The method of claim 35, further comprising obtaining, at the first device via the near-end connection, second audio captured with the second device;

and sending, with the first device, the second audio to the far-end when the second audio has a greater level than the first audio.

37. The method of claim 36, further comprising:

capturing, with the first device, first video for sending to the far-end;

obtaining, at the first device via the near-end connection, second video captured with the second device; and

sending, with the first device via the far-end connection, the second video to the far-end when the second audio is being sent to the far-end.

38. The method of claim 30, wherein sending, with the first device, the far-end audio for output in the near-end environment comprises sending, via the near-end connection, the far-end audio from the first device to the second device for output at the second device.

39. The method of claim 30, wherein sending, with the first device, the far-end audio for output in the near-end environment comprises outputting the far-end audio at the first device.

40. The method of claim 30, wherein sending, with the first device, the far-end audio for output in the near-end environment comprises switching from output of the far-end audio at the second device to output at the first device.

41. The method of claim 30, wherein cancelling comprises compensating for a frequency difference between a first clock of an analog-to-digital converter for a microphone of the second device and a second clock of a digital-to-analog converter for a loudspeaker of the first device.

42. The method of claim 30, wherein cancelling is performed at the first device, at the second device, or at both.

43. The method of claim 30, further comprising controlling a function at the first device in response to a control via the near-end connection from the second device.

44. The method of claim 30, further comprising sharing content via the near-end connection between the first device and the second device.

45. A first device, comprising:

a loudspeaker for outputting audio in a near-end environment;

one or more interfaces for communicatively connecting the first device with a far-end in a far-end connection and with a second device in a near-end connection; and

a processing unit communicatively connected to the loudspeaker and the one or more interfaces, the processing unit configured to;

connect with the far-end in the far-end connection;

output connection information in an imperceptible acoustic beacon in the near-end environment with the loudspeaker;

connect with the second device in the near-end connection based on the second device using the output connection information; and

take over a far-end connection of the second device to a far-end,

wherein to take over the far-end connection, the processing unit is configured to obtain, via the far-end connection, far-end audio and send the far-end audio for output in the near-end environment; and

wherein the processing unit is configured to cancel the far-end audio sent from the first device for output in the near-end environment that is present in second audio obtained at the first device from the second device.

46. The device of claim 45, wherein to cancel, the processing unit is configured to compensate for a frequency difference between a first clock of an analog-to-digital converter for a microphone of the second device and a second clock of a digital-to-analog converter for the loudspeaker of the first device.