Conversation detection in an ambient telephony system

• US 9,661,139 B2
• Filed: 09/09/2009
• Issued: 05/23/2017
• Est. Priority Date: 09/18/2008
• Status: Active Grant

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips N.V.
• Inventors: Harma, Aki Sakari
• Primary Examiner(s): Morlan, Robert M
• Assistant Examiner(s): RANDHAWA, MANDISH K
• Application Number:
  US13/063,764
• Publication Number:
  US 20110164742A1
• Time in Patent Office: 2,813 Days
• Field of Search: 370260, 370356
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10
• CPC Class Codes: H04L 65/1096 Supplementary features, e.g. call forwarding or call holding systems providing special services or facilities to telephony subscribers H04M3/42
• CPC Class Codes: H04M 1/0297 Telephone sets adapted to be mounted on a desk or on a wall
• CPC Class Codes: H04M 1/6033 for providing handsfree use or a loudspeaker mode in telephone sets arrangements for preventing acoustic echo H04M9/08
• CPC Class Codes: H04M 2201/40 using speech recognition
• CPC Class Codes: H04M 3/56 Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities video conference systems H04N7/15

Abstract

A method of controlling a conversation in an ambient telephone environment having a plurality of spaces includes providing a plurality of devices distributed in the plurality of spaces used by one or more users, at least one of the plurality of devices is connected to a telecommunications network for enabling communication between the environment and one or more remote terminals; and obtaining signals communicating a conversation between at least one remote terminal and at least one of the plurality of devices and audio from the one or more users. The method further includes identifying a user of the at least one device used in the obtained conversation by detecting interaction of a type corresponding to conversational turn-taking; and tracking movements of the user in the environment to determine its presence in a first of the plurality of spaces.

Claims

1. A method of controlling a conversation in an ambient telephone environment having a plurality of spaces including a respective plurality of local terminals with a first terminal of the plurality of local terminals connected to a telecommunications network for enabling communication with at least one remote terminal, the method comprising acts of:

obtaining signals communicating a conversation between a local user of the first terminal of the plurality of local terminals and a second user of one of a second terminal of the plurality of local terminals and the at least one remote terminal, the local terminals including at least one device of a plurality of devices;

analyzing the signals over time in relation to each other for detecting, based on at least one criterion, an interaction of a type corresponding to conversational turn-taking;

upon detecting the interaction of the type corresponding to the conversational turn-taking, inferring a position of the local user based on known positions of the at least one device of the first terminal on which the conversation is detected;

communicating an identification, availability, and location associated with the local user;

adjusting at least one output signal for controlling the at least one device upon determining whether the at least one criterion is met;

detecting a remote conversation relayed through a master device of the ambient telephone environment between two remote users of two remote terminals located external to the ambient telephone environment and not involving any users located within the ambient telephone environment;

in response to the act of detecting the remote conversation, transmitting a message by the master device informing the remote users that a direct conversation is possible; and

in response to acceptance of the message, establishing a new call between the two remote users, wherein the new call is no longer relayed through the master device.

2. The method according to claim 1, wherein the telecommunications network includes at least one of the Internet, one or more cellular telephone networks, and a land line telephone network.

3. The method according to claim 1, wherein presence of the local user is determined by one of providing the local user with tags selected at least from Radio Frequency Identification tags and audio-based localization methods.

4. The method according to claim 1, further comprising acts of:

setting up a new connection to the obtained conversation for a further local user when presence of the further local user is determined and the further local user is not taking part in the obtained conversation; and

controlling volume of a speakerphone system in vicinity of the further local user.

5. The method of claim 1, further comprising an act of tracking movements of the local user in the environment to determine location of the local user in the environment by detecting where the first terminal on which the local user is participating in the conversation is located.

6. A telecommunications system for controlling a conversation in an ambient telephone environment having a plurality of spaces, the system comprising:

a plurality of local terminals respectively distributed in the plurality of spaces of the environment for use by one or more users, a first terminal of the plurality of local terminals establishing a connection with a telecommunications network for enabling communication with one or more remote terminals; and

a processor configured to

obtain signals communicating a conversation between a local user of the first terminal of the plurality of local terminals and a second user of one of a second terminal of the plurality of local terminals and the at least one remote terminal, the local terminals including at least one device of a plurality of devices,

analyze the signals over time in relation to each other for detecting, based on at least one criterion, an interaction of a type corresponding to conversational turn-taking,

upon detecting the interaction of the type corresponding to the conversational turn-taking, infer a position of the local user based on known positions of the at least one device of the first terminal on which the conversation is detected,

communicate an identification, availability, and location associated with the local user, and

adjust at least one output signal for controlling the at least one device upon determining whether the at least one criterion is met;

detect a remote conversation relayed through a master device of the ambient telephone environment between two remote users of two remote terminals located external to the ambient telephone environment and not involving any users located within the ambient telephone environment;

in response to detection of the remote conversation, transmitting a message by the master device informing the remote users that a direct conversation is possible; and

in response to acceptance of the message, establishing a new call between the two remote users, wherein the new call is no longer relayed through the master device.

7. The telecommunications system of claim 6, wherein the processor is further configured to track movements of the local user in the environment to determine location of the local user in the environment.

8. The telecommunications system according to claim 6, wherein the plurality of devices comprises a speakerphone system including arrays of loudspeakers, microphones, and video terminals distributed in the environment and connected to each other via a local network.

9. The telecommunications system according to claim 8, wherein the processor is configured to establish a video link between the terminals of the local and second users in response to the act of detecting the interaction.

10. The telecommunications system according to claim 8, wherein the processor is configured to adjust the volume of audible output of the speakerphone system.

11. The telecommunications system according to claim 8, wherein the processor is configured to cause the conversation to cease to be reproduced by the speakerphone system.

12. The telecommunications system according to claim 8, wherein the processor is configured to cause the conversation to be reproduced by the speakerphone system.

13. The telecommunications system according to claim 8, wherein the processor is configured to controlling the speakerphone system in dependence on preferences of the local user.

14. The telecommunications system according to claim 8, wherein the processor is configured to mute a video terminal and control the volume of loudspeakers.

15. The telecommunications system according to claim 8, wherein the processor is configured to:

set up a new connection to the obtained conversation for a further local user when presence of the further local user is determined and the further local user is not taking part in the obtained conversation; and

control volume of the speakerphone system in vicinity of the further local user.

16. The telecommunications system according to claim 6, wherein the processor is configured to adjust a selection of the at least one of the plurality of devices from which the conversation is communicated to the second terminal.

17. The telecommunications system according to claim 6, wherein the telecommunications network includes at least one of the Internet, one or more cellular telephone networks, and a land line telephone network.

18. The telecommunications system according to claim 6, wherein the processor is configured to determine the presence of the local user by one of:

providing the local user with tags selected at least from Radio Frequency Identification tags;

audio-based localization methods;

or a combination of these acts.

19. The telecommunications system of claim 6, wherein the processor is configured to:

detect the conversation by an input device of a new local terminal located at a new location when the local user moves to the new location; and

in response to detecting the conversation, selecting the new local terminal at the new location for communication with the second user by activating an output device of the new local terminal for continuing the conversation between the local user and the second user through the new local terminal and ceasing reproduction of the conversation at an output device of the first terminal, and controlling external devices in neighborhood of the new local terminal including at least one of muting an entertainment device, opening a video link including controlling a display of the new local terminal to display an image of the second user and turning on a camera of the new local terminal, and controlling an illuminator to illuminate the new location to emphasize the local user.

20. A computer readable medium that is not a transitory propagating signal or wave, and comprising computer instructions which, when executed by a processor, configure the processor to perform a method of controlling a conversation in an ambient telephone environment having a plurality of spaces including a respective plurality of local terminals with a first terminal of the plurality of local terminals connected to a telecommunications network for enabling communication with at least one remote terminal, the method comprising acts of:

obtaining signals communicating a conversation between a local user of the first terminal of the plurality of local terminals and a second user of one of a second terminal of the plurality of local terminals and the at least one remote terminal, the local terminals including at least one device of a plurality of devices;

analyzing the signals over time in relation to each other for detecting an interaction of a type corresponding to conversational turn-taking;

upon detecting the interaction of the type corresponding to the conversational turn-taking, inferring a position of the local user based on known positions of the at least one device of the first terminal on which the conversation is detected;

communicating an identification, availability, and location associated with the local user;

adjusting at least one output signal for controlling the at least one device upon determining whether the at least one criterion is met;

detecting a remote conversation relayed through a master device of the ambient telephone environment between two remote users of two remote terminals located external to the ambient telephone environment and not involving any users located within the ambient telephone environment;

in response to the act of detecting the remote conversation, transmitting a message by the master device informing the remote users that a direct conversation is possible; and

in response to acceptance of the message, establishing a new call between the two remote users, wherein the new call is no longer relayed through the master device.

21. The computer readable medium of claim 20, further comprising an act of tracking movements of the local user in the environment to determine location of the local user in the environment.