SYSTEMS AND METHODS FOR MANAGING CONCURRENT AUDIO MESSAGES

• US 20130316679A1
• Filed: 10/30/2012
• Published: 11/28/2013
• Est. Priority Date: 05/27/2012
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: NEWHAM, Adam E., SAUHTA, Rohit, MILLER, Brian F., MENENDEZ, Jose
• Granted Patent: US 9,374,448 B2
• Time in Patent Office: Days
• US Class Current: 455/412.1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H03G 3/02 Manually-operated control H03G3/001 and H03G3/002 take precedence
• CPC Class Codes: H04B 1/385 Transceivers carried on the body, e.g. in helmets
• CPC Class Codes: H04B 2001/3872 with extendable microphones or earphones
• CPC Class Codes: H04M 1/05 specially adapted for use on head, throat or breast
• CPC Class Codes: H04M 1/6041 Portable telephones adapted for handsfree use
• CPC Class Codes: H04M 1/6066 including a wireless connection
• CPC Class Codes: H04M 1/724 User interfaces specially adapted for cordless or mobile telephones
• CPC Class Codes: H04M 1/72433 for voice messaging, e.g. dictaphones for answering incoming calls H04M1/64
• CPC Class Codes: H04M 2250/02 including a Bluetooth interface
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion
• CPC Class Codes: H04M 2250/62 user interface aspects of conference calls
• CPC Class Codes: H04M 3/436 Arrangements for screening incoming calls , i.e. evaluating the characteristics of a call before deciding whether to answer it based on the calling party profile H04M3/42059; based on location H04M3/42348; based on presence H04M3/42365; diversion H04M3/54
• CPC Class Codes: H04M 3/568 audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30
• CPC Class Codes: H04R 1/08 Mouthpieces; Microphones; Attachments therefor
• CPC Class Codes: H04R 1/1041 Mechanical or electronic switches, or control elements switches in general H01H
• CPC Class Codes: H04R 2420/07 Applications of wireless loudspeakers or wireless microphones
• CPC Class Codes: H04R 2460/15 : Determination of the acoustic seal of ear moulds or ear tips of hearing devices
• CPC Class Codes: H04R 3/00 : Circuits for transducers , loudspeakers or microphones
• CPC Class Codes: H04W 4/12 : Messaging; Mailboxes; Announcements

Abstract

A system for receiving multiple conversations or messages and for playing the multiple conversations or messages with a mobile device and wireless earpieces. The system may determine various presentation parameters based on various characteristics of the received messages and may play the messages such that audio appears at distinguishing locations around the user. The system may change how messages and/or conversations are played in response to recognize a change in the focus of the user based on detected user inputs, such as body movement gestures.

Claims

1. A method for playing multiple concurrent audio messages using a mobile device and an earpiece, comprising:

receiving a first audio message and a second audio message that overlap in time;

determining presentation parameters for the first and second audio messages based on a predefined rule; and

playing the first and second audio messages on one or both of the earpiece and the mobile device based on the determined presentation parameters.

2. The method of claim 1, further comprising determining relative rankings for the first audio message and the second audio message.

3. The method of claim 2, wherein determining relative rankings for the first audio message and the second audio message comprises:

evaluating metadata within the first and second audio messages to identify senders of the first and second audio messages;

comparing contact information stored within the mobile device related to the senders of the first and second audio messages; and

ranking the first audio message and the second audio message based on the comparison and user preference settings stored within the mobile device.

4. The method of claim 2, wherein determining presentation parameters for the first and second audio messages based on predefined protocols comprises using the determined relative rankings to assign presentation parameters to the first and second audio messages.

5. The method of claim 1, wherein playing the first and second audio messages on one or both of the earpiece and mobile device comprises playing the first and second audio messages on a first earpiece and a second earpiece, the method further comprising:

playing the first audio message through the first earpiece; and

playing the second audio message through the second earpiece.

6. The method of claim 1, wherein playing the first and second audio messages on one or both of the earpiece and mobile device based on the determined presentation parameters comprises distorting the first audio message to create a muffled sound effect.

7. The method of claim 1, wherein playing the first and second audio messages on one or both of the earpiece and mobile device based on the determined presentation parameters comprises changing a volume level of the first audio message.

8. The method of claim 1, wherein playing the first and second audio messages on one or both of the earpiece and mobile device comprises playing the first and second audio messages on two earpieces such that the first and second audio messages appear to originate from distinct three-dimensional locations.

9. The method of claim 1, wherein playing the first and second audio messages on one or both of the earpiece and mobile device comprises playing the first and second audio messages on two earpieces, the method further comprising:

detecting a change in a focus of attention by a user of the mobile device; and

changing how the first and second audio messages are played in the two earpieces in response to detecting the change in a focus of attention by the user.

10. The method of claim 9, wherein detecting a change in a focus of attention of the user comprises receiving a user input on a user interface.

11. The method of claim 9, wherein detecting a change in a focus of attention of the user comprises:

receiving motion sensor data from a motion sensor within an earpiece;

recognizing a body movement based on the received motion sensor data; and

determining a change in the focus of attention of the user based on the recognized body movement.

12. The method of claim 11, wherein recognizing a body movement based on the received motion sensor data comprises recognizing a head movement.

13. The method of claim 1, further comprising:

transmitting audio messages configured to initiate a one-way audio conversation with multiple recipients;

modifying the one-way audio conversation to include a response message from at least one of the multiple recipients; and

closing the one-way audio conversation to prevent transmission of response messages,

wherein receiving a first audio message and a second audio message comprises;

receiving an alert message from a participant requesting permission to contribute to the one-way audio conversation; and

receiving a response message from the participant containing information for the recipients of the one-way audio conversation.

14. The method of claim 1, wherein one of the first and second audio messages is a whisper service message.

15. The method of claim 1, wherein one of the first and second audio messages is a telephone conversation.

16. A mobile device, comprising:

a wireless transceiver;

a circuit for outputting audio signals to an earpiece; and

a processor coupled to the wireless transceiver and the circuit for outputting audio signals, wherein the processor is configured with processor-executable instructions to perform operations comprising;

receiving, via the wireless transceiver, a first audio message and a second audio message that overlap in time;

determining presentation parameters for the first and second audio messages based on a predefined rule; and

outputting audio signals to cause the first and second audio messages to be played on one or both of the earpiece and the mobile device based on the determined presentation parameters.

17. The mobile device of claim 16, wherein the processor is configured with processor-executable instructions to perform operations further comprising determining relative rankings for the first audio message and the second audio message.

18. The mobile device of claim 17, wherein the processor is configured with processor-executable instructions to perform operations such that determining relative rankings for the first audio message and the second audio message comprises:

evaluating metadata within the first and second audio messages to identify senders of the first and second audio messages;

comparing contact information stored within the mobile device related to the senders of the first and second audio messages; and

ranking the first audio message and the second audio message based on the comparison and user preference settings stored within the mobile device.

19. The mobile device of claim 17, wherein the processor is configured with processor-executable instructions to perform operations such that determining presentation parameters for the first and second audio messages based on predefined protocols comprises using the determined relative rankings to assign presentation parameters to the first and second audio messages.

20. The mobile device of claim 16, wherein:

the circuit for outputting audio signals to an earpiece comprises a circuit for outputting audio signals to a first earpiece and a second earpiece;

the processor is configured with processor-executable instructions to perform operations such that playing the first and second audio messages on one or both of the earpiece and mobile device comprises playing the first and second audio messages on the first earpiece and the second earpiece; and

the processor is configured with processor-executable instructions to perform operations further comprising;

playing the first audio message through the first earpiece; and

playing the second audio message through the second earpiece.

21. The mobile device of claim 16, wherein the processor is configured with processor-executable instructions to perform operations such that playing the first and second audio messages on one or both of the earpiece and mobile device based on the determined presentation parameters comprises distorting the first audio message to create a muffled sound effect.

22. The mobile device of claim 16, wherein the processor is configured with processor-executable instructions to perform operations such that playing the first and second audio messages on one or both of the earpiece and mobile device based on the determined presentation parameters comprises changing a volume level of the first audio message.

23. The mobile device of claim 16, wherein:

the circuit for outputting audio signals to an earpiece comprises a circuit for outputting audio signals to two earpieces; and

the processor is configured with processor-executable instructions to perform operations such that playing the first and second audio messages on one or both of the earpiece and mobile device comprises playing the first and second audio messages on the two earpieces such that the first and second audio messages appear to originate from distinct three-dimensional locations.

24. The mobile device of claim 16, wherein:

the processor is configured with processor-executable instructions to perform operations such that playing the first and second audio messages on one or both of the earpiece and mobile device comprises playing the first and second audio messages on two earpieces; and

the processor is configured with processor-executable instructions to perform operations further comprising;

detecting a change in a focus of attention by a user of the mobile device; and

changing how the first and second audio messages are played in the two earpieces in response to detecting the change in a focus of attention by the user.

25. The mobile device of claim 24, wherein the processor is configured with processor-executable instructions to perform operations such that detecting a change in a focus of attention of the user comprises receiving a user input on a user interface coupled to the mobile device.

26. The mobile device of claim 24, wherein the processor is configured with processor-executable instructions to perform operations such that detecting a change in a focus of attention of the user comprises:

receiving motion sensor data from a motion sensor within an earpiece;

recognizing a body movement based on the received motion sensor data; and

determining a change in the focus of attention of the user based on the recognized body movement.

27. The mobile device of claim 26, wherein the processor is configured with processor-executable instructions to perform operations such that recognizing a body movement based on the received motion sensor data comprises recognizing a head movement.

28. The mobile device of claim 16, wherein the processor is configured with processor-executable instructions to perform operations further comprising:

transmitting, via the wireless transceiver, audio messages configured to initiate a one-way audio conversation with multiple recipients;

modifying the one-way audio conversation to include a response message from at least one of the multiple recipients; and

closing the one-way audio conversation to prevent transmission of response messages,

wherein the processor is configured with processor-executable instructions to perform operations such that receiving, via the wireless transceiver, a first audio message and a second audio message comprises;

receiving, via the wireless transceiver, an alert message from a participant requesting permission to contribute to the one-way audio conversation; and

receiving, via the wireless transceiver, a response message from the participant containing information for the recipients of the one-way audio conversation.

29. The mobile device of claim 16, wherein the processor is configured with processor-executable instructions to perform operations such that one of the first and second audio messages is a whisper service message.

30. The mobile device of claim 16, wherein the processor is configured with processor-executable instructions to perform operations such that one of the first and second audio messages is a telephone conversation.

31. A communication system, comprising:

two earpieces each comprising;

a circuit for receiving audio signals;

a speaker for generating sounds based on received audio signals;

a motion sensor; and

a circuit for outputting motion data from the motion sensor; and

a mobile device comprising;

a wireless transceiver;

a circuit for outputting audio signals to the two earpieces; and

a processor coupled to the wireless transceiver and the circuit for outputting audio signals, wherein the processor is configured with processor-executable instructions to perform operations comprising;

receiving, via the wireless transceiver, a first audio message and a second audio message that overlap in time;

determining presentation parameters for the first and second audio messages based on a predefined rule; and

outputting audio signals to the two earpieces configured to cause the first and second audio messages to be played on the two earpieces based on the determined presentation parameters.

32. The communication system of claim 31, wherein the processor is configured with processor-executable instructions to perform operations such that outputting audio signals to the two earpieces configured to cause the first and second audio messages to be played on the two earpieces based on the determined presentation parameters comprises playing the first and second audio messages on the two earpieces so that the first and second audio messages appear to originate from distinct three-dimensional locations.

33. The communication system of claim 32, wherein the processor is configured with processor-executable instructions to perform operations further comprising:

detecting a change in a focus of attention by a user of the communication system; and

changing how the first and second audio messages are played in the two earpieces in response to detecting the change in a focus of attention by the user.

34. The mobile device of claim 32, wherein the processor is configured with processor-executable instructions to perform operations such that detecting a change in a focus of attention of the user comprises:

receiving motion sensor data from at least one of the motion sensors within the two earpieces;

recognizing a head movement based on the received motion sensor data; and

determining a change in the focus of attention of the user based on the recognized head movement.

35. A mobile device, comprising:

means for receiving a first audio message and a second audio message that overlap in time;

means for determining presentation parameters for the first and second audio messages based on a predefined rule; and

means for outputting audio signals to cause the first and second audio messages to be played on one or both of an earpiece and the mobile device based on the determined presentation parameters.

36. The mobile device of claim 35, further comprising means for determining relative rankings for the first audio message and the second audio message.

37. The mobile device of claim 36, wherein means for determining relative rankings for the first audio message and the second audio message comprises:

means for evaluating metadata within the first and second audio messages to identify senders of the first and second audio messages;

means for comparing contact information stored within the mobile device related to the senders of the first and second audio messages; and

means for ranking the first audio message and the second audio message based on the comparison and user preference settings stored within the mobile device.

38. The mobile device of claim 36, wherein means for determining presentation parameters for the first and second audio messages based on predefined protocols comprises means for using the determined relative rankings to assign presentation parameters to the first and second audio messages.

39. The mobile device of claim 35, further comprising:

means for playing the first audio message through a first earpiece; and

means for playing the second audio message through a second earpiece.

40. The mobile device of claim 35, wherein means for playing the first and second audio messages on one or both of the earpiece and mobile device based on the determined presentation parameters comprises means for distorting the first audio message to create a muffled sound effect.

41. The mobile device of claim 35, wherein means for playing the first and second audio messages on one or both of the earpiece and mobile device based on the determined presentation parameters comprises means for changing a volume level of the first audio message.

42. The mobile device of claim 35, wherein means for playing the first and second audio messages on one or both of the earpiece and mobile device comprises means for playing the first and second audio messages on two earpieces such that the first and second audio messages appear to originate from distinct three-dimensional locations.

43. The mobile device of claim 35, wherein means for playing the first and second audio messages on one or both of the earpiece and mobile device comprises playing the first and second audio messages on two earpieces,

the mobile device further comprising:

means for detecting a change in a focus of attention by a user of the mobile device; and

means for changing how the first and second audio messages are played in the two earpieces in response to detecting the change in a focus of attention by the user.

44. The mobile device of claim 43, wherein means for detecting a change in a focus of attention of the user comprises means for receiving a user input on a user interface coupled to the mobile device.

45. The mobile device of claim 43, wherein means for detecting a change in a focus of attention of the user comprises:

means for receiving motion sensor data from a motion sensor within an earpiece;

means for recognizing a body movement based on the received motion sensor data; and

means for determining a change in the focus of attention of the user based on the recognized body movement.

46. The mobile device of claim 45, wherein means for recognizing a body movement based on the received motion sensor data comprises means for recognizing a head movement.

47. The mobile device of claim 35, further comprising:

means for transmitting audio messages configured to initiate a one-way audio conversation with multiple recipients;

means for modifying the one-way audio conversation to include a response message from at least one of the multiple recipients; and

means for closing the one-way audio conversation to prevent transmission of response messages,

wherein means for receiving a first audio message and a second audio message comprises;

means for receiving an alert message from a participant requesting permission to contribute to the one-way audio conversation; and

means for receiving a response message from the participant containing information for the recipients of the one-way audio conversation.

48. The mobile device of claim 35, further comprising means for receiving one of the first and second audio messages as a whisper service message.

49. The mobile device of any of claim 35, further comprising means for receiving one of the first and second audio messages as a telephone conversation.

50. A non-transitory processor-readable storage medium having stored thereon processor-executable instructions configured to cause a processor of a mobile device to perform operations comprising:

receiving, via a wireless transceiver, a first audio message and a second audio message that overlap in time;

determining presentation parameters for the first and second audio messages based on a predefined rule; and

outputting audio signals to cause the first and second audio messages to be played on one or both of an earpiece and the mobile device based on the determined presentation parameters.

51. The non-transitory processor-readable storage medium of claim 50, wherein the stored processor-executable instructions are configured to cause a processor of a mobile device to perform operations further comprising determining relative rankings for the first audio message and the second audio message.

52. The non-transitory processor-readable storage medium of claim 51, wherein the stored processor-executable instructions are configured to cause a processor of a mobile device to perform operations such that determining relative rankings for the first audio message and the second audio message comprises:

evaluating metadata within the first and second audio messages to identify senders of the first and second audio messages;

comparing contact information stored within the mobile device related to the senders of the first and second audio messages; and

ranking the first audio message and the second audio message based on the comparison and user preference settings stored within the mobile device.

53. The non-transitory processor-readable storage medium of claim 51, wherein the stored processor-executable instructions are configured to cause a processor of a mobile device to perform operations such that determining presentation parameters for the first and second audio messages based on predefined protocols comprises using the determined relative rankings to assign presentation parameters to the first and second audio messages.

54. The non-transitory processor-readable storage medium of claim 50, wherein:

the stored processor-executable instructions are configured to cause a processor of a mobile device to perform operations such that playing the first and second audio messages on one or both of the earpiece and mobile device comprises playing the first and second audio messages on a first earpiece and a second earpiece, and

the stored processor-executable instructions are configured to cause a processor of a mobile device to perform operations further comprising;

playing the first audio message through the first earpiece; and

playing the second audio message through the second earpiece.

55. The non-transitory processor-readable storage medium of claim 50, wherein the stored processor-executable instructions are configured to cause a processor of a mobile device to perform operations such that playing the first and second audio messages on one or both of the earpiece and mobile device based on the determined presentation parameters comprises distorting the first audio message to create a muffled sound effect.

56. The non-transitory processor-readable storage medium of claim 50, wherein the stored processor-executable instructions are configured to cause a processor of a mobile device to perform operations such that playing the first and second audio messages on one or both of the earpiece and mobile device based on the determined presentation parameters comprises changing a volume level of the first audio message.

57. The non-transitory processor-readable storage medium of claim 50, wherein the stored processor-executable instructions are configured to cause a processor of a mobile device to perform operations such that playing the first and second audio messages on one or both of the earpiece and mobile device comprises playing the first and second audio messages on two earpieces such that the first and second audio messages appear to originate from distinct three-dimensional locations.

58. The non-transitory processor-readable storage medium of claim 50, wherein:

the stored processor-executable instructions are configured to cause a processor of a mobile device to perform operations such that playing the first and second audio messages on one or both of the earpiece and mobile device comprises playing the first and second audio messages on two earpieces; and

the stored processor-executable instructions are configured to cause a processor of a mobile device to perform operations further comprising;

detecting a change in a focus of attention by a user of the mobile device; and

changing how the first and second audio messages are played in the two earpieces in response to detecting the change in a focus of attention by the user.

59. The non-transitory processor-readable storage medium of claim 58, wherein the stored processor-executable instructions are configured to cause a processor of a mobile device to perform operations such that detecting a change in a focus of attention of the user comprises receiving a user input on a user interface coupled to the mobile device.

60. The non-transitory processor-readable storage medium of claim 58, wherein the stored processor-executable instructions are configured to cause a processor of a mobile device to perform operations such that detecting a change in a focus of attention of the user comprises:

receiving motion sensor data from a motion sensor within an earpiece;

recognizing a body movement based on the received motion sensor data; and

determining a change in the focus of attention of the user based on the recognized body movement.

61. The non-transitory processor-readable storage medium of claim 60, wherein the stored processor-executable instructions are configured to cause a processor of a mobile device to perform operations such that recognizing a body movement based on the received motion sensor data comprises recognizing a head movement.

62. The non-transitory processor-readable storage medium of claim 50, wherein the stored processor-executable instructions are configured to cause a processor of a mobile device to perform operations further comprising:

transmitting, via the wireless transceiver, audio messages configured to initiate a one-way audio conversation with multiple recipients;

modifying the one-way audio conversation to include a response message from at least one of the multiple recipients; and

closing the one-way audio conversation to prevent transmission of response messages,

wherein the stored processor-executable instructions are configured to cause a processor of a mobile device to perform operations such that receiving, via the wireless transceiver, a first audio message and a second audio message comprises;

receiving, via the wireless transceiver, an alert message from a participant requesting permission to contribute to the one-way audio conversation; and

receiving, via the wireless transceiver, a response message from the participant containing information for the recipients of the one-way audio conversation.

63. The non-transitory processor-readable storage medium of any of claim 50, wherein the stored processor-executable instructions are configured to cause a processor of a mobile device to perform operations such that one of the first and second audio messages is a whisper service message.

64. The non-transitory processor-readable storage medium of any of claim 50, wherein the stored processor-executable instructions are configured to cause a processor of a mobile device to perform operations such that one of the first and second audio messages is a telephone conversation.