DIRECTING AUDIO OUTPUT BASED ON GESTURES

• US 20150347086A1
• Filed: 01/22/2014
• Published: 12/03/2015
• Est. Priority Date: 01/22/2014
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Gulliksson, Johan, Liedholm, Johan
• Granted Patent: US 10,171,643 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 13/102 where the programme performs an interfacing function, e.g. device driver G06F13/105 takes precedence; scheduling within device drivers G06F9/52; contention policies within device drivers G06F9/4881
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04M 1/6041 Portable telephones adapted for handsfree use
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 1/72484 wherein functions are triggered by incoming communication events
• CPC Class Codes: H04W 24/08 Testing, supervising or monitoring using real traffic

Abstract

A method includes determining whether there is an incoming call to a first device or an outbound call from the first device. The method also includes monitoring at least one of: user input to the first device; motion of a second device; or motion of the first device. The method further includes: identifying a user'"'"'s gesture based on a result of the monitoring and in response to determining that there is an incoming call or an outbound call; and redirecting audio input and output, of the first device, at a first one of input/output (I/O) devices to a second one of the I/O devices based on the gesture. The I/O devices comprise the first device and the second device.

Claims

1. A first device comprising:

a memory to store instructions;

a processor configured to execute the instructions to;

determine whether there is an incoming call to the first device or an outbound call from the first device;

monitor at least one of;

user input to the first device;

motion of a second device;

or

motion of the first device;

identify a user'"'"'s gesture based on a result of the monitoring and in response to determining that there is an incoming call or an outbound call; and

redirect audio input and output at a first one of input/output (I/O) devices to a second one of the I/O devices based on the gesture,

wherein the I/O devices comprise the first device and the second device.

2. The first device of claim 1, wherein the first device includes one of:

a smart phone;

a tablet computer;

a computer;

a laptop computer, and

wherein the second device includes one or more of;

a headset;

speakers;

a microphone;

or a head-mounted display.

3. The first device of claim 1, wherein when the processor monitors the user input, the processor is further configured to:

detect initial digits of a phone number being input to the first device.

4. The first device of claim 1, further comprising a component that includes at least one of:

an accelerometer, a camera, a compass, a proximity sensor, and a gyroscope,

wherein when the processor monitors the motion of the first device, the processor receives and processes output of the component.

5. The first device of claim 1, wherein the second device further comprises a component that includes at least one of:

an accelerometer;

a camera,

a proximity sensor;

a sensor for determining whether the second device is being worn on a user'"'"'s head; and

a gyroscope,

wherein when the processor monitors the motion of the second device, the processor receives and processes output of the component.

6. The first device of claim 1, wherein the second device is coupled to the first device via one of:

a Bluetooth communication link;

or a communication link over a cable or a wire.

7. The first device of claim 1, wherein the gesture includes moving the second device to the head of a user,

wherein when the processor redirects the audio input and output, the processor directs the audio input and output to the second device.

8. The first device of claim 1, wherein the gesture includes moving the first device to the head of the user,

wherein when the processor redirects the audio input and output, the processor directs the audio input and output to the first device.

9. The first device of claim 1, wherein the gesture includes moving the first device away from the head of the user, and

wherein when the processor redirects audio input and output, the processor redirects the audio input and output to the second device.

10. The first device of claim 1, wherein the gesture includes moving the first device toward the head of the user,

wherein the I/O devices further comprise a third device paired with the first device;

and

wherein when the processor redirects the audio input and output, the processor;

causes the first device to decouple from the third device; and

directs the audio input and output to the first device.

11. The first device of claim 1, wherein the gesture includes moving the second device toward the head of the user,

wherein the I/O devices further comprise a third device paired with the first device;

and

wherein when the processor redirects the audio input and output, the processor;

causes the first device to decouple from the third device;

pairs the first device with the second device; and

directs the audio input and output to the second device.

12. The first device of claim 1, wherein the gesture includes moving the second device away the head of the user, and the first device is paired with the second device;

wherein the I/O devices further comprise a third device, and

wherein when the processor redirects the audio input and output, the processor;

causes the first device to decouple from the second device;

pairs the first device with the third device; and

directs the audio input and output to the third device.

13. The first device of claim 1, wherein the gesture includes dialing a portion of a phone number,

wherein when the processor redirects the audio input and output, the processor:

completes the dialing of the phone number; and

initiates a call based on the dialed number.

14. A method comprising:

determining whether there is an incoming call to a first device or an outbound call from the first device;

monitoring at least one of;

user input to the first device;

motion of a second device;

or

motion of the first device;

identifying a user'"'"'s gesture based on a result of the monitoring and in response to determining that there is an incoming call or an outbound call; and

redirecting audio input and output, of the first device, at a first one of input/output (I/O) devices to a second one of the I/O devices based on the gesture,

wherein the I/O devices comprise the first device and the second device.

15. The method of claim 14, wherein the gesture includes moving the second device to the head of a user,

wherein redirecting the audio input and output includes redirecting the audio input and output to the second device.

16. The method of claim 14, wherein the gesture includes moving the first device to the head of the user,

wherein redirecting the audio input and output includes redirecting the audio input and output to the first device.

17. The method of claim 14, wherein the gesture includes moving the first device away from the head of the user, and

wherein redirecting the audio input and output includes redirecting the audio input and output to the second device.

18. The method of claim 14, wherein the gesture includes moving the first device toward the head of the user,

wherein redirecting the audio input and output includes:

causing the first device to decouple from a third device; and

directing the audio input and output to the first device.

19. The method of claim 14, wherein the gesture includes moving the second device toward the head of the user, and

wherein redirecting the audio input and output includes:

causing the first device to decouple from a third device;

pairing the first device with the second device; and

directing the audio input and output to the second device.

20. The method of claim 14, wherein the gesture includes moving the second device away the head of the user,

wherein the first device is paired with the second device, and

wherein redirecting the audio signal includes:

causing the first device to decouple from the second device;

paring the first device with a third device; and

directing the audio input and output to the third device.

21. The method of claim 14, wherein the gesture includes dialing a portion of a phone number,

wherein redirecting the audio input and output includes:

completing the dialing of the phone number; and

initiating a call based on the dialed number.

22. A tangible computer-readable storage device, comprising computer executable instructions, when executed by a processor, cause the processor to:

determine whether there is an incoming call to a first device or an outbound call from the first device;

monitor at least one of;

user input to the first device;

motion of a second device;

or

motion of the first device;

identify a user'"'"'s gesture based on a result of the monitoring and in response to determining that there is an incoming call or an outbound call; and

redirect audio input and output at a first one of input/output (I/O) devices to a second one of the I/O devices based on the gesture,

wherein the I/O devices comprise the first device and the second device.