Orientation free handsfree device

• US 10,306,355 B2
• Filed: 06/07/2017
• Issued: 05/28/2019
• Est. Priority Date: 03/07/2013
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Vilermo, Miikka Tapani, Laaksonen, Lasse Juhani, Eronen, Antti, Ramo, Anssi Sakari, Ozcan, Koray, Leppanen, Jussi Artturi
• Primary Examiner(s): Deane, Jr., William J
• Application Number:
  US15/616,403
• Publication Number:
  US 20170272856A1
• Time in Patent Office: 720 Days
• Field of Search: 381 74, 381309
• CPC Class Codes: H04R 1/32 for obtaining desired directional characteristic only specially adapted for hearing aids H04R25/40
• CPC Class Codes: H04R 5/033 Headphones for stereophonic communication details thereof, e.g. relating to batteries, cables or control elements H04R1/10
• CPC Class Codes: H04S 7/304 For headphones

Abstract

Methods, apparatuses, and computer program products are provided to indicate or automatically configure headphone channel orientation based on a physical orientation determination. An apparatus is provided that is configured to at least determine an orientation of the headphone device; analyze the determined orientation; and provide an indication of the determined orientation or adjust the output channel configuration of the apparatus for the headphone device. The apparatus may be further configured to determine the orientation of the headphone device based on at least one of: a head turn position; a direction of one or more audio signals; a direction of movement, wherein the movement is determined based on a determination of acceleration or trajectory of the headphone device; two or more compass data, wherein at least one compass is located in each of the apparatus and the headphone device; and a difference in characteristics of one or more audio signals.

Claims

1. An apparatus comprising at least one processor and at least one memory including computer program instructions, the at least one memory and the computer program instructions configured to, with the at least one processor, cause the apparatus at least to:

determine an application with audio output is started on a mobile device;

determine that a user is providing input to the mobile device;

receive first sensor data to determine motion activity of the user based on the provided input wherein the first sensor data is provided from a first sensor of a headphone device, wherein the headphone device is worn at the user;

receive second sensor data indicating a direction of movement of the headphone device, wherein the second sensor data is provided from a second sensor at the headphone device or the mobile device, the direction of movement of the headphone device is based on a determination of acceleration or trajectory of the headphone device;

compare the received first sensor data to the received second sensor data;

determine from the comparison if the motion activity of the user corresponds to the direction of movement of the headphone device to determine a physical orientation of the headphone device; and

determine an output channel order for the headphone device and switch the output channel order when the motion activity of the user does not correspond with the direction of movement of the headphone device, wherein the output channels cause audio signals to be output from the headphone device.

2. The apparatus according to claim 1, wherein the input is provided from the user to the mobile device, wherein the first sensor data comprises a compass reading from the headphone device and the second sensor data comprises a compass reading from the mobile device, and wherein the at least one memory and the computer program instructions are configured to, with the at least one processor, further cause the apparatus to:

determine that the motion activity of the user corresponds to the direction of movement of the headphone device in an instance in which the compass data for the headphone device and the compass data for the mobile device are within 90 degrees of each other.

3. The apparatus according to claim 1, wherein the output channel order comprises either a correct headphone channel orientation or an incorrect headphone channel orientation, wherein the correct headphone channel orientation comprises a left channel placed to a left ear of the user and a right channel placed to a right ear of the user, and wherein the at least one memory and the computer program instructions are configured to, with the at least one processor, further cause the apparatus to:

provide an indication of the determined physical orientation or adjustably switch the output channel order of the headphone device so that a left output channel is to be provided to the left ear and a right output channel is to be provided to the right ear even when the output channel order is the incorrect headphone channel orientation.

4. The apparatus according to claim 1, wherein the motion activity of the user is a non-mobile activity and wherein the at least one memory and the computer program instructions are configured to, with the at least one processor, further cause the apparatus to:

receive at least two user generated audio signals based on one or more sound sources from two or more microphones associated with the headphone device; and

analyze at least one interaural difference between two or more microphone signals associated with the headphone device to determine the output channel order for the headphone device, wherein the at least one interaural difference comprises at least of;

a time delay, an intensity difference, and a phase difference of the user generated audio signals based on the two or more microphones.

5. The apparatus according to claim 1, wherein the at least one memory and the computer program instructions are configured to, with the at least one processor, further cause the apparatus to at least one of:

determine the physical orientation of the headphone device based on at least one of;

a head turn position;

a direction based on one or more audio signals; and

a difference in characteristics of one or more audio signals.

6. The apparatus according to claim 5, wherein the at least one memory and the computer program instructions are configured to, with the at least one processor, further cause the apparatus to:

output the one or more audio signals on channels of the headphone device; and

analyze one or more audio signal characteristics of the channels and the head turn position so as to determine the physical orientation of the headphone device.

7. The apparatus according to claim 1, wherein the first sensor data comprises data from an accelerometer in the headphone device, and wherein the second sensor data comprises Global Positioning System (GPS) data from the headphone device or the mobile device.

8. A method comprising:

determining an application with audio output is started on a mobile device;

determining that a user is providing input to the mobile device;

receiving first sensor data to determine motion activity of the user based on the provided input wherein the first sensor data is provided from a first sensor of a headphone device, wherein the headphone device is worn at the user;

receiving second sensor data indicating a direction of movement of the headphone device, wherein the second sensor data is provided from a second sensor at the headphone device or the mobile device, the direction of movement based on a determination of acceleration or trajectory of the headphone device;

comparing the received first sensor data to the received second sensor data;

determining from the comparison if the motion activity of the user corresponds to the direction of movement to determine a physical orientation of the headphone device; and

determining an output channel order for the headphone device and switching the output channel order when the motion activity of the user does not correspond with the direction of movement wherein the output channels cause audio signals to be output from the headphone device.

9. The method according to claim 8, wherein the input is provided from the user to the mobile device, wherein the first sensor data comprises a compass reading from a headphone device and the second sensor data comprises a compass reading from the mobile device, and wherein the method further comprises:

determining that the motion activity of the user corresponds to the direction of movement of the headphone device in an instance in which the compass data for the headphone device and the compass data for the mobile device are within 90 degrees of each other.

10. The method according to claim 8, wherein the output channel order comprises either a correct headphone channel orientation or an incorrect headphone channel orientation, wherein the correct headphone channel orientation comprises a left channel placed to a left ear of the user and a right channel placed to a right ear of the user, and wherein the method further comprises:

providing an indication of the determined physical orientation or adjustably switching the output channel order for the headphone device so that a left output channel is to be provided to the left ear and a right output channel is to be provided to the right ear even when the output channel order is the incorrect headphone channel orientation.

11. The method according to claim 8, wherein the motion activity of the user is a non-mobile activity and wherein the method further comprises:

receiving at least two user generated audio signals based on one or more sound sources from two or more microphones associated with the headphone device; and

analyzing at least one interaural difference between two or more microphone signals associated with the headphone device to determine the output channel order for the headphone device, wherein the at least one interaural difference comprises at least one of;

a time delay, an intensity difference, and a phase difference of the user generated audio signals based on the two or more microphones.

12. The method according to claim 8, further comprising determining the physical orientation of the headphone device based on at least one of:

a head turn position;

a direction based on one or more audio signals; and

a difference in characteristics of one or more audio signals.

13. The method according to claim 12, further comprising:

outputting the one or more audio signals on channels of the headphone device; and

analyzing one or more audio signal characteristics of the channels and the head turn position so as to determine the physical orientation of the headphone device.

14. The method according to claim 8, wherein the first sensor data comprises data from an accelerometer in the headphone device, and wherein the second sensor data comprises Global Positioning System (GPS) data from the headphone device or the mobile device.

15. A computer program product comprising at least one non-transitory computer-readable storage medium bearing computer program instructions embodied therein for use with a computer, the computer program instructions comprising program instructions configured to:

determine an application with audio output is started on a mobile device;

determine that a user is providing input to the mobile device;

receive first sensor data to determine motion activity of the user based on the provided input wherein the first sensor data is provided from a first sensor of a headphone device, wherein the headphone device is worn at the user;

receive second sensor data indicating a direction of movement of the headphone device, wherein the second sensor data is provided from a second sensor at the headphone device or the mobile device, the direction of movement based on a determination of acceleration or trajectory of the headphone device;

compare the received first sensor data to the received second sensor data;

determine from the comparison if the motion activity of the user corresponds to the direction of movement to determine a physical orientation of the headphone device; and

determine an output channel order for the headphone device and switch the channel order when the activity of the user does not correspond with the direction of movement, wherein the output channels cause audio signals to be output from the headphone device.

16. The computer program product according to claim 15, wherein the input is provided from the user to the mobile device, wherein the first sensor data comprises a compass reading from the headphone device and the second sensor data comprises a compass reading from the mobile device, and wherein the computer program instructions further comprise program instructions configured to:

determine that the motion activity of the user corresponds to the direction of movement of the headphone device in an instance in which the compass data for the headphone device and the compass data for the mobile device are within 90 degrees of each other.

17. The computer program product according to claim 15, wherein the output channel order comprises either a correct headphone channel orientation or an incorrect headphone channel orientation, wherein the correct headphone channel orientation comprises a left channel placed to a left ear of the user and a right channel placed to a right ear of the user, and wherein the computer program instructions further comprise program instructions configured to:

provide an indication of the determined physical orientation or adjustably switch the output channel order for the headphone device so that a left output channel is to be provided to the left ear and a right output channel is to be provided to the right ear even when the output channel order is the incorrect headphone channel orientation.

18. The computer program product according to claim 15, wherein the motion activity of the user is a non-mobile activity and wherein the computer program instructions further comprise program instructions configured to:

receive at least two user generated audio signals based on one or more sound sources from two or more microphones associated with the headphone device; and

analyze at least one interaural difference between the two or more microphone signals associated with the headphone device to determine the output channel order for the headphone device, wherein the at least one interaural difference comprises at least one of;

a time delay, an intensity difference, and a phase difference of the user generated audio signals based on the two or more microphones.

19. The computer program product according to claim 15, wherein the computer program instructions further comprise program instructions configured to:

determine the physical orientation of the headphone device based on at least one of;

a head turn position;

a direction based on one or more audio signals; and

a difference in characteristics of one or more audio signals;

output audio signals on channels of the headphone device; and

analyze one or more audio signal characteristics of the channels and the head turn position so as to determine the physical orientation of the headphone device.

20. The computer program product according to claim 15, wherein the first sensor data comprises data from an accelerometer in the headphone device, and wherein the second sensor data comprises Global Positioning System (GPS) data from the headphone device or the mobile device.