Gaze based directional microphone

• US 10,116,846 B2
• Filed: 03/08/2017
• Issued: 10/30/2018
• Est. Priority Date: 09/03/2013
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: Henderek, David Figgins, Skogo, Marten
• Primary Examiner(s): King, Simon
• Application Number:
  US15/453,661
• Publication Number:
  US 20170272627A1
• Time in Patent Office: 601 Days
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 2207/10152 Varying illumination
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04R 1/32 for obtaining desired directional characteristic only specially adapted for hearing aids H04R25/40
• CPC Class Codes: H04R 2201/40 Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups

Abstract

According to the invention, a system for converting sound to electrical signals is disclosed. The system may include a gaze tracking device and a microphone. The gaze tracking device may determine a gaze direction of a user. The microphone may be more sensitive in a selected direction than at least one other direction and alter the selected direction based at least in part on the gaze direction determined by the gaze tracking device.

Claims

1. A system for converting sounds to electrical signals, the system comprising:

a gaze tracking device, wherein the gaze tracking device determines a gaze direction of a user;

a microphone; and

a processor configured to;

select a first sound reproduction unit to reproduce sound received by the microphone when the first sound reproduction unit is within the gaze direction of the user and to not select a second sound reproduction unit to reproduce the sound received by the microphone when the second sound reproduction unit is outside the gaze direction of the user; and

select the second sound reproduction unit to reproduce the sound received by the microphone when the second sound reproduction unit is within the gaze direction of the user and to not select the first sound reproduction unit to reproduce the sound received by the microphone when the first sound reproduction unit is outside the gaze direction of the user.

2. The system for converting sounds to electrical signals of claim 1, wherein the processor is further configured to:

transmit wireless signals corresponding to the sound received from the microphone to the first sound reproduction unit when the first sound reproduction unit is selected or the second sound reproduction unit when the second sound reproduction unit selected.

3. The system for converting sounds to electrical signals of claim 1, wherein:

the processor selects the first sound reproduction unit or the second sound reproduction unit prior to the microphone receiving a sound.

4. The system for converting sounds to electrical signals of claim 1, wherein:

the processor selects the first sound reproduction unit or the second sound reproduction unit during the microphone receiving a sound.

5. The system for converting sounds to electrical signals of claim 1, wherein:

the processor selects the first sound reproduction unit or the second sound reproduction unit after the microphone receives a sound.

6. The system for converting sounds to electrical signals of claim 1, wherein selecting the first sound reproduction unit or the second sound reproduction unit comprises:

selecting the first sound reproduction unit or the second sound reproduction unit from a plurality of sound production units known to the processor.

7. The system for converting sounds to electrical signals of claim 1, the system further comprising:

a headset, wherein at least the gaze tracking device is disposed within the headset.

8. A method for converting sounds to electrical signals, the method comprising:

determining, with a gaze tracking device, a gaze direction of a user;

receiving, with a microphone, a sound;

selecting, with a processor, a first sound reproduction unit to reproduce sound received by the microphone when the first sound reproduction unit is within the gaze direction of the user and not selecting a second sound reproduction unit to reproduce the sound received by the microphone when the second sound reproduction unit is outside the gaze direction of the user; and

selecting the second sound reproduction unit to reproduce the sound received by the microphone when the second sound reproduction unit is within the gaze direction of the user and not selecting the first sound reproduction unit to reproduce the sound received by the microphone when the first sound reproduction unit is outside the gaze direction of the user.

9. The method for converting sounds to electrical signals of claim 8, the method further comprising:

transmitting wireless signals corresponding to the sound received from the microphone to the first sound reproduction unit or the second sound reproduction unit selected.

10. The method for converting sounds to electrical signals of claim 8, wherein:

selecting the first sound reproduction unit or the second sound reproduction unit occurs prior to the microphone receiving a sound.

11. The method for converting sounds to electrical signals of claim 8, wherein:

selecting the first sound reproduction unit or the second sound reproduction unit occurs during the microphone receiving a sound.

12. The method for converting sounds to electrical signals of claim 8, wherein:

selecting the first sound reproduction unit or the second sound reproduction unit occurs after the microphone receives a sound.

13. A non-transitory machine readable medium having instructions stored thereon for converting sounds to electrical signals, wherein the instructions are executable by one or more processors for at least:

determining, with a gaze tracking device, a gaze direction of a user;

receiving, from a microphone, a signal representing a sound;

selecting, with a processor, a first sound reproduction unit to reproduce the sound received by the microphone when the first sound reproduction unit is within the gaze direction of the user and not selecting a second sound reproduction unit to reproduce the sound received by the microphone when the second sound reproduction unit is outside the gaze direction of the user; and

selecting the second sound reproduction unit to reproduce the sound received by the microphone when the second sound reproduction unit is within the gaze direction of the user and not selecting the first sound reproduction unit to reproduce the sound received by the microphone when the first sound reproduction unit is outside the gaze direction of the user.

14. The non-transitory machine readable medium of claim 13, wherein the instructions are further executable for at least:

transmitting wireless signals corresponding to the signal received from the microphone to the first sound reproduction unit when the first sound reproduction unit is selected or the second sound reproduction unit the second sound reproduction unit is selected.

15. The non-transitory machine readable medium of claim 13, wherein:

selecting the first sound reproduction unit or the second sound reproduction unit occurs prior to the microphone receiving a sound.

16. The non-transitory machine readable medium of claim 13, wherein:

selecting the first sound reproduction unit or the second sound reproduction unit occurs during the microphone receiving a sound.

17. The non-transitory machine readable medium of claim 13, wherein:

selecting the first sound reproduction unit or the second sound reproduction unit occurs after the microphone receives a sound.