Gaze based directional microphone

• US 10,708,477 B2
• Filed: 10/23/2018
• Issued: 07/07/2020
• Est. Priority Date: 09/03/2013
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: Henderek, David Figgins, Skogo, Marten
• Primary Examiner(s): King, Simon
• Application Number:
  US16/167,874
• Publication Number:
  US 20190327399A1
• Time in Patent Office: 623 Days
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 2207/10152 Varying illumination
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04R 1/32 for obtaining desired directional characteristic only specially adapted for hearing aids H04R25/40
• CPC Class Codes: H04R 2201/40 Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups

Abstract

According to the invention, a system for converting sound to electrical signals is disclosed. The system may include a gaze tracking device and a microphone. The gaze tracking device may determine a gaze direction of a user. The microphone may be more sensitive in a selected direction than at least one other direction and alter the selected direction based at least in part on the gaze direction determined by the gaze tracking device.

Claims

1. A system for converting sounds to electrical signals, wherein the system comprises:

a gaze tracking device, wherein the gaze tracking device determines a gaze direction of a user;

multiple stationary microphones comprising a first stationary microphone and a second stationary microphone;

a camera;

a display device reproducing a scene captured by the camera, wherein;

the gaze tracking device determining the gaze direction of the user comprises determining a gaze point of the user on the display device;

wherein the first stationary microphone is more relatively directed towards the gaze direction than the second stationary microphone; and

processing outputs from the multiple stationary microphones for delivering directional sensitivity, wherein said processing comprises adding a delay to a signal received from the first stationary microphone to create a delayed signal, and then summing the delayed signal with a signal received from the second stationary microphone.

2. The system for converting sounds to electrical signals of claim 1, wherein the system further comprises:

an output device.

3. The system for converting sounds to electrical signals of claim 2, wherein the output device comprises a selection from a group consisting of:

a speaker;

a cochlear implant; and

a recording device.

4. The system for converting sounds to electrical signals of claim 1, wherein the system further comprises:

a frame configured to be worn on the user'"'"'s head, wherein the eye tracking device is coupled with the frame.

5. The system for converting sounds to electrical signals of claim 4, wherein:

the multiple stationary microphones are coupled with the frame.

6. A method for converting sounds to electrical signals, wherein the method comprises:

reproducing a scene captured by a camera on a display device;

determining the gaze direction of the user with a gaze tracking device, wherein determining the gaze direction comprises determining a gaze point of the user on the display device;

processing outputs from the multiple stationary microphones for delivering directional sensitivity, said multiple stationary microphones comprising a first stationary microphone and a second stationary microphone; and

wherein said processing outputs from the multiple stationary microphones for delivering directional sensitivity comprises adding a delay to a signal received from the first stationary microphone to create a delayed signal, and then summing the delayed signal with a signal received from the second stationary microphone, wherein the first stationary microphone is more relatively directed towards the gaze direction than the second stationary microphone.

7. A non-transitory machine readable medium having instructions stored thereon, wherein instructions are executable by a processor to at least:

reproduce a scene captured by a camera on a display device;

receive, from a gaze tracking device, data representing a gaze direction of a user;

determining the gaze direction of the user from the data, wherein determining the gaze direction comprises determining a gaze point of the user on the display device;

processing outputs from the multiple stationary microphones for delivering directional sensitivity, said multiple stationary microphones comprising a first stationary microphone and a second stationary microphone, and

wherein said processing outputs from the multiple stationary microphones for delivering directional sensitivity comprises adding a delay to a signal received from the first stationary microphone to create a delayed signal, and then summing the delayed signal with a signal received from the second stationary microphone, wherein the first stationary microphone is more relatively directed towards the gaze direction than the second stationary microphone.