Binaural recording for smart pen computing systems

• US 8,254,605 B2
• Filed: 05/29/2008
• Issued: 08/28/2012
• Est. Priority Date: 05/29/2007
• Status: Active Grant

• Current Assignee: Livescribe Incorporated (Anoto Group AB)
• Original Assignee: Livescribe Incorporated (Anoto Group AB)
• Inventors: Van Schaack, Andy, Canova, Frank, Connell, Byron, Lewis, Rick
• Primary Examiner(s): Warren, David
• Assistant Examiner(s): RUSSELL, CHRISTINA MARIE
• Application Number:
  US12/129,579
• Publication Number:
  US 20090022343A1
• Time in Patent Office: 1,552 Days
• Field of Search: 381/309, 381/71.1, 381/74, 381/91, 381/334, 345/179
• US Class Current: 381/309
• CPC Class Codes: H04R 1/028 associated with devices performing functions other than acoustics, e.g. electric candles
• CPC Class Codes: H04R 5/027 Spatial or constructional arrangements of microphones, e.g. in dummy heads
• CPC Class Codes: H04R 5/033 Headphones for stereophonic communication details thereof, e.g. relating to batteries, cables or control elements H04R1/10

Abstract

A pen based computing system concurrently captures handwriting gestures and records audio using binaural recording. A binaural headset communicatively coupled to the smart pen device uses at least two microphones. A left microphone is placed in or near the left ear and the right microphone is placed in or near the right ear, each facing outward. Speakers are integrated into a shared housing with the microphones facing inward towards the ear canal to play back the audio recordings. By recording audio with microphones placed close to the ears, the system provides realistic sounding playback and allows users to more easily differentiate between multiple sources of audio.

Claims

1. A pen-based computing system for recording and playing back audio, comprising:

a left audio device adapted to fit proximate to a user'"'"'s left ear, the left audio device having an integrated left microphone for capturing a left audio input signal, and an integrated left speaker for playing back a left audio output signal;

a right audio device adapted to fit proximate to a user'"'"'s right ear, the right audio device having an integrated right microphone for capturing a right audio input signal and an integrated right speaker for playing back a right audio output signal;

a connector plug for transferring audio signals between the left audio device, the right audio device, and a smart pen device, the connector plug comprising;

a first conducting surface for transferring the left audio input signal captured by the integrated left microphone from the left audio device to the smart pen device;

a second conducting surface for transferring the right audio input signal captured by the integrated right microphone from the right audio device to the smart pen device;

a third conducting surface for transferring the left audio output signal from the smart pen device to the integrated left speaker of the left audio device; and

a fourth conducting surface for transferring the right audio output signal from the smart pen device to the integrated right speaker of the right audio device; and

the smart pen device, comprising a connector jack configured to be coupled to the connector plug, the connector jack comprising;

a first conductor configured to be coupled to the first conducting surface of the connector plug;

a second conductor configured to be coupled to the second conducting surface of the connector plug;

a third conductor configured to be coupled to the third conducting surface of the connector plug; and

a fourth conductor configured to be coupled to the fourth conducting surface of the connector plug;

the smart pen device configured to record the left audio input signal received over the first conductor and record the right audio input signal received over the second conductor, and to synchronize captured handwriting gestures in time with the left audio input signal and the right audio input signal.

2. The pen-based computing system of claim 1,

wherein the left audio device comprises a left earbud housing adapted to be placed in a left ear wherein the integrated left microphone faces away from the left ear and the integrated left speaker faces towards the left ear;

and

wherein the right audio device comprises a right earbud housing adapted to be placed in a right ear wherein the integrated right microphone faces away from the right ear and the integrated right speaker faces towards the right ear.

3. The pen-based computing system of claim 1,

wherein the left audio device comprises a left earclip adapted to clip around a portion of a left ear such that the integrated left microphone faces away from the left ear and the integrated left speaker faces towards the left ear;

and

wherein the right audio device comprises a right earclip adapted to clip around a portion of a right ear such that the integrated right microphone faces away from the right ear and the integrated right speaker faces towards the right ear.

4. The pen-based computing system of claim 1, further comprising:

a rigid band shaped for placement around a user'"'"'s neck, wherein the left audio device is connected to a left end of the rigid band and the right audio devices is connected to a right end of the rigid band.

5. The pen-based computing system of claim 1, further comprising:

a first fastening mechanism for attaching the left audio device to a left side of a user'"'"'s clothing or body; and

a second fastening mechanism for attaching the right audio device to a right side of a user'"'"'s clothing or body.

6. The pen-based computing system of claim 1, further comprising:

a flexible strap for hanging around a user'"'"'s neck, wherein the left audio device is connected to a first end of the flexible strap and the right audio devices is connected to a second end of the flexible strap.

7. The pen-based computing system of claim 1, wherein the connector plug further comprises an integrated sliding volume controller for controlling speaker output volume.

8. The pen-based computing system of claim 1, wherein the connector plug further comprises:

a ground conducting surface for supplying a reference voltage relative to signals on the first conducting surface, the second conducting surface, the third conducting surface, and the fourth conducting surface.

9. The pen-based computing system of claim 1,

wherein the left audio device comprises a first membrane adapted for common use by the left microphone and the left speaker;

and

wherein the right audio device comprises a second membrane adapted for common use by the right microphone and the right speaker.

10. The pen-based computing system of claim 1, wherein the smart pen device comprises:

a processor for processing the audio captured by the left and right microphones to adjust relative gain between a first audio source originating from a first direction and a second audio source originating from a second direction.

11. The pen-based computing system of claim 10, wherein the processor is programmed to adjust the relative gain between the first audio source and the second audio source in real time and output the processed audio to the left and right speakers.

12. A headset for recording and playing back audio, comprising:

a left earbud adapted to fit substantially within a left ear, the left earbud comprising an integrated left microphone for capturing a left audio input signal and an integrated left speaker for playing back a left audio output signal, the left microphone facing opposite the left speaker;

a right earbud adapted to fit substantially within a right ear, the right earbud comprising an integrated right microphone for capturing a right audio input signal and an integrated right speaker for playing back a right audio output signal, the right microphone facing opposite the right speaker; and

a connector plug for transferring audio signals between the left earbud, the right earbud, and a memory, the connector plug comprising;

a first conducting surface for transferring the left audio input signal captured by the integrated left microphone from the left audio device to a memory;

a second conducting surface for transferring the right audio input signal captured by the integrated right microphone from the right audio device to a memory;

a third conducting surface for transferring the left audio output signal from a memory to the integrated left speaker of the left earbud; and

a fourth conducting surface for transferring the right audio output signal from a memory to the integrated right speaker of the right earbud.

13. The headset of claim 12, wherein the connector plug further comprises:

a ground conducting surface for supplying a reference voltage relative to the signals on the first conducting surface, the second conducting surface, the third conducting surface, and the fourth conducting surface.

14. The headset of claim 12,

wherein the left earbud comprises a first membrane commonly used by the left microphone and the left speaker;

and

wherein the right earbud comprises a second membrane commonly used by the right microphone and the right speaker.

15. The headset of claim 12, wherein the connector plug further comprises an integrated sliding volume controller for controlling speaker output volume.

16. A method for recording and playing audio in a smart pen computing system, comprising:

recording, at the smart pen, a left audio input signal captured by a left microphone located proximate to a left ear, the left audio input signal received over a first conductor of a connector jack on the smart pen;

recording, at the smart pen, a right audio input signal captured by a right microphone located proximate to a right ear, the right audio input signal received over a second conductor of the connector jack on the smart pen;

capturing, with the smart pen, handwriting gestures concurrently with recording the left audio input signal and the right audio input signal;

synchronizing the recorded left audio signal and the recorded right audio signal with the captured handwriting gestures;

transmitting the recorded left audio signal over a third conductor of the connector jack on the smart pen to be played back on a left speaker, the left speaker sharing a first housing with the left microphone; and

transmitting the recorded right audio signal over a fourth conductor of the connector jack on the smart pen to be played back on a right speaker, the right speaker sharing a second housing with the right microphone.

17. The method of claim 16, further comprising:

processing the audio captured by the left microphone and the right microphone to adjust relative gain between a first audio source originating from a first direction and a second audio source originating from a second direction.

18. The method of claim 17, wherein processing the audio comprises adjusting the relative gain between the first audio source and the second audio source in real time and outputting processed audio to the left and right speakers.

19. The method of claim 17, further comprising:

retrieving an electronic representation of the captured handwriting gestures together with playing back the recorded audio.

20. The method of claim 17,

wherein the left speaker is positioned facing into the left ear and the left microphone is positioned facing away from the left ear;

and

wherein the right speaker is positioned facing into the right ear and the right microphone is positioned facing away from the right ear.

21. A smart pen device for capturing handwriting gestures and for recording and playing back audio, comprising:

a connector jack, comprising;

a first conductor for receiving a left audio input signal to be recorded by the smart pen device, the first conductor coupled to a left microphone located proximate to a left ear;

a second conductor for receiving a right audio input signal to be recorded by the smart pen device, the second conductor coupled to a right microphone located proximate to a right ear;

a third conductor for transmitting a left audio output signal being played back by the smart pen device, the third conductor coupled to a left speaker located proximate to the left microphone and the left ear; and

a fourth conductor for transmitting a right audio output signal being played back by the smart pen device, the fourth conductor coupled to a right speaker located proximate to the right microphone and the right ear;

wherein the smart pen device is configured to record the left audio input signal received over the first conductor and record the right audio input signal received over the second conductor, and to synchronize captured handwriting gestures in time with the left audio input signal and the right audio input signal.