Method and Device for Virtual Navigation and Voice Processing

• US 20080252595A1
• Filed: 04/08/2008
• Published: 10/16/2008
• Est. Priority Date: 04/11/2007
• Status: Abandoned Application

• Current Assignee: Navisense
• Original Assignee: Navisense
• Inventors: Boillot, Marc
• Application Number:
  US12/099,662
• Publication Number:
  US 20080252595A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

An apparatus for virtual navigation and voice processing is provided. A system that incorporates teachings of the present disclosure may include, for example, a computer readable storage medium having computer instructions for processing voice signals captured from a microphone array, detecting a location of an object in a touchless sensory field of the microphone array, and receiving information from a user interface in accordance with the location and voice signals.

Claims

1. A microphone array device, comprising:

at least two microphones; and

a controller element communicatively coupled to the at least two microphones to

track a finger movement in a touchless sensory field of the at least two microphones;

process a voice signal associated with the finger movement; and

communicate a first control of a user interface responsive to the finger movement and a second control of the user interface responsive to the voice signal.

2. The microphone array device of claim 1, wherein the controller element

associates the finger movement with a component in the user interface, and

informs the user interface to present information associated with component in response to the voice signal,

where the information is audible, visual, or tactile feedback.

4. The microphone array device of claim 1, wherein the controller element

identifies a location of the finger in the touchless sensory field, and

in response to recognizing the voice signal, generates a user interface command associated with the location.

5. The microphone array device of claim 1, wherein the controller element

identifies a location or movement of the finger in the touchless sensory field,

associates the location or movement with at least one control of the user interface,

acquires the at least one control in response to a first voice signal,

adjusts the at least one control in accordance with a second finger movement, and

releases the at least one control in response to a second voice signal.

6. The microphone array device of claim 1, wherein the controller element

identifies a location or movement of a finger in the touchless sensory field,

acquires a control of the user interface according to the location or movement,

adjusts the control in accordance with a voice signal, and

releases the control in responsive to identifying a second location or movement of the finger.

7. The microphone array device of claim 6, wherein the voice signal increases the control, decreases the control, cancels the control, selects an item, de-selects the item, copies the item, pastes the item, or moves the item.

8. The microphone array device of claim 7, wherein the voice signal is an ‘

accept’

, ‘

reject’

, ‘

yes’

, ‘

no’

, ‘

cancel’

, ‘

back’

, ‘

next, ‘

increase’

, ‘

decrease’

, ‘

up’

, ‘

down’

, ‘

stop’

, ‘

play’

, ‘

pause’

, ‘

copy’

, ‘

cut’

, or ‘

paste’

.

9. The microphone array device of claim 1, wherein the microphone array comprises at least one transmitting element that transmits an ultrasonic signal, and the controller element identifies the finger movement from a relative phase and time of flight of a reflection of the ultrasonic pulse off the finger.

3. The microphone array device of claim 3, wherein the information is an advertisement, a search result, a multimedia selection, an address, or a contact.

10. A storage medium, comprising computer instructions for:

tracking a finger movement in a touchless sensory field of a microphone array;

processing a voice signal received at the microphone array associated with the finger movement; and

navigating a user interface in accordance with the finger movement and the voice signal;

presenting information in the user interface according to the finger movement and the voice signal.

11. The storage medium of claim 10, comprising computer instructions for

detecting a direction of the voice signal;

and

adjusting a directional sensitivity of the microphone array with respect to the direction.

12. The storage medium of claim 10, comprising computer instructions for

detecting a finger movement in the touchless sensory field;

and

controlling at least one component of the user interface in accordance with the finger movement and the voice signal.

13. The storage medium of claim 10, comprising computer instructions for activating a component of the user interface selected by the finger movement, and adjusting the component in response to a voice signal.

14. The storage medium of claim 10, comprising computer instructions for overlaying a pointer in the user interface, controlling a movement of the pointer in accordance with finger movements, and presenting the information when the pointer is over an item in the display.

15. The storage medium of claim 10, comprising computer instructions for overlaying information on the user interface when the finger is at a location in the touchless sensory space that is mapped to a component in the user interface.

16. A sensing unit, comprising

a transmitter to transmit ultrasonic signals for creating a touchless sensing field;

a microphone array to capture voice signals and reflected ultrasonic signals, and

a controller operatively coupled to the transmitter and microphone array to

process the voice signals and ultrasonic signals, and

adjust at least one user interface control according to the voice signals and reflected ultrasonic signals.

17. The sensing unit of claim 16, wherein the controller element identifies a location of an object in the touchless sensory field, and adjusts a directional sensitivity of the microphone array to the location of the object.

18. The sensing unit of claim 16, wherein the controller element

identifies a location of a finger in the touchless sensory field,

maps the location to a sound source, and

suppresses or amplifies acoustic signals from the sound source that are received at the microphone array.

19. The sensing unit of claim 17, wherein the controller determines from the location when the sensing unit is hand-held for speaker-phone mode and when the sensing unit is held in an ear-piece mode.

20. The sensing unit of claim 17 is communicatively coupled to a cell phone, a headset, a portable music player, a laptop, or a computer.