Apparatus for communicating with a vehicle during remote vehicle operations, program product, and associated methods

• US 20060190097A1
• Filed: 03/16/2006
• Published: 08/24/2006
• Est. Priority Date: 10/01/2001
• Status: Abandoned Application

• Current Assignee: Advanced Public Safety Incorporated (Trimble Inc.)
• Original Assignee: Trimble Navigation Limited (Trimble Inc.)
• Inventors: Rubenstein, Jeffrey D.
• Application Number:
  US11/376,676
• Publication Number:
  US 20060190097A1
• Time in Patent Office: Days
• US Class Current: 700/17
• CPC Class Codes: B60R 16/0373 Voice control in general G10L
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/221 Announcement of recognition results
• CPC Class Codes: G10L 2021/02166 Microphone arrays; Beamforming

Abstract

An apparatus to enhance command communication in a high-noise environment between a user and user vehicle mobile data computer system, program product, and associated methods are provided. The apparatus includes a vehicle computer adapted to be positioned within a user vehicle and a vehicle computer application program stored in memory of the vehicle computer adapted to communicate with a remote host computer. A voice command interface program product is also stored in the memory and is in communication with the mobile data communications application program. The voice command interface program product is adapted to receive as audio input, through an audio input device, a voice command from the user representing a command input, identify the voice command by analyzing the received audio input, echo the identified voice command through an audio speaker, and transmit the command input to the vehicle computer application program, the echo including a preselected audio message verbally representing the identified voice command.

Claims

1. An apparatus to enhance command communication in a high-noise environment between a user and user vehicle mobile data computer system, the apparatus comprising:

a vehicle computer adapted to be positioned within a user vehicle and having memory to store data therein to define a mobile data computer adapted to communicate with a remote host computer and in communication with at least one audio speaker and at least one audio input device;

a mobile data communications application program stored in the memory of the mobile data computer adapted to communicate with the remote host computer through the mobile data computer and to transmit and receive data through the remote host computer; and

a voice command interface program product stored in the memory of the mobile data computer and in communication with the mobile data communications application program to enhance user communication with the remote host computer through the mobile data computer, the voice command interface program product including instructions to perform the operations of receiving as audio input through the at least one audio input device a voice command from the user representing a command input, identifying the voice command by analyzing the received audio input, echoing the identified voice command through the at least one audio speaker, and transmitting the command input to the mobile data communications application program, the echo including a preselected audio message verbally representing the identified voice command.

2. An apparatus as defined in claim 1, wherein the voice command interface program product further includes instructions to perform the operation of transmitting audio data associated with the identified voice command through the at least one audio speaker, the audio data comprising a representation of the identified voice command in prerecorded human voice.

3. An apparatus as defined in claim 1,

wherein the received audio input includes a plurality of voice commands representing a corresponding plurality of command inputs;

and

wherein the voice command interface program product further includes instructions, responsive to a preselected time delay, to perform the operation of at least one of the following;

disabling receiving audio input from the audio input device, and disabling transmitting the plurality of command inputs to the mobile data communications application program.

4. An apparatus as defined in claim 1, wherein the voice command interface program product includes instructions, responsive to a preselected time-delay, to perform the operations of rejecting received audio input as being a command from the user, and resetting to receive a command from the user.

5. An apparatus as defined in claim 1,

wherein the received audio input includes a plurality of voice commands;

wherein the mobile data computer includes a mobile data input device having a plurality of control function selectors; and

wherein the apparatus further comprises an initializer accessible by the voice command interface program product and configured to assign a plurality of command terms or phrases defining the plurality of voice commands to a corresponding plurality of mobile data computer input device command inputs for the mobile data communication program, and to assign to each of a subset of the plurality of voice commands prerecorded audio output data to echo the respective voice commands.

6. An apparatus as defined in claim 1,

wherein the received audio input includes a plurality of voice commands representing a corresponding plurality of command inputs, continuous and repetitive noise, and noise caused by reverberation of the plurality of voice commands from adjacent vehicle structures;

wherein the at least one audio input device comprises an array microphone adapted to be connected to a vehicle structure separate and spaced apart from the user when receiving audio input from the user and having at least two separate and spaced apart unidirectional microphone transducers with individual audio channels adapted to provide a directional area of audio input sensitivity having an angle and area of reception, to thereby enhance detection of the plurality of voice commands and to thereby provide the plurality of voice commands from the user to the mobile data communications application program through the voice command interface program product; and

audio input processing program product adapted to interface with the array microphone and adapted to provide instructions to perform the operations of attenuating continuous and repetitive noise to thereby remove voice command recognition latency, and adjusting the area of reception of the audio input to the microphone array to substantially reduce reverberation noise to thereby enhance reception of the plurality of voice commands.

7. An apparatus as defined in claim 6, wherein the array microphone includes four separate and spaced apart unidirectional microphone transducers adapted to be positioned to focus on a voice of the user, wherein the array microphone includes a digital signal processor having memory, wherein the audio input processing program product is positioned in the memory of the digital signal processor, wherein the array microphone provides a differential of at least 25 dB at a frequency of 1 kHz between a voice frequency response measured within the area of reception and a background noise response measured outside the area of reception, and wherein the audio input processing program product is adapted, responsive to detection of audio input from the user, to adjust the angle of reception to focus the area of reception on the voice of the user.

8. An apparatus as defined in claim 1,

wherein the received audio input includes a plurality of voice commands representing a corresponding plurality of command inputs;

and

wherein the at least one audio input device comprises a wireless microphone assembly including a microphone and audio speaker adapted to provide wireless audio communication between the mobile data computer and the user when outside the law enforcement vehicle to transmit the plurality of voice commands from the user to the mobile data communications application program through the voice command interface program product, to thereby provide command input to the mobile data communications application program, and to receive an audio echo for each of a subset of the plurality of voice commands, to thereby provide the user verification of correct identification of each respective voice command echoed by the voice command interface program product.

9. A computer readable medium that is readable by a vehicle mobile data computer to enhance command communication in a high-noise environment between a user and a vehicle mobile data computer application program, the computer readable medium comprising a set of instructions that, when executed by the vehicle mobile data computer, cause the vehicle mobile data computer to perform the following operations:

extracting data from an initializer configured to assign a plurality of user-specific voice command terms or phrases defining a plurality of vehicle mobile data computer application program voice commands each to a corresponding vehicle mobile data computer input device command input for the vehicle mobile data computer application program;

assigning the plurality of vehicle mobile data computer application program voice commands, responsive to the extracted data, to corresponding vehicle mobile data keyboard key command inputs to interface with the vehicle mobile data computer application program, the voice commands specifically labeled for quick recognition and ease of recall by the user;

receiving audio input through an audio input device when in a high noise environment; and

performing an acoustic description comparison on the received audio input to thereby identify a preselected set of voice commands consisting essentially of;

voice command terms assigned in the initializer, members of a phonetic alphabet associated to the initializer to provide command input of a plurality of letters each corresponding to separate keyboard key input, and a plurality of numbers each corresponding to a separate numerical keyboard key input, to identify each respective voice command to thereby execute an associated vehicle mobile data computer application program command input, the preselected set of voice commands being specifically limited in number to reduce computer processor utilization requirements when performing the acoustic description comparison and to enhance voice command recognition probability.

10. A computer readable medium that is readable by a vehicle mobile data computer to enhance command communication in a high-noise environment between a user and a vehicle mobile data computer application program, the computer readable medium comprising a set of instructions that, when executed by the vehicle mobile data computer, cause the vehicle mobile data computer to perform the following operations:

receiving from the user through an audio input device as audio input a voice command representing a vehicle mobile data computer application program command input;

identifying the voice command by analyzing the received audio input;

echoing the identified voice command through an audio speaker, responsive to identification of the voice command, the echo including preselected audio data associated with the identified voice command and comprising a representation of the identified voice command in prerecorded human voice verbalizing the representation of the identified voice command; and

transmitting the corresponding command input to the vehicle mobile data computer application program.

11. A computer readable medium as defined in claim 10, further comprising a set of instructions that, when executed by the vehicle mobile data computer, cause the vehicle mobile data computer to perform the following operations:

extracting data from an initializer configured to assign a plurality of user-specific voice command terms or phrases defining a plurality of vehicle mobile data computer application program voice commands to a corresponding vehicle mobile data computer input device command input for the vehicle mobile data computer application program; and

assigning the plurality of vehicle mobile data computer application voice commands, responsive to the extracted data, to corresponding vehicle mobile data keyboard key command inputs to thereby interface with the vehicle mobile data computer application program.

12. A computer readable medium that is readable by a vehicle mobile data computer to enhance command communication in a high-noise environment between a user and a vehicle mobile data computer application program, the computer readable medium comprising a set of instructions that, when executed by the vehicle mobile data computer, cause the vehicle mobile data computer to perform the following operations:

receiving through an audio input device audio input including a plurality of voice commands from the user;

transmitting to the vehicle mobile data computer application program the plurality of voice commands from the user received as audio input; and

disabling, responsive to a preselected time delay, transmitting the plurality of voice commands to the vehicle mobile data communications application program.

13. A computer readable medium that is readable by a vehicle mobile data computer to enhance command communication in a high-noise environment between a user and a vehicle mobile data computer application program, the computer readable medium comprising a set of instructions that, when executed by the vehicle mobile data computer, cause the vehicle mobile data computer to perform the following operations:

receiving an audio input through an audio input device;

analyzing the received audio input to determine if the audio input includes a voice command from the user;

rejecting, responsive to a preselected time-out, the received audio input as including a voice command from the user; and

awaiting receipt of a voice command from the user, responsive to the time-out.

14. A method of enhancing command communication in a high-noise environment between a user and a user vehicle mobile data computer, the method comprising the steps of:

providing a voice command interface program product adapted to interface with a vehicle mobile data computer having a vehicle mobile data computer application program requiring command input, the voice command interface program product providing vehicle mobile data computer input device emulation; and

providing an initializer accessible by the voice command interface program product and configured to assign a plurality of user-tailored voice command terms or phrases defining a plurality of vehicle mobile data computer application program voice commands to a corresponding plurality of vehicle mobile data computer input device command inputs for the vehicle mobile data computer application program.

15. A method as defined in claim 14, the method further comprising the steps of:

providing a plurality of phonetic alphabet data sets, at least one selected to interface with the initializer and adapted to be accessible by the voice command interface program product, to thereby provide command input of a plurality of letters corresponding to a plurality of vehicle mobile data computer input device inputs for the vehicle mobile data computer application program.

16. A method of enhancing command communication in a high noise environment between a user and a user vehicle mobile data computer, the method comprising the steps of:

receiving by the user vehicle mobile data computer from a user accessible web site through an area network a single self-extracting executable program including a voice command interface program product adapted to interface with a user vehicle mobile data computer positioned in a user vehicle having at least one vehicle mobile data computer application program requiring command input, the voice command interface program product adapted, responsive to audio input including a plurality of voice commands provided through an audio input device in communication with the user vehicle mobile data computer, to provide vehicle mobile data computer input device emulation for the at least one vehicle mobile data computer application program;

executing the self-extracting executable program, to thereby install each of a plurality of voice command interface program product components of the voice command interface program product in memory of the vehicle mobile data computer; and

assigning a plurality of user-tailored vehicle mobile data computer application voice commands each to a corresponding keyboard key command input to interface audio input from the audio input device with the at least one vehicle mobile data computer application program, to thereby provide command input, responsive to the plurality of voice commands, to the at least one vehicle mobile data computer application program.

17. A method as defined in claim 16,

wherein the assigning step is provided through use of an initializer configured to assign a plurality of user-tailored voice command terms to the corresponding keyboard key command inputs, the voice command terms custom labeled for quick recognition and ease of recall by the user;

and

wherein the method further comprises the step of performing an acoustic description comparison when in a high noise environment on received audio input to thereby identify a preselected set of only the following voice commands;

voice command terms assigned in the initializer, members of a phonetic alphabet associated to the initializer to provide command input of a plurality of letters each corresponding to a separate keyboard key input, and a plurality of numbers each corresponding to a separate numerical keyboard key input, to identify each voice command to thereby execute an associated vehicle mobile data computer application program command input, the preselected set of voice commands being specifically limited in number to reduce computer processor utilization requirements when performing the acoustic description comparison and to enhance voice command recognition probability.

18. A method of enhancing command communication in a high-noise environment between a user and a user vehicle mobile data computer system, the method comprising the steps of:

receiving as audio input a voice command from the user through an audio input device, the voice command representing a corresponding command input for a vehicle mobile data computer application program;

identifying the voice command by analyzing the received audio input;

echoing the identified voice command through an audio speaker, the echo including a preselected audio message prerecorded in human voice verbally repeating the voice command; and

transmitting the corresponding command input to the vehicle mobile data computer application program.

19. A method as defined in claim 18,

wherein the received audio input includes a plurality of voice commands representing a corresponding plurality of command inputs;

wherein the audio input device is adapted to be carried by the user when positioned outside the user vehicle, to thereby transmit the plurality of voice commands from the user to a receiver connected to the user vehicle when positioned outside the user vehicle; and

wherein the method further comprises the steps of;

transmitting through the audio input device the plurality of voice commands from the user when outside the user vehicle to the at least one vehicle mobile data computer application program through the voice command interface program product, to thereby provide command input to the vehicle mobile data computer application program, and

receiving through an audio output device also carried by the user when outside the user vehicle an audio echo of the plurality of voice commands, to thereby provide the user verification of correct receipt of each command input.

20. A method as defined in claim 18, the method further comprising the steps of:

forming a log file to log each attempt at recognizing an audio input;

logging in the log file, responsive to receiving the respective audio input, each attempt at recognizing each respective audio input;

requesting the log file from the user; and

performing a statistical analysis on the log file to analyze recognition failure rates, to thereby enhance development of improved process steps.

21. A method of enhancing command communication in a high noise environment between a user and a user vehicle mobile data computer system, the method comprising the steps of:

receiving through an audio input device audio input including a plurality of voice commands from the user;

transmitting to a user vehicle mobile data computer application program the plurality of voice commands from the user received as audio input; and

disabling, responsive to a preselected time delay, transmitting the plurality of voice commands to the vehicle mobile data computer application program.

22. A method of enhancing command communication in a high noise environment between a user and a user vehicle mobile data computer system, the method comprising the steps of:

receiving an audio input through an audio input device;

analyzing the received audio input to determine if the audio input is a voice command representing a command input from the user to a vehicle mobile data computer application program;

rejecting, responsive to a preselected time-out, the received audio input as being a command input from the user; and

awaiting receipt of a command input from the user substantially without delay, responsive to the time-out.

23. A method as defined in claim 22, wherein the preselected time-out is selected to be less than three seconds in duration.