METHOD AND SYSTEM FOR CREATING A VOICE RECOGNITION DATABASE FOR A MOBILE DEVICE USING IMAGE PROCESSING AND OPTICAL CHARACTER RECOGNITION

• US 20120183221A1
• Filed: 01/19/2011
• Published: 07/19/2012
• Est. Priority Date: 01/19/2011
• Status: Active Grant

• Current Assignee: DENSO Corporation, Denso International America Incorporated (DENSO Corporation)
• Original Assignee: DENSO Corporation, Denso International America Incorporated (DENSO Corporation)
• Inventors: Alasry, Bilal, Vang, Doua, Thomas, Bryan
• Granted Patent: US 8,996,386 B2
• Time in Patent Office: Days
• US Class Current: 382/181
• CPC Class Codes: G10L 15/06 Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice G10L15/14 takes precedence
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: H04M 1/271 controlled by voice recognition
• CPC Class Codes: H04M 1/6075 adapted for handsfree use in a vehicle H04M1/6058 takes precedence; arrangements for holding telephones in a vehicle B60R11/0241
• CPC Class Codes: H04M 1/724 User interfaces specially adapted for cordless or mobile telephones

Abstract

A method and system for controlling a mobile device from a head unit using voice control is disclosed. The head unit receives a graphical representation of a current user interface screen of the mobile device. The head unit than scans the graphical representation of the current user interface screen to determine the locations of potential input mechanisms. The potential input mechanisms are scanned using optical character recognition and voice commands are determined for the input mechanisms. The determined voice commands and their respective locations on the user interface screens are stored in a voice recognition database, which is queried with uttered voice commands during voice recognition.

Claims

1. A method for remotely operating a mobile device from a vehicle head-unit using voice recognition, the method comprising:

receiving a representation of a user interface screen of the mobile device from the mobile device;

scanning the representation of the user interface screen to find a representation of an input mechanism, wherein the input mechanism is used to provide a command to the mobile device;

scanning the representation of the input mechanisms to determine a voice recognition command; and

associating the voice recognition command with the input mechanism in a voice recognition database, wherein when a user utters the voice recognition command the head unit transmits a signal corresponding to the input mechanism to the mobile device.

2. The method of claim 1 further comprising displaying the representation of the user interface screen on a display of the head-unit.

3. The method of claim 1 wherein the scanning of the representation of the user interface screen comprises performing image processing on the representation of the user interface screen to determine locations of the input mechanisms on the representation of the user interface screen.

4. The method of claim 1 wherein scanning the representation of the input mechanism comprises performing optical character recognition on the representation of the input mechanism.

5. The method of claim 4 wherein the voice recognition command is based on a result of the optical character recognition performed on the representation of the input mechanism.

6. The method of claim 4 wherein an optical character recognition application is configured to recognize characters and predetermined symbols and to associate a word or phrase with the scanned input mechanism based on the recognized characters or predetermined symbols.

7. The method of claim 6 wherein the predetermined symbols are associated with predetermined words or phrases.

8. The method of claim 1 further comprising receiving a set of predetermined voice recognition commands from the mobile device and storing the set of predetermined voice recognition commands in the voice recognition database.

9. A head unit of a vehicle configured to remotely operate a mobile device using voice recognition, the head-unit comprising:

a communication module that receives a representation of a user interface screen of the mobile device from the mobile device;

an image scanning module that scans the representation of the user interface screen to find a representation of an input mechanism on the representation of the user interface screen, wherein the input mechanism is used to provide a command to the mobile device;

an character recognition module that scans the representation of the input mechanism found by the image scanning module to determine a voice recognition command, wherein the voice recognition command is determined based on at least one character or symbol identified by the character recognition module; and

a mobile device voice recognition database that stores the voice recognition command corresponding to the input mechanism found in the user interface screen, wherein when a user utters the voice recognition command the head unit transmits a signal corresponding to the input mechanism to the mobile device.

10. The head unit of claim 9 further comprising a display that displays the representation of the user interface screen of the mobile device.

11. The head unit of claim 9 wherein the image scanning module performs image recognition to determine locations of the input mechanisms on the user interface screen.

12. The head unit of claim 9 wherein the character recognition modules performs optical character recognition on the representation of the input mechanism.

13. The head unit of claim 12 wherein the voice recognition command determined by the character recognition module is based on a result of the optical character recognition preformed on the representation of the input mechanism.

14. The head unit of claim 12 wherein the character recognition module is configured to recognize characters and predetermined symbols and to associate a word or phrase with the scanned input mechanism based on the recognized characters or predetermined symbols.

15. The head unit of claim 14 wherein the predetermined symbols are associated with predetermined words or phrases.

16. The head unit of claim 9 wherein the communication receives a set of predetermined voice recognition commands from the mobile device, wherein the predetermined voice recognition commands are stored in the voice recognition database of the head unit.