Method and system for creating a voice recognition database for a mobile device using image processing and optical character recognition

• US 8,996,386 B2
• Filed: 01/19/2011
• Issued: 03/31/2015
• Est. Priority Date: 01/19/2011
• Status: Active Grant

• Current Assignee: DENSO Corporation, Denso International America Incorporated (DENSO Corporation)
• Original Assignee: DENSO Corporation, Denso International America Incorporated (DENSO Corporation)
• Inventors: Alasry, Bilal, Vang, Doua, Thomas, Bryan
• Primary Examiner(s): Shah, Paras D
• Application Number:
  US13/009,101
• Publication Number:
  US 20120183221A1
• Time in Patent Office: 1,532 Days
• Field of Search: 704/231, 704/235, 704/251, 704/275, 704/270, 701/1, 701/533, 345/1.1, 345/2.1, 345/7, 345/8, 345/156
• US Class Current: 704/275
• CPC Class Codes: G10L 15/06 Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice G10L15/14 takes precedence
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: H04M 1/271 controlled by voice recognition
• CPC Class Codes: H04M 1/6075 adapted for handsfree use in a vehicle H04M1/6058 takes precedence; arrangements for holding telephones in a vehicle B60R11/0241
• CPC Class Codes: H04M 1/724 User interfaces specially adapted for cordless or mobile telephones

Abstract

A method and system for controlling a mobile device from a head unit using voice control is disclosed. The head unit receives a graphical representation of a current user interface screen of the mobile device. The head unit than scans the graphical representation of the current user interface screen to determine the locations of potential input mechanisms. The potential input mechanisms are scanned using optical character recognition and voice commands are determined for the input mechanisms. The determined voice commands and their respective locations on the user interface screens are stored in a voice recognition database, which is queried with uttered voice commands during voice recognition.

Claims

1. A method for remotely operating a mobile device from a vehicle head-unit using voice recognition, the method comprising:

receiving a representation of a user interface screen of the mobile device from the mobile device, the user interface screen including an input button which provides a command to the mobile device when the input button is directly engaged by a user;

scanning the representation of the user interface screen to find a representation of the input button;

scanning the representation of the input button;

determining if the input button is associated with a current voice recognition command;

creating an assigned voice recognition command based upon the scanning of the representation of the input button only when the input button is not associated with the current voice recognition command; and

associating the assigned voice recognition command with the input button in a voice recognition database, wherein when a user utters the assigned voice recognition command the head unit transmits a signal corresponding to the input button to the mobile device.

2. The method of claim 1 further comprising displaying the representation of the user interface screen on a display of the head-unit.

3. The method of claim 1 wherein the scanning of the representation of the user interface screen comprises performing image processing on the representation of the user interface screen to determine a location of the input button on the representation of the user interface screen.

4. The method of claim 1 wherein scanning the representation of the input button comprises performing optical character recognition on the representation of the input button.

5. The method of claim 4 wherein the creation of the voice recognition command is based on a result of the optical character recognition performed on the representation of the input button.

6. The method of claim 4 wherein an optical character recognition application is configured to recognize characters and predetermined symbols and creating the assigned voice recognition associates a word or phrase with the scanned input button based on the recognized characters or predetermined symbols.

7. The method of claim 6 wherein the predetermined symbols are associated with predetermined words or phrases.

8. The method of claim 1 further comprising receiving a set of predetermined voice recognition commands from the mobile device and storing the set of predetermined voice recognition commands in the voice recognition database.

9. A head unit of a vehicle configured to remotely operate a mobile device using voice recognition, the head-unit comprising:

a head unit voice recognition database that stores a head-unit voice recognition command corresponding to an input mechanism found only in the head unit, wherein when a user utters the head-unit voice recognition command, the head unit transmits a signal corresponding to the input button found only in the head unit;

a communication module that receives a representation of a user interface screen of the mobile device from the mobile device, the user interface screen including an input button which provides a command to the mobile device when the input button is directly engaged by the user;

an image scanning module that scans the representation of the user interface screen to find a representation of the input mechanism found only on the representation of the user interface screen, wherein the input button;

a character recognition module that scans the representation of the input button found by the image scanning module to determine a mobile device voice recognition command, wherein the mobile device voice recognition command is determined based on at least one character or symbol identified by the character recognition module; and

a mobile device voice recognition database that stores the mobile device voice recognition command corresponding to the input button found only in the user interface screen, wherein when the user utters the mobile device voice recognition command the head unit transmits a signal corresponding to the input button to the mobile device.

10. The head unit of claim 9 further comprising a display that displays the representation of the user interface screen of the mobile device.

11. The head unit of claim 9 wherein the image scanning module performs image recognition to determine a location of the input button on the user interface screen.

12. The head unit of claim 9 wherein the character recognition modules performs optical character recognition on the representation of the input button.

13. The head unit of claim 12 wherein the mobile device voice recognition command determined by the character recognition module is based on a result of the optical character recognition preformed on the representation of the input button.

14. The head unit of claim 12 wherein the character recognition module is configured to recognize characters and predetermined symbols and to associate a word or phrase with the scanned input button based on the recognized characters or predetermined symbols.

15. The head unit of claim 14 wherein the predetermined symbols are associated with predetermined words or phrases.

16. The head unit of claim 9 wherein the communication receives a set of predetermined mobile device voice recognition commands from the mobile device, wherein the predetermined mobile device voice recognition commands are stored in the mobile device voice recognition database of the head unit.