Methods and apparatus to convert received graphical and/or textual user commands into voice commands for application control

• US 9,368,119 B2
• Filed: 03/25/2014
• Issued: 06/14/2016
• Est. Priority Date: 03/25/2014
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Hrabak, Robert A.
• Primary Examiner(s): ALBERTALLI, BRIAN LOUIS
• Application Number:
  US14/225,238
• Publication Number:
  US 20150279367A1
• Time in Patent Office: 812 Days
• US Class Current: 1/1
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 21/10 Transforming into visible information

Abstract

A method for transmitting communications from a vehicle onboard computer system is provided. The method receives a graphical user command via a user interface; converts the user command into a voice instruction; and transmits the voice instruction to an electronic device, using machine-to-machine (M2M) communication.

Claims

1. A method for transmitting communications from a vehicle onboard computer system, the method comprising:

establishing a communication link to an electronic device comprising at least one software application;

receiving a listing of applicable commands for the electronic device, via the communication link, the listing of applicable commands comprising control commands for the at least one software application;

constructing a menu comprising the listing of applicable commands;

displaying the menu on a user interface of the vehicle onboard computer system;

receiving a graphical user command via the menu of the user interface, the graphical user command comprising a user selection of at least one of the listing of applicable commands;

converting the graphical user command into a voice instruction; and

transmitting the voice instruction to the electronic device, using machine-to-machine (M2M) communication.

2. The method of claim 1, further comprising:

activating a voice recognition (VR) capability of the electronic device, prior to transmitting the voice instruction.

3. The method of claim 1, further comprising:

after transmitting the voice instruction to the electronic device,

receiving data in response to the voice instruction; and

performing an operation based on the received data.

4. The method of claim 1, further comprising:

obtaining a plurality of graphical elements from the electronic device; and

displaying the plurality of graphical elements on the user interface, the menu comprising the plurality of graphical elements, and the plurality of graphical elements representative of the listing of applicable commands;

wherein the graphical user command is received via the plurality of graphical elements.

5. The method of claim 4, further comprising:

receiving a plurality of selections via the plurality of graphical elements displayed on the user interface; and

creating the graphical user command based on the plurality of selections.

6. The method of claim 1, wherein the graphical user command comprises an instruction to activate the at least one software application resident on the electronic device.

7. The method of claim 6, wherein the graphical user command comprises a second instruction to perform an operation using the activated at least one software application.

8. A system onboard a vehicle for performing machine to machine communication, the system comprising:

an electronic device, configured to activate and operate a plurality of software applications, wherein the software applications reside on the electronic device; and

an onboard computer system, communicatively coupled to the electronic device, the onboard computer system comprising;

an application counterpart module, configured to;

receive data associated with the plurality of software applications from the electronic device; and

generate a graphical interface for user interaction with the plurality of software applications residing on the electronic device;

a user interface, configured to;

display the graphical interface; and

receive, via the graphical interface, a user input instruction associated with control of at least one of the plurality of software applications resident on the electronic device;

a command conversion module, configured to convert the received user input instruction into a speech command compatible with voice recognition technology; and

a communication module, configured to transmit the speech command to the electronic device for execution by the electronic device.

9. The system of claim 8, wherein the electronic device is configured to:

receive the transmitted speech command;

interpret the speech command, utilizing a speech recognition algorithm;

execute the interpreted speech command; and

transmit data resulting from the executed speech command.

10. The system of claim 9, wherein the onboard computer system further comprises an application counterpart module, configured to:

receive the transmitted data resulting from the executed speech command; and

present output based on the transmitted data.

11. The system of claim 8, wherein the user interface is further configured to:

obtain a plurality of graphical elements from the communicatively coupled electronic device;

display the plurality of graphical elements; and

receive the user input via the plurality of graphical elements.

12. The system of claim 8, wherein the user input instruction comprises a command to activate one of the plurality of applications resident on the electronic device.

13. The system of claim 12, wherein the user input comprises a second command to perform an operation using the activated one of the plurality of applications resident on the electronic device.

14. The system of claim 8, wherein the communication module is further configured to activate a speech-recognition capability of the electronic device, prior to transmitting the speech command.

15. A non-transitory, computer-readable medium for a vehicle onboard computer system containing instructions thereon, which, when executed by a processor, perform a method comprising:

establishing a communication link between the vehicle onboard computer system and an electronic device comprising at least one software application;

receiving, by the vehicle onboard computer system via the communication link, a plurality of control commands for the at least one software application;

presenting, by a user interface of the vehicle onboard computer system, a plurality of graphical elements associated with the plurality of control commands;

receiving a graphical user command via the plurality of graphical elements of the user interface, the graphical user command comprising a user selection of at least one of the plurality of control commands;

translating the graphical user instruction into a form compatible with voice recognition (VR) technology, to obtain a VR instruction; and

transmitting the VR instruction, via machine-to-machine (M2M) communication, to an VR-enabled electronic device, the electronic device comprising the VR-enabled electronic device.

16. The non-transitory, computer-readable medium of claim 15, wherein the method further comprises:

after transmitting the VR instruction,

receiving result data from the VR-enabled electronic device; and

presenting the result data.

17. The non-transitory, computer-readable medium of claim 15, wherein the method further comprises:

before translating the graphical user instruction,

receiving a plurality of graphical elements from the VR-enabled electronic device;

presenting the plurality of graphical elements to a user, via a user interface; and

receiving the graphical user instruction via the plurality of graphical elements.

18. The non-transitory, computer-readable medium of claim 17, wherein the method further comprises:

presenting menu options to the user;

receiving a plurality of selections of the menu options via the plurality of graphical elements; and

creating the VR instruction based on the plurality of selections.

19. The non-transitory, computer-readable medium of claim 15, wherein the user instruction comprises:

a first command to execute a software application on the VR-enabled electronic device, the at least one software application comprising the software application; and

a second command to perform a particular operation using the executed software application.