Systems and methods using audio input with a mobile device

• US 9,996,315 B2
• Filed: 04/28/2015
• Issued: 06/12/2018
• Est. Priority Date: 05/23/2002
• Status: Active Grant

• Current Assignee: Gula Consulting Limited Liability Company (Intellectual Ventures LLC)
• Original Assignee: Gula Consulting Limited Liability Company (Intellectual Ventures LLC)
• Inventors: Barnes, Jr., Melvin L.
• Primary Examiner(s): King, Curtis
• Application Number:
  US14/697,856
• Publication Number:
  US 20150234636A1
• Time in Patent Office: 1,141 Days
• Field of Search: None
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/134 Hyperlinking
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06Q 10/02 Reservations, e.g. for tickets, services or events
• CPC Class Codes: G06Q 10/1053 Employment or hiring
• CPC Class Codes: G06Q 20/04 Payment circuits
• CPC Class Codes: G06Q 20/12 specially adapted for electronic shopping systems
• CPC Class Codes: G06Q 20/20 Point-of-sale [POS] network systems
• CPC Class Codes: G06Q 20/322 Aspects of commerce using mobile devices [M-devices]
• CPC Class Codes: G06Q 20/3224 Transactions dependent on location of M-devices
• CPC Class Codes: G06Q 20/325 using wireless networks
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0236 Incentive or reward received by requiring registration or ID from user
• CPC Class Codes: G06Q 30/0241 Advertisements
• CPC Class Codes: G06Q 30/0255 based on user history
• CPC Class Codes: G06Q 30/0259 based on store location
• CPC Class Codes: G06Q 30/0261 based on user location
• CPC Class Codes: G06Q 30/0267 Wireless devices
• CPC Class Codes: G06Q 30/0273 Determination of fees for advertising
• CPC Class Codes: G06Q 30/06 : Buying, selling or leasing transactions
• CPC Class Codes: G06Q 30/0601 : Electronic shopping [e-shopping]
• CPC Class Codes: G06Q 30/0639 : Item locations
• CPC Class Codes: G06Q 30/08 : Auctions
• CPC Class Codes: H04M 1/724 : User interfaces specially adapted for cordless or mobile telephones
• CPC Class Codes: H04W 4/02 : Services making use of location information
• CPC Class Codes: H04W 4/029 : Location-based management or tracking services

Abstract

Systems and methods of using audio input with a mobile device. A method comprises receiving content at a mobile device; annotating, at the mobile device, a selectable item of a user interface associated with the content with an annotation; receiving, at the mobile device, an audio input associated with the annotation; converting, at the mobile device, the audio input into a user interface command; and causing the mobile device to perform a function in response to the user interface command.

Claims

1. A method, comprising:

receiving content at a mobile device;

annotating, by the mobile device, a selectable item of a user interface associated with the content so that the selectable item is displayed with an annotation;

receiving, at the mobile device, an audio input prompted by the annotation;

converting, at the mobile device, the audio input into a user interface command; and

causing the mobile device to perform a function in response to the user interface command;

wherein annotating, by the mobile device, the selectable item comprises;

annotating selectable items having text that is identical such that the text of the selectable items are different from each other; and

displaying alternate text associated with the selectable item, wherein the alternate text is text that the content indicates is displayed as an alternative to displaying the selectable item.

2. The method according to claim 1, wherein the selectable item is a hyperlink.

3. The method according to claim 1, wherein the function comprises selecting the selectable item.

4. The method according to claim 3, wherein the function comprises changing a selection from the selected selectable item to a different selectable item of the user interface.

5. The method according to claim 1, wherein the function comprises activating the selectable item.

6. The method according to claim 1, wherein the selectable item includes at least one of form fields, pull down menus, scroll boxes, text boxes, form buttons, radio buttons, and check boxes.

7. The method according to claim 1, wherein annotating, at the mobile device, the selectable item comprises changing a text of the selectable item to be different from corresponding text in the content.

8. The method according to claim 1, wherein annotating, at the mobile device, the selectable item comprises displaying an overlay associated with the selectable item.

9. The method of claim 1, wherein the alternate text includes text of an image tag within the content.

10. The method according to claim 1, further comprising:

converting, at the mobile device, audio input into first text; and

comparing, at the mobile device, the first text to second text associated with the selectable item.

11. A mobile device comprising:

a user interface;

a communication module; and

a processor coupled to the user interface and the communication module, and configured to;

receive content;

annotate a selectable item of a user interface associated with the content with an annotation, wherein selectable items having text that is identical are annotated such that the text of the selectable items are different from each other;

receive an audio input associated with the annotation;

convert the audio input into a user interface command associated with a selectable item of the user interface;

perform a function in response to the user interface command; and

cause the user interface to display alternate text associated with the selectable item, wherein the alternate text is text that the content indicates is displayed as an alternative to displaying the selectable item.

12. The mobile device according to claim 11, wherein the function comprises selecting the selectable item.

13. The mobile device according to claim 12, wherein the function comprises changing a selection from the selected selectable item to a different selectable item of the user interface.

14. The mobile device according to claim 11, wherein the function comprises activating the selectable item.

15. The mobile device according to claim 11, wherein the processor is further configured to change a text of the selectable item.

16. The mobile device according to claim 11, wherein the processor is further configured to cause the user interface to display an overlay associated with the selectable item.

17. A method, comprising:

displaying, at a mobile device, a web page with a hyperlink;

modifying, at the mobile device, text associated with the hyperlink;

receiving, at the mobile device, a first audio input;

converting, at the mobile device, the first audio input into a first user interface command associated with the hyperlink;

annotating, at the mobile device, the hyperlink with highlighting in response to the first user interface command, wherein annotating, by the mobile device, the hyperlink comprises;

annotating hyperlinks having text that is identical such that the text of the annotated hyperlinks are different from each other; and

displaying alternate text associated with the hyperlink, wherein the alternate text is text that the web page indicates is displayed as an alternative to displaying the hyperlink;

receiving, at the mobile device, a second audio input;

converting, at the mobile device, the second audio input into a second user interface command associated with the hyperlink; and

selecting, at the mobile device, the hyperlink in response to the second user interface command.