Systems, devices and methods for list display and management

• US 8,880,397 B2
• Filed: 10/21/2011
• Issued: 11/04/2014
• Est. Priority Date: 10/21/2011
• Status: Active Grant

• Current Assignee: Walmart Apollo, LLC (WalMart Inc.)
• Original Assignee: Wal Mart Stores Inc (WalMart Inc.)
• Inventors: Almaer, Dion, Cousineau, Bernard Paul, Galbraith, Ben
• Primary Examiner(s): GUERRA-ERAZO, EDGAR X
• Application Number:
  US13/278,977
• Publication Number:
  US 20130103397A1
• Time in Patent Office: 1,110 Days
• Field of Search: 704/9, 704/10, 704/201, 704/235, 704/243, 704/246, 704/251, 704/270, 704/270.1, 704/275, 704/276
• US Class Current: 704/235
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G10L 15/1822 Parsing for meaning understanding
• CPC Class Codes: G10L 15/197 Probabilistic grammars, e.g. word n-grams
• CPC Class Codes: G10L 15/20 Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech G10L21/02 takes precedence
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/225 Feedback of the input speech

Abstract

Exemplary embodiments provide systems, devices and methods that allow creation and management of lists of items in an integrated manner on an interactive graphical user interface. A user may speak a plurality of list items in a natural unbroken manner to provide an audio input stream into an audio input device. Exemplary embodiments may automatically process the audio input stream to convert the stream into a text output, and may process the text output into one or more n-grams that may be used as list items to populate a list on a user interface.

Claims

1. A computer-implemented method for allowing creation and management of a list on a mobile computing device, the method comprising:

rendering a user interface on a display device of the mobile computing device;

receiving user input from a user for creating a list;

receiving an audio input stream from the user at an audio input device of the mobile computing device, the audio input stream including a sequence of a plurality of list items spoken by the user;

in response to receipt of the audio input stream at the audio input device, calling a speech processing engine from the user interface to process the audio input stream into input text and to parse the input text into one or more n-grams;

rendering representations of the one or more n-grams on the user interface to allow the user to accept, reject and/or edit the one or more n-grams for representation in the form of a list; and

in response to user input accepting the one or n-grams, rendering a list on the user interface in which each n-gram is represented as a separate list item.

2. The method of claim 1, further comprising:

automatically determining one or more product items corresponding to a list item;

allowing the user to select at least one of the one or more product items using the user interface; and

in response to user selection of at least one of the one or more product items, rendering representations of the at least one of the one or more selected product items on the user interface.

3. The method of claim 2, further comprising:

providing information on a product item on the user interface, the information including one of a price of the product item, a brand name of the product item, and a review of the product item, a rating of the product item.

4. The method of claim 2, wherein the automatic determining of the one or more product items is based on one or more prior product item selections made by the user.

5. The method of claim 2, wherein the automatic determining of the one or more product items is based on one or more products available at a store location corresponding to the user and/or a store location corresponding to a location of the user.

6. The method of claim 1, further comprising:

receiving user input at the user interface to merge representations of two or more selected list items into a representation of a merged list item; and

in response to the user input to merge the representations, updating the list rendered on the user interface to remove representations of the two or more selected list items and to include the representation of the merged list item.

7. The method of claim 1, further comprising:

receiving user input at the user interface to split a representation of a selected list item into representations of two or more split list items; and

in response to the user input to split the representation, updating the list rendered on the user interface to remove the representation of the selected list item and to include the representations of the two or more split list items.

8. The method of claim 1, further comprising:

rendering a map of a store on the user interface; and

rendering representations of the list items on representations on the map of corresponding geographical locations in the store at which the list items are available.

9. The method of claim 8, further comprising:

rendering a route on the map that connects the representations of the list items to indicate a path to follow in picking up the list items in the store.

10. The method of claim 1, further comprising:

removing one or more stop words and/or one or more words of hesitation from the input text before the one or more n-grams are generated.

11. The method of claim 1, further comprising:

removing audio noise from the audio input stream before processing the audio input stream at the speech processing engine.

12. A mobile computing system, comprising:

an audio input device for receiving audio input;

a visual display device configured to display one or more user interfaces; and

a processor programmed to;

render a user interface on the visual display device, receive user input from a user for creating a list, receive an audio input stream from the user at the audio input device, the audio input stream including a sequence of a plurality of list items spoken by the user, in response to receipt of the audio input stream at the audio input device, call a speech progressing engine from the user interface to process the audio input stream into input text and to parse the input text into one or more n-grams, render representations of the one or more n-grams on the user interface to allow the user to accept, reject and/or edit the one or more n-grams for representation in the form of a list, and in response to user input accepting the one or n-grams, render a list on the user interface in which each n-gram is represented as a separate list item.

13. The mobile computing system of claim 12, wherein the processor is further programmed to:

render a map of a store on the user interface; and

render representations of the list items on representations on the map of corresponding geographical locations in the store at which the list items are available.

14. The mobile computing system of claim 12, wherein the processor is further programmed to:

render a route on the map that connects the representations of the list items to indicate a path to follow in picking up the list items in the store.

15. One or more non-transitory computer-readable media encoded with computer-executable instructions for performing a method for allowing creation and management of a list on a mobile computing device, the method comprising:

rendering a user interface on a display device of the mobile computing device;

receiving user input from a user for creating a list;

receiving an audio input stream from the user at an audio input device of the mobile computing device, the audio input stream including a sequence of a plurality of list items spoken by the user;

in response to receipt of the audio input stream at the audio input device, calling a speech processing engine from the user interface to process the audio input stream into input text and to parse the input text into one or more n-grams;

rendering representations of the one or more n-grams on the user interface to allow the user to accept, reject and/or edit the one or more n-grams for representation in the form of a list; and

in response to user input accepting the one or n-grams, rendering a list on the user interface in which each n-gram is represented as a separate list item.

16. The one or more non-transitory computer-readable media of claim 15, wherein the method further comprises:

rendering a map of a store on the user interface; and

rendering representations of the list items on representations on the map of corresponding geographical locations in the store at which the list items are available.

17. The one or more non-transitory computer-readable media of claim 15, wherein the method further comprises:

rendering a route on the map that connects the representations of the list items to indicate a path to follow in picking up the list items in the store.

18. A computer-implemented method for a mobile computing device, comprising:

receiving a list of items;

rendering a map of a store on a user interface displayed on a visual display device of the mobile computing device;

rendering representations of the list items on representations on the map of corresponding geographical locations in the store at which the list items are available;

rendering a route on the map that connects the representations of the list items to indicate a path to follow in picking up the list items in the store;

rendering a second user interface on the visual display device of the mobile computing device;

receiving user input from a user for creating a list;

receiving an audio input stream from the user at an audio input device of the mobile computing device, the audio input stream including a sequence of a plurality of list items spoken by the user;

in response to receipt of the audio input stream at the audio input device, calling a speech processing engine from the user interface to process the audio input stream into input text and to parse the input text into one or more n-grams;

rendering representations of the one or more n-grams on the second user interface to allow the user to accept, reject and/or edit the one or more n-grams for representation in the form of a list; and

in response to user input accepting the one or n-grams, rendering a list on the second user interface in which each n-gram is represented as a separate list item.

19. The method of claim 18, further comprising:

automatically determining one or more product items corresponding to a list item;

allowing the user to select at least one of the one or more product items using the second user interface; and

in response to user selection of at least one of the one or more product items, rendering representations of the at least one of the one or more selected product items on the second user interface.

20. The method of claim 18, further comprising:

automatically determining the store based on its proximity to the mobile computing device.

21. The method of claim 18, further comprising:

changing the rendering of the map based on a location of the mobile computing device.