Multi-modal method for browsing graphical information displayed on mobile devices

• US 20030040341A1
• Filed: 09/10/2002
• Published: 02/27/2003
• Est. Priority Date: 03/30/2000
• Status: Abandoned Application

• Current Assignee: Eduardo Casais
• Original Assignee: Eduardo Casais
• Inventors: Casais, Eduardo
• Application Number:
  US10/237,593
• Publication Number:
  US 20030040341A1
• Time in Patent Office: Days
• US Class Current: 455/566
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: H04L 67/04 specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
• CPC Class Codes: H04M 1/271 controlled by voice recognition
• CPC Class Codes: H04M 1/72445 for supporting Internet browser applications

Abstract

A method of browsing interactive data services with a wireless mobile device using a multi-modal technique for selecting components of an image. The method of browsing is particularly useful with mobile devices operation in accordance with Wireless Application Protocol (WAP) but is not limited thereto. A first mode of selection includes overlaying an image over a grid of cells on the display of the mobile device such as a mobile phone (FIG. 2). The cells are matched to a corresponding key on the keypad of the mobile phone. The user selects the cell containing the portion of the image of interest for further browsing by pressing the appropriate key. The cell contains a pointer to, e.g. a universal resource locator (URL) on the Internet, related information for retrieval and display on the phone. A second mode of selection includes using vocal identifiers matched to specific cells on a voice recognition capable phone or network. When the user speaks a recognized identifier, it is matched to the appropriated cell which is then selected to display the desired information.

Claims

1. A method of browsing a data service with a wireless mobile device having a display capable of displaying images, the method comprising the steps of:

displaying an image on said display;

superimposing said image over a grid of selectable cells;

associating each of the cells with a specific action;

selecting said cell in response to performing the specific action, wherein the specific action comprises one of

pressing an appropriate key on a keypad of the mobile device to select a particular cell and

speaking a vocal identifier into the mobile device to select a particular cell; and

retrieving information for display associated with the selected cell.

2. A method according to claim 1 wherein said grid forms a uniform grid of cells.

3. A method according to claim 1 wherein said grid forms a non-uniform grid of cells suitably conforming to particular features of the image.

4. A method according to claim 1 wherein said data service locates on a server which the wireless mobile device accesses over a wireless connection.

6. A method according to claim 1 wherein the specific action of cell selection using the keypad or vocal identifiers occurs during the same browsing session as having retrieved said image.

7. A method according to claim 2 wherein the uniform grid comprises a three-by-three grid of cells, and wherein the cells are suitably mapped to keys one through nine of the mobile device.

5. A method according to claim I wherein said information associated with the selected cell is retrieved by following a previously stored virtual link.

8. A wireless mobile device for browsing data content as part of a data service, the wireless mobile device comprising:

a micro-browser for browsing and retrieving data content of the data service; and

a display for displaying an image retrieved by the micro-browser; and

the wireless mobile device being configured to select a portion of an image displayed by any one of pressing a key associated with said portion and speaking a vocal identifier associated with said portion; and

the micro-browser being configured to retrieve data content relating to the selected portion of the image for presentation on said display.

9. A mobile device according to claim 8 wherein said micro-browser operates in accordance with Wireless Application Protocol (WAP).

10. A mobile device according to claim 8 wherein said device comprises a speech recognition system to select said portion of the image by speaking a vocal identifier.

11. A mobile device according to claim 10 wherein said wireless mobile device permits the use of keypad selection and speaking a vocal identifier during the same browsing session as having retrieved said image.

12. A mobile device according to claim 9 wherein the data content is a page formatted in any one of wireless markup language (WML) and wireless bitmap format (WBMP).

13. A mobile device according to claim 12 wherein the data content is stored on and retrieved from a WAP server for presentation on the display.

14. A mobile device according to claim 8 wherein said image locates on a server which the wireless mobile device accesses over a wireless connection.

15. A mobile device according to claim 8 wherein said micro-browser is configured to retrieve the data content relating to the selected portion of the image by following a previously stored virtual link.