Method, device, and graphical user interface providing word recommendations for text input

• US 8,232,973 B2
• Filed: 06/30/2008
• Issued: 07/31/2012
• Est. Priority Date: 01/09/2008
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Kocienda, Kenneth, Christie, Greg, Ording, Bas, Forstall, Scott, Williamson, Richard, Bellegarda, Jerome René
• Primary Examiner(s): Awad, Amr
• Assistant Examiner(s): Bukowski, Kenneth
• Application Number:
  US12/165,554
• Publication Number:
  US 20090174667A1
• Time in Patent Office: 1,492 Days
• Field of Search: 345/156, 345168-169, 345171-178, 704/1, 704 8- 10, 715257-261
• US Class Current: 345/173
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/04895 Guidance during keyboard input operation, e.g. prompting

Abstract

A portable electronic device having a touch screen display performs a set of operations, including displaying a plurality of key icons, each having an adjustable size hit region, and receiving a sequence of individual touch points input by a user on the touch screen display. The operations performed by the device further include processing the received individual touch points by: forming a user-input directed graph for the sequence of individual touch points received so far, determining a character corresponding to a last received individual touch point in accordance with the adjustable hit regions of the displayed key icons, displaying a sequence of characters corresponding to the sequence of individual touch points, and updating sizes of the adjustable hit regions for a plurality of the key icons in accordance with the sequence of individual touch points input by the user.

Claims

1. A computer-implemented method, comprising:

at a portable electronic device having a touch screen display;

displaying a plurality of key icons, each key icon having a fixed displayed size and an adjustable undisplayed hit region of dynamically adjustable size;

receiving a sequence of individual touch points input by a user on the touch screen display, wherein;

each touch point is determined at lift off of a contact from the touch screen display, and

an image with an enlarged version of a character that will be selected as the character corresponding to an individual touch point is displayed prior to lift off of a respective contact, wherein the character image that is displayed prior to lift off is selected in accordance with the adjustable undisplayed hit regions of the displayed key icons; and

after receiving each of the individual touch points;

forming a user-input directed graph for the sequence of individual touch points received so far;

determining a character corresponding to a last received individual touch point in accordance with the adjustable undisplayed hit regions of the displayed key icons;

displaying a sequence of characters corresponding to the sequence of individual touch points, including the determined character; and

updating a size of an adjustable undisplayed hit region for at least one of the plurality of the key icons in accordance with the sequence of individual touch points input by the user, wherein the updating includes changing the size of at least one adjustable undisplayed hit region.

2. The computer-implemented method of claim 1, including:

determining one of more alternate sequences of characters corresponding to the sequence of individual touch points, and determining a respective probability for each of the alternate sequences of characters and for the displayed sequence of characters; and

displaying a suggested replacement character string comprising a selected one of the alternate sequence of characters when the probability of the selected alternate sequence meets one or more predefined criteria with respect to the probability of the displayed sequence of characters.

3. The computer-implemented method of claim 2, wherein the one or more predefined criteria include a requirement that the determined probability for the suggested replacement character string be greater than the determined probability for the displayed sequence of characters.

4. The computer-implemented method of claim 2, including:

receiving a touch point corresponding to a deletion key icon;

deleting one or more of the displayed characters to produce a shortened sequence of characters;

receiving additional individual touch points; and

after receiving each of the additional individual touch points;

determining and displaying a suggested character string only when the suggested character string starts with the shortened sequence of characters and the suggested character string meets predefined character string suggestion criteria.

5. The computer-implemented method of claim 1, wherein the adjustable undisplayed hit region of each key icon has a default size equal to a visible display size of the key icon.

6. The computer-implemented method of claim 1, wherein

updating the size of the adjustable undisplayed hit region for a respective key icon includes determining a probability associated with the respective key icon and determining a size of the adjustable undisplayed hit region in accordance with the determined probability.

7. The computer-implemented method of claim 6, wherein the probability associated with the respective key icon is determined in accordance with the displayed sequence of characters.

8. The computer-implemented method of claim 6, wherein the probability associated with the respective key icon is determined in accordance with a plurality of character sequences including the displayed sequence of characters and at least one other sequence of characters consistent with the sequence of individual touch points input by the user.

9. The computer-implemented method of claim 6, including determining a respective probability for each of a plurality of character sequences consistent with the sequence of individual touch points input by the user;

and

wherein the probability associated with the respective key icon is determined in accordance with determined probabilities of the plurality of character sequences, each of which comprises a potential prefix for a next character corresponding to a next touch point input by the user.

10. The computer-implemented method of claim 1, wherein:

the adjustable undisplayed hit region for each key icon comprises;

a visible key area displayed on the touch screen display and

a hidden hit region not displayed on the touch screen display; and

determining the character corresponding to the last received individual touch point in accordance with the adjustable undisplayed hit regions of the displayed key icons comprises;

if the hidden hit regions of two or more key icons overlap with a touch point position that corresponds to the last received individual touch point, then the character corresponding to the key icon in the two or more overlapping key icons with the largest adjustable undisplayed hit region is the determined character.

11. The computer-implemented method of claim 1, wherein:

the adjustable undisplayed hit region for each key icon comprises;

a visible key area displayed on the touch screen display and

a hidden hit region not displayed on the touch screen display; and

determining the character corresponding to the last received individual touch point in accordance with the adjustable undisplayed hit regions of the displayed key icons comprises;

if the hidden hit regions of two or more key icons overlap with a finger contact that corresponds to the last received individual touch point, then the character corresponding to the key icon in the two or more overlapping key icons with the largest adjustable undisplayed hit region is the determined character.

12. The method of claim 1, wherein the user-input directed graph is a directed graph formed by the sequence of individual touch points input by the user on the plurality of key icons, the plurality of key icons being part of a virtual keyboard.

13. A non-transitory computer readable storage medium having stored therein instructions, which when executed by a portable electronic device with a touch screen display, cause the device to:

display on the touch screen display a plurality of key icons, each key icon having a fixed displayed size and an adjustable undisplayed hit region of dynamically adjustable size;

receive a sequence of individual touch points input by a user on the touch screen display, wherein;

each touch point is determined at lift off of a contact from the touch screen display, and

an image with an enlarged version of a character that will be selected as the character corresponding to an individual touch point is displayed prior to lift off of a respective contact, wherein the character image that is displayed prior to lift off is selected in accordance with the adjustable undisplayed hit regions of the displayed key icons; and

process the received individual touch points by performing operations after receiving each of the individual touch points, the operations including;

forming a user-input directed graph for the sequence of individual touch points received so far;

determining a character corresponding to a last received individual touch point in accordance with the adjustable undisplayed hit regions of the displayed key icons;

displaying on the touch screen display a sequence of characters corresponding to the sequence of individual touch points, including the determined character; and

updating a size of an adjustable undisplayed hit region for at least one of the plurality of the key icons in accordance with the sequence of individual touch points input by the user wherein the updating includes changing the size of at least one adjustable undisplayed hit region.

14. The computer readable storage medium of claim 13, including instructions which cause the device to:

determine one of more alternate sequences of characters corresponding to the sequence of individual touch points, and determine a respective probability for each of the alternate sequences of characters and for the displayed sequence of characters; and

display a suggested replacement character string comprising a selected one of the alternate sequence of characters when the probability of the selected alternate sequence meets one or more predefined criteria with respect to the probability of the displayed sequence of characters.

15. The computer readable storage medium of claim 14, wherein the one or more predefined criteria include a requirement that the determined probability for the suggested replacement character string be greater than the determined probability for the displayed sequence of characters.

16. The computer readable storage medium of claim 14, including instructions which cause the device to:

receive a touch point corresponding to a deletion key icon;

delete one or more of the displayed characters to produce a shortened sequence of characters;

receive additional individual touch points; and

after receiving each of the additional individual touch points;

determine and display a suggested character string only when the suggested character string starts with the shortened sequence of characters and the suggested character string meets predefined character string suggestion criteria.

17. The computer readable storage medium of claim 13, wherein the adjustable undisplayed hit region of each key icon has a default size equal to a visible display size of the key icon.

18. The computer readable storage medium of claim 13, wherein

updating the size of the adjustable undisplayed hit region for a respective key icon includes determining a probability associated with the respective key icon and determining a size of the adjustable undisplayed hit region in accordance with the determined probability.

19. The computer readable storage medium of claim 18, wherein the probability associated with the respective key icon is determined in accordance with the displayed sequence of characters.

20. The computer readable storage medium of claim 18, wherein the probability associated with the respective key icon is determined in accordance with a plurality of character sequences including the displayed sequence of characters and at least one other sequence of characters consistent with the sequence of individual touch points input by the user.

21. The computer readable storage medium of claim 18, including instructions which cause the device to determine a respective probability for each of a plurality of character sequences consistent with the sequence of individual touch points input by the user;

and

wherein the probability associated with the respective key icon is determined in accordance with determined probabilities of the plurality of character sequences, each of which comprises a potential prefix for a next character corresponding to a next touch point input by the user.

22. The computer readable storage medium of claim 13, wherein:

the adjustable undisplayed hit region for each key icon comprises;

a visible key area displayed on the touch screen display and

a hidden hit region not displayed on the touch screen display; and

determining the character corresponding to the last received individual touch point in accordance with the adjustable undisplayed hit regions of the displayed key icons comprises;

if the hidden hit regions of two or more key icons overlap with a touch point position that corresponds to the last received individual touch point, then the character corresponding to the key icon in the two or more overlapping key icons with the largest adjustable undisplayed hit region is the determined character.

23. The computer readable storage medium of claim 13, wherein:

the adjustable undisplayed hit region for each key icon comprises;

a visible key area displayed on the touch screen display and

a hidden hit region not displayed on the touch screen display; and

determining the character corresponding to the last received individual touch point in accordance with the adjustable undisplayed hit regions of the displayed key icons comprises;

if the hidden hit regions of two or more key icons overlap with a finger contact that corresponds to the last received individual touch point, then the character corresponding to the key icon in the two or more overlapping key icons with the largest adjustable undisplayed hit region is the determined character.

24. A portable electronic device, comprising:

a touch screen display;

one or more processors;

memory; and

one or more programs stored in the memory, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying on the touch screen display a plurality of key icons, each key icon having a fixed displayed size and an adjustable undisplayed hit region of dynamically adjustable size;

receiving a sequence of individual touch points input by a user on the touch screen display, wherein;

each touch point is determined at lift off of a contact from the touch screen display, and

an image with an enlarged version of a character that will be selected as the character corresponding to an individual touch point is displayed prior to lift off of a respective contact, wherein the character image that is displayed prior to lift off is selected in accordance with the adjustable undisplayed hit regions of the displayed key icons; and

processing the received individual touch points by performing operations after receiving each of the individual touch points, the operations including;

forming a user-input directed graph for the sequence of individual touch points received so far;

determining a character corresponding to a last received individual touch point in accordance with the adjustable undisplayed hit regions of the displayed key icons;

displaying on the touch screen display a sequence of characters corresponding to the sequence of individual touch points, including the determined character; and

updating a size of an adjustable undisplayed hit region for at least one of the plurality of the key icons in accordance with the sequence of individual touch points input by the user wherein the updating includes changing the size of at least one adjustable undisplayed hit region.

25. The portable electronic device of claim 24, wherein the portable electronic device comprises a portable communications device.

26. The device of claim 24, including instructions for:

determining one of more alternate sequences of characters corresponding to the sequence of individual touch points, and determining a respective probability for each of the alternate sequences of characters and for the displayed sequence of characters; and

displaying a suggested replacement character string comprising a selected one of the alternate sequence of characters when the probability of the selected alternate sequence meets one or more predefined criteria with respect to the probability of the displayed sequence of characters.

27. The device of claim 26, wherein the one or more predefined criteria include a requirement that the determined probability for the suggested replacement character string be greater than the determined probability for the displayed sequence of characters.

28. The device of claim 26, including instructions for:

receiving a touch point corresponding to a deletion key icon;

deleting one or more of the displayed characters to produce a shortened sequence of characters;

receiving additional individual touch points; and

after receiving each of the additional individual touch points;

determining and displaying a suggested character string only when the suggested character string starts with the shortened sequence of characters and the suggested character string meets predefined character string suggestion criteria.

29. The device of claim 24, wherein the adjustable undisplayed hit region of each key icon has a default size equal to a visible display size of the key icon.

30. The device of claim 24, wherein

updating the size of the adjustable undisplayed hit region for a respective key icon includes determining a probability associated with the respective key icon and determining a size of the adjustable undisplayed hit region in accordance with the determined probability.

31. The device of claim 30, wherein the probability associated with the respective key icon is determined in accordance with the displayed sequence of characters.

32. The device of claim 30, wherein the probability associated with the respective key icon is determined in accordance with a plurality of character sequences including the displayed sequence of characters and at least one other sequence of characters consistent with the sequence of individual touch points input by the user.

33. The device of claim 30, including instructions for determining a respective probability for each of a plurality of character sequences consistent with the sequence of individual touch points input by the user;

and

wherein the probability associated with the respective key icon is determined in accordance with determined probabilities of the plurality of character sequences, each of which comprises a potential prefix for a next character corresponding to a next touch point input by the user.

34. The device of claim 24, wherein:

the adjustable undisplayed hit region for each key icon comprises;

a visible key area displayed on the touch screen display and

a hidden hit region not displayed on the touch screen display; and

determining the character corresponding to the last received individual touch point in accordance with the adjustable undisplayed hit regions of the displayed key icons comprises;

if the hidden hit regions of two or more key icons overlap with a touch point position that corresponds to the last received individual touch point, then the character corresponding to the key icon in the two or more overlapping key icons with the largest adjustable undisplayed hit region is the determined character.

35. The device of claim 24, wherein:

the adjustable undisplayed hit region for each key icon comprises;

a visible key area displayed on the touch screen display and

a hidden hit region not displayed on the touch screen display; and

determining the character corresponding to the last received individual touch point in accordance with the adjustable undisplayed hit regions of the displayed key icons comprises;

if the hidden hit regions of two or more key icons overlap with a finger contact that corresponds to the last received individual touch point, then the character corresponding to the key icon in the two or more overlapping key icons with the largest adjustable undisplayed hit region is the determined character.