Application-independent text entry for touch-sensitive display

• US 20040263487A1
• Filed: 06/30/2003
• Published: 12/30/2004
• Est. Priority Date: 06/30/2003
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Motorola, Inc. (Motorola Solutions, Inc.)
• Inventors: Guo, Jin, Wu, Charles Yimin, Mayoraz, Eddy
• Granted Patent: US 7,057,607 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04804 Transparency, e.g. transparent or translucent windows
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A user interface method and apparatus for an electronic device operates by detecting (108) a stroke of a touch sensitive display (170) forming a part of the electronic device. The stroke is categorized (116) as one of a swish type stroke and a non-swish type stroke. If the stroke is a non-swish stroke, it is translated (132) into an application function. If the stroke is a swish stroke, it is converted (128) to a character input function. The touch sensitive display (170) has a grid (50) containing cells (51, 53, etc.), with each cell containing a plurality of characters, and the grid can overlay application interface to thereby occupying a common area, up to and including the entire area, of the touch sensitive display (170).

Claims

1. A user interface method for an electronic device, comprising:

detecting a stroke of a touch sensitive medium forming a part of the electronic device, the stroke occurring on a region of the touch sensitive medium that could represent either one of an application function and a character input function;

determining if the stroke can be categorized as a first type of stroke, wherein the first type of stroke corresponds to character input stokes, wherein the determination is based at least upon touch location, release location, and contact time associated with the stroke;

if so, converting the stroke to a character input function;

if not, categorizing the stroke as a second type, and translating the stroke to the application function.

2. The user interface method according to claim 1, wherein the first type of stroke is used to represent each available character that can be input and is not used in any application function.

3. The user interface method according to claim 1, wherein the first type of stroke comprises a swish stroke.

4. The user interface method according to claim 1, wherein the second type of stroke comprises a tap stroke and the first type of stroke comprises a swish stroke.

5. The user interface method according to claim 1, wherein the translating comprises associating a location of the stroke on the touch sensitive medium with the application function.

6. The user interface method according to claim 1, wherein the first type of stroke comprises a swish type stroke, and wherein the converting comprises:

identifying a region of the touch sensitive medium containing a touch point of the stroke;

determining a direction of movement associated with the stroke; and

mapping the region and direction to the character.

7. The user interface method according to claim 1, wherein the touch sensitive medium has a grid containing cells, with each cell being associated with a plurality of characters,

and wherein the first type of stroke comprises a swish type stroke,

and wherein the converting comprises:

identifying a grid cell of the touch sensitive medium containing a touch point of the stroke;

determining a direction of movement associated with the stroke; and

mapping the region and direction to the character.

8. The user interface method according to claim 7, wherein the direction of movement is determined by calculating the direction from the touch point and a release point of the stroke.

9. The user interface method according to claim 1, wherein the touch sensitive medium comprises a touch sensitive display.

10. The user interface method according to claim 9, further comprising:

an application interface, and

wherein the touch sensitive display has a grid containing cells, with each cell containing a plurality of characters, and

wherein the grid overlays the application interface thereby occupying a common area of the touch sensitive display.

11. The user interface method according to claim 10, wherein the grid is displayed simultaneously with the application interface.

12. The user interface method according to claim 11, wherein a feature of the grid is displayed prominently in a first display mode and less prominently in a second display mode.

13. The user interface method according to claim 12, wherein the feature of the grid is displayed in the second display mode in a different manner than in the first display mode and wherein the different manner comprises at least one of a different color, a lesser intensity, a lower contrast, dashed lines, and broken lines.

14. The user interface method according to claim 1, wherein the determining comprises detecting a swish type stroke as a touch-move-release stroke in a single direction with comparatively short time duration between the touch and the release.

15. The user interface method according to claim 1, wherein the second type of stroke comprises a non-swish type stroke and the first type of stroke comprises a swish type stroke, and wherein the determining comprises:

detecting an initial touch location and time of the stroke;

detecting a movement of the touch location and determining at least one touch location and touch time associated with the movement;

detecting a release location and time; and

categorizing the stroke as a swish type stroke if;

1) the distance between the location of the release location and the initial touch location is larger than a distance threshold,

2) the initial touch location is within one of a set of specified regions of the touch sensitive medium, and

3) the difference in time between the touch time and the release time is less than a time threshold.

16. The user interface method according to claim 15, further comprising:

associating the swish operation with one of a plurality of regions on the touch sensitive medium defined by at least one of the initial touch location, the initial touch time, the intermediate touch location, the intermediate touch time, the release location and the release time;

associating the swish operation with one of a plurality of types defined by at least one of the initial touch location, the initial touch time, the intermediate touch location, the intermediate touch time, the release location and the release time; and

conducting an action defined for the associated type of swish operation at the associated region.

17. The user interface method according to claim 15, wherein the stroke is in a straight line between the initial touch location and the release location.

18. A user interface method for an electronic device, comprising:

detecting a stroke of a touch sensitive medium forming a part of the electronic device;

categorizing the stroke as one of a swish type stroke and a non-swish type stroke;

if the stroke is a swish type stroke, converting the swish type stroke to a character input function;

if the stroke is a non-swish type stroke, translating the stroke into an application function.

19. The user interface method according to claim 18, wherein the translating comprises associating a location of the non-swish type stroke on the touch sensitive medium with the application function.

20. The user interface method according to claim 18, wherein the converting comprises:

identifying a region of the touch sensitive medium containing a touch point of the stroke;

determining a direction of movement associated with the stroke; and

mapping the region and direction to the character.

21. The user interface method according to claim 18, wherein the touch sensitive medium has a grid containing cells, with each cell being associated with a plurality of characters, and wherein the converting comprises:

identifying a grid cell of the touch sensitive medium containing a touch point of the stroke;

determining a direction of movement associated with the stroke; and

mapping the region and direction to the character.

22. The user interface method according to claim 18, wherein the touch sensitive medium comprises a touch sensitive display.

23. The user interface method according to claim 22, wherein the touch sensitive display has a grid containing cells, with each cell being associated with a plurality of characters;

and wherein the converting comprises;

identifying a grid cell of the touch sensitive display containing a touch point of the swish stroke;

determining a direction of movement associated with the swish stroke; and

mapping the region and direction to the character.

24. The user interface method according to claim 23, further comprising an application interface, and wherein the grid overlays the application interface thereby occupying a common area of the touch sensitive display.

25. The user interface method according to claim 24, wherein the grid overlays substantially the entire touch sensitive display.

26. The user interface method according to claim 24, wherein the grid is displayed simultaneously with the application interface.

27. The user interface method according to claim 26, wherein a feature of the grid is displayed prominently in a first display mode and less prominently in a second display mode.

28. The user interface method according to claim 27, wherein the feature of the grid is displayed in the second display mode in a different manner than in the first display mode and wherein the different manner comprises at least one of a different color, a lesser intensity, a lower contrast, dashed lines, and broken lines.

29. The user interface method according to claim 23, wherein the direction of movement is determined by calculating the direction from the touch point and a release point of the swish stroke.

30. The user interface method according to claim 18, wherein at least one of the types of non-swish strokes comprises a tap.

31. The user interface method according to claim 18, wherein the categorizing comprises:

detecting an initial touch location and time of the stroke;

detecting a movement of the touch location and determining at least one touch location and touch time associated with the movement;

detecting a release location and time; and

categorizing the stroke as a swish type stroke if;

4) the distance between the location of the release location and the initial touch location is larger than a distance threshold,

5) the initial touch location is within one of a set of specified regions of the touch sensitive medium, and

6) the difference in time between the touch time and the release time is less than a time threshold.

32. The user interface method according to claim 31, further comprising:

associating the swish operation with one of a plurality of regions on the touch sensitive medium defined by at least one of the initial touch location, the initial touch time, the intermediate touch location, the intermediate touch time, the release location and the release time;

associating the swish operation with one of a plurality of types defined by at least one of the initial touch location, the initial touch time, the intermediate touch location, the intermediate touch time, the release location and the release time; and

conducting an action defined for the associated type of swish operation at the associated region.

33. The user interface method according to claim 31, wherein the stroke is in a straight line between the initial touch location and the release location.

34. A user interface method for an electronic device, comprising:

a detecting a stroke of a touch sensitive display forming a part of the electronic device, an application interface, wherein the touch sensitive display has a grid containing cells, with each cell containing a plurality of characters, and wherein the grid overlays the application interface thereby occupying substantially the entire active area of the touch sensitive display;

categorizing the stroke as one of a tap stroke and a swish stroke;

if the stroke is a tap stroke;

translating the tap into an application function by associating a location of the tap on the touch sensitive display with the application function, and

carrying out the application function; and

if the stroke is a swish stroke;

converting the swish stroke to a character by identifying a region of the touch sensitive display containing a touch point of the swish stroke, determining a direction of movement associated with the swish stroke, and mapping the region and direction to the character, wherein the direction of movement is determined by calculating the direction from the touch point and a release point of the swish stroke, wherein the movement from touch point to release point is in an approximately straight line; and

entering the character as data.

35. A computer readable storage medium containing instructions that, when executed on a programmed processor carries out a user interface method for an electronic device, the instructions comprising:

a segment of code that detects a stroke of an area of a touch sensitive medium that could represent either an application function or a character input function, the touch sensitive medium forming a part of the electronic device;

a segment of code that categorizes the stroke as one of a first type and a second type, wherein the second type of stroke is used to represent each available character that can be input and is not used in any application function;

a segment of code that branches to a first operation if the stroke is of the first type and to a second operation if the stroke is of the second type;

the first operation being carried out by a segment of code that translates the stroke to an application function; and

the second operation being carried out by a segment of code that converts the stroke to a character input function.

36. The computer readable storage medium according to claim 35, wherein the first type of stroke comprises a non-swish type stroke and the second type of stroke comprises a swish type stroke.

37. The computer readable storage medium according to claim 35, wherein the translating comprises associating a location on the touch sensitive display with the application function.

38. The computer readable storage medium according to claim 35, wherein the converting comprises:

identifying a region of the touch sensitive medium containing a touch point of the stroke;

determining a direction of movement associated with the stroke; and

mapping the region and direction to the character.

39. An electronic apparatus, comprising:

a touch sensitive display that provides a mechanism of user output and input;

a computer receiving input from the touch sensitive display and providing an output thereto;

a user interface program running on the computer, that carries out a process of;

detecting a stroke of a touch sensitive display forming a part of the electronic device;

categorizing the stroke as one of a swish type stroke and a non-swish type;

if the stroke is of the non-swish type, translating the stroke to an application function; and

if the stroke is of the second type, converting the stroke to a character input function.

40. The electronic apparatus according to claim 39, wherein the non-swish type of stroke comprises a tap stroke.

41. The electronic apparatus according to claim 39, further comprising a computer program running on the computer and wherein the computer program further comprises:

an application interface, and

wherein the touch sensitive display has a grid containing cells, with each cell containing a plurality of characters, and

wherein the grid overlays the application interface thereby occupying a common area of the touch sensitive display therewith.

42. The electronic apparatus according to claim 41, wherein the grid is displayed simultaneously with the application interface.

43. The electronic apparatus according to claim 42, wherein a feature of the grid is displayed prominently in a first display mode and less prominently in a second display mode.

44. The electronic apparatus according to claim 43, wherein the feature of the grid is displayed in the second display mode in a different manner than in the first display mode and wherein the different manner comprises at least one of a different color, a lesser intensity, a lower contrast, dashed lines, and broken lines.

45. An electronic apparatus, comprising, comprising:

a touch sensitive display that provides a mechanism of user output and input;

a computer receiving input from the touch sensitive display and providing an output thereto;

means for detecting a stroke of the touch sensitive display;

means for categorizing the stroke as one of a swish type stroke and a non-swish type stroke;

means for translating the tap into an application function, if the stroke is a non-swish type stroke; and

means for converting the swish-type stroke to a character input function, if the stroke is a swish type stroke.

46. The electronic apparatus according to claim 45, wherein the touch sensitive display has a grid containing cells, with each cell being associated with a plurality of characters;

and wherein the mapping comprises;

identifying a grid cell of the touch sensitive display containing a touch point of the swish stroke;

determining a direction of movement associated with the swish stroke; and

mapping the region and direction to the character.

47. The electronic apparatus according to claim 45, further comprising an application interface, and wherein the grid overlays the application interface thereby occupying a common area of the touch sensitive display therewith.

48. The electronic apparatus according to claim 45, wherein the grid overlays substantially the entire touch sensitive display.

49. The electronic apparatus according to claim 48, wherein the grid is displayed simultaneously with the application interface.

50. The electronic apparatus according to claim 49, wherein a feature of the grid is displayed prominently in a first display mode and less prominently in a second display mode.

51. The electronic apparatus according to claim 50, wherein the feature of the grid is displayed in the second display mode in a different manner than in the first display mode and wherein the different manner comprises at least one of a different color, a lesser intensity, a lower contrast, dashed lines, and broken lines.

52. An input/output apparatus for an electronic device, comprising:

a touch sensitive display having a touch sensitive display area;

a grid overlaying a portion of the display area, the grid representing an arrangement of characters that can be entered; and

an application interface, displayed on the same portion of the display area, wherein the electronic device responds to a first type of touch stroke to enter characters, and responds to a second type of touch stroke to interact with the application interface.

53. The input/output apparatus according to claim 52, wherein the grid overlays substantially the entire touch sensitive display area.

54. The input/output apparatus according to claim 52, wherein the first type of touch stroke comprises a tap stroke and the second type of touch stroke comprises a swish stroke.

55. The input/output apparatus according to claim 54, wherein the grid is displayed simultaneously with the application interface.

56. The input/output apparatus according to claim 55, wherein a feature of the grid is displayed prominently in a first display mode and less prominently in a second display mode.

57. The input/output apparatus according to claim 56, wherein the feature of the grid is displayed in the second display mode in a different manner than in the first display mode and wherein the different manner comprises at least one of a different color, a lesser intensity, a lower contrast, dashed lines, and broken lines.

58. A user interaction operation for a user interface method, comprising:

detecting an initial touch of a touch sensitive medium, and recording an initial touch location and an associated initial touch time;

detecting movement of the touch on the touch sensitive medium, and recording at least one touch location, and associated touch time, at a time different from the time of initial touch;

detecting a release of the touch sensitive medium, and recording a release location and its associated release time;

categorizing the initial touch, movement and release as a swish operation if;

1) a distance between the release location and the initial touch location is larger than a distance threshold;

2) the initial touch location is within one of a set of pre-defined regions of the touch sensitive medium; and

3) the difference between the release time and the touch time is shorter than a time threshold.

59. The user interaction operation for a user interface method according to claim 58, further comprising:

associating the swish operation with one of a plurality of regions on the touch sensitive medium defined by at least one of the initial touch location, the initial touch time, the intermediate touch location, the intermediate touch time, the release location and the release time;

associating the swish operation with one of a plurality of types defined by at least one of the initial touch location, the initial touch time, the intermediate touch location, the intermediate touch time, the release location and the release time; and

conducting an action defined for the associated type of swish operation at the associated region.

60. A user interface method for an electronic device, comprising:

detecting a stroke of a touch sensitive medium forming a part of the electronic device, the stroke occurring on a region of the touch sensitive medium that could represent either one of an application function and a character input function;

determining if the stroke can be categorized as a first type of stroke, wherein the first type of stroke corresponds to a character input stoke, and wherein the first type of stroke is used to represent each available character that can be input and is not used in any application function;

if so, converting the stroke to a character input function;

if not, categorizing the stroke as a second type, and translating the stroke to the application function.

61. The user interface method according to claim 60, wherein the first type of stroke comprises a swish stroke.

62. The user interface method according to claim 60, wherein the first type of stroke comprises a swish type stroke, and wherein the converting comprises:

identifying a region of the touch sensitive medium containing a touch point of the stroke;

determining a direction of movement associated with the stroke; and

mapping the region and direction to the character.

63. The user interface method according to claim 60, wherein the touch sensitive medium comprises a display area and wherein a grid overlays a portion of the display area, the grid representing an arrangement of characters that can be entered;

and

64. The user interface method according to claim 63, wherein the grid is displayed simultaneously with an application interface.

65. The user interface method according to claim 64, wherein a feature of the grid is displayed prominently in a first display mode and less prominently in a second display mode.

66. The user interface method according to claim 65, wherein the feature of the grid is displayed in the second display mode in a different manner than in the first display mode and wherein the different manner comprises at least one of a different color, a lesser intensity, a lower contrast, dashed lines, and broken lines.

67. An input/output apparatus for an electronic device, comprising:

a touch sensitive display having a touch sensitive display area;

a grid overlaying a portion of the display area, the grid representing an arrangement of commands that can be entered; and

an application interface, displayed on the same portion of the display area simultaneously with the grid, wherein the electronic device responds to a predetermined type of touch stroke to enter commands from the arrangement of commands on the grid into the application.

68. The input/output apparatus according to claim 67, wherein the grid overlays substantially the entire touch sensitive display area.

69. The input/output apparatus according to claim 67, wherein the predetermined type of touch stroke comprises a swish stroke.

70. The input/output apparatus according to claim 67, wherein a feature of the grid is displayed prominently in a first display mode and less prominently in a second display mode.

71. The input/output apparatus according to claim 70, wherein the feature of the grid is displayed in the second display mode in a different manner than in the first display mode and wherein the different manner comprises at least one of a different color, a lesser intensity, a lower contrast, dashed lines, and broken lines.