Stroke-based data entry device, system, and method

• US 7,519,748 B2
• Filed: 06/16/2005
• Issued: 04/14/2009
• Est. Priority Date: 06/18/2004
• Status: Active Grant

• Current Assignee: Tamiras Per Pte Ltd LLC (Intellectual Ventures LLC)
• Original Assignee: Microth, Inc.
• Inventors: Kuzmin, Yevgeniy Pavlovich
• Primary Examiner(s): Sorrell; Eron J
• Application Number:
  US11/570,287
• Publication Number:
  US 20080075368A1
• Time in Patent Office: 1,398 Days
• Field of Search: None
• US Class Current: 710/67
• CPC Class Codes: G06F 2203/04809 Textured surface identifying touch areas, e.g. overlay structure for a virtual keyboard
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 10/17 using hand-held instruments

Abstract

A data entry system comprising of: an input surface, a limited number of input elements of any shape and positions at the input surface, and a processing device (for detecting a continuous sweeps of an input object over the input surface, for tracking a sequence of the input elements interacted with the input object during such sweeps, and for generating a function associated with the sequence after the sweep is completed). A system characterized in that the processing device is adapted for time independent and reliable detecting a sequence of input elements, even if an input object could interact with several input elements simultaneously. A system also characterized in that the sweeps may represent strokes of handwritten symbols. The invention can be utilized in new designs of compact data input systems for electronic devices.

Claims

1. A data entry system comprising:

an input surface having a limited number of non-adjacent input elements with gaps therebetween; and

a processing device adapted to;

detect a continuous sweep of an input object over an input region of the input surface, wherein the continuous sweep comprises a continuous surface interaction between the input object and the input surface;

trace an input sequence of the input elements interacted with by the input object during the surface interaction, wherein the input sequence is associated with no more than one input, wherein all inputs associated with input sequences are stored in a dictionary on a memory; and

unconditionally and immediately select the input associated with the input sequence from the memory and activate the input associated with the input sequence after the surface interaction is discontinued without interpretation of the input sequence, without further interaction of the input elements by the input object, and without external selection or confirmation of the input associated with the input sequence.

2. The system of claim 1, wherein the processing device is further adapted to convert input sequences into inputs.

3. The system of claim 2, wherein the processing device is further adapted to convert the input sequence into predicted inputs during the sweep.

4. The system of claim 2, wherein the processing device is further adapted to convert the input sequence into an input comprising a change at least one of the following parameters selected from the group of frequency, volume, bass, treble, fade, balance, play speed, listening speed, temperature, humidity, time, pressure, acceleration, weight, coordinate, distance, direction, angle, and position in a list.

5. The system of claim 2, wherein the processing device is further adapted to convert the input sequence into an input comprising one of the control functions selected from the group of (i) advancing the track of a digital media player, (ii) reversing the track of a digital media player, (iii) pausing the play of a digital media player, (iv) beginning the play of a digital media player, (v) stopping the play of a digital media player, (vi) advancing the play of a digital media player, (vii) reversing the play of a digital media player, (viii) increasing the volume of a digital media player, (ix) decreasing the volume of a digital media player;

(x) control of burners of a stove;

(xi) control of temperature of an oven, (xii) control of a timer associated with use of an oven;

(xiii) control of temperature of a zone of a refrigerator or freezer, (xiv) control of humidity of a zone of a refrigerator or freezer, (xv) control of power level of a microwave, (xvi) control of cooking time of a microwave, (xvii) control of cooking modes of a microwave, (xviii) control of options of a microwave, and (xix) control of activation of a microwave, (xx) selecting a recorded program of a digital video recorder, (xxi) pausing the play of a digital video recorder, (xxii) beginning the play of a digital video recorder, (xxiii) stopping the play of a digital video recorder, (xxiv) advancing the play of a digital video recorder, (xxv) reversing the play of a digital video recorder, (xxvi) increasing the speed of play of a digital video recorder, (xxvii) decreasing the speed of play of a digital video recorder, and (xxiii) deleting a recorded program of a digital video recorder.

6. The system of claim 2, wherein the processing device is further adapted to convert the input sequence into an input comprising a change in selection of at least one of the following from the group of:

(i) a language script element from a predefined set of language script elements, (ii) a value from a predefined set of values, (iii) a mode from a predefined set of operating modes, (iv) a menu item selected from a predefined set of menu items, (v) an operation selected from a predefined set of available operations, and (vi) a channel selected from a predefined set of available channels.

7. The system according to claim 1, wherein the processing device is further adapted to detect interaction with input elements from when the input object starts interacting with the input surface to when the input object stops interacting with the input surface.

8. The system according to claim 1, wherein the processing device is further adapted to detect an input sequence when the input object interacts with more than one input elements simultaneously.

9. The system according to claim 1, wherein the input elements are positioned and spaced about the input surface in such a way that the input object interacting with the input surface also interacts with at least one input element.

10. The system according to claim 1, wherein the processing device is further adapted to convert a group of input sequences represented by at least two consecutive surface interactions between an input object and the input surface into an input.

11. The system according to claim 1, wherein the processing device is further adapted to detect an unassociated input sequence and add an input sequence representation for an input by creating an association between the unassociated input sequence and the input.

12. The system according to claim 1, wherein the processing device is further adapted to delete an input sequence representation for an input by removing an association between a representation of an input sequence and the input.

13. The system according to claim 1, wherein the input surface is adapted to and the processing device is further adapted to permit the input object to be selected from any of the input objects of the group of:

a finger, thumb, stylus, pen, laser pointer, cursor, image of an object, and a two-dimensional shape.

14. The system according to claim 1, wherein the input surface is further adapted to permit interaction of any of the input elements and input surface by interactions of the physical nature selected from the group of:

electronic, electromechanical, proximity, mechanical, and visual.

15. The system according to claim 1, wherein at least one input element is defined by a shape selected from the group consisting of a dot, a line, and a planar area.

16. The system according to claim 1, wherein the input surface is a continuous volume of material.

17. The system according to claim 1, further comprising a touch-sensitive display covering at least a portion of the input surface.

18. The system according to claim 1, further comprising a plurality of displays covering a corresponding plurality of input zones.

19. The system according to claim 1, wherein the input surface includes at least one tactile feature selected from the group of:

grooves, bumps, lines, and dots.

20. The system according to claim 19, wherein the tactile features define the input element zones.

21. The system according to claim 1, wherein the input surface includes at least one of backlighting, static symbology displaying, and dynamic symbology displaying to provide visual feedback during interaction of input elements by an input object.

22. The system according to claim 1, wherein the input surface and the processing device are further adapted to detect continuous surface interactions between the input surface and the input object within an input region of arbitrary shape of the input surface.

23. The system according to claim 22, wherein the processing device is further adapted to detect interaction with input elements from when the input object enters into the input region of the input surface to when the input object leaves the input region of the input surface, wherein the interaction of the input object with the input surface is uninterrupted and continuous.

24. The system according to claim 1, wherein the processing device includes an electronic circuit which registers and processes interactions between the input surface and an input object.

25. The system of claim 1, wherein the processing device is further adapted to activate an input associated with the input sequence only after the sweep is complete.

26. The system of claim 1, wherein the processing device is further adapted to indicate an input associated with the input sequence during the sweep.

27. The system of claim 1, wherein the processing device is further adapted to provide an intermediate indication of the currently identified input associated with the current input sequence during the sweep and select for activation a final identified input associated with the input sequence after the sweep is complete.

28. The system of claim 1, wherein the input surface and processing device are configured as part of a device selected from the group consisting of a radio, a satellite radio, an MP3 player, a personal media device, a GPS device, a medical device, a computer mouse, a refrigerator, an oven, a climate control device, a portable computer, an electronic dictionary, a phone, a pager, a watch, a TV set, a dishwasher, a washing machine, a dryer, a thermostat, an alarm system control panel, an audio mixer, an automobile control panel, a security system, a smartcard, a remote control device, an industrial process control panel, and a portable input device.

29. A method of performing data entry, comprising the steps of:

detecting interaction of at least a first input element of an input surface with an input object;

detecting interaction of at least a second input element of the input surface with the input object, wherein the first and second input elements are non-adjacent to each other and spaced apart about the input surface by a gap therebetween, wherein the interaction of the first and the at least second input elements of the input surface with the input object comprises a continuous surface interaction between the input object and the input surface within an input region;

capturing an input sequence of input element interactions by the input object;

converting the captured input sequence into no more than one data entry input associated with the captured input sequence, wherein all data entry inputs associated with input sequences are stored in a dictionary on a memory; and

unconditionally and immediately selecting the data entry input associated with the captured input sequence from the memory and activating the converted data entry input without interpretation of the input sequence, without further interaction of input elements of the input surface by the input object, and without external selection or confirmation of the data entry input associated with the sequence.

30. The method of claim 29, further comprising the step of unconditionally and immediately activating the single input associated with the captured input sequence after the surface interaction is discontinued.

31. The method of claim 29, further comprising the step of indicating an input associated with the captured input sequence during the sweep.

32. The method of claim 29, further comprising the step of interacting with the first and the at least second input elements which can be detected to create the input sequence related to at least one of the position and order of the input elements with respect to each other about the input surface.

33. The method of claim 29, further comprising the steps of interacting with at least two input elements simultaneously, wherein the interaction of at least two input elements simultaneously is detected as one of the interactions selected from the group of:

an interaction with the input element first individually interacted with, an interaction with the input element last individually interacted with, an interaction of none of the input elements, an interaction with a group of all input element individually interacted with; and

an interaction with the input element most prevalently interacted with by the input object.

34. The method of claim 29, wherein the input sequence is formed in accordance with at least one of the position and order of the input elements with respect to each other about the input surface.

35. The method of claim 34, wherein the input sequence is formed by an ordered sequence of rotation through at least two input elements of a plurality of input elements positioned in a closed curve about the input surface.

36. The method of claim 35, wherein the input sequence is formed by position of the first element of the curve, the rotational direction of the ordered sequence along the curve, and the number of input elements in the sequence between the first and last input elements, and wherein the number of input elements in the sequence takes into account any complete revolutions of a loop of the close curve.

37. The method of claim 29, further comprising the step of operating an electronic device using the captured data entry sequence.

38. The method of claim 37, wherein the step of operating a compact electronic device includes operating a device selected from the group consisting of:

a portable electronic device, a media player, a portable computer, a mobile phone, a pager, a personal data assistant (PDA), a portable medical device, a global positioning system (GPS) device, a dictionary, a translator device, a personal information manager, a labeler, and a watch.

39. A data entry device comprising at least two non-adjacent input elements defining input element zones of an input surface, wherein the non-adjacent input elements are separated by gaps therebetween and adapted to sense an input object touching the input surface to create a data entry input sequence from a single continuous sweep of the input object, wherein at least one of the input elements is defined by a shape selected from the group consisting of a line and a planar area, wherein the single continuous sweep comprises a continuous interaction between the input object and the input surface within the input region, wherein the data entry input sequence is associated with no more than one input, wherein all inputs associated with data entry input sequences are stored in a dictionary on the memory, the input associated with the data entry input sequence being unconditionally and immediately selected from the memory and activated without interpretation of the input sequence, without further interaction of input elements of the input surface by the input object, and without external selection or confirmation of the data entry input associated with the sequence.

40. The data entry device of claim 39, wherein the input surface is defined by at least one of the textures selected from the group of:

smooth, bumped, ribbed, grooved, concave, convex, and curved.

41. The data entry device of claim 39, wherein data entry selected from the group consisting of letters of an alphabet, numbers, syllables, ideographic characters, script elements, strings, macros, continuous values, discrete values, list values, control parameters, control actions, functions, and symbols are entered by input sequences of sweeps between combinations of at least two input elements positioned about an input surface having non-adjacent input elements at the periphery of the input surface.

42. The data entry device of claim 39, wherein data entry selected from the group consisting of letters of an alphabet, numbers, syllables, ideographic characters, script elements, strings, macros, continuous values, discrete values, list values, control parameters, control actions, functions, and symbols are entered by input sequences of rotational sweeps through at least two non-adjacent input elements at rotational positions of input element zones about a round input surface.

43. The data entry device of claim 39, wherein a function is entered by an input sequence.

44. The data entry device of claim 43, wherein the function is a change selected from the group of parameters of frequency, volume, bass, treble, fade, balance, play speed, listening speed, temperature, humidity, time, pressure, acceleration, weight, coordinate, distance, direction, angle, and position in a list.

45. The data entry device of claim 43, wherein the function is a control function selected from the group of (i) advancing the track of a digital media player, (ii) reversing the track of a digital media player, (iii) pausing the play of a digital media player, (iv) beginning the play of a digital media player, (v) stopping the play of a digital media player, (vi) advancing the play of a digital media player, (vii) reversing the play of a digital media player, (viii) increasing the volume of a digital media player, (ix) decreasing the volume of a digital media player;

(x) control of burners of a stove;

(xi) control of temperature of an oven, (xii) control of a timer associated with use of an oven;

(xiii) control of temperature of a zone of a refrigerator or freezer, (xiv) control of humidity of a zone of a refrigerator or freezer, (xv) control of power level of a microwave, (xvi) control of cooking time of a microwave, (xvii) control of cooking modes of a microwave, (xviii) control of options of a microwave, and (xix) control of activation of a microwave, (xx) selecting a recorded program of a digital video recorder, (xxi) pausing the play of a digital video recorder, (xxii) beginning the play of a digital video recorder, (xxiii) stopping the play of a digital video recorder, (xxiv) advancing the play of a digital video recorder, (xxv) reversing the play of a digital video recorder, (xxvi) increasing the speed of play of a digital video recorder, (xxvii) decreasing the speed of play of a digital video recorder, and (xxiii) deleting a recorded program of a digital video recorder, wherein the control function is entered by the input sequence.

46. The data entry device of claim 43, wherein the function is a change in selection of at least one of the following from the group of:

(i) a language script element from a predefined set of language script elements, (ii) a value from a predefined set of values, (iii) a mode from a predefined set of operating modes, (iv) a menu item selected from a predefined set of menu items, (v) an operation selected from a predefined set of available operations, and (vi) a channel selected from a predefined set of available channels.

47. The data entry device of claim 43, wherein the function is an incremental change of a discrete parameter entered by the input sequence.

48. The data entry device of claim 43, wherein the function is an incremental change in a continuous parameter entered by the input sequence.

49. The data entry device of claim 47, wherein the value of the incremental change is constant.

50. The data entry device of claim 48, wherein the value of the incremental change is dynamic and depends upon at least one of the following parameters selected from the group of:

(i) a current value of the parameter, (ii) length of the input sequence, (iii) duration of the sweep, and (iv) speed of the input object over the input surface.

51. The data entry device of claim 39, wherein an input is entered by an input sequence.

52. The data entry device of claim 51, wherein the input is explicitly defined in a dictionary with associations between available inputs and input sequences.

53. The data entry device of claim 51, wherein the input is implicitly defined by markings on the input surface.

54. The data entry device of claim 51, wherein the input sequence is formed by an ordered sequence of rotation through at least two input elements of a plurality of input elements positioned in a closed curve about the input surface, wherein the input is defined by a function depending upon position of the first element of the curve, the rotational direction of the ordered sequence along the curve, and the number of input elements in the sequence between the first and last input elements, and wherein the number of input elements in the sequence takes into account any complete revolutions of a loop of the closed curve.