Method for creating and operating control systems

• US 20020141643A1
• Filed: 02/15/2001
• Published: 10/03/2002
• Est. Priority Date: 02/15/2001
• Status: Abandoned Application

• Current Assignee: Intertact Corporation
• Original Assignee: Intertact Corporation
• Inventors: Jaeger, Denny
• Application Number:
  US09/785,049
• Publication Number:
  US 20020141643A1
• Time in Patent Office: Days
• US Class Current: 382/181
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Abstract

A method for on-screen programming of an electronic device includes hand drawing of graphic inputs on-screen. The graphic inputs are recognized by determining the vertices, trend, size, context, and other parameters, and, once recognized, are converted to functional objects on-screen. The functional objects may be linked in a selected order by arrows or lines to produce a desired output, or may be ganged for action in common. The device may provide a control panel for signal processing, or a telephone display for controlling call blocking and call answering.

Claims

1. In an electronic device that accepts hand drawn entries, a method for recognizing the hand drawn entries, comprising the steps of:

receiving each hand drawn entry as a plurality of sequential points;

performing at least one of the following steps in any order;

measuring the size of the hand drawn entry and comparing the size of the hand drawn entry to a size range;

determining the existence and number and angles of vertices in a line which could be drawn between said points;

comparing the results of said at least one step to a set of rules, a favorable comparison leading to conclusive identification of the hand drawn entry as an identified shape.

2. The method for recognizing hand drawn entries of claim 1, wherein said at least one step includes determining the distance between said vertices.

3. The method for recognizing hand drawn entries of claim 1, wherein said at least one step includes performing a Wide Pen Test.

4. The method for recognizing hand drawn entries of claim 1, wherein said at least one step includes performing a test for Golden Clues.

5. The method for recognizing hand drawn entries of claim 1, wherein said at least one step includes the step of excluding identification of shapes that do not conform to said set of rules.

6. The method for recognizing hand drawn entries of claim 1, wherein said at least one step includes excluding identification of shapes that do not conform to said set of rules regarding size.

7. The method for recognizing hand drawn entries of claim 1, further including a plurality of hand drawn entries, each of said hand drawn entries being analyzed individually.

8. The method for recognizing hand drawn entries of claim 1, further including a plurality of hand drawn entries, said lines being agglomerated and analyzed as a single entity.

9. The method for recognizing hand drawn entries of claim 1, further including a plurality of hand drawn entries of different colors, said set of rules including color rules to determine agglomeration of said entries as a single entity.

10. The method for programming an electronic device of claim 1, further including the step of using arrow logics to establish attributes of said identified shape.

11. The method for programming an electronic device of claim 1, further including the step of creating an info window for at least one of said identified shapes, said info window enabling setting and altering attributes for said at least one identified shape.

12. The method for recognizing hand drawn entries of claim 1, further including the step of carrying out further analytic tests to determine the specific object type.

13. The method for recognizing hand drawn entries of claim 1, wherein said at least one step includes determining the angular trend of said plurality of sequential points.

14. The method for recognizing hand drawn entries of claim 13, further including the step of excluding identification of shapes that do not conform to said set of rules regarding angular trend.

15. The method for recognizing hand drawn entries of claim 1, wherein said step of measuring the size includes the step of generating a minimum bounding rectangle to circumscribe the hand drawn entry.

16. The method for recognizing hand drawn entries of claim 15, further including the step of determining the size of said bounding rectangle, and comparing said size to size rules for at least one identifiable shape.

17. The method for recognizing hand drawn entries of claim 3, wherein said wide pen test includes the step of generating a minimum bounding rectangle to circumscribe the hand drawn entry.

18. The method for recognizing hand drawn entries of claim 17, further including the step of generating at least one identifiable geometric shape inscribed in said bounding rectangle, and comparing the coincidence of said points of said hand drawn entry with a wide pen stroke defining at least one identifiable geometric shape.

19. The method for recognizing hand drawn entries of claim 18, wherein said wide pen stroke is selected to be a predetermined width, and further including the step of adaptively altering said predetermined wide pen stroke width.

20. The method for recognizing hand drawn entries of claim 19, wherein the identifiable geometric shape yielding a degree of coincidence greater than a predetermined coincidence threshold is determined to be the shape of said hand drawn entry.

21. The method for recognizing hand drawn entries of claim 20, further including the step of adaptively altering said coincidence threshold.

22. The method for recognizing hand drawn entries of claim 20, further including the step of determining the angular trend of said hand drawn entry.

23. The method for programming an electronic device of claim 11, including the step of drawing at least one arrow from an attribute shown in an info window to at least one identified shape outside said info window.

24. The method for recognizing hand drawn entries of claim 1, further including the step of determining the angular orientation of said hand drawn entry with respect to a reference orientation.

25. The method for recognizing hand drawn entries of claim 24, further including the step of excluding identification of shapes that do not conform to said set of rules regarding angular orientation.

26. The method for recognizing hand drawn entries of claim 1, further including the step of determining the proximity of said hand drawn entry to another graphic object.

27. The method for recognizing hand drawn entries of claim 26, further including the step of excluding identification of shapes that do not conform to said set of rules regarding maximum proximate distance to said another graphic object.

29. The method for recognizing hand drawn entries of claim 1, further including the step of identifying a portion of said hand drawn entry drawn more slowly than other portions of said hand drawn entry.

30. The method for recognizing hand drawn entries of claim 29, further including the step of determining the existence of a vertex in said portion of said hand drawn entry, and calculating the vertex angle.

31. The method for recognizing hand drawn entries of claim 29, wherein said portion of said hand drawn entry is identified by storing and analyzing time of entry data of said plurality of points.

32. The method for recognizing hand drawn entries of claim 30, wherein if a vertex angle in said portion of said hand drawn entry is substantially orthogonal, said golden clue test provides increased potential for identifying a rectilinear shape.

33. The method for recognizing hand drawn entries of claim 30, wherein if a vertex angle in said portion of said hand drawn entry is substantially non-orthogonal, said golden clue test provides increased potential for exclusion of all rectilinear shapes.

34. The method for recognizing hand drawn entries of claim 30, wherein if a pair of vertex angles in said portion of said hand drawn entry are substantially orthogonal, proximate, and opposite, said golden clue test provides increased potential for identification of a folder shape.

35. The method for recognizing hand drawn entries of claim 30, wherein said golden clue test includes identifying a first-drawn portion of said hand drawn entry, determining the existence of a vertex in said first drawn portion of said hand drawn entry, and calculating the vertex angle.

36. The method for recognizing hand drawn entries of claim 35, wherein if a vertex angle in said first-drawn portion of said hand drawn entry is substantially orthogonal, said golden clue test provides increased potential for identification of rectilinear shapes.

37. The method for recognizing hand drawn entries of claim 35, wherein if a vertex angle in said first-drawn portion of said hand drawn entry is substantially non-orthogonal, said golden clue test provides increased potential for exclusion of all rectilinear shapes.

38. The method for recognizing hand drawn entries of claim 1, further including a slice step of identifying three of said points that are adjacent and spaced apart greater than a minimum pixel length distance, constructing an angle defined by said three points, measuring the constructed angle, and reiterating said slice step in serial fashion with consecutive points of said hand drawn entry to include substantially all said points of said hand drawn entry.

39. The method for recognizing hand drawn entries of claim 38, further including the step of storing the angle measurement of a slice when it exceeds a predetermined angle threshold.

40. The method for recognizing hand drawn entries of claim 39, further including the step of reducing said predetermined angle threshold whenever said reiterated slice step yields an angular measurement less than said predetermined angle threshold.

41. The method for recognizing hand drawn entries of claim 39, wherein if an angle measurement of a given slice step exceeds said predetermined angle threshold, and the angle measurement of the subsequent slice step is less than said predetermined angle threshold, a vertex is identified in the portion of said hand drawn entry containing said given slice step.

42. The method for recognizing hand drawn entries of claim 1, wherein said at least one step includes detecting and storing the first pen down location of said hand drawn entry.

43. The method for recognizing hand drawn entries of claim 1, wherein said at least one step includes detecting and storing the direction of the pen stroke of said hand drawn entry.

44. The method for recognizing hand drawn entries of claim 1, wherein said at least one step includes measuring the speed of drawing said hand drawn entry.

45. The method for recognizing hand drawn entries of claim 44, wherein said speed of drawing is determined by detecting the point-to-point spacing between said sequential points of said hand drawn entry, the point-to-point spacing varying directly with said speed of drawing.

46. The method for recognizing hand drawn entries of claim 44, wherein said speed of drawing is determined by recording the time of entry of each of said sequential points, and calculating the speed of drawing from said time of entry data.

47. The method for recognizing hand drawn entries of claim 1, further including the step of weighting the importance of the comparison of results to said set of rules, whereby some comparison results are accorded more importance in determining the identified shape.

48. The method for recognizing hand drawn entries of claim 1, wherein said results of said at least one step include numerical parameters that correspond to characteristics of said hand drawn entry, said numerical parameters being compared to stored magic number values.

49. The method for recognizing hand drawn entries of claim 48, wherein said magic number values are selectively varied in response to inconclusive comparisons to said set of rules.

50. The method for recognizing hand drawn entries of claim 49, wherein said magic number values can be selectively varied by user input.

95. The method for programming an electronic device of claim 11, including the step of drawing at least one arrow to an attribute shown in an info window from at least one identified shape outside said info window.

96. The method for recognizing hand drawn entries of claim 40, wherein the maximum total reduction of said predetermined angle threshold is determined by a user-defined parameter.

51. In an electronic device that accepts hand drawn entries, a method for programming of said device, including the steps of:

using an input device to freehand draw at least one recognizable hand drawn entry;

performing at least one of the following steps in any order;

converting said at least one recognizable hand drawn entry into a functional device having a function that may be carried out by said electronic device;

converting said at least one recognizable hand drawn entry into an action that may be carried out by said electronic device.

52. The method for programming of claim 51, further including the step of assigning attributes to said recognizable hand drawn entry, said attributes defining said hand drawn entry as a functional device.

53. The method for programming of claim 51, further including the step of assigning attributes to said at least one recognizable hand drawn entry, said attributes comprising at least one action that may be carried out by said electronic device.

54. The method for programming of claim 51, further including the step of creating an info window for said at least one recognizable hand drawn entry, said info window enabling setting and altering attributes for said at least one hand drawn entry.

55. The method for programming of claim 51, further including the step of creating an info window for determining object recognition tests to identify said at least one recognizable hand drawn entry.

56. The method for programming of claim 51, further include the step of joining a plurality of functional devices in a utilitarian sequence.

57. The method for programming of claim 56, wherein said utilitarian sequence receives a designated input and produces a desired output.

58. The method for programming of claim 56, wherein said joining step includes the step of drawing at least one line extending to and intersecting said functional devices in said sequence.

59. The method for programming of claim 58, further including the step of selecting a line color for said at least one line, said functional devices being drawn in object colors, the coincidence of said line color and said object colors enabling the joining of said line and objects.

60. The method for programming of claim 51, further including the step of grouping a plurality of selected functional devices for action in common.

61. The method for programming of claim 60, wherein said grouping step includes the step of drawing a line that substantially circumscribes said selected functional devices.

62. The method for programming of claim 60, wherein said grouping step includes the step of drawing a line that substantially intersects said selected functional devices.

63. The method for programming of claim 60, wherein said grouping step includes the step of drawing a bracket that substantially spans said selected functional devices.

64. The method for programming of claim 51, further including the step of agglomerating at least two of said hand drawn entries into a single object.

65. The method for programming of claim 64, further including the step of enabling agglomeration only between at least two of said hand drawn entries having a common color.

66. The method for programming of claim 51, further including the step of applying functional parameters to a recognizable hand drawn entry by drawing a line from a functional device having defined functional parameters to a recognizable hand drawn entry lacking functional parameters.

67. The method for programming of claim 51, further including the step of assigning attributes to said at least one recognizable hand drawn entry by inputting text.

68. The method for programming of claim 51, further including the step of assigning attributes to said at least one recognizable hand drawn entry by making entries in an info window.

69. The method for programming of claim 51, further including the step of assigning attributes to said at least one recognizable hand drawn entry by inputting at least one verbal statement.

70. The method for programming of claim 51, further including providing an info window for each recognizable hand drawn entry, said info window enabling setting and altering attributes of said at least one recognizable hand drawn entry.

71. The method for programming of claim 70, wherein said info window attributes include the aesthetic properties of said recognizable hand drawn entry.

72. The method for programming of claim 70, wherein said info window attributes include the definition of recognizable hand drawn entry.

73. The method for programming of claim 70, wherein said info window attributes include the action of said recognizable hand drawn entry.

74. The method for programming of claim 70, wherein said info window attributes include the assignment of said recognizable hand drawn entry.

75. The method for programming of claim 74, wherein said assignment sets forth the ability of said recognizable hand drawn entry to acquire the attributes of another recognizable hand drawn entry that is disposed within a predetermined proximity.

76. The method for programming of claim 51, further including inputting a plurality of said recognizable hand drawn entries.

77. The method for programming of claim 76, further including the step of connecting said plurality of recognizable hand drawn entries.

78. The method for programming of claim 77, wherein said connected recognizable hand drawn entries receive a selected input and produce a desired output.

79. The method for programming of claim 77, wherein said step of connecting includes drawing a line that extends to each of said plurality of recognizable hand drawn entries.

80. The method for programming of claim 76, further including the step of grouping said plurality of recognizable hand drawn entries for action in common.

81. The method for programming of claim 80, wherein said grouping step includes drawing a bracket that encompasses said plurality of recognizable hand drawn entries.

82. The method for programming of claim 51, further including the step of using arrow logics to establish attributes of said at least one recognizable hand drawn entry.

83. The method for programming of claim 51, further including the step of applying a physical control device on-screen to said at least one functional device, said physical control device enabling a user to input variable control values to said at least one functional device.

84. The method for programming of claim 83, wherein said physical control device comprises a crack-and-peel controller.

85. The method for programming of claim 51, wherein said device includes a telephone, and further including the step of selective call blocking.

86. The method for programming of claim 85, including the step of assigning telephone numbers to a subset of said functional devices, drawing a symbol representing the call blocking function, and drawing an arrow from said symbol to one of said subset of functional devices to block calls from the telephone number represented by said one functional device.

87. The method for programming of claim 51, wherein said device includes a telephone, and further including the step of selective call answering.

88. The method for programming an electronic device of claim 87, including the step of assigning telephone numbers to a first subset of said functional devices, assigning different answering messages to a second subset of said functional devices, and drawing an arrow from one of said second subset of functional devices to one of said first subset of functional devices to assign the respective answering message to a call from a respective telephone number.

89. The method for programming an electronic device of claim 51, wherein said device displays a signal waveform, and said functional device comprises a chop tool juxtaposed over said signal waveform, said signal waveform being cut off at the point of intersection of said waveform and said chop tool.

90. The method for programming of claim 76, wherein said plurality of recognizable hand drawn entries comprise an audio control panel.

91. The method for programming of claim 76, further including the step of conveying the attributes of one functional device to another functional device by drawing an arrow from said one functional device to said another functional object.

92. The method for programming of claim 51, wherein said recognizable hand drawn entry comprises an arrow, and further including the step of recognizing the start point and end point of said arrow.

93. The method for programming of claim 92, wherein said arrow is assigned the function of conveying attributes from a recognizable hand drawn entry proximate to said starting point to a recognizable hand drawn entry proximate to said end point.

94. The method for programming of claim 92, wherein said arrow is assigned the function of copying a recognizable hand drawn entry proximate to said starting point to a location proximate to said end point.

97. The method for programming of claim 51, further including the step of creating an info window for said at least one recognizable hand drawn entry, each info window storing parameters determining the function of said at least one recognizable hand drawn entry.

98. The method for programming an electronic device of claim 54, including the step of drawing at least one arrow to an attribute shown in an info window from at least one identified shape outside said info window.

99. The method for programming an electronic device of claim 54, including the step of drawing at least one arrow from an attribute shown in an info window to at least one identified shape outside said info window.

100. The method for programming an electronic device of claim 51, wherein said device displays a graphic object, and said functional device comprises a chop tool juxtaposed over said graphic object, said graphic object being cut off at the line of intersection of said graphic object and said chop tool.

101. The method for programming of claim 91, further including the step of modifying the attribute conveyed by an arrow by entering a text command proximate to said arrow.

102. The method for programming of claim 92, further including the step of providing an info window for said arrow, said info window enabling setting and modifying attributes of said arrow.

103. The method for programming of claim 70, wherein said info window attributes include the function of a recognizable hand drawn entry.