Definition and use of node-based shapes, areas and windows on touch screen devices

• US 9,268,423 B2
• Filed: 04/13/2013
• Issued: 02/23/2016
• Est. Priority Date: 09/08/2012
• Status: Expired due to Fees

• Current Assignee: Stormlit Ltd.
• Original Assignee: Stormlit Ltd.
• Inventors: Stone, Norman Michael
• Primary Examiner(s): OSORIO, RICARDO
• Application Number:
  US13/862,382
• Publication Number:
  US 20150338942A1
• Time in Patent Office: 1,046 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

A method and system are presented which will detect combinations of user touches on a touch screen device as nodes, and will create shapes, areas and windows from these nodes. Where the device has a communications capability, the locally defined shapes, areas and windows can be shared with remote users and databases, and similarly shapes, areas and windows created by others can be viewed on a local display. The method and system are of particular benefit to drawing applications, windows definition on touch screen devices, real estate management, navigation, and exploitation of mapping resources.

Claims

1. A method for interpreting multiple, concurrent user touches on a touch screen device to create and edit shapes on the display of said touch screen device, comprising:

a. recognition of single and multiple, concurrent user touches to a touch screen device,

b. interpretation of said user touches as node positions and associated node motions on the screen display of said touch screen,

c. interpretation of said node positions, and said node motions to determine the geometric shape to be drawn on the touch screen display,

d. retaining recognition and information of said shape persistently after the user touches to the touch screen device have ceased,

e. allowing reselection by a user of a previously defined shape for operation on that geometric entity,

f. allowing reselection by a user of any node of a previously defined shape for operation on that node.

2. The method of claim 1 wherein the number of said concurrent user touches is interpreted as two, and one of the nodes produced by these remains substantially motionless for a predetermined length of time while the other node initially moves and subsequently also remains substantially motionless for a predetermined length of time, thereby resulting in the drawing of a circle centered on the initially stationary node and passing through the initially moving node.

3. The method of claim 1 wherein the number of said concurrent user touches is interpreted as two, and both of the nodes produced by said concurrent user touches initially move and subsequently remain substantially motionless for a predetermined length of time, thereby resulting in the drawing of a rectangle determined by the positions of the two nodes at diagonally opposite corners.

4. The method of claim 3 wherein the two concurrent user touches are initially detected as a single node due to proximity of said user touches to each other before the movement of the two resultant nodes apart.

5. The method of claim 1 wherein the number of said concurrent user touches is interpreted as three and the nodes produced by these remain substantially motionless for a predetermined length of time, thereby resulting in the drawing of a triangle between the three nodes such that each node position becomes an apex of the triangle.

6. The method of claim 1 wherein the number of said concurrent user touches is interpreted as four and the nodes produced by these remain substantially motionless for a predetermined length of time, thereby resulting in the drawing of a quadrilateral shape between the four nodes such that each node position becomes a corner of the quadrilateral.

7. The method of claim 1 wherein the number of said concurrent user touches is interpreted as five and the nodes produced by these remain substantially motionless for a predetermined length of time, thereby resulting in the drawing of a pentagon between the five nodes such that each node position becomes a vertex of the pentagon.

8. The method of claim 1 wherein the number of said concurrent user touches is interpreted as greater than five and the nodes produced by these remain substantially motionless for a predetermined length of time, thereby resulting in the drawing of a polygon between the plurality of nodes such that each node position becomes a vertex of said polygon.

9. The method of claim 1 wherein reselection of the shape is via the user touching a node or side of the shape for a predetermined period of time.

10. The method of claim 1 wherein said operation on said geometric entity is movement of the whole geometric entity with all nodes being moved together with respect to the virtual area or background so that the nodes are not moved in relation to one another.

11. The method of claim 1 wherein said operation on said geometric entity is the addition of user-defined information into predetermined fields to categorise, label or otherwise define parameters relating to the geometric entity in the area of application.

12. The method of claim 1 wherein said operation on said geometric entity is the deletion of the geometric entity.

13. The method of claim 1 wherein said operation on said geometric entity is an independent moving of two component nodes of said geometric entity along two orthogonal axes of said touch screen module such that a two dimensional stretching or compressing of said geometric entity occurs proportional to the movement of the two nodes in each axis.

14. The method of claim 13 wherein said two dimensional stretching or compressing is of two nodes on the circumference of a circle geometric entity such that an ellipse shape is created from the original circle.

15. The method of claim 1 wherein one or more sub-nodes is automatically created at intervals along the sides of a shape, allowing the user to identify, select and move any said sub-node whereby said sub-node becomes a new node of said shape and a new side is added to said shape.

16. The method of claim 1 wherein the number of sides in a geometric shape is decreased by user selection of a node of said shape and a subsequent deletion operation on said selected node occurs, whereby nodes previously connected to the deleted node are directly joined.

17. The method of claim 1 wherein said geometric shape becomes the boundary within said touch screen module of an area comprising a two dimensional image, map or surface having its own coordinate system such that the bounding node positions of said areas on the display of said touch screen correspond to the coordinates of said image, map or surface.

18. The method of claim 1 wherein said geometric shape is created on top of an existing two dimensional image, map or surface having its own coordinate system such that the bounding node positions of said shape define coordinates of said two dimensional image, map or surface displayed on said touch screen module, and a subsequent pan and zoom operation is performed either to the specific area of said image, map or surface defined by said geometric shape or to an area centered on and including said specific area which also shows additional surrounding area due to differences in shape or aspect ratio of the said shape and the available screen area.

19. The method of claim 1 wherein said geometric shape becomes the boundary within said touch screen module of a new window which runs a software application independent from any main or background software application, and independent from a software application running in any other window.

20. The method of claim 19 wherein selection options for applications to run in said new window are presented to the user in a menu or list adjacent to the new window after creation of the new window.

21. The method of claim 19 wherein selection options for applications to run in said new window are presented to the user via icons appearing inside the new window after creation of the new window.

22. The method of claim 19 wherein an applications to run in said new window is selected by the user prior to creation of the new window.

23. An apparatus, comprising:

a. a touch screen module incorporating a touch panel adapted to receiving user input in the form of multi-touch shape gestures including finger touches and finger movements, and a display surface adapted to present node and shape information to the user,

b. a control module which is operatively connected to said touch screen module to determine node positions from said finger touches, to determine node motions from said finger movements, to recognize a geometric shape from combinations of said node positions and node motions, to recognize an application associated with said geometric shape, to detect a selection touch to a pre-existing said shape, to control the editing of said selected shape, to control other modules and to generate a continuous graphical image including said node positions and plurality of said geometric shapes for display on the touch screen module,

c. a memory module logically connected to said control module which is able to store from and provide to said control module a logical element selected from the group consisting of operating systems, system data for said operating systems, applications which can be executed by the control module, data for said applications, node data shape data, area data and windows data.

24. The apparatus of claim 23, wherein the apparatus is selected from the group consisting of a mobile telephone with a touch screen, a tablet computer with a touch screen, a satellite navigation device with a touch screen, an electronic book reader with a touch screen, a television with a touch screen, a desktop computer with a touch screen, a notebook computer with a touch screen and a workstation computer of the type used in command and control operations centers such as air traffic control centers, but having a touch screen.

25. The apparatus of claim 23, wherein the node, shape, area and window information presented to the user includes node symbols, shapes, areas and windows currently detected or selected.

26. The apparatus of claim 23, wherein the node, shape, area and window information presented to the user includes node symbols, shapes, areas and windows from previous user touches, recalled from memory, previously defined, or received from a remote database, device or application.

27. The apparatus of claim 23, wherein a communications module is incorporated adapted to the transfer of node, shape, area and window information including node position and shape type, to and from other devices, networks and databases.

28. The apparatus of claim 27, wherein the control module will accept external node, shape, area and window data from said communications module and pass them to the touch screen module for display to the user.

29. The apparatus of claim 27, wherein the control module will pass locally created nodes, shapes, areas and windows to the communications module for communication to other devices, networks and databases.

30. The apparatus of claim 23, wherein said geometric shapes recognised by said control module from the detected node positions and node movements include circles, rectangles, triangles, quadrilaterals, pentagons and polygons with greater than five vertices.

31. The apparatus of claim 23, wherein the edits to selected shapes includes the transformation of a selected circle into an ellipse.

32. The apparatus of claim 23, wherein the edits to selected shapes includes the two dimensional stretching of a selected shape in the axes determined by node movements.

33. The apparatus of claim 23, wherein the edits to selected shapes, areas and windows includes the creation of shapes, areas and windows with one side more than when selected, by the addition of a new node between two existing nodes of a shape.

34. The apparatus of claim 23, wherein the node positions of a re-selected geometric shape, area or window are moved by the node being touched with a finger which is moved over the surface of said touch screen module wherein the node moves accordingly, and the said geometric shape, area or window is modified accordingly.

35. The apparatus of claim 23, wherein said geometric shapes are re-selected by a non-moving user touch of a constituent node of said geometric shape for a period of less than three seconds, after which the whole geometric shape is moved accordingly by subsequent movement of said constituent node.

36. The apparatus of claim 23, wherein the said geometric shapes recognised by said control module represent areas on a two dimensional image, map or surface having its own coordinate system wherein the bounding node positions of said areas on the display of said touch screen correspond to the coordinates of said image, map or surface.

37. The apparatus of claim 23, wherein the said geometric shapes recognised by said control module represent window boundaries on the display of said touch screen such that a plurality of independent computer programs or applications are run concurrently on said display.

38. The apparatus of claim 23, wherein said geometric shapes recognised by said control module represent area boundaries on the display of said touch screen such that a combined pan and zoom operation is performed to the specified said area boundary.