Gesture-equipped touch screen system, method, and computer program product

• US 10,521,047 B1
• Filed: 01/08/2019
• Issued: 12/31/2019
• Est. Priority Date: 08/05/2011
• Status: Active Grant

• Current Assignee: Smith Interface Technologies, LLC
• Original Assignee: P4tents1 LLC
• Inventors: Smith, Michael S
• Primary Examiner(s): Xavier, Antonio
• Application Number:
  US16/243,058
• Time in Patent Office: 357 Days
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/1647 including at least an additional display G06F1/1692 takes precedence
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/045 using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 9/4843 : by program, e.g. task dispatcher, supervisor, operating system

Abstract

In one embodiment, a system, method, and computer program product are provided to: display a textual word; detect a gesture via the touch screen on the textual word; in a first touch state, perform a first function in connection with the textual word; in a second touch state, perform a second function in connection with the textual word, the second function including selecting the textual word so as to display a selection of the textual word in a separate virtual display layer that is at least partially transparent or translucent for viewing an insertion point of the textual word.

Claims

1. An apparatus, comprising:

at least one non-transitory memory storing instructions and a plurality of applications;

a touch screen; and

one or more processors in communication with the at least one non-transitory memory and the touch screen, wherein the one or more processors execute the instructions to cause the apparatus to;

display a textual word in a virtual display layer;

detect a gesture via the touch screen on the textual word;

in a first touch state, perform a first function in connection with the textual word the first function including selecting the textual word; and

in a second touch state, perform a second function in connection with movement of the selected textual word, the second function including displaying the selected textual word in a plurality of virtual display layers including the virtual display layer and a separate virtual display layer, such that at least one of the plurality of virtual display layers is at least partially translucent.

2. The apparatus of claim 1, wherein the apparatus is configured such that the selected textual word is displayed to include a bounding shape surrounding the selected textual word.

3. The apparatus of claim 1, wherein the apparatus is configured such that the first function is performed in response to detection of a cessation of the gesture.

4. The apparatus of claim 1, wherein the apparatus is configured such that the first function is performed while the gesture is being detected.

5. The apparatus of claim 1, wherein the apparatus is configured such that the first function is conditionally performed, based on detection of a cessation of the gesture before a duration of the gesture surpassing a predetermined duration threshold.

6. The apparatus of claim 1, wherein the apparatus is configured such that the gesture includes a double tap gesture, and the first function further includes shading the selected textual word.

7. The apparatus of claim 1, wherein the apparatus is configured such that the gesture includes a drag gesture.

8. The apparatus of claim 1, wherein the apparatus is configured such that the second function is performed in the event of detection of a separate gesture on the textual word after the gesture.

9. The apparatus of claim 1, wherein the apparatus is configured such that the second function is performed in the event of detection of a separate gesture on the textual word after a lift off event is detected for the gesture.

10. The apparatus of claim 1, wherein the apparatus is configured such that the second function is conditionally performed, based on detection of a separate gesture on the textual word having a duration surpassing a predetermined duration threshold.

11. The apparatus of claim 10, wherein the apparatus is configured such that a visual aspect of the selected textual word in the virtual display layer is changed, based on detection of the separate gesture having the duration surpassing the predetermined duration threshold.

12. The apparatus of claim 10, wherein the apparatus is configured such that the separate gesture includes a press gesture.

13. The apparatus of claim 10, wherein the apparatus is configured such that the separate gesture includes a press gesture component and a subsequent drag gesture component that are both part of the same single continuous gesture.

14. The apparatus of claim 10, wherein the apparatus is configured such that the display of the selected textual word in the plurality of virtual display layers, continues while the separate gesture continues to be detected.

15. The apparatus of claim 10, wherein the apparatus is configured such that the display of the selected textual word in the separate virtual display layer, continues only while the separate gesture continues to be detected.

16. The apparatus of claim 10, wherein the apparatus is configured such that the display of the selected textual word in the plurality of virtual display layers, continues until detection of a cessation of the separate gesture, in response to which the selected textual word in the separate virtual display layer is no longer displayed.

17. The apparatus of claim 10, wherein the apparatus is configured such that the display of the selected textual word in the plurality of virtual display layers, continues until detection of a cessation of the separate gesture, in response to which the separate virtual display layer and the selected textual word therein are no longer displayed.

18. The apparatus of claim 10, wherein the apparatus is configured such that the display of the selected textual word in the plurality of virtual display layers, continues until detection of a cessation of the separate gesture, in response to which the selected textual word in the separate virtual display layer is no longer displayed, and the selected textual word is pasted at a different location in the virtual display layer.

19. The apparatus of claim 10, wherein the apparatus is configured such that the display of the selected textual word in the separate virtual display layer continues until detection of a cessation of the separate gesture, in response to which:

the selected textual word in the separate virtual display layer is no longer displayed, the selected textual word is no longer displayed at an original location in the virtual display layer, and the selected textual word is displayed at a different location in the virtual display layer.

20. The apparatus of claim 10, wherein the apparatus is configured such that the display of the selected textual word in the separate virtual display layer continues until detection of a cessation of the separate gesture, wherein the apparatus is further configured such that the selected textual word is no longer displayed at an original location in the virtual display layer, and the selected textual word is displayed at a different location in the virtual display layer.

21. The apparatus of claim 10, wherein the apparatus is configured such that the display of the selected textual word in the separate virtual display layer continues until detection of a cessation of the separate gesture, in response to which:

the selected textual word is removed from the separate virtual display layer, the selected textual word is cut from an original location in the virtual display layer, and the selected textual word is pasted at a different location in the virtual display layer.

22. The apparatus of claim 1, wherein the apparatus is configured such that, in the second touch state, the selected textual word in the separate virtual display layer is moved in response to detection of a separate gesture including movement.

23. The apparatus of claim 1, wherein the apparatus is configured such that at least one of the plurality of virtual display layers is at least partially translucent to facilitate identifying an insertion point for the selected textual word.

24. The apparatus of claim 1, wherein the apparatus is configured such that the virtual display layer is at least partially translucent.

25. The apparatus of claim 1, wherein the apparatus is configured such that the separate virtual display layer is at least partially translucent.

26. The apparatus of claim 1, wherein the apparatus is configured such that at least one of the plurality of virtual display layers is at least partially translucent, by an entirety thereof excluding the selected textual word, being at least partially translucent.

27. The apparatus of claim 1, wherein the apparatus is configured such that an entirety of a bounding box, excluding the selected textual word therein, in at least one of the plurality of virtual display layers is at least partially translucent.

28. The apparatus of claim 1, wherein the apparatus is configured such that the selected textual word displayed in at least one of the plurality of virtual display layers is not translucent.

29. The apparatus of claim 1, wherein the apparatus is configured such that, in the second touch state, at least one aspect of the selected textual word displayed in the virtual display layer is altered.

30. The apparatus of claim 1, wherein the apparatus is configured such that, in the second touch state, the selected textual word displayed in the virtual display layer is faded.

31. The apparatus of claim 1, wherein the apparatus is configured such that the separate virtual display layer is not displayed during the first touch state.

32. The apparatus of claim 1, wherein the apparatus is configured such that the separate virtual display layer is not displayed before the second touch state.

33. The apparatus of claim 1, wherein the apparatus is configured such that the selected textual word is displayed in the plurality of virtual display layers, by the selected textual word being copied to the separate virtual display layer.

34. The apparatus of claim 1, wherein the apparatus is configured such that the second function is performed prior to the movement of the selected textual word.

35. The apparatus of claim 1, wherein the apparatus is configured such that the second function is performed during the movement of the selected textual word.

36. The apparatus of claim 1, wherein the apparatus is configured such that, in a third touch state, a third function is performed including the movement of the selected textual word.

37. The apparatus of claim 1, wherein the apparatus is configured such that:

the second function is conditionally performed, based on detection of a separate gesture on the textual word that is detected after the gesture;

the display of the selected textual word in the separate virtual display layer, continues only while the separate gesture continues to be detected;

in response to detection of a cessation of the separate gesture, the separate virtual display layer and the selected textual word therein are no longer displayed; and

the selected textual word is cut from an original location in the virtual display layer and pasted at a different location in the virtual display layer.

38. The apparatus of claim 37, wherein the apparatus is configured such that the selected textual word is cut from the original location in the virtual display layer, in response to detection of the cessation of the separate gesture.

39. The apparatus of claim 37, wherein the apparatus is configured such that the selected textual word is pasted at the different location in the virtual display layer, in response to detection of the cessation of the separate gesture.

40. The apparatus of claim 37, wherein the apparatus is configured such that the second function is conditionally performed, based on detection of the separate gesture that has a duration surpassing a predetermined duration threshold.

41. The apparatus of claim 37, wherein the apparatus is configured such that the apparatus is conditionally vibrated, based on detection of the separate gesture.

42. The apparatus of claim 37, wherein the apparatus is configured such that the second function is performed prior to the movement of the selected textual word.

43. The apparatus of claim 37, wherein the apparatus is configured such that the second function is performed during the movement of the selected textual word.

44. The apparatus of claim 37, wherein the apparatus is configured such that, in a third touch state, a third function is performed including the movement of the selected textual word.

45. The apparatus of claim 37, wherein at least one of:

the movement includes relocation;

the movement includes pasting the selected word;

the movement does not include pasting the selected word;

the selected textual word includes a single textual word;

the selected textual word includes multiple textual words;

the selected textual word is displayed both in the virtual display layer and in the separate virtual display layer, by being displayed identically in the virtual display layer and in the separate virtual display layer;

the selected textual word is displayed both in the virtual display layer and in the separate virtual display layer, by being displayed differently in the virtual display layer and in the separate virtual display layer;

the selected textual word is displayed both in the virtual display layer and in the separate virtual display layer, by being displayed with different formatting in the virtual display layer and in the separate virtual display layer;

the selected textual word is displayed both in the virtual display layer and in the separate virtual display layer, by being displayed with different information in the virtual display layer and in the separate virtual display layer;

the selected textual word is displayed both in the virtual display layer and in the separate virtual display layer, by the selected textual word being copied to the separate virtual display layer;

the separate virtual display layer is displayed before the selected textual word is displayed in the separate virtual display layer;

the gesture and the separate gesture are detected on the textual word by being detected at a same point on the textual word;

the gesture and the separate gesture are detected on the textual word by being detected at different points on the textual word;

the gesture and the separate gesture are detected on the textual word by being detected at different points within a predetermined distance of the textual word;

the at least one of the virtual display layer or the separate virtual display layer is at least partially translucent for providing an appearance of the selected textual word pushing through at least one of the virtual display layer or the separate virtual display layer;

the virtual display layer is above the separate virtual display layer;

the virtual display layer is below the separate virtual display layer;

the plurality of virtual display layers differ in size;

the plurality of virtual display layers are offset;

the second touch state occurs in response to detection of a separate gesture that occurs after a lift off event is detected for the gesture;

the textual word is the only object in the separate virtual display layer;

the second touch state occurs in response to detection of a separate gesture;

a degree of the translucency is a function of user input;

a degree of the translucency is not a function of user input;

the second function is performed during an entirety of the second touch state;

the second function is performed during at least a portion of the second touch state;

the second function is performed in response to a detection of the second touch state;

the touch screen is pressure sensitive;

the touch screen is not pressure sensitive;

at least one of the plurality of virtual display layers is at least partially translucent by being at least partially transparent;

the separate virtual display layer is at least partially translucent, by at a least portion of the separate virtual display layer being translucent;

the separate virtual display layer is at least partially translucent, by an entirety of the separate virtual display layer being translucent;

the separate virtual display layer is at least partially translucent, by an entirety of the separate virtual display layer, including the textual word, being at least partially translucent;

the separate virtual display layer is at least partially translucent, by an entirety of the separate virtual display layer, excluding the textual word, being at least partially translucent;

the virtual display layer is at least partially translucent, by at a least portion of the virtual display layer being translucent;

the virtual display layer is at least partially translucent, by an entirety of the virtual display layer being translucent;

the virtual display layer is at least partially translucent, by an entirety of the virtual display layer, including the textual word, being at least partially translucent;

or

the virtual display layer is at least partially translucent, by an entirety of the virtual display layer, excluding the textual word, being at least partially translucent.

46. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a device, cause the device to:

display a textual word in a virtual display layer;

detect a gesture on the textual word;

in response to the gesture, selecting the textual word; and

detect another gesture on the textual word;

in response to the gesture, perform a second function in connection with movement of the selected textual word, the second function including displaying the selected textual word in a plurality of virtual display layers including the virtual display layer and a separate virtual display layer, such that at least one of the plurality of virtual display layers is at least partially translucent.

47. The non-transitory computer readable storage medium of claim 46, wherein the instructions, when executed by the device, cause the device to operate such that:

the second function is conditionally performed, based on detection of a separate gesture on the textual word that is detected after the gesture;

the display of the selected textual word in the separate virtual display layer, continues only while the separate gesture continues to be detected;

in response to detection of a cessation of the separate gesture, the separate virtual display layer is no longer displayed; and

the selected textual word is cut from an original location in the virtual display layer and pasted at a different location in the virtual display layer.

48. The non-transitory computer readable storage medium of claim 47, wherein the instructions, when executed by the device, cause the device to operate such that the selected textual word is cut from the original location in the virtual display layer, in response to detection of the cessation of the separate gesture.

49. The non-transitory computer readable storage medium of claim 47, wherein the instructions, when executed by the device, cause the device to operate such that the selected textual word is pasted at the different location in the virtual display layer, in response to detection of the cessation of the separate gesture.

50. The non-transitory computer readable storage medium of claim 47, wherein the instructions, when executed by the device, cause the device to operate such that the second function is conditionally performed, based on detection of the separate gesture that has a duration surpassing a predetermined duration threshold.

51. The non-transitory computer readable storage medium of claim 47, wherein the instructions, when executed by the device, cause the device to operate such that the selected textual word is faded, in response to detection of the separate gesture.

52. The non-transitory computer readable storage medium of claim 47, wherein the instructions, when executed by the device, cause the device to operate such that the second function is performed prior to the movement of the selected textual word.

53. The non-transitory computer readable storage medium of claim 47, wherein the instructions, when executed by the device, cause the device to operate such that the second function is performed during the movement of the selected textual word.

54. The non-transitory computer readable storage medium of claim 47, wherein the instructions, when executed by the device, cause the device to operate such that, in response to movement in the separate gesture, the selected textual word is moved.