Pressure-based touch screen system, method, and computer program product with virtual display layers

• US 10,222,895 B1
• Filed: 05/03/2018
• Issued: 03/05/2019
• Est. Priority Date: 08/05/2011
• Status: Active Grant

• Current Assignee: Smith Interface Technologies, LLC
• Original Assignee: P4tents1 LLC
• Inventors: Smith, Michael S
• Primary Examiner(s): Xavier, Antonio
• Application Number:
  US15/969,893
• Time in Patent Office: 306 Days
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/1647 including at least an additional display G06F1/1692 takes precedence
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/045 using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 9/4843 : by program, e.g. task dispatcher, supervisor, operating system

Abstract

Apparatuses and a computer-readable media are provided to: display an object and at least a portion of an interface in a same virtual display layer; detect a single static gesture being applied to the touch screen on the object, the single static gesture varying in pressure between a plurality of discrete touch states; perform a first pressure-dependent step-wise function in response to a first change in the discrete touch states; perform a second pressure-dependent step-wise function in response to a second change in the discrete touch states; and during at least a portion of the gesture and as a function of an increase in a magnitude of the pressure of the gesture being applied to the touch screen on the object, continuously blur the at least portion of the interface such that the at least portion of the interface and the object are displayed in different virtual display layers.

Claims

1. An apparatus, comprising:

at least one non-transitory memory storing instructions and a plurality of applications;

a touch screen; and

one or more processors in communication with the at least one non-transitory memory and the touch screen, wherein the one or more processors execute the instructions to cause the apparatus to;

display an object and at least a portion of an interface;

detect a gesture via the touch screen on the object;

perform a first function in a first touch state;

perform a second function in a second touch state; and

during detection of at least a portion of the gesture and based on a change in a pressure of the gesture being detected via the touch screen on the object, blur the at least portion of the interface.

2. The apparatus of claim 1, wherein the apparatus is configured such that the at least portion of the gesture is detected after the first touch state and before the second touch state.

3. The apparatus of claim 1, wherein the apparatus is configured such that the at least portion of the gesture is detected before the first touch state, and the second touch state is detected after the first touch state.

4. The apparatus of claim 1, wherein the apparatus is configured such that the first function is performed after a cessation of the gesture is detected.

5. The apparatus of claim 1, wherein the apparatus is configured such that the second function is performed before a cessation of the gesture is detected.

6. The apparatus of claim 1, wherein the apparatus is configured such that the first function and the second function are not performed if a cessation of the gesture is detected while the at least portion of the gesture is detected.

7. The apparatus of claim 1, wherein the apparatus is configured such that the blurring is a cue to a user regarding a level of the pressure of the gesture.

8. The apparatus of claim 1, wherein the apparatus is configured such that the blurring is a cue to a user regarding access to at least one of:

the first touch state or the second touch state.

9. The apparatus of claim 1, wherein the apparatus is configured such that the blurring emphasizes an accessibility, via the object, to at least one of:

the first touch state or the second touch state.

10. The apparatus of claim 1, wherein the apparatus is configured such that the blurring indicates a movement between a first virtual layer including the at least portion of the interface and a second virtual layer including the object.

11. The apparatus of claim 1, wherein the apparatus is configured such that the blurring indicates a movement of the object to a different virtual layer.

12. The apparatus of claim 1, wherein the apparatus is configured such that the gesture includes a press.

13. The apparatus of claim 1, wherein the apparatus is configured such that the gesture is a continuous gesture.

14. The apparatus of claim 1, wherein the apparatus is configured such that the gesture varies only in a level of the pressure.

15. The apparatus of claim 1, wherein the apparatus is configured such that the change includes a continuous change, and the blur includes a continuously changing blur.

16. The apparatus of claim 1, wherein the apparatus is configured such that the first touch state includes a cessation of the gesture and only the first touch state is detected for a first gesture to cause only the first function to be performed;

neither the first touch state nor the second touch state are detected for a second gesture to cause the blurring without the first function nor the second function being performed; and

only the second touch state is detected for a third gesture to cause the blurring and the second function to be performed without the first function being performed.

17. The apparatus of claim 1, wherein the apparatus is configured such that at least one of:

said touch screen includes a touch interface and a display;

said touch screen is a combination of a touch interface and a display;

said touch screen is on a front face of the apparatus;

said touch screen is on a back face of the apparatus;

said one or more processors is in direct communication with the at least one non-transitory memory, and the touch screen;

said one or more processors is in indirect communication with the at least one non-transitory memory, and the touch screen;

said one or more processors is in communication, via at least one bus, with the at least one non-transitory memory, and the touch screen;

said at least one non-transitory memory includes a single memory for storing the instructions and the plurality of applications;

said at least one non-transitory memory includes a first memory for storing the instructions and a second memory for storing the plurality of applications;

said interface includes a software interface;

said interface includes a graphical user interface;

said blur results from a three-dimensional depth cue;

said blur indicates a movement through different layers;

said first touch state is a surface touch state;

said second touch state is a surface touch state;

said first touch state is not a surface touch state;

said second touch state is not a surface touch state;

said first touch state includes a first sub-range of a range of measurable contact pressures, and the second touch state includes a second sub-range of the range of measurable contact pressures;

said first touch state includes a first threshold pressure within a range of measurable contact pressures, and the second touch state includes a second threshold pressure within the range of measurable contact pressures;

said first touch state includes a first threshold pressure within a range of measurable contact pressures that, when surpassed, triggers the first function, and the second touch state includes a second threshold pressure within the range of measurable contact pressures that, when surpassed, triggers the second function;

said gesture includes at least one of a touch gesture and/or a press gesture;

said gesture includes a combination of a touch gesture component and a press gesture component;

said pressure is detected utilizing one or more of a plurality of contact-sensing technologies including a capacitive-based contact sensing technology, a resistive-based contact sensing technology, an optical-based contact sensing technology, or a surface acoustic wave-based contact sensing technology;

said touch screen is a two-dimensional layered user interface;

said touch screen is a single layer user interface that simulates a three-dimensional layered user interface through use of virtual display layers;

said pressure on the touch screen on the object is detected, by being detected on a selection boundary that, at least in part, overlaps the object;

said first function includes a display function;

said second function includes a display function;

said first function includes a step-wise function;

said second function includes a step-wise function;

said first function is pressure dependent;

said second function is pressure dependent;

said first function is the same as the second function;

said first function is different from the second function;

said gesture does not involve movement across an interaction surface of the touch screen;

said gesture does not involve movement in proximity to an interaction surface of the touch screen;

said first function is associated with the first touch state, by a user;

said first function is associated with the first touch state, by a developer;

said first function is associated with the first touch state, via system learning;

said second function is associated with the second touch state, by a user;

said blurring occurs after the first touch state is detected and before the second touch state is detected;

said blurring occurs only after the first touch state is detected;

said blurring remains after the second touch state is detected;

said blurring is based on the change in the pressure of the gesture being detected on the touch screen on the object, by conditionally blurring based on the change in the pressure of the gesture being detected on the touch screen on the object reaching a threshold pressure;

said blurring is based on the change in the pressure of the gesture being detected on the touch screen on the object, by increasing based on the change in the pressure of the gesture being detected on the touch screen on the object;

said blur is based only on the change in the pressure of the gesture being detected via the touch screen on the object;

said blur is based on the change in the pressure of the gesture being detected via the touch screen on the object, in addition to one or more other factors;

said blur is based on the change in the pressure of the gesture being detected via the touch screen on the object, by being based on a function of the change in the pressure of the gesture being detected via the touch screen on the object;

said gesture is detected on an entirety of the object;

said gesture is detected on at least a portion of the object;

said pressure on the object is detected, by being detected within a selection boundary that, at least in part, overlaps the object;

said second function is associated with the second touch state, by a developer;

said second function is associated with the second touch state, via system learning;

said first touch state is detected without the second touch state being detected in a first use scenario, and the second touch state is detected without the first touch state being detected in a second use scenario;

or

said at least portion of the interface includes at least one other object.

18. An apparatus, comprising:

at least one non-transitory memory storing instructions and a plurality of applications;

a touch screen;

a vibrator; and

one or more processors in communication with the at least one non-transitory memory, the touch screen, and the vibrator, wherein the one or more processors execute the instructions to cause the apparatus to;

display a first object and at least one other object;

detect a gesture via the touch screen on the first object;

perform a first action in a first touch state;

perform a second action in a second touch state; and

during detection of at least a portion of the gesture between the first and second touch states and before a cessation of the gesture is detected, blur, based on a pressure of the gesture being detected via the touch screen on the first object, at least a portion of a virtual display layer in which the at least one other object resides.

19. The apparatus of claim 18, wherein the apparatus is configured such that the gesture is a continuous gesture.

20. The apparatus of claim 18, wherein the apparatus is configured such that the blurring is a cue to a user regarding a magnitude of the pressure of the gesture.

21. The apparatus of claim 18, wherein the apparatus is configured such that the blurring is a cue to a user regarding an accessibility of the second action via the first object.

22. A non-transitory computer-readable media storing computer instructions that, when executed by one or more processors of a mobile device, cause the mobile device to:

display an object and at least one other object;

detect a gesture on a touch screen on the object, the gesture varying in pressure; and

during detection of at least a portion of the gesture before a cessation thereof is detected, blur, based on a change in the pressure of the gesture being detected on the touch screen on the object, the at least one other object.

23. The non-transitory computer-readable media of claim 22, wherein the blurring is a cue to a user regarding the pressure of the gesture.

24. The non-transitory computer-readable media of claim 22, wherein the blurring is a cue to a user regarding an accessibility of a subsequent action via the object.

25. The non-transitory computer-readable media of claim 22, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that, simultaneous with the at least one other object being blurred, the at least one other object is faded.

26. The non-transitory computer-readable media of claim 22, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that, simultaneous with the at least one other object being blurred, a first size of the at least one other object is reduced as compared to a second size of the object.

27. The non-transitory computer-readable media of claim 26, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the first size of the at least one other object is continuously and increasingly reduced as compared to the second size of the object, and the blur of the at least one other object is continuously increased, both as a continuous function of an increase in the pressure of the gesture being detected on the touch screen on the object.

28. The non-transitory computer-readable media of claim 27, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the first size of the at least one other object is continuously and increasingly enlarged as compared to the second size of the object, and the blur of the at least one other object is continuously decreased, both as a continuous function of a decrease in the pressure of the gesture being detected on the touch screen on the object.

29. The non-transitory computer-readable media of claim 22, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that, simultaneous with the at least one other object being blurred, a first size of the object is enlarged as compared to a second size of the at least one other object.

30. The non-transitory computer-readable media of claim 29, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the first size of the object is continuously and increasingly enlarged as compared to the second size of the at least one other object, and the blur of the at least one other object is continuously increased, both as a continuous function of an increase in the pressure of the gesture being detected on the touch screen on the object.

31. The non-transitory computer-readable media of claim 30, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the first size of the object is continuously and increasingly reduced as compared to the second size of the at least one other object, and the blur of the at least one other object is continuously decreased, both as a continuous function of a decrease in the pressure of the gesture being detected on the touch screen on the object.

32. The non-transitory computer-readable media of claim 22, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that, simultaneous with the at least one other object being blurred, a first location of the at least one other object is offset relative to a second location of the object.

33. The non-transitory computer-readable media of claim 32, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the offset of the first location of the at least one other object relative to the second location of the object is continuously increased, and the blur of the at least one other object is continuously increased, both as a continuous function of an increase in the pressure of the gesture being detected on the touch screen on the object.

34. The non-transitory computer-readable media of claim 33, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the offset of the first location of the at least one other object relative to the second location of the object is continuously decreased, and the blur of the at least one other object is continuously decreased, both as a continuous function of a decrease in the pressure of the gesture being detected on the touch screen on the object.

35. The non-transitory computer-readable media of claim 22, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that, simultaneous with the at least one other object being blurred, a periphery of the object is enlarged.

36. The non-transitory computer-readable media of claim 35, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the periphery of the object is continuously and increasingly enlarged, and the blur of the at least one other object is continuously increased, both as a continuous function of an increase in the pressure of the gesture being detected on the touch screen on the object.

37. The non-transitory computer-readable media of claim 36, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the periphery of the object is continuously and increasingly reduced, and the blur of the at least one other object is continuously decreased, both as a continuous function of a decrease in the pressure of the gesture being detected on the touch screen on the object.

38. The non-transitory computer-readable media of claim 22, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that, simultaneous with the at least one other object being blurred, a shadow of the object is enlarged.

39. The non-transitory computer-readable media of claim 38, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the shadow of the object is continuously and increasingly enlarged, and the blur of the at least one other object is continuously increased, both as a continuous function of an increase in the pressure of the gesture being detected on the touch screen on the object.

40. The non-transitory computer-readable media of claim 39, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the shadow of the object is continuously and increasingly reduced, and the blur of the at least one other object is continuously decreased, both as a continuous function of a decrease in the pressure of the gesture being detected on the touch screen on the object.

41. The non-transitory computer-readable media of claim 22, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the blurring is continuously increased and decreased based on the pressure of the gesture being detected on the touch screen on the object.

42. The non-transitory computer-readable media of claim 22, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to modify a border of the object based on the pressure of the gesture being detected on the touch screen on the object.

43. The non-transitory computer-readable media of claim 22, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the at least one other object is blurred for emphasizing the object.

44. The non-transitory computer-readable media of claim 22, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the at least one other object is blurred for emphasizing the object and an accessibility of a function via the object via an increase in the pressure detected on the touch screen on the object.

45. The non-transitory computer-readable media of claim 22, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that:

after the at least portion of the gesture is detected, a function is performed;

the object includes a first application icon displayed via a home screen that is associated with a first application and the at least one other object includes a second application icon displayed via the home screen that is associated with a second application; and

the function includes displaying a menu including one or more menu items for performing an action using the first application.

46. The non-transitory computer-readable media of claim 45, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the menu includes another one or more menu items for performing another action using a third application.

47. The non-transitory computer-readable media of claim 45, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the displaying the menu includes magnifying the menu.

48. The non-transitory computer-readable media of claim 22, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that:

after the at least portion of the gesture is detected, a function is performed;

the object includes a hyperlink and the at least one other object includes text surrounding the hyperlink; and

the function includes opening the hyperlink.

49. The non-transitory computer-readable media of claim 22, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that:

after the at least portion of the gesture is detected, a function is performed;

the object includes at least a portion of a message and the at least one other object includes at least a portion of another message; and

the function includes opening the message.

50. The non-transitory computer-readable media of claim 49, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the message is opened in a window.

51. The non-transitory computer-readable media of claim 49, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the message is opened in a view.

52. The non-transitory computer-readable media of claim 22, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that a summary of the gesture is displayed, utilizing a border that is a function of the pressure being detected on the touch screen on the object.

53. The non-transitory computer-readable media of claim 22, wherein the object includes at least one of:

a hyperlink, an e-mail item, an instant message item, an address, or a calendar item, and the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that, after the detection of the at least portion of the gesture, a function is performed, and, before the detection of the at least portion of the gesture and before the cessation of the gesture is detected, another function is performed after the cessation of the gesture is detected, where the another function includes opening content associated with the object, and the function includes displaying, in a window, at least a portion of the content associated with the object.

54. The non-transitory computer-readable media of claim 53, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that, in response to an increase in the pressure of the gesture being detected on the touch screen on the object, a size of the window is enlarged.

55. The non-transitory computer-readable media of claim 53, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that, in response to an increase in the pressure of the gesture being detected on the touch screen on the object, the window is sharpened.

56. The non-transitory computer-readable media of claim 53, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the opening of the content associated with the object, and the displaying of the at least portion of the content associated with the object, result in the display of the content differently.

57. The non-transitory computer-readable media of claim 53, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that the opening of the content associated with the object results in scrolling being permitted;

and the displaying of the at least portion of the content associated with the object results in scrolling not being permitted.

58. The non-transitory computer-readable media of claim 53, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that, in response to a slide gesture being detected on the touch screen:

a menu is displayed, with at least part of the window, for displaying selectable functions capable of being performed in connection with the object.

59. The non-transitory computer-readable media of claim 53, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that, in response to a slide gesture being detected on the touch screen:

a menu is displayed, with at least part of the window, for displaying selectable functions capable of being performed in connection with the content associated with the object.

60. The non-transitory computer-readable media of claim 22, wherein the instructions, when executed by the one or more processors of the mobile device, cause the mobile device to operate such that, after the at least portion of the gesture is detected, a function is performed;

and before the at least portion of the gesture is detected, another function is performed after a cessation of the gesture is detected.

61. An apparatus, comprising:

at least one non-transitory memory storing instructions and a plurality of applications;

a touch screen;

a vibrator; and

one or more processors in communication with the at least one non-transitory memory, the touch screen, and the vibrator, wherein the one or more processors execute the instructions to cause the apparatus to;

display a first object and at least one other object;

detect a gesture on the touch screen on the first object;

during detection of at least a portion of the gesture before a completion thereof is detected, blur, based on a change in a pressure of the gesture being detected on the touch screen on the first object, at least a portion of the at least one other object; and

after the blurring, vibrate the apparatus and perform an action.

62. The apparatus of claim 61, wherein the apparatus is configured such that the blurring is a cue to a user regarding a level of the pressure of the gesture.

63. The apparatus of claim 61, wherein the apparatus is configured such that the blurring is a cue to a user regarding an accessibility of the action.

64. The apparatus of claim 61, wherein the apparatus is configured such that:

after the blurring and during detection of at least another portion of the gesture before the completion thereof is detected, at least a portion of a window is resized based on the pressure of the gesture being detected on the touch screen.

65. The apparatus of claim 64, wherein the apparatus is configured such that the blurring and the resizing are cues to a user regarding a change in the pressure of the gesture.

66. The apparatus of claim 64, wherein the apparatus is configured such that the blurring is a cue to a user regarding an accessibility of the at least portion of the window.

67. The apparatus of claim 64, wherein the apparatus is configured such that the resizing is a cue to a user regarding an accessibility of the action.

68. The apparatus of claim 64, wherein the apparatus is configured such that the resizing is a cue to a user regarding a status of the completion of the gesture.