Tri-state gesture-equipped touch screen system, method, and computer program product

• US 10,209,806 B1
• Filed: 09/28/2017
• Issued: 02/19/2019
• Est. Priority Date: 08/05/2011
• Status: Active Grant

• Current Assignee: Smith Interface Technologies, LLC
• Original Assignee: P4tents1 LLC
• Inventors: Smith, Michael S
• Primary Examiner(s): Xavier, Antonio
• Application Number:
  US15/719,420
• Time in Patent Office: 509 Days
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/1647 including at least an additional display G06F1/1692 takes precedence
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/045 using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 9/4843 : by program, e.g. task dispatcher, supervisor, operating system

Abstract

A system, method, and computer program product are provided for operating a mobile device including a touch screen, a memory, and a vibratory feedback mechanism coupled to at least one processor. A plurality of applications including an application is stored, utilizing the memory. A first pressure signal indicative of a first magnitude of pressure being applied to the touch screen is identified. In response to the first pressure signal indicative of the first magnitude of pressure being applied to the touch screen, a first state is identified, utilizing the at least one processor. In response to the identification of the first state, an operation is performed, utilizing the at least one processor. A second pressure signal is identified indicative of a second magnitude of pressure being applied to the touch screen that is greater than the first magnitude, in connection with the indicia. In response to the second pressure signal indicative of the second magnitude of pressure being applied to the touch screen, a second state is identified, utilizing the at least one processor. In response to the identification of the second state, the mobile device is vibrated, utilizing the vibratory feedback mechanism. Also in response to the identification of the second state, another operation is performed.

Claims

1. An apparatus, comprising:

a mobile device including a touch screen, a memory, and a vibrator coupled to at least one processor;

said memory configured to store a plurality of applications including an application;

said touch screen configured to cooperate with the at least one processor to display indicia;

said touch screen configured to cooperate with the at least one processor to receive a first pressure signal indicative of a first magnitude of pressure being applied to the touch screen, in connection with the indicia;

said at least one processor configured to, in response to the first pressure signal indicative of the first magnitude of pressure being applied to the touch screen, identify a first state;

said touch screen configured to cooperate with the at least one processor to, in response to the identification of the first state, perform an operation;

said touch screen configured to cooperate with the at least one processor to receive a second pressure signal indicative of a second magnitude of pressure being applied to the touch screen that is greater than the first magnitude, in connection with the indicia;

said at least one processor configured to, in response to the second pressure signal indicative of the second magnitude of pressure being applied to the touch screen that is greater than the first magnitude, identify a second state;

said vibrator configured to cooperate with the at least one processor to, in response to the identification of the second state, vibrate the mobile device;

said touch screen configured to cooperate with the at least one processor to, in response to the identification of the second state, perform another operation that includes display of at least a portion of content associated with the indicia while blurring or fogging at least a portion of an interface for making the at least portion of the interface appear to be at a greater depth as compared to the at least portion of the content;

said touch screen configured to cooperate with the at least one processor to receive a third pressure signal indicative of a third magnitude of pressure being applied to the touch screen that is greater than the first magnitude;

said at least one processor configured to, in response to the third pressure signal indicative of the third magnitude of pressure being applied to the touch screen that is greater than the first magnitude, identify a third state;

said vibrator configured to cooperate with the at least one processor to, in response to the identification of the third state, vibrate the mobile device;

said touch screen configured to cooperate with the at least one processor to, in response to the identification of the third state, open the content associated with the indicia.

2. The apparatus of claim 1, wherein:

said touch screen is configured to cooperate with the at least one processor to receive a slide gesture signal indicative of a slide gesture being applied to the touch screen;

said at least one processor is configured to, in response to the slide gesture signal indicative of the slide gesture being applied to the touch screen, identify a fourth state;

said touch screen is configured to cooperate with the at least one processor to, in response to the identification of the fourth state, display at least one menu including a plurality of particular actions;

said touch screen is configured to cooperate with the at least one processor to receive a selection signal indicative of pressure being applied to the touch screen, in connection with at least one of the particular actions; and

said at least one processor configured to, in response to the selection signal, execute the at least one particular action.

3. The apparatus of claim 2, wherein the apparatus is configured such that the fourth state occurs between the second state and the third state.

4. The apparatus of claim 2, wherein the apparatus is configured such that the touch screen is configured to cooperate with the at least one processor to receive the slide gesture signal indicative of the slide gesture being applied to the touch screen, after the second pressure signal and before the third pressure signal.

5. The apparatus of claim 2, wherein the apparatus is configured such that the particular actions include at least one user-specific action.

6. The apparatus of claim 2, wherein the apparatus is configured such that the at least one menu permits user access to the particular actions associated with the application while avoiding launching the application.

7. The apparatus of claim 2, wherein the apparatus is configured such that the indicia includes a web hyperlink, the application includes a web browser application, and the particular actions include an open action and a copy action associated with the application.

8. The apparatus of claim 2, wherein the apparatus is configured such that the indicia includes a date hyperlink, the application includes a calendar application, and the particular actions include a create action associated with the application.

9. The apparatus of claim 2, wherein the apparatus is configured such that the indicia includes at least one hyperlinked aspect of a contact, and the particular actions include a first communication type action and a second communication type action.

10. The apparatus of claim 2, wherein the apparatus is configured such that the indicia includes a physical address hyperlink, the application includes a navigation application, and the particular actions include showing a physical address utilizing the navigation application.

11. The apparatus of claim 2, wherein the apparatus is configured such that the indicia includes media, the application includes a media application, and the particular actions include a play action associated with the application.

12. The apparatus of claim 2, wherein the apparatus is configured such that the indicia includes an e-mail, the application includes an e-mail application, and the particular actions include a reply action and a forward action associated with the application.

13. The apparatus of claim 2, wherein the apparatus is configured such that the indicia includes content-specific indicia associated with the content, and the content associated with the indicia is opened in response to the identification of the third state utilizing the application.

14. The apparatus of claim 2, wherein the apparatus is configured such that at least one of:

said touch screen includes a touch interface and a display;

said touch screen is a combination of a touch interface and a display;

said touch screen is on a front face of the mobile device;

said states each include a selection state;

said operation is associated with the first state by a user;

said operation is associated with the first state by a device;

said operation is associated with the first state via system learning;

said another operation is associated with the second state by a user;

said another operation is associated with the second state by a device;

said another operation is associated with the second state via system learning;

said content opening is associated with the third state by a user;

said content opening is associated with the third state by a device;

said content opening is associated with the third state via system learning;

said content opening is displaying the content being opened;

said content opening includes displaying the content being opened;

said menu display is associated with the fourth state by a user;

said menu display is associated with the fourth state by a device;

said menu display is associated with the fourth state via system learning;

said operation and the another operation permit viewing at least a portion of the content;

said operation is performed while the second magnitude of pressure is maintained on the touch screen;

said operation and the another operation serve to display the content differently;

said slide gesture being part of a pinch gesture;

said slide gesture taking the form of a swipe gesture;

said slide gesture including a vertical slide gesture;

said at least portion of the content and the interface are part of a three-dimensional layered user interface;

said at least portion of the content and the interface are each part of different layers;

said fogging or blurring includes the fogging;

said fogging or blurring includes the blurring;

said fog includes a thin, uniform fog;

said fog results from a three-dimensional depth cue;

said blur results from a three-dimensional depth cue;

said at least portion of the content and the interface are each part of different layers with different three-dimensional depth cues;

said at least portion of the content and the interface are each part of different layers that are accessible via different inputs of different pressure levels;

said at least portion of the content and the interface are each part of different layers that are accessible via different inputs of different pressure levels, and the fog or blur indicate a movement through the different layers;

said at least portion of the content and the interface are part of a three-dimensional layered user interface that can be operated upon via a back interaction surface;

each of the first state, the second state, the third state, and the fourth state is a touch state;

each of the first state, the second state, the third state, and the fourth state is a partitioning of a range of measurable pressures exerted upon a surface;

said first state is identified in response to the identification of the first pressure signal, by being identified in response to the identification of the first pressure signal, after a release of the first magnitude of pressure;

said first state is identified in response to the identification of the first pressure signal, by being identified in response to the identification of the first pressure signal without any intermediate input or operation;

said first state is identified in response to the identification of the first pressure signal, by being identified in response to the identification of the first pressure signal with at least one intermediate input or operation;

said second state is identified in response to the identification of the second pressure signal, by being identified in response to the identification of the second pressure signal, after a release of the second magnitude of pressure;

said second state is identified in response to the identification of the second pressure signal, by being identified in response to the identification of the second pressure signal without any intermediate input or operation;

said second state is identified in response to the identification of the second pressure signal, by being identified in response to the identification of the second pressure signal with at least one intermediate input or operation;

said third state is identified in response to the identification of the third pressure signal, by being identified in response to the identification of the third pressure signal, after a release of the corresponding pressure;

said third state is identified in response to the identification of the third pressure signal, by being identified in response to the identification of the third pressure signal without any intermediate input or operation;

said third state is identified in response to the identification of the third pressure signal, by being identified in response to the identification of the third pressure signal with at least one intermediate input or operation;

said first state is capable of being identified in a first usage scenario without the second state being identified, and the second state is identified in a second usage scenario without the first state being identified;

said second state is capable of being identified in a first usage scenario without the first state being identified, and the first state is identified in a second usage scenario without the second state being identified;

said first state is capable of being identified in a first usage scenario without the third state being identified, and the third state is identified in a second usage scenario without the first state being identified;

said third pressure signal is indicative of a third magnitude of pressure being applied to the touch screen that is greater than the first magnitude said third pressure signal is indicative of the second magnitude of pressure being applied to the touch screen that is greater than the first magnitude;

said indicia includes a hyperlink and the at least portion of the content associated with the indicia is linked via the hyperlink;

said content is opened by linking thereto via the indicia which includes a hyperlink;

said indicia includes a user interface control widget;

said indicia includes a selectable graphic;

each pressure results from a touch event;

or

each pressure is in connection with a gesture input.

15. The apparatus of claim 1, wherein the apparatus is configured such that the third magnitude of pressure associated with the third pressure signal is a continuation of the second magnitude of pressure associated with the second pressure signal such that the second pressure signal and the third pressure signal are prompted by the same continuous gesture.

16. The apparatus of claim 1, wherein the apparatus is configured such that the another operation is performed while the second magnitude of pressure is maintained on the touch screen.

17. The apparatus of claim 1, wherein the apparatus is configured such that the operation and the another operation serve to display the content differently.

18. The apparatus of claim 1, wherein the apparatus is configured such that, based on a particular magnitude of pressure and a particular time during which the particular magnitude of pressure is applied, the indicia is capable of causing at least the first state, the second state, and the third state, each of which is accessible via the indicia despite a size of the touch screen of the mobile device by only varying a pressure duration and magnitude on a same location of the indicia.

28. The apparatus of claim 1, wherein the apparatus is configured such that the blurring or fogging includes the blurring, and the blurring is continuously increased as a function of an increasing magnitude of pressure being applied to the touch screen, in connection with the indicia.

19. An apparatus, comprising:

a non-transitory memory storing instructions and a plurality of applications;

a touch screen;

a vibrator; and

one or more processors in communication with the non-transitory memory, the touch screen, and the vibrator, wherein the one or more processors execute the instructions to;

display a hyperlink;

receive a first pressure signal indicative of a first magnitude of pressure being detected on the hyperlink displayed on the touch screen;

in response to the first pressure signal indicative of the first magnitude of pressure being detected on the hyperlink displayed on the touch screen for less than a predetermined amount of time, identify a first state;

in response to the identification of the first state, display content associated with the hyperlink in a first manner;

receive a second pressure signal indicative of a second magnitude of pressure being detected on the hyperlink displayed on the touch screen that is greater than the first magnitude;

in response to the second pressure signal indicative of the second magnitude of pressure being detected on the hyperlink displayed on the touch screen that is greater than the first magnitude, identify a second state;

in response to the identification of the second state, vibrate the apparatus;

in response to the identification of the second state, display the content associated with the hyperlink in a second manner that results in display of the content associated with the hyperlink over at least a portion of an interface that is blurred or fogged for making the at least portion of the interface appear to be at a greater depth as compared to the content associated with the hyperlink;

receive a third pressure signal indicative of a third magnitude of pressure being detected on the hyperlink displayed on the touch screen that is greater than the first magnitude;

in response to the third pressure signal indicative of the third magnitude of pressure being detected on the hyperlink displayed on the touch screen that is greater than the first magnitude, identify a third state;

in response to the identification of the third state, vibrate the apparatus; and

in response to the identification of the third state, display the content associated with the hyperlink in the first manner.

20. The apparatus of claim 19, wherein the one or more processors further execute the instructions to:

in response to the first pressure signal indicative of the first magnitude of pressure being detected on the hyperlink displayed on the touch screen for more than the predetermined amount of time, identify a fourth state;

in response to the identification of the fourth state, display a first menu for displaying operations capable of being performed in connection with the hyperlink including an open operation, a copy operation, and a share operation;

receive a first selection signal indicative of pressure being detected on the touch screen, in connection with at least one of the displayed operations of the first menu; and

in response to the first selection signal, execute the at least one displayed operation of the first menu.

21. The apparatus of claim 20, wherein the one or more processors further execute the instructions to:

receive a slide gesture signal indicative of a slide gesture being detected on the hyperlink displayed on the touch screen after the second state;

in response to the slide gesture signal indicative of the slide gesture being detected on the touch screen, identify a fifth state after the second state;

in response to the identification of the fifth state, display a second menu for displaying operations capable of being performed in connection with the hyperlink including the open operation, the copy operation, and the share operation;

receive a second selection signal indicative of pressure being detected on the touch screen, in connection with at least one of the displayed operations of the second menu; and

in response to the second selection signal, execute the at least one displayed operation of the second menu.

22. The apparatus of claim 19, wherein the apparatus is configured such that, based on a particular magnitude of pressure and a particular time during which the particular magnitude of pressure is detected on the hyperlink, the hyperlink is capable of causing at least one of the first state, the second state, or the third state, where each of the first state, the second state, and the third state are accessible via the hyperlink despite a size of the touch screen of a mobile device by only varying a magnitude and duration of pressure being detected on the hyperlink.

23. The apparatus of claim 19, wherein the apparatus is configured such that the third magnitude of pressure associated with the third pressure signal is a continuation of the second magnitude of pressure associated with the second pressure signal such that the second pressure signal and the third pressure signal are prompted by the same continuous gesture.

24. The apparatus of claim 19, wherein the apparatus is configured such that the blurring or fogging includes the blurring, and the blurring is continuously increased to provide a cue as a function of an increasing magnitude of pressure being detected on the touch screen.

25. An apparatus, comprising:

a non-transitory memory storing instructions and a plurality of applications;

a touch screen;

a vibrator; and

one or more processors in communication with the non-transitory memory, the touch screen, and the vibrator, wherein the one or more processors execute the instructions to;

display an electronic mail message;

receive a first pressure signal resulting from a first magnitude of pressure being detected on the electronic mail message displayed on the touch screen;

in response to the first pressure signal resulting from the first magnitude of pressure being detected on the electronic mail message displayed on the touch screen, identify a first state;

in response to the identification of the first state, display content associated with the electronic message in a first manner;

receive a second pressure signal resulting from a second magnitude of pressure being detected on the electronic mail message displayed on the touch screen that is greater than the first magnitude;

in response to the second pressure signal resulting from the second magnitude of pressure being detected on the electronic mail message displayed on the touch screen that is greater than the first magnitude, identify a second state;

in response to the identification of the second state, vibrate the apparatus;

in response to the identification of the second state, display the content associated with the electronic message in a second manner while blurring or fogging at least a portion of an interface for making the at least portion of the interface appear to be at a greater depth as compared to at least portion of the content;

receive a third pressure signal resulting from a third magnitude of pressure being detected on the electronic mail message displayed on the touch screen that is greater than the first magnitude;

in response to the third pressure signal resulting from the third magnitude of pressure being detected on the electronic mail message displayed on the touch screen that is greater than the first magnitude, identify a third state;

in response to the identification of the third state, vibrate the apparatus; and

in response to the identification of the third state, display the content associated with the electronic message in the first manner.

26. The apparatus of claim 25, wherein the one or more processors further execute the instructions to:

receive a slide gesture signal resulting from a slide gesture being detected on the electronic mail message displayed on the touch screen after the second state;

in response to the slide gesture signal resulting from the slide gesture being detected on the touch screen, identify a fourth state;

in response to the identification of the fourth state, display a menu for displaying operations capable of being performed in connection with the electronic mail message including a reply operation and a forward operation;

receive a selection signal resulting from a pressure being detected on the touch screen, in connection with at least one of the displayed operations of the menu; and

in response to the selection signal, execute the at least one displayed operation of the menu.

27. The apparatus of claim 25, wherein the apparatus is configured such that, based on a particular magnitude of pressure and a particular time during which the particular magnitude of pressure is applied to the electronic mail message, a pressure detected on the electronic mail message is capable of causing at least one of the first state, the second state, or the third state, where each of the first state, the second state, and the third state are accessible via the electronic mail message despite a size of the touch screen of a mobile device by only varying a magnitude and duration of the pressure detected on the electronic mail message.

29. The apparatus of claim 25, wherein the apparatus is configured such that the blurring or fogging includes the blurring, and the blurring is continuously increased prior to the identification of the second state as a function of an increasing magnitude of pressure being detected on the electronic mail message displayed on the touch screen.