Gesture-equipped touch screen system, method, and computer program product

• US 10,275,086 B1
• Filed: 10/06/2018
• Issued: 04/30/2019
• Est. Priority Date: 08/05/2011
• Status: Active Grant

• Current Assignee: Smith Interface Technologies, LLC
• Original Assignee: P4tents1 LLC
• Inventors: Smith, Michael S
• Primary Examiner(s): Xavier, Antonio
• Application Number:
  US16/153,763
• Time in Patent Office: 206 Days
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/1647 including at least an additional display G06F1/1692 takes precedence
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/045 using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 9/4843 : by program, e.g. task dispatcher, supervisor, operating system

Abstract

In various embodiments, an electronic device, a method, and a non-transitory computer-readable media are provided for storing a plurality of applications including an application, utilizing the memory; displaying indicia; when a first pressure being applied to the touch screen is detected as ceasing in connection with the indicia, performing an operation; when a second pressure being applied to the touch screen is detected in connection with the indicia after the first pressure is detected without the ceasing, outputting feedback that is perceptible by touch; when the second pressure being applied to the touch screen is detected in connection with the indicia after the first pressure is detected without the ceasing, performing another operation; when a third pressure being applied to the touch screen is detected in connection with the indicia after the second pressure is detected, outputting additional feedback that is perceptible by touch; when the third pressure being applied to the touch screen is detected in connection with the indicia after the second pressure is detected, opening content associated with the indicia; and when a slide gesture being applied to the touch screen is detected after the second pressure is detected, displaying at least one menu including a plurality of particular actions.

Claims

1. A non-transitory computer-readable media storing computer instructions that;

when executed by at least one processor of a mobile device including a touch screen, and a memory, and an actuator coupled to the at least one processor;

cause the mobile device to;

display indicia associated with an application, utilizing the touch screen;

when a first pressure being applied to the touch screen is detected as ceasing in connection with the indicia, perform an operation;

when a second pressure, that is different than the first pressure, being applied to the touch screen is detected in connection with the indicia after the first pressure is detected without the ceasing, output feedback that is perceptible by touch, utilizing the actuator;

when the second pressure being applied to the touch screen is detected in connection with the indicia after the first pressure is detected without the ceasing, perform another operation;

when a third pressure, that is different than the first pressure and the second pressure, being applied to the touch screen is detected in connection with the indicia after the second pressure is detected, output additional feedback that is perceptible by touch, utilizing the actuator;

when the third pressure being applied to the touch screen is detected in connection with the indicia after the second pressure is detected, open content associated with the indicia; and

when a slide gesture being applied to the touch screen is detected after the second pressure is detected, display at least one menu including a plurality of particular actions, such that, when a selection pressure being applied to the touch screen is detected in connection with at least one of the particular actions, the at least one particular action is performed.

2. The non-transitory computer-readable media of claim 1, further including instructions that, when executed by the at least one processor, cause the mobile device to operate such that the particular actions are associated with the application.

3. The non-transitory computer-readable media of claim 1, further including instructions that, when executed by the at least one processor, cause the mobile device to operate such that the indicia includes a date hyperlink, the application includes a calendar application, and the particular actions include a create action associated with the calendar application.

4. The non-transitory computer-readable media of claim 1, further including instructions that, when executed by the at least one processor, cause the mobile device to operate such that the indicia includes a web hyperlink, the application includes a web browser application, and the particular actions include an open action and a copy action utilizing the web browser application.

5. The non-transitory computer-readable media of claim 1, further including instructions that, when executed by the at least one processor, cause the mobile device to operate such that the indicia includes at least one hyperlinked aspect of a contact, and the particular actions include a first communication type action and a second communication type action.

6. The non-transitory computer-readable media of claim 1, further including instructions that, when executed by the at least one processor, cause the mobile device to operate such that the indicia includes a physical address hyperlink, the application includes a navigation application, and the particular actions include showing a physical address utilizing the navigation application.

7. The non-transitory computer-readable media of claim 1, further including instructions that, when executed by the at least one processor, cause the mobile device to operate such that the indicia includes media, the application includes a media application, and the particular actions include a play action associated with the media application.

8. The non-transitory computer-readable media of claim 1, further including instructions that, when executed by the at least one processor, cause the mobile device to operate such that the indicia includes an e-mail, the application includes an e-mail application, and the particular actions include a reply action and a forward action associated with the e-mail application.

9. The non-transitory computer-readable media of claim 1, further including instructions that, when executed by the at least one processor, cause the mobile device to operate such that the first pressure is detected for a first gesture without the second pressure, the slide gesture, the selection pressure, nor the third pressure being detected;

the first pressure and the second pressure are detected for a second gesture without the slide gesture, the selection pressure, nor the third pressure being detected;

the first pressure, the second pressure, and the slide gesture are detected for a third gesture without the selection pressure nor the third pressure being detected;

the first pressure, the second pressure, the slide gesture, and the selection pressure are detected for a fourth gesture without the third pressure being detected;

the first pressure, the second pressure, and the third pressure are detected for a fifth gesture without the slide gesture nor the selection pressure being detected.

10. The non-transitory computer-readable media of claim 1, further including instructions that, when executed by the at least one processor, cause the mobile device to operate such that the first pressure is detected as ceasing for a first gesture without the second pressure, the slide gesture, the selection pressure, nor the third pressure being detected;

the second pressure is detected for a second gesture without the first pressure being detected as ceasing, nor the slide gesture, the selection pressure, and the third pressure being detected;

the second pressure and the slide gesture are detected for a third gesture without the first pressure being detected as ceasing, nor the selection pressure and the third pressure being detected;

the second pressure, the slide gesture, and the selection pressure are detected for a fourth gesture without the first pressure being detected as ceasing, nor the third pressure being detected;

the second pressure and the third pressure are detected for a fifth gesture without the first pressure being detected as ceasing, nor the slide gesture and the selection pressure being detected.

11. The non-transitory computer-readable media of claim 1, further including instructions that, when executed by the at least one processor, cause the mobile device to operate such that only the first pressure is detected for a first gesture;

only the first pressure and the second pressure are detected for a second gesture;

only the first pressure, the second pressure, and the slide gesture are detected for a third gesture;

only the first pressure, the second pressure, the slide gesture, and the selection pressure are detected for a fourth gesture; and

only the first pressure, the second pressure, and the third pressure are detected for a fifth gesture.

12. The non-transitory computer-readable media of claim 1, further including instructions that, when executed by the at least one processor, cause the mobile device to operate such that the third pressure is a continuation of the second pressure, and the second pressure are detected as a continuation of the first pressure.

13. The non-transitory computer-readable media of claim 1, further including instructions that, when executed by the at least one processor, cause the mobile device to operate such that the first pressure, the second pressure, and the third pressure are detected as part of the same gesture.

14. The non-transitory computer-readable media of claim 1, further including instructions that, when executed by the at least one processor, cause the mobile device to operate such that the content is opened via the application so that a user is capable of scrolling through the content.

15. The non-transitory computer-readable media of claim 1, further including instructions that, when executed by the at least one processor, cause the mobile device to operate such that the slide gesture is detected as a continuation of the second pressure, and the second pressure is detected as a continuation of the first pressure.

16. The non-transitory computer-readable media of claim 1, further including instructions that, when executed by the at least one processor, cause the mobile device to operate such that the first pressure, the second pressure, and the slide gesture are detected as part of the same gesture.

17. The non-transitory computer-readable media of claim 1, further including instructions that, when executed by the at least one processor, cause the mobile device to operate such that at least one of:

said touch screen includes a touch interface and a display;

said touch screen is a combination of a touch interface and a display;

said touch screen is on a front face of the mobile device;

said touch screen is on a back face of the mobile device;

said memory is part of the computer-readable media;

said memory is separate from the computer-readable media;

said feedback is the same as the additional feedback;

said feedback is different from the additional feedback;

said feedback is less than the additional feedback in terms of duration;

said feedback is less than the additional feedback in terms of magnitude;

said feedback is less than the additional feedback in terms of instances;

said feedback includes a vibration;

said feedback includes at least one of;

a vibration, a force feedback, a tactile output, a weight feedback, a mechanical output, or a mass feedback;

said actuator includes at least one of;

a vibrator, a motor, or an actuator;

said feedback includes at least one of;

a vibration, a force feedback, a tactile output, a weight feedback, a mechanical output, or a mass feedback;

said feedback that is perceptible by touch results from the mobile device being vibrated only once;

said feedback that is perceptible by touch results from the mobile device being vibrated at least once;

said feedback that is perceptible by touch results from the mobile device being vibrated for a predetermined period of time;

said content opening is displaying the content being opened;

said content opening includes displaying the content being opened;

each instance of said display is carried out by the touch screen;

said operation is performed after the first pressure ceases;

said operation is performed in response to the first pressure ceasing;

said operation is performed upon the first pressure ceasing;

said operation and said another operation permit viewing at least a portion of the content;

said operation includes displaying the content associated with the indicia such that scrolling is permitted and the another operation includes at least partly displaying the content associated with the indicia without scrolling;

said another operation is performed while the second pressure is maintained on the touch screen;

said operation and the another operation are the same;

said operation and the another operation are different;

said operation includes opening the content;

said operation and the another operation include opening the content;

said operation and the another operation does not include opening the content;

said operation and the another operation serve to display the content differently;

said content includes at least one of;

a message, a web page, navigation information, an appointment, contact information, or media;

said slide gesture is part of a pinch gesture;

said slide gesture taking the form of a swipe gesture;

said slide gesture including a vertical slide gesture;

said slide gesture being applied to the touch screen is detected in connection with the indicia;

said first pressure being applied to the touch screen is detected in connection with the indicia, by being detected on the indicia;

said first pressure being applied to the touch screen is detected in connection with the indicia, by being detected on at least a portion of the indicia;

said second pressure being applied to the touch screen is detected in connection with the indicia, by being detected on the indicia;

said second pressure being applied to the touch screen is detected in connection with the indicia, by being detected on at least a portion of the indicia;

said third pressure being applied to the touch screen is detected in connection with the indicia, by being detected on the indicia;

said third pressure being applied to the touch screen is detected in connection with the indicia, by being detected on at least a portion of the indicia;

said second pressure being applied to the touch screen is greater than the first pressure;

said third pressure being applied to the touch screen is greater than the second pressure;

said first, second, and third pressures are different in terms of magnitude;

at least two of the first, second, and third pressures are different while sharing a common corresponding magnitude threshold;

said second and third pressures are different while sharing a common corresponding magnitude threshold, by the second pressure exceeding the common corresponding magnitude threshold a first amount and the third pressure exceeding the common corresponding magnitude threshold a second amount;

said second and third pressures are different and share a common corresponding magnitude threshold, where the second and third pressures need not necessarily exceed the common corresponding magnitude threshold by different amounts;

said second and third pressures are different by having different corresponding magnitude thresholds;

said selection pressure being applied to the touch screen is greater than the first pressure;

said selection pressure being applied to the touch screen is greater than the second pressure;

said selection pressure being applied to the touch screen is in the form of a touch;

each instance of said when includes at least one point of time when a pressure magnitude meets a corresponding threshold;

each instance of said when includes at least one point in time after a pressure magnitude changes to a corresponding threshold;

each instance of said when includes when a pressure magnitude initially meets a corresponding threshold;

each instance of said when includes an entire duration when a pressure magnitude meets a corresponding threshold;

each instance of said when includes only a portion of a duration when a pressure magnitude meets a corresponding threshold;

each instance of said when includes when a pressure magnitude changes to a corresponding threshold;

each instance of said when includes after a pressure magnitude changes to a corresponding threshold;

each instance of said when includes only a portion of a duration;

each instance of said when includes while;

each instance of said pressure is detected utilizing one or more of a plurality of contact-sensing technologies including a capacitive-based contact sensing technology, a resistive-based contact sensing technology, an optical-based contact sensing technology, or a surface acoustic wave-based contact sensing technology;

each instance of said pressure is detected utilizing a plurality of contact-sensing technologies including at least two of;

a capacitive-based contact sensing technology, a resistive-based contact sensing technology, an optical-based contact sensing technology, or a surface acoustic wave-based contact sensing technology;

each instance of said pressure generates a touch signal that, during a first component of an associated gesture, is not pressure magnitude-dependent, and, during a second component of the associated gesture, is pressure magnitude-dependent;

each instance of said pressure generates a touch signal that, during a first component of an associated gesture, is not pressure magnitude-dependent and thus results in a touch signal, and, during a second component of the associated gesture, is pressure magnitude-dependent and thus results in a pressure signal;

said first pressure is detected for a first gesture without the second pressure, the slide gesture, the selection pressure, nor the third pressure being detected;

the first pressure and the second pressure are detected for a second gesture without the slide gesture, the selection pressure, nor the third pressure being detected;

the first pressure, the second pressure, and the slide gesture are detected for a third gesture without the selection pressure nor the third pressure being detected;

the first pressure, the second pressure, the slide gesture, and the selection pressure are detected for a fourth gesture without the third pressure being detected;

the first pressure, the second pressure, and the third pressure are detected for a fifth gesture without the slide gesture nor the selection pressure being detected;

said first pressure is detected as ceasing for a first gesture without the second pressure, the slide gesture, the selection pressure, nor the third pressure being detected;

the second pressure is detected for a second gesture without the first pressure being detected as ceasing, nor the slide gesture, the selection pressure, and the third pressure being detected;

the second pressure and the slide gesture are detected for a third gesture without the first pressure being detected as ceasing, nor the selection pressure and the third pressure being detected;

the second pressure, the slide gesture, and the selection pressure are detected for a fourth gesture without the first pressure being detected as ceasing, nor the third pressure being detected;

the second pressure and the third pressure are detected for a fifth gesture without the first pressure being detected as ceasing, nor the slide gesture and the selection pressure being detected;

only the first pressure is detected for a first gesture;

only the first pressure and the second pressure are detected for a second gesture;

only the first pressure, the second pressure, and the slide gesture are detected for a third gesture;

only the first pressure, the second pressure, the slide gesture, and the selection pressure are detected for a fourth gesture; and

only the first pressure, the second pressure, and the third pressure are detected for a fifth gesture;

said indicia includes a hyperlink;

said indicia includes hyperlinked text;

said indicia includes at least a portion of a message;

said indicia includes a user interface control widget;

said indicia includes a selectable graphic;

each pressure results from a touch event;

or

each pressure is in connection with a gesture input.

18. A mobile device, comprising:

a touch screen;

one or more sensors to detect levels of contacts with the touch screen;

an actuator;

at least one processor;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the at least one processor, the one or more programs including instructions for;

displaying indicia, utilizing the touch screen;

when a first pressure being applied to the touch screen is detected as ceasing on the indicia, performing an operation;

when a second pressure, that is different than the first pressure, being applied to the touch screen is detected on the indicia after the first pressure is detected without the ceasing, outputting feedback that is perceptible by touch, utilizing the actuator;

when the second pressure being applied to the touch screen is detected on the indicia after the first pressure is detected without the ceasing, performing another operation;

when a third pressure, that is different than the first pressure and the second pressure, being applied to the touch screen is detected on the indicia after the second pressure is detected, outputting additional feedback that is perceptible by touch, utilizing the actuator;

when the third pressure being applied to the touch screen is detected on the indicia after the second pressure is detected, performing the operation; and

when a slide gesture being applied to the touch screen is detected after the second pressure is detected, displaying at least one menu including a plurality of particular actions, such that, when a selection pressure being applied to the touch screen is detected on at least one of the particular actions, the at least one particular action is performed.

19. The mobile device of claim 18, wherein the mobile device is configured such that the first pressure is capable of being detected for a first gesture without the second pressure, the slide gesture, the selection pressure, nor the third pressure being detected;

the first pressure and the second pressure are capable of being detected for a second gesture without the slide gesture, the selection pressure, nor the third pressure being detected;

the first pressure, the second pressure, and the slide gesture are capable of being detected for a third gesture without the selection pressure nor the third pressure being detected;

the first pressure, the second pressure, the slide gesture, and the selection pressure are capable of being detected for a fourth gesture without the third pressure being detected;

the first pressure, the second pressure, and the third pressure are capable of being detected for a fifth gesture without the slide gesture nor the selection pressure being detected.

20. The mobile device of claim 18, wherein the mobile device is configured such that the first pressure is capable of being detected as ceasing for a first gesture without the second pressure, the slide gesture, the selection pressure, nor the third pressure being detected;

the second pressure is capable of being detected for a second gesture without the first pressure being detected as ceasing, nor the slide gesture, the selection pressure, and the third pressure being detected;

the second pressure and the slide gesture are capable of being detected for a third gesture without the first pressure being detected as ceasing, nor the selection pressure and the third pressure being detected;

the second pressure, the slide gesture, and the selection pressure are capable of being detected for a fourth gesture without the first pressure being detected as ceasing, nor the third pressure being detected;

the second pressure and the third pressure are capable of being detected for a fifth gesture without the first pressure being detected as ceasing, nor the slide gesture and the selection pressure being detected.

21. The mobile device of claim 18, wherein the mobile device is configured such that only the first pressure is capable of being detected for a first gesture;

only the first pressure and the second pressure are capable of being detected for a second gesture;

only the first pressure, the second pressure, and the slide gesture are capable of being detected for a third gesture;

only the first pressure, the second pressure, the slide gesture, and the selection pressure are capable of being detected for a fourth gesture; and

only the first pressure, the second pressure, and the third pressure are capable of being detected for a fifth gesture.

22. The mobile device of claim 18, wherein the mobile device is configured such that the third pressure is a continuation of the second pressure, and the second pressure are capable of being detected as a continuation of the first pressure.

23. The mobile device of claim 18, wherein the mobile device is configured such that the first pressure, the second pressure, and the third pressure are capable of being detected as part of the same gesture.

24. The mobile device of claim 18, wherein the mobile device is configured such that the slide gesture is capable of being detected as a continuation of the second pressure, and the second pressure is capable of being detected as a continuation of the first pressure.

25. The mobile device of claim 18, wherein the mobile device is configured such that the first pressure, the second pressure, and the slide gesture are capable of being detected as part of the same gesture.

26. A system, comprising:

first means for storing a plurality of applications including an application; and

second means for displaying indicia;

wherein the system is configured for;

when a first pressure is detected as ceasing on the indicia, causing an operation to be performed,

when a second pressure, that is different than the first pressure, is detected on the indicia after the first pressure is detected without the ceasing, causing feedback that is perceptible by touch to be output,

when the second pressure is detected on the indicia after the first pressure is detected without the ceasing, causing another operation to be performed,

when a third pressure, that is different than the first pressure and the second pressure, is detected on the indicia after the second pressure is detected, causing additional feedback that is perceptible by touch to be output,

when the third pressure is detected on the indicia after the second pressure is detected, causing the operation to be performed, and

when a slide gesture is detected after the second pressure is detected, causing display of at least one menu including a plurality of particular actions, such that, when a selection pressure is detected on at least one of the particular actions, the at least one particular action is performed.

27. The system of claim 26, wherein the first means includes memory, and the second means includes a display.

28. A method, comprising:

providing particular application code that is part of a particular application configured to cooperate with an electronic device including a touch screen and memory coupled to at least one processor, where the particular application code, when installed on the electronic device, cooperates with an operating system of the electronic device to cause the electronic device to;

display indicia, utilizing the touch screen;

detect a first pressure being applied to the touch screen as ceasing on the indicia, for performing an operation;

detect a second pressure, that is different than the first pressure, being applied to the touch screen on the indicia after the first pressure is detected without the ceasing, for performing another operation, and for outputting feedback that is perceptible by touch;

detect a third pressure, that is different than the first pressure and the second pressure, being applied to the touch screen on the indicia after the second pressure is detected, for performing the operation, and for outputting additional feedback that is perceptible by touch; and

detect a slide gesture being applied to the touch screen after the second pressure is detected, for displaying at least one menu including a plurality of particular actions, such that at least one of the particular actions is performed in response to a detection of a selection pressure being applied to the touch screen on the at least one particular action.

29. The method of claim 28, wherein the third pressure is a continuation of the second pressure, and the second pressure are detected as a continuation of the first pressure.

30. The method of claim 28, wherein the first pressure, the second pressure, and the third pressure are detected as part of the same gesture.