SYSTEM AND METHOD FOR DETECTING AND INTERPRETING ON AND OFF-SCREEN GESTURES

• US 20140043265A1
• Filed: 08/07/2013
• Published: 02/13/2014
• Est. Priority Date: 08/07/2012
• Status: Abandoned Application

• Current Assignee: Nook Digital, LLC (f/k/a Barnesandnoble.com LLC) (Bahwan CyberTek Pvt Ltd.)
• Original Assignee: Nook Digital, LLC (f/k/a Barnesandnoble.com LLC) (Bahwan CyberTek Pvt Ltd.)
• Inventors: CHANG, Songan Andy, MISHRA, Abhinayak, CHAN, Bennett
• Application Number:
  US13/961,796
• Publication Number:
  US 20140043265A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A system and method for the detection and interpretation of unique and distinctive gestures by extending the input sensor area to a perimeter area beyond the display area. In systems that have more flexible requirements, an additional gesture band can be located within the display area. The extended input sensor area allows for new gestures that are facilitated by the expanded sensor area. One gesture initiated around the corner of the device is most useful as ‘next’ and ‘previous’ navigation gestures found in traditional electronic publication reader applications, but can be overloaded or repurposed to serve different functions depending on the context. An gesture is used to initiate screen capture process. A third gesture is a corner-fold bookmark gesture and is used to bookmark a page by ‘dog earing’ the corner of the page electronically. An additional gesture, also initiated at the corner of the device launches selectable icons for the most frequently used applications.

Claims

1. A system for detecting and executing a gesture comprising:

a display having an active display area;

an on-screen touch sensor array disposed in registration with the active display area;

an off-screen touch sensor array disposed adjacent to the on-screen touch sensor array and not in registration with the active display area;

a memory that includes instructions for operating the system;

control circuitry coupled to the memory, coupled to the display, coupled to the on-screen touch sensor array, and coupled to the off-screen touch sensor array, the control circuitry capable of executing the instructions and is operable to at least;

receive at least one off-screen touch input detected by the off-screen touch sensor array;

receive at least one on-screen touch input detected by the on-screen touch sensor array, wherein the at least one off-screen and on-screen touch inputs are part of a single gesture;

determine the single gesture associated with the at least one off-screen and on-screen touch inputs; and

execute a function associated with the single gesture.

2. The system of claim 1, wherein the on-screen touch sensor array and the off-screen touch sensor array are integrally formed.

3. The system of claim 1, wherein the function executed by the control circuitry is to display icons representing executable applications on the display.

4. The system of claim 1, wherein the at least one off-screen touch input is a first off-screen touch input, wherein the control circuitry is further operable to execute the instructions to receive a second off-screen touch input from the off-screen touch sensor array.

5. The system of claim 4, wherein the first and second off-screen inputs are received from sensors of the off-screen touch sensor array disposed adjacent a same side of the active display, and wherein the function executed by the control circuitry is to capture a screen on the display.

6. The system of claim 5, wherein the control circuitry is further operable to execute the instructions to:

display a capture selection box on the display;

receive drag inputs from the on-screen sensor array, and move the capture selection box on the display in response to the drag inputs;

receive resize inputs from the on-screen sensor array, and resize the capture selection box on the display in response to the resize inputs; and

capture the screen in response to a capture input received from the on-screen sensor array.

7. The system of claim 4, wherein the first off-screen input is received from sensors of the off-screen touch sensor array disposed adjacent a first side of the active display, wherein the second off-screen input is received from sensors of the off-screen touch sensor array disposed adjacent a second side of the active display, wherein the first and second sides of the active display are substantially perpendicular, and wherein the function executed by the control circuitry is to electronically bookmark a page of an electronic document being displayed on the display.

8. The system of claim 1 further comprising:

a vertical gesture area comprising sensors of the off-screen touch sensor array disposed adjacent a vertical side of the display; and

a horizontal gesture area comprising sensors of the off-screen touch sensor array disposed adjacent a horizontal side of the display.

9. The system of claim 8, wherein the at least one off-screen touch input is a first off-screen touch input and is received from sensors in one of the vertical gesture area or the horizontal gesture area, wherein the control circuitry is further operable to execute the instructions to receive a second off-screen touch input from sensors in the other of the vertical gesture area or the horizontal gesture area.

10. The system of claim 9, wherein the function executed by the control circuitry is a navigation function in an electronic publication displayed on the display.

11. The system of claim 10, wherein the navigation function displays a next page in the electronic publication if the single gesture is a clockwise gesture and displays a previous page in the electronic publication if the single gesture is a counter clockwise gesture.

12. The system of claim 1, wherein the on-screen touch sensor array further comprises an on-screen gesture band consisting of sensors adjacent the off-screen touch sensor array.

13. A system for detecting and executing a gesture comprising:

a display having an active display area;

an on-screen touch sensor array disposed in registration with the active display area, wherein the on-screen touch sensor array further comprises on-screen gesture band consisting of sensors adjacent a perimeter of the active display area;

a memory that includes instructions for operating the system;

control circuitry coupled to the memory, coupled to the display, and coupled to the on-screen touch sensor array, the control circuitry capable of executing the instructions and is operable to at least;

receive a first touch input detected by sensors in the on-screen gesture band;

receive second touch input detected by sensors not in the on-screen gesture band, wherein the first and second touch inputs are part of a single gesture;

determine the single gesture associated with the first and second touch inputs; and

execute a function associated with the single gesture.

14. A method for detecting and executing a gesture in an electronic device having a display with an active display area, the method comprising:

receiving, by control circuitry, at least one on-screen touch input detected by an on-screen touch sensor array, the on-screen touch sensor array disposed in registration with the active display area

receiving, by the control circuitry, at least one off-screen touch input detected by an off-screen touch sensor array, the off-screen touch sensor array disposed adjacent to the on-screen touch sensor array and not in registration with the active display area, wherein the at least one off-screen and on-screen touch inputs are part of a single gesture;

determining, by the control circuitry, the single gesture associated with the at least one off-screen and on-screen touch inputs; and

executing, by the control circuitry, a function associated with the single gesture.

15. The method of claim 14, wherein the act of executing the function further comprises displaying icons representing executable applications on the display.

16. The method of claim 14, wherein the at least one off-screen touch input is a first off-screen touch input, the method further comprising receiving a second off-screen touch input from the off-screen touch sensor array.

17. The method of claim 16, wherein the first and second off-screen inputs are received from sensors of the off-screen touch sensor array disposed adjacent a same side of the active display, and wherein the act of executing the function further comprises capturing a screen on the display.

18. The method of claim 16, wherein the first off-screen input is received from sensors of the off-screen touch sensor array disposed adjacent a first side of the active display, wherein the second off-screen input is received from sensors of the off-screen touch sensor array disposed adjacent a second side of the active display, wherein the first and second sides of the active display are substantially perpendicular, and wherein the act of executing the function further comprises electronically bookmarking a page of an electronic document being displayed on the display.

19. The method of claim 14, wherein the at least one off-screen touch input is a first off-screen touch input, the method further comprising:

receiving the first off-screen touch input from sensors in a vertical gesture area of the off-screen touch sensor array disposed adjacent a vertical side of the display; and

receiving a second off-screen touch input from sensors in a horizontal gesture area of the off-screen touch sensor array disposed adjacent a horizontal side of the display.

20. The method of claim 19, wherein the function is a navigation function in an electronic publication displayed on the display.