Recognizing selection regions from multiple simultaneous input

• US 10,095,392 B2
• Filed: 05/06/2016
• Issued: 10/09/2018
• Est. Priority Date: 05/30/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Weiss, John Guido Atkins
• Primary Examiner(s): TITCOMB, WILLIAM D
• Application Number:
  US15/148,380
• Publication Number:
  US 20160253075A1
• Time in Patent Office: 886 Days
• Field of Search: 715784
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04855 Interaction with scrollbars
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Selection regions can be recognized from multiple simultaneous inputs. Input selection regions are calculated from simultaneous contacts on a multi-touch input display surface. Computer system users can use natural and/or more intuitive hand gestures to select items on an input/display surface. Selection regions can be dynamically adjusted to in response to detected changes in contact at different locations on a surface. For example, selection region changes can be updated in essentially real-time as fingers are added and moved on the multi-touch input display surface, and as the surface is scrolled. The calculation of selection regions can vary based on an application and/or operating system context.

Claims

1. At a computer system including a multi-touch input display surface, a method for selecting items displayed on the multi-touch input display surface, the method comprising:

an act of detecting a first contact with the multi-touch input display surface at a detected first location on the multi-touch input display surface; and

an act of detecting a second contact with the multi-touch input display surface at a detected second location on the multi-touch input display surface;

an act of calculating a selection region on the multi-touch input display surface based at least on the detected first location and the detected second location, wherein calculating the selection region on the multi-touch input display surface comprises calculating the selection region based on a context at the computer system;

an act of selecting one or more items displayed on the multi-touch input display surface in response to the one or more items being at least partially included within at least a portion of the calculated selection region; and

an act of rendering item visual feedback at the multi-touch input surface to visually indicate the one or more items having been selected by at least altering display characteristics of the one or more selected items.

2. The method as recited in claim 1, wherein the first and second locations each include coordinate locations on the multi-touch input display surface that are abstracted from areas of the first and second contact on the multi-touch input display surface, respectively.

3. The method as recited in claim 1, the method further comprising:

detecting a third contact with the multi-touch input display surface at a detected third location on the multi-touch input display surface;

calculating a new selection region based at least in part on the detected first location and the detected second location and the detected third location;

selecting at least one item in the new selection region; and

altering display characteristics of the at least one item by at least highlighting the at least one item.

4. The method as recited in claim 1, wherein the altering display characteristics of the one or more selected items includes highlighting the one or more selected items.

5. The method as recited in claim 2, wherein the first and second contact each occur between a human hand and the multi-touch input display surface.

6. The method as recited in claim 1, wherein the method further includes receiving an ordered set of points for each of the detected first and second locations.

7. The method as recited in claim 1, wherein the one or more items includes at least one item that only partially intersects or overlaps with the selection region.

8. The method as recited in claim 1, wherein the method further includes an act of rending a visible boundary of the selection region.

9. A computer system comprising:

one or more processors;

a multi-touch input display surface; and

at least one storage device having stored computer-executable instructions which are executable by the one or more processors for causing the computer system to perform a method for selecting items displayed on the multi-touch input display surface, the method comprising;

an act of detecting a first contact with the multi-touch input display surface at a detected first location on the multi-touch input display surface; and

an act of detecting a second contact with the multi-touch input display surface at a detected second location on the multi-touch input display surface;

an act of calculating a selection region on the multi-touch input display surface based at least on the detected first location and the detected second location, wherein calculating the selection region on the multi-touch input display surface comprises calculating the selection region based on a context at the computer system;

an act of selecting one or more items displayed on the multi-touch input display surface in response to the one or more items being at least partially included within at least a portion of the calculated selection region; and

an act of rendering item visual feedback at the multi-touch input surface to visually indicate the one or more items having been selected by at least altering display characteristics of the one or more selected items.

10. The computer system as recited in claim 9, wherein the one or more items includes at least one item that only partially intersects or overlaps with the selection region.

11. The computer system as recited in claim 9, wherein the method further includes:

detecting a third contact with the multi-touch input display surface at a detected third location on the multi-touch input display surface;

calculating a new selection region based at least in part on the detected first location and the detected second location and the detected third location; and

selecting at least one item in the new selection region.

12. The computer system as recited in claim 9, wherein the first and second locations each include coordinate locations on the multi-touch input display surface that are abstracted from areas of the first and second contact on the multi-touch input display surface, respectively.

13. The computer system as recited in claim 12, wherein the first and second contact each occur between a human hand and the multi-touch input display surface.

14. The computer system as recited in claim 9, wherein the method further includes receiving an ordered set of points for each of the detected first and second locations.

15. The computer system as recited in claim 9, wherein the altering display characteristics of the one or more selected items includes highlighting the one or more selected items.

16. The computer system as recited in claim 9, wherein the method further includes an act of rending a visible boundary of the selection region.

17. A storage device for operation with a computing system having one or more processors and a multi-touch input display surface, the storage device comprising:

stored computer-executable instructions which are executable by the one or more processors for causing the computing system to perform a method for selecting items displayed on the multi-touch input display surface, the method comprising;

an act of detecting a first contact with the multi-touch input display surface at a detected first location on the multi-touch input display surface; and

an act of detecting a second contact with the multi-touch input display surface at a detected second location on the multi-touch input display surface;

an act of calculating a selection region on the multi-touch input display surface based at least on the detected first location and the detected second location, wherein calculating the selection region on the multi-touch input display surface comprises calculating the selection region based on a context at the computer system;

an act of selecting one or more items displayed on the multi-touch input display surface in response to the one or more items being at least partially included within at least a portion of the calculated selection region; and

an act of rendering item visual feedback at the multi-touch input surface to visually indicate the one or more items having been selected by at least altering display characteristics of the one or more selected items.

18. The storage device as recited in claim 17, wherein the first and second locations each include coordinate locations on the multi-touch input display surface that are abstracted from areas of the first and second contact on the multi-touch input display surface, respectively, and wherein the first and second contact each occur between a human hand and the multi-touch input display surface.

19. The storage device as recited in claim 17, wherein the method further includes an act of rending a visible boundary of the selection region and wherein the one or more items includes at least one item that overlaps with the visible boundary of the selection region.

20. The storage device as recited in claim 17, the method further comprising:

detecting a third contact with the multi-touch input display surface at a detected third location on the multi-touch input display surface;

calculating a new selection region based at least in part on the detected first location and the detected second location and the detected third location;

selecting at least one item in the new selection region; and

altering display characteristics of the at least one item by at least highlighting the at least one item.