Display mapping modes for multi-pointer indirect input devices

• US 9,658,715 B2
• Filed: 10/20/2011
• Issued: 05/23/2017
• Est. Priority Date: 10/20/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Drayton, Peter, Wang, Lei, Honji, Scott
• Primary Examiner(s): Ma, Tize
• Application Number:
  US13/277,220
• Publication Number:
  US 20130100158A1
• Time in Patent Office: 2,042 Days
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment

Abstract

An indirect interaction input device, such as but not limited to a touch sensor, can provide multiple points of input, such as two or more positions in a coordinate space where a user is touching the sensor. These multiple points are in turn mapped to multiple positions on an output device such as a display. The mapping can be relative or absolute. With a relative mapping, boundary conditions for single and multiple displays are applied and, if appropriate, remedial offsets are added to the input points to maintain a desired user interaction model.

Claims

1. A computer-implemented process comprising:

receiving information describing input points from a multi-pointer indirect input device into memory;

mapping the input points to coordinates in a display coordinate space for a display including multiple monitors;

determining if the coordinates for a mapped input point are not within a visible area of the display, wherein the determining comprises determining if the coordinates for the mapped input point lie in an internal void in a virtual display area encompassing the multiple monitors;

in response to determining that the coordinates of the mapped input point lie in an internal void in the virtual display area encompassing the multiple monitors;

selecting a nonconforming bounding box containing points outside of the visible area of the display;

computing an offset between coordinates of the nonconforming bounding box and coordinates of the visible area of the display in the display coordinate space that, when added to coordinates of at least one corner of the nonconforming bounding box, places the at least one corner of the nonconforming bounding box within the visible area of the display;

adding the computed offset to the coordinates of the mapped input points to provide updated coordinates for the mapped input points, such that the updated coordinates of at least one of the mapped input points is within the visible area of the display; and

displaying output points, corresponding to the input points, on the display at the updated coordinates for the mapped input points.

2. The computer-implemented process of claim 1, wherein mapping further comprises:

selecting an input locator in device coordinate space; and

mapping the input locator to an output locator in display coordinate space.

3. The computer-implemented process of claim 2, further comprising determining size and location of a viewport representing the device coordinate space in display coordinates according to the output locator.

4. The computer-implemented process of claim 2, wherein selecting the input locator comprises selecting a first arriving input point as the input locator.

5. The computer-implemented process of claim 2, wherein selecting the input locator comprises selecting a point with geometric precedence over other points as the input locator.

6. The computer-implemented process of claim 1, further comprising applying a timer to the received input points to account for arrival and departure timeout of the received input points on the multi-pointer indirect input device.

7. The computer-implemented process of claim 1, further comprising:

receiving an indication of a selected mapping option, selected from among at least relative mapping and absolute mapping;

wherein mapping the input points to coordinates in the display coordinate space is performed in accordance with the selected mapping option.

8. The computer-implemented process of claim 7, wherein the selected mapping is a relative mapping.

9. The computer-implemented process of claim 1, wherein the computed offset, when added to the coordinates of the mapped input points, places the coordinates of all mapped input points within the visible area of the display.

10. An article of manufacture, comprising:

a computer-readable storage device;

computer program instructions stored on the computer readable storage device which, when processed by a computer, instruct the computer to perform a process comprising;

receiving information describing input points from a multi-pointer indirect input device into memory;

mapping the input points to coordinates in a display coordinate space for a display including multiple monitors;

determining if the coordinates of the mapped input points are not within a visible area defined by outer boundaries of the display, comprising determining if the coordinates for a mapped input point lie in an internal void in a virtual display area encompassing the multiple monitors;

in response to a determination that the coordinates of the mapped input point lie in the internal void in the virtual display area;

selecting a nonconforming bounding box containing points outside of the visible area of the display; and

computing an offset between coordinates of the nonconforming bounding box and coordinates of the visible area of the display in the display coordinate space that, when added to coordinates of at least one corner of the nonconforming bounding box, places the at least one corner of the nonconforming bounding box within the visible area of the display;

adding the computed offset to the coordinates of the mapped input points to provide updated coordinates for the mapped input points, such that the updated coordinates of at least one of the mapped input points is within the visible area of the display; and

displaying output points, corresponding to the input points, on the display at the updated coordinates for the mapped input points.

11. The article of manufacture of claim 10, wherein mapping further comprises:

selecting an input locator in device coordinate space; and

mapping the input locator to an output locator in display coordinate space.

12. The article of manufacture of claim 11, further comprising determining a size and location of a viewport representing the device coordinate space in display coordinates according to the output locator.

13. The article of manufacture of claim 11, wherein selecting the input locator comprises selecting a first arriving input point as the input locator.

14. The article of manufacture of claim 11, wherein selecting the input locator comprises selecting a point with geometric precedence over other points as the input locator.

15. The article of manufacture of claim 10, further comprising applying a timer to the received input points to account for arrival and departure timeout of the received input points on the multi-pointer indirect input device.

16. The article of manufacture of claim 10, wherein the process performed by the computer further comprises receiving an indication of a selected mapping option, selected from among at least relative mapping and absolute mapping, and wherein mapping the input points to coordinates in the display coordinate space is performed in accordance with the selected mapping option.

17. The article of manufacture of claim 10, wherein the computed offset, when added to the coordinates of the mapped input points, places the coordinates of all mapped input points within the visible area of the display.

18. A computer system, comprising;

a processor and memory;

an input connection to receive information describing input points from a multi-pointer indirect input device into the memory;

the processor being configured to;

map the input points to coordinates in a display coordinate space for a display, the display including multiple monitors, and determine if the coordinates of the mapped input points are not within a visible area of the display;

determine if the coordinates for a mapped input point are not within a visible area defined by outer boundaries of the display, comprising determining if the coordinates for the mapped input point lie in an internal void in a virtual display area encompassing the multiple monitors;

in response to a determination that the coordinates of the mapped input point lie in the internal void of the virtual display area, to;

select a nonconforming bounding box containing points outside of the visible area of the display;

compute an offset between coordinates of the nonconforming bounding box and coordinates of the visible area of the display in the display coordinate space that, when added to coordinates of at least one corner of the nonconforming bounding box, places the at least one corner of the nonconforming bounding box within the visible area of the display;

add the computed offset to the coordinates of the mapped input points to provide updated coordinates for the mapped input points, such that the updated coordinates of at least one of the mapped input points is within the visible area of the display; and

display output points, corresponding to the input points, on the display at the updated coordinates for the mapped input points.

19. The computer system of claim 18, wherein the computed offset, when added to the coordinates of the mapped input points, places the coordinates of all mapped input points within the visible area of the display.

20. The computer system of claim 18, wherein the processor is further configured to receive an indication of a selected mapping option, selected from among at least relative mapping and absolute mapping, and wherein the processor is further configured to map the input points to coordinates in the display coordinate space in accordance with the selected mapping option.