Touch region projection onto touch-sensitive surface

• US 10,664,090 B2
• Filed: 07/31/2014
• Issued: 05/26/2020
• Est. Priority Date: 07/31/2014
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Kang, Jinman, Peres, Jordi Morillo, Short, David Bradley
• Primary Examiner(s): Reed, Stephen T.
• Application Number:
  US15/500,816
• Publication Number:
  US 20170228092A1
• Time in Patent Office: 2,126 Days
• Field of Search: None
• CPC Class Codes: G06F 1/1605 Multimedia displays, e.g. with integrated or attached speakers, cameras, microphones
• CPC Class Codes: G06F 1/1616 with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• CPC Class Codes: G06F 1/1639 the display being based on projection
• CPC Class Codes: G06F 1/1673 Arrangements for projecting a virtual keyboard
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04162 for exchanging data with external devices, e.g. smart pens, via the digitiser sensing hardware
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

Examples disclosed herein relate to projecting onto a touch-sensitive surface a projection image having projected regions corresponding to target and non-target touch regions. Examples include a computing system having a touch-sensitive surface, and a camera to capture an image representing an object disposed between the camera and the touch-sensitive surface. The computing system may also include a detection engine to identify, based at least on the object represented in the image, at least one touch region of the touch-sensitive surface, and to generate a projection image including a projected region corresponding to the touch region, and a projector to project the projection image onto the touch-sensitive surface.

Claims

1. A computing system comprising:

a touch-sensitive surface;

a camera to capture an image representing an object disposed between the camera and the touch-sensitive surface;

a detection engine to identify, based at least on the object represented in the image, a touch region associated with the touch-sensitive surface, the touch region comprising at least one of a target touch region and a non-target touch region, wherein input within the target touch region is to be accepted and input within the non-target touch region is to be rejected;

a projection engine to generate a projection image comprising a projected region corresponding to the target touch region; and

a projector to project the projection image, including the target touch region, onto the touch-sensitive surface,

wherein the object is a hand and the non-target touch region corresponds to an area on the touch-sensitive surface over which a palm of the hand is disposed.

2. The computing system of claim 1, wherein the camera comprises at least one of:

an image sensor to capture image data representing the object;

a depth sensor to capture depth data representing the object;

or

an infrared sensor to capture infrared data representing the object,

wherein the detection engine is to identify the touch region of the touch-sensitive surface based on at least one of the image data, the depth data, and the infrared data.

3. The computing system of claim 1, wherein the target touch region of the projected region has at least one visual characteristic different from that of an area of the projection image surrounding the projected region, the visual characteristic comprising a background color, a background pattern, or a background brightness.

4. The computing system of claim 1, wherein the touch region comprises the target touch region from which a touch input is to be accepted, the target touch region being smaller than the touch-sensitive surface.

5. The computing system of claim 1, wherein the touch region comprises the non-target touch region from which a touch input is to be rejected, the non-target touch region being smaller than the touch-sensitive surface.

6. A non-transitory machine-readable storage medium comprising instructions executable by a processing resource of a computing system comprising a touch-sensitive surface and a camera, the instructions executable to:

acquire, from the camera, an image representing an object disposed between the camera and the touch-sensitive surface;

identify a current touch input scenario of a plurality of touch input scenarios;

identify a touch region of the touch-sensitive surface based at least on the current touch input scenario and a location of a portion of the object as represented in the image, the touch region comprising a target touch region and a non-target touch region, wherein input within the target touch region is to be accepted and input within the non-target touch region is to be rejected; and

project a projection image onto the touch-sensitive surface, the projection image comprising a projected region corresponding to the identified touch region,

wherein the object is a hand and the non-target touch region corresponds to an area on the touch-sensitive surface over which a palm of the hand is disposed.

7. The non-transitory machine-readable storage medium of claim 6, wherein the camera comprises at least one of:

an image sensor to capture image data representing the object;

a depth sensor to capture depth data representing the object;

or

an infrared sensor to capture infrared data representing the object,

wherein the instructions are executable to identify the at touch region of the touch-sensitive surface based on at least one of the image data, the depth data, or the infrared data.

8. The non-transitory machine-readable storage medium of claim 6, wherein the projected region has a visual characteristic different from that of an area of the projection image surrounding the projected region, the visual characteristic comprising a background color, a background pattern, or a background brightness.

9. The non-transitory machine-readable storage medium of claim 6, wherein the plurality of touch input scenarios comprise a hand input scenario and a stylus input scenario.

10. The non-transitory machine-readable storage medium of claim 6, wherein the touch region comprises the non-target touch region from which a touch input is to be rejected and the target touch region from which the touch input is to be accepted.

11. A method comprising:

detecting an object on or above a touch-sensitive surface;

determining a target touch region of the touch-sensitive surface based on a portion of the detected object associated with touch input;

determining a non-target touch region of the touch-sensitive surface over which a palm of a hand is disposed;

projecting a projection image on the touch-sensitive surface, the projection image comprising projected region corresponding to the target touch region and the non-target touch region, wherein input within the target touch region is to be accepted and input within the non-target touch region is to be rejected; and

rejecting an input touch to the non-target touch region,

wherein the object is a hand and the non-target touch region corresponds to an area on the touch-sensitive surface over which a palm of the hand is disposed.

12. The method of claim 11, further comprising acquiring an image representing the object, wherein detecting the object comprises detecting the object based at least on the image.

13. The method of claim 11, further comprising receiving projection configuration data, the projection configuration data comprising at least one visual characteristic of the projected region.

14. The method of claim 11, further comprising:

accepting a second input touch to the target touch region.