Displaying an object indicator

• US 10,379,680 B2
• Filed: 12/13/2018
• Issued: 08/13/2019
• Est. Priority Date: 09/30/2014
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Kang, Jinman, Morillo Peres, Jordi, Short, David Bradley
• Primary Examiner(s): Osorio, Ricardo
• Application Number:
  US16/218,930
• Publication Number:
  US 20190114034A1
• Time in Patent Office: 243 Days
• CPC Class Codes: G06F 2200/1631 Panel PC, e.g. single housing hosting PC and display panel
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886

Abstract

Examples disclosed herein describe, among other things, a computing system. The computing system may in some examples include a touch-sensitive surface, a display, and at least one camera to capture an image representing an object disposed between the camera and the touch-sensitive surface. The computing system may also include a detection engine to determine, based at least on the image, display coordinates, where the display coordinates may correspond to the object'"'"'s projection onto the touch-sensitive surface, and the display is not parallel to the touch-sensitive surface. In some examples, the detection engine is also to display an object indicator at the determined display coordinates on the display.

Claims

1. A computing system comprising:

a touch-sensitive surface;

a display, wherein the display is not parallel to the touch-sensitive surface;

at camera to capture an image representing an object disposed between the camera and the touch-sensitive surface; and

a non-transitory machine-readable storage medium storing instructions executable by a processing resource to;

determine display coordinates corresponding to the object'"'"'s projection onto the touch-sensitive surface;

select an object indicator;

determine to display the object indicator based on a combination of both the object'"'"'s distance from the touch-sensitive surface and the object'"'"'s distance from the display; and

provide the selected object indicator to the display for displaying the selected object indicator at the determined display coordinates on the display.

2. The computing system of claim 1, wherein the instructions further comprise instructions to determine the display coordinates corresponding to the object'"'"'s projection based on the image representing the object.

3. The computing system of claim 1, wherein the instructions further comprise instructions to select the object indicator from at least two different object indicators based on whether the object is touching the touch-sensitive surface.

4. The computing system of claim 1, wherein the instructions further comprise instructions to determine whether the touch detected by the touch-sensitive surface is associated with the object.

5. The computing system of claim 4, wherein the instructions further comprise instructions to determine whether the touch detected by the touch-sensitive surface is associated with the object based on whether a location of the touch coincides or is within a predefined distance from the object or from the objects'"'"' projections on the touch sensitive surface.

6. The method of claim 5, wherein the determination of the locations is based on a plurality of images obtained from at a RGB camera, an infrared camera, a depth camera, or combinations thereof.

7. The computing system of claim 1, wherein the instructions further comprise instructions to determine to display the object indicator based on a ratio of the object'"'"'s distance from the touch-sensitive surface and the object'"'"'s distance from the display.

8. The computing system of claim 1, wherein the instructions further comprise instructions to determine whether to display the object indicator based on a difference between the object'"'"'s distance from the touch-sensitive surface and the object'"'"'s distance from the display.

9. A method comprising:

determining a locations of a plurality of objects including an object that is not touching either of a touch-sensitive surface or a display that is not parallel to the touch-sensitive surface;

determining for each object in the plurality of objects display coordinates corresponding to coordinates of each object'"'"'s projection onto the touch-sensitive surface;

determine to display an object indicator for the object not touching either of the touch-sensitive surface or display based on a combination of both the object'"'"'s distance from the touch-sensitive surface and the object'"'"'s distance from the display; and

display the determined object indicator at the determined display coordinates on the display.

10. A non-transitory machine-readable storage medium comprising instructions executable by a processing resource to:

determine three-dimensional coordinates of an object;

based on the three-dimensional coordinates of the object, determine two-dimensional display coordinates corresponding to two-dimensional projection coordinates, wherein the two-dimensional projection coordinates correspond to the object'"'"'s projection onto a touch-sensitive surface other than a display'"'"'s surface included in a computing system, wherein the display'"'"'s surface is not parallel to the touch-sensitive surface;

determine to display an object indicator based on a combination of both the object'"'"'s distance from the touch-sensitive surface and the object'"'"'s distance from the display; and

provide for display of the object indicator at the determined display coordinates on the display.

11. The non-transitory machine-readable storage medium of claim 10, wherein the instructions further comprising instructions to determine the three-dimensional coordinates of the object based on at least two images obtained from two different cameras of a plurality of cameras including an RGB camera, an infrared camera, and a depth camera.

12. The non-transitory machine-readable storage medium of claim 10, wherein the instructions further comprise instructions to detect a type of the object, and wherein selecting the object indicator is further based on the type of the object.

13. The non-transitory machine-readable storage medium of claim 12, wherein the instructions further comprising instructions to detect whether the object is a stylus, a fingertip, a game piece, a book, a mug, a document, or a photo.

14. The non-transitory machine-readable storage medium of claim 10, wherein the instructions further comprising instructions to determine to display the object indicator based on the object'"'"'s distance from the touch-sensitive surface and the object'"'"'s distance from the display when the object is not touching either of the touch-sensitive surface or the display.