Displaying an object indicator

• US 10,168,838 B2
• Filed: 09/30/2014
• Issued: 01/01/2019
• Est. Priority Date: 09/30/2014
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Kang, Jinman, Morillo Peres, Jordi, Short, David Bradley
• Primary Examiner(s): Osorio, Ricardo L
• Application Number:
  US15/514,639
• Publication Number:
  US 20170249054A1
• Time in Patent Office: 1,554 Days
• CPC Class Codes: G06F 2200/1631 Panel PC, e.g. single housing hosting PC and display panel
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886

Abstract

Examples disclosed herein describe, among other things, a computing system. The computing system may in some examples include a touch-sensitive surface, a display, and at least one camera to capture an image representing an object disposed between the camera and the touch-sensitive surface. The computing system may also include a detection engine to determine, based at least on the image, display coordinates, where the display coordinates may correspond to the object'"'"'s projection onto the touch-sensitive surface, and the display is not parallel to the touch-sensitive surface. In some examples, the detection engine is also to display an object indicator at the determined display coordinates on the display.

Claims

1. A computing system comprising:

a touch-sensitive surface;

a display;

at least one camera to capture an image representing an object disposed between the camera and the touch-sensitive surface; and

a detection engine to;

based at least on the image, determine display coordinates corresponding to the object'"'"'s projection onto the touch-sensitive surface, wherein the display is not parallel to the touch-sensitive surface;

select an object indicator from at least two different object indicators based at least on whether the object is touching the touch-sensitive surface;

determine to display the object indicator based on a ratio of the object'"'"'s distance from the touch-sensitive surface and the object'"'"'s distance from the display when the object is not touching either of the touch-sensitive surface or the display; and

provide the selected object indicator to the display for displaying the selected object indicator at the determined display coordinates on the display.

2. The computing system of claim 1, wherein:

the touch-sensitive surface is to detect a touch; and

the detection engine is further to;

determine whether the touch detected by the touch-sensitive surface is associated with the object.

3. The computing system of claim 2, wherein the object comprises a fingertip.

4. The computing system of claim 1, wherein the display comprises a touch-sensitive display, and the detection engine is further to:

determine whether to display the object indicator based on at least one of the object'"'"'s distance from the touch-sensitive surface, the object'"'"'s distance from the touch-sensitive display or a combination of both the object'"'"'s distance from the touch-sensitive surface and the object'"'"'s distance from the display.

5. The computing system of claim 4, wherein the detection engine further is to determine whether to display the object indicator based on a difference between the object'"'"'s distance from the touch-sensitive surface and the object'"'"'s distance from the display.

6. A method comprising:

determining locations of a plurality of objects, wherein at least one object is touching a touch-sensitive surface or a display and at least one object is not touching either of the touch-sensitive surface or the display;

based at least on the locations, determining for each object in the plurality of objects display coordinates corresponding to coordinates of the object'"'"'s projection onto the surface;

determine to display an object indicator for the at least one object not touching either of the touch-sensitive surface or display based on a ratio between the object'"'"'s distance from the touch-sensitive surface and the object'"'"'s distance from the display; and

for each object in the plurality of objects, display the object indicator at the determined display coordinates on the display.

7. The method of claim 6, the method further comprising:

for each object from the plurality of objects, selecting the object indicator from at least two different object indicators based on whether the object is touching the touch-sensitive surface.

8. The method of claim 6, wherein the determination of the locations is based on a plurality of images obtained from at least one of an RGB camera, an infrared camera, and a depth camera.

9. The method of claim 6, wherein determining whether to display the object indicator is based on a difference between the object'"'"'s distance from the surface and the object'"'"'s distance from the display.

10. A non-transitory machine-readable storage medium comprising instructions executable by a processing resource of a computing system comprising a display, the instructions executable to:

determine three-dimensional coordinates of an object based on at least two images obtained from two different cameras of a plurality of cameras, wherein the plurality of cameras comprises at least an RGB camera, an infrared camera, and a depth camera;

based on the three-dimensional coordinates of the object, determine two-dimensional display coordinates corresponding to two-dimensional projection coordinates, wherein the two-dimensional projection coordinates correspond to the object'"'"'s projection onto a surface other than the display'"'"'s surface;

determine to display an object indicator based on a ratio of the object'"'"'s distance from a touch-sensitive surface and the object'"'"'s distance from the display when the object is not touching either of the touch-sensitive surface or the display; and

provide for display of the object indicator at the determined display coordinates on the display.

11. The non-transitory machine-readable storage medium of claim 10, wherein the instructions are further executable to:

receive, from the touch-sensitive surface, touch data representing at least one touch;

determining whether the touch is associated with the object; and

selecting the object indicator from at least two different object indicators based on the determination.

12. The non-transitory machine-readable storage medium of claim 11, wherein the instructions are further executable to detect a type of the object, and wherein selecting the object indicator is further based on the type of the object.

13. The non-transitory machine-readable storage medium of claim 10, wherein the instructions are further executable to:

determine whether to provide for display the object indicator based on a difference between the object'"'"'s distance from the surface and the object'"'"'s distance from the display.