VIRTUAL TOUCH SCREEN

• US 20200133432A1
• Filed: 10/02/2019
• Published: 04/30/2020
• Est. Priority Date: 04/12/2013
• Status: Abandoned Application

• Current Assignee: Iconics, Inc. (Mitsubishi Electric Corporation)
• Original Assignee: Iconics, Inc. (Mitsubishi Electric Corporation)
• Inventors: Kresl, Vojta, Elsbree, Christopher N., Agrusa, Russell L., De Barros, Paulo G., Altman, Petr
• Application Number:
  US16/591,007
• Publication Number:
  US 20200133432A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

Apparatus and methods are provided for converting a display into a touch display. One or more optical sensors are arranged proximate the display. A processor receives a signal from the optical sensor(s) and, based on the signal, executes instructions for: (i) determining a distance between a pointer device and a surface of the display signal; (ii) determining a position of the pointer device on the surface of the display; (iii) when the distance is less than a threshold detection distance and greater than a threshold touch distance, providing an indication on the display that the position of the pointer device has been determined; and (iv) when the distance is less than the threshold touch distance, taking an action indicative of contact between the pointer device and the surface of the display.

Claims

1-26. -26. (canceled)

27. A system comprising:

at least one laser projector aimed in a direction substantially parallel to a surface of a display;

at least one camera positioned proximate the display; and

a processor configured to receive a signal from the at least one camera and, based thereon, perform operations comprising;

determining a position of a pointer device in front of the display; and

adjusting an image presented on the display based on the determined position.

28. The system of claim 27, wherein the at least one laser projector is positioned outside a perimeter of the display.

29. The system of claim 27, wherein the at least one laser projector is positioned substantially within a plane defined by a surface of the display.

30. The system of claim 27, wherein the at least one laser projector comprises more than one laser projector.

31. The system of claim 27, wherein the at least one camera is positioned outside a perimeter of the display.

32. The system of claim 27, wherein the at least one camera is configured to obtain an image of the pointer device near the display.

33. The system of claim 27, wherein the at least one camera comprises more than one camera.

34. The system of claim 27, wherein the pointer device comprises a finger of a user.

35. The system of claim 27, wherein determining the position comprises determining a separation distance between the pointer device and the surface of the display.

39. A method comprising:

projecting laser light from at least one laser projector aimed in a direction substantially parallel to a surface of a display;

receiving a signal from at least one camera positioned proximate the display;

determining, based on the signal, a position of a pointer device in front of the display; and

adjusting an image presented on the display based on the determined position.

40. The method of claim 39, wherein the at least one laser projector is positioned outside a perimeter of the display.

41. The method of claim 39, wherein the at least one laser projector is positioned substantially within a plane defined by a surface of the display.

42. The method of claim 39, wherein the at least one camera is positioned outside a perimeter of the display.

43. The method of claim 39, wherein the at least one camera is configured to obtain an image of the pointer device near the display.

44. The method of claim 39, wherein determining the position comprises determining a closest point to the at least one pointer device on the surface of the display.

45. The method of claim 39, wherein adjusting the image comprises taking an action indicative of contact between the pointer device and the surface of the display.

46. An article, comprising:

a non-transitory computer-readable medium having instructions stored thereon that, when executed by one or more computer processors;

cause the computer processors to perform operations comprising;

receiving a signal from at east one camera positioned proximate a surface of a display,

wherein the at least one camera is configured to obtain an image of a pointer device near the display while at least one laser projector is aimed in a direction substantially parallel to the surface of the display;

determining, based on the signal, a position of the pointer device in front of the display; and

adjusting an image presented on the display based on the determined position.