Displays and information input devices

• US 9,569,093 B2
• Filed: 01/06/2014
• Issued: 02/14/2017
• Est. Priority Date: 05/18/2005
• Status: Active Grant

• Current Assignee: Power2B, Inc.
• Original Assignee: Power2B, Inc.
• Inventors: Lipman, Sarah Michelle, Kali, Eran, Gutin, Boris, Margalit, Moti, Lipman, Robert Michael, Zwiebel, Ken
• Primary Examiner(s): ABDULSELAM, ABBAS I
• Application Number:
  US14/148,309
• Publication Number:
  US 20140132542A1
• Time in Patent Office: 1,135 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1637 Details related to the display arrangement, including those related to the mounting of the display in the housing
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/03542 Light pens for emitting or receiving light
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0386 for light pen
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

An integrated display and input device including a pixel array operative to provide a visually sensible output, at least one sensor operative to sense at least a position of at least one object with respect to the pixel array when the at least one object has at least a predetermined degree of propinquity to the pixel array and circuitry receiving an output from the at least one sensor and providing a non-imagewise input representing the position of the at least one object relative to the pixel array to utilization circuitry.

Claims

1. An integrated display and input device, comprising:

a pixel array operative to provide a visually sensible output;

at least one sensor operative to sense a position of an object with respect to the pixel array when the object is within a predetermined degree of propinquity to the pixel array;

at least one illuminator that provides backlighting and illuminates the object within the predetermined degree of propinquity; and

circuitry that receives an output from the at least one sensor and provides a non-imagewise input representing the position of the object relative to the pixel array to utilization circuitry.

2. The integrated display and input device according to claim 1, wherein the at least one illuminator is located in a plane coplanar with or parallel to the at least one sensor.

3. The integrated display and input device according to claim 1, wherein the at least one sensor senses light reflected from the object.

4. The integrated display and input device according to claim 3, wherein the at least one sensor senses ambient light reflected from the object.

5. The integrated display and input device according to claim 1, wherein the at least one sensor senses IR light reflected from the object.

6. The integrated display and input device according to claim 1, wherein the object is a finger.

7. The integrated display and input device according to claim 1, wherein the object is a located device.

8. The integrated display and input device according to claim 1, further comprising utilization circuitry.

9. The integrated display and input device according to claim 8, wherein the utilization circuitry provides chording functionality.

10. The integrated display and input device according to claim 8, wherein the utilization circuitry provides functionality to distinguish at least between positions of the object when touching and not touching the device.

11. The integrated display and input device according to claim 8, wherein the utilization circuitry provides functionality to distinguish at least between directions of motion of the object towards and away from the device.

12. The integrated display and input device according to claim 8, wherein the utilization circuitry provides functionality to compute at least one characteristic of a trajectory of motion of the object substantially parallel to the pixel array.

13. The integrated display and input device according to claim 12, wherein the at least one characteristic includes at least one of location, direction, velocity, or change in direction.

14. The integrated display and input device according to claim 8, wherein the utilization circuitry enables panning or scrolling.

15. The integrated display and input device according to claim 8, wherein the utilization circuitry enables one-handed zooming.

16. The integrated display and input device according to claim 8, wherein the utilization circuitry determines a distinction between the object touching the device and the object not touching the device.

17. The integrated display and input device according to claim 16, wherein the utilization circuitry enables mouse over or click.

18. The integrated display and input device according to claim 16, wherein the utilization circuitry enables document browsing.

19. The integrated display and input device according to claim 16, wherein the utilization circuitry enables gaming.

20. The integrated display and input device according to claim 16, wherein the utilization circuitry detects differences in sensed relative positions for fingers of a user.

21. The integrated display and input device according to claim 16, wherein the utilization circuitry provides interactive television functionality.

22. The integrated display and input device according to claim 16, wherein the utilization circuitry provides portable computer functionality.

23. The integrated display and input device according to claim 1, wherein the at least one sensor comprises a plurality of detector elements arranged in a plane substantially parallel to a viewing plane.

24. The integrated display and input device according to claim 1, wherein the at least one sensor is substantially coplanar with the pixel array.

25. The integrated display and input device according claim 1, wherein the pixel array and the at least one sensor each comprise a respective plurality of elements arranged in substantially parallel planes that are substantially parallel to a viewing plane.

26. The integrated display and input device according to claim 1, wherein the at least one sensor comprises a detector assembly arranged at an edge of a viewing plane defining plate.

27. The integrated display and input device according to claim 26, wherein the detector assembly is arranged about the edge of the viewing plane defining plate.

28. The integrated display and input device according to claim 26, wherein the detector assembly is arranged along the edge of the viewing plane defining plate.

29. The integrated display and input device according to claim 26, wherein the detector assembly further comprises a support substrate, and an arrangement of detector elements.

30. The integrated display and input device according to claim 29, wherein the detector assembly further comprises a cover layer.

31. The integrated display and input device according to claim 30, wherein the cover layer is formed of a light transmissive material.

32. The integrated display and input device according to claim 30, wherein the cover layer includes a mask having apertures defined therein.

33. The integrated display and input device according to claim 30, wherein the cover layer includes a field-of-view defining mask having light-collimating tunnel-defining apertures.

34. The integrated display and input device according to claim 30, wherein the cover layer includes lenses.

35. The integrated display and input device according to claim 29, wherein the support substrate is integrated with a housing of the integrated display and input device.

36. The integrated display and input device according to claim 29, wherein the arrangement of detector elements comprises a plurality of discrete single-element detectors.

37. The integrated display and input device according to claim 29, wherein the arrangement of detector elements comprises an integrally formed multi-element detector array.

38. The integrated display and input device according to claim 29, wherein the arrangement of detector elements comprises a plurality of discrete multi-element detectors.

39. The integrated display and input device according to claim 26, wherein the edge includes a mask having apertures defined therein.

40. The integrated display and input device according to claim 26, wherein the edge includes a field-of-view defining mask having light-collimating tunnel-defining apertures.

41. The integrated display and input device according to claim 26, wherein the edge includes lenses.

42. The integrated display and input device according to claim 26, wherein the at least one sensor comprises a plurality of substantially forward-facing detectors arranged about edges of a display element.

43. An integrated display and input device, comprising:

a pixel array operative to provide a visually sensible output;

at least one illuminator that illuminates an object, the at least one illuminator is located substantially in a same plane as at least one backlighting illuminator associated with the pixel array;

at least one sensor operative to sense a position of the object with respect to the pixel array when the object has a predetermined degree of propinquity to the pixel array; and

circuitry for receiving an output from the at least one sensor and providing a non-imagewise input representing the position of the object relative to the pixel array.

44. An integrated display and input device, comprising:

a pixel array operative to provide a visually sensible output;

a detector assembly arranged at an edge of a viewing plane defining plate, the detector assembly includes a support substrate and an arrangement of sensor elements, wherein at least one sensor element in the arrangement of sensor elements detects electromagnetic radiation at a baseline level and senses the position of the object with respect to the pixel array when the object is within a predetermined degree of propinquity to the pixel array; and

circuitry that receives an output from the detector assembly and provides a non-imagewise input to utilization circuitry, the non-imagewise input represents the position of the object relative to the pixel array and corresponds to a location of the at least one sensor element in the arrangement when an amount of electromagnetic radiation or a change in the amount of electromagnetic radiation detected by the at least one sensor element exceeds a first predetermined threshold.

45. The integrated display and input device according to claim 44, wherein the at least one sensor element detects electromagnetic radiation reflected by the object.

46. The integrated display and input device according to claim 45, wherein the light reflected by the object propagates within the viewing plane defining plate to the at least one sensor element.

47. The integrated display and input device according to claim 45, wherein the light reflected by the object propagates above the viewing plane defining plate to the at least one sensor element.

48. The integrated display and input device according to claim 45, wherein the light reflected by the object is transmitted through the viewing plane defining plate directly to the at least one sensor element.

49. The integrated display and input device according to claim 44, wherein the non-imagewise input further corresponds to a location of the at least one sensor element when the amount of radiation detected by the at least one sensor element is below a second predetermined threshold.

50. The integrated display and input device according to claim 49, further comprising:

detector processing circuitry operative to;

receive outputs from individual sensor elements of the arrangement of sensor elements;

determine when at least one of the amount of electromagnetic radiation detected by the at least one sensor element exceeds the first predetermined threshold, the change in the amount of electromagnetic radiation detected by the at least one sensor element exceeds the first predetermined threshold, or the amount of radiation detected by the at least one sensor element is below the second predetermined threshold; and

provide a detector output for the at least one sensor element;

array processing circuitry operative to receive the detector output and generate an array detection output; and

position determining circuitry operative to receive the array detection output and determine the position of the object therefrom.

51. The integrated display and input device according to claim 50, wherein the array detection output includes information corresponding to the location of an impingement point of the object on the viewing plane defining plate.

52. The integrated display and input device according to claim 50, wherein the array detection output includes information corresponding to the location of the object relative to the viewing plane defining plate.

53. The integrated display and input device according to claim 44, wherein the electromagnetic radiation detected at the baseline level is from an external source relative to the integrated display and input device.

54. The integrated display and input device according to claim 53, wherein the external source comprises at least one of sunlight, artificial room lighting, or infrared (IR) radiation emitted from a human body.

55. The integrated display and input device according to claim 53, further comprising an illumination subassembly operative to provide illumination for augmenting the electromagnetic radiation from the baseline level.

56. The integrated display and input device according to claim 44, further comprising an illumination subassembly operative to provide the electromagnetic radiation at said baseline level.

57. The integrated display and input device according to claim 56, wherein the illumination subassembly comprises at least one electromagnetic radiation emitting source.

58. The integrated display and input device according to claim 57, wherein the at least one electromagnetic radiation emitting source comprises at least one of an infrared (IR) emitting light emitting diode (LED), or a visible light emitting LED.

59. The integrated display and input device according to claim 58, wherein the at least one electromagnetic radiation emitting source is disposed at an intersection of two mutually perpendicular edges of the viewing plane defining plate.

60. The integrated display and input device according to claim 58, wherein the at least one electromagnetic radiation emitting source forms part of a linear arrangement of display backlights underlying the viewing plane defining plate.

61. The integrated display and input device according to claim 56, wherein the illumination subassembly comprises at least one substantially linear arrangement of a plurality of electromagnetic radiation emitting sources arranged in parallel to the edge of the viewing plane defining plate.

62. The integrated display and input device according to claim 61, wherein at least one of the plurality of electromagnetic radiation emitting sources is arranged behind the at least one sensor.

63. A position sensing assembly comprising:

a plate defining a surface;

at least one pixel array including a plurality of detector elements detecting electromagnetic radiation at a baseline level, said at least one pixel array being operative to sense a position of an object with respect to said surface according to locations of ones of said plurality of detector elements at which at least one of the amount of electromagnetic radiation detected or the change in the amount of electromagnetic radiation detected exceed a predetermined threshold, said at least one pixel array being operative to sense at least a position of at least one object with respect to said at least one pixel array when said at least one object has at least a predetermined degree of propinquity to said at least one pixel array; and

circuitry receiving an output from said at least one pixel array and providing a non-imagewise input representing the position of said at least one object relative to said at least one pixel array to utilization circuitry.

64. The position sensing assembly according to claim 63, and further comprising at least one IR illuminator for illuminating said at least one object when it has said at least a predetermined degree of propinquity to said at least one pixel array.

65. The position sensing assembly according to claim 64, wherein said at least one illuminator also functions as at least one backlighting illuminator associated with a display associated with said at least one pixel array.

66. The position sensing assembly according to claim 64, wherein said at least one illuminator is located in a plane coplanar with or parallel to said at least pixel array.

67. The position sensing assembly according to claim 64, wherein said at least one illuminator is located substantially in the same plane as at least one backlighting illuminator.

68. The position sensing assembly according to claim 63, wherein said at least one pixel array senses light reflected from said at least one object.

69. The position sensing assembly according to claim 68, wherein said at least one pixel array senses ambient light reflected from said at least one object.

70. The position sensing assembly according to claim 63, wherein said at least one pixel array senses IR light reflected from said at least one object.

71. The position sensing assembly according to claim 63, wherein said at least one object is at least one finger.

72. The position sensing assembly according to claim 63, wherein said at least one object is at least one located device.

73. The position sensing assembly according to claim 63, and further comprising utilization circuitry.

74. The position sensing assembly according to claim 73, wherein said utilization circuitry provides chording functionality.

75. The position sensing assembly according to claim 73, wherein said utilization circuitry provides functionality to distinguish at least between positions of said at least one object when touching and not touching said device.

76. The position sensing assembly according to claim 73, wherein said utilization circuitry provides functionality to distinguish at least between directions of motion of said at least one object towards and away from said device.

77. The position sensing assembly according to claim 73, wherein said utilization circuitry provides functionality to compute at least one characteristic of a trajectory of motion of said at least one object substantially parallel to said at least one pixel array.

78. The position sensing assembly according to claim 77, wherein said at least one characteristic includes at least one of location, direction, velocity, or change in direction.

79. The position sensing assembly according to claim 73, wherein said utilization circuitry provides functionality for panning and scrolling.

80. The position sensing assembly according to claim 73, wherein said utilization circuitry provides functionality for one-handed zooming.

81. The position sensing assembly according to claim 73, wherein said utilization circuitry provides functionality for employing a sensed distinction between instances when said at least one object touches and does not touch said device.

82. The position sensing assembly according to claim 81, wherein said utilization circuitry provides functionality for mouse over and click.

83. The position sensing assembly according to claim 81, wherein said utilization circuitry provides functionality for turning pages.

84. The position sensing assembly according to claim 81, wherein said utilization circuitry provides functionality for gaming.

85. The position sensing assembly according to claim 81, wherein said utilization circuitry provides functionality utilizing differences in sensed relative positions of a user'"'"'s fingers.

86. The position sensing assembly according to claim 63, wherein said change in the amount of electromagnetic radiation detected results from ones of said plurality of detector elements detecting reflected light from said object in addition to detecting said electromagnetic radiation at said baseline level.

87. The position sensing assembly according to claim 86, wherein said reflected light propagates within said plate to ones of said plurality of detector elements.

88. The position sensing assembly according to claim 86, wherein said reflected light propagates above said surface to ones of said plurality of detector elements.

89. The position sensing assembly according to claim 86, wherein said reflected light is transmitted through said plate directly to at least one of said plurality of detector elements.

90. The position sensing assembly according to claim 63, and further comprising a processing subassembly including:

detector analyzing processing circuitry operative to receive detector outputs of individual ones of said plurality of detector elements, to determine whether at least one of the amount of electromagnetic radiation or the change in the amount of electromagnetic radiation detected by said individual ones of said plurality detector element exceeds said predetermined threshold, and to provide detector analysis outputs for said individual ones of said plurality of detector elements;

array processing circuitry operative to receive said detector analysis outputs of said plurality of detector elements of a single one of said at least one pixel array and to generate an array detection output therefrom; and

position determining circuitry operative to receive said array detection output of said at least one pixel array and to determine said position of said object therefrom.

91. The position sensing assembly according to claim 90, wherein said array detection output includes information corresponding to the location of an impingement point of said object on said surface.

92. The position sensing assembly according to claim 90, wherein said array detection output includes information corresponding to the location of said object relative to said surface.

93. The position sensing assembly according to claim 63, wherein said position of said object comprises at least one of a two-dimensional position of said object, a three-dimensional position of said object, or angular orientation of said object.

94. The position sensing assembly according to claim 63, wherein said electromagnetic radiation at said baseline level is provided by at least one source of radiation external to said position sensing assembly.

95. The position sensing assembly according to claim 94, wherein said at least one source of radiation comprises at least one of sunlight, artificial room lighting, or IR illumination emitted from a human body.

96. The position sensing assembly according to claim 94, and further comprising an illumination subassembly operative to provide illumination for augmenting said electromagnetic radiation at said baseline level.

97. The position sensing assembly according to claim 96, wherein said illumination subassembly comprises at least one electromagnetic radiation emitting source.

98. The position sensing assembly according to claim 97, wherein said at least one electromagnetic radiation emitting source comprises at least one of at least one infrared IR emitting light emitting diode (LED) or at least one visible light emitting LED.

99. The position sensing assembly according to claim 96, wherein said at least one pixel array comprises at least two pixel arrays arranged at mutually perpendicular edges of said plate.

100. The position sensing assembly according to claim 99, wherein said illumination subassembly comprises an electromagnetic radiation emitting source disposed at an intersection of two of said at least two pixel arrays.

101. The position sensing assembly according to claim 99, wherein said illumination subassembly comprises an electromagnetic radiation emitting source disposed at an intersection of two mutually perpendicular edges of said plate, and across from an intersection point of two of said at least two pixel arrays.

102. The position sensing assembly according to claim 99, wherein said illumination subassembly comprises at least one electromagnetic radiation emitting source forming part of a linear arrangement of display backlights underlying said plate.

103. The position sensing assembly according to claim 102, wherein said at least one electromagnetic radiation emitting source comprises an infrared IR emitting light emitting diode (LED).

104. The position sensing assembly according to claim 99, wherein said illumination subassembly comprises at least one substantially linear arrangement of a plurality of electromagnetic radiation emitting sources arranged in parallel to at least one edge of said plate.

105. The position sensing assembly according to claim 104, wherein at least one of said plurality of electromagnetic radiation emitting sources is arranged behind at least one of said at least two pixel arrays.

106. The position sensing assembly according to claim 96, wherein said at least one pixel array is arranged in a plane parallel to said surface.

107. The position sensing assembly according to claim 106, wherein said illumination subassembly comprises at least one substantially linear arrangement of a plurality of electromagnetic radiation emitting sources arranged in parallel to at least one edge of said plate.

108. The position sensing assembly according to claim 106, wherein said illumination subassembly comprises an electromagnetic radiation emitting source disposed at an intersection of two mutually perpendicular edges of said plate.

109. The position sensing assembly according to claim 96, wherein said at least one pixel array comprises a single pixel array arranged along an edge of said plate.

110. The position sensing assembly according to claim 109, wherein said illumination subassembly comprises an electromagnetic radiation emitting source disposed at an intersection of edges of said plate.

111. The position sensing assembly according to claim 109, wherein said illumination subassembly comprises at least one electromagnetic radiation emitting source forming part of a linear arrangement of display backlights underlying said plate.

112. The position sensing assembly according to claim 111, wherein said at least one electromagnetic radiation emitting source comprises an infrared (IR) emitting light emitting diode (LED).

113. The position sensing assembly according to claim 109, wherein said illumination subassembly comprises at least one substantially linear arrangement of a plurality of electromagnetic radiation emitting sources arranged in parallel to at least one edge of said plate.

114. The position sensing assembly according to claim 113, wherein at least one of said plurality of electromagnetic radiation emitting sources is arranged behind said single pixel array.

115. The position sensing assembly according to claim 63, and further comprising an illumination subassembly operative to provide said electromagnetic radiation at said baseline level to said plurality of detector elements.