DISPLAYS AND INFORMATION INPUT DEVICES

• US 20140132542A1
• Filed: 01/06/2014
• Published: 05/15/2014
• Est. Priority Date: 05/18/2005
• Status: Active Grant

• Current Assignee: Power2B, Inc.
• Original Assignee: Power2B, Inc.
• Inventors: Kali, Eran, Gutin, Boris, Margalit, Moti, Zwiebel, Ken, Lipman, Sarah Michelle, Lipman, Robert Michael
• Granted Patent: US 9,569,093 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1637 Details related to the display arrangement, including those related to the mounting of the display in the housing
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/03542 Light pens for emitting or receiving light
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0386 for light pen
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

An integrated display and input device including a pixel array operative to provide a visually sensible output, at least one sensor operative to sense at least a position of at least one object with respect to the pixel array when the at least one object has at least a predetermined degree of propinquity to the pixel array and circuitry receiving an output from the at least one sensor and providing a non-imagewise input representing the position of the at least one object relative to the pixel array to utilization circuitry.

Claims

1. An integrated display and input device, comprising:

a pixel array operative to provide a visually sensible output;

at least one sensor operative to sense at least a position of at least one object with respect to said pixel array when said at least one object has at least a predetermined degree of propinquity to said pixel array; and

circuitry receiving an output from said at least one sensor and providing a non-imagewise input representing the position of said at least one object relative to said pixel array to utilization circuitry.

2. An integrated display and input device according to claim 1, further comprising at least one IR illuminator for illuminating said at least one object when it has said at least a predetermined degree of propinquity to said pixel array.

3. An integrated display and input device according to claim 2, wherein said at least one illuminator also functions as at least one backlighting illuminator associated with said pixel array.

4. An integrated display and input device according to claim 2, wherein said at least one illuminator is located in a plane coplanar with or parallel to said at least one sensor.

5. An integrated display and input device according to claim 1, wherein said at least one illuminator is located generally in the same plane as at least one backlighting illuminator associated with said pixel array.

6. An integrated display and input device according to claim 1, wherein said at least one sensor senses light reflected from said at least one object.

7. An integrated display and input device according to claim 6, wherein said at least one sensor senses ambient light reflected from said at least one object.

8. An integrated display and input device according to claim 1, wherein said at least one sensor senses IR light reflected from said at least one object.

9. An integrated display and input device according to claim 1, wherein said at least one object is at least one finger.

10. An integrated display and input device according to claim 1, wherein said at least one object is at least one located device.

11. An integrated display and input device according to claim 1, further comprising utilization circuitry.

12. An integrated display and input device according to claim 11, wherein said utilization circuitry provides chording functionality.

13. An integrated display and input device according to claim 11, wherein said utilization circuitry provides functionality to distinguish at least between positions of said at least one object when touching and not touching said device.

14. An integrated display and input device according to claim 11, wherein said utilization circuitry provides functionality to distinguish at least between directions of motion of said at least one object towards and away from said device.

15. An integrated display and input device according to claim 11, wherein said utilization circuitry provides functionality to compute at least one characteristic of a trajectory of motion of said at least one object generally parallel to said pixel array.

16. An integrated display and input device according to claim 15, wherein said at least one characteristic includes at least one of location, direction, velocity and change in direction.

17. An integrated display and input device according to claim 11, wherein said utilization circuitry provides functionality for panning and scrolling.

18. An integrated display and input device according to claim 11, wherein said utilization circuitry provides functionality for one-handed zooming.

19. An integrated display and input device according to claim 11, wherein said utilization circuitry provides functionality for employing a sensed distinction between instances when said at least one object touches and does not touch said device.

20. An integrated display and input device according to claim 19, wherein said utilization circuitry provides functionality for mouse over and click.

21. An integrated display and input device according to claim 19, wherein said utilization circuitry provides functionality for document browsing.

22. An integrated display and input device according to claim 19, wherein said utilization circuitry provides functionality for gaming.

23. An integrated display and input device according to claim 19, wherein said utilization circuitry provides functionality utilizing differences in sensed relative positions of a user'"'"'s fingers.

24. An integrated display and input device according to claim 19, wherein said utilization circuitry provides interactive television functionality.

25. An integrated display and input device according to claim 19, wherein said utilization circuitry provides portable computer functionality.

26. An integrated display and input device according to claim 1, wherein said at least one sensor comprises a plurality of detector elements arranged in a plane parallel to a viewing plane.

27. An integrated display and input device according to claim 1, wherein said at least one sensor is coplanar with said pixel array.

28. An integrated display and input device according claim 1, wherein each of said pixel array and said at least one sensor comprise a plurality of elements arranged in parallel planes, parallel to a viewing plane.

29. An integrated display and input device according to claim 1, wherein said at least one sensor comprises a detector assembly arranged at least one edge of a viewing plane defining plate.

30. An integrated display and input device according to claim 29, wherein said detector assembly is arranged about said at least one edge of said viewing plane defining plate.

31. An integrated display and input device according to claim 29, wherein said detector assembly is arranged along said at least one edge of said viewing plane defining plate.

32. An integrated display and input device according to claim 29, wherein said detector assembly comprises:

a support substrate; and

an arrangement of detector elements.

33. An integrated display and input device according to claim 32, wherein said detector assembly also comprises a cover layer.

34. An integrated display and input device according to claim 32, wherein said support substrate is integrated with a housing of said integrated display and input device.

35. An integrated display and input device according to claim 32, wherein said arrangement of detector elements comprises a plurality of discrete single-element detectors.

36. An integrated display and input device according to claim 32, wherein said arrangement of detector elements comprises an integrally formed multi-element detector array.

37. An integrated display and input device according to claim 32, wherein said arrangement of detector elements comprises a plurality of discrete multi-element detectors.

38. An integrated display and input device according to claim 33, wherein said cover layer is formed of a light transmissive material.

39. An integrated display and input device according to claim 33, wherein said cover layer includes a mask having apertures defined therein.

40. An integrated display and input device according to claim 33, wherein said cover layer includes a field-of-view defining mask having light-collimating tunnel-defining apertures.

41. An integrated display and input device according to claim 33, wherein said cover layer includes lenses.

42. An integrated display and input device according to claim 29, wherein said at least one edge includes a mask having apertures defined therein.

43. An integrated display and input device according to claim 29, wherein said at least one edge includes a field-of-view defining mask having light-collimating tunnel-defining apertures.

44. An integrated display and input device according to claim 29, wherein said at least one edge includes lenses.

45. An integrated display and input device according to claim 29, wherein said at least one sensor comprises a plurality of generally forward-facing detectors arranged about edges of a display element.

46. An integrated display and input device according to claim 32, wherein at least one detector in said arrangement detects electromagnetic radiation at a baseline level and senses said position of said object with respect to said pixel array and said circuitry provides said non-imagewise input according to location of at least one detector in said arrangement for which at least one of the amount of radiation detected and the change in the amount of radiation detected exceed a first predetermined threshold.

47. An integrated display and input device according to claim 46, wherein said change in the amount of radiation detected results from at least one detector in said arrangement detecting reflected light from said object in addition to detecting said radiation at said baseline level.

48. An integrated display and input device according to claim 47, wherein said reflected light propagates within said viewing plane defining plate to at least one detector in said arrangement.

49. An integrated display and input device according to claim 47, wherein said reflected light propagates above said viewing plane defining plate to at least one detector in said arrangement.

50. An integrated display and input device according to claim 47, wherein said reflected light is transmitted through said viewing plane defining plate directly to at least one detector in said arrangement.

51. An integrated display and input device according to claim 46, wherein said at least one detector in said arrangement detects radiation at said baseline level, senses said position of said object with respect to said pixel array and said circuitry provides said non-imagewise input according to location of at least one detector in said arrangement at which the amount of radiation detected is below a second predetermined threshold.

52. An integrated display and input device according to claim 51, further comprising a processing subassembly including:

detector analyzing processing circuitry operative to receive detector outputs of individual detectors in said arrangement, to determine at least one of whether the amount of radiation detected by said individual detectors exceeds said first predetermined threshold, whether the change in the amount of radiation detected by said individual detectors exceeds said first predetermined threshold and whether the amount of radiation detected by said individual detectors is below said second predetermined threshold, and to provide detector analysis outputs for said individual detectors;

array processing circuitry operative to receive said detector analysis outputs of individual detectors in said arrangement and to generate an array detection output therefrom; and

position determining circuitry operative to receive said array detection output of said arrangement and to determine said position of said object therefrom.

53. An integrated display and input device according to claim 52, wherein said array detection output includes information corresponding to the location of an impingement point of said object on said viewing plane defining plate.

54. An integrated display and input device according to claim 52, wherein said array detection output includes information corresponding to the location of said object relative to said viewing plane defining plate.

55. An integrated display and input device according to claim 46, wherein said radiation at said baseline level is provided by at least one source of illumination external to said integrated display and input device.

56. An integrated display and input device according to claim 55, wherein said at least one source of illumination comprises at least one of sunlight, artificial room lighting and IR illumination emitted from a human body.

57. An integrated display and input device according to claim 55, and further comprising an illumination subassembly operative to provide illumination for augmenting said radiation at said baseline level.

58. An integrated display and input device according to claim 46, and further comprising an illumination subassembly operative to provide said radiation at said baseline level.

59. An integrated display and input device according to claim 57, wherein said illumination subassembly comprises at least one electromagnetic radiation emitting source.

60. An integrated display and input device according to claim 59, wherein said at least one electromagnetic radiation emitting source comprises at least one of at least one IR emitting LED and at least one visible light emitting LED.

61. An integrated display and input device according to claim 60, wherein said at least one electromagnetic radiation emitting source is disposed at an intersection of two mutually perpendicular edges of said viewing plane defining plate.

62. An integrated display and input device according to claim 60, wherein said at least one electromagnetic radiation emitting source forms part of a linear arrangement of display backlights underlying said viewing plane defining plate.

63. An integrated display and input device according to claim 58, wherein said illumination subassembly comprises at least one generally linear arrangement of a plurality of electromagnetic radiation emitting sources arranged in parallel to at least one edge of said viewing plane defining plate.

64. An integrated display and input device according to claim 63, wherein at least one of said at least one generally linear arrangement is arranged behind said at least one sensor.

65. A position sensing assembly comprising:

a plate defining a surface;

at least one pixel array including a plurality of detector elements detecting electromagnetic radiation at a baseline level, said at least one pixel array being operative to sense a position of an object with respect to said surface according to locations of ones of said plurality of detector elements at which at least one of the amount of radiation detected and the change in the amount of radiation detected exceed a predetermined threshold, said at least one pixel array being operative to sense at least a position of at least one object with respect to said at least one pixel array when said at least one object has at least a predetermined degree of propinquity to said at least one pixel array; and

circuitry receiving an output from said at least one pixel array and providing a non-imagewise input representing the position of said at least one object relative to said at least one pixel array to utilization circuitry.

66. A position sensing assembly according to claim 65, and further comprising at least one IR illuminator for illuminating said at least one object when it has said at least a predetermined degree of propinquity to said at least one pixel array.

67. A position sensing assembly according to claim 66, wherein said at least one illuminator also functions as at least one backlighting illuminator associated with a display associated with said at least one pixel array.

68. A position sensing assembly according to claim 66, wherein said at least one illuminator is located in a plane coplanar with or parallel to said at least pixel array.

69. A position sensing assembly according to claim 66, wherein said at least one illuminator is located generally in the same plane as at least one backlighting illuminator.

70. A position sensing assembly according to claim 65, wherein said at least one pixel array senses light reflected from said at least one object.

71. A position sensing assembly according to claim 70, wherein said at least one pixel array senses ambient light reflected from said at least one object.

72. A position sensing assembly according to claim 65, wherein said at least one pixel array senses IR light reflected from said at least one object.

73. A position sensing assembly according to claim 65, wherein said at least one object is at least one finger.

74. A position sensing assembly according to claim 65, wherein said at least one object is at least one located device.

75. A position sensing assembly according to claim 65, and further comprising utilization circuitry.

76. A position sensing assembly according to claim 75, wherein said utilization circuitry provides chording functionality.

77. A position sensing assembly according to claim 75, wherein said utilization circuitry provides functionality to distinguish at least between positions of said at least one object when touching and not touching said device.

78. A position sensing assembly according to claim 75, wherein said utilization circuitry provides functionality to distinguish at least between directions of motion of said at least one object towards and away from said device.

79. A position sensing assembly according to claim 75, wherein said utilization circuitry provides functionality to compute at least one characteristic of a trajectory of motion of said at least one object generally parallel to said at least one pixel array.

80. A position sensing assembly according to claim 79, wherein said at least one characteristic includes at least one of location, direction, velocity and change in direction.

81. A position sensing assembly according to claim 75, wherein said utilization circuitry provides functionality for panning and scrolling.

82. A position sensing assembly according to claim 75, wherein said utilization circuitry provides functionality for one-handed zooming.

83. A position sensing assembly according to claim 75, wherein said utilization circuitry provides functionality for employing a sensed distinction between instances when said at least one object touches and does not touch said device.

84. A position sensing assembly according to claim 83, wherein said utilization circuitry provides functionality for mouse over and click.

85. A position sensing assembly according to claim 83, wherein said utilization circuitry provides functionality for turning pages.

86. A position sensing assembly according to claim 83, wherein said utilization circuitry provides functionality for gaming.

87. A position sensing assembly according to claim 83, wherein said utilization circuitry provides functionality utilizing differences in sensed relative positions of a user'"'"'s fingers.

88. A position sensing assembly according to claim 65, wherein said change in the amount of radiation detected results from ones of said plurality of detector elements detecting reflected light from said object in addition to detecting said radiation at said baseline level.

89. A position sensing assembly according to claim 88, wherein said reflected light propagates within said plate to ones of said plurality of detector elements.

90. A position sensing assembly according to claim 88, wherein said reflected light propagates above said surface to ones of said plurality of detector elements.

91. A position sensing assembly according to claim 88, wherein said reflected light is transmitted through said plate directly to at least one of said plurality of detector elements.

92. A position sensing assembly according to claim 65, and further comprising a processing subassembly including:

detector analyzing processing circuitry operative to receive detector outputs of individual ones of said plurality of detector elements, to determine whether at least one of the amount of radiation and the change in the amount of radiation detected by said individual ones of said plurality detector element exceeds said predetermined threshold, and to provide detector analysis outputs for said individual ones of said plurality of detector elements;

array processing circuitry operative to receive said detector analysis outputs of said plurality of detector elements of a single one of said at least one pixel array and to generate an array detection output therefrom; and

position determining circuitry operative to receive said array detection output of said at least one pixel array and to determine said position of said object therefrom.

93. A position sensing assembly according to claim 92, wherein said array detection output includes information corresponding to the location of an impingement point of said object on said surface.

94. A position sensing assembly according to claim 92, wherein said array detection output includes information corresponding to the location of said object relative to said surface.

95. A position sensing assembly according to claim 65, wherein said position of said object comprises at least one of a two-dimensional position of said object, a three-dimensional position of said object and angular orientation of said object.

96. A position sensing assembly according to claim 65, wherein said radiation at said baseline level is provided by at least one source of radiation external to said position sensing assembly.

97. A position sensing assembly according to claim 96, wherein said at least one source of radiation comprises at least one of sunlight, artificial room lighting and IR illumination emitted from a human body.

98. A position sensing assembly according to claim 96, and further comprising an illumination subassembly operative to provide illumination for augmenting said radiation at said baseline level.

99. A position sensing assembly according to claim 65, and further comprising an illumination subassembly operative to provide said radiation at said baseline level to said plurality of detector elements.

100. A position sensing assembly according to claim 98, wherein said illumination subassembly comprises at least one electromagnetic radiation emitting source.

101. A position sensing assembly according to claim 100, wherein said at least one electromagnetic radiation emitting source comprises at least one of at least one IR emitting LED and at least one visible light emitting LED.

102. A position sensing assembly according to claim 98, wherein said at least one pixel array comprises at least two pixel arrays arranged at mutually perpendicular edges of said plate.

103. A position sensing assembly according to claim 102, wherein said illumination subassembly comprises an electromagnetic radiation emitting source disposed at an intersection of two of said at least two pixel arrays.

104. A position sensing assembly according to claim 102, wherein said illumination subassembly comprises an electromagnetic radiation emitting source disposed at an intersection of two mutually perpendicular edges of said plate, and across from an intersection point of two of said at least two pixel arrays.

105. A position sensing assembly according to claim 102, wherein said illumination subassembly comprises at least one electromagnetic radiation emitting source forming part of a linear arrangement of display backlights underlying said plate.

106. A position sensing assembly according to claim 105, wherein said at least one electromagnetic radiation emitting source comprises an IR emitting LED.

107. A position sensing assembly according to claim 102, wherein said illumination subassembly comprises at least one generally linear arrangement of a plurality of electromagnetic radiation emitting sources arranged in parallel to at least one edge of said plate.

108. A position sensing assembly according to claim 107, wherein at least one of said at least one generally linear arrangement is arranged behind at least one of said at least two pixel arrays.

109. A position sensing assembly according to claim 98, wherein said at least one pixel array is arranged in a plane parallel to said surface.

110. A position sensing assembly according to claim 109, wherein said illumination subassembly comprises at least one generally linear arrangement of a plurality of electromagnetic radiation emitting sources arranged in parallel to at least one edge of said plate.

111. A position sensing assembly according to claim 109, wherein said illumination subassembly comprises an electromagnetic radiation emitting source disposed at an intersection of two mutually perpendicular edges of said plate.

112. A position sensing assembly according to claim 98, wherein said at least one pixel array comprises a single pixel array arranged along an edge of said plate.

113. A position sensing assembly according to claim 112, wherein said illumination subassembly comprises an electromagnetic radiation emitting source disposed at an intersection of edges of said plate.

114. A position sensing assembly according to claim 112, wherein said illumination subassembly comprises at least one electromagnetic radiation emitting source forming part of a linear arrangement of display backlights underlying said plate.

115. A position sensing assembly according to claim 114, wherein said at least one electromagnetic radiation emitting source comprises an IR emitting LED.

116. A position sensing assembly according to claim 112, wherein said illumination subassembly comprises at least one generally linear arrangement of a plurality of electromagnetic radiation emitting sources arranged in parallel to at least one edge of said plate.

117. A position sensing assembly according to claim 116, wherein at least one of said at least one generally linear arrangement is arranged behind said single pixel array.