Retroreflection based multitouch sensor, method and program

• US 9,348,463 B2
• Filed: 08/02/2007
• Issued: 05/24/2016
• Est. Priority Date: 08/03/2006
• Status: Active Grant

• Current Assignee: New York University
• Original Assignee: New York University
• Inventors: Perlin, Kenneth
• Primary Examiner(s): Eisen, Alexander
• Assistant Examiner(s): LAM, NELSON C
• Application Number:
  US11/888,729
• Publication Number:
  US 20080060854A1
• Time in Patent Office: 3,218 Days
• Field of Search: 345173-179
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04109 FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

A detection apparatus includes a multilocation sensor. The apparatus includes a sheet in communication with the sensor, which when a plurality of locations of the sheet are simultaneously activated, the sensor senses these locations, simultaneously with retroreflection.

Claims

1. A detection apparatus comprising:

a first light source which produces light;

a multilocation sensor having an aperture; and

a sheet which receives light from the first light source, the sheet in communication with the multilocation sensor, which when a plurality of locations of the sheet are simultaneously activated by an object touching the sheet, the sensor senses these locations based on retroreflection of the light, simultaneously, the sheet includes a first lenslet array, a surface of the sheet is at a focal length of each lenticular lens of the first lenslet array, the first lenslet array is placed so that the first lenslet array'"'"'s ridged side is facing toward the multilocation sensor and the first lenslet array'"'"'s smooth side is facing away from the multilocation sensor, the smooth side forms the sheet'"'"'s surface, the first light source is placed such that a line in space between the first light source and the aperture of the multilocation sensor is parallel to a line in space formed by each individual lenticular lenslet of the first lenslet array, light that arrives at the sheet from any direction is focused by each lenticular lens into a thin bright line of light upon the smooth side of the lenticular lens array so that light is concentrated into thin bright parallel stripes of light upon the smooth side of the sheet, when the light contacts the object touching the surface, the light is collimated retroreflected directly back toward the source.

2. The apparatus as described in claim 1 wherein the multilocation sensor, when a plurality of locations of the sheets surface are touched simultaneously, the multilocation sensor senses these locations, simultaneously.

3. The apparatus as described in claim 2 wherein the multilocation sensor includes an imager which produces images of the surface of the sheet.

4. The apparatus as described in claim 3 wherein the imager includes a camera and the multilocation sensor includes a computer in communication with the camera and receives images from the camera.

5. The apparatus as described in claim 4 wherein the first lenslet array has a smooth side and a ridged side, and the first lenslet array is positioned so the ridged side is facing the camera.

6. The apparatus as described in claim 5 wherein the first lenslet array has lateral spacing between the lenses to allow the sheet to be looked through.

7. The apparatus as described in claim 5 including a second lenslet array.

8. The apparatus as described in claim 7 wherein the second lenslet array is oriented perpendicular to the first lenslet array, and together the first and second lenslet arrays act as a rear projector screen.

9. The apparatus as described in claim 8 including a projector in communication with the computer that displays an image generated by the computer.

10. The apparatus as described in claim 1 wherein the multilocation sensor uses touch, pressure, or proximity to determine the locations.

11. The apparatus as described in claim 2 wherein the surface of the sheet is a thin-film comprising micro lenses.

12. The apparatus as described in claim 11 wherein the micro lenses are sparsely placed so the surface of the sheet appears transparent.

13. The apparatus as described in claim 12 wherein the sheet includes a substrate and both sides of the substrate are coated with thin films comprising micro lenses.

14. The apparatus as described in claim 3 wherein the camera includes a shutter to reduce optical noise.

15. The apparatus as described in claim 3 wherein the first light source is placed in a same focal plane of the lenticular lenses of the lenticular lens array and including a second light source placed in a different focal plane than the focal plane of the lenticular lenses of the lenticular lens array, and the computer subtracts pixel values from a second image formed when the second light source is on from corresponding pixel values of a first image formed when the first light source is on to remove almost all of that portion of the first image which is due to light that has been reflected back from objects not touching the smooth surface.

16. A method for detection comprising steps of:

activating a first light source which produces light;

activating simultaneously a plurality of locations of a sheet by an object touching the sheet, the sheet includes a first lenslet array, the sheet'"'"'s surface is at a focal length of each lenslet lens of the first lenslet array; and

sensing these locations simultaneously with a multilocation sensor having an aperture in communication with the sheet based on retroreflection of the light, the first lenslet array is placed so that the first lenslet array'"'"'s ridged side is facing toward the sensor and the first lenslet array'"'"'s smooth side is facing away from the multilocation sensor, the smooth side forms the sheet'"'"'s surface, the first light source is placed such that a line in space between the first light source and the aperture of the multilocation sensor is parallel to a line in space formed by each individual lenticular lenslet of the first lenslet array, light that arrives at the sheet from any direction is focused by each lenticular lens into a thin bright line of light upon the smooth side of the lenticular lens array so that light is concentrated into thin bright parallel stripes of light upon the smooth side of the sheet, when the light contacts the object touching the surface, the light is collimated retroreflected directly back toward the source.

17. The method as described in claim 16 wherein the first light source is placed in a same focal plane of the lenticular lenses of the lenticular lens array and including a second light source placed in a different focal plane than the focal plane of the lenticular lenses of the lenticular lens array and wherein the sensing step includes the step of subtracting pixel values of a second image formed when the second light source is on from corresponding pixel values of a first image formed when the first light source is on to remove almost all of that portion of the first image which is due to light that has been reflected back from objects not touching the smooth surface.

18. A software program stored on a non-transitory computer readable medium comprising steps of:

activating a light source which produces light; and

sensing simultaneously a plurality of locations of a sheet activated simultaneously by an object touching the sheet, the sheet includes a first lenslet array, the sheet'"'"'s surface is at a focal length of each lens of the first lenslet array with a multilocation sensor having an aperture in communication with the sheet based on retroreflection of the light, the first lenslet array is placed so that the first lenslet array'"'"'s ridged side is facing toward the sensor and the first lenslet array'"'"'s smooth side is facing away from the multilocation sensor, the smooth side forms the sheet'"'"'s surface, the first light source is placed such that a line in space between the first light source and the aperture of the multilocation sensor is parallel to a line in space formed by each individual lenticular lenslet of the first lenslet array, light that arrives at the sheet from any direction is focused by each lenticular lens into a thin bright line of light upon the smooth side of the lenticular lens array so that light is concentrated into thin bright parallel stripes of light upon the smooth side of the sheet, when the light contacts the object touching the surface, the light is collimated retroreflected directly back toward the source.

19. The software program stored on a non-transitory computer readable medium as described in claim 18 including a step of measuring an area on contact of these locations.