Interactive display system, tool for use with the system, and tool management apparatus

• US 9,063,617 B2
• Filed: 10/16/2006
• Issued: 06/23/2015
• Est. Priority Date: 10/16/2006
• Status: Active Grant

• Current Assignee: FlatFrog Laboratories AB
• Original Assignee: FlatFrog Laboratories AB
• Inventors: Eliasson, Jonas Ove Philip, Larsen, Niels Agersnap, Bastue, Jens, stergaard, Jens Wagenblast Stubbe
• Primary Examiner(s): Moon, Seokyun
• Application Number:
  US11/581,126
• Publication Number:
  US 20080088603A1
• Time in Patent Office: 3,172 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04109 FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
• CPC Class Codes: G06F 3/0312 for tracking the rotation of a spherical or circular member, e.g. optical rotary encoders used in mice or trackballs using a tracking ball or in mouse scroll wheels tracking relative movement in co-operation with a regularly or irregularly patterned surface, e.g. as in optical mice G06F3/0317; constructional details of scroll or thumb-wheels G06F3/0362; optical rotary encoders G01D5/3473
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421

Abstract

An interactive display system that may be implemented to provide an electronic whiteboard that enables users to input information to the system by engaging a display with one or more objects. The system may present an image via the display that reflects the inputs received from the user. For example, the display may be dynamically updated to mimic inputs made to a whiteboard by the user via one or more pens and/or an eraser. The interactive display system may implement an underlayer embedded within the display to guide electromagnetic radiation that emanates from an object engaged with the display to one or more detectors by total internal reflection. Due at least in part to the efficiency of the underlayer in guiding the electromagnetic radiation to the detectors, the interactive display system may enhance the speed and/or accuracy of the interpretation of the inputs made by the user.

Claims

1. An interactive display system comprising:

a waveguide that comprises;

an interface surface configured to be engaged by a user with an object; and

an underlayer having a first index of refraction and being disposed between layers of the waveguide having indices of refraction that are less than the first index of refraction; and

one or more photosensitive detectors in optical communication with the underlayer to receive electromagnetic radiation therefrom, the one or more photosensitive detectors generating one or more output signals, a given one of the one or more output signals being related to an amount of electromagnetic radiation received from the underlayer by the corresponding one of the one or more photosensitive detectors that generated the given output signal,

wherein the waveguide and the one or more photosensitive detectors are configured such that electromagnetic radiation emanating from the object into the waveguide is guided by total internal reflection within the underlayer to the one or more photosensitive detectors such that information related to the position of the object with respect to the interface surface can be determined as a function of the one or more output signals.

2. The system of claim 1, wherein the one or more photosensitive detectors comprise a plurality of photosensitive detectors.

3. The system of claim 2, further comprising a processor that determines information related to the position of the object with respect to the interface surface from the output signals based on the relative amounts electromagnetic radiation received by the photosensitive detectors.

4. The system of claim 3, wherein the underlayer is configured to diffuse the electromagnetic radiation propagating therethrough in a substantially uniform manner without regard for the directionality of the electromagnetic radiation.

5. The system of claim 3, further comprising an image generation device, wherein the processor controls the image generation device to generate an image that is viewable at the interface surface, and wherein the image generated by the image generation device is dictated at least in part by the information related to the position of the object with respect the interface surface as determined by the processor.

6. The system of claim 5, wherein the processor controls the image generation device to generate the image to include markings and/or erasures at locations on the interface surface where the object has engaged the interface surface.

7. The system of claim 3, wherein the electromagnetic radiation emanating from the object that is guided by total internal reflection within the underlayer to the plurality of detectors comprises electromagnetic radiation emitted by the object, and wherein one or more properties of the electromagnetic radiation emitted by the object enable the processor to distinguish the object from one or more other objects.

8. The system of claim 1, further comprising a magnetic material disposed within or near the waveguide that enables the object to be removably attached to the interface surface if the object includes a magnetized material.

9. The system of claim 8, wherein the magnetic material is formed into a grid disposed within or near the waveguide.

10. The system of claim 1, further comprising a disposable layer removably disposed on the interface surface that protects the interface surface from one or more of scratches, stains, or impacts.

11. The system of claim 1, wherein the electromagnetic radiation that emanates from the object includes electromagnetic radiation that is reflected and/or scattered by the object.

12. The system of claim 1, wherein the underlayer is disposed within the waveguide apart from the interface surface.

13. The system of claim 1, further comprising:

an interface layer having a second index of refraction that provides the interface surface and is bounded on a side opposite from the interface surface by a waveguide layer having an index of refraction less than the second index of refraction; and

one or more emitters that are optically coupled to the interface layer to emit electromagnetic radiation that becomes trapped within the interface layer by total internal reflection, wherein if the object is engaged with the interface surface the object scatters and/or reflects electromagnetic radiation provided into the interface layer from the one or more emitters such that at least a portion of the scattered and/or reflected electromagnetic radiation is guided by total internal reflection within the underlayer to at least one of the one or more detectors.

14. The system of claim 1, further comprising:

an image generation device that provides electromagnetic radiation to the interface surface in spatially sequential manner; and

a processor,

wherein the electromagnetic radiation emanating from the object to be guided by total internal reflection within the underlayer to the plurality of detectors comprises electromagnetic radiation that is provided to the interface surface by the image generation device and is reflected and/or scattered by the object, and

wherein the processor determines the position of the object with respect to the interface surface from the output signals based on the timing of the receipt by the photosensitive detectors of electromagnetic radiation that has been provided to the interface surface by the image generation device in a spatially sequential manner and has been scattered and/or reflected by the object.

15. An interactive display system comprising:

a waveguide that provides an interface surface configured to be engaged by a user with an object;

one or more photosensitive detectors in optical communication with the waveguide to receive electromagnetic radiation therefrom, the one or more photosensitive detectors generating one or more output signals, a given one of the one or more output signals being related to one or more properties of the electromagnetic radiation received from the waveguide by the photosensitive detector that generated the given output signal; and

a processor configured to receive the output signals generated by the plurality of photosensitive detectors,

wherein the waveguide and the one or more photosensitive detectors are configured such that engagement of the interface surface with the object by the user causes electromagnetic radiation emanating from the object to be guided by total internal reflection within the waveguide to the one or more photosensitive detectors, and

wherein the processor is further configured, based on the output signals generated in response to the electromagnetic radiation that is emanated by the object and received from the waveguide by the one or more photosensitive detectors, to (i) determine an identity of the object, and (ii) determine the position of the object with respect to the interface surface.

16. The system of claim 15, further comprising an image generation device that generates an image that is viewable at the interface surface, wherein the processor controls the image generation device such that the image generated by the image generation device reflects the identity of the object and the position of the object with respect to the interface surface.

17. The system of claim 16, wherein the output signals generated in response to the electromagnetic radiation that is emanated by the object and received from the waveguide by the plurality of photosensitive detectors enable the processor to determine the rotational orientation of the object.

18. The system of claim 17, wherein the processor controls the image generation device such that the image generated by the image generation device reflects the rotational orientation of the object.

19. The system of claim 17, wherein the object comprises one or more of a camera, a vibration sensitive device, a micro-display, a mobile telephone, a computer mouse, a temperature sensitive device, a speaker device, a hygrometer, an altimeter, or a microphone.