Touch sensing for curved displays

• US 9,857,915 B2
• Filed: 05/19/2008
• Issued: 01/02/2018
• Est. Priority Date: 01/25/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Benko, Hrvoje, Wilson, Andrew, Balakrishnan, Ravin
• Primary Examiner(s): LEE, NICHOLAS J
• Application Number:
  US12/122,736
• Publication Number:
  US 20090189857A1
• Time in Patent Office: 3,515 Days
• Field of Search: 345158, 345173, 345174, 345419, 345 6, 715863
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen

Abstract

Described herein is an apparatus that includes a curved display surface that has an interior and an exterior. The curved display surface is configured to display images thereon. The apparatus also includes an emitter that emits light through the interior of the curved display surface. A detector component analyzes light reflected from the curved display surface to detect a position on the curved display surface where a first member is in physical contact with the exterior of the curved display surface.

Claims

1. A display apparatus, comprising:

a diffuse spherical display that defines an interior region of the display apparatus, the diffuse spherical display having an interior surface, an exterior surface, and an aperture;

a ring-like configuration of light emitters positioned around the aperture in the interior region of the display apparatus, the light emitters configured to emit infrared light through the interior region towards the interior surface of the diffuse spherical display, the infrared light passes through the interior surface and then passes through the exterior surface of the diffuse curved display;

a wide-angle lens that is positioned inside the aperture and flush with the ring-like configuration of light emitters;

a wavelength filter that is optically coupled to the wide-angle lens, wherein infrared light received by way of the wide-angle lens passes through the wavelength filter;

an infrared camera that is optically coupled to the wavelength filter and the wide-angle lens, the infrared camera is configured to receive infrared light that passes through the wavelength filter; and

a projector that is optically coupled to the wavelength filter, wherein the wavelength filter reflects visible light emitted from the projector through the wide-angle lens such that the visible light is displayed on the exterior surface of the diffuse spherical display, an optical path of the infrared light received by the wavelength filter and an optical path of the visible light reflected by the wavelength filter are in alignment.

2. The display apparatus of claim 1, further comprising a detector component that is configured to:

receive an infrared image of the interior surface of the diffuse spherical display, the infrared image generated by the infrared camera; and

based upon the infrared image, detect a position on the diffuse spherical display where a member is in physical contact with the exterior surface of the diffuse spherical display, the infrared image indicating where, on the exterior surface of the diffuse curved display, infrared light emitted by the emitter has reflected off of the member and passed back through the diffuse curved display.

3. The display apparatus of claim 2, wherein the detector component is further configured to detect a position of a second member on the exterior surface of the diffuse spherical display based upon the infrared image, where the member and the second member are simultaneously in physical contact with the exterior surface of the diffuse spherical display.

4. The display apparatus of claim 2, further comprising:

a processor; and

memory that comprises instructions that, when executed by the processor, cause the processor to;

generate a normalized image based upon the infrared image; and

detect the position of the member based upon the normalized image.

5. The display apparatus of claim 4, the instructions, when executed by the processor, further cause the processor to control images output by the projector based upon the position of the member detected by the detector component.

6. The apparatus of claim 2, the detector component is further configured to:

receive a plurality of images of the interior surface of the diffuse spherical display; and

detect a velocity of movement of the member along the exterior surface of the diffuse spherical display based upon the plurality of images, the projector configured to project imagery based upon the velocity of movement detected by the detector component.

7. The display apparatus of claim 2, the projector is configured to cause an image to be presented on the exterior surface of the diffuse spherical display based upon the detected position of the member on the exterior surface of the diffuse spherical display.

8. The display apparatus of claim 2, wherein the projector is controlled based upon the detected position.

9. The display apparatus of claim 2, wherein velocity of movement of the member across the exterior surface of the diffuse spherical display is determined based upon the detected position, and further wherein the projector is controlled based upon the determined velocity.

10. The display apparatus of claim 1, the ring-like configuration of light emitters comprises a light emitting diode that emits at least a portion of the infrared light.

11. The display apparatus of claim 10, the ring-like configuration of light emitters comprises a plurality of light emitting diodes that are configured in a ring-like manner around the aperture.

12. A method, comprising:

emitting light through an interior region of a display apparatus towards an interior surface of a diffuse spherical display, the diffuse spherical display is configured to display images on an exterior surface thereof, and the act of emitting comprises;

using a ring-like configuration of light emitters positioned in the interior region of the display apparatus and around an aperture of the spherical display, emitting infrared light through the interior region and towards the interior surface of the diffuse spherical display, the infrared light emitted by the emitters passes through the interior surface of the diffuse spherical display and further through the exterior surface of the diffuse curved display; and

using a projector, a wavelength filter, and a wide-angle lens that is positioned inside the aperture and flush with the ring-like configuration of light emitters, emitting visible light through the aperture, through the interior region, and towards the interior surface to project images on the exterior surface of the diffuse curved display, wherein the visible light emitted by the projector is reflected off of the wavelength filter and through the wide-angle lens; and

using an infrared camera, capturing an image of the interior surface of the diffuse curved display, wherein infrared light captured by the infrared camera passes through the wavelength filter and the wide-angle lens, and further wherein an optical path of the infrared light received by the wavelength filter and an optical path of the visible light reflected off of the wavelength filter are in alignment.

13. The method of claim 12, further comprising:

detecting a position of a member that is in physical contact with the exterior surface of the diffuse spherical display based upon the image.

14. The method of claim 13, further comprising:

displaying images on the exterior surface of the diffuse spherical display based upon the position on the exterior surface of the diffuse spherical display where the member is in physical contact with the exterior surface of the diffuse spherical display.

15. The method of claim 13, the act of detecting comprises:

normalizing the image captured by the camera; and

detecting the position of the member based upon the normalized image.

16. The method of claim 13, further comprising:

based upon the image, detecting a second position of a second member that is in physical contact with the exterior surface of the diffuse spherical display simultaneously with the member; and

projecting images onto the exterior surface of the diffuse spherical display based upon the position of the member and the second position of the second member.

17. The method of claim 13, further comprising:

detecting velocity of movement of the member across the exterior surface of the diffuse spherical display; and

controlling output of the projector based upon the velocity of movement of the member across the exterior surface of the diffuse curved display.

18. A display apparatus, comprising:

a spherical display that includes an aperture, the spherical display includes an interior surface and an exterior surface and is diffuse in nature, the interior surface defining a hollow central region of the spherical display;

a ring-like configuration of light-emitting diodes that is positioned around the aperture, the light-emitting diodes are configured to emit infrared light through the hollow central region and through the interior surface and then through the exterior surface of the spherical display;

a wide-angle lens that is positioned inside the aperture and flush with the ring-like configuration of light-emitting diodes;

a wavelength filter that is optically coupled to the wide-angle lens, infrared light received by way of the wide-angle lens passes through the wavelength filter;

an infrared camera that is optically coupled to the wavelength filter and the wide-angle lens, the infrared camera is configured to receive infrared light that passes through the wavelength filter; and

a projector that is optically coupled to the wavelength filter, the wavelength filter reflects visible light emitted from the projector through the wide-angle lens such that the visible light is displayed on the exterior surface of the spherical display, an optical axis of infrared light received by the wavelength filter is aligned with an optical axis of visible light reflected by the wavelength filter.

19. The display apparatus of claim 18, the infrared light received by the infrared camera is reflected from a finger in contact with the exterior surface of the spherical display.

20. The display apparatus of claim 18, the wavelength filter being a cold mirror.