Method for reducing perceived optical distortion

• US 9,557,813 B2
• Filed: 06/30/2014
• Issued: 01/31/2017
• Est. Priority Date: 06/28/2013
• Status: Expired due to Fees

• Current Assignee: Tactus Technology Inc.
• Original Assignee: Tactus Technology Inc.
• Inventors: Yairi, Micah B, Parthasarathy, Radhakrishnan
• Primary Examiner(s): McCulley, Ryan D
• Application Number:
  US14/320,041
• Publication Number:
  US 20150177906A1
• Time in Patent Office: 946 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 3/02 Affine transformations for image registration G06T3/147; for image mosaicing G06T3/4038
• CPC Class Codes: G09G 2320/028 by changing the viewing angle properties, e.g. widening the viewing angle, adapting the viewing angle to the view direction
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: G09G 5/003 Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto specific for a CRT G09G1/165; for a flat panel G09G3/2092

Abstract

One variation of a method for reducing perceived optical distortion of light output through a dynamic tactile interface includes: rendering an image on a digital display coupled to a substrate opposite a tactile layer, the tactile layer defining a tactile surface, a peripheral region, and a deformable region adjacent the peripheral region, disconnected from the substrate, and operable between a retracted setting and an expanded setting, the deformable region substantially flush with the peripheral region in the retracted setting and offset above the peripheral region in the expanded setting; estimating a viewing position of a user relative to the digital display; transitioning the deformable region from the retracted setting into the expanded setting; and modifying the portion of the image rendered on the digital display according to the estimated viewing position of the user and a profile of the tactile surface across the deformable region in the expanded setting.

Claims

1. A method for reducing perceived optical distortion of light output through a dynamic tactile interface, the method comprising:

rendering an image on a digital display coupled to a substrate opposite a tactile layer, the substrate and the tactile layer being substantially transparent, the tactile layer defining a tactile surface, a peripheral region, and a deformable region, the peripheral region adjacent the deformable region and coupled to the substrate opposite the tactile surface, the deformable region disconnected from the substrate and operable between a retracted setting and an expanded setting, the tactile surface at the deformable region being substantially flush with the tactile surface at the peripheral region in the retracted setting and offset above the tactile surface at the peripheral region in the expanded setting;

estimating a viewing position of a user relative to the digital display;

transitioning the deformable region from the retracted setting into the expanded setting; and

modifying a portion of the image rendered on the digital display according to the estimated viewing position of the user and a profile of the tactile surface across the deformable region in the expanded setting,

wherein

estimating the viewing position of the user comprises capturing a photographic image of the user through a forward-facing camera arranged within a computing device coupled to the dynamic tactile interface, detecting eyes of the user within the photographic image, and generating a viewing position matrix defining an angel between the eyes of the user and the digital display along a first axis of the tactile layer and an angle between the eyes of the user and the digital display along a second axis of the tactile layer for each discrete position in a set of discrete positions across the tactile layer based on a position of the eyes within the photographic image; and

modifying the portion of the image rendered on the digital display comprises selecting a geometry matrix defining a profile of the tactile surface for the deformable region in the expanded setting for each discrete position in the set of discrete positions, transforming the image rendered on the digital display according to the viewing position matrix and geometry matrix to generate a second image, and rendering the second image on the digital display.

2. The method of claim 1,

wherein rendering the image on the digital display comprises rendering a first frame comprising an icon for an input key of a computing device coupled to the dynamic tactile interface, the icon substantially aligned with the deformable region in the retracted setting in the first frame;

and

wherein modifying the portion of the image comprises generating a second frame comprising a scaled and translated version of the icon and rendering the second frame on the digital display in response to transitioning the deformable region into the expanded setting.

3. The method of claim 2, wherein modifying the portion of the image comprises shifting to black a set of pixels in the digital display, the set of pixels corresponding to an area of a first icon excluding an area of an intersection of the first icon and a second icon as rendered on the digital display.

4. The method of claim 2, wherein modifying the portion of the image comprises non-uniformly reducing backlight intensity of a set of pixels in the digital display, the set of pixels corresponding to an area of a first icon excluding an area of an intersection of the first icon and a second icon as rendered on the digital display.

5. The method of claim 2, wherein scaling the icon and translating the icon from the first frame to generate the second frame comprises setting a scaling value based on a vertical position of the deformable region in the expanded setting, setting a translation magnitude value and a translation direction based on a vertical position of the deformable region in the expanded setting and the estimated viewing position of the user, applying the scaling value uniformly across the icon, and translating the icon according to the translation magnitude value and the translation direction in the first frame to generate the second frame.

6. The method of claim 1, wherein transitioning the deformable region from the retracted setting into the expanded setting comprises displacing a volume of fluid through a fluid channel to expand the deformable region, the fluid channel fluidly coupled to a cavity cooperatively defined by the substrate and the deformable region.

7. The method of claim 6, wherein modifying the portion of the image rendered on the digital display comprises estimating a three-dimensional surface profile of the tactile layer across the deformable region in the expanded setting based on a magnitude of the volume of fluid, estimating a non-uniform magnification of the portion of the image by the deformable region in the expanded setting based on the estimated three-dimensional surface profile, and non-uniformly scaling the portion of the image rendered on the digital display to compensate for the non-uniform magnification of the portion of the image rendered on the digital display.

8. The method of claim 7, wherein modifying the portion of the image rendered on the digital display comprises estimating a change in perceived position of the portion of the image by the user through the deformable region between the retracted setting and the expanded setting based on the estimated three-dimensional surface profile and the estimated viewing position of the user, calculating a translation magnitude value and a translation direction to compensate for the change in perceived position of the portion of the image by the user, and translating the portion of the image rendered on the digital display based on the translation magnitude value and the translation direction.

9. The method of claim 1, wherein transforming the image rendered on the digital display comprises transforming the image into the second image further based on an index of refraction of the tactile layer and an index of refraction of a fluid arranged between the deformable region and the substrate.

10. The method of claim 1,

wherein transitioning the deformable region from the retracted setting into the expanded setting comprises transitioning a set of deformable regions from the retracted setting into the expanded setting;

and

wherein selecting the geometry matrix comprises generating the geometry matrix defining an effective thickness of the tactile layer across the peripheral region and the set of deformable regions in the expanded setting for each discrete position in the set of discrete positions.

11. The method of claim 1, wherein generating the viewing position matrix comprises translating a position of the eyes within the photographic image to a viewing angle of the eyes to the forward-facing camera, translating a distance between the eyes within the photographic image to a viewing distance between the eyes and the forward-facing camera, and transforming the viewing angle and the viewing distance into an angle between the eyes of the user along the first axis and an angle between the eyes of the user along the second axis for each discrete position in the set of discrete positions across the tactile layer based on a location of each discrete position in the set of discrete positions across the tactile layer.

12. The method of claim 1,

wherein rendering the image on the digital display comprises rendering the image on the digital display at a first time;

wherein transitioning the deformable region from the retracted setting into the expanded setting comprises transitioning the deformable region into the expanded setting over a period of time succeeding the first time, the period of time terminating in a second time; and

wherein modifying the portion of the image rendered on the digital display comprises cyclically refreshing an image rendered on the display according to a position of the deformable region over the peripheral region during the period of time.

13. The method of claim 12, wherein modifying the portion of the image comprises predicting a first perceived parallax of each pixel in the digital display by the user at the first time for the deformable region in the retracted setting, predicting a second perceived parallax of each pixel in the digital display by the user at the second time for the deformable region in the expanded setting, and modifying the image to compensate for a change in perceived parallax of each pixel of the digital display from the first perceived parallax to the second perceived parallax.

14. The method of claim 1,

wherein transitioning the deformable region from the retracted setting into the expanded setting comprises transitioning the deformable region into the expanded setting at a first time;

wherein rendering the image on the digital display comprises rendering the image on the digital display substantially at the first time;

wherein estimating the viewing position of the user relative to the digital display comprises estimating a first viewing position of the user relative to the digital display substantially at the first time and estimating a second viewing position of the user relative to the digital display different from the first viewing position at a second time succeeding the first time; and

wherein modifying the portion of the image rendered on the digital display comprises refreshing the image rendered on the digital display according to a difference between the first viewing position and the second viewing position.

15. The method of claim 14,

wherein estimating the first viewing position of the user and the second viewing position of the user comprises estimating a new viewing position of the user relative to the digital display at a refresh rate, and

wherein modifying the portion of the image rendered on the digital display comprises refreshing a transfer matrix at the refresh rate, the transfer matrix defining transformation of images rendered on the digital display based on an estimated position of the user to the digital display.

16. A method for reducing perceived optical distortion of light output through a dynamic tactile interface, the dynamic tactile interface including a digital display coupled to a substrate opposite a tactile layer, the substrate and the tactile layer being substantially transparent, the tactile layer defining a tactile surface, a peripheral region, and a deformable region, the peripheral region adjacent the deformable region and coupled to the substrate opposite the tactile surface, the deformable region disconnected from the substrate, the method comprising:

transitioning the deformable region from a retracted setting into an expanded setting, the tactile surface at the deformable region being substantially flush with the tactile surface at the peripheral region in the retracted setting and offset from the tactile surface at the peripheral region in the expanded setting; and

at a first time, estimating a first viewing position of a user relative to the digital display;

substantially at the first time, rendering an image on the digital display based on the first viewing position and a profile of the tactile surface across the deformable region in the expanded setting, the image comprising a portion rendered on the digital display adjacent the deformable region in the expanded setting;

at a second time succeeding the first time, estimating a second viewing position of the user relative to the digital display; and

modifying a position of the portion of the image rendered on the display adjacent the deformable region based on a difference between the first viewing position and the second viewing position

wherein

estimating the first viewing position or estimating the second viewing position of the user comprises capturing a photographic image of the user through a camera arranged within a computing device coupled to the dynamic tactile interface, detecting eyes of the user within the photographic image, and generating a viewing position matrix defining an angel between the eyes of the user and the digital display along a first axis of the tactile layer and an angle between the eyes of the user and the digital display along a second axis of the tactile layer for each discrete position in a set of discrete positions across the tactile layer basedon a position of the eyes with in the photographic image; and

modifying the portion of the image rendered on the digital display comprises selecting a geometry matrix defining a profile of the tactile surface for the deformable region in the expanded setting for each discrete position in the set of discrete positions, transforming the image rendered on the digital display according to the viewing position matrix and the geometry matrix to generate a second image, and rendering the second image on the digital display.

17. The method of claim 16, wherein modifying the position of the portion of the image rendered on the display further comprises estimating a first perceived parallax of the image at the first time based on a first set of viewing angles, estimating a second perceived parallax of the image at the second time based on a second set of viewing angles of the user to the set of discrete positions across the digital display, and translating and scaling the portion of the image to compensate for a difference between the first perceived parallax and the second perceived parallax.

18. The method of claim 16, wherein transitioning the deformable region from the retracted setting into the expanded setting comprises displacing a preset volume of fluid into a fluid channel fluidly coupled to a cavity cooperatively defined by the substrate and the deformable region to expand the deformable region to a target height offset above the peripheral region.

19. A method for reducing perceived optical distortion of light output through a dynamic tactile interface, the method comprising:

rendering an image on a digital display, the digital display coupled to a tactile layer defining a tactile surface, a peripheral region, and a deformable region;

estimating a viewing position of a user relative to the digital display;

transitioning the deformable region from a retracted setting into an expanded setting, the tactile surface at the deformable region substantially flush with the tactile surface at the peripheral region in the retracted setting and offset from the tactile surface at the peripheral region in the expanded setting; and

in response to transitioning the deformable region into the expanded setting, modifying the image rendered on the digital display according to the estimated viewing position of the user to compensate for a surface profile of the tactile layer at the deformable region in the expanded setting,

wherein

estimating the viewing position of the user comprises capturing a photographic image of the user through a forward-facing camera arranged within a computing device coupled to the dynamic tactile interface, and detecting eyes of the user within the photographic image, and generating a viewing position matrix defining an angel between the eyes of the user and the digital display along a first axis of the tactile layer and an angle between the eyes of the user and the digital display along a second axis of the tactile layer for each discrete position in a set of discrete positions across the tactile layer based on a position of the eyes within the photographic image; and

modifying the image rendered on the digital display comprises selecting a geometry matrix defining a profile of the tactile surface for the deformable region in the expanded setting for each discrete position in the set of discrete positions, transforming the image rendered on the digital display according to the viewing position matrix and the geometry matrix to generate a second image, and rendering the second image on the digital display.