Tactile interaction with content

• US 9,760,241 B1
• Filed: 11/05/2010
• Issued: 09/12/2017
• Est. Priority Date: 11/05/2010
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Lewbel, Hannah Rebecca
• Primary Examiner(s): Landis, Lisa
• Application Number:
  US12/940,936
• Time in Patent Office: 2,503 Days
• Field of Search: 345173
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1652 the display being flexible, e.g. mimicking a sheet of paper, or rollable
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G09B 21/003 using tactile presentation of the information, e.g. Braille displays
• CPC Class Codes: G09B 29/12 Relief maps relief models G09B25/06

Abstract

Some implementations provide tactile interaction to a user during consumption of content. For instance, when a user accesses a content item on an electronic device having a display, the user may touch the display at a location corresponding to a first feature in a displayed image to generate a first type of tactile output. Moving the user'"'"'s finger to a location of a second feature of the image may result in a second type of tactile output, different from the first. Additionally, in some implementations, a force of a touch input may be determined, and the tactile output may vary based on the amount of force of the touch input. Further, in some implementations, the tactile output may vary based on a time duration of a touch input.

Claims

1. A device providing tactile interaction with content, the device comprising:

a processor;

memory coupled to the processor;

a topographic map stored in the memory, the topographic map having at least a first contour line representing a first continuous unitary elevation throughout the topographic map and at least a second contour line representing a second continuous unitary elevation throughout the topographic map, the second continuous unitary elevation being higher than the first continuous unitary elevation;

a touch-sensitive display communicatively coupled to the processor to detect touch inputs and to render an image of at least a portion of the topographic map, the image having at least the first contour line and the second contour line;

a tactile output component to generate a tactile output of a selected intensity; and

a feedback module, stored in the memory and executable on the processor to;

receive a first indication that the touch-sensitive display has detected a first touch input crossing over the first contour line;

select a first tactile output of a first intensity based at least in part on the first touch input crossing over the first contour line;

instruct the tactile output component to provide the first tactile output;

receive a second indication that the touch-sensitive display has detected a second touch input crossing over the second contour line;

select a second tactile output of a second intensity, different from the first intensity, based at least in part on the second touch input crossing over the second contour line;

instruct the tactile output component to provide the second tactile output;

wherein;

the first contour line represents a lower portion of land represented by the topographic map;

the second contour line represents a higher portion of the land represented by the topographic map;

the first intensity of the first tactile output is based, at least in part, on a first height of the land represented by the first contour line; and

the second intensity of the second tactile output is based, at least in part, on a second height of the land represented the second contour line.

2. The device as recited in claim 1, wherein the tactile output component provides localized vibration to an area of the touch-sensitive display as the tactile output.

22. The device as recited in claim 1, wherein the feedback module is further configured to automatically recognize different elevations represented in the topographic map and to automatically assign varying levels of intensity of tactile output with contour lines in the topographic map based at least in part on automatically recognized differences in elevation.

23. The device as recited in claim 1, wherein the topographic map stored in memory includes metadata associating the first tactile output with the first contour line and associating the second tactile output with the second contour line.

3. A device comprising:

a processor;

memory coupled to the processor;

a touch-sensitive display communicatively coupled to the processor to display the content item and to detect touch inputs;

a content item stored in the memory, the content item specifying multiple different levels of tactile output to be generated in response to touch inputs; and

a feedback module, stored in the memory and executable on the processor to;

receive an indication that the touch-sensitive display has detected a touch input at a first location;

determine that the first location is associated with the content item; and

select a tactile output from the multiple different levels of tactile output, wherein the tactile output comprises an electrical stimulus detectable on a surface of the touch-sensitive display.

4. The device as recited in claim 3, further comprising a tactile output component to generate the tactile output selected from the multiple different levels of tactile output, the tactile output component being configured to generate the electrical stimulus at multiple levels of intensity.

5. The device as recited in claim 4, wherein the tactile output component comprises an electrically conductive grid on the surface of the touch-sensitive display.

6. The device as recited in claim 4, wherein the tactile output component is configured to generate a tactile output that is localized to the first location on the touch-sensitive display that has detected the touch input.

7. The device as recited in claim 3, wherein in response to detecting movement of the touch input from the first location to a second location, the feedback component is further executable on the processor to gradually and non-stepwise change an intensity of the tactile output from a first level of intensity to a second level of intensity.

8. The device as recited in claim 7, wherein the first location corresponds to a first contour of an image of the content item displayed on the touch-sensitive display and the second location corresponds to a second contour of the image.

9. The device as recited in claim 3, wherein the feedback component is further executable on the processor to generate one or more of an audio output or a visual output based at least in part on the touch input at the first location.

10. A method, under control of an electronic device configured with specific executable instructions and having a display, comprising:

receiving a first touch input by a first user at a first location corresponding to a first portion of a content item being output by the display, the first user associated with a first calibration setting;

receiving a second touch input by a second user at a second location, different from the first location and corresponding to a second portion of the content item, the second user associated with a second calibration setting;

generating a first localized tactile output to a first area of the display at least partly in response to the first touch input; and

generating a second localized tactile output to a second area of the display at least partly in response to the second touch input, the second localized tactile output different from the first localized tactile output, wherein the first calibration setting correspond to a first plurality of touch-input force levels and the second calibration setting correspond to a second plurality of touch-input force levels.

11. The method as recited in claim 10, further comprising generating a sound output concurrently with the first tactile output and the second tactile output, wherein as the first tactile output changes to the second tactile output, the sound output changes in at least one of pitch or volume.

12. The method as recited in claim 10, wherein:

the content item includes an image displayed on the display; and

different features displayed in the image have different levels of tactile output associated therewith, the different features including the first portion of the content item and the second portion of the content item.

13. The method as recited in claim 12, wherein the image includes a map having contour lines, wherein different contour lines have different levels of tactile output associated therewith.

14. The method as recited in claim 10, wherein:

the content item includes an image having identifiable foreground features and a background; and

the electronic device assigns a first level of tactile output to the identifiable foreground features and a second level of tactile output to the background.

15. The method as recited in claim 10, wherein:

the display provides a three-dimensional (3D) image of the content item; and

the first portion of the content item appears as a lower portion of the 3D image at the first location and the second portion of the content item appears as a higher portion of the image at the second location.

16. The method as recited in claim 10, further comprising measuring an amount force exerted by the first touch input and the second touch input on the display, wherein:

the second touch input comprises a lower or higher amount of force on the display; and

the second tactile output differs from the first tactile output based at least in part on detected differences between the amount of force exerted by the first touch input and the amount of force exerted by the second touch input.

17. The method as recited in claim 10, wherein the first location and the second location are determined by at least one of:

a conductive grid;

detected interference with an electromagnetic field;

detected sound;

detected light blockage;

detected Infrared radiation;

or

a camera.

18. The method as recited in claim 10, wherein the electronic device further includes a camera, and further comprising converting an image from the camera into a content item for tactile interaction.

19. The method as recited in claim 10, wherein the first touch input made by the first user and the second touch input made by the second user are made contemporaneously.

20. The method as recited in claim 10, wherein the first touch input made by the first user and the second touch input made by the second user are made sequentially and the electronic device automatically switches from the first calibration setting to the second calibration setting when control of the electronic device is changed from the first user to the second user.

21. The method as recited in claim 10, wherein:

the content item includes an image having a plurality of separately defined areas, with each area being associated with a level of tactile output that is different from a level of tactile output associated with an adjacent area.