Guidance device for the sensory impaired

• US 10,254,840 B2
• Filed: 02/20/2018
• Issued: 04/09/2019
• Est. Priority Date: 07/21/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Weinraub, Chananiel
• Primary Examiner(s): Camby, Richard M
• Application Number:
  US15/900,728
• Publication Number:
  US 20180181204A1
• Time in Patent Office: 413 Days
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

Sensor data is obtained regarding an environment around a guidance device. A model of the environment is generated based on the data. The model is mapped at least to an input/output touch surface of the guidance device. Tactile output is provided to a user of the guidance device via the input/output touch surface based at least on the mapping. Other output based on the model may also be provided. The guidance device may include a variety of different components such as sensors that obtain data regarding the environment, input/output mechanisms for receiving input from and/or providing input to the user, processing units and/or other components for generating the model and/or mapping the model to various input/output mechanisms, and so on. Additionally, the guidance device may cooperate and/or communicate with a variety of different electronic devices that have one or more such components in order to perform such functions.

Claims

1. An electronic device, comprising:

an enclosure;

a tactile feedback layer positioned in the enclosure and configured to provide tactile output at an input/output surface;

a display layer positioned in the enclosure and configured to provide visual output through the input/output surface;

a sensor positioned within the enclosure and configured to sense an object within an external environment; and

a processing unit, operably coupled to the sensor, wherein;

the processing unit is configured to determine an estimated location of the object within the external environment based on an output of the sensor; and

the processing unit is configured to cause the tactile feedback layer to generate the tactile output, the tactile output including a representation that corresponds to the estimated location of the object.

2. The electronic device of claim 1, wherein the tactile feedback layer is operable to provide the tactile output by raising portions of the input/output surface.

3. The electronic device of claim 1, wherein the display layer provides the representation along a region of the input/output surface that corresponds to the estimated location of the object with respect to an orientation and position of the electronic device.

4. The electronic device of claim 1, wherein a shape of the representation corresponds to a shape of the object.

5. The electronic device of claim 1, wherein the sensor is an image sensor.

6. The electronic device of claim 1, wherein the sensor senses the object using another electronic device that is separate from the electronic device.

7. The electronic device of claim 1, wherein the electronic device comprises a smart watch.

8. An electronic device, comprising:

an enclosure defining a surface operable to receive a touch input;

a sensor configured to sense an object positioned within an environment; and

a processing unit operably coupled to the sensor;

wherein;

the processing unit is configured to detect the touch input along a portion of the surface being touched;

in response to detecting the touch input, the processing unit is configured to cause the portion of the surface to generate a tactile output; and

the tactile output includes a representation that corresponds to the object sensed using the sensor.

9. The electronic device of claim 8, wherein:

the electronic device further comprises an orientation sensor that is configured to detect an orientation of the electronic device; and

a location of the representation along the surface changes in accordance with a change in the orientation of the electronic device.

10. The electronic device of claim 8, wherein the representation includes a direction indication that corresponds to a navigation direction to a destination.

11. The electronic device of claim 8, wherein the electronic device comprises a display screen positioned below the surface.

12. The electronic device of claim 8, wherein the tactile output includes:

a first representation of a first object located in a first position with respect to the electronic device; and

a second representation of a second object located in a second position with respect to the electronic device.

13. The electronic device of claim 12, wherein:

the first representation indicates that a movement of the electronic device is in a direction of travel toward the first object.

14. The electronic device of claim 13, wherein:

the second representation indicates that the direction of travel is away from the second object.

15. An electronic device, comprising:

a housing;

a sensor configured to sense an external environment;

a processing unit positioned within the housing;

a haptic device operably coupled to the processing unit and configured to produce a haptic output along a portion of an external surface of the electronic device; and

a touch sensing device;

wherein;

the processing unit is configured to determine details of a hand of a user that is touching the touch sensing device, the processing unit is configured to cause the haptic device to produce the haptic output; and

the haptic output comprises an output image that corresponds to a portion of the external environment sensed by the sensor, the haptic output being provided in accordance with the details of the hand of the user.

16. The electronic device of claim 15, wherein:

the output image includes a two-dimensional representation of the portion of the external environment.

17. The electronic device of claim 15, wherein the haptic device comprises at least one of piezoelectric cells or vibration actuators.

18. The electronic device of claim 15, wherein the haptic device is operable to provide the haptic output as a number of raised bumps.

19. The electronic device of claim 15, wherein the details of the hand include:

a location where the hand is touching the touch sensing device;

whether the hand is a left hand;

whether the hand is a right hand;

or

a palm size of the hand.