Guidance device for the sensory impaired

• US 10,664,058 B2
• Filed: 02/27/2019
• Issued: 05/26/2020
• Est. Priority Date: 07/21/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Weinraub, Chananiel
• Primary Examiner(s): Camby, Richard M
• Application Number:
  US16/287,883
• Publication Number:
  US 20190196594A1
• Time in Patent Office: 454 Days
• Field of Search: None
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

Sensor data is obtained regarding an environment around a guidance device. A model of the environment is generated based on the data. The model is mapped at least to an input/output touch surface of the guidance device. Tactile output is provided to a user of the guidance device via the input/output touch surface based at least on the mapping. Other output based on the model may also be provided. The guidance device may include a variety of different components such as sensors that obtain data regarding the environment, input/output mechanisms for receiving input from and/or providing input to the user, processing units and/or other components for generating the model and/or mapping the model to various input/output mechanisms, and so on. Additionally, the guidance device may cooperate and/or communicate with a variety of different electronic devices that have one or more such components in order to perform such functions.

Claims

1. An electronic device, comprising:

an enclosure;

a first sensor positioned within the enclosure and configured to detect an orientation of the enclosure relative to an external environment;

a second sensor positioned within the enclosure and configured to detect an object within the external environment; and

a processing unit, operably coupled to the first and second sensors, wherein;

the processing unit is configured to recognize the presence of the object within the external environment based on an output of the second sensor; and

the processing unit is configured to output information regarding the object responsive to recognizing the presence of the object and the detected orientation of the enclosure.

2. The electronic device of claim 1, wherein the information output by the processing unit is visually displayed on the electronic device.

3. The electronic device of claim 1, wherein the information output by the processing unit is an audio output from the electronic device.

4. The electronic device of claim 1, wherein the first sensor is a positional sensor and the second sensor is an image sensor.

5. The electronic device of claim 1, wherein the second sensor is configured to detect the object when the enclosure is oriented in a particular orientation.

6. The electronic device of claim 1, wherein the information output by the processing unit regarding the object is transmitted to a second electronic device.

7. The electronic device of claim 1, wherein the electronic device comprises a smart watch.

8. An electronic device, comprising:

a housing;

a first sensor positioned within the housing and configured to detect an orientation of the housing relative to an external environment;

a second sensor positioned within the housing and configured to generate image data relative to an object within the external environment; and

a processing unit, operably coupled to the first and second sensors, wherein;

the processing unit is configured to analyze the image data to identify the object within the external environment; and

the processing unit is configured to output information pertaining to the object responsive to the identity of the object and the detected orientation of the housing.

9. The electronic device of claim 8, wherein the processing unit analyzes the image data using image recognition to identify the object.

10. The electronic device of claim 8, wherein the information pertaining to the object is transmitted to another electronic device.

11. The electronic device of claim 8, wherein the electronic device comprises an input-output touch layer configured to detect touch and provide tactile output.

12. The electronic device of claim 11, wherein the input/output touch layer comprises a display layer configured to provide visual output.

13. The electronic device of claim 11, wherein the input-output touch layer comprises a capacitive sensor.

14. The electronic device of claim 8, wherein the electronic device comprises a smart phone.

15. A method for aiding interaction with an external environment, the method comprising:

providing an electronic device having a first and second sensor and a processing unit, the first sensor being configured to detect a particular orientation of the electronic device and the second sensor being configured to generate image data relative to an object within the external environment;

positioning the electronic device in the particular orientation;

generating image data relative to the object within the external environment;

analyzing the image data at the processing unit to identify the object; and

outputting information about the object to a user responsive to the identity of the object and positioning the electronic device to the particular orientation.

16. The method of claim 15, wherein the second sensor begins generating image data when the electronic device is positioned in the particular orientation.

17. The method of claim 15, wherein outputting information about the object to a user includes displaying visual information on a display screen of the electronic device.

18. The method of claim 15, wherein outputting information about the object to a user includes providing a haptic response.

19. The method of claim 18, wherein providing a haptic response includes vibrating a portion of the electronic device.

20. The method of claim 15, wherein the outputting information about the object to a user includes outputting information relative to navigating the external environment.