VISUALLY IMPAIRED AUGMENTED REALITY

• US 20180293980A1
• Filed: 04/05/2017
• Published: 10/11/2018
• Est. Priority Date: 04/05/2017
• Status: Abandoned Application

• Current Assignee: Intel Corporation
• Original Assignee: Moorthy Rajesh
• Inventors: Dwarakanath, Kumar Narasimhan, Rajesh, Moorthy, Ratnayake, Senaka Cuda Bandara
• Application Number:
  US15/479,916
• Publication Number:
  US 20180293980A1
• Time in Patent Office: Days
• CPC Class Codes: A61F 9/08 Devices or methods enabling eye-patients to replace direct visual perception by another kind of perception
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09B 21/006 using audible presentation of the information
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

System and techniques for visually impaired augmented reality are described herein. An utterance may be received from a user. The utterance may be classified to produce a filter. The user'"'"'s environment may be classified based on the filter to produce an environmental event. An audible interpretation of the environmental event may be rendered.

Claims

1. A system for visually impaired augmented reality, the system comprising:

sensor interface to receive an utterance from a user;

a controller to;

classify the utterance to produce a filter; and

classify an environment of the user based on the filter to produce an environmental event, wherein, to classify the environment, the controller selects a classifier from multiple classifiers based on the filter; and

an output driver to render an audible interpretation of the environmental event, wherein the system is implemented in circuitry of a user worn device or a user held device.

2. The system of claim 1, wherein, to classify the utterance to produce the filter, the controller is to perform a speech-to-text conversion of the utterance to produce a parameter.

3. The system of claim 2, wherein, to classify the environment of the user based on the filter, the controller is to select a classifier to classify the environment based on the parameter.

4. The system of claim 1, wherein the audible interpretation includes a set of words intelligible by the user.

5. The system of claim 4, wherein, to classify the environment to produce an environmental event, the controller is to limit a frequency of environmental events produced.

6. The system of claim 5, wherein the frequency of environmental events produced is based on a cardinality of the set of words corresponding to potential events.

7. The system of claim 5, wherein the frequency of environmental events produced is based on a time-to-render of the set of words corresponding to potential events.

8. The system of claim 7, wherein the frequency of environmental events produced is beyond a threshold, and wherein the audible interpretation is a generalized description of multiple environmental events.

9. A machine implemented method for visually impaired augmented reality, the method comprising:

receiving, by a sensor interface of the machine, an utterance from a user;

classifying, by a controller of the machine, the utterance to produce a filter;

classifying, by the controller, an environment of the user based on the filter to produce an environmental event, wherein classifying the environment includes selecting a classifier from multiple classifiers based on the filter; and

rendering, by an output driver of the machine, an audible interpretation of the environmental event, wherein the machine is implemented in circuitry of a user worn device or a user held device.

10. The method of claim 9, wherein classifying the utterance to produce the filter includes performing a speech-to-text conversion of the utterance to produce a parameter.

11. The method of claim 10, wherein classifying the environment of the user based on the filter includes selecting a classifier to classify the environment based on the parameter.

12. The method of claim 9, wherein the audible interpretation includes a set of words intelligible by the user.

13. The method of claim 12, wherein classifying the environment to produce an environmental event includes limiting a frequency of environmental events produced.

14. The method of claim 13, wherein the frequency of environmental events produced is based on a cardinality of the set of words corresponding to potential events.

15. The method of claim 13, wherein the frequency of environmental events produced is based on a time-to-render of the set of words corresponding to potential events.

16. The method of claim 15, wherein the frequency of environmental events produced is beyond a threshold, and wherein the audible interpretation is a generalized description of multiple environmental events.

17. At least one non-transitory machine readable medium including instructions for visually impaired augmented reality, the instructions, when executed by processing circuitry, cause the processing circuitry to perform operations comprising:

receiving an utterance from a user;

classifying the utterance to produce a filter;

classifying an environment of the user based on the filter to produce an environmental event, wherein classifying the environment includes selecting a classifier from multiple classifiers based on the filter; and

rendering an audible interpretation of the environmental event, wherein the processing circuitry is in a user worn device or a user held device.

18. The at least one machine readable medium of claim 17, wherein classifying the utterance to produce the filter includes performing a speech-to-text conversion of the utterance to produce a parameter.

19. The at least one machine readable medium of claim 18, wherein classifying the environment of the user based on the filter includes selecting a classifier to classify the environment based on the parameter.

20. The at least one machine readable medium of claim 17, wherein the audible interpretation includes a set of words intelligible by the user.

21. The at least one machine readable medium of claim 20, wherein classifying the environment to produce an environmental event includes limiting a frequency of environmental events produced.

22. The at least one machine readable medium of claim 21, wherein the frequency of environmental events produced is based on a cardinality of the set of words corresponding to potential events.

23. The at least one machine readable medium of claim 21, wherein the frequency of environmental events produced is based on a time-to-render of the set of words corresponding to potential events.

24. The at least one machine readable medium of claim 23, wherein the frequency of environmental events produced is beyond a threshold, and wherein the audible interpretation is a generalized description of multiple environmental events.