Modifying Vision-Assist Device Parameters Based on an Environment Classification

• US 20160225287A1
• Filed: 01/30/2015
• Published: 08/04/2016
• Est. Priority Date: 01/30/2015
• Status: Active Grant

• Current Assignee: Toyota Jidosha Kabushiki Kaisha (Toyota Motor Corporation)
• Original Assignee: Toyota Motor Engineering & Manufacturing North America Incorporated (Toyota Motor Corporation)
• Inventors: Djugash, Joseph M.A.
• Granted Patent: US 10,217,379 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G05B 2219/25084 Select configuration as function of operator
• CPC Class Codes: G06F 9/50 Allocation of resources, e.g. of the central processing unit [CPU]
• CPC Class Codes: G09B 21/006 using audible presentation of the information
• CPC Class Codes: G09B 21/007 using both tactile and audible presentation of the information
• CPC Class Codes: G09B 21/008 using visual presentation of the information for the partially sighted

Abstract

A vision-assist device may include one or more sensors configured to generate data corresponding to one or more objects present in an environment, and a processor communicatively coupled to the one or more sensors. The processor is programmed to identify one or more objects present in the environment based on the data generated by the one or more sensors, classify the environment based on the one or more identified objects, and modify at least one parameter of the vision-assist device based on the classification of the environment.

Claims

1. A vision-assist device comprising:

one or more sensors configured to generate data corresponding to one or more objects present in an environment;

a processor communicatively coupled to the one or more sensors and programmed to;

identify the one or more objects present in the environment based on the data generated by the one or more sensors;

classify the environment based on the one or more identified objects; and

modify at least one parameter of the vision-assist device based on the classification of the environment based on the one or more identified objects.

2. The vision-assist device of claim 1, wherein the one or more sensors comprise an image sensor, a microphone, a location sensor, an accelerometer, a gyroscope, or an inertial measurement unit.

3. The vision-assist device of claim 1, comprising at least two sensors, wherein at least one of the two sensors comprises an image sensor.

4. The vision-assist device of claim 1, wherein the processor is programmed to identify the one or more objects present in the environment by applying an object recognition algorithm to the data generated by the one or more sensors.

5. The vision-assist device of claim 1, wherein the processor is programmed to classify the environment by applying an object correlation algorithm to the identified objects.

6. The vision-assist device of claim 1, wherein the at least one parameter of the vision-assist device comprise a frequency of notifications provided, an allocation of processing capacity, a prioritization of processing, or a setting of an output mechanism.

7. A vision-assist device comprising:

a first sensor comprising an image sensor configured to generate image data corresponding to an environment;

a second sensor configured to generate data corresponding to the environment;

a processor communicatively coupled to the image sensor and the second sensor and programmed to;

identify a first object and a second object present in the environment based on the image data;

classify the environment based on the first and second objects using an object correlation algorithm and the data generated by the second sensor; and

modify at least one parameter of the vision-assist device based on the classification of the environment based on the first and second objects.

8. The vision-assist device of claim 7, wherein the second sensor comprises a microphone, a location sensor, an accelerometer, a gyroscope, or an inertial measurement unit.

9. The vision-assist device of claim 7, wherein the processor is programmed to determine a confidence value based on a correlation of the first and second objects.

10. The vision-assist device of claim 9, wherein the processor is programmed to modify the at least one parameter responsive to the confidence value being greater than or equal to a predetermined confidence value threshold.

11. The vision-assist device of claim 9, the vision-assist device further comprising a third sensor configured to generate data corresponding to the environment, wherein the processor is programmed to classify the environment based on the first and second objects using the object correlation algorithm, the data generated by the second sensor, and the data generated by the third sensor responsive to the confidence value being below a predetermined confidence value threshold.

12. The vision-assist device of claim 7, wherein the processor is programmed to:

store user parameter modification information;

access the user parameter modification information to retrieve user parameter modification information corresponding to the classification of the environment; and

modify the at least one parameter based at least in part on the user parameter modification information corresponding to the classification of the environment.

13. The vision-assist device of claim 12, wherein the user parameter modification information corresponding to the classification of the environment comprises information relating to a volume level associated with an audio device.

14. The vision-assist device of claim 7, wherein the second sensor comprises a location sensor, and wherein the environment is classified at least in part by location information generated by the location sensor.

15. A vision-assist device comprising:

an image sensor configured to generate image data corresponding to an environment;

a location sensor configured to generate location data corresponding to the environment;

an audio device;

a tactile feedback device;

a processor communicatively coupled to the image sensor, the location sensor, the audio device, and the tactile feedback device, the processor being programmed to;

identify a first object and a second object present in the environment based on the image data;

identify a preliminary classification of the environment based on the first and second objects using an object correlation algorithm; and

modify a setting of the audio device or the tactile feedback device of the vision-assist device based on the preliminary classification of the environment based on the first and second objects.

16. The vision-assist device of claim 15, wherein the processor is programmed to determine a classification of the environment based on at least the preliminary classification and the location data.

17. The vision-assist device of claim 16, wherein the processor is programmed to modify an allocation of processing capacity based on the environment classification based on at least the preliminary classification, based on the first and second objects, and the location data.

18. The vision-assist device of claim 16, wherein the processor is programmed to modify a prioritization of processing based on the environment classification.

19. The vision-assist device of claim 16, wherein the processor is programmed to determine a confidence value based on a correlation of the first and second objects, and wherein the processor is programmed to modify the setting of the audio device or the tactile feedback device responsive to the confidence value being greater than or equal to a predetermined confidence value threshold.

20. The vision-assist device of claim 19, wherein the processor is programmed to determine the confidence value based on the correlation of the first and second objects and the location data.