WEARABLE ELECTRONIC IMAGE ACQUISITION AND ENHANCEMENT SYSTEM AND METHOD FOR IMAGE ACQUISITION AND VISUAL ENHANCEMENT

• US 20130131985A1
• Filed: 04/11/2012
• Published: 05/23/2013
• Est. Priority Date: 04/11/2011
• Status: Abandoned Application

• Current Assignee: University of Southern California
• Original Assignee: Armand R. Tanguay Jr
• Inventors: Weiland, James D., Medioni, Gerard, Itti, Laurent, Humayan, Mark S., Tanguay, Armand R. Jr., Pradeep, Vivek
• Application Number:
  US13/444,839
• Publication Number:
  US 20130131985A1
• Time in Patent Office: Days
• US Class Current: 701/516
• CPC Class Codes: A61H 3/061 with electronic detecting or guiding means
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G08B 3/00 Audible signalling systems; Audible personal calling systems
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals

Abstract

The system comprises a wearable, electronic image acquisition and processing system (or visual enhancement system) to guide visually impaired individuals through their environment, providing information to the user about nearby objects of interest, potentially dangerous obstacles, their location, and potential paths to their destination.

Claims

17. A method of providing navigation information comprising:

Receiving data from a data acquisition module;

Providing the data from the data acquisition module to a processor for generating environmental information and for identifying a safe path through the environment;

Predicting a user'"'"'s direction of motion and measuring deviation from the safe path;

Transmitting feedback information from the processor to a user feedback system to indicate a user'"'"'s relationship with the path.

1. A system comprising:

a data acquisition module for receiving image information associated with the environment of a user;

a user input module comprising tactile and audio controllers for receiving user commands comprising mobility and data acquisition goals;

a processor coupled to the data acquisition module and to the user input module for receiving and processing image data and for receiving and implementing user commands;

a user feedback module comprising tactile and audio feedback coupled to the processor for receiving information about the mobility and data acquisition goals.

2. The system of claim 1 wherein the data acquisition module comprises a camera.

3. The system of claim 2 wherein the camera is mounted on a pair of eyeglasses.

4. The system of claim 3 wherein the camera comprises a stereoscopic system.

5. The system of claim 1 wherein the processor is coupled to the data acquisition module, the user input module, and the user feedback module via a wireless connection.

6. The system of claim 1 wherein the user feedback module comprises a tactile feedback system.

7. The system of claim 1 wherein the user feedback module comprises an auditory feedback system.

8. The system of claim 5 wherein the processor is a cloud based processor.

9. The system of claim 1 wherein the processor comprises a processing module and a control module.

10. The system of claim 2 in which the camera further comprises a wide field of view lens.

11. The system of claim 2 in which the camera further comprises a wide dynamic range image sensor.

12. The system of claim 2 in which the camera comprises a device that provides a depth image.

13. The system of claim 2 wherein the camera is a 3D camera.

14. The system of claim 1 further including firmware implenting a path planning module for the generation of simultaneous localization and mapping (SLAM) data for use in generating a safe path for the user.

15. The system of claim 14 further including the use of neuromorphic data for use in generating a safe path for the user.

16. The system of claim 15 further including a path planning algorithm for use in generating a safe path for the user.

18. The method of claim 17 wherein the data provided from the data acquisition module is depth data and wherein the processor uses the depth data to generate environmental information.

19. The method of claim 17 wherein the data is a pair of images processed to produce depth information used by the processor to generate environmental information.

20. The method of claim 17 wherein the system generates environmental information by performing simultaneous localization and mapping.

21. The method of claim 20 further including the step of obstacle detection to identify obstacles in the path.

22. The method of claim 21 further including providing a warning to the user through the feedback system.

23. The method of claim 17 wherein the user can issue commands to the processor using voice commands.

24. The method of claim 23 further including the user of tactile input to issue commands to the processor.

25. The method of claim 17 wherein the processor switches between a plurality of modes.

26. The method of claim 25 wherein the modes comprise proximity mode and mobility mode.

27. The method of claim 26 wherein the system provides object detection in response to a command from the user.

28. The method of claim 27 wherein the object detection is a neuromorphic system.

29. The method of claim 25 wherein the mode is detect and acquire mode.

30. The method of claim 29 wherein the mode allows the system to detect an object and assist the user in reaching for and grasping the object.

32. The method of claim 17 wherein the data acquisition module acquires images of the environment with a wide field of view.

33. The method of claim 17 wherein the data acquisition module acquires images under both low lighting conditions and high lighting conditions.

34. The system of claim 1 further including a module for object detection and recognition.

30-1. The method of claim 27 further including object recognition in response to a command from the user.