SMART NECKLACE WITH STEREO VISION AND ONBOARD PROCESSING

• US 20150201181A1
• Filed: 01/14/2014
• Published: 07/16/2015
• Est. Priority Date: 01/14/2014
• Status: Active Grant

• Current Assignee: Toyota Jidosha Kabushiki Kaisha (Toyota Motor Corporation)
• Original Assignee: Toyota Motor Engineering & Manufacturing North America Incorporated (Toyota Motor Corporation)
• Inventors: Moore, Douglas A., Djugash, Joseph M.A., Ota, Yasuhiro
• Granted Patent: US 9,578,307 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61H 2003/063 with tactile perception
• CPC Class Codes: A61H 2201/1609 Neck
• CPC Class Codes: A61H 2201/165 Wearable interfaces
• CPC Class Codes: A61H 2201/5007 computer controlled
• CPC Class Codes: A61H 2201/5043 Displays
• CPC Class Codes: A61H 2201/5048 Audio interfaces, e.g. voice or music controlled
• CPC Class Codes: A61H 2201/5058 Sensors or detectors
• CPC Class Codes: A61H 2201/5064 Position sensors
• CPC Class Codes: A61H 2201/5071 Pressure sensors
• CPC Class Codes: A61H 2201/5082 Temperature sensors
• CPC Class Codes: A61H 2201/5084 Acceleration sensors
• CPC Class Codes: A61H 2201/5089 Gas sensors, e.g. for oxygen or CO2
• CPC Class Codes: A61H 2201/5092 Optical sensor
• CPC Class Codes: A61H 2201/5097 wireless
• CPC Class Codes: A61H 3/061 with electronic detecting or guiding means
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 2013/0092 : Image segmentation from stereoscopic image signals

Abstract

A wearable neck device for providing environmental awareness to a user, the wearable neck device includes a flexible tube. A first stereo pair of cameras is encased in a left portion of the flexible tube and a second stereo pair of cameras is encased in a right portion of the flexible tube. A vibration motor within the flexible tube provides haptic and audio feedback to the user. A processor in the flexible tube recognizes objects from the first stereo pair of cameras and the second stereo pair of cameras. The vibration motor provides haptic and audio feedback of the items or points of interest to the user.

Claims

1. A wearable neck device for providing environmental awareness to a user, comprising:

a flexible tube defining a cavity and having a center portion, a left portion and a right portion;

a first stereo pair of cameras positioned on the left portion of the flexible tube;

a second stereo pair of cameras positioned on the right portion of the flexible tube;

a vibration unit, positioned within the cavity, configured to provide haptic feedback to the user;

a speaker, positioned along the flexible tube, configured to provide audio feedback to the user; and

a processor, positioned within the cavity, configured to receive video frames from the first stereo pair of cameras and the second stereo pair of cameras, provide object recognition of items in the video frames, identify points of interest to the user based on the object recognition, and control the vibration unit to provide haptic feedback and the speaker to provide audio feedback to the user based on the points of interest.

2. The wearable neck device of claim 1 further comprising a storage device configured to store a map data.

3. The wearable neck device of claim 1 further comprising an antenna configured for wireless communication.

4. The wearable neck device of claim 1 further comprising at least one of a radio frequency identification (RFID) reader for reading RFID tags or a near field communication (NFC) unit for reading NFC tags.

5. The wearable neck device of claim 1 further comprising an inertial measurement unit (IMU) and a global position system (GPS) unit for providing navigation guidance.

6. The wearable neck device of claim 1 further comprising a microphone for receiving voice commands.

7. The wearable neck device of claim 1 further comprising a battery capable of being wirelessly charged.

8. The wearable neck device of claim 1 further comprising an input device for adjusting parameters for haptic and audio feedback.

9. The wearable neck device of claim 1 further comprising at least one of a fifth camera positioned on the left portion of the flexible tube or a sixth camera positioned on the right portion of the flexible tube, the at least one of the fifth or sixth camera being configured to increase a field of view for the wearable neck device.

10. The wearable neck device of claim 1 wherein the first stereo pair of cameras is removable from the left portion of the flexible tube and the second stereo pair of cameras is removable from the right portion of the flexible tube.

11. The wearable neck device of claim 1 wherein the first stereo pair of cameras is coupled to the flexible tube using at least one of a retractable tether, string or a cable.

12. The wearable neck device of claim 10 wherein the first stereo pair of cameras or the second pair of stereo cameras are capable of isolated object recognition when placed near an item.

13. The wearable neck device of claim 1 further comprising a removable tube having a fifth camera, the removable tube being coupled to at least one of the left portion or the right portion using at least one of a magnetic attachment;

a clip;

a retractable tether, string or a cable;

or combinations thereof, wherein the fifth camera is capable of isolated object recognition when placed near an item.

14. A wearable neck device for providing environmental awareness to a user, comprising:

a band defining a cavity and having a center portion, a left portion and a right portion;

a first stereo pair of cameras positioned on the left portion of the band;

a first camera positioned to a side of the first stereo pair of cameras;

a second stereo pair of cameras positioned on the right portion of the band;

a second camera positioned to a side of the second stereo pair of cameras;

a vibration unit, positioned within the cavity, configured to provide haptic feedback to the user;

a speaker, positioned along the band, configured to provide audio feedback to the user; and

a processor, positioned within the cavity, configured to receive video frames from the first stereo pair of cameras, the first camera, the second stereo pair of cameras and the second camera, provide object recognition of items in the video frames, identify points of interest to the user based on the object recognition, and control the vibration unit to provide haptic feedback and the speaker to control the speaker to provide audio feedback to the user based on the items of interest.

15. The wearable neck device of claim 14 further comprising an overmold covering at least a portion of the band to provide cushioning and grip.

16. The wearable neck device of claim 14, further comprising:

a storage device configured to store a map data, and

a global position system (GPS) unit and an inertial measurement unit (IMU) for providing navigation guidance.

17. The wearable neck device of claim 14 further comprising an antenna configured for wireless communication.

18. The wearable neck device of claim 14 wherein the first stereo pair of cameras is removable from the left portion of the band and the second stereo pair of cameras is removable from the right portion of the band to provide isolated object recognition when the first stereo pair of cameras or the second stereo pair of cameras is placed near an item.

19. A method of navigation using a wearable neck device, the method comprising:

recognizing objects with a stereo pair of cameras of the wearable neck device;

determining a location of the wearable neck device with respect to the objects;

determining a route to a destination that avoids the objects;

providing a first audio or haptic cue indicating a waypoint along the route; and

providing a second audio or haptic cue when the wearable neck device reaches the destination.

20. The method of claim 19 further comprising providing an audible alert when the smart necklace is within a predetermined distance from one of the objects.