SYSTEMS AND METHODS FOR PROVIDING ENVIRONMENT INFORMATION USING AN UNMANNED VEHICLE

• US 20170319426A1
• Filed: 05/09/2016
• Published: 11/09/2017
• Est. Priority Date: 05/09/2016
• Status: Active Grant

• Current Assignee: Toyota Motor Engineering & Manufacturing North America Incorporated (Toyota Motor Corporation)
• Original Assignee: Toyota Motor Engineering & Manufacturing North America Incorporated (Toyota Motor Corporation)
• Inventors: Dayal, Rajiv, Lee, Christopher P., Thackston, Allison
• Granted Patent: US 10,188,580 B2
• Time in Patent Office: Days
• CPC Class Codes: A61H 2003/063 with tactile perception
• CPC Class Codes: A61H 2201/5048 Audio interfaces, e.g. voice or music controlled
• CPC Class Codes: A61H 2201/5058 Sensors or detectors
• CPC Class Codes: A61H 2201/5071 Pressure sensors
• CPC Class Codes: A61H 2201/5082 Temperature sensors
• CPC Class Codes: A61H 2201/5089 Gas sensors, e.g. for oxygen or CO2
• CPC Class Codes: A61H 2201/5092 Optical sensor
• CPC Class Codes: A61H 3/061 with electronic detecting or guiding means
• CPC Class Codes: G01C 21/3476 using point of interest [POI] information, e.g. a route passing visible POIs
• CPC Class Codes: G01C 21/3629 Guidance using speech or audio output, e.g. text-to-speech text to speech systems per se G10L13/00
• CPC Class Codes: G01C 21/3652 Guidance using non-audiovisual output, e.g. tactile, haptic or electric stimuli
• CPC Class Codes: G01C 21/3679 Retrieval, searching and output of POI information, e.g. hotels, restaurants, shops, filling stations, parking facilities G01C21/3611 takes precedence
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/024 Guidance services
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 4/40 for vehicles, e.g. vehicle-to-pedestrians [V2P]

Abstract

A system for providing, to a user, navigation directions to a point of interest. The system includes a device having an output unit configured to output the navigation directions to the point of interest. The device is configured to communicate, to an unmanned vehicle, a point of interest identification. The system also includes the unmanned vehicle having a camera configured to detect image data. The unmanned vehicle is configured to determine Whether the point of interest identification is detected from the image data. The unmanned vehicle is also configured to determine a point of interest location when the point of interest identification is detected from the image data. The unmanned vehicle is also configured to determine point of interest navigation data based on the point of interest location. The unmanned vehicle is also configured to communicate, to the device, the point of interest navigation data.

Claims

1. A system for providing, to a user, navigation directions to a point of interest, the system comprising:

a device having an output unit configured to output the navigation directions to the point of interest, and being configured to communicate, to an unmanned vehicle, a point of interest identification; and

the unmanned vehicle having a camera configured to detect image data, and being configured to;

determine whether the point of interest identification is detected from the image data,

determine a point of interest location when the point of interest identification is detected from the image data,

determine point of interest navigation data based on the point of interest location, and

communicate, to the device, the point of interest navigation data.

2. The system of claim 1, wherein the unmanned vehicle is further configured to:

determine an information collecting location;

automatically move to the information collecting location; and

detect image data at the information collecting location.

3. The system of claim 2, wherein the unmanned vehicle is further configured to adjust the information collecting location when the point of interest location is not determined based on the image data.

4. The system of claim 2, wherein the unmanned vehicle includes a memory comprising map data and the information collecting location is determined based on the map data.

5. The system of claim 4, wherein the map data includes previously stored information collecting locations.

6. The system of claim 2, wherein the information collecting location is within a communication range of the device.

7. The system of claim 2, wherein the unmanned vehicle is further configured to automatically move within a communication range of the device to communicate the point of interest navigation data when the information collecting location is outside the communication range of the device.

8. The system of claim 1, wherein the device is a wearable device worn by the user and the unmanned vehicle is an unmanned aerial vehicle.

9. The system of claim 1, wherein the unmanned vehicle is further configured to determine an orientation of the user and wherein the point of interest navigation data is relative to the orientation of the user.

10. A device for providing, to a user, navigation directions to a point of interest, the device comprising:

an input unit configured to receive a point of interest identification associated with the point of interest;

a device camera configured to detect image data;

a transceiver configured to communicate with an unmanned vehicle;

a device control unit configured to;

determine whether point of interest identification is detected from the image data,

communicate, to the unmanned vehicle, the point of interest identification when the point of interest identification is not detected from the image data, and

receive, from the unmanned vehicle, point of interest navigation data; and

an output unit configured to output the navigation directions to the point of interest based on the point of interest navigation data received from the unmanned vehicle.

11. The device of claim 10, wherein the device is a wearable device worn by the user.

12. The device of claim 10, wherein the output unit is further configured to output an indication that the unmanned vehicle is being used to determine the navigation directions when the point of interest identification is not detected from the image data.

13. The device of claim 10, wherein the point of interest navigation data received from the unmanned vehicle comprises the point of interest location and the device control unit is further configured to determine the navigation directions to the point of interest based on the point of interest location.

14. The device of claim 10, wherein the unmanned vehicle is within a communication range of the device.

15. A method for providing, to a user, navigation directions to a point of interest, the method comprising:

communicating, by a device to an unmanned vehicle, a point of interest identification;

detecting, by the unmanned vehicle, image data;

determining, by the unmanned vehicle, whether the point of interest identification is detected from the image data;

determining, by the unmanned vehicle, a point of interest location when the point of interest identification is detected from the image data;

determining, by the unmanned vehicle, point of interest navigation data based on the point of interest location;

communicating, by the unmanned vehicle to the device, the point of interest navigation data; and

outputting, by the device, the navigation directions to the point of interest based on the point of interest navigation data.

16. The method of claim 15, further comprising:

determining, by the unmanned vehicle, an information collecting location;

automatically moving, by the unmanned vehicle, to the information collecting location; and

detecting, by the unmanned vehicle, the image data at the information collecting location.

17. The method of claim 16, further comprising adjusting, by the unmanned vehicle, the information collecting location to detect additional image data when the point of interest location is not determined based on the image data.

18. The method of claim 16, further comprising determining, by the unmanned vehicle, the information collecting location based on map data stored in an unmanned vehicle memory.

19. The method of claim 18, wherein the map data includes previously stored information collecting locations.

20. The method of claim 16, further comprising automatically moving, by the unmanned vehicle, within a communication range of the device to communicate the point of interest navigation data when the information collecting location is outside the communication range of the device.