Vehicle vision system using aerial camera

• US 10,562,624 B2
• Filed: 11/16/2017
• Issued: 02/18/2020
• Est. Priority Date: 11/18/2016
• Status: Active Grant

• Current Assignee: Magna Mirrors of America Incorporated (Magna International Incorporated)
• Original Assignee: Magna Mirrors of America Incorporated (Magna International Incorporated)
• Inventors: Baur, Michael J.
• Primary Examiner(s): McPherson, James M
• Application Number:
  US15/815,090
• Publication Number:
  US 20180141658A1
• Time in Patent Office: 824 Days
• Field of Search: 701 2
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 2300/101 using cameras with adjustable capturing direction
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/107 using stereoscopic cameras
• CPC Class Codes: B60R 2300/406 using wireless transmission
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: B64U 10/13 Flying platforms
• CPC Class Codes: B64U 10/60 Tethered aircraft
• CPC Class Codes: B64U 2101/20 for use as communications relays, e.g. high-altitude platforms
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: B64U 2201/202 using tethers for connecting to ground station
• CPC Class Codes: B64U 30/20 Rotors; Rotor supports
• CPC Class Codes: B64U 80/86 Land vehicles
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G06V 20/17 taken from planes or by drones
• CPC Class Codes: G06V 20/182 Network patterns, e.g. roads or rivers
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road

Abstract

A vision system for a vehicle includes at least one vehicle camera disposed at a vehicle so as to have a field of view exterior of the vehicle and a control that includes an image processor operable to process image data captured by the vehicle camera. An aerial platform is disposed at the vehicle and is operable to detach from and fly above the vehicle. The aerial platform includes at least one drone camera that captures image data and the image data captured by the drone camera is communicated to the control. At least one of (i) the image processor processes image data captured by the drone camera to detect objects present in the field of view of the drone camera, and (ii) a display in the vehicle displays video images derived from image data captured by the drone camera for viewing by a driver of the vehicle.

Claims

1. A vision system for a vehicle, said vision system comprising:

at least one vehicle camera disposed at a vehicle equipped with said vision system, said at least one vehicle camera having a field of view exterior of the equipped vehicle;

a control disposed at the equipped vehicle, said control comprising an image processor operable to process image data captured by said at least one vehicle camera;

an aerial platform comprising at least one drone camera disposed thereat;

wherein said aerial platform is disposed at the equipped vehicle and is operable to detach from the equipped vehicle and to fly above the equipped vehicle, said at least one drone camera capturing image data representative of an area in the field of view of said at least one drone camera when said aerial platform is flying above the equipped vehicle;

wherein, when detached from the equipped vehicle and flying above the equipped vehicle, said aerial platform communicates image data captured by said at least one drone camera to said control disposed at the equipped vehicle; and

wherein at least one of (i) said image processor of said control, when said aerial platform is detached from the equipped vehicle and flying above the equipped vehicle, processes image data captured by said at least one drone camera to detect objects present in the field of view of said at least one drone camera, and (ii) a display in the equipped vehicle, when said aerial platform is detached from the equipped vehicle and flying above the equipped vehicle, displays video images derived from image data captured by said at least one drone camera for viewing by a driver of the equipped vehicle.

2. The vision system of claim 1, wherein said aerial platform detaches from and flies above the equipped vehicle responsive to said control.

3. The vision system of claim 2, wherein said control causes said aerial platform to detach from the equipped vehicle and fly above the equipped vehicle responsive to determination of an obstruction in the field of view of said at least one vehicle camera.

4. The vision system of claim 2, wherein said control causes said aerial platform to detach from the equipped vehicle and fly above the equipped vehicle responsive to a traffic condition encountered by the equipped vehicle.

5. The vision system of claim 1, wherein said aerial platform flies over a target region responsive to said control.

6. The vision system of claim 5, wherein said control controls said aerial platform to fly over the target region responsive to a user input of the equipped vehicle.

7. The vision system of claim 1, wherein said aerial platform, when said aerial platform is detached from the equipped vehicle and flying above the equipped vehicle, moves along and above a path of travel of the equipped vehicle.

8. The vision system of claim 1, wherein said aerial platform is tethered to the equipped vehicle, and wherein image data captured by said drone camera is communicated to said control via a cable that at least in part tethers said aerial platform to the equipped vehicle.

9. The vision system of claim 1, wherein said aerial platform, when said aerial platform is detached from the equipped vehicle and flying above the equipped vehicle, flies at a height at or below a first height above the equipped vehicle.

10. The vision system of claim 9, wherein said aerial platform, when said aerial platform is detached from the equipped vehicle and flying above the equipped vehicle, and responsive to determination that the equipped vehicle is in a traffic jam, flies at a second height above the equipped vehicle that is greater than the first height.

11. The vision system of claim 1, wherein said at least one vehicle camera comprises a plurality of vehicle cameras disposed at the equipped vehicle and having respective fields of view exterior of the equipped vehicle.

12. The vision system of claim 11, wherein said control, when said aerial platform is detached from the equipped vehicle and flying above the equipped vehicle, controls said aerial platform to direct the field of view of said at least one drone camera in a viewing direction of one of said vehicle cameras of the equipped vehicle responsive to the field of view of the one of said vehicle cameras of the equipped vehicle being obstructed.

13. The vision system of claim 1, wherein said image processor, when said aerial platform is detached from the equipped vehicle and flying above the equipped vehicle, processes image data captured by said at least one drone camera to detect objects present in the field of view of said at least one drone camera.

14. The vision system of claim 13, wherein said control generates a communication to a driver of the equipped vehicle that is indicative of objects detected in the field of view of said at least one drone camera.

15. The vision system of claim 1, wherein a display in the equipped vehicle, when said aerial platform is detached from the equipped vehicle and flying above the equipped vehicle, displays video images derived from image data captured by said at least one drone camera for viewing by a driver of the equipped vehicle.

16. A vision system for a vehicle, said vision system comprising:

at least one vehicle camera disposed at a vehicle equipped with said vision system, said at least one vehicle camera having a field of view exterior of the equipped vehicle;

a control disposed at the equipped vehicle, said control comprising an image processor operable to process image data captured by said at least one vehicle camera;

an aerial platform comprising at least one drone camera disposed thereat;

wherein said aerial platform is disposed at the equipped vehicle and is operable to detach from the equipped vehicle and to fly above the equipped vehicle, said at least one drone camera capturing image data representative of an area in the field of view of said at least one drone camera when said aerial platform is flying above the equipped vehicle;

wherein said aerial platform detaches from and flies above the equipped vehicle responsive to said control;

wherein said aerial platform, when said aerial platform is detached from the equipped vehicle and flying above the equipped vehicle, moves along and above a path of travel of the equipped vehicle;

wherein, when detached from the equipped vehicle and flying above the equipped vehicle and along and above the path of travel of the equipped vehicle, said aerial platform communicates image data captured by said at least one drone camera to said control disposed at the equipped vehicle; and

wherein at least one of (i) said image processor of said control, when said aerial platform is detached from the equipped vehicle and flying above the equipped vehicle, processes image data captured by said at least one drone camera to detect objects present in the field of view of said at least one drone camera, and (ii) a display in the equipped vehicle, when said aerial platform is detached from the equipped vehicle and flying above the equipped vehicle, displays video images derived from image data captured by said at least one drone camera for viewing by a driver of the equipped vehicle.

17. The vision system of claim 16, wherein said control controls said aerial platform to fly over a target region responsive to a user input of the equipped vehicle.

18. A vision system for a vehicle, said vision system comprising:

a plurality of vehicle cameras disposed at a vehicle equipped with said vision system, said vehicle cameras having respective fields of view exterior of the equipped vehicle;

a control disposed at the equipped vehicle, said control comprising an image processor operable to process image data captured by said vehicle cameras;

an aerial platform comprising at least one drone camera disposed thereat;

wherein said aerial platform is disposed at the equipped vehicle and is operable to detach from the equipped vehicle and to fly above the equipped vehicle, said at least one drone camera capturing image data representative of an area in the field of view of said at least one drone camera when said aerial platform is flying above the equipped vehicle;

wherein said aerial platform detaches from and flies above the equipped vehicle responsive to said control;

wherein, when detached from the equipped vehicle and flying above the equipped vehicle, said aerial platform communicates image data captured by said at least one drone camera to said control disposed at the equipped vehicle; and

wherein at least one of (i) said image processor of said control, when said aerial platform is detached from the equipped vehicle and flying above the equipped vehicle, processes image data captured by said at least one drone camera to detect objects present in the field of view of said at least one drone camera, wherein said control generates a communication to a driver of the equipped vehicle that is indicative of objects detected in the field of view of said at least one drone camera, and (ii) a display in the equipped vehicle, when said aerial platform is detached from the equipped vehicle and flying above the equipped vehicle, displays video images derived from image data captured by said at least one drone camera for viewing by a driver of the equipped vehicle.

19. The vision system of claim 18, wherein said control causes said aerial platform to detach from the equipped vehicle and fly above the equipped vehicle responsive to determination of an obstruction in the field of view of at least one of said vehicle cameras.

20. The vision system of claim 18, wherein said control, when said aerial platform is detached from the equipped vehicle and flying above the equipped vehicle, controls said aerial platform to direct the field of view of said at least one drone camera in a viewing direction of one of said vehicle cameras of the equipped vehicle responsive to the field of view of the one of said vehicle cameras of the equipped vehicle being obstructed.