Method and apparatus for the alignment of multi-aperture systems

• US 8,001,860 B1
• Filed: 02/02/2010
• Issued: 08/23/2011
• Est. Priority Date: 11/09/2004
• Status: Active Grant

• Current Assignee: Eagle Harbor Holdings, L.L.C., AutoBrilliance, LLC (Jeffrey M. Gross)
• Original Assignee: Eagle Harbor Holdings, L.L.C.
• Inventors: Preston, Dan, Olmstead, David
• Primary Examiner(s): Williams, Hezron
• Assistant Examiner(s): Bellamy, Tamiko D
• Application Number:
  US12/698,960
• Time in Patent Office: 567 Days
• Field of Search: 73/13.8, 734/321, 738/665, 356/399, 356/400, 356/614, 356/620, 356/623, 356/138, 356/139.03, 356/139.1, 356/140, 356/141.1, 356/141.2, 356/147, 356/3.01, 356/3.1, 356 313- 314, 250/330
• US Class Current: 73/866.5
• CPC Class Codes: B60W 2050/0013 Optimal controllers
• CPC Class Codes: B60W 2050/0085 Setting or resetting initial positions
• CPC Class Codes: B60W 40/107 Longitudinal acceleration
• CPC Class Codes: B60W 40/109 Lateral acceleration
• CPC Class Codes: B60W 40/11 Pitch movement
• CPC Class Codes: B60W 40/112 Roll movement
• CPC Class Codes: B60W 40/114 Yaw movement
• CPC Class Codes: B60W 50/045 Monitoring control system parameters
• CPC Class Codes: G01P 15/02 by making use of inertia forces using solid seismic massesG01P15/14 takes precedence

Abstract

A vehicle sensor system consisting of video, radar, ultrasonic or laser sensors, oriented to obtain a 360 degree view around the vehicle for the purpose of developing a situation or scene awareness. The sensors may or may not have overlapping field of views, or support the same applications, but data will be shared by all. Orientation of the sensor to the vehicle body coordinates is critical in order to accurately assess threat and respond. This system describes methods based on measuring force and rotation on each sensor and computing a dynamic alignment to first each other, then second to the vehicle.

Claims

1. A sensor alignment system for establishing and maintaining accurate alignment of optical sensors comprising:

multiple image sensors collocated on a common substrate and mounted on an automotive vehicle for gathering object data around the vehicle using optical information;

a first micro inertial sensor included with the sensors that measures at least one of rotation rate and acceleration along two or more axes of the sensors for the establishment of a sensor reference frame;

a second micro inertial sensor mounted on the vehicle that measures at least one of rotation rate and acceleration along two or more axes of the vehicle for the establishment of a vehicle reference frame; and

a processor determining an amount of misalignment of the sensor reference frame with the vehicle reference frame and aligning sensor target data with the vehicle reference frame according to the amount of misalignment.

2. The system according to claim 1 wherein the image sensors operate as a single sensor.

3. The system according to claim 1 wherein the image sensors collect at least one of raw image information or a complete image.

4. The system according to claim 1 wherein the second micro inertial sensor is also used for at least one of vehicle stability control or braking.

5. The system according to claim 1 wherein the first micro-inertial uses acceleration over time to estimate speed.

6. The system according to claim 1 wherein the accelerometer sense gravity and use the values measured to establish the vehicle reference frame.

7. The system according to claim 1 wherein the amount of misalignment includes a pre-determined value.

8. The system according to claim 1 wherein the multiple sensors have at least one of coincident or largely coincident fields of view.

9. The system according to claim 1 wherein the substrate is a supporting material on which a circuit is formed or fabricated.

10. The system according to claim 1 wherein the multiple sensors are image sensors.

11. The system according to claim 1 wherein the substrate is a supporting material on which multiple sensors are mounted.

12. The system according to claim 1 wherein the sensors are separate components that are bolted, glued or otherwise rigidly attached to the substrate.

13. The system according to claim 1 wherein the object data is used for detecting collision conditions.

14. The system according to claim 1 wherein the substrates are made from material resistant to dimensional changes due to temperature.

15. The system according to claim 1 wherein the sensors have a known physical relationship.

16. The system according to claim 1 wherein the multiple sensors are rigidly mounted to the substrates prior to the substrate being installed in the vehicle.

17. The system according to claim 1 wherein the sensors have an unknown physical relationship and require axis translation or rotation into a common reference frame.

18. The system according to claim 1 wherein the processor is collocated with the sensors and the first micro-inertial sensor.

19. The system according to claim 18 wherein the alignment of the sensor target data to the vehicle reference frame is done at the sensor.

20. The system according to claim 1 wherein the processor is located within a vehicle system processor, which includes the first micro-inertial sensor.

21. The system according to claim 20 wherein the alignment of the sensor target data to the vehicle reference frame is done within the vehicle system processor.

22. The system according to claim 1 wherein multiple sensors for gathering target data around the vehicle are mounted on the vehicle, each with micro-inertial sensors that are used to determine an amount of misalignment between the multiple sensors.

23. The system according to claim 22 wherein each sensor aligns itself to the vehicle reference frame in a distributed process.

24. The system according to claim 22 wherein each sensor is aligned to the vehicle reference frame in a vehicle system processor in a centralized process.

25. The system according to claim 22 wherein only one of the sensors aligns itself to the vehicle reference frame.

26. A multi-sensor system, comprising;

multiple sensors integrated onto a singular substrate forming a unitary multi-sensor platform that provides a known consistent physical relationship between the multiple sensors,

a micro inertial sensor included with the sensors that measures rotation rate and acceleration along two or more axes of the sensor for the establishment of a sensor reference frame;

a processor configured to;

determine an amount of misalignment of the sensor reference frame with a vehicle body reference frame;

aligning sensor target data with the vehicle body reference frame according to the amount of misalignment;

correlate data from the sensors to identify and track objects that may come within a certain vicinity of a vehicle.

27. A multi-sensor system according to claim 26 wherein the processor performs at least one of signal processing, communication or diagnostic tasks for at least two sensors on the substrate.

28. A multi-sensor system according to claim 26 wherein the measurements from the different sensors are translated to a common reference before the different data is correlated.

29. A multi-sensor system according to claim 26 wherein the sensors have a known physical relationship and do not require axis translation or rotation into a common reference frame.

30. A multi-sensor system according to claim 26 wherein the processor correlates data from the multiple sensors and converts the correlated data for detected objects into track files.

31. A multi-sensor system according to claim 26 wherein memory is integrated into the substrate to store sensor data, signal processing applications or other operating system functions.

32. A multi-sensor system according to claim 31 wherein the application is one of lane departure warning, collision avoidance, blind spot detection or adaptive cruise control.

33. A multi-sensor system according to claim 26 wherein one of the sensors is an image sensor and able to determine the angle of an element in the scene to within one-tenth of a degree.