DYNAMIC REARVIEW MIRROR DISPLAY FEATURES

• US 20140114534A1
• Filed: 03/15/2013
• Published: 04/24/2014
• Est. Priority Date: 10/19/2012
• Status: Abandoned Application

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Zhang, Wende, Wang, Jinsong, Lybecker, Kent S., Piasecki, Jeffrey S., Clem, James, Green, Charles A., Frakes, Ryan M., Hester, Travis S.
• Application Number:
  US13/835,741
• Publication Number:
  US 20140114534A1
• Time in Patent Office: Days
• US Class Current: 701/42
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/02 Rear-view mirror arrangements periscope arrangements B60R1/10
• CPC Class Codes: B60R 1/24 in front of the vehicle
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation

Abstract

A method for displaying a captured image on a display device. A scene is captured by at least one vision-based imaging device. A virtual image of the captured scene is generated by a processor using a camera model. A view synthesis technique is applied to the captured image by the processor for generating a de-warped virtual image. A dynamic rearview mirror display mode is actuated for enabling a viewing mode of the de-warped image on the rearview mirror display device. The de-warped image is displayed in the enabled viewing mode on the rearview mirror display device.

Claims

1. A method for displaying a captured image on a display device comprising the steps of:

capturing a scene by an at least one vision-based imaging device;

generating a virtual image of the captured scene by a processor using a camera model;

applying a view synthesis technique to the captured image by the processor for generating a de-warped virtual image;

actuating a dynamic rearview mirror display mode for enabling a viewing mode of the de-warped image on the rearview mirror display device; and

displaying the de-warped image in the enabled viewing mode on the rearview mirror display device.

2. The method of claim 1 wherein multiple images are captured by a plurality of image capture devices that include different viewing zones exterior of the vehicle, the multiple images having overlapping boundaries for generating a panoramic view of an exterior scene of the vehicle, wherein the method further comprises the steps of:

prior to camera modeling, applying image stitching to each of the multiple images captured by the plurality of the image capture devices, the image stitching combining the multiple images within for generating a seamless transition between the overlapping regions of the multiple images.

3. The method of claim 2 wherein the image stitching includes clipping and shifting of the overlapping regions of the respective image for generating the seamless transition.

4. The method of claim 2 wherein image stitching includes identifying corresponding points pair sets in the overlapping region between two respective images and registering the corresponding point pairs for stitching the two respective images.

5. The method of claim 2 wherein image stitching includes a stereo vision processing technique applied to find correspondence in the overlapping region between two respective images.

6. The method of claim 2 wherein the plurality of image capture devices include three narrow field-of-view image capture devices each capturing a different respective field-of-view scene, wherein each set of adjacent field-of-views scenes includes overlapping scene content, and wherein image stitching is applied to the overlapping scene content of each set of adjacent field-of-view scenes.

7. The method of claim 6 wherein the imaging stitching applied to the three narrow field-of-views generates a panoramic scene of approximately 180 degrees.

8. The method of claim 6 wherein each of the plurality of image capture devices are rear facing image capture devices.

9. The method of claim 6 wherein each of the plurality of image capture devices are forward facing image capture devices.

10. The method of claim 6 wherein vehicle information relating to vehicle operating conditions are communicated to a camera switch for selectively enabling and disabling image capture devices based on the vehicle operating conditions.

11. The method of claim 6 wherein image capture devices are enabled and disabled based on a driver selectively enabling or disabling a respective image capture device.

12. The method of claim 2 wherein the plurality of image capture devices includes a narrow field-of-view image capture device and a wide field-of-view image capture device, the narrow field-of-view image capture device capturing a narrow field-of-view scene, the wide field-of-view image capture device capturing a wide field-of-view scene of substantially 180 degrees, wherein the narrow field-of-view captured scene is a subset of the wide field-of-view captured scene for enhancing an overlapping field-of-view, wherein correspondence point pairs sets at overlap region of the narrow field-of-view scene and associated wide field-of-view scene are identified for registering point pair used to image stitch the narrow field-of-view scene and the wide field-of-view scene.

13. The method of claim 2 wherein the plurality of image capture devices includes a plurality of vehicle surround facing image capture devices disposed on different sides of the vehicle, wherein the plurality of surround facing capture image devices include a forward facing camera for capturing images forward of the vehicle, a rearward facing camera for capturing images rearward of the vehicle, right side facing camera for capturing images on a right side of the vehicle, and a left side facing camera for capturing images on a left side of the vehicle, wherein a respective image is displayed on the rearview mirror display device.

14. The method of claim 13 wherein image capture devices are selectively enabled and disabled based on communicating vehicle information relating to vehicle operating conditions to a camera switch.

15. The method of claim 14 wherein a visual icon is actuated representing a current view being captured by the enabled image capture device.

16. The method of claim 13 wherein image capture devices are enabled and disabled based on a driver selectively enabling or disabling a respective image capture device.

17. The method of claim 1 wherein enabling a viewing mode is selected from one of a mirror display mode, a mirror display on with image overlay mode, and mirror display on without image overlay mode, wherein the mirror display mode projects no image on the rearview display mirror, wherein the mirror display on with image overlay mode projects the generated de-warped image and an image overlay replicating interior components of the vehicle, and wherein the mirror display without image overlay mode displays only the generated de-warped image.

18. The method of claim 17 wherein selecting the mirror display on with image overlay mode for generating an image overlay replicating interior component of the vehicle includes replicating at least one of a head rest, rear window trim, and c-pillars in the rearview mirror display device.

19. The method of claim 17 wherein a rearview mirror mode button is actuated by a driver for selecting one of the respective captured images for display on the rearview mirror display device.

20. The method of claim 17 wherein a rearview mirror mode button is actuated by at least one of mirror display mode only at high speed, a mirror display on with image overlay mode at low speed or in parking, a mirror display on with image overlay mode in parking, a speed adjusted ellipse zooming factor, a turn signal activated respective view display mode.

21. The method of claim 17 wherein image capture devices and viewing mode are selectively enabled and disabled based on communicating vehicle information relating to vehicle operating conditions to a camera switch.

22. The method of claim 21 wherein the vehicle information is obtained from one of a plurality devices that include steering wheel angle sensors, turn signals, yaw sensors, and speed sensors.

23. The method of claim 21 wherein the vehicle information is used to change a camera pose of the camera model relative to the pose of the vision-based imaging device.

24. The method of claim 1 wherein the view synthesis technique for generating the virtual image is enabled based on a driving scenario of a vehicle operation, wherein the dynamic view synthesis generates a direction zoom to a region of the image for enhancing visual awareness to a driver for the respective region.

25. The method of claim 24 wherein the driving scenario of a vehicle operation for enabling the dynamic view synthesis includes determining whether the vehicle is driving in a parking lot.

26. The method of claim 24 wherein the driving scenario of a vehicle operation for enabling the dynamic view synthesis includes determining whether the vehicle is driving in on highway.

27. The method of claim 24 wherein the driving scenario of a vehicle operation for enabling the dynamic view synthesis includes actuating a turn signal.

28. The method of claim 24 wherein the driving scenario of a vehicle operation for enabling the dynamic view synthesis is based on a steering wheel angle.

29. The method of claim 24 wherein the driving scenario of a vehicle operation for enabling the dynamic view synthesis is based on a speed of the vehicle.