Rear-view mirror simulation

• US 10,562,452 B2
• Filed: 09/22/2017
• Issued: 02/18/2020
• Est. Priority Date: 04/19/2010
• Status: Active Grant

• Current Assignee: SMR Patents Sarl (SMR Patents)
• Original Assignee: SMR Patents Sarl (SMR Patents)
• Inventors: Herrmann, Andreas, Schwalb, Martin, Linsenmaier, Frank, Eder, Oliver, Rotzer, Ilka, Jochmann, Thomas
• Primary Examiner(s): Rao, Anand S
• Assistant Examiner(s): Edwards, Tyler B
• Application Number:
  US15/712,486
• Publication Number:
  US 20180194285A1
• Time in Patent Office: 879 Days
• Field of Search: None
• CPC Class Codes: B60Q 1/2665 on rear-view mirrors lighting devices for vehicle interior on or for rear-view mirrors B60Q3/258
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2011/004 outside the vehicle
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/207 using multi-purpose displays, e.g. camera image and navigation or video on same display
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60R 2300/307 virtually distinguishing relevant parts of a scene from the background of the scene
• CPC Class Codes: B60R 2300/8046 for replacing a rear-view mirror system
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 3/047 Fisheye or wide-angle transformations
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: G06V 10/44 Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
• CPC Class Codes: G06V 10/76 based on eigen-space representations, e.g. from pose or different illumination conditions; Shape manifolds
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G08G 1/0104 : Measuring and analyzing of parameters relative to traffic conditions
• CPC Class Codes: G08G 1/0175 : by photographing vehicles, e.g. when violating traffic rules
• CPC Class Codes: G08G 1/166 : for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 : Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 23/698 : for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 25/61 : the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
• CPC Class Codes: H04N 25/615 : involving a transfer function modelling the optical system, e.g. optical transfer function [OTF], phase transfer function [PhTF] or modulation transfer function [MTF]

Abstract

A method displays information graphically on an image captured by an optical system used to simulate a rear-view mirror system of a vehicle. The method includes capturing the image and identifying an object in the image. The method the assigns a priority level to the object based on a predetermined criterion. The object is altered based on its priority level to create an altered object. An altered object may have a changed color, a colored halo surrounding it, or a colored object inside it. Other possible ways to alter the way the object looks are possible. The altered object is displayed in the image in place of the object to alert a vehicle operator of its presence and the priority level associated therewith.

Claims

1. A method for displaying information graphically on an image captured by an optical system used to simulate a rear-view mirror system of a vehicle, the method comprising the steps of:

capturing the image;

identifying an object in the image;

defining an entire outer periphery of the object;

assigning a priority level to the object based on a predetermined criterion;

altering the object based on its priority level to create an altered object by creating a halo disposed outside and adjacent the entire outer periphery such that the halo has a shape similar to the outer periphery of the object; and

displaying the altered object in the image in place of the object to alert a vehicle operator of its presence and the priority level associated therewith.

2. A method as set forth in claim 1 including the step of changing the priority level as conditions between the object and the vehicle change.

3. A method as set forth in claim 2 including the step of updating the halo around the object due to changes in the priority level.

4. A method as set forth in claim 3 wherein the step of updating the halo includes changing one or more characteristic parameter of the halo, each characteristic parameter being selected from a group including color, brightness, thickness, transparency, contrast and position of the halo.

5. A method as set forth in claim 3 wherein the step of updating the halo includes periodically switching the halo on and off to represent a pulsating halo.

6. A method as set forth in claim 1 including the step of reverting the altered object back to the object when the priority level of the object is reduced below a predetermined level.

7. A method as set forth in claim 1 wherein the step of identifying the object in the image includes the step of characterizing the object as animate or inanimate prior to the step of creating the altered object.

8. A method as set forth in claim 1 wherein the step of identifying the object in the image includes the step of characterizing the object as another road user prior to the step of creating the altered object.

9. A method as set forth in claim 8 wherein the other road user is selected from a group comprising a motor vehicle, a bicycle, a pedestrian and an animal prior to the step of creating the altered object.

10. A method as set forth in claim 8 wherein the other road user is selected from a group comprising a car, a bus, a truck, a caravan, a police car, an ambulance vehicle prior to the step of creating the altered object.

11. A method as set forth in claim 7 or 8, wherein the object is altered to create the altered object based upon the characterization of the object.

12. A method as set forth in claim 1 wherein the step of altering the object to create the altered object includes the step of coloring at least a portion of the object.

13. A method as set forth in claim 1 wherein the step of assigning a priority level to the object based on a predetermined criterion includes the step of assigning one of a plurality of priority levels to the object based on a set of predetermined criteria.

14. A method as set forth in claim 13 wherein each of the plurality of priority levels relates to a separate degree of alert.

15. A method as set forth in claim 14 including the step of changing the altered object based on a set of external conditions wherein the set of external conditions are selected from a group consisting of ambient light, types of ambient light, temperature, precipitation and road conditions.

16. A method as set forth in claim 14 wherein the set of predetermined criteria are selected from a group consisting of relative distance, relative velocity, and relative acceleration between the vehicle and the object.

17. A method as set forth in claim 1 wherein the step of altering the object includes the step of transforming pixels defining an area immediately adjacent the object to create the halo.