Methods and systems for providing notifications on camera displays for vehicles

• US 10,268,907 B2
• Filed: 01/11/2017
• Issued: 04/23/2019
• Est. Priority Date: 01/11/2017
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Murad, Mohannad, Machak, Joseph, Wuergler, Michael A.
• Primary Examiner(s): Mikeska, Neil R
• Application Number:
  US15/403,810
• Publication Number:
  US 20180197023A1
• Time in Patent Office: 832 Days
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 2300/207 using multi-purpose displays, e.g. camera image and navigation or video on same display
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60Y 2400/92 Driver displays
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: H04N 23/10 for generating image signals from different wavelengths
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/634 Warning indications
• CPC Class Codes: H04N 5/265 Mixing
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

Methods and systems are provided for providing notifications on camera displays for vehicles. In accordance with one embodiment, camera is mounted on a body of the vehicle, and is configured to generate camera images. A processor is configured to at least facilitate generating a display image based on a processing of the camera images, for display on a display screen within the vehicle; determining a fixed region of the display image corresponding to a fixed part of the vehicle; and providing notifications on the display image in the fixed region of the display image.

Claims

1. A method comprising:

obtaining camera images for a camera that is mounted on a vehicle, each of the camera images including a plurality of frames, and each frame including a plurality of pixels;

generating, via a processor, a display image based on a processing of the camera images for display on a display screen within the vehicle;

analyzing corresponding pixels for each of the plurality of frames, in sequence, with respect a respective color and a respective brightness for each of the pixels for each of the frames, via the processor;

determining, via the processor, a fixed region of the display image corresponding to a fixed part of the vehicle, based on the analyzing of the corresponding pixels for each of the plurality of frames, wherein the fixed region is determined by the processor as being a region of the display image in which a rate of change in pixel color, pixel brightness, or both for pixels within the region across multiple frames in sequence is less than a predetermined threshold; and

providing notifications on the display image in the fixed region of the display image.

2. The method of claim 1, wherein:

the camera images show a region behind the vehicle;

the method further comprises detecting, via one or more sensors, the presence of one or more objects in proximity to the vehicle; and

the step of providing the notifications comprises providing, in the fixed region of the display image, notifications pertaining to the detected objects.

3. The method of claim 2, wherein:

the step of providing the notifications comprises providing, in the fixed region of the display image, notifications in a particular color based at least in part on a position of the object with respect to the vehicle.

4. The method of claim 2, wherein:

the method further comprises determining, using information provided by the one or more sensors, a direction of movement of the one or more objects in proximity to the vehicle; and

the step of providing the notifications comprises providing, in the fixed region of the display image, a notification corresponding to the determined direction of movement.

14. The method of claim 1, wherein the fixed region is determined by the processor as being a region of the display image in which a rate of change in pixel color for pixels within the region across multiple frames in sequence is less than the predetermined threshold.

15. The method of claim 1, wherein the fixed region is determined by the processor as being a region of the display image in which a rate of change in pixel brightness for pixels within the region across multiple frames in sequence is less than the predetermined threshold.

5. A system comprising:

a communication link configured to provide camera images for a camera that is mounted on a vehicle, each of the camera images including a plurality of frames, and each frame including a plurality of pixels; and

a processor configured to at least facilitate;

generating a display image based on a processing of the camera images, for display on a display screen within the vehicle;

analyzing corresponding pixels for each of the plurality of frames, in sequence, with respect a respective color and a respective brightness for each of the pixels for each of the frames;

determining a fixed region of the display image corresponding to a fixed part of the vehicle, based on the analyzing of the corresponding pixels for each of the plurality of frames, wherein the fixed region is determined as being a region of the display image in which a rate of change in pixel color, pixel brightness, or both for pixels within the region across multiple frames in sequence is less than a predetermined threshold; and

providing notifications on the display image in the fixed region of the display image.

6. The system of claim 5, wherein:

the camera images show a region behind the vehicle;

the system further comprises one or more sensors configured to detect the presence of one or more objects in proximity to the vehicle; and

the processor is configured to at least facilitate providing, in the fixed region of the display image, notifications pertaining to the detected objects.

7. The system of claim 6, wherein the processor is configured to at least facilitate providing, in the fixed region of the display image, notifications in a particular color based at least in part on a position of the object with respect to the vehicle.

8. The system of claim 6, wherein the processor is configured to at least facilitate providing, in the fixed region of the display image, a notification corresponding to the determined direction of movement.

16. The system of claim 5, wherein the processor is configured to determine the fixed processor as being a region of the display image in which a rate of change in pixel color for pixels within the region across multiple frames in sequence is less than the predetermined threshold.

17. The system of claim 5, wherein the processor is configured to determine the fixed processor as being a region of the display image in which a rate of change in pixel brightness for pixels within the region across multiple frames in sequence is less than the predetermined threshold.

9. A vehicle comprising:

a body;

a camera mounted on the body, the camera configured to generate camera images, each of the camera images including a plurality of frames, and each frame including a plurality of pixels; and

a processor configured to at least facilitate;

generating a display image based on a processing of the camera images, for display on a display screen within the vehicle;

analyzing corresponding pixels for each of the plurality of frames, in sequence, with respect a respective color and a respective brightness for each of the pixels for each of the frames;

determining a fixed region of the display image corresponding to a fixed part of the vehicle, based on the analyzing of the corresponding pixels for each of the plurality of frames, wherein the fixed region is determined by the processor as being a region of the display image in which a rate of change in pixel color, pixel brightness, or both for pixels within the region across multiple frames in sequence is less than a predetermined threshold; and

providing notifications on the display image in the fixed region of the display image.

10. The vehicle of claim 9, wherein:

the camera images show a region behind the vehicle;

the system further comprises one or more sensors configured to detect the presence of one or more objects in proximity to the vehicle; and

the processor is configured to at least facilitate providing, in the fixed region of the display image, notifications pertaining to the detected objects.

11. The vehicle of claim 10, wherein the processor is configured to at least facilitate providing, in the fixed region of the display image, notifications in a particular color based at least in part on a position of the object with respect to the vehicle.

12. The vehicle of claim 10, wherein the processor is configured to at least facilitate providing, in the fixed region of the display image, a notification corresponding to the determined direction of movement.

13. The vehicle of claim 9, further comprising:

a communication link configured to provide the camera images from the camera to the processor; and

a display screen configured to provide the display image, including the notifications on the fixed region thereof, based on instructions provided by the processor.

18. The vehicle of claim 9, wherein the processor is configured to determine the fixed processor as being a region of the display image in which a rate of change in pixel color for pixels within the region across multiple frames in sequence is less than the predetermined threshold.

19. The vehicle of claim 9, wherein the processor is configured to determine the fixed processor as being a region of the display image in which a rate of change in pixel brightness for pixels within the region across multiple frames in sequence is less than the predetermined threshold.

20. The vehicle of claim 9, wherein the processor is configured to determine the fixed processor as being a region of the display image in which both:

a rate of change in pixel color for pixels within the region across multiple frames in sequence is less than a first predetermined threshold; and

a rate of change in pixel brightness for pixels within the region across multiple frames in sequence is less than a second predetermined threshold.