Method and apparatus for enhancing top view image

• US 10,282,074 B2
• Filed: 03/10/2017
• Issued: 05/07/2019
• Est. Priority Date: 03/10/2017
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Murad, Mohannad, Abdel-Rahman, Akram, Khaligh, Sepehr Pourrezaei
• Primary Examiner(s): Wu, Chong
• Application Number:
  US15/455,371
• Publication Number:
  US 20180260103A1
• Time in Patent Office: 788 Days
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 3/00 Geometric image transformations in the plane of the image
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting

Abstract

A method and apparatus for enhancing a top view image of a vehicle are provided. The method includes determining a trajectory of a vehicle or a trailer; and performing at least one from among zooming the top view image of the vehicle or trailer and panning the top view image, based on the determined trajectory. The method and apparatus may provide a better view of the surroundings of a vehicle in order to better navigate the vehicle, including the case where a trailer is hitched to the vehicle.

Claims

1. A method for enhancing a top view image of a vehicle or trailer, the method comprising:

receiving a plurality of images from a plurality of cameras disposed on the vehicle;

transforming and stitching the plurality of images to form the top view image showing a predetermined area around the vehicle or a trailer;

displaying the top view image;

determining a trajectory of the vehicle or the trailer; and

performing at least one from among;

zooming the top view image of the vehicle or trailer based on the determined trajectory and based on whether the trailer is hitched to the vehicle; and

panning the top view image based on the determined trajectory and based on whether the trailer is hitched to the vehicle,

wherein the panning the top view image comprises panning the image to the right in response to the determined trajectory of the vehicle or trailer being a rightward trajectory and panning the image to the left in response to the determined trajectory of the vehicle or trailer being a leftward trajectory.

2. The method of claim 1, wherein the determining the trajectory of the vehicle or the trailer is performed based on at least one from among a steering angle of the vehicle, a wheel angle of the vehicle, a trailer hitch angle a heading of the vehicle, a speed of the vehicle, and a path of the vehicle.

3. The method of claim 2, further comprising determining whether a trailer is hitched to the vehicle.

4. The method of claim 3, wherein the zooming the top view image comprises zooming out of the top view image in response to the trailer being hitched to the vehicle and zooming into the top view image in response to the trailer being unhitched from the vehicle.

5. The method of claim 4, wherein the panning the image comprises panning the image to the right for a distance determined based on the rightward trajectory and panning the image to the left for a distance determined based on the leftward trajectory.

6. The method of claim 3, wherein the determining whether the trailer is hitched to the vehicle comprises detecting a connection to the trailer or receiving a user input indicating that the trailer is hitched to the vehicle.

7. The method of claim 1, wherein the zooming the top view image comprises zooming into or zooming out of the top view image in response to a user selection of an icon on the top view image.

8. An apparatus for enhancing a top view image of a vehicle or trailer, the apparatus comprising:

at least one memory comprising computer executable instructions; and

at least one processor configured to read and execute the computer executable instructions, the computer executable instructions causing the at least one processor to;

receive a plurality of images from a plurality of cameras disposed on the vehicle;

transform the plurality of images to form the top view image of the vehicle;

display the top view image of the vehicle;

determine a trajectory of the vehicle; and

perform at least one from among;

zooming into the top view image of the vehicle or trailer based on the determined trajectory and based on whether the trailer is hitched to the vehicle; and

panning the top view image based on the determined trajectory and based on whether the trailer is hitched to the vehicle,

wherein the computer executable instructions further cause the at least one processor to pan the top view image by panning the image to the right in response to the determined trajectory of the vehicle being a rightward trajectory and panning the image to the left in response to the determined trajectory of the vehicle being a leftward trajectory.

9. The apparatus of claim 8, wherein the computer executable instructions cause the at least one processor to determine the trajectory of the vehicle or the trailer based on at least one from among a steering angle of the vehicle, a wheel angle of the vehicle, a trailer hitch angle a heading of the vehicle, a speed of the vehicle, and a path of the vehicle.

10. The apparatus of claim 9, wherein the computer executable instructions cause the at least one processor to determine whether a trailer is hitched to the vehicle.

11. The apparatus of claim 10, wherein the computer executable instructions cause the at least one processor to zoom the top view image by zooming out of the top view image in response to the trailer being hitched to the vehicle and zooming into the top view image in response to the trailer being unhitched from the vehicle.

12. The apparatus of claim 11, wherein the computer executable instructions further cause the at least one processor to pan the image by panning the image to the right for a distance determined based on the rightward trajectory and panning the image to the left for a distance determined based on the leftward trajectory.

13. The apparatus of claim 8, wherein the computer executable instructions further cause the at least one processor to determine whether the trailer is hitched to the vehicle by detecting a connection to the trailer or receiving a user input indicating that the trailer is hitched to the vehicle, and

wherein the computer executable instructions further cause the at least one processor to zoom the top view image by zooming into or zooming out of the top view image in response to a user selection of an icon on the top view image.

14. The apparatus of claim 8, further comprising the plurality of cameras disposed on a vehicle.

15. The apparatus of claim 8, further comprising a display configured to display the top view image of the vehicle.