IMAGE PROCESSING APPARATUS

• US 20140292805A1
• Filed: 03/24/2014
• Published: 10/02/2014
• Est. Priority Date: 03/29/2013
• Status: Active Grant

• Current Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Original Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Inventors: YAMADA, Masahiro, MORIYAMA, Shinichi, MORIMOTO, Ryuichi, MURASUMI, Miki
• Granted Patent: US 9,646,572 B2
• Time in Patent Office: Days
• US Class Current: 345/629
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2380/10 Automotive applications
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence

Abstract

An image processing apparatus determines a transparency percentage of each of plural portions of a cabin image of a vehicle, causes the plural portions to be semi-transparent or to be transparent at the determined transparency percentages and displays the cabin image. Thus, the user can intuitively understand a positional relationship between the vehicle and a surrounding region and does not miss an obstacle in a course of traveling of the vehicle.

Claims

1. An image processing apparatus configured to be used on a vehicle, the image processing apparatus comprising:

(a) an image processor configured to;

(i) generate a surrounding image showing a surrounding region of the vehicle viewed from a virtual viewpoint located in the vehicle, by using an image captured by a camera mounted on the vehicle;

(ii) obtain a vehicle image that is divided into plural portions showing the vehicle viewed from the virtual viewpoint;

(iii) generate a combined image by combining the surrounding image and the vehicle image having the plural portions; and

(iv) output the combined image for display on a display apparatus, and

(b) a controller configured to determine a transparency percentage of each of the plural portions of the vehicle image,

wherein the image processor causes the plural portions to be semi-transparent or to be transparent at the determined transparency percentages such that the combined image includes the surrounding image and the vehicle image having the plural portions caused to be semi-transparent or to be transparent at the determined transparency percentages.

2. The image processing apparatus according to claim 1, wherein

the plural portions overlap each other when the surrounding region is viewed from the virtual viewpoint.

3. The image processing apparatus according to claim 1, wherein

the plural portions include at least one of a tail lamp, a headlamp, a tire and a wheel housing.

4. The image processing apparatus according to claim 1, wherein

the virtual viewpoint is a viewpoint looking rearward of the vehicle from an inside of the vehicle, and

the plural portions include an outline showing a shape of the vehicle, a tail lamp and a tire.

5. The image processing apparatus according to claim 1, wherein

the image processor does not cause an outline showing a shape of the vehicle to be transparent.

6. The image processing apparatus according to claim 1, wherein

the image processor causes a portion higher than a predetermined height of the vehicle to be transparent, among the plural portions.

7. The image processing apparatus according to claim 1, wherein

the image processor causes the plural portions to be semi-transparent in a mesh pattern.

8. The image processing apparatus according to claim 1, wherein

the image processor gradually increases the determined transparency percentages of the plural portions.

9. The image processing apparatus according to claim 8, wherein

after gradually increasing the determined transparency percentages of the plural portions, the image processor gradually decreases the determined transparency percentages of the plural portions.

10. The image processing apparatus according to claim 1, wherein

the controller determines the transparency percentages based on a vehicle state of the vehicle.

11. The image processing apparatus according to claim 1, further comprising

a speed obtaining part that obtains a speed of the vehicle, wherein

the controller determines the transparency percentages based on the obtained speed of the vehicle.

12. The image processing apparatus according to claim 1, wherein

as a speed of the vehicle becomes higher, the controller increases the transparency percentage of a portion corresponding to a higher portion of the vehicle, among the plural portions.

13. The image processing apparatus according to claim 1, wherein

as a speed of the vehicle becomes lower, the controller increases the transparency percentage of a portion corresponding to a lower portion of the vehicle, among the plural portions.

14. The image processing apparatus according to claim 1, further comprising

a rotation direction sensor that senses an operated direction of a steering wheel included in the vehicle, wherein

the controller determines the transparency percentages based on a sensed rotated direction of the steering wheel.

15. The image processing apparatus according to claim 1, wherein

the controller determines the transparency percentages based on an operation status of a turn-signal of the vehicle.

16. The image processing apparatus according to claim 1, further comprising

an obstacle detector that detects a position of an object located adjacent to the vehicle, wherein

the controller determines the transparency percentages based on the detected position of the object.

17. The image processing apparatus according to claim 1, wherein

the controller determines the transparency percentage of each of the plural portions based on setting information set based on an operation made by a user.

18. The image processing apparatus according to claim 1, wherein

the image processor outputs a portion for which the transparency percentage is settable, among the plural portions, for display on the display apparatus, and wherein

the controller is configured to select the portion, displayed on the display apparatus, for which the transparency percentage is settable to determine the transparency percentage thereof, based on an operation made by the user for the portion.

20. An image processing system configured to be used in a vehicle, the image processing system comprising:

the image processing apparatus according to claim 1, and

the display apparatus that displays the combined image output by the image processing apparatus.

19. An image processing method that is used in a vehicle, the image processing method executed by an image processor and comprising the steps of

generating a surrounding image showing a surrounding region of the vehicle viewed from a virtual viewpoint located in the vehicle, by using an image captured by a camera mounted on the vehicle;

obtaining a vehicle image that shows the vehicle viewed from the virtual viewpoint;

dividing the vehicle image into plural portions, and causing the plural portions to be semi-transparent or to be transparent at determined transparency percentages for each of the plural portions;

generating a combined image by combining the surrounding image and the vehicle image having the plural portions caused to be semi-transparent or to be transparent; and

outputting the combined image for display on a display apparatus.