Image processing apparatus

• US 9,646,572 B2
• Filed: 03/24/2014
• Issued: 05/09/2017
• Est. Priority Date: 03/29/2013
• Status: Active Grant

• Current Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Original Assignee: Fujitsu Ten Limited (DENSO Corporation)
• Inventors: Yamada, Masahiro, Moriyama, Shinichi, Morimoto, Ryuichi, Murasumi, Miki
• Primary Examiner(s): Chauhan, Ulka
• Assistant Examiner(s): Yoon, Sae Won
• Application Number:
  US14/222,986
• Publication Number:
  US 20140292805A1
• Time in Patent Office: 1,142 Days
• Field of Search: 345592, 345629, 348118, 348135, 348148
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2380/10 Automotive applications
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence

Abstract

An image processing apparatus determines a transparency percentage of each of plural portions of a cabin image of a vehicle, causes the plural portions to be semi-transparent or to be transparent at the determined transparency percentages and displays the cabin image. Thus, the user can intuitively understand a positional relationship between the vehicle and a surrounding region and does not miss an obstacle in a course of traveling of the vehicle.

Claims

1. An image processing apparatus configured to be used on a vehicle, the image processing apparatus comprising:

(a) an image processor configured to;

(i) generate a surrounding image showing a surrounding region of the vehicle viewed from a virtual viewpoint located in the vehicle, by using an image captured by a camera mounted on the vehicle;

(ii) obtain a vehicle image that is divided into plural portions showing the vehicle viewed from the virtual viewpoint;

(iii) generate a combined image by combining the surrounding image and the vehicle image having the plural portions; and

(iv) output the combined image for display on a display apparatus, and

(b) a controller configured to determine a transparency percentage of each of the plural portions of the vehicle image,

wherein the image processor causes the plural portions to be semi-transparent or to be transparent at the determined transparency percentages such that the combined image includes the surrounding image and the vehicle image having the plural portions caused to be semi-transparent or to be transparent at the determined transparency percentages,

wherein the plural portions include parts that are of a cabin of the vehicle and are physically independent of one another,

wherein a list of the parts of which the transparency percentages are settable is displayed on a transparency percentage setting screen,

wherein a user enters an arbitrary transparency percentage for each of the parts to the transparency setting screen,

wherein the parts that are physically independent of each other are each individually selectable and the transparency percentage setting screen includes a list of the plural portions each individually selectable, and

wherein the controller is further configured to perform at least one of;

as a speed of the vehicle becomes higher, increasing the transparency percentage of a portion corresponding to a higher portion of the vehicle, among the plural portions and as a speed of the vehicle becomes lower, increasing the transparency percentage of a portion corresponding to a lower portion of the vehicle, among the plural portions.

2. The image processing apparatus according to claim 1, wherein

the plural portions overlap each other when the surrounding region is viewed from the virtual viewpoint.

3. The image processing apparatus according to claim 1, wherein

the plural portions include at least one of a tail lamp, a headlamp, a tire and a wheel housing.

4. The image processing apparatus according to claim 1, wherein

the virtual viewpoint is a viewpoint looking rearward of the vehicle from an inside of the vehicle, and

the plural portions include an outline showing a shape of the vehicle, a tail lamp and a tire.

5. The image processing apparatus according to claim 1, wherein

the image processor does not cause an outline showing a shape of the vehicle to be transparent.

6. The image processing apparatus according to claim 1, wherein

the image processor causes a portion higher than a predetermined height of the vehicle to be transparent, among the plural portions.

7. The image processing apparatus according to claim 1, wherein

the image processor causes the plural portions to be semi-transparent in a mesh pattern.

8. The image processing apparatus according to claim 1, wherein

the image processor gradually increases the determined transparency percentages of the plural portions.

9. The image processing apparatus according to claim 8, wherein

after gradually increasing the determined transparency percentages of the plural portions, the image processor gradually decreases the determined transparency percentages of the plural portions.

10. The image processing apparatus according to claim 1, wherein

the controller determines the transparency percentages based on a vehicle state of the vehicle.

11. The image processing apparatus according to claim 1, further comprising

a speed obtaining part that obtains the speed of the vehicle, wherein

the controller determines the transparency percentages based on the obtained speed of the vehicle.

12. The image processing apparatus according to claim 1, further comprising

a rotation direction sensor that senses an operated direction of a steering wheel included in the vehicle, wherein

the controller determines the transparency percentages based on a sensed rotated direction of the steering wheel.

13. The image processing apparatus according to claim 1, wherein

the controller determines the transparency percentages based on an operation status of a turn-signal of the vehicle.

14. The image processing apparatus according to claim 1, further comprising

an obstacle detector that detects a position of an object located adjacent to the vehicle, wherein

the controller determines the transparency percentages based on the detected position of the object.

16. An image processing system configured to be used in a vehicle, the image processing system comprising:

the image processing apparatus according to claim 1, and

the display apparatus that displays the combined image output by the image processing apparatus.

15. An image processing method that is used in a vehicle, the image processing method executed by an image processor and comprising the steps of:

generating a surrounding image showing a surrounding region of the vehicle viewed from a virtual viewpoint located in the vehicle, by using an image captured by a camera mounted on the vehicle;

obtaining a vehicle image that shows the vehicle viewed from the virtual viewpoint;

dividing the vehicle image into plural portions, and causing the plural portions to be semi-transparent or to be transparent at determined transparency percentages for each of the plural portions;

generating a combined image by combining the surrounding image and the vehicle image having the plural portions caused to be semi-transparent or to be transparent;

outputting the combined image for display on a display apparatus,

wherein the plural portions include parts that are of a cabin of the vehicle and are physically independent of one another;

displaying, on a transparency setting screen, a list of the parts of which the transparency percentages are settable,

wherein a user enters an arbitrary transparency percentage for each of the parts to the transparency setting screen,

wherein the parts that are physically independent of each other are each individually selectable, and the transparency percentage setting screen includes a list of the plural portions each individually selectable, and

performing, at least one of;

as a speed of the vehicle becomes higher, increasing the transparency percentage of a portion corresponding to a higher portion of the vehicle, among the plural portions and as a speed of the vehicle becomes lower, increasing the transparency percentage of a portion corresponding to a lower portion of the vehicle, among the plural portions.