Driver assistance system, driver assistance method and information storage medium

• US 9,230,179 B2
• Filed: 01/28/2014
• Issued: 01/05/2016
• Est. Priority Date: 02/19/2013
• Status: Expired due to Fees

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: Omino, Takayuki
• Primary Examiner(s): Chang, Jon
• Application Number:
  US14/165,825
• Publication Number:
  US 20140233795A1
• Time in Patent Office: 707 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes

Abstract

A driver assistance system includes a mobile terminal provided on an automobile, and a detection server capable of communicating with the mobile terminal. The mobile terminal includes an image capture apparatus which captures images around the automobile, and an image transmission unit which transmits the captured image to the detection server. The detection server includes an image filter which carries out a working process for the image, and a detection engine which receives the image after the working process by the image filter as an input thereto and detects whether or not the image includes an object. If it is decided that the image includes an object, the detection server transmits the result of the decision to the mobile terminal.

Claims

1. A driver assistance system, comprising:

a mobile terminal provided on an automobile; and

a detection server capable of communicating with the mobile terminal;

the mobile terminal including;

an image capture apparatus configured to capture an image around the automobile; and

an image transmission unit configured to transmit the captured image to the detection server;

the detection server including;

an image filter configured to carry out a working process for the image; and

a detection engine configured to receive the image inputted thereto after the working process by the image filter and detect whether or not the image includes an object;

the detection server transmitting, when it is detected that the image includes an object, the result of the decision to the mobile terminal,

wherein the image filter includes a rain removing unit configured to remove a region in which rain is pictured from within the image inputted thereto.

2. The driver assistance system according to claim 1,

wherein the detection server further includes a storage apparatus in which a plurality of images are stored in advance, and

the detection engine extracts, from among the plurality of images stored in the storage apparatus, an image similar to the image transmitted thereto from the mobile terminal and detects whether or not the extracted image includes an object.

3. The driver assistance system according to claim 2,

wherein the image filter includes a super-resolution unit which superimposes the plurality of images inputted thereto to produce an image of a high resolution.

4. The driver assistance system according to claim 2,

wherein the mobile terminal further includes an alarm unit which issues a warning to a driver of the vehicle when a result of decision that the image includes an object is received.

5. The driver assistance system according to claim 2,

wherein, when the mobile terminal receives a result of decision that the image includes an object, the mobile terminal carries out control for causing the vehicle to evade the object.

6. The driver assistance system according to claim 1,

wherein the image filter includes a super-resolution unit which superimposes the plurality of images inputted thereto to produce an image of a high resolution.

7. The driver assistance system according to claim 6,

wherein the mobile terminal further includes an alarm unit which issues a warning to a driver of the vehicle when a result of decision that the image includes an object is received.

8. The driver assistance system according to claim 6,

wherein, when the mobile terminal receives a result of decision that the image includes an object, the mobile terminal carries out control for causing the vehicle to evade the object.

9. The driver assistance system according to claim 1,

wherein the mobile terminal further includes an alarm unit which issues a warning to a driver of the vehicle when a result of decision that the image includes an object is received.

10. The driver assistance system according to claim 9,

wherein, when the mobile terminal receives a result of decision that the image includes an object, the mobile terminal carries out control for causing the vehicle to evade the object.

11. The driver assistance system according to claim 1,

wherein, when the mobile terminal receives a result of decision that the image includes an object, the mobile terminal carries out control for causing the vehicle to evade the object.

12. A driver assistance method, comprising:

transmitting an image around an automobile, the image captured by a mobile terminal provided on the automobile, to a detection server which is capable of communicating with the mobile terminal;

carrying out a working process for the image by the detection server;

detecting whether or not the image after the working process includes an object by the detection server;

transmitting, when it is decided that the image includes an object, the result of the decision to the mobile terminal by the detection server; and

removing a region in which rain is pictured from within the image inputted thereto by the detection server.

13. The driver assistance method according to claim 12,

wherein the detection server stores a plurality of images therein in advance, and extracts, from among the plurality of stored images, an image similar to the image transmitted from the mobile terminal, and detects whether or not the extracted image includes an object.

14. A non-transitory computer-readable information storage medium storing a driver assistance program that, when executed by an information processing device, causes execution of a method comprising:

inputting an image around an automobile, the image captured by an image capture apparatus provided in a mobile terminal provided on the automobile, and carrying out a working process for the image;

inputting the image after the working process and detecting whether or not the image includes an object;

transmitting, when it is decided that the image includes an object, the result of the decision to the mobile terminal; and

removing a region in which rain is pictured from within the image inputted thereto.

15. The non-transitory computer-readable information storage medium according to claim 14 storing the driver assistance program that, when executed by the information processing device, causes the execution of the method further comprising:

storing a plurality of images in advance; and

extracting, from among the plurality of stored images, an image similar to the image transmitted from the mobile terminal and detecting whether or not the extracted image includes an object.