DIAGNOSIS APPARATUS AND DIAGNOSIS METHOD

• US 20120307059A1
• Filed: 05/25/2012
• Published: 12/06/2012
• Est. Priority Date: 11/30/2009
• Status: Abandoned Application

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Hamaguchi, Shingo, Ozaki, Kazuyuki, YAMAKAGE, Yuzuru
• Application Number:
  US13/481,146
• Publication Number:
  US 20120307059A1
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60W 40/09 Driving style or behaviour
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes

Abstract

A diagnosis apparatus includes an object extraction unit to extract one or more objects around a vehicle, a line-of-vision determination unit to determine whether or not at least one region of the object is included in a line-of-vision space centered around a line of vision of a driver of the vehicle, and a degree-of-recognition diagnosis unit to diagnose the driver'"'"'s degree of recognition of the object in accordance with the determination result.

Claims

1. A diagnosis apparatus comprising:

an object extraction unit configured to extract one or more objects around a vehicle;

a line-of-vision determination unit configured to determine whether or not at least one region of the object is included in a line-of-vision space centered around a line of vision of a driver of the vehicle; and

a degree-of-recognition diagnosis unit configured to diagnose the driver'"'"'s degree of recognition of the object in accordance with the determination result.

2. The diagnosis apparatus according to claim 1, wherein

the line-of-vision determination unit determines a positional relationship between the line-of-vision space and the object, and

the degree-of-recognition diagnosis unit diagnoses the degree of recognition in accordance with the positional relationship between the line-of-vision space and the object.

3. The diagnosis apparatus according to claim 2, wherein

the line-of-vision determination unit determines whether or not the at least one region of the object is included in the line-of-vision space in accordance with an angle formed by a line-of-vision vector indicating a direction of a line of vision of the driver and an object vector from the driver toward the object.

4. The diagnosis apparatus according to claim 1, wherein

the line-of-vision determination unit further calculates a viewing time during which the at least one region of the object is included in the line-of-vision space for each object, and

the degree-of-recognition diagnosis unit diagnoses the degree of recognition of each object in accordance with the viewing time.

5. The diagnosis apparatus according to claim 1, wherein

the line-of-vision determination unit further calculates a non-viewing time during which each object is located outside the line-of-vision space, and

the degree-of-recognition diagnosis unit diagnoses the degree of recognition of each object in accordance with the non-viewing time.

6. The diagnosis apparatus according to claim 5, wherein

the degree-of-recognition diagnosis unit diagnoses the degree of recognition of each object in accordance with whether or not the non-viewing time is shorter than a TTC (Time to collision) which is a time that elapses before a collision occurs between the vehicle and each object.

7. The diagnosis apparatus according to claim 1, wherein

the degree of recognition diagnosis unit diagnoses the driver'"'"'s degree of recognition in accordance with a ratio between the number of objects around the vehicle and the number of objects judged by the line-of-vision determination unit to be included in the line-of-vision space from among the objects around the vehicle.

8. The diagnosis apparatus according to claim 1, wherein

when the line-of-vision determination unit determines that one or more mirrors equipped on the vehicle are along an extension of the line of vision of the driver, the line-of-vision determination unit corrects a direction of the line of vision in accordance with the one or more mirrors and determines whether or not at least one region of the object is included in a line-of-vision space centered around the corrected line of vision.

9. The diagnosis apparatus according to claim 1, further comprising

a diagnosis result output unit configured to output information on an object corresponding to the degree of recognition diagnosed by the degree-of-recognition diagnosis unit which is less than or equal to a predetermined value.

10. The diagnosis apparatus according to claim 9, further comprising:

a relative information calculation unit configured to calculate relative information for each object, the relative information including a relative speed and/or relative distance relative to the vehicle; and

a degree-of-risk calculation unit configured to calculate a degree of risk of a collision between the vehicle and each object in accordance with the relative information, wherein

the diagnosis result output unit outputs the degree of risk of a collision with the object corresponding to the degree of recognition which is less than or equal to the predetermined value.

11. The diagnosis apparatus according to claim 1, further comprising:

a relative information calculation unit configured to calculate relative information for each object, the relative information including a relative speed and/or relative distance relative to the vehicle; and

a degree-of-risk calculation unit configured to calculate a degree of risk of a collision between the vehicle and each object in accordance with the relative information, wherein

the line-of-vision determination unit determines whether or not at least one region of a hazardous object is included in the line-of-vision space, and the hazardous object is an object included in the objects and corresponding to the degree of risk of a collision with the vehicle which is equal to a predetermined threshold or greater, and

the degree-of-recognition diagnosis unit diagnoses the driver'"'"'s degree of recognition of the hazardous object in accordance with the determination result.

12. A diagnosis method executed by a diagnosis apparatus, the method comprising:

extracting one or more objects around a vehicle;

determining whether or not at least one region of the object is included in a line-of-vision space centered around a line of vision of a driver of the vehicle; and

diagnosing the driver'"'"'s degree of recognition of the object in accordance with the determination result.

13. A diagnosis apparatus comprising:

a proximate area information obtainment unit configured to obtain proximate area information including information on one or more objects around a vehicle;

an object extraction unit configured to extract the one or more objects from the proximate area information;

a line-of-vision detection unit configured to detect a line of vision of a driver of the vehicle;

a line-of-vision determination unit configured to determine whether or not at least one region of the object is included in a line-of-vision space centered around the line of vision of the driver of the vehicle; and

a degree-of-recognition diagnosis unit configured to diagnose the driver'"'"'s degree of recognition of the object in accordance with the determination result.

14. The diagnosis apparatus according to claim 13, wherein

the proximate area information obtainment unit includes one or more image pickup apparatuses which pick up an image of an area around the vehicle, and further includes image processing unit configured to generate a proximate area image of the region around the vehicle from the image picked up by the image pickup apparatus, and

the object extraction unit extracts the one or more objects from the proximate area image.

15. The diagnosis apparatus according to claim 13, wherein

the object extraction unit obtains a sensing result from an object sensor which senses one or more objects around the vehicle, and extracts the one or more objects in accordance with the sensing result.

16. The diagnosis apparatus according to claim 13, wherein

the object extraction unit obtains object information transmitted from one or more objects around the vehicle and including a position, speed, acceleration, and/or traveling direction of the one or more objects, and extracts the one or more objects in accordance with the object information.