Driver management apparatus and travel management system

• US 8,164,463 B2
• Filed: 01/30/2008
• Issued: 04/24/2012
• Est. Priority Date: 02/01/2007
• Status: Active Grant

• Current Assignee: DENSO Corporation
• Original Assignee: DENSO Corporation
• Inventors: Omi, Takuhiro
• Primary Examiner(s): Tweel, Jr., John A
• Application Number:
  US12/449,027
• Publication Number:
  US 20100090839A1
• Time in Patent Office: 1,546 Days
• Field of Search: 340/575, 340/576, 340/439, 180/272, 382/118, 701/29, 701/28, 701/35, 702/182, 702/183, 702/188, 702/189
• US Class Current: 340/575
• CPC Class Codes: B60K 28/04 responsive to presence or absence of the driver, e.g. to weight or lack thereof
• CPC Class Codes: B60W 40/08 related to drivers or passengers
• CPC Class Codes: B60W 50/16 Tactile feedback to the driver, e.g. vibration or force feedback to the driver on the steering wheel or the accelerator pedal
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation

Abstract

In a driver management apparatus for managing the driver of a vehicle, a state estimating means estimates a state of the driver based on the sensing information from a sensing means Based on an estimation result, an extracting means extracts, as a capture region, part of the sensing information. The capture information storing means extracts the sensing information associated with the extracted capture region and stores the extracted sensing information as capture information. The determining means determines whether the estimation result satisfies a reporting condition. When it is determined that the estimation result satisfies the reporting condition, the controlling means retrieves the capture information associated with the estimation result and causes the retrieved capture information to be transmitted with the estimation result to the external center.

Claims

1. A driver management apparatus for managing a driver of a vehicle, the apparatus being capable of exchanging various data sets with an external center, the apparatus comprising:

a sensing means for sensing the driver;

a sensing information storing means for temporarily storing the sensing information that is a result of the sensing of the driver provided by the sensing means;

a state estimating means for estimating a state of the driver based on the sensing information;

an extracting means for extracting, as a capture region, part of the sensing information, which is stored by the sensing information storing means, based on an estimation result provided by the state estimating means;

a capture information storing means for extracting the sensing information, which is associated with the capture region extracted by the extracting means, from the sensing information storing means, and for storing the extracted sensing information as capture information;

a determining means for determining whether the estimation result provided by the state estimating means satisfies a reporting condition for determining that the external center is to be informed of the estimation result; and

a controlling means for retrieving the capture information, which is associated with the estimation result, from the capture information storing means, and for causing the retrieved capture information to be transmitted with the estimation result to the external center when the determining means determines that the estimation result satisfies the reporting condition.

2. The driver management apparatus according to claim 1, wherein the controlling means causes the estimation result and the capture information to be transmitted with additional information to the external center.

3. The driver management apparatus according to claim 2, wherein:

the controlling means is capable of acquiring vehicle information related to the vehicle; and

the controlling means causes the estimation result and the capture information to be transmitted with the acquired vehicle information, which serves as the additional information, to the external center.

4. The driver management apparatus according to claim 2, wherein:

the controlling means is capable of acquiring operation information indicating operation of the driver; and

the controlling means causes the estimation result and the capture information to be transmitted with the acquired operation information, which serves as the additional information, to the external center.

5. The driver management apparatus according to claim 2, wherein:

the controlling means is capable of acquiring vehicle environment information related to a situation of an environment of the vehicle; and

the controlling means causes the estimation result and the capture information to be transmitted with the acquired environment information, which serves as the additional information, to the external center.

6. The driver management apparatus according to claim 1, wherein the sensing means acquires bioinformation of the driver and senses the driver based on the acquired bioinformation.

7. The driver management apparatus according to claim 1, wherein the sensing means acquires an image of a face of the driver and senses the driver based on the acquired image.

8. The driver management apparatus according to claim 7, wherein the sensing means acquires the face image of the driver as a dynamic image or a series of a plurality of static images.

9. The driver management apparatus according to claim 1, wherein the capture region is a region, in which a phenomenon having great influence on estimating the state of the driver exists.

10. The driver management apparatus according to claim 1, wherein the reporting condition includes that the driver is sleepy.

11. The driver management apparatus according to claim 1, wherein the reporting condition includes that the driver drives carelessly.

12. The driver management apparatus according to claim 1, wherein the reporting condition includes that the driver is drunk.

13. The driver management apparatus according to claim 1, wherein the reporting condition includes that the driver is tired.

14. The driver management apparatus according to claim 1, wherein the reporting condition includes that the external center requests that the estimation result and the capture information are transmitted thereto.

15. The driver management apparatus according to claim 1, wherein the reporting condition includes that the driver wants to transmit the estimation result and the capture information to the external center.

16. The driver management apparatus according to claim 1, wherein the reporting condition includes that it is determined preferable that the estimation result and the capture information are transmitted to the external center based on a situation of an environment of the vehicle.

17. The driver management apparatus according to claim 1, wherein the reporting condition includes that it is determined preferable that the estimation result and the capture information are transmitted to the external center based on a biorhythm of the driver.

18. The driver management apparatus according to claim 1, wherein the reporting condition includes that a present time is a preset time, at which the estimation result and the capture information are required to be transmitted to the external center.

19. The driver management apparatus according to claim 1, wherein the reporting condition includes that a location of the vehicle corresponds to a preset point, where the estimation result and the capture information are required to be transmitted to the external center.

20. A travel management system for managing travel of a vehicle, the system comprising:

a center; and

the driver management apparatus according to claim 1, wherein;

the center and the driver management apparatus are configured to exchange various data sets therebetween;

the center includes an inputting means for receiving information provided from the driver management apparatus; and

the center includes a storing means for storing the received information.

21. The travel management system according to claim 20, wherein the center further includes a reporting means for retrieving the information stored in the storing means and for reporting the same.

22. A driver management apparatus for managing a driver of a vehicle, the apparatus being capable of exchanging various data sets with an external center, the apparatus comprising:

a sensing means for sensing the driver;

a sensing information storing means for temporarily storing the sensing information that is a result of the sensing of the driver provided by the sensing means;

a state estimating means for estimating a state of the driver based on the sensing information;

an extracting means for extracting, as a capture region, part of the sensing information, which is stored by the sensing information storing means, based on an estimation result provided by the state estimating means;

a capture information storing means for extracting the sensing information, which is associated with the capture region extracted by the extracting means, from the sensing information storing means, and for storing the extracted sensing information as capture information;

a determining means for determining whether the estimation result provided by the state estimating means satisfies a reporting condition for determining that the external center is to be informed of the estimation result;

a travel information storing means capable of storing information related to travel of the vehicle; and

a controlling means for retrieving the capture information, which is associated with the estimation result, from the capture information storing means, and for causing the travel information storing means to store the retrieved capture information with the estimation result when the determining means determines that the estimation result satisfies the reporting condition.

23. The driver management apparatus according to claim 22, wherein the controlling means causes the travel information storing means to store the estimation result and the capture information with additional information.

24. The driver management apparatus according to claim 23, wherein:

the controlling means is capable of acquiring vehicle information related to the vehicle; and

the controlling means causes the travel information storing means to store the estimation result and the capture information with the acquired vehicle information, which serves as the additional information.

25. The driver management apparatus according to claim 23, wherein:

the controlling means is capable of acquiring operation information indicating operation of the driver; and

the controlling means causes the travel information storing means to store the estimation result and the capture information with the acquired operation information, which serves as the additional information.

26. The driver management apparatus according to claim 23, wherein:

the controlling means is capable of acquiring vehicle environment information related to an environment of the vehicle; and

the controlling means causes the travel information storing means to store the estimation result and the capture information with the acquired environment information, which serves as the additional information.

27. The driver management apparatus according to claim 22, wherein the sensing means acquires bioinformation of the driver and senses the driver based on the acquired bioinformation.

28. The driver management apparatus according to claim 22, wherein the sensing means acquires an image of a face of the driver and senses the driver based on the acquired image.

29. The driver management apparatus according to claim 28, wherein the sensing means acquires the face image of the driver as a dynamic image or a series of a plurality of static images.

30. The driver management apparatus according to claim 22, wherein the capture region is a region, in which a phenomenon having great influence on estimating the state of the driver exists.

31. The driver management apparatus according to claim 22, wherein the reporting condition includes that the driver is sleepy.

32. The driver management apparatus according to claim 22, wherein the reporting condition includes that the driver drives carelessly.

33. The driver management apparatus according to claim 22, wherein the reporting condition includes that the driver is drunk.

34. The driver management apparatus according to claim 22, wherein the reporting condition includes that the driver is tired.

35. The driver management apparatus according to claim 22, wherein the reporting condition includes that the external center requests that the estimation result and the capture information are transmitted thereto.

36. The driver management apparatus according to claim 22, wherein the reporting condition includes that the driver wants to transmit the estimation result and the capture information to the external center.

37. The driver management apparatus according to claim 22, wherein the reporting condition includes that it is determined preferable that the estimation result and the capture information are transmitted to the external center based on a situation of an environment of the vehicle.

38. The driver management apparatus according to claim 22, wherein the reporting condition includes that it is determined preferable that the estimation result and the capture information are transmitted to the external center based on a biorhythm of the driver.

39. The driver management apparatus according to claim 22, wherein the reporting condition includes that a present time is a preset time, at which the estimation result and the capture information are required to be transmitted to the external center.

40. The driver management apparatus according to claim 22, wherein the reporting condition includes that a location of the vehicle corresponds to a preset point, where the estimation result and the capture information are required to be transmitted to the external center.

41. A travel management system for managing travel of a vehicle, the system comprising:

a center; and

the driver management apparatus according to claim 22, wherein;

the center and the driver management apparatus are configured to exchange various data sets therebetween;

the center includes an inputting means for receiving information provided from the driver management apparatus; and

the center includes a storing means for storing the received information.

42. The travel management system according to claim 41, wherein the center further includes a reporting means for retrieving the information stored in the storing means and for reporting the same.

43. A driver management apparatus for managing a driver of a vehicle, the apparatus being capable of exchanging various data sets with an external center, the apparatus comprising:

a sensing means for sensing bioinformation of the driver;

a sensing information storing means for temporarily storing sensing information that is a result of the sensing of the bioinformation of the driver provided by the sensing means;

a state estimating means for estimating a state of the driver based on the sensing information;

a face image acquiring means for acquiring an image of a face of the driver;

a face image storing means for temporarily storing the acquired image of the face of the driver;

an extracting means for extracting, as a capture region, part of the face image, which is stored by the face image storing means, based on an estimation result provided by the state estimating means;

a capture information storing means for extracting at least one of the sensing information, which is associated with the capture region extracted by the extracting means, and the face image, which is associated with the capture region, and for storing, as capture information, the at least one of the sensing information and the face image;

a determining means for determining whether the estimation result provided by the state estimating means satisfies a reporting condition for determining that the external center is to be informed of the estimation result; and

a controlling means for retrieving the capture information, which is associated with the estimation result, from the capture information storing means and for causing the retrieved capture information to be transmitted with the estimation result to the external center when the determining means determines that the estimation result satisfies the reporting condition.

44. The driver management apparatus according to claim 43, wherein the controlling means causes the estimation result and the capture information to be transmitted with additional information to the external center.

45. The driver management apparatus according to claim 44, wherein:

the controlling means is capable of acquiring vehicle information related to the vehicle; and

the controlling means causes the estimation result and the capture information to be transmitted with the acquired vehicle information, which serves as the additional information, to the external center.

46. The driver management apparatus according to claim 44, wherein:

the controlling means is capable of acquiring operation information indicating operation of the driver; and

the controlling means causes the estimation result and the capture information to be transmitted with the acquired operation information, which serves as the additional information, to the external center.

47. The driver management apparatus according to claim 44, wherein:

the controlling means is capable of acquiring vehicle environment information related to a situation of an environment of the vehicle; and

the controlling means causes the estimation result and the capture information to be transmitted with the acquired environment information, which serves as the additional information, to the external center.

48. The driver management apparatus according to claim 43, wherein the face image acquiring means acquires the face image as a dynamic image or a series of a plurality of static images.

49. The driver management apparatus according to claim 43, further comprising a data compressing means for compressing data included in the capture information.

50. The driver management apparatus according to claim 49, wherein the data compressing means compresses the data included in the capture information when the capture information is stored in the capture information storing means.

51. The driver management apparatus according to claim 49, wherein:

when the capture information includes an image, the data compressing means discriminates a region other than a region of a face of the driver in the image; and

the data compressing means only compresses all or part of the discriminated region.

52. The driver management apparatus according to claim 49, wherein:

when the capture information includes an image, the data compressing means discriminates a region other than a region of a face of the driver in the image; and

the data compressing means deletes all or part of the discriminated region.

53. The driver management apparatus according to claim 49, wherein:

when the capture information includes an image, the data compressing means discriminates a region other than a region of a face of the driver in the image; and

the data compressing means monochromatizes all or part of the discriminated region.

54. The driver management apparatus according to claim 49, wherein:

when the capture information includes an image, the data compressing means discriminates a region of a face of the driver in the image; and

the data compressing means compresses the region of the face and a region other than the region of the face at different compressing rates.

55. A driver management apparatus for managing a driver of a vehicle, the apparatus being capable of exchanging various data sets with an external center, the apparatus comprising:

a sensing means for sensing bioinformation of the driver;

a sensing information storing means for temporarily storing sensing information that is a result of the sensing of the bioinformation of the driver provided by the sensing means;

a state estimating means for estimating a state of the driver based on the sensing information;

a face image acquiring means for acquiring an image of a face of the driver;

a face image storing means for temporarily storing the face image of the driver acquired by the face image acquiring means;

an extracting means for extracting, as a capture region, part of the face image, which is stored by the face image storing means, based on an estimation result provided by the state estimating means;

a capture information storing means for extracting at least one of the sensing information, which is associated with the capture region extracted by the extracting means, and the face image, which is associated with the capture region, and for storing, as capture information, the at least one of the sensing information and the face image;

a determining means for determining whether the estimation result provided by the state estimating means satisfies a reporting condition for determining that the external center is to be informed of the estimation result;

a travel information storing means capable of storing information related to travel of the vehicle; and

a controlling means for retrieving the capture information, which is associated with the estimation result, from the capture information storing means, and for causing the travel information storing means to store the retrieved capture information with the estimation result when the determining means determines that the estimation result satisfies the reporting condition.

56. The driver management apparatus according to claim 55, wherein the controlling means causes the travel information storing means to store the estimation result and the capture information with additional information.

57. The driver management apparatus according to claim 56, wherein:

the controlling means is capable of acquiring vehicle information related to the vehicle; and

the controlling means causes the travel information storing means to store the estimation result and the capture information with the acquired vehicle information, which serves as the additional information.

58. The driver management apparatus according to claim 56, wherein:

the controlling means is capable of acquiring operation information indicating operation of the driver; and

the controlling means causes the travel information storing means to store the estimation result and the capture information with the acquired operation information, which serves as the additional information.

59. The driver management apparatus according to claim 56, wherein:

the controlling means is capable of acquiring vehicle environment information related to a situation of an environment of the vehicle; and

the controlling means causes the travel information storing means to store the estimation result and the capture information with the acquired environment information, which serves as the additional information.