Method and device for monitoring a vehicle occupant

• US 8,958,978 B2
• Filed: 07/30/2013
• Issued: 02/17/2015
• Est. Priority Date: 07/31/2012
• Status: Active Grant

• Current Assignee: Robert Bosch GmbH
• Original Assignee: Robert Bosch GmbH
• Inventors: Fuehrer, Thomas
• Primary Examiner(s): EL CHANTI, HUSSEIN A
• Application Number:
  US13/954,466
• Publication Number:
  US 20140039788A1
• Time in Patent Office: 567 Days
• Field of Search: 701/301
• US Class Current: 701/301
• CPC Class Codes: B60K 28/02 responsive to conditions relating to the driver
• CPC Class Codes: G06Q 30/0241 Advertisements
• CPC Class Codes: G06Q 30/0242 Determining effectiveness of advertisements
• CPC Class Codes: G06Q 50/40 Business processes related to the transportation industry shipping G06Q10/083
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08

Abstract

A method, a corresponding device, and a corresponding computer program for monitoring a vehicle occupant, including the following: detecting multiple objects in the vehicle surroundings with the aid of a surroundings detection device, detecting a viewing direction of the vehicle occupant with the aid of a gaze detection device, and automatically associating the detected viewing direction with one of the detected objects with the aid of an association device for a determination regarding which object of the multiple objects the vehicle occupant has viewed.

Claims

1. A computer-implemented method for monitoring a vehicle occupant, the method comprising:

detecting, by a surroundings detection device having a first sensor system, multiple objects in the vehicle surroundings;

detecting, by a gaze detection device having a second sensor system, a viewing direction of the vehicle occupant; and

automatically associating, by an association device having a computer processor, the detected viewing direction with one of the detected objects to determine which object of the multiple objects the vehicle occupant has viewed.

2. The method of claim 1, wherein the detected viewing direction is associated with one of the detected objects only when the detected viewing direction points, at least indirectly, in the direction of a vehicle window.

3. The method of claim 1, wherein information concerning the viewed object is queried from a database and provided to the vehicle occupant.

4. The method of claim 3, wherein the information concerning the viewed objected is provided one of:

visually, acoustically, or haptically.

5. The method of claim 1, wherein a navigation system provides the vehicle occupant with a recommended route based on the viewed object.

6. The method of claim 1, wherein while the vehicle occupant is traveling on a route from a first position to a second position, a recording is made of which objects the vehicle occupant has viewed along the route in order to create a corresponding view/object profile for this route.

7. The method of claim 6, wherein the vehicle occupant travels along the route multiple times thereby creating multiple profiles for statistical evaluation.

8. The method of claim 7, wherein the statistical evaluation determines which of the objects along the route are most viewed and least viewed.

9. The method of claim 6, wherein the recorded view/object profile is transmitted to a cloud server for an evaluation of the view/object profile.

10. The method of claim 1, wherein an identity of the vehicle occupant is detected and linked to the viewed object.

11. The method of claim 1, wherein information concerning the viewed object is queried from a database and provided to the vehicle occupant, wherein an identity of the vehicle occupant is detected and linked to the viewed object, and wherein the provision of the information includes transmitting the information as a personal message to the vehicle occupant.

12. The method of claim 1, wherein an instantaneous location of the vehicle occupant relative to a coordinate system formed externally with respect to the vehicle is determined and linked to the viewed object.

13. The method of claim 1, wherein the determination of the object viewed by the vehicle occupant is further used to recognize whether the vehicle occupant is distracted during travel.

14. The method of claim 13, wherein the determination of the object viewed by the vehicle occupant is further used to determine an accident risk by evaluating whether the occupant views objects relevant to safety, the objects relevant to safety including at least one of:

other vehicles, obstructions, navigation signs, general information signs, and boundary markers along a road.

15. The method of claim 1, wherein the vehicle occupant is at least one of a driver of the vehicle and a passenger of the vehicle.

16. The method of claim 1, wherein the detecting multiple objects in the vehicle surroundings includes a classification of each individual determined object.

17. A device for monitoring a vehicle occupant, comprising:

a surroundings detection device for detecting multiple objects in the vehicle surroundings;

a gaze detection device for detecting a viewing direction of the vehicle occupant; and

an association device for automatically associating the detected viewing direction with one of the detected objects to determine which object of the multiple objects the vehicle occupant has viewed.

18. A non-transitory computer readable storage medium storing a computer program that is executable by a processor, the storage medium comprising:

a program code arrangement having program code for monitoring a vehicle occupant, by performing the following;

detecting multiple objects in the vehicle surroundings with the aid of a surroundings detection device;

detecting a viewing direction of the vehicle occupant with the aid of a gaze detection device; and

automatically associating the detected viewing direction with one of the detected objects with the aid of an association device to determine which object of the multiple objects the vehicle occupant has viewed.