Visual attention influenced condition indicia apparatus and method

• US 6,906,619 B2
• Filed: 02/27/2003
• Issued: 06/14/2005
• Est. Priority Date: 02/27/2003
• Status: Active Grant

• Current Assignee: Motorola Solutions, Inc.
• Original Assignee: Motorola, Inc. (Motorola Solutions, Inc.)
• Inventors: Williams, Marc, Wheatley, David, Hurwitz, Joshua
• Primary Examiner(s): PHAM, TOAN NGOC
• Application Number:
  US10/375,569
• Publication Number:
  US 20040178890A1
• Time in Patent Office: 838 Days
• Field of Search: 340/425.5, 340/435, 340/436, 340/438, 340/439, 340/440, 340/691.6, 340/692, 701/301
• US Class Current: 340/425.5
• CPC Class Codes: B60Q 1/52 for indicating emergencies
• CPC Class Codes: B60Q 9/00 Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 , e.g. haptic signalling

Abstract

A vehicle (30), such as an automobile, has an indicia controller (31) that can determine, via one or more direction-of-visual-attention sensors (32) a likely direction of visual attention for a given occupant of the vehicle such as, for example, the driver or another passenger. When a predetermined condition is sensed by one or more condition sensors (34, 35) (such as, for example, a predetermined hazard or other unsafe operating condition), the indicia controller can determine whether the monitored person is likely looking in a direction that likely includes the condition of concern. A particular condition indicia (36) as corresponds to the detected condition can then be provided as a function, at least in part, of whether the driver or other monitored person is already likely looking at, and is hence aware of, the detecting condition.

Claims

1. A method comprising:

in a vehicle;

determining at least a recent history of a plurality of likely directions of visual attention of a predetermined person;

determining a likely present direction of visual attention of the predetermined person;

detecting a predetermined condition regarding the vehicle;

making a determination regarding an indicia to provide to an operator of the vehicle regarding the predetermined condition as a function, at least in part, of the recent history and the likely present direction of visual attention of the predetermined person.

2. The method of claim 1 wherein determining a likely direction of visual attention of a predetermined person includes determining a likely direction of visual attention of an occupant of the vehicle.

3. The method of claim 2 wherein determining a likely direction of visual attention of an occupant of the vehicle includes determining a likely direction of visual attention of the operator of the vehicle.

4. The method of claim 1 wherein determining a likely direction of visual attention of a predetermined person includes using an eye tracker to determine a likely direction of visual attention of a predetermined person.

5. The method of claim 1 wherein determining a likely direction of visual attention of a predetermined person includes determining a likely substantially current direction of visual attention of a predetermined person.

6. The method of claim 1 wherein detecting a predetermined condition regarding the vehicle includes receiving information from at least one in-vehicle sensor regarding a predetermined condition regarding the vehicle.

7. The method of claim 6 wherein receiving information from at least one in-vehicle sensor regarding a predetermined condition regarding the vehicle includes receiving information from at least one in-vehicle sensor comprising at least one of:

vehicle speed sensor;

vehicle heading sensor;

vehicle location sensor;

vehicle acceleration sensor;

turn signal status sensor;

headlight status sensor;

cruise control status sensor;

seat occupancy status sensor;

radar-based sensor;

lidar-based sensor;

horn status sensor;

brake status sensor;

external temperature sensor;

image processor.

8. The method of claim 1 wherein making a determination regarding an indicia to provide to an operator of the vehicle regarding the predetermined condition as a function, at least in part, of the likely direction of visual attention of the predetermined person includes determining whether to provide the indicia.

9. The method of claim 1 wherein making a determination regarding an indicia to provide to an operator of the vehicle regarding the predetermined condition as a function, at least in part, of the likely direction of visual attention of the predetermined person includes making the determination as a function, at least in part, of a likely future direction of visual attention of the predetermined person.

10. The method of claim 1 wherein detecting a predetermined condition regarding the vehicle includes detecting a predetermined condition that is external to the vehicle.

11. The method of claim 1 wherein detecting a predetermined condition regarding the vehicle includes detecting a predetermined condition that is internal to the vehicle.

12. A method comprising:

in a vehicle;

determining a likely direction of visual attention of a predetermined person;

detecting a predetermined condition regarding the vehicle, at least in part, by receiving information from at least one non-vehicle source via a wireless communication link;

making a determination regarding an indicia to provide to an operator of the vehicle regarding the predetermined condition as a function, at least in part, of the likely direction of visual attention of the predetermined.

13. A method comprising:

in a vehicle;

determining a likely direction of visual attention of a predetermined person;

detecting a predetermined condition regarding the vehicle;

making a determination regarding an indicia to provide to an operator of the vehicle regarding the predetermined condition as a function, at least in part, of the likely direction of visual attention of the predetermined person and by determining which indicia to provide from amongst a plurality of candidate indicia that each relate to the predetermined function.

14. The method of claim 13 wherein making a determination regarding an indicia to provide to an operator of the vehicle regarding the predetermined condition as a function, at least in part, of the likely direction of visual attention of the predetermined person includes:

making a first determination when the likely direction of visual attention of the predetermined person at least substantially accords with a first evaluation criteria; and

making a second determination, which second determination is different from the first determination, when the likely direction of visual attention of the predetermined person does not at least substantially accord with the first evaluation criteria.

15. The method of claim 14 wherein the first evaluation criteria includes a likely direction of visual attention of the predetermined person that at least substantially coincides with a field of view that includes at least a portion of the predetermined condition.

16. An apparatus comprising:

a direction-of-visual-attention sensor disposed operationally proximal to a predetermined person;

at least one condition sensor;

a condition indicia;

an indicia controller having inputs operably coupled to the direction-of-visual-attention sensor and the condition sensor and having an output operably coupled to the condition indicia, wherein;

the indicia controller controls the condition indicia pursuant to a first mode of operation when the direction-of-visual-attention sensor indicates that the predetermined person is likely to view a predetermined vehicle condition, which predetermined vehicle condition correlates to the condition indicia; and

the indicia controller controls the condition indicia pursuant to a second mode of operation when the direction-of-view-attention sensor indicates that the predetermined person is not likely to view the predetermined vehicle condition.

17. The apparatus of claim 16 wherein the direction-of-visual-attention sensor comprises means for detecting a direction of visual attention of the predetermined person.

18. The apparatus of claim 17 wherein the means for detecting a direction of visual attention of the predetermined person comprises an eye tracker.

19. The apparatus of claim 16 wherein the at least one condition sensor includes at least one of a:

vehicle speed sensor;

vehicle heading sensor;

vehicle location sensor;

vehicle acceleration sensor;

turn signal status sensor;

headlight status sensor;

cruise control status sensor;

seat occupancy status sensor;

radar-based sensor;

lidar-based sensor;

horn status sensor;

brake status sensor;

external temperature sensor;

image processor.

20. The apparatus of claim 16 wherein the indicia controller comprises processing means for determining when the predetermined person is likely paying visual attention to the predetermined vehicle condition.

21. The apparatus of claim 20 wherein the processing means for determining when the predetermined person is likely paying visual attention to the predetermined vehicle condition includes means for determining that the predetermined person is likely, in the near future, to pay visual attention to the predetermined vehicle condition.

22. The apparatus of claim 16 wherein the apparatus comprises a vehicle.

23. The apparatus of claim 22 wherein the vehicle comprises a terrestrial vehicle.