Systems and methodologies for real-time driver gaze location determination and analysis utilizing computer vision technology
First Claim
1. A method comprising:
- monitoring, with one or more image capture devices, one or more eyes of a vehicle operator during a plurality of trips of a vehicle to generate, for each of the plurality of trips, a plurality of gaze location logs, each of the plurality of gaze location logs including a gaze location value and a timestamp,wherein the gaze location value is generated by;
determining a gaze location corresponding to the one or more eyes of the vehicle operator,determining an area of the vehicle associated with the gaze location, andassigning the gaze location value based on the area of the vehicle associated with the gaze location;
analyzing, by one or more processors, the plurality of gaze location logs for each of the plurality of trips to determine a duration of a gaze of the vehicle operator for each of a plurality of areas of the vehicle, the determination of the duration of the gaze of the vehicle operator being based on a difference between two timestamps included in the plurality of gaze location logs;
for each of the plurality of areas of the vehicle, collectively analyzing, by the one or more processors, the durations of the gaze of the vehicle operator for the plurality of trips to identify one or more recommendations to improve performance of the vehicle operator, whereincollectively analyzing the durations of the gaze of the vehicle operator includes determining whether the gaze of the vehicle operator shifts from a front windshield of the vehicle to one or more different areas of the plurality of areas with a sufficiently high frequency,the one or more different areas include at least one or both of (i) a mirror of the vehicle, and (ii) a dashboard of the vehicle, andat least one of the one or more recommendations recommending an adjustment of the durations of gaze of the vehicle operator for at least one of the plurality of areas of the vehicle; and
electronically communicating the one or more recommendations to the vehicle operator.
1 Assignment
0 Petitions
Accused Products
Abstract
The method, system, and computer-readable medium facilitates monitoring one or more eyes of a vehicle operator during a driving session to generate a plurality of gaze location logs with gaze location values and timestamps. The gaze location value may be generated by determining a focal point of the vehicle operator'"'"'s gaze, determining which of a plurality of areas of the vehicle is associated with the focal point, and assigning the gaze location value based on the area of the vehicle associated with the focal point. The gaze location logs may be analyzed to determine the duration of the vehicle operator'"'"'s gaze at each area of the vehicle. Based on the duration of the vehicle operators gaze, recommendations to improve vehicle operator performance may be determined and communicated to the vehicle operator.
-
Citations
15 Claims
-
1. A method comprising:
-
monitoring, with one or more image capture devices, one or more eyes of a vehicle operator during a plurality of trips of a vehicle to generate, for each of the plurality of trips, a plurality of gaze location logs, each of the plurality of gaze location logs including a gaze location value and a timestamp, wherein the gaze location value is generated by; determining a gaze location corresponding to the one or more eyes of the vehicle operator, determining an area of the vehicle associated with the gaze location, and assigning the gaze location value based on the area of the vehicle associated with the gaze location; analyzing, by one or more processors, the plurality of gaze location logs for each of the plurality of trips to determine a duration of a gaze of the vehicle operator for each of a plurality of areas of the vehicle, the determination of the duration of the gaze of the vehicle operator being based on a difference between two timestamps included in the plurality of gaze location logs; for each of the plurality of areas of the vehicle, collectively analyzing, by the one or more processors, the durations of the gaze of the vehicle operator for the plurality of trips to identify one or more recommendations to improve performance of the vehicle operator, wherein collectively analyzing the durations of the gaze of the vehicle operator includes determining whether the gaze of the vehicle operator shifts from a front windshield of the vehicle to one or more different areas of the plurality of areas with a sufficiently high frequency, the one or more different areas include at least one or both of (i) a mirror of the vehicle, and (ii) a dashboard of the vehicle, and at least one of the one or more recommendations recommending an adjustment of the durations of gaze of the vehicle operator for at least one of the plurality of areas of the vehicle; and electronically communicating the one or more recommendations to the vehicle operator. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A computer system comprising:
-
one or more processors; one or more image capture devices; and a program memory storing instructions that when executed by the one or more processors cause the computer system to; monitor, with the one or more image capture devices, one or more eyes of a vehicle operator during a plurality of trips of a vehicle to generate, for each of the plurality of trips, a plurality of gaze location logs, each of the plurality of gaze location logs including a gaze location value and a timestamp, wherein the gaze location value is generated by; determining a gaze location corresponding to the one or more eyes of the vehicle operator, determining an area of the vehicle associated with the gaze location, and assigning the gaze location value based on the area of the vehicle associated with the gaze location; analyze the plurality of gaze location logs for each of the plurality of trips to determine a duration of a gaze of the vehicle operator for each of a plurality of areas of the vehicle, the determination of the duration of the gaze of the vehicle operator being based on a difference between two timestamps included in the plurality of gaze location logs; for each of the plurality of areas of the vehicle, collectively analyze the durations of the gaze of the vehicle operator for the plurality of trips to identify one or more recommendations to improve performance of the vehicle operator, wherein collectively analyzing the durations of the gaze of the vehicle operator includes determining whether the gaze of the vehicle operator shifts from a front windshield of the vehicle to one or more different areas of the plurality of areas with a sufficiently high frequency, the one or more different areas include at least one or both of (i) a mirror of the vehicle, and (ii) a dashboard of the vehicle, and at least one of the one or more recommendations recommending an adjustment of the durations of gaze of the vehicle operator for at least one of the plurality of areas of the vehicle; and communicate the one or more recommendations to the vehicle operator. - View Dependent Claims (7, 8, 9, 10)
-
-
11. A non-transitory, computer-readable medium storing instructions that when executed by one or more processors cause a computer system to:
-
monitor, with one or more image capture devices, one or more eyes of a vehicle operator during a plurality of trips of a vehicle to generate, for each of the plurality of trips, a plurality of gaze location logs, each of the plurality of gaze location logs including a gaze location value and a timestamp, wherein the gaze location value is generated by; determining a gaze location corresponding to the one or more eyes of the vehicle operator, determining an area of the vehicle associated with the gaze location, and assigning the gaze location value based on the area of the vehicle associated with the gaze location; analyze the plurality of gaze location logs for each of the plurality of trips to determine a duration of a gaze of the vehicle operator for each of a plurality of areas of the vehicle, the determination of the duration of the gaze of the vehicle operator being based on a difference between two timestamps included in the plurality of gaze location logs; for each of the plurality of areas of the vehicle, collectively analyze the durations of the gaze of the vehicle operator for the plurality of trips to identify one or more recommendations to improve performance of the vehicle operator, wherein collectively analyzing the durations of the gaze of the vehicle operator includes determining whether the gaze of the vehicle operator shifts from a front windshield of the vehicle to one or more different areas of the plurality of areas with a sufficiently high frequency, the one or more different areas include at least one or both of (i) a mirror of the vehicle, and (ii) a dashboard of the vehicle, and at least one of the one or more recommendations recommending an adjustment of the durations of gaze of the vehicle operator for at least one of the plurality of areas of the vehicle; and communicate the one or more recommendations to the vehicle operator. - View Dependent Claims (12, 13, 14, 15)
-
Specification