Control apparatus and related method

• US 10,040,350 B2
• Filed: 04/30/2015
• Issued: 08/07/2018
• Est. Priority Date: 05/01/2014
• Status: Active Grant

• Current Assignee: Jaguar Land Rover Limited (TATA Motors Limited)
• Original Assignee: Jaguar Land Rover Limited (TATA Motors Limited)
• Inventors: Dias, Eduardo, Hardy, Robert, Paszkowicz, Sebastian, Gaszczak, Anna, Popham, Thomas, Alexander, George
• Primary Examiner(s): Fan, Hongmin
• Application Number:
  US15/306,595
• Publication Number:
  US 20170120749A1
• Time in Patent Office: 1,195 Days
• CPC Class Codes: B60K 2360/195 Blocking or enabling display functions
• CPC Class Codes: B60K 28/066 actuating a signalling device B60K28/063 takes precedence
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60W 2040/0818 Inactivity or incapacity of driver
• CPC Class Codes: B60W 2040/0872 Driver physiology
• CPC Class Codes: B60W 2050/143 Alarm means
• CPC Class Codes: B60W 2050/146 Display means
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 40/08 related to drivers or passengers
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2358/00 Arrangements for display data security
• CPC Class Codes: G09G 3/20 for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters

Abstract

The present disclosure relates to a method of controlling one or more vehicle systems. The method uses at least one sensor (3-1, 3-2) to monitor a driver (D) to identify a driver distracted state. One or more functions of a first vehicle system (7, 9, 17) are inhibited when the driver distracted state is identified. The present application also relates to a control apparatus (1); and to a vehicle (V). The present disclosure also relates to a method and related apparatus for controlling the output of a visual notification within the vehicle (V).

Claims

1. A method of controlling output of a notification to a driver in a vehicle cabin, the method comprising:

monitoring the driver via at least one sensor to identify a driver distracted state;

identifying which one of a plurality of areas in the vehicle cabin other than a front windscreen the driver is currently looking at, wherein the plurality of areas comprises at least a first area corresponding to a first vehicle system and a second area not overlapping the first area and corresponding to a second vehicle system; and

displaying a visual notification in a display region proximal to or coincident with the identified area in dependence on identification of the driver distracted state.

2. The method of claim 1, wherein the visual notification is only output to the display region proximal to or coincident with the identified area.

3. The method of claim 1, wherein the visual notification is displayed on a display proximal to or coincident with the identified area, or wherein the visual notification is projected onto a surface proximal to or coincident with the identified area.

4. The method of claim 1, wherein identifying which one of the plurality of areas in the vehicle cabin other than a front windscreen the driver is currently looking at comprises generating a virtual projection in three-dimensional space representative of a line of sight of the driver and determining which one of the plurality of areas is intersected by the virtual projection.

5. The method of claim 1, further comprising determining a depth dimension in addition to other spatial dimensions from information received from the sensor to construct a three-dimensional gaze vector.

6. The method of claim 1, wherein monitoring the driver to identify the driver distracted state comprises measuring an uninterrupted time period when the driver is looking at the identified area or measuring a cumulative time period when the driver repeatedly looks at the identified area and/or a frequency with which the driver repeatedly looks at the identified area.

7. The method of claim 1, wherein a different time threshold is defined for each of the plurality of areas and/or a different frequency threshold is defined for each of the plurality of areas, wherein identification of the driver distracted state is determined by exceedance of the time threshold and/or frequency threshold corresponding to the identified area.

8. The method of claim 7, wherein each time threshold and/or frequency threshold varies dependent upon at least one dynamic vehicle parameter, and/or at least one external parameter, and/or where the driver is looking within the vehicle cabin.

9. A control apparatus for controlling output of a notification to a driver in a vehicle cabin, the control apparatus comprising:

at least one sensor for monitoring the driver; and

one or more processors configured to analyse data output from the at least one sensor to identify a driver distracted state and to identify which one of a plurality of areas in the vehicle cabin other than a front windscreen the driver is currently looking at, wherein the plurality of areas comprises at least a first area corresponding to a first vehicle system and a second area not overlapping the first area and corresponding to a second vehicle system; and

a controller for outputting a control signal to cause a visual notification to be displayed in a display region proximal to or coincident with the identified area in dependence on identification of the driver distracted state.

10. The control apparatus of claim 9, wherein the control signal causes the visual notification to be displayed only at or proximal to the identified area.

11. The control apparatus of claim 9, wherein the control signal is configured to control a display proximal to or coincident with the identified area to display the visual notification, or to control a projector to project the visual notification onto a surface proximal to or coincident with the identified area.

12. The control apparatus of claim 9, wherein the one or more processors are configured to generate a virtual projection in three-dimensional space representative of a line of sight of the driver and to determine which one of the plurality of areas is intersected by the virtual projection to identify where the driver is currently looking.

13. The control apparatus of claim 12, wherein the one or more processors are configured to determine a depth dimension in addition to other spatial dimensions from information received from the at least one sensor to construct a three-dimensional gaze vector.

14. The control apparatus of claim 9, wherein the at least one sensor comprises a stereo image sensor.

15. The control apparatus of claim 9, wherein the one or more processors are configured to measure an uninterrupted time period when the driver is looking at the identified area, or are configured to measure a cumulative time period when the driver repeatedly looks at the identified area, and/or are configured to measure a frequency with which the driver repeatedly looks at the identified area.

16. The control apparatus of claim 9, wherein a different time threshold is defined for each of the plurality of areas and/or a different frequency threshold is defined for each of the plurality of areas, wherein identification of the driverdistracted state is determined by exceedance of the time threshold and/or frequency threshold corresponding to the identified area.

17. The control apparatus of claim 16, wherein each time threshold and/or frequency threshold varies dependent upon at least one dynamic vehicle parameter, and/or at least one external parameter, and/or where the driver is looking within the vehicle cabin.

18. A vehicle comprising the control apparatus of claim 9.

19. A method of controlling output of a notification to a driver in a vehicle cabin, the method comprising:

monitoring the driver via at least one sensor to identify a driver distracted state;

identifying which one of a plurality of areas in the vehicle cabin the driver is currently looking at, wherein the plurality of areas comprises at least a first area and a second area, wherein a distance between the second area and an area corresponding to a non-distracted state is greater than a distance between the first area and the area corresponding to a non-distracted state;

wherein a first threshold associated with distraction and corresponding to at least one of a first time or a first frequency is defined for the first area;

wherein a second threshold associated with distraction and corresponding to at least one of a second time less than the first time or a second frequency less than the first frequency is defined for the second area; and

causing at least one of;

displaying a visual notification in a display region proximal to or coincident with the identified area, or inhibiting functionality associated with the display region, in dependence on identification of the driver distracted state determined by exceedance of the one of the first threshold and the second threshold corresponding to the identified area.

20. The method as claimed in claim 19, wherein the first area corresponds to an instrument display panel and the second area corresponds to an infotainment system display panel.