Warning a vehicle occupant before an intense movement

• US 10,059,347 B2
• Filed: 12/12/2016
• Issued: 08/28/2018
• Est. Priority Date: 10/26/2015
• Status: Active Grant

• Current Assignee: Atnomity Ltd.
• Original Assignee: Active Knowledge Ltd
• Inventors: Thieberger-Navon, Tal, Thieberger, Gil, Frank, Ari M
• Primary Examiner(s): MELTON, TODD M
• Application Number:
  US15/376,237
• Publication Number:
  US 20170113702A1
• Time in Patent Office: 624 Days
• CPC Class Codes: B60W 2050/143 Alarm means
• CPC Class Codes: B60W 2050/146 Display means
• CPC Class Codes: B60W 30/025 related to comfort of drivers or passengers
• CPC Class Codes: B60W 50/0097 Predicting future conditions
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention

Abstract

A safety system for an autonomous vehicle that may be used to warn an occupant engaged in a certain activity that involves handling an object that can harm the occupant in an event of a Sudden Decrease in Ride Smoothness (an SDRS event). The safety system includes a camera that takes images of the occupant and a computer that estimates, based on the images, whether the occupant is engaged in the certain activity. The computer receives from an autonomous-driving control system an indication of whether an SDRS event is imminent. Responsive to both receiving an indication of an imminent SDRS event and estimating that the occupant is engaged in the certain activity, the computer commands a user interface to warn the occupant shortly before the SDRS event.

Claims

1. A safety system for an autonomous vehicle, comprising:

a camera configured to take images of an occupant of the vehicle; and

a computer configured to;

estimate, based on the images, whether the occupant is engaged in a certain activity that involves handling an object that can harm the occupant in a case of a Sudden Decrease in Ride Smoothness (SDRS);

receive an indication indicative of whether an SDRS event is imminent; and

responsive to both receiving an indication indicative of an imminent SDRS event and estimating that the occupant is engaged in the certain activity, command a user interface to provide a first warning to the occupant shortly before the SDRS.

2. The safety system of claim 1, wherein responsive to receiving an indication indicative of an imminent SDRS event and not estimating that the occupant is engaged in the certain activity, the computer is further configured not to command the user interface to warn the occupant, or to command the user interface to provide a second warning to the occupant shortly before the SDRS event wherein the second warning is less noticeable than the first warning.

3. The safety system of claim 2, wherein the occupant does not drive the vehicle, and the first warning comprises at least one of the followings:

a visual cue that is more intense than a visual cue of the second warning, and a sound that is louder than a sound of the second warning.

4. The safety system of claim 2, wherein the object is a tool for applying makeup, and the certain activity comprises bringing the tool close to an eye.

5. The safety system of claim 2, wherein the object is an ear swab, and the certain activity comprises cleaning an ear with the ear swab.

6. The safety system of claim 2, wherein the object is selected from the group comprising the following tools:

a knife, a tweezers, a scissors, and a syringe; and

the certain activity comprises using the tool.

7. The safety system of claim 2, wherein the object is a cup that is at least partially filled with liquid, and the certain activity comprises drinking the liquid.

8. The safety system of claim 2, wherein responsive to both receiving an indication indicative of no imminent SDRS event and estimating that the occupant is engaged in the certain activity, the computer is further configured not to command the user interface to warn the occupant.

9. The safety system of claim 2, wherein warning the occupant shortly before the SDRS event refers to warning the occupant less than 30 seconds before the SDRS event;

and wherein the SDRS event may result from one or more of the following;

driving on a speed bump, driving over a pothole, starting to drive after a full stop, driving up the pavement, making a sharp turn, and a hard breaking.

10. The safety system of claim 9, wherein the computer is configured to command the user interface to provide the first warning at least one second before the SDRS event.

11. The safety system of claim 1, wherein the computer is configured to receive the indication indicative of whether an SDRS event is imminent from an autonomous-driving control system, and the autonomous-driving control system calculates the indication based on at least one of the following sources:

sensors mounted to the vehicle, sensors mounted to nearby vehicles, an autonomous-driving control system used to drive a nearby vehicle, and a database comprising descriptions of obstacles in the road that are expected to cause intense movement of the vehicle.

12. The safety system of claim 1, wherein the camera comprises a video camera, and the computer is configured to utilize an image processing algorithm to identify the object and to estimate whether the occupant is engaged in the certain activity.

13. The safety system of claim 1, wherein the camera comprises an active 3D tracking device, and the computer is configured to analyze the 3D data to identify the object and to estimate whether the occupant is engaged in the certain activity.

14. The safety system of claim 1, wherein the camera is physically coupled to the compartment.

15. The safety system of claim 1, wherein the occupant wears a head-mounted display (HMD), and the camera is physically coupled to the HMD.

16. A method for warning an occupant of an autonomous vehicle, comprising:

receiving images of the occupant;

estimating, based on the images, whether the occupant is engaged in a certain activity that involves handling an object that can harm the occupant in a case of a Sudden Decrease in Ride Smoothness (SDRS);

receiving an indication indicative of whether an SDRS event is imminent; and

responsive to both receiving an indication indicative of an imminent SDRS event and estimating that the occupant is engaged in the certain activity, commanding a user interface to provide a first warning to the occupant shortly before the SDRS event.

17. The method of claim 16, wherein responsive to both receiving an indication indicative of no imminent SDRS event and estimating that the occupant is engaged in the certain activity, the computer is further configured not to command the user interface to warn the occupant.

18. The method of claim 16, wherein the indication indicative of whether an SDRS event is imminent is received from an autonomous-driving control system, and warning the occupant shortly before the SDRS event refers to warning the occupant less than 30 seconds before the SDRS event;

and wherein the SDRS event may result from one or more of the following;

driving on a speed bump, driving over a pothole, starting to drive after a full stop, driving up the pavement, making a sharp turn, and a hard breaking.

19. The method of claim 16, wherein responsive to receiving an indication indicative of an imminent SDRS event and not estimating that the occupant is engaged in the certain activity, commanding the user interface to provide a second warning to the occupant, or not commanding the user interface to warn the occupant shortly before the SDRS event;

wherein the second warning is less noticeable than the first warning.

20. A non-transitory computer-readable medium for use in a computer to warn an occupant of an autonomous vehicle, the computer comprises a processor, and the non-transitory computer-readable medium comprising:

program code for receiving images of the occupant;

program code for estimating, based on the images, whether the occupant is engaged in a certain activity that involves handling an object that can harm the occupant in a case of a Sudden Decrease in Ride Smoothness (SDRS);

program code for receiving, from an autonomous-driving control system, an indication indicative of whether an SDRS event is imminent;

program code for commanding a user interface to provide a first warning to the occupant shortly before the SDRS event, responsive to both receiving an indication indicative of an imminent SDRS event and estimating that the occupant is engaged in the certain activity; and

program code for commanding the user interface to provide a second warning to the occupant, or not commanding the user interface to warn the occupant, shortly before the SDRS event, responsive to receiving an indication indicative of an imminent SDRS event and not estimating that the occupant is engaged in the certain activity;

wherein the second warning is less noticeable than the first warning.