Systems and methods for adaptively communicating notices in a vehicle

• US 10,166,996 B2
• Filed: 02/09/2017
• Issued: 01/01/2019
• Est. Priority Date: 02/09/2017
• Status: Active Grant

• Current Assignee: Toyota Jidosha Kabushiki Kaisha (Toyota Motor Corporation)
• Original Assignee: Toyota Motor Engineering & Manufacturing North America Incorporated (Toyota Motor Corporation)
• Inventors: Ishihara, Mikiya, Li, Yi, Ebe, Kazutoshi
• Primary Examiner(s): Heinle, Courtney D
• Application Number:
  US15/428,379
• Publication Number:
  US 20180222490A1
• Time in Patent Office: 691 Days
• CPC Class Codes: B60K 2360/149 Instrument input by detecting viewing direction not otherwise provided for
• CPC Class Codes: B60K 2360/151 Instrument output devices for configurable output
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2360/771 on the ceiling
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/20 Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/22 Display screens
• CPC Class Codes: B60K 35/26 using acoustic output
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60K 35/81 for controlling displays
• CPC Class Codes: B60N 2/002 Seats provided with an occupancy detection means mounted therein or thereon detection means responsive to presence or absence of children B60N2/266
• CPC Class Codes: B60N 2/0276 reaction to emergency situations, e.g. crash
• CPC Class Codes: B60Q 1/2696 Mounting of devices using LEDs
• CPC Class Codes: B60Q 1/346 with automatic actuation
• CPC Class Codes: B60Q 3/745 using lighting panels or mats, e.g. electro-luminescent panels, LED mats
• CPC Class Codes: B60Q 3/82 Switches specially adapted for vehicle interior lighting, e.g. switching by tilting the lens
• CPC Class Codes: B60Q 9/00 Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 , e.g. haptic signalling
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/108 : using 'non-standard' camera systems, e.g. camera sensor used for additional purposes i.a. rain sensor, camera sensor split in multiple image areas
• CPC Class Codes: B60R 2300/205 : using a head-up display
• CPC Class Codes: B60R 2300/301 : combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/303 : using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/8033 : for pedestrian protection
• CPC Class Codes: B60R 2300/8093 : for obstacle warning
• CPC Class Codes: B60W 10/04 : including control of propulsion units
• CPC Class Codes: B60W 10/18 : including control of braking systems
• CPC Class Codes: B60W 10/20 : including control of steering systems
• CPC Class Codes: B60W 2050/143 : Alarm means
• CPC Class Codes: B60W 2050/146 : Display means
• CPC Class Codes: B60W 40/08 : related to drivers or passengers
• CPC Class Codes: B60W 50/14 : Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: B60Y 2400/92 : Driver displays
• CPC Class Codes: G06V 20/59 : inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions

Abstract

System, methods, and other embodiments described herein relate to adaptively communicating notices to passengers within a vehicle. In one embodiment, a method includes in response to receiving a notice about an occurrence of an event, determining a viewing orientation of a passenger in the vehicle according to at least one electronic input that indicates information about a physical position of the passenger within the vehicle. The event is an incident associated with the vehicle for which the passenger is to be informed. The method also includes selecting at least one alerting device from available communication devices in the vehicle according to the viewing orientation by determining which of the available communication devices correspond with the viewing orientation of the passenger. The method further includes controlling the at least one alerting device to communicate the notice to the passenger about the occurrence of the event.

Claims

1. An indication system of a vehicle, comprising:

one or more processors;

a memory communicably coupled to the one or more processors and storing;

an orientation module including instructions that when executed by the one or more processors cause the one or more processors to, in response to receiving a notice about an occurrence of an event when the vehicle is opertating according to an automomous mode, determine a viewing orientation of a passenger in the vehicle according to at least one electronic input that indicates information about a physical position of the passenger within the vehicle including determining whether a line-of-sight of the passenger is directed to a secondary display panel which is positioned in relation to the passenger to shift the line-of-sight away from a primary direction of travel of the vehicle, and wherein the event is associated with at least one of a current location of the vehicle or operation of the vehicle,

wherein the orientation module further includes instructions to select at least one alerting device from available communication devices in the vehicle according to the viewing orientation by determining which of the available communication devices correspond with the viewing orientation of the passenger; and

a notice module including instructions that when executed by the one or more processors cause the one or more processors to control the at least one alerting device to communicate the notice to the passenger about the occurrence of the event.

2. The indication system of claim 1, wherein the orientation module further includes instructions to determine the viewing orientation of the passenger by analyzing the at least one electronic input to determine the line-of-sight of the passenger, wherein the electronic input specifies information from a seat circuit that indicates a seat position for a seat of the passenger, and

wherein the orientation module further includes instructions to select the at least one alerting device by selecting the at least one alerting device in place of a primary instrument panel when the orientation of the passenger indicates that the line-of-sight of the passenger is engaged with the at least one alerting device instead of the primary instrument panel.

3. The indication system of claim 2, wherein the orientation module further includes instructions to determine whether the viewing orientation of the passenger is directed at the secondary display panel by:

(i) determining that the line-of-sight of the passenger is oriented to view a side panel of the vehicle when the seat circuit indicates a side position for the seat,

(ii) determining that the line-of-sight of the passenger is oriented to view a rear panel of the vehicle when the seat circuit indicates a reverse position of the seat, and

(iii) determining that the passenger is oriented to view a roof panel of the vehicle when the seat circuit indicates a recline position of the seat.

4. The indication system of claim 3, wherein the orientation module further includes instructions to select the at least one alerting device according to the viewing orientation by:

(i) selecting the at least one alerting device to be a side display device that is located within a proximity of the side panel when the passenger is oriented to view the side panel,

(ii) selecting the at least one alerting device to be a rear display device that is located within a proximity of a rear portion of the vehicle when the passenger is oriented to view the rear panel, and

(iii) selecting the at least one alerting device to be a roof display device that is located in the roof panel when the passenger is oriented to view the roof panel.

5. The indication system of claim 1, wherein the orientation module further includes instructions to select the at least one alerting device by selecting embedded lighting of a passenger compartment of the vehicle when the viewing orientation indicates that the line-of-sight of the passenger is oriented away from the primary instrument panel.

6. The indication system of claim 5, wherein the embedded lighting is located in separately controllable sections throughout the passenger compartment, wherein the notice module further includes instructions to control the at least one alerting device by selectively lighting one or more of the sections of the embedded lighting to indicate the notice to the passenger and selectively varying a color and intensity of the one or more of the sections according to attributes of the notice, and

wherein the electronic input specifies information from an eye tracking device that indicates a present viewing area of the passenger in addition to information from a seat circuit to refine a determination of the present viewing area.

7. The indication system of claim 1, wherein the orientation module further includes instructions to determine the viewing orientation of the passenger by determining that the passenger is using a mobile device when the at least one electronic input identifies that the mobile device is in active use,

wherein the notice module further includes instructions to control the at least one alerting device by controlling the mobile device to display the notice when the viewing orientation indicates that the mobile device is in active use, and

wherein the orientation module further includes instructions to determine the viewing orientation of the passenger by determining that the passenger is viewing one of the communication devices that is displaying entertainment content.

8. The indication system of claim 2, wherein the orientation module further includes instructions to select the at least one alerting device by selecting an audio device when the viewing orientation indicates that the passenger is inattentive to the available communication devices within the vehicle as determined from a present viewing area of the passenger,

wherein the notice module further includes instructions to control the at least one alerting device to communicate the notice when the at least one alerting device is the audio device by controlling the audio device to produce audible sounds that alert the passenger to the notice, and

wherein the audio device includes speakers that are positioned in the vehicle according to positions to which the seat is configured to move.

9. The indication system of claim 1, wherein the orientation module further includes instructions to receive the notice by receiving the notice while the vehicle is operating in an autonomous mode that includes the vehicle self-driving without receiving direct control input from a driver that is the passenger, and

wherein the notice module further includes instructions to control the at least one alerting device by controlling a seat of the passenger to move into a position in which the passenger is viewing a primary instrument panel of the vehicle when the notice is associated with a handover from the autonomous mode to a manual mode in which the passenger is to control the vehicle.

10. A non-transitory computer-readable medium storing instructions that when executed by one or more processors cause the one or more processors to:

in response to receiving a notice about an occurrence of an event when a vehicle is opertating according to an automomous mode, determine a viewing orientation of a passenger in the vehicle according to at least one electronic input that indicates information about a physical position of the passenger within the vehicle including determining whether a line-of-sight of the passenger is directed to a secondary display panel which is positioned in relation to the passenger to shift the line-of-sight away from a primary direction of travel of the vehicle, and wherein the event is an incident associated with at least one of a current location of the vehicle or operation of the vehicle;

select at least one alerting device from available communication devices in the vehicle according to the viewing orientation by determining which of the available communication devices correspond with the viewing orientation of the passenger; and

control the at least one alerting device to communicate the notice to the passenger about the occurrence of the event.

11. The non-transitory computer-readable medium of claim 10, wherein the instructions to cause the one or more processors to determine the viewing orientation of the passenger including instructions to analyze the at least one electronic input to determine the line-of-sight of the passenger, wherein the electronic input specifies information from a seat circuit that indicates a seat position for a seat of the passenger, and

wherein the instructions to cause the one or more processors to select the at least one alerting device includes instructions to select the at least one alerting device in place of a primary instrument panel when the orientation of the passenger indicates that the line-of-sight of the passenger is engaged with the at least one alerting device instead of the primary instrument panel.

12. The non-transitory computer-readable medium of claim 11, wherein the instructions to cause the one or more processors to determine the viewing orientation of the passenger include instructions to:

(i) determine that the line-of-sight of the passenger is oriented to view a side panel of the vehicle when the seat circuit indicates a side position for the seat,

(ii) determine that the line-of-sight of the passenger is oriented to view a rear panel of the vehicle when the seat circuit indicates a reverse position of the seat, and

(iii) determine that the passenger is oriented to view a roof panel of the vehicle when the seat circuit indicates a recline position of the seat, and

wherein the instructions to cause the one or more processors to select the at least one alerting device according to the viewing orientation include instructions to;

(i) select the at least one alerting device to be a side display device that is located on the side panel when the passenger is oriented to view the side panel,

(ii) select the at least one alerting device to be a rear display device that is located in a rear portion of the vehicle when the passenger is oriented to view the rear panel, and

(iii) select the at least one alerting device to be a roof display device that is located in the roof panel when the passenger is oriented to view the roof panel.

13. The non-transitory computer-readable medium of claim 10, wherein the instructions to cause the one or more processors to determine the viewing orientation of the passenger include instructions to determine that the passenger is using a mobile device when the at least one electronic input identifies that the mobile device is in active use,

wherein the instructions to cause the one or more processors to control the at least one alerting device include instructions to control the mobile device to display the notice when the mobile device is in active use,

wherein the instructions to cause the one or more processors to select the at least one alerting device include instructions to select an audio device when the viewing orientation indicates that the passenger is inattentive to the available communication devices within the vehicle, and wherein the instructions to cause the one or more processors to control the at least one alerting device to communicate the notice when the at least one alerting device is the audio device include instructions to control the audio device to produce audible sounds that alert the passenger to the notice.

14. A method of providing notifications within a vehicle, comprising:

in response to receiving a notice about an occurrence of an event when the vehicle is operating according to an autonomous mode, determining a viewing orientation of a passenger in the vehicle according to at least one electronic input that indicates information about a physical position of the passenger within the vehicle including determining whether a line-of-sight of the passenger is directed to a secondary display panel which is positioned in relation to the passenger to shift the line-of-sight away from a primary direction of travel of the vehicle, and wherein the event is an incident associated with at least one of a current location of the vehicle or operation of the vehicle;

selecting at least one alerting device from available communication devices in the vehicle according to the viewing orientation by determining which of the available communication devices correspond with the viewing orientation of the passenger; and

controlling the at least one alerting device to communicate the notice to the passenger about the occurrence of the event.

15. The method of claim 14, wherein determining the viewing orientation of the passenger includes analyzing the at least one electronic input to determine the line-of-sight of the passenger, wherein the electronic input specifies information from a seat circuit that indicates a seat position for a seat of the passenger, and

wherein selecting the at least one alerting device includes selecting the at least one alerting device in place of a primary instrument panel when the orientation of the passenger indicates that the line-of-sight of the passenger is engaged with the at least one alerting device instead of the primary instrument panel.

16. The method of claim 15, wherein determining the viewing orientation of the passenger includes:

(i) determining that the line-of-sight of the passenger is oriented to view a side panel of the vehicle when the seat circuit indicates a side position for the seat,

(ii) determining that the line-of-sight of the passenger is oriented to view a rear panel of the vehicle when the seat circuit indicates a reverse position of the seat, and

(iii) determining that the passenger is oriented to view a roof panel of the vehicle when the seat circuit indicates a recline position of the seat, and

wherein selecting the at least one alerting device according to the viewing orientation includes;

(i) selecting the at least one alerting device to be a side display device that is located on the side panel when the passenger is oriented to view the side panel,

(ii) selecting the at least one alerting device to be a rear display device that is located in a rear portion of the vehicle when the passenger is oriented to view the rear panel, and

(iii) selecting the at least one alerting device to be a roof display device that is located in the roof panel when the passenger is oriented to view the roof panel.

17. The method of claim 14, wherein selecting the at least one alerting device includes selecting embedded lighting of a passenger compartment of the vehicle when the viewing orientation indicates that the line-of-sight of the passenger is oriented away from the primary instrument panel, and wherein the embedded lighting is located in separately controllable sections throughout the passenger compartment,

wherein controlling the at least one alerting device includes selectively lighting one or more of the sections of the embedded lighting to indicate the notice to the passenger and selectively varying a color and intensity of the one or more of the sections according to attributes of the notice, and wherein the electronic input specifies information from an eye tracking device that indicates a present viewing area of the passenger in addition to information from a seat circuit to refine a determination of the present viewing area.

18. The method of claim 14, wherein determining the viewing orientation of the passenger includes determining that the passenger is using a mobile device when the at least one electronic input identifies that the mobile device is in active use, and

wherein controlling the at least one alerting device includes controlling the mobile device to display the notice when the mobile device is in active use.

19. The method of claim 14, wherein selecting the at least one alerting device includes selecting an audio device when the viewing orientation indicates that the passenger is inattentive to the available communication devices within the vehicle, and wherein controlling the at least one alerting device to communicate the notice when the at least one alerting device is the audio device includes controlling the audio device to produce audible sounds that alert the passenger to the notice.

20. The method of claim 14, wherein receiving the notice includes receiving the notice while the vehicle is operating in an autonomous mode that includes the vehicle self-driving without receiving direct control input from a driver that is the passenger, and

wherein controlling the at least one alerting device includes controlling a seat of the passenger to move into a position in which the passenger is viewing a primary instrument panel of the vehicle when the notice is associated with a handover from the autonomous mode to a manual mode in which the passenger is to control the vehicle.