Sensory stimulation system for an autonomous vehicle

• US 9,789,880 B2
• Filed: 03/03/2016
• Issued: 10/17/2017
• Est. Priority Date: 03/03/2016
• Status: Active Grant

• Current Assignee: Uber Technologies, Inc.
• Original Assignee: Uber Technologies, Inc.
• Inventors: Sweeney, Matthew, Bartel, Emily
• Primary Examiner(s): PAIGE, TYLER D
• Application Number:
  US15/059,493
• Publication Number:
  US 20170253254A1
• Time in Patent Office: 593 Days
• Field of Search: 701 23
• CPC Class Codes: A61M 2021/0022 by the tactile sense, e.g. vibrations
• CPC Class Codes: A61M 2021/0027 by the hearing sense
• CPC Class Codes: A61M 2021/0044 by the sight sense
• CPC Class Codes: A61M 21/00 Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
• CPC Class Codes: A61M 2205/332 Force measuring means
• CPC Class Codes: B60H 1/00764 the input being a vehicle driving condition, e.g. speed B60H1/00828, B60H1/00864 take precedence
• CPC Class Codes: B60N 2/0244 with logic circuits
• CPC Class Codes: B60N 2/14 rotatable, e.g. to permit easy access B60N2/10 , B60N2/2869 take precedence
• CPC Class Codes: B60N 2/185 characterised by the drive mechanism
• CPC Class Codes: B60N 2002/981 Warning systems, e.g. the seat or seat parts vibrates to warn the passenger when facing a danger
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 2300/207 using multi-purpose displays, e.g. camera image and navigation or video on same display
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60W 40/10 related to vehicle motion
• CPC Class Codes: B60W 50/16 Tactile feedback to the driver, e.g. vibration or force feedback to the driver on the steering wheel or the accelerator pedal
• CPC Class Codes: G05D 1/02 Control of position or course in two dimensions

Abstract

A sensory stimulation system for autonomous vehicle (AV) can monitor a set of maneuvers of the AV. Based on each respective maneuver, the sensory stimulation system can determine a set of sensory stimulation outputs to provide a rider of the AV with sensory indications of the respective maneuver. The sensory stimulation system can then output the set of sensory stimulation outputs via an interior output system.

Claims

1. A sensory stimulation system for an autonomous vehicle (AV), the sensory stimulation system comprising:

an output system;

one or more processors; and

one or more memory resources storing instructions that, when executed by the one or more processors, causes the sensory stimulation system to;

monitor a set of maneuvers of the AV;

based on each respective maneuver of the set, determine a set of sensory stimulation outputs to provide a rider of the AV with sensory indications of the respective maneuver; and

output the set of sensory stimulation outputs via the output system;

wherein the output system comprises a light bar within an interior of the AV, and wherein the set of sensory stimulation outputs comprise visual responses on the light bar to each of the set of maneuvers.

2. The sensory stimulation system of claim 1, wherein

the set of maneuvers comprise acceleration, braking, and change of direction actions to be performed by the AV.

3. The sensory stimulation system of claim 2, wherein the executed instructions cause the sensory stimulation system to output the visual responses on the light bar for each of the acceleration, braking, and change of direction actions.

4. The sensory stimulation system of claim 1, wherein the light bar comprises multi-colored light elements, and wherein the executed instructions cause the sensory stimulation system to determine the set of sensory stimulation outputs by selecting a color and a brightness for the light bar to indicate the respective maneuver.

5. The sensory stimulation system of claim 2, wherein the output system further comprises at least one display unit within the interior of the AV, and wherein the set of sensory stimulation outputs comprises a live presentation on the at least one display unit, the live presentation indicating the respective maneuver.

6. The sensory stimulation system of claim 5, wherein the executed instructions cause the sensory stimulation system to dynamically generate the live presentation to include (i) a visual representation of the AV traveling along a current route, and (ii) preemptive and dynamic visual indications of each of the acceleration, braking, and change of direction actions to be performed by the AV.

7. The sensory stimulation system of claim 1, wherein the output system further comprises one or more controllable seats, and wherein the set of sensory stimulation outputs includes seat commands to operate the one or more controllable seats based on each respective maneuver.

8. The sensory stimulation system of claim 7, wherein each of the one or more controllable seats comprises a haptic system, and wherein the seat commands cause the haptic system to provide a haptic indication of the respective maneuver.

9. The sensory stimulation system of claim 7, wherein each of the one or more controllable seats comprises at least one motor to control at least pitch and roll of the controllable seat, and wherein the seat commands cause the at least one motor to adjust one or more of a pitch or a roll of the controllable seat based on the respective maneuver.

10. The sensory stimulation system of claim 9, wherein the at least one motor further controls yaw of the controllable seat, and wherein the seat commands further cause the at least one motor to adjust a yaw of the controllable seat based on the respective maneuver.

11. The sensory stimulation system of claim 1, wherein the output system further comprises an airflow system to provide air pressure outputs to the rider, and wherein the set of sensory stimulation outputs includes one or more air pressure outputs providing the rider with vestibular stimulation to indicate the respective maneuver.

12. The sensory stimulation system of claim 11, wherein the executed instructions cause the sensory stimulation system to output the one or more air pressure outputs to the rider to preemptively indicate the respective maneuver.

13. The sensory stimulation system of claim 11, wherein the executed instruction cause the sensory stimulation system to output the one or more air pressure outputs to the rider to indicate the respective maneuver as the AV performs the respective maneuver.

14. The sensory stimulation system of claim 11, wherein the executed instructions cause the sensory stimulation system to adjust an intensity of each the one or more air pressure outputs based on an intensity of the respective maneuver.

15. An autonomous vehicle (AV) comprising:

a sensor system to generate sensor data indicating a situational environment of the AV;

acceleration, steering, and braking systems; and

a control system comprising one or more processors and one or more memory resources storing instructions that, when executed by the one or more processors, cause the control system to;

process the sensor data to autonomously control the acceleration, steering, and braking systems along a current route;

monitor a set of maneuvers of the AV;

based on each respective maneuver of the set, determine a set of sensory stimulation outputs to provide a rider of the AV with sensory indications of the respective maneuver; and

output the set of sensory stimulation outputs via an output system of the AV;

wherein the output system comprises a light bar within an interior of the AV, and wherein the set of sensory stimulation outputs comprise visual responses on the light bar to each of the set of maneuvers.

16. The AV of claim 15, wherein the set of maneuvers comprise acceleration, braking, and change of direction actions performed by the control system in autonomously operating the acceleration, steering, and braking systems.

17. The AV of claim 16, wherein the executed instructions cause the control system to output the visual responses on the light bar for each of the acceleration, braking, and change of direction actions.

18. The AV of claim 15, wherein the light bar comprises multi-colored light elements, and wherein the executed instructions cause the control system to determine the set of sensory stimulation outputs by selecting a color and a brightness for the light bar to indicate the respective maneuver.

19. The AV of claim 16, wherein the output system further comprises at least one display unit within the interior of the AV, and wherein the set of sensory stimulation outputs comprises a live presentation on the at least one display unit, the live presentation including (i) a visual representation of the AV traveling along a current route, and (ii) preemptive and dynamic visual indications of each of the acceleration, braking, and change of direction actions performed by the AV.

20. A non-transitory computer readable medium storing instructions for providing sensory stimulation for one or more riders to indication motion of an autonomous vehicle (AV), wherein the instructions, when executed by one or more processors, cause the one or more processors to:

monitor a set of maneuvers of the AV;

based on each respective maneuver of the set, determine a set of sensory stimulation outputs to provide a rider of the AV with sensory indications of the respective maneuver; and

output the set of sensory stimulation outputs via an output system of the AV;

wherein the output system comprises a light bar within an interior of the AV, and wherein the set of sensory stimulation outputs comprise visual responses on the light bar to each of the set of maneuvers.