Creating a sensory experience in a vehicle

• US 9,096,128 B2
• Filed: 01/14/2013
• Issued: 08/04/2015
• Est. Priority Date: 01/14/2013
• Status: Active Grant

• Current Assignee: Tahoe Research Limited (f/k/a Learndale Limited) (Vector Capital Corporation)
• Original Assignee: Intel Corporation
• Inventors: Shaw, David I., Wouhaybi, Rita H.
• Primary Examiner(s): Cheung, Mary
• Assistant Examiner(s): WONG, YUEN H
• Application Number:
  US13/740,510
• Publication Number:
  US 20140200762A1
• Time in Patent Office: 932 Days
• Field of Search: 701/36
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/182 Distributing information between displays
• CPC Class Codes: B60K 2360/186 Displaying information according to relevancy
• CPC Class Codes: B60K 2360/191 Highlight information
• CPC Class Codes: B60K 2360/563 Vehicle displaying mobile device information
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60K 35/80 Arrangements for controlling instruments

Abstract

Systems and methods directed to creating a sensory experience in a vehicle are described herein. Data may be received from one or more sources. Device data may be generated based at least in part on the received data. One or more output components associated with the vehicle may be identified. The device data may be transmitted to one or more output components for output to a user of the vehicle.

Claims

1. A computer-implemented method comprising:

receiving, by one or more processors, sensed data associated with a scene of an outside environment of a vehicle from at least one of one or more sensors associated with the vehicle, one or more sensors of a second vehicle, a database, or a website in real time;

combining the sensed data, by the one or more processors, to generate device data;

extracting, by the one or more processors, one or more objects or streams of device data to create an in-vehicle sensory experience of the scene of the outside environment of the vehicle, wherein content of the in-vehicle sensory experience comprises at least one of one or more videos, sounds, objects, or surfaces;

modifying, by the one or more processors, the device data to compose the outside environment of the vehicle;

identifying, by the one or more processors, one or more output components associated with the vehicle, wherein the one or more output components comprise at least one of one or more projectors, a climate control system, an audio system, or a dashboard panel;

sending, by the one or more processors, instructions to an output module to display the scene of the outside environment of the vehicle on one or more interior surfaces of the vehicle; and

creating, by the one or more processors, the in-vehicle sensory experience in the vehicle by sending the device data to the one or more output components associated with the vehicle for output to a user of the vehicle.

2. The computer-implemented method of claim 1, further comprising storing, by the one or more processors, the device data on a server.

3. The computer-implemented method of claim 1, further comprising receiving, by the one or more processors, a second device data obtained from a device data market.

4. The computer-implemented method of claim 1, wherein the one or more output components comprise at least one of one or more projectors associated with the vehicle, one or more speakers associated with the vehicle, one or more display panels associated with the vehicle, or a heating and air conditioning system associated with the vehicle.

5. The computer-implemented method of claim 1, further comprising:

establishing, by the one or more processors, a connection with one or more devices; and

sending, by the one or more processors, the device data to the one or more devices for output.

6. A system comprising:

one or more computers comprising;

at least one processor; and

at least one memory storing computer-executable instructions, wherein the at least one processor is operable to access the at least one memory and execute the computer-executable instructions to;

receive sensed data associated with a scene of an outside environment of a vehicle from at least one of one or more sensors associated with the vehicle, one or more sensors of a second vehicle, a database, or a website in real time;

combine the sensed data to generate device data;

extract one or more objects or streams of device data to create an in-vehicle sensory experience of the scene of the outside environment of the vehicle, wherein content of the in-vehicle sensory experience comprises at least one of one or more videos, sounds, objects, or surfaces;

modify the device data to compose the outside environment of the vehicle;

identify one or more output components associated with the vehicle, wherein the one or more output components comprise at least one of one or more projectors, a climate control system, an audio system, or a dashboard panel;

send instructions to an output module to display the scene of the outside environment of the vehicle on one or more interior surfaces of the vehicle; and

create the in-vehicle sensory experience in the vehicle by sending the device data to one or more output components associated with the vehicle for output to a user of the vehicle.

7. The system of claim 6, wherein the one or more output components further comprises at least one of one or more speakers, one or more projectors, one or more display panels associated with the vehicle, or an environmental system associated with the vehicle.

8. The system of claim 6, wherein the at least one processor is further configured to execute the computer-executable instructions to:

store the generated device data.

9. The system of claim 8, wherein the at least one processor is further configured to execute the computer-executable instructions to:

facilitate access to the stored device data to one or more users via at least one network.

10. The system of claim 6, wherein the received data comprises at least one of device data associated with the vehicle, device data associated with a second vehicle, or device data generated by a third party.

11. The system of claim 6, wherein the at least one processor is further configured to execute the computer-executable instructions to:

process the received data based at least in part on sensor fusion; and

generate the device data based at least in part on the processed data.

12. A non-transitory computer-readable storage medium having stored therein instructions, that when executed by a computing device, cause the computing device to perform functions comprising:

receiving sensed data associated with a scene of an outside environment of a vehicle from at least one of one or more sensors associated with the vehicle, one or more sensors of a second vehicle, a database, or a website in real time;

combining the received data to generate device data;

extracting one or more objects or streams of device data to create an in-vehicle sensory experience of the scene of the outside environment of the vehicle, wherein content of the in-vehicle sensory experience comprises at least one of one or more videos, sounds, objects, or surfaces;

modifying the device data to compose the outside environment of the vehicle;

identifying one or more output components associated with the vehicle, wherein the one or more output components comprise at least one of one or more projectors, a climate control system, an audio system, or a dashboard panel;

sending instructions to an output module to display the scene of the outside environment of the vehicle on one or more interior surfaces of the vehicle; and

creating the in-vehicle sensory experience in the vehicle by sending the device data to the one or more output components associated with the vehicle for output to a user of the vehicle.

13. The non-transitory computer-readable storage medium of claim 12, further comprising:

sending instructions to adjust a climate control system associated with the vehicle based at least in part on the device data.

14. The non-transitory computer-readable storage medium of claim 12, wherein generating the device data further comprises:

processing the received data from the one or more data sensors associated with the vehicle based at least in part on sensor fusion;

extracting relevant content from the processed data; and

generating device data based at least in part on the extracted content.

15. The non-transitory computer-readable storage medium of claim 12, further comprising:

projecting a user interface on a surface of the vehicle;

receiving interaction data, wherein the interaction data is captured by one or more vehicle sensors and the interaction data captures the interaction of one or more users with the projected user interface; and

processing the interaction data.

16. The non-transitory computer-readable storage medium of claim 15, further comprising

sending instructions to one or more vehicle components associated with the user interface based at least in part on the processed interaction data.