Virtual convertible tops, sunroofs, and back windows, and systems and methods for providing same

• US 8,733,938 B2
• Filed: 03/07/2012
• Issued: 05/27/2014
• Est. Priority Date: 03/07/2012
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Sachdev, Anil K., Verbrugge, Mark W., Shaw, Byron T
• Primary Examiner(s): CHOWDHURY, SULTAN U.
• Application Number:
  US13/414,126
• Publication Number:
  US 20130235351A1
• Time in Patent Office: 811 Days
• Field of Search: 353 10- 13, 353/15, 353/22, 353/30, 353/46, 353 70- 71, 348/148, 348/E07.085, 348/E07.087, 349/5, 349 7- 11, 359/13, 359/865
• US Class Current: 353/13
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/23 with a predetermined field of view
• CPC Class Codes: B60R 2300/202 displaying a blind spot scene on the vehicle part responsible for the blind spot

Abstract

A virtual-sunroof system for providing a virtual sunroof at an interior of a vehicle for viewing by a passenger of the vehicle. The system includes a virtual-sunroof imaging device configured and arranged at the vehicle to collect image information from an environment above the vehicle and create digital image data using the image information. The system also includes a virtual-sunroof projection device configured and arranged in the vehicle to be in communication with the virtual-sunroof imaging device for providing a virtual sunroof display. The virtual sunroof display provided (a) is viewable above a head of the passenger, (b) is formed using the image data, (c) represents accurately at the interior of the vehicle a rendition of the environment above the vehicle, and (d) has a size, shape, and location corresponding generally to a size, shape, and location that an actual conventional-type sunroof would have in the vehicle.

Claims

1. A virtual-sunroof system, for providing a virtual sunroof at an interior of a vehicle for viewing by a passenger when the passenger is seated in the vehicle, comprising:

a virtual-sunroof image-collection device configured and arranged at the vehicle to sense an environment above the vehicle and create digital image data using the image information, wherein the sensing is performed continuously over time and the digital image data is updated in real-time based on the continuous sensing and any changes of the environment being sensed; and

a virtual-sunroof projection device configured and arranged in the vehicle to be in communication with the virtual-sunroof image-collection device for providing a virtual sunroof display that;

is viewable above a head of the passenger seated in the vehicle, where a conventional sunroof would be positioned but is absent;

is formed using the image data;

represents accurately at the interior of the vehicle a rendition of the environment above the vehicle in real-time as the image data is updated; and

has a size, shape, and location corresponding generally to a size, shape, and location that an actual conventional-type sunroof would have in the vehicle.

2. The virtual-sunroof system of claim 1, wherein:

the virtual-sunroof system further comprises;

a processor; and

a computer-readable storage device having instructions that, when executed by the processor, cause the processor to perform a method comprising;

receiving the image data from the virtual-sunroof image-collection device;

processing the image data to form processed image data; and

providing the processed image data post processing to the virtual-sunroof display device for providing the virtual sunroof;

the virtual-sunroof projection device, in being configured and arranged in the vehicle to be in communication with the virtual-sunroof image-collection device is configured to be in communication with the virtual-sunroof image-collection device by way of the processor; and

the virtual-sunroof projection device, in being configured and arranged in the vehicle to provide the display formed using the image data, is configured and arranged in the vehicle to provide the display formed using the processed image data.

3. The virtual-sunroof system of claim 2, wherein the operation of processing the image data comprises adding virtual information to the image data to form the processed image data.

4. The virtual-sunroof system of claim 3, wherein the operations further comprise receiving the virtual information from a source remote to the vehicle.

5. The virtual-sunroof system of claim 4, wherein the operation of receiving the virtual information from a source remote to the vehicle comprises receiving the virtual information from a source selected from a group of sources consisting of:

a remote customer-service center;

an entity near the vehicle; and

a global communications network.

6. The virtual-sunroof system of claim 4, wherein the operation of receiving the virtual information from a source remote to the vehicle comprises receiving the virtual information using a communication technology selected from a group of communication technologies consisting of:

a long-range communications standard; and

a short-range communications standard.

7. The virtual-sunroof system of claim 3, wherein the operations further comprise obtaining the virtual information from a database of the vehicle.

8. The virtual-sunroof system of claim 3, wherein the operation of adding the virtual information to the image data comprises adding to the image data virtual information that is related to an item of the environment above the vehicle sensed by the virtual-sunroof image-collection device.

9. The virtual-sunroof system of claim 3, wherein the operation of adding the virtual information to the image data comprises adding to the image data virtual information including text related to the environment.

10. The virtual-sunroof system of claim 2, wherein the processor and computer-readable storage device are parts of:

the virtual-sunroof image-collection device;

or

the virtual-sunroof projection device.

11. The virtual-sunroof system of claim 1, wherein the virtual-sunroof image-collection device includes at least one device selected from a group of devices consisting of:

a device capable of creating three-dimensional image data;

a charge coupled device;

an infra-red device;

a light detection and ranging device; and

a radio detection and ranging device.

12. The virtual-sunroof system of claim 1, wherein the virtual-sunroof projection device, in being configured and arranged in the vehicle to provide the virtual-sunroof display, is configured and arranged in the vehicle to provide the virtual-sunroof display having a virtual sunroof cover.

13. A virtual-convertible-top system, for providing a virtual convertible top at an interior of a vehicle for viewing by a passenger when the passenger is seated in the vehicle, comprising:

a virtual-convertible-top image-collection device configured and arranged at the vehicle to sense an environment above the vehicle and create, based on the sensing, digital image data using the image information, wherein the sensing is performed continuously over time and the digital image data is updated in real-time based on the continuous sensing and any changes of the environment being sensed; and

a virtual-convertible-top projection device configured and arranged in the vehicle to be in communication with the virtual-convertible-top image-collection device for providing a virtual-convertible-top display that;

is viewable above a head of the passenger seated in the vehicle, where the environment would be visible directly if the vehicle had a conventional convertible top down;

is formed using the image data; and

represents accurately, at the interior of the vehicle, a rendition of the environment above the vehicle in real-time as the image data is updated.

18. The virtual-convertible-top system of claim 13, wherein:

the image information is first image information;

the image data is second image data;

the virtual-convertible-top image-collection device is configured and arranged at the vehicle to collect second image information from an environment lateral of the vehicle and create second digital image data using the second image information; and

the virtual-convertible-top projection device is configured and arranged in the vehicle to, in providing the virtual-convertible-top display;

provide a first part of the display, formed using the first image data, on or adjacent a ceiling of the vehicle, to represent the environment above the vehicle; and

provide a second part of the display, formed using the second image data, on or adjacent a component of the vehicle other than the ceiling of the vehicle, to represent the environment lateral of the vehicle.

14. The virtual-convertible-top system of claim wherein:

the virtual-convertible-top system further comprises;

a processor; and

a computer-readable storage device having instructions that, when executed by the processor, cause the processor to perform operations comprising;

receiving the image data from the virtual-convertible-top image-collection device;

processing the image data to form processed image data; and

providing the processed image data to the virtual-convertible-top display device for providing the virtual convertible top;

the virtual-convertible-top projection device, in being configured and arranged in the vehicle to be in communication with the virtual-convertible-top image-collection device is configured to be in communication with the virtual-convertible-top image-collection device by way of the processor; and

the virtual-convertible-top projection device, in being configured and arranged in the vehicle to provide the display formed using the image data, is configured and arranged in the vehicle to provide the display formed using the processed image data.

15. The virtual-convertible-top system of claim 14, wherein the operation of processing the image data comprises adding virtual information to the image data to form the processed image data.

16. The virtual-convertible-top system of claim 15, wherein the operations further comprise receiving the virtual information from a source remote to the vehicle.

17. The virtual-convertible-top system of claim 15, wherein the operation of adding the virtual information to the image data comprises adding to the image data virtual information related to an item of the environment above the vehicle sensed by the virtual-convertible-top image-collection device.

19. A computer-readable storage device comprising instructions that, when executed by a processor, cause the processor to perform operations, for providing a virtual overhead display for viewing by a passenger seated in a vehicle, comprising:

receiving, from an image-collection device, overhead image data representing visual qualities of an environment above the vehicle, wherein the overhead image data is received continuously over time, and so representing over time any changes to the above-vehicle environment;

processing the overhead image data to form processed overhead image data; and

providing the processed overhead image data to a display device for use by the display device to provide the virtual overhead display, in real-time as the image data is updated in response to changing of the above-vehicle environment, to be viewable by the passenger seated in the vehicle.

20. The computer-readable storage device of claim 19 wherein:

the operation of processing the overhead image data to form processed image data comprises adding virtual information to the overhead image data to form the processed overhead image data; and

the operations further comprise obtaining the virtual information from a source selected from a group of sources consisting of;

a source remote to the vehicle;

a database of the vehicle; and

a global computer network.