System and method to place subjective messages on a vehicle

• US 9,959,792 B2
• Filed: 09/29/2016
• Issued: 05/01/2018
• Est. Priority Date: 09/29/2016
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Singireddy, Anvesh
• Primary Examiner(s): HSIEH, PING Y
• Application Number:
  US15/280,076
• Publication Number:
  US 20180090039A1
• Time in Patent Office: 579 Days
• CPC Class Codes: B60Q 1/50 for indicating other intentions or conditions, e.g. request for waiting or overtaking
• CPC Class Codes: G06V 10/462 Salient features, e.g. scale invariant feature transforms [SIFT]
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G09F 19/18 involving the use of optical projection means, e.g. projection of images on clouds projection apparatus per se G03B
• CPC Class Codes: G09F 21/04 by land vehicles
• CPC Class Codes: G09F 21/042 the advertising matter being fixed on the roof of the vehicles
• CPC Class Codes: G09F 21/048 Advertisement panels on sides, front or back of vehicles
• CPC Class Codes: G09F 27/00 Combined visual and audible advertising or displaying, e.g. for public address

Abstract

A system to exhibit subjective messages on a vehicle including a memory, controller, transceiver, external display, camera, image recognition module, and technology platform. The memory is configured to comprise modules of executable instructions. The controller is configured to read and execute the modules. The transceiver is configured to communicate data transmissions. The external display is configured to exhibit information on the vehicle, visible in the external environment. The camera is configured to capture an image of the vehicle environment. The executable instructions enable the controller to: receive an image of the vehicle environment comprising a selected object; perform the image recognition module to identify the selected object; receive the results of the image recognition module; communicate the results to the technology platform; receive subjective message information from the technology platform; and operate the external display to exhibit the subjective message information to the vehicle environment.

Claims

1. A system to exhibit one or more subjective messages on a vehicle, the system comprising:

a memory configured to comprise one or more modules of executable instructions;

a controller configured to read and execute the modules;

a transceiver configured to communicate one or more data transmissions;

an external display configured to exhibit information on a vehicle, the information being visible in the environment external to the vehicle;

a camera located on the vehicle, the camera configured to view or capture or view and capture an image of a selected portion of the vehicle environment;

an image recognition module;

wherein the executable instructions enable the controller to;

receive, from the camera, an image of the vehicle environment comprising at least one of a driver, passenger, vehicle logo, vehicle model, and license plate;

perform the image recognition module to identify the at least one of a driver, passenger, vehicle logo, vehicle model, and license plate;

receive the results of the image recognition module;

communicate the results, via the transceiver, to an advertising exchange, wherein the advertising exchange facilitates the buying and selling of advertising information from multiple advertising networks, wherein the advertising exchange is configured to enable a publisher to provide advertising information as subjective message information based on the results of the image recognition module through the advertising exchange;

receive subjective message information, via the transceiver, from the advertising exchange; and

operate the external display to exhibit the subjective message information to the vehicle environment.

2. The system of claim 1, further comprising:

at least one GPS module, the GPS module configured to provide vehicle coordinate information;

one or more vehicle system modules (VSMs) configured to provide vehicle dynamics information, wherein the vehicle dynamics information comprises speedometer data information, odometer data information, vehicle suspension compression ratio information, anti-lock brake activity information, vehicle environment temperature data information, vehicle environment ambient light information, and windshield wiper power information;

wherein the executable instructions further enable the controller to;

receive, from the at least one GPS module, vehicle coordinate information;

receive, from the one or more VSMs, vehicle dynamics information; and

manipulate the subjective message information based on both the vehicle dynamics information and the vehicle coordinate information.

3. The system of claim 2, wherein

the manipulation of the subjective message comprises adjustments to at least one of the font size, image color scheme, and image brightness.

4. The system of claim 1, wherein the image recognition module comprises:

a keypoints-based comparison;

a visual symbol comparison comprising a comparison of at least one character or symbol that appears on or in connection with the selected object, wherein the visual symbol comparison comprises a cosine comparison;

a region-based color comparison; and

a sensor modalities analysis.

5. The system of claim 1, wherein the image recognition module comprises a comparison of one or more text, logos, alphanumeric characters, driver observable characteristics, passenger observable characteristics, or a combination thereof.

6. The system of claim 1, wherein the subjective message is commercial in nature.

7. The system of claim 1, wherein the vehicle environment is located behind, on the side of, or above the vehicle.

8. A method to exhibit one or more subjective messages on a vehicle, the method comprising:

providing a memory configured to comprise one or more modules of executable instructions;

providing a controller configured to read and execute the modules;

providing a transceiver configured to communicate one or more data transmissions;

providing an external display configured to exhibit information on a vehicle, the information being visible in the environment external to the vehicle;

providing a camera located on the vehicle, the camera configured to view or capture or view and capture an image of a selected portion of the vehicle environment;

providing an image recognition module;

receiving, from the camera, an image of the vehicle environment comprising at least one of a driver, passenger, vehicle logo, vehicle model, and license plate;

performing, via the controller, the image recognition module to identify the at least one of a driver, passenger, vehicle logo, vehicle model, and license plate;

receiving, at the controller, the results of the image recognition module;

communicating, via the transceiver, the results to an advertising exchange, wherein the advertising exchange facilitates the buying and selling of advertising information from multiple advertising networks, wherein the advertising exchange is configured to enable a publisher to provide advertising information as subjective message information based on the results of the image recognition module through the advertising exchange, via the transceiver, subjective message information from the advertising exchange; and

operating, via the controller, the external display to exhibit the subjective message information to the vehicle environment.

9. The method of claim 8, further comprising:

providing at least one GPS module, the GPS module configured to provide vehicle coordinate information;

providing one or more vehicle system modules (VSMs) configured to provide vehicle dynamics information, wherein the vehicle dynamics information comprises speedometer data information, odometer data information, vehicle suspension compression ratio information, anti-lock brake activity information, vehicle environment temperature data information, vehicle environment ambient light information, and windshield wiper power information;

receiving, from the at least one GPS module, vehicle coordinate information;

receiving, from the one or more VSMs, vehicle dynamics information; and

manipulating, via the controller, the subjective message information based on both the vehicle dynamics information and the vehicle coordinate information.

10. The method of claim 9, wherein

the manipulation of the subjective message comprises adjustments to at least one of the font size, image color scheme, and image brightness.

11. The method of claim 8, wherein the image recognition module comprises:

a keypoints-based comparison;

a visual symbol comparison comprising a comparison of at least one character or symbol that appears on or in connection with the selected object, wherein the visual symbol comparison comprises a cosine comparison;

a region-based color comparison; and

a sensor modalities analysis.

12. The method of claim 8, wherein the image recognition module comprises a comparison of one or more text, logos, alphanumeric characters, driver observable characteristics, passenger observable characteristics, or a combination thereof.

13. The method of claim 8, wherein the subjective message is commercial in nature.

14. The method of claim 8, wherein the vehicle environment is located behind, on the side of, or above the vehicle.

15. A method to exhibit one or more subjective commercial messages on a vehicle back-glass window, the method comprising:

providing a memory configured to comprise one or more modules of executable instructions;

providing a controller configured to read and execute the modules;

providing a transceiver configured to communicate one or more data transmissions;

providing an external display configured to exhibit information on the back-glass window, the information being visible in the environment behind the vehicle;

providing a camera located on the vehicle, the camera configured to view or capture or view and capture an image of a selected portion of the vehicle environment;

providing an image recognition module;

providing at least one GPS module, the GPS module configured to provide vehicle coordinate information;

providing one or more vehicle system modules (VSMs) configured to provide vehicle dynamics information, wherein the vehicle dynamics information comprises speedometer data information, odometer data information, vehicle suspension compression ratio information, anti-lock brake activity information, vehicle environment temperature data information, vehicle environment ambient light information, and windshield wiper power information;

receiving, from the camera, an image of the vehicle environment comprising a driver, vehicle logo, vehicle model, and license plate;

receiving, from the one or more VSMs, vehicle dynamics information;

receiving, from the at least one GPS module, vehicle coordinate information;

performing, via the controller, the image recognition module to identify at least one of the driver, vehicle logo, vehicle model, and license plate;

receiving, at the controller, the results of the image recognition module;

communicating, via the transceiver, the results to an advertising exchange, wherein the advertising exchange facilitates the buying and selling of advertising information from multiple advertising networks, wherein the advertising exchange is configured to enable a publisher to provide advertising information as subjective message information based on the results of the image recognition module through the advertising exchange;

receiving, via the transceiver, subjective commercial message information from the advertising exchange;

manipulating, via the controller, the subjective commercial message information based on both the vehicle dynamics information and the vehicle coordinate information;

operating, via the controller, the external display to exhibit the subjective message information to the vehicle environment.

16. The method of claim 15, wherein

the manipulation of the subjective message comprises adjustments to at least one of the font size, image color scheme, and image brightness.

17. The method of claim 15, wherein the image recognition module comprises:

a keypoints-based comparison;

a visual symbol comparison comprising a comparison of at least one character or symbol that appears on or in connection with the selected object, wherein the visual symbol comparison comprises a cosine comparison;

a region-based color comparison; and

a sensor modalities analysis.

18. The method of claim 15, wherein the image recognition module comprises a comparison of one or more text, logos, alphanumeric characters, driver observable characteristics, passenger observable characteristics, or a combination thereof.