Identifying a sensor in an autopilot vehicle

• US 10,386,848 B2
• Filed: 02/28/2017
• Issued: 08/20/2019
• Est. Priority Date: 02/28/2017
• Status: Active Grant

• Current Assignee: Malikie Innovations Limited (Key Patent Innovations Limited)
• Original Assignee: Blackberry Limited
• Inventors: Klische, Marcus
• Primary Examiner(s): Black, Thomas G
• Assistant Examiner(s): Kong, Sze-Hon
• Application Number:
  US15/445,446
• Publication Number:
  US 20180246519A1
• Time in Patent Office: 903 Days
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: G05D 1/0055 with safety arrangements
• CPC Class Codes: G05D 1/0061 for transition from automatic pilot to manual pilot and vice versa
• CPC Class Codes: G05D 1/0246 using a video camera in combination with image processing means
• CPC Class Codes: G06K 19/06009 with optically detectable marking G06K19/063, G06K19/08 take precedence
• CPC Class Codes: G06K 7/1404 Methods for optical code recognition
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle

Abstract

Systems, methods, and software can be used to identify a sensor on an autopilot vehicle. In some aspects, a video frame that is captured by a lens coupled to a vehicle is received. The video frame is determined to include an identifier of the lens. In response to determining that the video frame includes the identifier of the lens, the video frame is transmitted to an autopilot processor.

Claims

1. A method, comprising:

receiving, at an image processor, a video frame that is captured by a lens coupled to a vehicle, wherein the video frame includes an image of a micro pattern that indicates an identifier of the lens, and the micro pattern is engraved on the lens or a glass that is coupled with the lens;

determining, by the image processor, that the video frame captured by the lens includes the identifier of the lens; and

in response to determining that the video frame includes the identifier of the lens, transmitting the video frame to an autopilot processor that generates an autopilot command for the vehicle.

2. The method of claim 1, wherein the micro pattern comprises micro dots arranged in a 2-dimensional (2D) pattern.

3. The method of claim 1, further comprising:

prior to transmitting the video frame, encrypting the video frame using the identifier.

4. The method of claim 1, further comprising:

receiving, at the image processor, a second video frame;

determining, by the image processor, that the second video frame does not include the identifier of the lens; and

in response to determining that the second video frame does not includes the identifier of the lens, transmitting a notification to the autopilot processor indicating that a video frame without the identifier of the lens has been received.

5. The method of claim 1, wherein the method further comprises:

removing the micro pattern from the video frame before transmitting the video frame to the autopilot processor.

6. A video image capturing system for a vehicle, comprising:

a lens configured to capture a video frame, wherein the video frame includes an image of a micro pattern that indicates an identifier of the lens, and the micro pattern is engraved on the lens or a glass that is coupled with the lens;

a pre-processor configured to convert the video frame from an analog format to a digital format; and

an image processor configured to;

determine that the video frame captured by the lens includes the identifier of the lens; and

in response to determining that the video frame includes the identifier of the lens, transmit the video frame to an autopilot processor that generates an autopilot command for the vehicle.

7. The video image capturing system of claim 6, wherein the micro pattern comprises micro dots arranged in a 2-dimensional (2D) pattern.

8. The video image capturing system of claim 6, wherein the image processor is configured to:

prior to transmitting the video frame, encrypt the video frame using the identifier.

9. The video image capturing system of claim 6, wherein the image processor is configured to:

receive a second video frame;

determine that the second video frame does not include the identifier of the lens; and

in response to determining that the second video frame does not includes the identifier of the lens, transmit a notification to the autopilot processor indicating that a video frame without the identifier of the lens has been received.

10. The video image capturing system of claim 6, wherein the image processor is configured to:

remove the micro pattern from the video frame before transmitting the video frame to the autopilot processor.

11. A vehicle having an autopilot system, comprising:

a lens configured to capture a video frame, wherein the video frame includes an image of a micro pattern that indicates an identifier of the lens, and the micro pattern is engraved on the lens or a glass that is coupled with the lens;

a pre-processor configured to convert the video frame from an analog format to a digital format;

an image processor configured to;

determine that the video frame captured by the lens includes the identifier of the lens; and

in response to determining that the video frame includes the identifier of the lens, transmit the video frame to an autopilot processor; and

the autopilot processor communicatively coupled with a memory and configured to;

receive the video frame; and

generate an autopilot command for the vehicle.

12. The vehicle of claim 11, wherein the autopilot command comprises at least one of an acceleration command or a deceleration command.

13. The vehicle of claim 11, wherein the micro pattern comprises micro dots arranged in a 2-dimensional (2D) pattern.

14. The vehicle of claim 11, wherein the image processor is configured to:

prior to transmitting the video frame, encrypt the video frame using the identifier.

15. The vehicle of claim 11, wherein

the image processor is configured to:

receive a second video frame;

determine that the second video frame does not include the identifier of the lens; and

in response to determining that the second video frame does not includes the identifier of the lens, transmit a notification to the autopilot processor indicating that a video frame without the identifier of the lens has been received; and

the autopilot processor is configured to;

receive the notification; and

in response to receiving the notification, releasing a control of an autopilot operation of the vehicle.