Detection of mobile computing device use in motor vehicle

• US 9,137,498 B1
• Filed: 08/16/2011
• Issued: 09/15/2015
• Est. Priority Date: 08/16/2011
• Status: Expired due to Fees

• Current Assignee: L'Heureux, Israel, Mark D. Alleman
• Original Assignee: L'Heureux, Israel, Mark D. Alleman
• Inventors: L'Heureux, Israel, Alleman, Mark D.
• Primary Examiner(s): Torrente, Richard
• Assistant Examiner(s): Habib, Irfan
• Application Number:
  US13/210,535
• Time in Patent Office: 1,491 Days
• Field of Search: 348/148
• US Class Current: 1/1
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 20/62 Text, e.g. of license plates, overlay texts or captions on TV images
• CPC Class Codes: G06V 20/625 License plates
• CPC Class Codes: G08G 1/0175 by photographing vehicles, e.g. when violating traffic rules
• CPC Class Codes: G08G 1/04 using optical or ultrasonic detectors
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

Embodiments for the detection of mobile device use in a motor vehicle are disclosed. As one example, a system and method are disclosed in which an image of a scene is captured via a camera. The presence of a graphical display of a mobile device is detected within the scene by processing the image to identify a signature pixel characteristic indicative of a graphical display in a portion of the scene corresponding to a driver'"'"'s position within a vehicle frame of reference. An indication of a positive detection of the graphical display is output by the system.

Claims

1. A method performed by a computing device for detecting presence of an illuminated graphical display of a mobile device within a motor vehicle, the method comprising:

capturing, by a camera, an image of the vehicle being operated on a public roadway responsive to satisfaction of a trigger condition indicating presence of the vehicle;

receiving the image of the vehicle being operated on a public roadway captured by the camera;

determining a location of a driver'"'"'s seat region of the vehicle corresponding to a darker geometric region within the image that is representative of a window of the vehicle;

searching within window of the vehicle within the image for pixels of a signature pixel characteristic having a high luminosity relative to other pixels of the darker geometric region and/or a characteristic hue within a predefined range;

identifying an area of contiguous pixels of the signature pixel characteristic within the image indicative of the illuminated graphical display of the mobile device;

determining whether the area of contiguous pixels appears within a border of a trapezoidal shape having an aspect ratio that is within a predetermined range of a target 4;

3 aspect ratio; and

outputting an indication of a positive detection of the illuminated graphical display of the mobile device within the image if the aspect ratio of the border of the trapezoidal shape is within the predetermined range of the target 4;

3 aspect ratio.

2. The method of claim 1, wherein the signature pixel characteristic further includes one or more of a chroma and/or a brightness within respective predefined ranges.

3. The method of claim 1, wherein outputting the indication includes presenting the image via a graphical display for inspection by personnel.

4. The method of claim 1, wherein outputting the indication includes transmitting image data including the image to a remote computing device via a communication network.

5. The method of claim 1, wherein outputting the indication includes mailing the image to a mailing address associated with the vehicle along with a government issued citation.

6. The method of claim 1, wherein the image is a first image, the method further comprising:

capturing a second image from a different perspective than the first image, the different perspective enabling a license plate of the vehicle to be visible in the second image; and

presenting the second image or outputting an identifier of the license plate captured in the second image responsive to positive detection of the illuminated graphical display.

7. The method of claim 1, further comprising:

applying a filter to the image to identify the signature pixel characteristic.

8. The method of claim 1, further comprising:

further processing the image to identify a finger of the driver obstructing a portion of the trapezoidal shape corresponding to the illuminated graphical display.

9. A system for detection of a driver'"'"'s mobile device use while operating a motor vehicle, comprising:

a camera positioned to capture an image of a driver'"'"'s side of the motor vehicle while the vehicle is being operated on a public roadway; and

a computing device being configured to;

capture, by the camera, the image of the vehicle being operated on the public roadway responsive to satisfaction of a trigger condition indicating presence of the vehicle;

receive the image of the vehicle captured by the camera;

determine a location of a driver'"'"'s seat region of the vehicle corresponding to a darker geometric region within the image that is representative of a window of the vehicle;

search within window of the vehicle within the image for pixels of a signature pixel characteristic having a high luminosity relative to other pixels of the darker geometric region and/or a characteristic hue within a predefined range;

identify an area of contiguous pixels of the signature pixel characteristic within the image indicative of an illuminated graphical display of the mobile device;

determine whether the area of contiguous pixels appears within a border of a trapezoidal shape having an aspect ratio that is within a predetermined range of a target 4;

3 aspect ratio; and

output an indication of a positive detection of the illuminated graphical display of the mobile device within the image if the aspect ratio of the border of the trapezoidal shape is within the predetermined range of the target 4;

3 aspect ratio.

10. The system of claim 9, wherein the signature pixel characteristic further includes one or more of a chroma and/or a brightness within respective predefined ranges.

11. The system of claim 9, wherein the computing device is configured to identify the window as a driver'"'"'s side window by extracting features of the vehicle including detected wheels and/or outline of the vehicle, and locating the estimated position of the driver'"'"'s side window based on the extracted features.

12. The system of claim 9, wherein the computing device is further configured to process the image by identifying the signature pixel characteristic in each of a plurality of contiguous pixels of the subject pixel region covering at least a threshold area within the image.

13. The system of claim 9, further comprising:

a sensor configured to sense a predetermined position of the motor vehicle;

a controller being configured to receive a signal from the sensor indicating the motor vehicle is in the predetermined position, and in response to send a signal to the camera to cause the camera to capture the image.

14. The system of claim 13, wherein the controller is configured to associate meta data with the image including location and time.