Vision based alert system using portable device with camera

• US 7,482,937 B2
• Filed: 03/24/2006
• Issued: 01/27/2009
• Est. Priority Date: 03/24/2006
• Status: Expired due to Fees

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Motorola, Inc. (Motorola Solutions, Inc.)
• Inventors: Kujawa, Gregory A., Chai, Sek M.
• Primary Examiner(s): Mullen; Thomas J
• Application Number:
  US11/277,377
• Publication Number:
  US 20070222617A1
• Time in Patent Office: 1,040 Days
• Field of Search: 340/576, 340/439, 340/575, 701/36, 701/49, 348/143, 348/148, 348/158, 348/159, 348/373, 348/376
• US Class Current: 340/576
• CPC Class Codes: B60W 2040/0818 Inactivity or incapacity of driver
• CPC Class Codes: B60W 2040/0872 Driver physiology
• CPC Class Codes: B60W 40/09 Driving style or behaviour
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Abstract

An alert system is activated in response to an event by positioning a portable electronic device, a cellular telephone or PDA for example, such that a camera of the electronic device is orientated to capture images relating to a visual criterion by which the event is to be detected. Images relating to the visual criterion are processed to detect the event and an alert system is activated if an event is detected. In one application, the portable device is held in a holder in a vehicle and used to detect vehicle lane departure or driver drowsiness.

Claims

1. A method for activating an alert in response to an event, the method comprising:

positioning a portable electronic device such that a camera of the electronic device is orientated to capture images relating to a visual criterion by which the event is to be detected;

processing the images relating to the visual criterion on a processor of the portable electronic device to detect the event;

activating an alert related to the event based upon an output signal of the portable electronic device;

downloading a program of instructions to the portable electronic device via a wireless communication link; and

executing the program of instructions on the processor of the portable electronic device.

2. A method in accordance with claim 1, wherein the portable electronic device is positioned in a vehicle and wherein the visual criterion comprises the position of the vehicle on a road.

3. A method in accordance with claim 1, wherein the portable electronic device is positioned in a vehicle and wherein positioning the portable electronic device comprises mounting the portable electronic device in a holder attached to the vehicle.

4. A method in accordance with claim 3, wherein positioning the electronic device is performed automatically by the holder.

5. A method in accordance with claim 1, wherein activating the alert based upon the output signal of the portable electronic device comprises emitting sound from a loudspeaker of the portable electronic device.

6. A method in accordance with claim 1, wherein activating the alert based upon the output signal of the portable electronic device comprises signaling an alert system external to the portable electronic device.

7. A method in accordance with claim 6, wherein signaling an alert system external to the portable electronic device comprises signaling via a wireless communication link.

8. A method in accordance with claim 6, wherein the alert system is selected from a group of alert systems consisting of an audio system, a visual system and a haptic system.

9. A method in accordance with claim 1, wherein the portable electronic device is positioned in a vehicle and further comprising:

the portable electronic device receiving vehicle information from the vehicle; and

the portable electronic device using the vehicle information to assist the detection of an event.

10. A method in accordance with claim 1, wherein the portable electronic device is positioned in a vehicle and further comprising the portable electronic device transmitting information to the vehicle.

11. A method in accordance with claim 1 further comprising:

presenting a user interface to a user of the portable electronic device; and

selecting the program of instructions from a plurality of programs of instructions dependent upon the user'"'"'s interaction with the user interface.

12. A method in accordance with claim 1 farther comprising:

presenting a user interface to a user of the portable electronic device; and

selecting input values for the program of instructions dependent upon the user'"'"'s interaction with the user interface.

13. A system for activating an alert in response to an event, the system comprising:

a portable electronic device comprising a camera, a processor, and a communication circuit; and

an alert system adapted to generate an alert signal in response to a signal from the communication circuit of the portable electronic device;

wherein the processor of the portable electronic device is operable to process images from the camera, detect the event from features of the images, and control the communication circuit to signal the alert system if the event is detected,

wherein the processor is further operable to download a program of instructions to the portable electronic device via a wireless communication link and to execute the program of instructions.

14. A system in accordance with claim 13, wherein the portable electronic device comprises a cellular telephone.

15. A system in accordance with claim 14, wherein the cellular telephone further comprises a loudspeaker and wherein the alert system comprises the loudspeaker of the cellular telephone.

16. A holder of a system for activating an alert in response to an event, the holder comprising:

a support element operable to support a portable electronic device and orient a camera of the portable electronic device to capture images relating to a visual characteristic of the event;

an image transfer element operable to transfer images from the portable device to the holder; and

a communication circuit operable to couple the holder to an alert system.

17. A holder in accordance with claim 16, wherein the orientation of the holder is adjusted automatically to orient the camera of the portable electronic device.

18. A holder in accordance with claim 16, wherein the holder is operable to orient the camera of the portable electronic device.

19. A holder in accordance with claim 16, wherein the holder further comprises a processor and wherein the processor of the holder and the portable electronic device jointly process images from the camera, detect the event from features of the images and control the communication circuit to signal the alert system if the event is detected.

20. A holder in accordance with claim 16, wherein the holder is operable to illuminate the field of view of the camera.

21. A holder in accordance with claim 16, wherein the holder further comprises a processor operable to process images from the camera, detect the event from features of the images and control the communication circuit to signal the alert system if the event is detected.

22. A method for activating an alert in response to an event, the method comprising:

positioning a portable electronic device such that a camera of the electronic device is orientated to capture images relating to a visual criterion by which the event is to be detected;

processing the images relating to the visual criterion on a processor of the portable electronic device to detect the event; and

activating an alert related to the event based upon an output signal of the portable electronic device,

wherein the event comprises the appearance of drowsiness of a person and wherein the visual criterion relates to the person'"'"'s eyes.