Vehicle mounted navigation and incident recording device and method of operating

• US 20050162513A1
• Filed: 11/16/2004
• Published: 07/28/2005
• Est. Priority Date: 07/07/1999
• Status: Abandoned Application

• Current Assignee: Advanced Future Technologies Incorporated
• Original Assignee: Advanced Future Technologies Incorporated
• Inventors: Chan, David
• Application Number:
  US10/988,885
• Publication Number:
  US 20050162513A1
• Time in Patent Office: Days
• US Class Current: 348/118
• CPC Class Codes: G07C 5/085 using electronic data carriers

Abstract

A vehicle mounted, navigation device is disclosed. This invention combines a global position system (GPS) with an image capturing system into a portable device that can be optimally mounted within a vehicle. It can be used for land, air and sea vehicles. The image capturing system detects and interprets visual information to provide the vehicle operator with appropriate navigational guidance assistance and to alert operator of potentially hazardous conditions. Additionally, the device has the capability to store consecutive frames of detected, visual information so as to enable the device to be used for accident aftermath analysis and the documentation of an event or scene.

Claims

1. A digital in-vehicle device comprising:

an image capturing device for continuously capturing actual scene in real-time;

a vision microprocessor coupled to said image capturing device for controlling the operation of said image capturing device,

a vision memory device coupled to said vision microprocessor,

a persistent memory device coupled to said vision microprocessor, wherein said persistent memory device is a non-volatile storage device,

means connected to said vision microprocessor for triggering a permanent storage in response to selective triggering events, in said persistent memory device, of a plurality of consecutive frames of captured visual scene, wherein said permanent storage of a plurality of consecutive frames is achieved by means of prohibiting the current content in said persistent memory from being over-written by new images after a pre-programmed elapsed time period such that said plurality of consecutive frames stored are composed of a number of images captured so many seconds before and after said selective triggering events occur, wherein the number of said images stored is a function of the size of said persistent memory, wherein said persistent memory consisting of a finite number of storage elements overwritten repeatedly by said vision microprocessor in a first-in-first-out fashion so that a finite storage can be used to buffer up a plurality of said images continuously,

means connected to said vision microprocessor for manually triggering the said permanent storage, in said persistent memory device, of frames of said visual scene, wherein said manually triggering can be an action selected from the group consisting of taking snap shots of visual scene, taking a sequence of continuous images of visual scene, taking a sequence of continuous images of visual scene that makes up so many seconds before and after said trigger and freezing the activity of said continuously capturing visual information so as to prevent existing said images in said persistent memory of being replaced by new images in order to preserve existing said images,

wherein said stored frames can be used for various purposes, including accident aftermath analysis and documentation of the visual aspects of an event or scene; and

said microprocessor executing software being adaptable to learn and store a plurality of events including hazardous events and inconsequential events, said microprocessor being operative to alert operator in response to identifying the hazardous events by inspecting said captured real-time images.

2. A digital in-vehicle device as recited in claim 1 further comprises a mounting assembly for mounting said in-vehicle device so as to allow said device to be securely and steadily positioned, while at the same time causing minimum interference with the vehicle operator'"'"'s field of view, said mounting assembly providing for a mounting arrangement chosen from the group consisting of mounting said device behind the vehicle'"'"'s rearview mirror and mounting said devices as an integral part of the vehicle'"'"'s rearview mirror.

3. A digital in-vehicle device as recited in claim 1 further comprising

a computational microprocessor;

a computational memory and storage device coupled to said computational microprocessor and

a communications unit.

4. A digital in-vehicle device as recited in claim 3 further comprising a mounting assembly for mounting said in-vehicle device so as to allow said devices and said units to be securely and steadily positioned, while at the same time causing minimum interference with the vehicle operator'"'"'s field of view, said assembly providing for a mounting arrangement chosen from the group consisting of mounting said devices and said units behind the vehicle'"'"'s rearview mirror and mounting said device as an integral part of the vehicle'"'"'s rearview mirror.

5. A digital in-vehicle device as recited in claim 3, wherein said computational and vision microprocessors are merged into the same microprocessor and said computational and vision memory devices are merged into the same memory device.

6. A digital in-vehicle device as recited in claim 3, wherein said communications unit comprises:

a data input and output port connected to said computational unit that receives data from and communicates data to an external computer,

a global position system (GPS) antenna and receiver that are connected to said computational unit for receiving signals from GPS satellites, wherein said computational unit further comprises the means for processing said GPS signals to help determine the current position of said vehicle, and

means for providing communications from said computational unit to a vehicle operator, said means connected to said computational unit and chosen from the group consisting of a directional indicator screen that displays icons which provide navigational information in a visual form, and a voice input-output system, which is connected to said computational unit, that converts a vehicle operator'"'"'s spoken message into digital information for input into said computational unit, while also using portions of the computational unit'"'"'s digital output to provide the vehicle operator with navigational information in an audible form.

7. A digital in-vehicle device as recited in claim 6, wherein said antenna and receiver are portable and located inside a vehicle exposed to the sky through the windshield such that said antenna and receiver can be readily used for most vehicles without any special or deliberate arrangement.

8. A digital in-vehicle device as recited in claim 2, wherein, for a vehicle having a rearview mirror with a mirror attached to the front surface of a frame and from the rear side of said frame extends a mounting arm that holds the frame in a desired position and connects the frame to an interior surface of said vehicle, comprising a mounting assembly for mounting said devices behind said vehicle'"'"'s rearview mirror comprises:

a case having a box-shape with inner and outer surfaces, including outer front and top surfaces, said devices being operationally connected to said inner surfaces so that the case forms a protective enclosure for said devices, said case so configured and of a size so that, when the front surface of said case is in close proximity to the rear surface of said rearview mirror frame, the vehicle operator'"'"'s field of view is not obstructed, and said outer top surface of said case having a recessed portion that accommodates the rearview mirror frame'"'"'s mounting arm while allowing the said front outer surface of said case to be placed in close proximity to the rear surface of said rearview mirror frame,

a ball joint attached to said case'"'"'s outer top surface,

an extendible pole having a top end and a bottom end, said bottom end being attached to said ball joint, said pole having a plurality of tubular members that are retractably enmeshed with each other,

a clamp having a clamp base, a pair of clamping jaws attached to said clamp base, and means coupled to said clamping jaws for biasing said clamping jaws towards one another so that they releasably affix said clamp to said rearview mirror frame mounting arm, and

a hinge that couples said clamp base with the top end of said extendible pole.

9. A digital in-vehicle device as recited in claim 4 wherein, for a vehicle having a rearview mirror with a mirror attached to the front surface of a frame and from the rear side of said frame extends a mounting arm that holds the frame in a desired position and connects the frame to an interior surface of said vehicle, comprising a mounting assembly for mounting said devices and said units behind said vehicle'"'"'s rearview mirror comprises:

a case having a box-shape with inner and outer surfaces, including outer front and top surfaces, said devices and said units being operationally connected to said inner surfaces so that the case forms a protective enclosure for said devices and said units, said case so configured and of a size so that, when the front surface of said case is in close proximity to the rear surface of said rearview mirror frame, the vehicle operator'"'"'s field of view is not obstructed, and said outer top surface of said case having a recessed portion that accommodates the rearview mirror frame'"'"'s mounting arm while allowing the said front outer surface of said case to be placed in close proximity to the rear surface of said rearview mirror frame,

a ball joint attached to said case'"'"'s outer top surface,

an extendible pole having a top end and a bottom end, said bottom end being attached to said ball joint, said pole having a plurality of tubular members that are retractably emeshed with each other,

a clamp having a clamp base, a pair of clamping jaws attached to said clamp base, and means coupled to said clamping jaws for biasing said clamping jaws towards one another so that they releasably affix said clamp to said rearview mirror frame mounting arm, and

a hinge that couples said clamp base with the top end of said extendible pole.

10. A digital in-vehicle device as recited in claim 2, wherein said mounting assembly for mounting said devices as an integral part of the vehicle'"'"'s rearview mirror comprises:

a case having a box-shape with inner and outer surfaces, including outer front, back and side surfaces, said devices being operationally connected to said inner surfaces so that the case forms a protective enclosure for said devices,

wherein said vehicle having a rearview mirror assembly that is especially configured to mesh with said case, said rearview mirror assembly comprising a frame having a pair of leg portions horizontally spaced apart from one another and connected by a middle portion, which has a front, rear and top surface, said middle portion extending between and connected to said leg portions so as to define a slot in said frame for receiving and supporting the sides of said case therein between said leg portions and the rear surface of said middle portion,

wherein said rearview mirror assembly further comprising a mirror attached to the front surface of the middle portion of said frame, a mounting arm having a top and bottom end, the bottom end being attached to the top surface of said middle portion, the arm holding the frame in a desired position with top end of said arm connected to an interior surface of said vehicle.

11. A digital in-vehicle device as recited in claim 4, wherein said mounting assembly mounting said devices and said units as an integral part of the vehicle'"'"'s rearview mirror comprises:

a case having a box-shape with inner and outer surfaces, including outer front, back and side surfaces, said devices and said units being operationally connected to said inner surfaces so that the case forms a protective enclosure for said devices and said units,

wherein said vehicle having a rearview mirror assembly that is especially configured to mesh with said case, said rearview mirror assembly comprising a frame having a pair of leg portions horizontally spaced apart from one another and connected by a middle portion, which has a front, rear and top surface, said middle portion extending between and connected to said leg portions so as to define a slot in said frame for receiving and supporting the sides of said case therein between said leg portions and the rear surface of said middle portion,

wherein said rearview mirror assembly further comprising a mirror attached to the front surface of the middle portion of said frame, a mounting arm having a top and bottom end, the bottom end being attached to the top surface of said middle portion, the arm holding the frame in a desired position with top end of said arm connected to an interior surface of said vehicle.

12. A digital in-vehicle device as recited in claim 1, wherein said

means connected to said vision microprocessor for triggering the automatic storage including a variety of mechanisms chosen from the group consisting of programmable logical instructions resided inside said vision memory that fire off signals to said vision microprocessor in responding to said actual scene captured, hardware mechanisms and combinations thereof, wherein said hardware mechanism including at least one sensor capable of sending out a signal to said vision microprocessor upon detecting a physical event, wherein said physical event can be a physical impact, sudden change in momentum, sudden change in sound wave amplitude and combinations thereof.

13. A digital in-vehicle device as recited in claim 1, wherein said means connected to said vision microprocessor for manually triggering the storage in said persistent memory device of detected visual information including at least one mechanism capable of causing a signal to be sent to said vision microprocessor, wherein said mechanism is selected from the group consisting of push button, flip switch and voice input unit.

14. A method for digitally capturing an actual scene so that captured images can be used for various purposes, said method comprising the steps of:

continuously capturing actual scene in real-time and converting said scene into digital form,

permanently storing up captured said images so that said images can be retrieved for viewing at a later time,

continuously buffering up a plurality of captured images using a first-in-first-out mechanism so that said buffered images can be preserved permanently if so desired,

manually triggering the storage in a persistent memory device of consecutive frames of detected visual information, wherein said manually triggering can be an action selected from the group consisting of taking snap shots of visual scene, taking a sequence of continuous images of visual scene, taking a sequence of continuous images of visual scene that makes up so many seconds before and after said trigger and freezing the activity of said continuously capturing visual information so as to prevent existing said images in said persistent memory be replaced by new images in order to preserve existing said images.

15. The method as recited in claim 14 further comprising the step of:

comparing captured images with database images and alerting operator of potential hazardous condition.

16. The method as recited in claim 14 further comprising the step of:

inspecting captured images and alerting operator of potential hazardous condition.

17. The method as recited in claim 14 further comprising the step of:

learning to recognize and store hazardous and inconsequential conditions.

18. The method as recited in claim 14 further comprising the step of:

automatically triggering a permanent storage of a plurality of consecutive frames of captured visual information, wherein said permanent storage of a plurality of consecutive frames is achieved by prohibiting older said images from being erased and replaced by newer images after a pre-programmed elapsed time period such that said plurality of consecutive frames stored are composed of a number of images captured so many seconds before and after said automatic triggering,

19. The method as recited in claim 14 further comprising the step of:

analyzing said images to extract information in real-time useful for navigation assistance and accident avoidance purpose.

20. The method as recited in claim 14 further comprising the step of:

receiving global positioning system (GPS) signals for travel direction and position assistance.

21. The method as recited in claim 19 further comprising the step of:

providing directional information to said operator in a manner which does not distract said operator from more important concurrent task, wherein said direction indication is in the form of display symbol within the field of view of said operator.

22. The method as recited in claim 20 further comprising the step of:

providing directional information to said operator in a manner which does not distract said operator from more important concurrent task, wherein said direction indication is in the form of display symbol within the field of view of said operator.

23. The method as recited in claim 14 further comprising the steps of:

providing information to said operator in an audible form, and receiving verbal command from said operator and converting said command into digital form.

24. The method as recited in claim 18 further comprising the step of:

detecting external events including physical impact, sudden change of momentum, sudden change of sound amplitude, and unusual occurrence or movement of objects in said visual scene captured so as to generate said automatic triggering.

25. A method for digitally capturing an actual scene so that captured images can be used for various purposes, said method comprising the steps of:

continuously capturing actual scene in real-time and converting said scene into digital form, controlling the operation and timing of said capture process,

permanently storing up captured said images so that said images can be retrieved for viewing at a later time,

continuously buffering up a plurality of captured images using a first-in-first-out mechanism so that said buffered images can be preserved permanently if so desired,

inspecting captured images and alerting operator of potential hazardous condition,

manually triggering the storage in a persistent memory device of consecutive frames of detected visual information, wherein said manually triggering can be an action selected from the group consisting of taking snap shots of visual scene, taking a sequence of continuous images of visual scene, taking a sequence of continuous images of visual scene that makes up so many seconds before and after said trigger and freezing the activity of said continuously capturing visual information so as to prevent existing said images in said persistent memory be replaced by new images in order to preserve existing said images.

26. A method for digitally capturing an actual scene so that captured images can be used for various purposes, said method comprising the steps of:

continuously capturing actual scene in real-time and converting said scene into digital form, controlling the operation and timing of said capture process,

continuously buffering up a plurality of captured images using a first-in-first-out mechanism so that said buffered images can be preserved permanently if so desired,

inspecting captured images and alerting operator of potential hazardous condition,

manually triggering the storage in a persistent memory device of consecutive frames of detected visual information, wherein said manually triggering can be an action selected from the group consisting of taking snap shots of visual scene, taking a sequence of continuous images of visual scene, and freezing the activity of said continuously capturing visual information so as to prevent existing said images in said persistent memory be replaced by new images in order to preserve existing said images.

27. A method for digitally capturing an actual scene so that captured images can be used for various purposes, said method comprising the steps of:

continuously capturing actual scene in real-time and converting said scene into digital form, p1 continuously buffering up a plurality of captured images using a first-in-first-out mechanism so that said buffered images can be preserved permanently if so desired,

manually triggering the storage in a persistent memory device of consecutive frames of detected visual information, wherein said manually triggering can be an action selected from the group consisting of taking snap shots of visual scene, taking a sequence of continuous images of visual scene, taking a sequence of continuous images of visual scene that makes up so many seconds before and after the trigger and freezing the activity of said continuously capturing visual information so as to prevent existing said images in said persistent memory be replaced by new images in order to preserve existing said images.

28. A method for digitally capturing an actual scene so that captured images can be used for various purposes, said method comprising the steps of:

continuously capturing actual scene in real-time and converting said scene into digital form,

continuously buffering up a plurality of captured images using a first-in-first-out mechanism so that said buffered images can be preserved permanently if so desired,

inspecting captured images and alerting operator of potential hazardous condition,

automatically triggering a permanent storage of a plurality of consecutive frames of captured visual information, wherein said permanent storage of a plurality of consecutive frames is achieved by prohibiting older said images from being erased and replaced by newer images after a pre-programmed elapsed time period such that said plurality of consecutive frames stored are composed of a number of images captured so many seconds before and after said automatic triggering.