Vehicle mounted navigation device

• US 5,899,956 A
• Filed: 03/31/1998
• Issued: 05/04/1999
• Est. Priority Date: 03/31/1998
• Status: Expired due to Fees

• Current Assignee: Advanced Future Technologies Incorporated
• Original Assignee: Advanced Future Technologies Incorporated
• Inventors: Chan, Chuk David
• Primary Examiner(s): Cuchlinski, Jr., William A.
• Assistant Examiner(s): WYCKOFF, TIMOTHY R
• Application Number:
  US09/052,188
• Time in Patent Office: 399 Days
• Field of Search: 701/211, 701/123, 701/201, 701/204, 701/213, 701/49, 701/216, 701/206, 701/207, 701/208, 701/209, 340/991, 340/994, 340/995, 340/990, 340/998, 354/266, 354/550
• US Class Current: 701/213
• CPC Class Codes: G01C 21/28 with correlation of data from several navigational instruments

Abstract

A vehicle mounted, navigation device is disclosed. This invention combines a global position system (GPS) with an image capturing system into a portable device that can be optimally mounted within a vehicle. The image capturing system detects and interprets visual information in the vicinity of the vehicle to provide the vehicle operator with appropriate navigational guidance assistance and to compensate for the positioning errors embedded in commercial GPS signals. Additionally, the device has the capability to store consecutive frames of detected, visual information so as to enable the device to be used for accident aftermath analysis and the documentation of an event or scene that occurs within the vicinty of the vehicle. The device includes a mounting assembly which enables the device to be used in most automotive vehicles, with the device usually being mounted behind the vehicle'"'"'s rearview mirror such that a set of directional turning indicators naturally fall within the vehicle operator'"'"'s field of view.

Claims

1. A digital in-vehicle device comprising:

an image capturing device for continuously capturing actual road scene that comes within the vicinity of vehicle in real-time,

a vision microprocessor coupled to said image capturing device for controlling the operation of said image capturing device,

a vision memory device coupled to said vision microprocessor,

a persistent memory device coupled to said vision microprocessor, wherein said persistent memory device is a non-volatile storage device,

means connected to said vision microprocessor for automatically triggering a permanent storage, in said persistent memory device, of a plurality of consecutive frames of captured visual scene that comes within the vicinity of said vehicle, wherein said permanent storage of a plurality of consecutive frames is achieved by means of prohibiting the current content in said persistent memory from being over-written by new images after a pre-programmed elapsed time period such that said plurality of consecutive frames stored are composed of a number of images captured so many seconds before and after said triggering occurs, wherein the number of said images stored is a function of the size of said persistent memory, wherein said persistent memory consisting of a finite number of storage elements overwritten repeatedly by said vision microprocessor in a first-in-first-out fashion so that a finite storage can be used to buffer up a plurality of said images continuously, and

means connected to said vision microprocessor for manually triggering the said permanent storage, in said persistent memory device, of frames of said visual scene that comes within the vicinity of said vehicle, wherein said manually triggering can be an action selected from the group consisting of taking snap shots of visual scene, taking a sequence of continuous images of visual scene, and freezing the activity of said continuously capturing visual information so as to prevent existing said images in said persistent memory of being replaced by new images in order to preserve existing said images,

wherein said stored frames can be used for various purposes, including accident aftermath analysis and documentation of the visual aspects of an event or scene that occurs within the vicinity of the vehicle.

2. A digital in-vehicle device as recited in claim 1 further comprises:

a mounting assembly for mounting said devices so as to allow said devices to be securely and steadily positioned, while at the same time causing minimum interference with the vehicle operator'"'"'s field of view, said assembly providing for a mounting arrangement chosen from the group consisting of mounting said devices behind the vehicle'"'"'s rearview mirror and mounting said devices as an integral part of the vehicle'"'"'s rearview mirror.

3. A digital in-vehicle device as recited in claim 1 further comprises:

a computational microprocessor,

a computational memory and storage device coupled to said computational microprocessor, and

a communications unit.

4. A digital in-vehicle device as recited in claim 3 further comprises:

a mounting assembly for mounting said devices and said units so as to allow said devices and said units to be securely and steadily positioned, while at the same time causing minimum interference with the vehicle operator'"'"'s field of view, said assembly providing for a mounting arrangement chosen from the group consisting of mounting said devices and said units behind the vehicle'"'"'s rearview mirror and mounting said device as an integral part of the vehicle'"'"'s rearview mirror.

5. A digital in-vehicle device as recited in claim 3, wherein said computational and vision microprocessors are merged into the same microprocessor and said computational and vision memory devices are merged into the same memory device.

6. A digital in-vehicle device as recited in claim 3, wherein said communications unit comprises:

a data input and output port connected to said computational unit that receives data from and communicates data to an external computer,

a global position system (GPS) antenna and receiver that are connected to said computational unit for receiving signals from GPS satellites, wherein said computational unit further comprises the means for processing said GPS signals to help determine the current position of said vehicle, and

means for providing communications from said computational unit to a vehicle operator, said means connected to said computational unit and chosen from the group consisting of a directional indicator screen that displays icons which provide navigational information in a visual form, and a voice input-output system, which is connected to said computational unit, that converts a vehicle operator'"'"'s spoken message into digital information for input into said computational unit, while also using portions of the computational unit'"'"'s digital output to provide the vehicle operator with navigational information in an audible form.

7. A digital in-vehicle device as recited in claim 6, wherein said

antenna and receiver are portable and located inside a vehicle exposed to the sky through the windshield such that said antenna and receiver can be readily used for most vehicles without any special or deliberate arrangement.

8. A digital in-vehicle device as recited in claim 2, wherein, for a vehicle having a rearview mirror with a mirror attached to the front surface of a frame and from the rear side of said frame extends a mounting arm that holds the frame in a desired position and connects the frame to an interior surface of said vehicle, comprising a mounting assembly for mounting said devices behind said vehicle'"'"'s rearview mirror comprises:

a case having a box-shape with inner and outer surfaces, including outer front and top surfaces, said devices being operationally connected to said inner surfaces so that the case forms a protective enclosure for said devices, said case so configured and of a size so that, when the front surface of said case is in close proximity to the rear surface of said rearview mirror frame, the vehicle operator'"'"'s field of view is not obstructed, and said outer top surface of said case having a recessed portion that accommodates the rearview mirror frame'"'"'s mounting arm while allowing the said front outer surface of said case to be placed in close proximity to the rear surface of said rearview mirror frame,

a ball joint attached to said case'"'"'s outer top surface,

an extendible pole having a top end and a bottom end, said bottom end being attached to said ball joint, said pole having a plurality of tubular members that are retractably emeshed with each other,

a clamp having a clamp base, a pair of clamping jaws attached to said clamp base, and means coupled to said clamping jaws for biasing said clamping jaws towards one another so that they releasably affix said clamp to said rearview mirror frame mounting arm, and

a hinge that couples said clamp base with the top end of said extendible pole.

9. A digital in-vehicle device as recited in claim 4 wherein, for a vehicle having a rearview mirror with a mirror attached to the front surface of a frame and from the rear side of said frame extends a mounting arm that holds the frame in a desired position and connects the frame to an interior surface of said vehicle, comprising a mounting assembly for mounting said devices and said units behind said vehicle'"'"'s rearview mirror comprises:

a case having a box-shape with inner and outer surfaces, including outer front and top surfaces, said devices and said units being operationally connected to said inner surfaces so that the case forms a protective enclosure for said devices and said units, said case so configured and of a size so that, when the front surface of said case is in close proximity to the rear surface of said rearview mirror frame, the vehicle operator'"'"'s field of view is not obstructed, and said outer top surface of said case having a recessed portion that accommodates the rearview mirror frame'"'"'s mounting arm while allowing the said front outer surface of said case to be placed in close proximity to the rear surface of said rearview mirror frame,

a ball joint attached to said case'"'"'s outer top surface,

an extendible pole having a top end and a bottom end, said bottom end being attached to said ball joint, said pole having a plurality of tubular members that are retractably emeshed with each other,

a clamp having a clamp base, a pair of clamping jaws attached to said clamp base, and means coupled to said clamping jaws for biasing said clamping jaws towards one another so that they releasably affix said clamp to said rearview mirror frame mounting arm, and

a hinge that couples said clamp base with the top end of said extendible pole.

10. A digital in-vehicle device as recited in claim 2, wherein said mounting assembly for mounting said devices as an integral part of the vehicle'"'"'s rearview mirror comprises:

a case having a box-shape with inner and outer surfaces, including outer front, back and side surfaces, said devices being operationally connected to said inner surfaces so that the case forms a protective enclosure for said devices,

wherein said vehicle having a rearview mirror assembly that is especially configured to mesh with said case, said rearview mirror assembly comprising a frame having a pair of leg portions horizontally spaced apart from one another and connected by a middle portion, which has a front, rear and top surface, said middle portion extending between and connected to said leg portions so as to define a slot in said frame for receiving and supporting the sides of said case therein between said leg portions and the rear surface of said middle portion,

wherein said rearview mirror assembly further comprising a mirror attached to the front surface of the middle portion of said frame, a mounting arm having a top and bottom end, the bottom end being attached to the top surface of said middle portion, the arm holding the frame in a desired position with top end of said arm connected to an interior surface of said vehicle.

11. A digital in-vehicle device as recited in claim 4, wherein said mounting assembly mounting said devices and said units as an integral part of the vehicle'"'"'s rearview mirror comprises:

a case having a box-shape with inner and outer surfaces, including outer front, back and side surfaces, said devices and said units being operationally connected to said inner surfaces so that the case forms a protective enclosure for said devices and said units,

wherein said vehicle having a rearview mirror assembly that is especially configured to mesh with said case, said rearview mirror assembly comprising a frame having a pair of leg portions horizontally spaced apart from one another and connected by a middle portion, which has a front, rear and top surface, said middle portion extending between and connected to said leg portions so as to define a slot in said frame for receiving and supporting the sides of said case therein between said leg portions and the rear surface of said middle portion,

wherein said rearview mirror assembly further comprising a mirror attached to the front surface of the middle portion of said frame, a mounting arm having a top and bottom end, the bottom end being attached to the top surface of said middle portion, the arm holding the frame in a desired position with top end of said arm connected to an interior surface of said vehicle.

12. A digital in-vehicle device as recited in claim 1, wherein said

means connected to said vision microprocessor for triggering the automatic storage including a variety of mechanisms chosen from the group consisting of programmable logical instructions resided inside said vision memory that fire off signals to said vision microprocessor in responding to said actual scene captured, hardware mechanisms and combinations thereof, wherein said hardware mechanism including at least one sensor capable of sending out a signal to said vision microprocessor upon detecting a physical event, wherein said physical event can be a physical impact, sudden change in momentum, sudden change in sound wave amplitude and combinations thereof.

13. A digital in-vehicle device as recited in claim 1, wherein said

means connected to said vision microprocessor for manually triggering the storage in said persistent memory device of detected visual information that comes within the vicinity of said vehicle including at least one mechanism capable of causing a signal to be sent to said vision microprocessor, wherein said mechanism is selected from the group consisting of push button, flip switch and voice input unit.

14. A method for digitally capturing an actual scene on a road in real-time so that captured images can be used for various purposes, including accident aftermath analysis, documentation of the visual aspects of an event or scene that occurs within a vicinity of a vehicle and navigation assistance, said method comprises steps of:

continuously capturing actual road scene that comes within the vicinity of vehicle in real-time on the road and converting said scene into digital form,

controlling the operation and timing of said capture process,

permanently storing up captured said images so that said images can be retrieved for viewing at a later time,

continuously buffering up a plurality of captured images using a first-in-first-out mechanism so that said buffered images can be preserved permanently if so desired,

automatically triggering a permanent storage of a plurality of consecutive frames of captured visual information that comes within the vicinity of said vehicle, wherein said permanent storage of a plurality of consecutive frames is achieved by prohibiting older said images from being erased and replaced by newer images after a pre-programmed elapsed time period such that said plurality of consecutive frames stored are composed of a number of images captured so many seconds before and after said automatic triggering, and

manually triggering the storage in a persistent memory device of consecutive frames of detected visual information that comes within the vicinity of said vehicle, wherein said manually triggering can be an action selected from the group consisting of taking snap shots of visual scene, taking a sequence of continuous images of visual scene, and freezing the activity of said continuously capturing visual information so as to prevent existing said images in said persistent memory be replaced by new images in order to preserve existing said images.

15. The method as recited in claim 14 further comprising the step of:

analyzing said images to extract information in real-time useful for navigation assistance, said information including text on street plate, text on highway sign, symbols on street/highway sign, traffic light figures, road marks, street intersection patterns and general road scene information.

16. The method as recited in claim 14 further comprising the step of:

receiving global positioning system (GPS) signals for travel direction and position assistance.

17. The method as recited in claim 15 further comprising the step of:

providing directional information to said operator in a manner which does not distract said operator from more important concurrent task, wherein said direction indication is in the form of display symbol within the field of view of said operator.

18. The method as recited in claim 16 further comprising the step of:

providing directional information to said operator in a manner which does not distract said operator from more important concurrent task, wherein said direction indication is in the form of display symbol within the field of view of said operator.

19. The method as recited in claim 14 further comprising the steps of:

providing information to said operator in an audible form, and

receiving verbal command from said operator and converting said command into digital form.

20. The method as recited in claim 14 further comprising the step of:

detecting external events including physical impact, sudden change of momentum, sudden change of sound amplitude, and unusual occurrence or movement of objects in said visual scene captured so as to generate said automatic triggering.