Techniques to Obtain Information About Objects Around a Vehicle

• US 20140152823A1
• Filed: 03/25/2013
• Published: 06/05/2014
• Est. Priority Date: 11/30/1998
• Status: Abandoned Application

• Current Assignee: American Vehicular Sciences LLC (Acacia Research Corporation)
• Original Assignee: American Vehicular Sciences LLC (Acacia Research Corporation)
• Inventors: Breed, David S.
• Application Number:
  US13/849,715
• Publication Number:
  US 20140152823A1
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60N 2/002 Seats provided with an occupancy detection means mounted therein or thereon detection means responsive to presence or absence of children B60N2/266
• CPC Class Codes: B60N 2/02246 Electric motors therefor
• CPC Class Codes: B60N 2/0244 with logic circuits
• CPC Class Codes: B60N 2/0268 using sensors or detectors for adapting the seat or seat part, e.g. to the position of an occupant
• CPC Class Codes: B60N 2/0276 reaction to emergency situations, e.g. crash
• CPC Class Codes: B60R 2022/208 by automatic or remote control means
• CPC Class Codes: B60R 21/013 including means for detecting collisions, impending collisions or roll-over
• CPC Class Codes: B60R 21/0134 responsive to imminent contact with an obstacle , e.g. using radar systems
• CPC Class Codes: B60R 21/01534 using electromagneticwaves, e.g. infrared
• CPC Class Codes: B60R 21/01536 using ultrasonic waves
• CPC Class Codes: B60R 21/01538 for image processing, e.g. cameras or sensor arrays
• CPC Class Codes: B60R 21/0154 in combination with seat heating
• CPC Class Codes: B60R 25/25 using biometry
• CPC Class Codes: B60R 25/252 Fingerprint recognition
• CPC Class Codes: B60R 25/255 Eye recognition
• CPC Class Codes: B60R 25/257 Voice recognition
• CPC Class Codes: G01S 17/46 Indirect determination of position data
• CPC Class Codes: G01S 17/931 of land vehicles
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/59 inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: H04N 7/18 : Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

Method for monitoring an area surrounding a host vehicle or objects external of the vehicle includes projecting light into an area of interest external to the vehicle from one or more light sources on the vehicle, detecting reflected light at at least one camera on the vehicle at a position different than the position from which the light is projected and at a position from which light reflected from any objects in the area of interest in the exterior of the vehicle is received and analyzing the reflected light relative to the projected light to obtain information about a distance between the vehicle and objects located in the area of interest and/or motion of the objects located in the area of interest. Then, one or more actions are undertaken on the vehicle based on the information about the distance and motion of the external object.

Claims

1. A method for monitoring an area surrounding a host vehicle or objects external of the host vehicle during movement of the host vehicle under control of an occupant in the host vehicle, the host vehicle having a frame defining a compartment that accommodates the occupant of the host vehicle who is able to guide movement of the host vehicle when present in the compartment, the method comprising:

projecting light into an area of interest external to the host vehicle from at least one light source on the host vehicle;

detecting reflected light at at least one camera arranged on the host vehicle at a position different than the position of the at least one light source and at a position from which light reflected from any objects in the area of interest in the exterior of the host vehicle is received;

analyzing the reflected light relative to the projected light to obtain information about a distance between the host vehicle and objects located in the area of interest and motion of the objects located in the area of interest; and

causing an action on the vehicle based on the obtained information about the distance and motion.

2. The method of claim 1, wherein the step of projecting light into the area of interest comprises projecting structured light into the area of interest, rays of light forming the structured light originating from the at least one light source, the structured light being a pattern of light including a plurality of light areas and at least one dark area alongside one another.

3. The method of claim 1, wherein the step of projecting light into the area of interest comprises projecting light from a plurality of light sources, the at least one camera being positioned between the light sources, the step of analyzing the reflected light to obtain information comprising determining the distance between the host vehicle and the object in an image obtained by the at least one camera based on spacing of reflected light from the plurality of light sources.

4. The method of claim 3, wherein the plurality of light sources comprises two light sources that each projects a dot of light.

5. The method of claim 4, wherein the plurality of light sources comprise two light sources that project light beams parallel to one another.

6. The method of claim 4, wherein the plurality of light sources comprise two light sources that project light beams at an angle to one another.

7. The method of claim 1, wherein the analyzing step comprises:

inputting an image derived from the reflected light detected by the at least one camera into a processor configured to draw a virtual box around a portion of an object in the image; and

monitoring movement edges of the box that are indicative of a direction of movement of the object.

8. The method of claim 1, wherein the analyzing step comprises:

inputting an image derived from the reflected light detected by the at least one camera into a processor configured to draw virtual horizontal and vertical edges around a portion of an object in the image; and

monitoring movement of the virtual horizontal and vertical of the box that are indicative of a direction of movement of the object.

9. The method of claim 1, wherein the analyzing step comprises:

inputting an image derived from the reflected light detected by the at least one camera into a processor;

providing the processor with map data about roads in the image; and

deriving the distance between the host vehicle and an object in the image based on the map data.

10. The method of claim 1, wherein the at least one camera is configured to measure an angle of light received at each pixel, the step of analyzing the reflected light to obtain information comprising deriving the distance between the host vehicle and an object in an image obtained by the at least one camera based on the angle of light received at each pixel.

11. The method of claim 1, wherein the step of analyzing the reflected light to obtain information comprises analyzing the reflected light to recognize an object in an image obtained by the at least one camera, correlating the recognition of the object into information about a size of the object, and monitoring change in size of the object by analyzing reflected light obtained at a subsequent time to derive information about motion of the object.

12. The method of claim 1, further comprising adjusting for motion of the at least one camera by obtaining inertial measurements of the vehicle by means of an inertial measurement unit positioned on the vehicle and deriving motion of the at least one camera based on inertial measurements by the inertial measurement unit and a known positioning relationship between the inertial measurement unit and the at least one camera.

13. The method of claim 1, wherein the at least one camera includes an aspheric or fish-eye lens.