Surround camera to generate a parking video signal and a recorder video signal from a single sensor

• US 9,538,077 B1
• Filed: 07/26/2013
• Issued: 01/03/2017
• Est. Priority Date: 07/26/2013
• Status: Active Grant

• Current Assignee: Ambarella International LP (Ambarella Incorporated)
• Original Assignee: Ambarella Incorporated
• Inventors: Huang, Cheng-Yu, Pertsel, Shimon
• Primary Examiner(s): Ustaris, Joseph
• Assistant Examiner(s): Navas, Jr., Edemio
• Application Number:
  US13/951,548
• Time in Patent Office: 1,257 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/173 Reversing assist
• CPC Class Codes: B60K 2360/186 Displaying information according to relevancy
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/22 Display screens
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60K 35/654 the user being the driver
• CPC Class Codes: B60K 35/81 for controlling displays
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: G02B 13/06 Panoramic objectives; So-called "sky lenses" including panoramic objectives having reflecting surfaces
• CPC Class Codes: G06T 2207/10016 : Video; Image sequence
• CPC Class Codes: G06T 2207/30264 : Parking
• CPC Class Codes: G06T 3/18 : Image warping, e.g. rearranging pixels individually
• CPC Class Codes: G06T 5/20 : using local operators
• CPC Class Codes: G06T 5/80 : Geometric correction
• CPC Class Codes: G06T 7/80 : Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: G06V 20/58 : Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 : Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 23/698 : for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/2628 : Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 5/268 : Signal distribution or switching
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

An apparatus comprising a sensor and a processor. The sensor may be configured to capture a first video signal having a first field of view. The processor may be configured to generate a second video signal having a second field of view and a third video signal having a third field of view. The second video signal may generate the second field of view to include a first portion of the first video signal. The third video signal may generate the third field of view to include a second portion of the first video signal. The second portion may be processed to remove possible warping present on a bottom portion of the first video signal. The first and second portions may comprise an area less than the first field of view.

Claims

1. An apparatus comprising:

a sensor configured to generate a first video signal having a first field of view; and

a processor configured to (a) generate a second video signal having a second field of view and a third video signal having a third field of view both from said first video signal generated by said sensor and (b) encode said second video signal, wherein (i) said second video signal is encoded for recording to a storage device, (ii) said third video signal is presented to a display for viewing, (iii) at least one of said second video signal and said third video signal is processed to remove possible warping present on a bottom portion of said first video signal, (iv) said second and third fields of view each comprise an area less than said first field of view and (v) said second field of view and said third field of view are generated without installing separate sets of cameras.

2. The apparatus according to claim 1, wherein said first video signal is (i) cropped to generate said second field of view usable as a dash mounted recorder to record actions around a vehicle and (ii) cropped and corrected to generate said third field of view showing a surround view on a dash mounted display.

3. The apparatus according to claim 1, wherein a plurality of said sensors are used to capture a surround view of a vehicle to display in one of a plurality of portions of a dash mounted display.

4. The apparatus according to claim 1, wherein said sensor comprises a wide angle lens.

5. The apparatus according to claim 1, wherein said sensor comprises a fish eye lens configured to capture at least one of (i) a 180 degree field of view and (ii) said first field of view greater than 180 degrees.

6. The apparatus according to claim 1, wherein said sensor comprises a fish eye lens configured to capture said first field of view less than 180 degrees.

7. The apparatus according to claim 1, wherein said third field of view comprises said bottom portion of said first video signal cropped and corrected for geometric distortion.

8. The apparatus according to claim 1, wherein said second video signal is de-warped by said processor without interruption of the generation of the third video signal by said processor.

9. The apparatus according to claim 1, wherein said second field of view for recording to said storage device is encoded to have a higher resolution than said third field of view presented to said display.

10. The apparatus according to claim 1, wherein said processor is further configured to implement a calibration process to compensate for a movement of said sensor.

11. The apparatus according to claim 1, wherein said storage device comprises at least one of a SD card and a built-in drive.

12. The apparatus according to claim 1, wherein said processor comprises a dewarp engine.

13. The apparatus according to claim 1, wherein said processor is further configured to implement driver assist analytics based on said first video signal.

14. A method for generating video signals, comprising the steps of:

(A) capturing a first video signal having a first field of view using a sensor;

(B) generating a second video signal having a second field of view and a third video signal having a third field of view both from said first video signal generated by said sensor, and

(C) encoding said second video signal, wherein (i) said second video signal is encoded for recording to a storage device, (ii) said third video signal is presented to a display for viewing, (iii) at least one said second video signal and said third video signal is processed to remove possible warping present on a bottom portion of said first video signal, (iv) said second and said third fields of view each comprise an area less than said first field of view and (v) said second field of view and said third field of view are generated without installing separate sets of cameras.

15. The method according to claim 14, wherein said first video signal is (i) cropped to generate said second field of view usable as a dash mounted recorder to record actions around a vehicle and (ii) cropped and corrected to generate said third field of view showing a surround view on a dash mounted display.

16. The method according to claim 14, wherein step (A) is repeated a plurality of times to capture a surround view of a vehicle to display on one of a plurality of portions of a dash mounted display.

17. The method according to claim 14, wherein step (A) implements a wide angle lens.

18. The method according to claim 14, wherein step (A) implements a fish eye lens configured to capture at least one of (i) a 180 degree field of view and (ii) said first field of view greater than 180 degrees.

19. The method according to claim 14, wherein step (A) implements a fish eye lens configured to capture said first field of view less than 180 degrees.

20. The method according to claim 14, wherein said third field of view comprises said bottom portion of said first video signal cropped and corrected for geometric distortion.