Surround camera to generate a parking video signal and a recorder video signal from a single sensor

• US 10,187,570 B1
• Filed: 11/23/2016
• Issued: 01/22/2019
• Est. Priority Date: 07/26/2013
• Status: Active Grant

• Current Assignee: Ambarella International LP (Ambarella Incorporated)
• Original Assignee: Ambarella Incorporated
• Inventors: Huang, Cheng-Yu, Pertsel, Shimon
• Primary Examiner(s): Navas, Jr., Edemio
• Application Number:
  US15/360,296
• Time in Patent Office: 790 Days
• Field of Search: None
• CPC Class Codes: B60K 2360/173 Reversing assist
• CPC Class Codes: B60K 2360/186 Displaying information according to relevancy
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/22 Display screens
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60K 35/654 the user being the driver
• CPC Class Codes: B60K 35/81 for controlling displays
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 1/27 providing all-round vision, e.g. using omnidirectional cameras
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/607 from a bird's eye viewpoint
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: G02B 13/06 : Panoramic objectives; So-called "sky lenses" including panoramic objectives having reflecting surfaces
• CPC Class Codes: G06T 2207/10016 : Video; Image sequence
• CPC Class Codes: G06T 2207/30264 : Parking
• CPC Class Codes: G06T 3/18 : Image warping, e.g. rearranging pixels individually
• CPC Class Codes: G06T 5/20 : using local operators
• CPC Class Codes: G06T 5/80 : Geometric correction
• CPC Class Codes: G06T 7/80 : Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: G06V 20/58 : Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 : Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 23/698 : for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/2628 : Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 5/268 : Signal distribution or switching
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

An apparatus comprising a sensor and a processor. The sensor may be configured to capture a first video signal having a first field of view. The processor may be configured to generate a second video signal having a second field of view and a third video signal having a third field of view. The second video signal may generate the second field of view to include a first portion of the first video signal. The third video signal may generate the third field of view to include a second portion of the first video signal. The second portion may be processed to remove possible warping present on a bottom portion of the first video signal. The first and second portions may comprise an area less than the first field of view.

Claims

1. An apparatus comprising:

an interface configured to receive a video signal having a first field of view; and

a circuit, connected to the interface, configured to (a) generate a second field of view and a third field of view both from said video signal received from said interface and (b) encode said second field of view, wherein (i) said second field of view is (A) encoded for storage and (B) not presented to a display for viewing, (ii) said third field of view is (A) presented to said display for viewing and (B) not encoded, (iii) said second field of view and said third field of view each comprise an area less than said first field of view and (iv) said second field of view and said third field of view are both generated from a portion of said video signal captured by a camera sensor of a single camera.

2. The apparatus according to claim 1, wherein said second field of view and said third field of view are generated without installing a first camera to generate said second field of view and a second camera to generate said third field of view.

3. The apparatus according to claim 1, wherein said second field of view and said third field of view are generated from said single camera in a camera system comprising a plurality of cameras.

4. The apparatus according to claim 1, wherein said video signal is (i) cropped to generate said second field of view usable as a dash mounted recorder to record actions around a vehicle and (ii) cropped and corrected to generate said third field of view showing a surround view on a dash mounted display.

5. The apparatus according to claim 1, wherein said single camera is part of a camera system comprising a plurality of sensors configured to capture a surround view of a vehicle to display in one of a plurality of portions of a dash mounted display.

6. The apparatus according to claim 1, wherein said circuit is configured to crop and correct said video signal for geometric distortion to generate said third field of view.

7. The apparatus according to claim 1, wherein said circuit is configured to de-warp said video signal to generate said second field of view without interruption of the generation of said third field of view by said circuit.

8. The apparatus according to claim 1, wherein said second field of view is encoded to have a higher resolution than said third field of view presented to said display.

9. The apparatus according to claim 1, wherein said circuit is further configured to implement a calibration process to compensate for a movement of said single camera.

10. The apparatus according to claim 1, wherein said storage comprises at least one of a SD card and a built-in storage drive.

11. The apparatus according to claim 1, wherein said circuit comprises a dewarp engine.

12. The apparatus according to claim 1, wherein said circuit is further configured to implement driver assist analytics based on said video signal.

13. The apparatus according to claim 1, wherein said single camera comprises a wide angle lens.

14. The apparatus according to claim 1, wherein said single camera comprises a fish eye lens configured to capture said first field of view of at least one of (i) 180 degrees and (ii) greater than 180 degrees.

15. The apparatus according to claim 1, wherein said single camera comprises a fish eye lens configured to capture said first field of view less than 180 degrees.

16. An apparatus comprising:

a sensor configured to generate a video signal having a first field of view; and

a processor configured to (a) generate a second field of view and a third field of view both from said video signal generated by said sensor and (b) encode said second field of view, wherein (i) said second field of view is (A) encoded for storage and (B) not presented to a display for viewing, (ii) said third field of view is (A) presented to said display for viewing and (B) not encoded, (iii) said second and third fields of view each comprise an area less than said first field of view and (iv) said second field of view and said third field of view are both generated from a portion of said video signal captured by a single sensor of a camera system.

17. An apparatus comprising:

an interface configured to receive a first video signal having a first field of view from a sensor; and

a circuit, connected to the interface, configured to (a) generate a second video signal having a second field of view and a third video signal having a third field of view both from said first video signal generated by said sensor and (b) encode said second video signal, wherein (i) said second video signal is (A) encoded for recording to a storage device and (B) not presented to a display for viewing, (ii) said third video signal is (A) presented to said display for viewing and (B) not encoded, (iii) at least one of said second video signal and said third video signal is processed to remove possible warping present on a bottom portion of said first video signal, (iv) said second and third fields of view each comprise an area less than said first field of view and (v) said second field of view and said third field of view are both generated from a single sensor of a camera without installing separate sets of sensors.