DETECTING VISUAL INFORMATION CORRESPONDING TO AN ANIMAL

• US 20170154241A1
• Filed: 12/01/2016
• Published: 06/01/2017
• Est. Priority Date: 12/01/2015
• Status: Active Grant

• Current Assignee: MobilEye Vision Technologies Ltd. (Intel Corporation)
• Original Assignee: MobilEye Vision Technologies Ltd. (Intel Corporation)
• Inventors: SHAMBIK, Yakov, YOGEV, Noam, DAGAN, Erez
• Granted Patent: US 10,152,649 B2
• Time in Patent Office: Days
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2011/0026 Windows, e.g. windscreen
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/307 virtually distinguishing relevant parts of a scene from the background of the scene
• CPC Class Codes: B60R 2300/8053 for bad weather conditions or night vision
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: G06V 10/467 Encoded features or binary features, e.g. local binary patterns [LBP]
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A system for detecting an animal in a vicinity of a vehicle is disclosed. The system includes at least one processor programmed to receive, from an image capture device, at least one image of the vicinity of the vehicle; analyze the at least one image using a truncated animal appearance template to detect visual information suspected to be associated with an animal, wherein the truncated animal appearance template corresponds to a portion of a body and one or more limbs of a suspected animal; and initiate a vehicle response based on the detected visual information of the suspected animal in the at least one image.

Claims

1. A system for detecting an animal in a vicinity of a vehicle, the system comprising:

at least one processor programmed to;

receive, from an image capture device, at least one image of the vicinity of the vehicle;

analyze the at least one image using a truncated animal appearance template to detect visual information suspected to be associated with an animal, wherein the truncated animal appearance template corresponds to a portion of a body and one or more limbs of a suspected animal; and

initiate a vehicle response based on the detected visual information of the suspected animal in the at least one image.

2. The system of claim 1, wherein the at least one processor is further programmed to:

segment the at least one image into a plurality of search areas; and

detect one or more areas of the at least one image that include visual information that matches the truncated animal appearance template.

3. The system of claim 2, wherein the at least one processor is further programmed to:

determine whether visual information of a prior animal was detected in one or more prior captured images; and

initiate the vehicle response when the visual information of the suspected animal in the at least one image is consistent with visual information of the prior animal detected in the one or more prior captured images.

4. The system of claim 2, wherein the at least one processor is further programmed to:

generate a data structure corresponding to a detected area of the at least one image that includes visual information that matches the truncated animal appearance template;

adjust the data structure according to a calculated estimated location of the suspected animal and an estimated change in scale of the suspected animal in a subsequent captured image;

analyze the subsequent captured image with respect to the adjusted data structure to detect areas of the subsequent captured image that include visual information that matches the adjusted data structure; and

initiate the vehicle response when the subsequent captured image and the adjusted data structure meet a predefined criteria.

5. The system of claim 2, wherein the at least one processor is further programmed to determine a size of at least one of the search areas based on a detected distance of the visual information in the at least one image from the image capture device.

6. The system of claim 2, wherein the truncated animal appearance template does not correspond to a shape of a head of a suspected animal or a shape of a tail of a suspected animal.

7. The system of claim 2, wherein the at least one processor is further programmed to analyze the at least one image using a plurality of truncated animal appearance templates.

8. The system of claim 2, wherein the truncated animal appearance template corresponds to a suspected animal having proportions characterized by a predetermined torso size and a predetermined limb size.

9. The system of claim 2, wherein the truncated animal appearance template corresponds to one of a plurality of truncated animal appearance templates of the suspected animal at one of a plurality of different viewing angles.

10. The system of claim 2, wherein the truncated animal appearance template corresponds to a suspected animal according to one of a plurality of states of motion including walking, running, and standing still.

11. The system of claim 2, wherein the truncated animal appearance template corresponds to an appearance of a suspected animal among a grouping of two or more animals positioned adjacent to one another.

12. A method of detecting an animal in a vicinity of a vehicle, the method comprising:

receiving a plurality of images of the vicinity of the vehicle from one or more image capture devices;

receiving a truncated animal appearance template, wherein the truncated animal appearance template corresponds to appearance of at least a portion of a body and one or more limbs of an animal without a shape of a head of the animal;

processing the plurality of images using the truncated animal appearance template to detect, in at least one image from the plurality of images, visual information that corresponds to the truncated animal appearance template; and

initiating a vehicle response when visual information corresponding to the truncated animal appearance template is detected in at least two images of the plurality of images.

13. The method according to claim 12, wherein initiating the vehicle response comprises initiating at least one of an alert or a motion control instruction for the vehicle.

14. A system for detecting an animal in a vicinity of a vehicle, comprising:

a camera configured to acquire a plurality of images of the vicinity of the vehicle;

a storage unit storing a truncated animal appearance template, wherein the truncated animal appearance template corresponds to an appearance of at least a portion of a body and limbs of an animal without a shape of a head of the animal; and

a processor configured to;

process the plurality of images to detect in at least one of the plurality of images visual information that corresponds to the truncated animal appearance template; and

initiate a response when visual information corresponding to the truncated animal appearance template is detected in the at least one image.

15. The system of claim 14, wherein the processor is further configured to:

analyze a current captured image of the plurality of images by segmenting the current image into a plurality of search areas; and

use template matching to detect areas of the current image that include visual information that matches the truncated animal appearance template, wherein a size of the search area is based on a detected distance of the visual information in the current image from the camera.

16. The system of claim 15, wherein the processor is further configured to:

determine whether visual information of a suspected animal was detected in one or more prior captured images of the plurality of images; and

initiate the response when the visual information of the current image is determined, according to predefined criteria, to be consistent with visual information of a suspected animal detected in the one or more prior captured images.

17. The system of claim 15, wherein the processor is further configured to:

generate a data structure corresponding to a detected area of an image that includes visual information that matches a truncated animal appearance template;

adjust the data structure according to a calculated estimated location of the suspected animal and an estimated change in scale of the suspected animal in a subsequent image;

analyze a subsequently captured image with respect to the adjusted data structure to detect areas of the subsequent image that include visual information that matches the adjusted data structure; and

initiate the response when the subsequent image and the adjusted data structure meet a predefined criteria.

18. The system of claim 14, wherein the processor is configured to process the plurality of images using a plurality of truncated animal appearance templates.

19. The system of claim 14, wherein the truncated animal appearance template corresponds to a suspected animal having proportions characterized by a predetermined torso size and a predetermined limb size.

20. The system of claim 14, wherein the truncated animal appearance template corresponds to a suspected animal according to one of a plurality of states of motion including walking, running, and standing still.