MOVING OBJECT DETECTOR

• US 20150092051A1
• Filed: 02/10/2014
• Published: 04/02/2015
• Est. Priority Date: 10/02/2013
• Status: Abandoned Application

• Current Assignee: Toshiba Corporation
• Original Assignee: Toshiba Corporation
• Inventors: FURUKAWA, Kenji
• Application Number:
  US14/176,453
• Publication Number:
  US 20150092051A1
• Time in Patent Office: Days
• US Class Current: 348/143
• CPC Class Codes: G06T 2207/20068 Projection on vertical or horizontal image axis
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/194 involving foreground-background segmentation
• CPC Class Codes: G06T 7/215 Motion-based segmentation
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

According to one embodiment, a moving object detector includes an image input device and an image processing device. The image input device captures a moving object existing at a close distance to acquire image information of the moving object. The image processing device applies arithmetic processing to the image information to generate a cylindrical binary image and a top view binary image, extracts a region of the moving object by background correlation, estimates an approaching direction of the moving object from the cylindrical binary image, and estimates a motion trajectory of the moving object based on the approaching direction and the top view binary image.

Claims

1. A moving object detector comprising:

an image input device that captures a moving object existing at a close distance to acquire image information of the moving object; and

an image processing device that applies arithmetic processing to the image information to generate a cylindrical binary image and a top view binary image, extracts a region of the moving object by background correlation, estimates an approaching direction of the moving object from the cylindrical binary image, and estimates a motion trajectory of the moving object based on the approaching direction and the top view binary image.

2. The detector according to claim 1, wherein

the image processing device includes:

a cylindrical binary image generator that generates a cylindrical image from the image information acquired by the image input device and generates a cylindrical binary image based on the cylindrical image;

a top view binary image generator that generates an top view image from the image information acquired by the image input device and generates a top view binary image based on the top view image;

an approaching direction detector that detects the approaching direction from the cylindrical binary image; and

a motion trajectory estimator that estimates the motion trajectory from the approaching direction and top view binary image.

3. The detector according to claim 1, wherein

the image input device is a fish-eye camera.

4. The detector according to claim 2, wherein

the image input device is a fish-eye camera.

5. The detector according to claim 2, wherein

the cylindrical image is generated by developing, on a virtual flat surface, the image information obtained by capturing an object existing on a virtual cylindrical surface with the image input device.

6. The detector according to claim 2, wherein

the top view image is generated by applying view point conversion to the image information obtained by image captured by the image input device.

7. The detector according to claim 2, wherein

the generation of the cylindrical binary image and top view binary image includes applying generation of a difference image from a background based on background correlation using an edge image and extraction of only a moving object region using a two-stage Otsu'"'"'s binarization method considering a noise component to the cylindrical image and top view image independently of each other.

8. The detector according to claim 2, wherein

the estimation of the approaching direction of the moving object includes projection of the cylindrical binary image in a y-direction to calculate center of gravity coordinates and calculation of the approaching direction of the moving object from the calculated center of gravity coordinates.

9. The detector according to claim 2, wherein

the estimation of the motion trajectory includes rotation of the top view binary image using the approaching direction and correction of the rotation of the top view binary image such that the moving object always faces a predetermined direction, labeling of the rotation-corrected top view binary image to calculate a foot candidate region, estimation of a distance from a foot region by a weighted mean of an area of the foot candidate region, and calculation of a foot position for each frame based on the approaching direction and distance from the foot region.

10. A system comprising:

an electronic equipment to be operated by a user; and

the moving object detector according to claim 1 being mounted on the electronic equipment.

11. The system according to claim 10, wherein

the input image acquisition device captures an image of the user.