Investigation assist device, investigation assist method and investigation assist system

• US 10,475,337 B2
• Filed: 02/14/2018
• Issued: 11/12/2019
• Est. Priority Date: 08/17/2017
• Status: Active Grant

• Current Assignee: I-Pro Company Limited
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: Watanabe, Masao, Yoshida, Hideyuki, Yoshimura, Takahiro, Iiizumi, Masaomi, Arai, Takamitsu, Koishi, Takao, Morioka, Mikio, Suzuki, So
• Primary Examiner(s): Dang, Philip P.
• Application Number:
  US15/896,812
• Publication Number:
  US 20190057600A1
• Time in Patent Office: 636 Days
• CPC Class Codes: G06Q 50/26 Government or public services business processes related to the transportation industry G06Q50/40
• CPC Class Codes: G06Q 50/40 Business processes related to the transportation industry shipping G06Q10/083
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/54 of traffic, e.g. cars on the road, trains or boats
• CPC Class Codes: G08G 1/0116 from roadside infrastructure, e.g. beacons
• CPC Class Codes: G08G 1/0129 for creating historical data or processing based on historical data
• CPC Class Codes: G08G 1/0133 for classifying traffic situation
• CPC Class Codes: G08G 1/0175 by photographing vehicles, e.g. when violating traffic rules
• CPC Class Codes: G08G 1/04 using optical or ultrasonic detectors
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

An investigation assist device is connected to cameras installed at a plurality of intersections respectively. The investigation assist device has a processor and a storage that records road map information including the plurality of intersections and captured video of each camera in association with camera information and intersection information. The processor extracts camera information of intersections adjacent to a first point where an event occurred according to an information input including information on the first point and feature information of a vehicle having caused the event. The processor retrieves a vehicle satisfying the feature information of the vehicle using a captured video of a camera specified by the extracted camera information. The processor analyzes feature information of the retrieved vehicle. The processor updates feature information of the vehicle by adding the analyzed feature information of the vehicle to the feature information of the vehicle input by the information input, and stores the updated information in the storage. The processor updates detection point information of the vehicle from the information on the first point into detection point information of the retrieved vehicle, and stores the updated information in the storage.

Claims

1. An investigation assist device that is connected to cameras installed at a plurality of positions respectively so as to communicate with the cameras, the investigation assist device comprising:

a processor; and

a storage that records road map information including the plurality of positions and captured video of each camera in association with camera information and position information;

wherein the processor extracts the camera information of positions in a proximity of a first point where an event occurred according to an information input including information on the first point and feature information of a vehicle having caused the event;

wherein the processor retrieves a plurality of vehicles satisfying the feature information of a vehicle having caused the event using a captured video of a camera specified by the extracted camera information;

wherein the processor;

displays a plurality of individual images of the plurality of retrieved vehicles, respectively, on an operator terminal, each displayed individual image of the plurality of individual images including a respective retrieved vehicle of the plurality of retrieved vehicles, and

receives, from an operator of the operator terminal, a selection of an individual image of the plurality of displayed individual images,

wherein the processor analyzes feature information of the vehicle of the plurality of retrieved vehicles corresponding to the selected individual image of the plurality of displayed individual images;

wherein the processor updates the feature information of the vehicle having caused the event by adding the analyzed feature information of the retrieved vehicle corresponding to the selected individual image to the feature information of the vehicle having caused the event and stores the updated feature information in the storage,

wherein the processor updates detection point information of the vehicle having caused the event from the information on the first point to the detection point information of the retrieved vehicle corresponding to the selected individual image, and

wherein the processor determines a route of the vehicle having caused the event based on the updated detection point information of the retrieved vehicle corresponding to the selected individual image and stores the updated detection point information in the storage.

2. The investigation assist device of claim 1,

wherein whenever the detection point information of the vehicle having caused the event is updated, the processor extracts the camera information of the positions in the proximity of a detection point specified by the updated detection point information.

3. The investigation assist device of claim 1,

wherein the processor sets a predetermined period as a retrieval target period for the captured video of the camera, the predetermined period containing an occurrence time of a report about an occurrence of the event or a detection time of the vehicle having caused the event.

6. The investigation assist device of claim 1, wherein the route of the vehicle having caused the event is an escape route and the processor is configured to:

overlay the escape route of the vehicle having caused the event on the road map information;

output the escape route of the vehicle having caused the event overlaid on the road map information to a display.

7. The investigation assist device of claim 6, wherein the processor is configured to:

incorporate information indicating an escape direction of the vehicle having caused the event into the escape route overlaid on the road map information;

output the incorporated information indicating the escape direction to the display.

4. An investigation assist method using an investigation assist device that is connected to cameras installed at a plurality of positions respectively so as to communicate with the cameras, the investigation assist method comprising:

receiving an information input including information on a first point where an event occurred and feature information of a vehicle having caused the event;

extracting camera information of positions in a proximity of the first point according to the information input;

retrieving a plurality of vehicles satisfying the feature information of a vehicle having caused the event using a captured video of a camera specified by the extracted camera information;

displaying a plurality of individual images of the plurality of retrieved vehicles, respectively, on an operator terminal, each displayed individual image of the plurality of individual images including a respective retrieved vehicle of the plurality of retrieved vehicles;

receiving, from an operator of the operator terminal, a selection of an individual image of the plurality of displayed individual images;

analyzing feature information of a retrieved vehicle of the plurality of retrieved vehicles corresponding to the selected individual image of the plurality of displayed individual images;

updating the feature information of the vehicle having caused the event by adding the analyzed feature information of the retrieved vehicle corresponding to the selected individual image to the feature information of the vehicle having caused the event and storing the updated feature information in a storage;

updating detection point information of the vehicle having caused the event from the information on the first point to the detection point information of the retrieved vehicle corresponding to the selected individual image and storing the updated detection point information in the storage; and

determining a route of the vehicle having caused the event based on the updated detection point information.

8. The investigation assist method of claim 4, wherein the route of the vehicle having caused the event is an escape route and the investigation assist method comprises:

overlaying the escape route of the vehicle having caused the event on road map information;

outputting the escape route of the vehicle having caused the event overlaid on the road map information to a display.

9. The investigation assist device of claim 8, comprising:

incorporating information indicating an escape direction of the vehicle having caused the event into the escape route overlaid on the road map information;

outputting the incorporated information indicating the escape direction to the display.

5. An investigation assist system comprising:

cameras installed at a plurality of positions respectively; and

an investigation assist device connected to the cameras so as to communicate with the cameras, wherein the investigation assist device includes;

a processor; and

a storage that records road map information including the plurality of positions and captured video of each camera in association with camera information and position information;

wherein the processor extracts the camera information of positions in a proximity of a first point where an event occurred, according to an information input including information on the first point and feature information of a vehicle having caused the event;

wherein the processor retrieves a plurality of vehicles satisfying the feature information of a vehicle having caused the event using a captured video of a camera specified by the extracted camera information;

wherein the processor;

displays a plurality of individual images of the plurality of retrieved vehicles, respectively, on an operator terminal, each displayed individual image of the plurality of individual images including a respective retrieved vehicle of the plurality of retrieved vehicles; and

receives, from an operator of the operator terminal, a selection of an individual image of the plurality of displayed individual images,

wherein the processor analyzes feature information of a vehicle of the plurality of retrieved vehicles corresponding to the selected individual image of the plurality of displayed individual images; and

wherein the processor;

updates the feature information of the vehicle having caused the event by adding the analyzed feature information of the retrieved vehicle corresponding to the selected individual image to the feature information of the vehicle having caused the event,

stores the updated feature information in the storage,

updates detection point information of the vehicle having caused the event from the information on the first point to the detection point information of the retrieved vehicle corresponding to the selected individual image,

stores the updated detection point information in the storage, and

determines a route of the vehicle having caused the event based on the updated detection point information.

10. The investigation assist system of claim 5, wherein the route of the vehicle having caused the event is an escape route and wherein the processor is configured to:

overlay the escape route of the vehicle having caused the event on the road map information;

output the escape route of the vehicle having caused the event overlaid on the road map information to a display.

11. The investigation assist system of claim 10, wherein the processor is configured to:

incorporate information indicating an escape direction of the vehicle having caused the event into the escape route overlaid on the road map information;

output the incorporated information indicating the escape direction to the display.

12. An investigation assist device that is connected to cameras installed at a plurality of positions respectively so as to communicate with the cameras, the investigation assist device comprising:

a processor; and

a storage that records road map information including the plurality of positions and captured video of each camera in association with camera information and position information;

wherein the processor extracts camera information of positions in a proximity of a first point where an event occurred according to an information input including information on the first point and feature information of a vehicle having caused the event, and a period of time measured from when a report of the event is received or from when the vehicle having caused the event is detected;

wherein the processor retrieves a plurality of vehicles satisfying the feature information of the vehicle having caused the event using a captured video of a camera specified by the extracted camera information;

wherein the processor;

displays a plurality of individual images of the plurality of retrieved vehicles, respectively, on an operator terminal, each displayed individual image of the plurality of individual images including a respective retrieved vehicle of the plurality of retrieved vehicles, and

receives, from an operator of the operator terminal, a selection of an individual image of the plurality of displayed individual images,

wherein the processor analyzes feature information of a retrieved vehicle of the plurality of retrieved vehicles corresponding to the selected individual image of the plurality of displayed individual images;

wherein the processor updates the feature information of the vehicle having caused the event by adding the analyzed feature information of the retrieved vehicle corresponding to the selected individual image to the feature information of the vehicle having caused the event and stores the updated feature information in the storage,

wherein the processor updates detection point information of the vehicle having caused the event from the information on the first point to the detection point information of the retrieved vehicle corresponding to the selected individual image and stores the updated detection point information in the storage,

wherein the processor determines an escape route of the vehicle having caused the event based on the updated detection point information of the retrieved vehicle corresponding to the selected individual image,

wherein the processor overlays the escape route on the road map information and outputs the escape route overlaid on the road map information to a display.

13. The investigation assist device of claim 12, wherein the camera specified by the extracted camera information is a camera which is within a movable distance of the vehicle having caused the event, the movable distance of the vehicle having caused the event being measured from the first point or being measured from a location determined from the updated detection point information.

14. The investigation assist device of claim 12, wherein the period of time measured from when a report of the event is received is equal to a difference between a time when the event is reported and a current time.

15. The investigation assist device of claim 12, wherein the period of time measured from when the vehicle having caused the event is detected is equal to a difference between a time when the vehicle having caused the event is detected and a current time.

16. The investigation device of claim 12, wherein the camera specified by the extracted camera information is a camera within a distance from the first point or a distance from a location where the vehicle causing the event is detected that is equal to a distance the vehicle having caused the event can travel in a period of time equal to a difference between a time when a report of the event is received and a current time or a difference between a time when the vehicle the caused the event is detected and the current time.