MONITORING SYSTEM

• US 20150334299A1
• Filed: 05/14/2014
• Published: 11/19/2015
• Est. Priority Date: 05/14/2014
• Status: Abandoned Application

• Current Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: TSUNENO, Masashige, KAWAMOTO, Koji
• Application Number:
  US14/277,278
• Publication Number:
  US 20150334299A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/292 Multi-camera tracking
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A monitoring system includes a stationary camera, an omni-directional camera, and image processing apparatus and a display unit. The stationary camera captures an image in a predetermined imaging range. The omni-directional camera captures an image in an omni-directional imaging area including the predetermined imaging range. The image processing apparatus detects a predetermined event in first image data generated from the image in the predetermined imaging range captured by the stationary camera. In a case where the predetermined event is detected in the predetermined imaging range of the first image data, the display unit displays the first image data and second image data generated from the image in the omni-directional imaging area captured by the omni-directional camera and includes the predetermined imaging range from which the predetermined event is detected.

Claims

1. A monitoring system, comprising:

a stationary camera that captures an image in a predetermined imaging range;

an omni-directional camera that captures an image in an omni-directional imaging area including the predetermined imaging range;

an image processing apparatus that detects a predetermined event in first image data, wherein the first image data is generated from the image in the predetermined imaging range captured by the stationary camera; and

a display unit that displays image data, wherein

in a case where the predetermined event is detected in the predetermined imaging range of the first image data, the display unit displays the first image data and second image data, wherein the second image data is generated from the image in the omni-directional imaging area captured by the omni-directional camera and includes the predetermined imaging range from which the predetermined event is detected.

2. The monitoring system according to claim 1, wherein

the omni-directional camera or the image processing apparatus generates the second image data that includes plane image data having a predetermined display range based on the image in the omni-directional imaging area captured by the omni-directional camera.

3. The monitoring system according to claim 2, wherein

the display unit displays the plane image data having the predetermined display range in which the predetermined imaging range captured by the stationary camera is included.

4. The monitoring system according to claim 2, wherein

the plane image data includes first and second divided plane image data generated by dividing the omni-directional imaging area into two areas,

a display range of the first or second divided plane image data includes the predetermined imaging range captured by the stationary camera, and

the display unit displays the first and second divided plane image data.

5. The monitoring system according to claim 2, wherein

the display unit displays a setting range input screen for causing a display range of the plane image data to be set, and

the omni-directional camera or the image processing apparatus generates the plane image data based on the display range set on the setting range input screen according to an input operation with respect to the setting range input screen.

6. The monitoring system according to claim 1, wherein

the image processing apparatus detects, as the predetermined event, a motion of a specific object in the predetermined imaging range of the first image data.

7. The monitoring system according to claim 1, wherein

the image processing apparatus detects, as the predetermined event, a face of a specific person in the predetermined imaging range of the first image data.

8. The monitoring system according to claim 6, wherein

the image processing apparatus detects the motion of the specific object in an area designated with respect to the display unit in the predetermined imaging range of the first image data.

9. The monitoring system according to claim 7, wherein

the image processing apparatus detects the face of the specific person in an area designated with respect to the display unit in the predetermined imaging range of the first image data.

10. The monitoring system according to claim 6, further comprising:

a storage unit that stores video data for each predetermined event, wherein the video data includes the first image data generated from the image captured by the stationary camera from a start of detecting the motion of the specific object to an end of detecting the motion of the specific object. wherein

the display unit displays an event card which indicates a storage of the video data stored for each predetermined event.

11. The monitoring system according to claim 10, wherein

the display unit displays, as the event card, a plurality of thumbnail image data items at a different time points from the start of detecting the motion of the specific object to the end of detecting the motion of the specific object.

12. The monitoring system according to claim 10, wherein

the display unit displays, as the event card, thumbnail image data of the plane image data with the display range having the predetermined imaging range captured by the stationary camera from the start of detecting the motion of the specific object to the end of detecting the motion of the specific object.

13. The monitoring system according to claim 11, wherein

the display unit reproduces the plane image data generated based on the omni-directional image data by the omni-directional camera from the start of detecting the motion of the specific object to the end of detecting the motion of the specific object according to an operation of the event card.

14. The monitoring system according to claim 7, further comprising:

a storage unit that stores video data for each predetermined event, wherein the video data includes the first image data generated from the image captured by the stationary camera from a start of detecting the face of the specific person to an end of detecting the face of the specific person, wherein

the display unit displays an event card which indicates a storage of the video data stored for each predetermined event.

15. The monitoring system according to claim 7, wherein

in a case where the image processing apparatus detects a face of a first person in the first image data, the image processing apparatus detects a face of a second person existing in the second image data at a plurality of different time points from a time point when the face of the first person is detected, and

the display unit displays image data of the face of the first person detected from the first image and image data of the face of the second person detected from the second image.

16. The monitoring system according to claim 7, wherein

in a predetermined time period including the time point when a face of a first person is detected in the first image data, the image processing apparatus detects a face of a second person existing in the second image data at a plurality of time points different from a time point when the face of the first person is detected, and

the display unit displays image data of the face of the first person detected from the first image data and image data of the face of the second person detected from the second image data.

17. The monitoring system according to claim 7, wherein

the image processing apparatus detects the face of the second person that exists at the same time as the detected face of the first person based on the image data related to the omni-direction captured by the omni-directional camera, and

the display unit displays a degree of relevance between the first person and the second person based on an imaging time of the face of the first person and an imaging time of the face of the second person.

18. The monitoring system according to claim 7, wherein

the image processing apparatus detects a face of a second person based on the second image data, the second person existing at a same time as a face of a first person detected from the first image data, and

the display unit displays a degree of relevance between the first person and the second person based on a distance between the first person and the second person.

19. The monitoring system according to claim 7, wherein

the image processing apparatus detects faces of a plurality of other persons based on the second image, the plurality of other persons existing in same image data in which the face of the first person designated with respect to the display unit exists, and

the display unit displays the faces of the plurality of other persons in an order determined based on a degree of relevance between the face of the designated first person and the faces of the plurality of other persons.