System and method for monitoring motion object

• US 8,270,705 B2
• Filed: 08/28/2010
• Issued: 09/18/2012
• Est. Priority Date: 07/23/2010
• Status: Active Grant

• Current Assignee: Cloud Network Technology Singapore Pte. Ltd. (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Hon Hai Precision Industry Co., Ltd.
• Inventors: Lee, Hou-Hsien, Lee, Chang-Jung, Lo, Chih-Ping
• Primary Examiner(s): Tabatabai, Abolfazl
• Application Number:
  US12/870,797
• Publication Number:
  US 20120020516A1
• Time in Patent Office: 752 Days
• Field of Search: 382/103, 382/107, 382/154, 382/236, 348/14.1, 348/97, 348/143, 348/144, 348/154, 348/155, 348/169, 348/208.16, 348/352, 348/407.1, 348/451, 345/108, 345/474, 715/752
• US Class Current: 382/154
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69

Abstract

A motion object monitoring system captures an image of a scene and distance data between points in the scene and a time-of-flight (TOF) camera by the TOF camera. A 3D model of the scene is built according to the image of the scene and the distance data. The motion object monitoring system gives numbers to the monitored objects according to specific features of the monitored objects. The specific features of the monitored objects are obtained by detecting the built 3D model of the scene. Only one of the numbers of each of the monitored objects is stored, instead of repeatedly storing the numbers of same motion objects. The motion object monitoring system analyzes the stored numbers, and displays an analysis result. The motion object monitoring system also determines a movement of each of the motion objects according to corresponding numbers of the motion objects.

Claims

1. A motion object monitoring system comprising:

a time-of-flight (TOF) camera to capture a scene to obtain an image of the scene and distance data between a plurality of points in the scene and the TOF camera;

a processor; and

a storage device connected to the processor and storing one or more computerized instructions to be executed by the processor, wherein the storage device comprises;

a three-dimensional (3D) model module to build a 3D model of the scene according to the image of the scene and the distance data between the plurality of points in the scene and the TOF camera;

an information gathering module obtaining specific features of the monitored objects by detecting the built 3D model of the scene, and giving numbers to each of the monitored objects according to the specific features;

a storing and comparing module storing one of the given numbers of each of the monitored objects; and

a processing module analyzing the given numbers stored in the storing and comparing module.

2. The motion object monitoring system of claim 1, wherein the 3D model building module obtains a curved surface according to the distance data between the plurality of points in the scene and the TOF camera, to obtain the 3D model of the scene.

3. The motion object monitoring system of claim 1, wherein the processing module comprises a data analyzing unit analyzing the given numbers stored in the storing and comparing module to obtain an analysis result.

4. The motion object monitoring system of claim 3, wherein each of the given numbers further comprises a position portion representing a coordinate position of the monitored object in the monitored area, and a time portion representing a time when the monitored object appears at the coordinate position.

5. The motion object monitoring system of claim 4, wherein the processing module comprises:

a data storing unit receiving the given numbers from the information gathering module, and storing the given numbers;

an object tracking unit reading the position portions and the time portions of the given numbers with same feature portions, from the data storing unit, and sequencing the position portions according to the time portions correspondingly; and

a displaying unit displaying the coordinate positions in sequence of time according to the sequenced position portions.

6. The motion object monitoring system of claim 1, wherein each of the given numbers comprises a feature portion representing the specific features of a corresponding one of the monitored objects.

7. The motion object monitoring system of claim 6, wherein the storing and comparing module compares the feature portion of a given number with the feature portion of each of the stored numbers in response to receipt of the given number, the storing and comparing module stores the given number in response to the feature portion of the given number being different from the feature portion of all of the stored numbers, the given number is not stored in the storing and comparing module in response to the feature portion of the given number being the same as the feature portion of one of the stored numbers.

8. The motion object monitoring system of claim 1, wherein the information gathering module comprises:

a key portion locating unit locating key portions which have the specific features of the monitored objects in the 3D model of the scene;

a feature obtaining unit obtaining the specific features by detecting the key portions of each of the images; and

a numbering unit generating the numbers for the monitored objects according to the detected specific features.

9. The motion object monitoring system of claim 1, wherein the monitored objects are subjects, the key portions of the 3D model of the scene comprise faces of the subjects, the specific features of the monitored objects comprise facial features of the subjects.

10. A motion object monitoring method comprising:

capturing a scene by a time-of-flight (TOF) camera to obtain an image of the scene and distance data between a plurality of points in the scene and the TOF camera;

building a three-dimensional (3D) model of the scene according to the image and the distance data;

obtaining specific features of each of the motion objects by detecting the built 3D model of the scene by an information gathering module;

giving numbers to each of the motion objects according to the specific features of the motion objects;

storing one of the given numbers of each of the motion objects by a storing and comparing module; and

processing the stored given numbers of the storing and comparing module by a processing module.

11. The motion object monitoring method of claim 10, wherein the 3D model is obtained from a curved surface according to the distance data between the plurality of points in the scene and the TOF camera.

12. The motion object monitoring method of claim 10, wherein the step of obtaining specific features of each of the motion objects comprises:

locating key portions of the 3D model of the scene by a key portion locating unit of the information gathering module; and

obtaining the specific features by detecting the key portions of the 3D model of the scene by a feature obtaining unit of the information gathering module.

13. The motion object monitoring method of claim 10, wherein the numbers of each of the motion objects are generated by a numbering unit of the information gathering module.

14. The motion object monitoring method of claim 10, wherein each of the given numbers comprises a feature portion representing the specific features of a corresponding one of the motion objects.

15. The motion object monitoring method of claim 14, wherein the step of storing one of the given numbers of each of the motion objects comprises:

receiving a number by the storing and comparing module; and

comparing the feature portion of the received number with the feature portion of each of the stored numbers by the storing and comparing module;

wherein the storing and comparing module stores the received number in response to the feature portion of the received number being different from the feature portion of all of the stored numbers;

the received number is not stored in the storing and comparing module in response to the feature portion of the received number being the same as the feature portion of one of the stored numbers.

16. The motion object monitoring method of claim 10, wherein the step of processing the stored given numbers comprises:

counting the stored given numbers by a data analyzing unit of the processing module; and

displaying a counting result of the stored given numbers by a displaying unit of the processing module.

17. A motion object monitoring method comprising:

capturing a scene by a time-of-flight (TOF) camera to obtain an image of the scene and distance data between a plurality of points in the scene and the TOF camera;

building a three-dimensional (3D) model of the scene according to the image and the distance data;

obtaining specific features of each of the motion objects by detecting the built 3D model of the scene by an information gathering module;

giving numbers to the motion objects by an information gathering module, wherein each of the numbers of each of the motion objects comprises a feature portion representing specific features of the motion object, a position portion representing a coordinate position of the motion object in the monitored area, and a time portion representing a time when the motion object appears at the coordinate position;

storing the given numbers in a data storing unit;

reading the position portions and the time portions of the given numbers with same feature portions from the data storing unit, and determining a movement of each of the motion objects by sequencing the position portions according to corresponding time portions by an object tracking unit; and

displaying the movement of each of the motion objects by a displaying unit.