INFORMATION PROCESSING APPARATUS, CONTROL METHOD, AND PROGRAM

• US 20190325589A1
• Filed: 06/18/2019
• Published: 10/24/2019
• Est. Priority Date: 03/18/2016
• Status: Active Grant

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: OAMI, Ryoma, TAKAHASHI, Katsuhiko, KONISHI, Yusuke, YAMADA, Hiroshi, IKEDA, Hiroo, NAKAGAWA, Junko, YOSHIMI, Kosuke, KAWAI, Ryo, OGAWA, Takuya
• Granted Patent: US 11,205,275 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: G06T 2207/20076 Probabilistic image processing
• CPC Class Codes: G06T 2207/20081 Training; Learning
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 2207/30242 Counting objects in image
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/269 using gradient-based methods
• CPC Class Codes: G06T 7/292 Multi-camera tracking
• CPC Class Codes: G06V 20/53 Recognition of crowd images, e.g. recognition of crowd congestion
• CPC Class Codes: G06V 40/25 Recognition of walking or running movements, e.g. gait recognition
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

An information processing apparatus (2000) includes a first analyzing unit (2020), a second analyzing unit (2040), and an estimating unit (2060). The first analyzing unit (2020) calculates a flow of a crowd in a capturing range of a fixed camera (10) using a first surveillance image (12). The second analyzing unit (2040) calculates a distribution of an attribute of objects in a capturing range of a moving camera (20) using a second surveillance image (22). The estimating unit (2060) estimates an attribute distribution for a range that is not included in the capturing range of the moving camera (20).

Claims

1. An information processing system comprising:

at least one memory storing instructions; and

at least one processor coupled to the at least one memory, the at least one processor being configured to execute the instructions to;

calculate a distribution of attributes of persons in an analysis range by analyzing at least any of images and voices, the attributes being distinguished by used language;

estimate, with respect to at least one attribute included in the attributes, a number or a ratio of persons who belong to the at least one attribute and who are present in an estimation range including a range not included in the analysis range, using the calculated distribution; and

cause a display device to display, on a map of an area including the estimation range, a position of at least one of;

a security guard that is able to speak a specific language;

a security guard carrying a device that provides translation function; and

a robot carrying a device that provides translation function.

2. The information processing system according to claim 1, wherein the at least one processor is further configured to

calculate the distribution of the attributes of the objects by analyzing used language in voices recorded by an microphone near the analysis range.

3. The information processing system according to claim 1, wherein the at least one processor is further configured to:

calculate a flow of persons in a particular range related to the analysis range using an image of the particular range; and

estimate the number or the ratio of persons who belong to the at least one attribute and who are present in the estimation range at a time point in future, using the calculated flow and the calculated distribution.

4. The information processing system according to claim 1, wherein

the at least one processor is further configured to:

calculate two or more distributions of attributes of persons in two or more analysis ranges by the analyzing;

acquire two or more estimation results which are results of each estimation of the number or the ratio of the persons which belong to the at least one attribute and which are present in the estimation range, the each estimation being performed based on respective one of the two or more distributions; and

superpose the acquired two or more estimation results and cause the display device to display the superposed two or more estimation results.

5. An information processing method comprising:

calculating a distribution of attributes of persons in an analysis range by analyzing at least any of images and voices, the attributes being distinguished by used language;

estimating, with respect to at least one attribute included in the attributes, a number or a ratio of persons who belong to the at least one attribute and who are present in an estimation range including a range not included in the analysis range, using the calculated distribution; and

causing a display device to display, on a map of an area including the estimation range, a position of at least one of;

a security guard that is able to speak a specific language;

a security guard carrying a device that provides translation function; and

a robot carrying a device that provides translation function.

6. The information processing method according to claim 5, further comprising

calculating the distribution of the attributes of the objects by analyzing used language in voices recorded by an microphone near the analysis range.

7. The information processing method according to claim 5, further comprising

calculating a flow of persons in a particular range related to the analysis range using an image of the particular range;

and

estimating the number or the ratio of persons who belong to the at least one attribute and who are present in the estimation range at a time point in future, using the calculated flow and the calculated distribution.

8. The information processing method according to claim 5, further comprising:

calculating two or more distributions of attributes of persons in two or more analysis ranges by the analyzing;

acquiring two or more estimation results which are results of each estimation of the number or the ratio of the persons which belong to the at least one attribute and which are present in the estimation range, the each estimation being performed based on respective one of the two or more distributions; and

superposing the acquired two or more estimation results and cause the display device to display the superposed two or more estimation results.

9. A non-transitory computer-readable storage medium storing a program that causes a computer to perform:

calculating a distribution of attributes of persons in an analysis range by analyzing at least any of images and voices, the attributes being distinguished by used language;

estimating, with respect to at least one attribute included in the attributes, a number or a ratio of persons who belong to the at least one attribute and who are present in an estimation range including a range not included in the analysis range, using the calculated distribution; and

causing a display device to display, on a map of an area including the estimation range, a position of at least one of;

a security guard that is able to speak a specific language;

a security guard carrying a device that provides translation function; and

a robot carrying a device that provides translation function.

10. The storage medium according to claim 9, wherein the program further causes the computer to perform

calculating the distribution of the attributes of the objects by analyzing used language in voices recorded by an microphone near the analysis range.

11. The storage medium according to claim 9, wherein the program further causes the computer to perform:

calculating a flow of persons in a particular range related to the analysis range using an image of the particular range; and

estimating the number or the ratio of persons who belong to the at least one attribute and who are present in the estimation range at a time point in future, using the calculated flow and the calculated distribution.

12. The storage medium according to claim 9, wherein the program further causes the computer to perform:

calculating two or more distributions of attributes of persons in two or more analysis ranges by the analyzing;

acquiring two or more estimation results which are results of each estimation of the number or the ratio of the persons which belong to the at least one attribute and which are present in the estimation range, the each estimation being performed based on respective one of the two or more distributions; and

superposing the acquired two or more estimation results and cause the display device to display the superposed two or more estimation results.