Information processing device, information processing method, and computer program product

• US 10,402,634 B2
• Filed: 08/30/2017
• Issued: 09/03/2019
• Est. Priority Date: 03/03/2017
• Status: Active Grant

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Kozakaya, Tatsuo
• Primary Examiner(s): Woldemariam, Aklilu K
• Application Number:
  US15/690,700
• Publication Number:
  US 20180253597A1
• Time in Patent Office: 734 Days
• Field of Search: 382103, 382110, 382115, 382118, 348135, 348150, 348222, 348345
• CPC Class Codes: G06F 18/24133 Distances to prototypes
• CPC Class Codes: G06F 18/2415 based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G08B 13/196 using television cameras

Abstract

According to an embodiment, an information processing device includes a memory and processing circuitry. The processing circuitry is configured to receive an image and area information indicating a first area. The processing circuitry is configured to detect an object from the image. The processing circuitry is configured to, based on positional relationship between the first area and the object, estimate probability of occurrence of an event in the first area.

Claims

1. An information processing device comprising:

a memory; and

processing circuitry configured to;

receive an image and area information indicating a first area;

detect an object from the image; and

based on positional relationship between the first area and the object and based on a movement trajectory of the object, estimate probability of occurrence of an event in the first area,

wherein the object is a person, and

when a first person is present at a position whose distance to the first area is equal to or smaller than a first threshold value and when an obstruction is present between the first area and one or more second persons, the estimating sets the probability of occurrence of an event in the first area to be equal to or greater than a second threshold value.

2. The device according to claim 1, wherein

when the object moves out of viewing area of the image and when the object is likely to be present in the first area, the circuitry is further configured to set state information indicating that the object is likely to be present in the first area, and

the estimating estimates the probability of occurrence of an event in the first area further based on the state information.

3. The device according to claim 1, wherein

the object is a person,

the detecting further detects attribute information indicating attribute of the person, and

the estimating estimates the probability of occurrence of an event in the first area further based on the attribute information.

4. The device according to claim 3, wherein the attribute information contains at least one of age, gender, wearables, belongings, hairstyle, and race.

5. The device according to claim 1, wherein

the object is a person, and

the estimating estimates the probability of occurrence of an event in the first area further based on behavior information indicating behavior of the person.

6. The device according to claim 5, wherein the behavior information contains at least one of face orientation of the person, direction of an eye of the person, a movement speed of the person, a hand movement of the person, and a period of stay for which the person stays in a second area including the first area.

7. The device according to claim 1, wherein

the detecting further detects a predetermined object from an image, and

the estimating estimates the probability of occurrence of an event in the first area further based on distance between the predetermined object and the first area.

8. The device according to claim 1, wherein the estimating estimates the probability of occurrence of an event in the first area further based on attribute information indicating attribute of the first area.

9. The device according to claim 1, wherein the estimating estimates the probability of occurrence of an event in the first area further according to the time of day.

10. The device according to claim 1, wherein the estimating further estimates a timing at which the probability of occurrence of an event in the first area becomes equal to or greater than a threshold value.

11. The device according to claim 1, wherein the circuitry is further configured to, when the probability of occurrence of an event in the first area is equal to or greater than a threshold value, notify that the probability of occurrence of the event in the first area is equal to or greater than the threshold value.

12. An information processing method comprising:

receiving an image and area information indicating a first area;

detecting an object from the image; and

estimating, based on positional relationship between the first area and the object and based on a movement trajectory of the object, probability of occurrence of an event in the first area,

wherein the object is a person, and

when a first person is present at a position whose distance to the first area is equal to or smaller than a first threshold value and when an obstruction is present between the first area and one or more second persons, the estimating sets the probability of occurrence of an event in the first area to be equal to or greater than a second threshold value.

13. The method according to claim 12, wherein

when the object moves out of viewing area of the image and when the object is likely to be present in the first area, the detecting includes setting state information indicating that the object is likely to be present in the first area, and

the estimating estimates the probability of occurrence of an event in the first area further based on the state information.

14. The method according to claim 12, wherein

the object is a person,

the detecting further detects attribute information indicating attribute of the person, and

the estimating estimates the probability of occurrence of an event in the first area further based on the attribute information.

15. The method according to claim 14, wherein the attribute information contains at least one of age, gender, wearables, belongings, hairstyle, and race.

16. A computer program product comprising a non-transitory computer-readable medium including programmed instructions, wherein the instructions, when executed by a computer, cause the computer to function as:

a receiving unit configured to receive an image and area information indicating a first area;

a detecting unit configured to detect an object from the image; and

an estimating unit configured to, based on positional relationship between the first area and the object and based on a movement trajectory of the object, estimate probability of occurrence of an event in the first area,

wherein the object is a person, and

when a first person is present at a position whose distance to the first area is equal to or smaller than a first threshold value and when an obstruction is present between the first area and one or more second persons, the estimating sets the probability of occurrence of an event in the first area to be equal to or greater than a second threshold value.