Image processing apparatus, image processing method, and image processing system

• US 10,319,099 B2
• Filed: 04/04/2016
• Issued: 06/11/2019
• Est. Priority Date: 04/14/2015
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Tsunashima, Nobuhiro
• Primary Examiner(s): Fujita, Katrina R
• Application Number:
  US15/542,685
• Publication Number:
  US 20170372485A1
• Time in Patent Office: 1,163 Days
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

An information processing apparatus, including circuitry configured to generate or receive a first image of a sequence of images including an object. The circuitry is configured to determine a length of time movement of the object is below a predetermined movement threshold. The circuitry is further configured to identify the object as a target object based on the determined length of time the movement of the object is below the predetermined movement threshold.

Claims

1. An information processing apparatus, comprising:

circuitry configured to;

generate or receive a first image of a sequence of images including a plurality of objects,

determine for each of the objects a length of time during which a movement of an object is below a predetermined movement threshold,

identify the object as a target object based on the determined length of time during which the movement of the object is below the predetermined movement threshold,

generate a reduced image from the first image by lowering a resolution of the first image, wherein the target object in the reduced image is less visually recognizable than the target object in the first image,

generate a cropped image from the first image by cropping the first image by cropping each of the objects identified as the target object, the cropped image having the lowered resolution of the first image, and

display the reduced image and the cropped image so that a user can visually confirm a full view of the first image and the each of the objects identified as the target object in the cropped image.

2. The information processing apparatus according to claim 1, wherein the circuitry is configured to:

receive or generate the sequence of images, including the first image and a second image captured before the first image, the object being identified as the target object in the second image,

determine whether to continue to identify the object as the target object in the first image based on the determined length of time during which the movement of the object is below the predetermined movement threshold, and

identify the object as the target object when the circuitry determines to continue to identify the object as the target object in the first image.

3. The information processing apparatus according to claim 2, wherein the circuitry is configured to change the target object from the object to a different object included in the first image when the circuitry determines not to continue identifying the object as the target object.

4. The information processing apparatus according to claim 1, wherein the circuitry is configured to:

determine whether the length of time during which the movement of the object is below the predetermined movement threshold exceeds an upper time limit, and

identify the object as the target object when the length of time during which the movement of the object is below the predetermined movement threshold is less than or equal to the upper time limit.

5. The information processing apparatus according to claim 1, wherein the circuitry is configured to:

determine whether the length of time during which the movement of the object is below the predetermined movement threshold exceeds an upper time limit, and

identify a different object included in the first image as the target object when the length of the time during which the movement of the object is below the predetermined movement threshold exceeds the upper time limit.

6. The information processing apparatus according to claim 1, further comprising:

an image sensor configured to capture the sequence of images, including the first image.

7. The information processing apparatus according to claim 1, wherein

the target object is a cropping target, and

the circuitry is configured to generate the cropped image by cropping the first image based on a position of the object within the first image when the object is identified as the target object.

8. The information processing apparatus according to claim 7, wherein the circuitry is configured to:

transmit the cropped image and the reduced image.

9. The information processing apparatus according to claim 1, wherein

the circuitry is configured to transmit a plurality of image streams,

the plurality of image streams includes cropped images of different portions of each of the sequence of images, and

each of the different portions corresponds to a different object.

10. The information processing apparatus according to claim 1, wherein the circuitry is configured to:

identify the object as the target object based on the determined length of time during which the movement of the object is below the predetermined movement threshold and another length of time during which the object is identified as the target object.

11. The information processing apparatus according to claim 1, wherein the predetermined movement threshold corresponds to an amount of movement between successive images in the sequence of images.

12. The information processing apparatus according to claim 1, wherein the circuitry is configured to:

set an upper time limit based on a user input, and

identify the object as the target object based on a comparison of the length of time during which the movement of the object is below the predetermined movement threshold and the set upper time limit.

13. The information processing apparatus according to claim 1, wherein the circuitry is configured to:

set different upper time limits for different images, including the first image, in the sequence of images, and

identify the object as the target object in the first image based on a comparison of the length of time during which the movement of the object is below the predetermined movement threshold and the upper time limit set for the first image.

14. The information processing apparatus according to claim 1, wherein the circuitry is configured to:

detect the plurality of objects included in the first image, and

identify a subset of the plurality of objects as target objects in the first image when a number of the plurality of objects exceeds a predetermined maximum number of target objects, the predetermined maximum number being greater than 1.

15. The information processing apparatus according to claim 1, wherein the circuitry is configured to:

continue to identify the object as the target object in subsequent successive images of the sequence of images, including the object and captured after the first image, until the length of time during which the movement of the object is below the predetermined movement threshold exceeds an upper time limit.

16. The information processing apparatus according to claim 1, wherein the circuitry is configured to:

determine a plurality of cropped regions of the first image, each of the cropped regions corresponding to a different target object, and

determine whether a first one of the plurality of cropped regions overlaps with a second one of the plurality of cropped regions.

17. The information processing apparatus according to claim 16, wherein the circuitry is configured to:

determine that the first one of the plurality of cropped regions overlaps with the second one of the plurality of cropped regions when an area of an overlapping region for the first one of the plurality of cropped regions and the second one of the plurality of cropped regions exceeds a first predetermined overlap threshold or a distance between centers of the first one of the plurality of cropped regions and the second one of the plurality of cropped regions exceeds a second predetermined overlap threshold.

18. The information processing apparatus according to claim 1, wherein the length of time during which the movement of the object is below the predetermined movement threshold indicates a length of time during which the object has stopped.

19. A method of an information processing apparatus for identifying a target object, the method comprising:

generating or receiving a first image of a sequence of images including a plurality of objects;

determining, by circuitry of the information processing apparatus, for each of the objects a length of time during which a movement of an object is below a predetermined movement threshold;

identifying, by the circuitry, the object as the target object based on the determined length of time during which the movement of the object is below the predetermined movement threshold;

generating a reduced image from the first image by lowering a resolution of the first image, wherein the target object in the reduced image is less visually recognizable than the target object in the first image;

generating a cropped image from the first image by cropping the first image by cropping each of the objects identified as the target object, the cropped image having the lowered resolution of the first image; and

displaying the reduced image and the cropped image so that a user can visually confirm a full view of the first image and the each of the objects identified as the target object in the cropped image.

20. A non-transitory computer-readable medium storing instructions which when executed by a computer cause the computer to perform a method of an information processing apparatus for identifying a target object, the method comprising:

generating or receiving a first image of a sequence of images including a plurality of objects;

determining for each of the objects a length of time during which a movement of an object is below a predetermined movement threshold;

identifying the object as the target object based on the determined length of time during which the movement of the object is below the predetermined movement threshold;

generating a reduced image from the first image by lowering a resolution of the first image, wherein the target object in the reduced image is less visually recognizable than the target object in the first image;

generating a cropped image from the first image by cropping the first image by cropping each of the objects identified as the target object, the cropped image having the lowered resolution of the first image; and

displaying the reduced image and the cropped image so that a user can visually confirm a full view of the first image and the each of the objects identified as the target object in the cropped image.