Representative image generation device and representative image generation method

• US 10,740,623 B2
• Filed: 08/18/2016
• Issued: 08/11/2020
• Est. Priority Date: 09/25/2015
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Ebihara, Masakazu
• Primary Examiner(s): Tabatabai, Abolfazl
• Application Number:
  US15/758,226
• Publication Number:
  US 20180260632A1
• Time in Patent Office: 1,454 Days
• Field of Search: 382103
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G08B 13/1961 Movement detection not involving frame subtraction, e.g. motion detection on the basis of luminance changes in the image
• CPC Class Codes: G08B 13/19613 Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion

Abstract

A representative image generation device includes circuitry that identifies a selected image from a plurality of recorded images of an object. The plurality of recorded images are captured as the object traverses a predetermined area. The device prepares the selected image for display on a display device, wherein the selected image provides a visual recognizability of the object greater than a predetermined threshold.

Claims

1. A representative image generation device, comprising:

circuitry configured to;

identify a selected image of an object from a plurality of recorded images, wherein the plurality of recorded images includes at least a portion of the object, and the plurality of recorded images is captured as the object traverses a determined area; and

control display of the selected image on a display device, wherein the selected image provides a visual recognizability of the object greater than a determined threshold.

2. The representative image generation device of claim 1, wherein the determined threshold corresponds to a highest recognizability of the object among the plurality of recorded images.

3. The representative image generation device of claim 1, wherein the determined threshold corresponds to the visual recognizability of the object that is greater than a visual recognizability of the object at a time the object is initially detected in the determined area.

4. The representative image generation device of claim 1, further comprising the display device configured to display a representation of the selected image.

5. The representative image generation device of claim 1, wherein the circuitry is further configured to produce a tracking frame that includes the portion of the object.

6. The representative image generation device of claim 1, wherein the selected image is a thumbnail image.

7. The representative image generation device of claim 1, wherein the circuitry is further configured to track the object as the object traverses the determined area.

8. The representative image generation device of claim 1, wherein the circuitry is further configured to use a size of the object in at least two of the plurality of recorded images of the object as a factor to identify the selected image that has the visual recognizability greater than the determined threshold.

9. The representative image generation device of claim 1, wherein the circuitry is further configured to use object aspect ratio of the object in at least two of the plurality of recorded images of the object as a factor to identify the selected image that has the visual recognizability greater than the determined threshold.

10. The representative image generation device of claim 1, wherein the circuitry is further configured to use direction of motion of the object in at least two of the plurality of recorded images of the object as a factor to identify the selected image that has the visual recognizability greater than the determined threshold.

11. The representative image generation device of claim 1, wherein the circuitry is further configured to use a calculated human likeness indication of the object in at least two of the plurality of recorded images of the object as a factor to identify the selected image that has the visual recognizability greater than the determined threshold.

12. The representative image generation device of claim 1, wherein the circuitry is further configured to use face direction of the object in at least two of the plurality of recorded images of the object as a factor to identify the selected image that has the visual recognizability greater than the determined threshold.

13. The representative image generation device of claim 1, wherein the circuitry is further configured to use color information frame correlation in at least two of the plurality of recorded images of the object as a factor to identify the selected image that has the visual recognizability greater than the determined threshold.

14. The representative image generation device of claim 1, wherein the circuitry is further configured to use object speed of the object in at least two of the plurality of recorded images of the object as a factor to identify the selected image that has the visual recognizability greater than the determined threshold.

15. The representative image generation device of claim 1, wherein the circuitry is further configured to use object signal to noise ratio of the object in at least two of the plurality of recorded images of the object as a factor to identify the selected image that has the visual recognizability greater than the determined threshold.

16. The representative image generation device of claim 1, wherein the circuitry is further configured to use object luminance in at least two of the plurality of recorded images of the object as a factor to identify the selected image that has the visual recognizability greater than the determined threshold.

17. The representative image generation device of claim 1, wherein

the plurality of recorded images is respective frames of a video, and

the circuitry is further configured to produce a thumbnail image from the selected image.

18. The representative image generation device of claim 1, wherein the circuitry is further configured to detect the object at a time the object enters the determined area.

19. A representative image generation system, comprising:

a surveillance camera; and

circuitry configured to;

identify a selected image of an object from a plurality of recorded images, wherein the plurality of recorded images includes at least a portion of the object captured by the surveillance camera, and the plurality of recorded images is captured as the object traverses a determined area; and

control display of the selected image on a display device, wherein the selected image provides a visual recognizability of the object greater than a determined threshold.

20. A non-transitory computer-readable medium having stored thereon, computer executable instructions, which when executed by circuitry, cause the circuitry to execute operations, the operations comprising:

identifying a selected image of an object from a plurality of recorded images, wherein the plurality of recorded images includes at least a portion of the object, and the plurality of recorded images are captured as the object traverses a determined area; and

controlling display of the selected image on a display device, wherein the selected image provides a visual recognizability of the object greater than a determined threshold.

21. A representative image generation device, comprising:

circuitry configured to;

identify a selected image from a plurality of recorded images, wherein the plurality of recorded images includes at least a portion of an object, and the plurality of recorded images is captured as the object traverses a determined area; and

control display of the selected image on a display device, wherein

the selected image provides a visual recognizability of the object greater than a determined threshold, and

the determined threshold corresponds to the visual recognizability of the object that is greater than a visual recognizability of the object when initially detected in the determined area.