IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND NON-TRANSITORY COMPUTER-READABLE STORAGE MEDIUM

• US 20200134841A1
• Filed: 10/29/2019
• Published: 04/30/2020
• Est. Priority Date: 10/31/2018
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Toyoda, Takuya
• Granted Patent: US 11,645,763 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/248 involving reference images or patches
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition

Abstract

An image processing apparatus detects a tracking target object in a moving image, executes tracking processing to track the tracking target object, determines an attribute of an object included in the moving image, specifies, when a first state in which the tracking target object is detected changes to a second state in which the tracking target object is not detected, an object, which is included in the moving image and is partially positioned in front of the tracking target object in the second state, based on a position of the tracking target object in the first state, and controls, based on the attribute of the specified object, the tracking processing performed on the tracking target object.

Claims

1. An image processing apparatus comprising:

a tracking unit configured to detect a tracking target object in a moving image and execute tracking processing to track the tracking target object;

an attribute determination unit configured to determine an attribute of an object included in the moving image;

a specification unit configured to specify, when a first state in which the tracking target object is detected changes to a second state in which the tracking target object is not detected, an object, which is included in the moving image and is partially positioned in front of the tracking target object in the second state, based on a position of the tracking target object in the first state; and

a tracking control unit configured to control, based on the attribute of the object specified by the specification unit, the tracking processing performed on the tracking target object by the tracking unit.

2. The apparatus according to claim 1, wherein the tracking control unit determines based on the attribute of the object specified by the specification unit whether to end the tracking processing on the tracking target object, and controls the tracking unit to end the tracking processing if a determination to end the tracking processing is made.

3. The apparatus according to claim 1, wherein the specification unit specifies an object adjacent to the tracking target object in the first state as the object positioned in front of the tracking target object.

4. The apparatus according to claim 1, wherein the specification unit specifies an object overlapping the tracking target object in the moving image in the first state as the object positioned in front of the tracking target object.

5. The apparatus according to claim 1, wherein the tracking control unit determines based on the attribute of the object specified by the specification unit whether to continue performing the tracking processing on the tracking target object for a predetermined time, and controls the tracking unit to continue performing the tracking processing on the tracking target object until at least the predetermined time has elapsed if a determination to continue the tracking processing on the tracking target object for the predetermined time is made.

6. The apparatus according to claim 1, wherein the tracking control unit controls the tracking processing, performed on the tracking target object by the tracking unit, based on the size of the object and the attribute of the object specified by the specifying unit.

7. The apparatus according to claim 1, wherein the tracking control unit controls the tracking processing, performed on the tracking target object by the tracking unit, further based on the position of the tracking target object in the first state.

8. The apparatus according to claim 1, wherein the tracking control unit determines based on the attribute of the object specified by the specification unit whether to continue performing the tracking processing on the tracking target object for a predetermined time, and controls the tracking unit to continue performing the tracking processing on the tracking target object until at least the predetermined time has elapsed if a determination to continue the tracking processing on the tracking target object for the predetermined time is made, and

the predetermined time is determined in accordance with the object specified by the specification unit.

9. An image processing method comprising:

detecting a tracking target object in a moving image and executing tracking processing to track the tracking target object;

determining an attribute of an object included in the moving image;

specifying, when a first state in which the tracking target object is detected changes to a second state in which the tracking target object is not detected, an object, which is included in the moving image and is partially positioned in front of the tracking target object in the second state, based on a position of the tracking target object in the first state; and

controlling, based on the attribute of the specified object, the tracking processing performed on the tracking target object.

10. A non-transitory computer-readable storage medium storing a program for causing a computer to function as

a tracking unit configured to detect a tracking target object in a moving image and execute tracking processing to track the tracking target object;

an attribute determination unit configured to determine an attribute of an object included in the moving image;

a specification unit configured to specify, when a first state in which the tracking target object is detected changes to a second state in which the tracking target object is not detected, an object, which is included in the moving image and is partially positioned in front of the tracking target object in the second state, based on a position of the tracking target object in the first state; and

a tracking control unit configured to control, based on the attribute of the object specified by the specification unit, the tracking processing performed on the tracking target object by the tracking unit.