Tracking device and image-capturing apparatus

• US 8,385,597 B2
• Filed: 06/03/2011
• Issued: 02/26/2013
• Est. Priority Date: 10/03/2006
• Status: Expired due to Fees

• Current Assignee: Nikon Corporation
• Original Assignee: Nikon Corporation
• Inventors: Muramatsu, Keiko
• Primary Examiner(s): AZARIAN, SEYED H
• Application Number:
  US13/153,362
• Publication Number:
  US 20110234885A1
• Time in Patent Office: 634 Days
• Field of Search: 382/100, 382/103, 382/106, 382/107, 382/105, 382/168, 382/170, 382/181, 382189-199, 382/209, 382/219, 382/232, 382/254, 382/255, 382/274, 382/275, 382/276, 382/312, 382/321, 382/291, 348/135, 348/143, 348/144, 348/169, 348/353, 348/345, 348/154, 348/208.15
• US Class Current: 382/103
• CPC Class Codes: G03B 35/18 by simultaneous viewing
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/672 based on the phase difference signals
• CPC Class Codes: H04N 23/675 comprising setting of focusing regions

Abstract

A tracking device includes: an image sensor that obtains image information of an image present within an image plane formed via an optical system; a tracking unit that tracks a target within the image plane based upon the image information; a focus detection unit that detects a focus adjustment state of the optical system over at least one focus detection area set in the image plane; a focus adjustment unit that executes focus adjustment for the optical system based upon the focus adjustment state detected in the focus detection area corresponding to a position of the target; a decision-making unit that makes a decision as to whether or not the target is being tracked based upon results of tracking operation executed by the tracking unit; and a control unit that bans the focus adjustment based upon results of the decision made by the decision-making unit.

Claims

1. A tracking device, comprising:

an image sensor that obtains image information of an image present within an image plane formed via an optical system;

a tracking unit that tracks a target within the image plane based upon the image information;

a focus detection unit that detects a focus adjustment state of the optical system over at least one focus detection area set in the image plane;

a control unit that executes focus adjustment control for the optical system based upon the focus adjustment state detected in the focus detection area corresponding to a position of the target; and

a decision-making unit that makes a decision as to whether or not the target is being tracked based upon results of tracking operation executed by the tracking unit,

wherein the control unit bans the focus adjustment control based upon results of the decision made by the decision-making unit.

2. A tracking device according to claim 1, wherein:

a plurality of focus detection areas are set in the image plane; and

the tracking unit calculates a difference quantity indicating a difference between image information in the image plane and image information corresponding to the target and tracks the target based upon the difference quantity.

3. A tracking device according to claim 1, wherein:

a plurality of focus detection areas are set in the image plane; and

the tracking unit calculates a difference quantity indicating a difference between image information in the image plane and image information corresponding to the target and tracks the target by designating an area indicating the smallest difference quantity as an area where the target is located.

4. A tracking device according to claim 1, wherein:

the tracking unit compares image information in the image plane with image information corresponding to the target; and

the decision-making unit makes a decision as to whether or not the target is being tracked based upon comparison results.

5. A tracking device according to claim 1, wherein:

the tracking unit compares image information in the image plane with image information corresponding to the target; and

the decision-making unit makes a decision as to whether or not the target is being tracked based upon a match rate at which the image information in the image plane and the image information corresponding to the target match.

6. A tracking device according to claim 1, wherein:

the control unit bans the focus adjustment control if the decision-making unit determines that the target is not being tracked.

7. A tracking device according to claim 1, wherein:

the decision-making unit makes a decision as to whether or not to ban the focus adjustment control based upon comparison results obtained by comparing image information in the image plane with image information corresponding to the target and the focus adjustment state detected in the focus detection area corresponding to a position of the target.

8. A tracking device according to claim 1, wherein:

if the target is judged to have been tracked after banning the focus adjustment control, the control unit rescinds a ban of the focus adjustment control.

9. A tracking device according to claim 1, wherein:

if the target is judged to have been tracked after banning the focus adjustment control, the control unit executes focus adjustment control for the optical system based upon the focus adjustment state detected in the focus detection area corresponding to a position of the target after banning the focus adjustment control.

10. A tracking device according to claim 1, wherein:

if the target cannot be tracked continuously over a predetermined length of time after banning the focus adjustment control, the control unit rescinds a ban of the focus adjustment control.

11. A tracking device according to claim 1, wherein:

if a ban of the focus adjustment control is rescinded after banning the focus adjustment control, the control unit executes focus adjustment control for the optical system based upon the focus adjustment state detected in the focus detection area corresponding to a position of the target before the ban of the focus adjustment control was started.

12. A tracking device according to claim 1, wherein:

the tracking unit tracks the target inside a search area set within the image plane; and

the search area can be altered based upon results of the decision made by the decision-making unit.

13. A tracking device according to claim 1, wherein:

the tracking unit tracks the target in a search area set within the image plane; and

if a position of the target is outside the search area, the tracking unit tracks the target by expanding the search area.

14. A tracking device according to claim 1, wherein:

the tracking unit tracks the target inside a search area set within the image plane; and

if a position of the target is outside the search area, a direction along which the subject is likely to move within the image plane is estimated and the search area is changed by the estimated moving direction.

15. A tracking device according to claim 1, wherein:

the image information indicates color or brightness of the target.

16. An image-capturing apparatus comprising:

a tracking device according to claim 1.

17. An image-capturing apparatus according to claim 16, wherein:

the image sensor includes a first image sensor used to obtain image information and record the image within the image plane and a second image sensor that obtains image information used by the tracking unit when tracking the target.

18. A tracking method, comprising:

obtaining image information of an image within an image plane formed via an optical system;

tracking a target within the image plane based upon the image information;

detecting a focus adjustment state of the optical system in correspondence to at least one focus adjustment area set within the image plane;

executing focus adjustment control for the optical system by using the focus adjustment state detected in the focus detection area corresponding to a position of the target;

making a decision as to whether or not results of tracking operation for the target have met a predetermined condition; and

controlling the focus adjustment control based upon results of the decision.

19. A tracking method according to claim 18, further comprising:

comparing image information in the image plane with image information corresponding to the target,

wherein the decision as to whether or not the results of tracking operation for the target have met the predetermined condition is made based upon comparison results.

20. A tracking method according to claim 18, further comprising:

comparing image information in the image plane and image information corresponding to the target,

wherein the decision as to whether or not the results of tracking operation for the target have met the predetermined condition is made based upon a match rate at which the image information in the image plane and the image information corresponding to the target match.

21. A tracking method according to claim 18, further comprising:

making a decision as to whether or not to control the focus adjustment control based upon comparison results obtained by comparing image information in the image plane and image information corresponding to the target and the focus adjustment state detected in the focus detection area corresponding to a position of the target.

22. A tracking device, comprising:

an image sensor that obtains image information of an image present within an image plane formed via an optical system;

a tracking unit that tracks a target within the image plane based upon the image information;

a focus detection unit that detects a focus adjustment state of the optical system over at least one focus detection area set in the image plane;

a control unit that executes focus adjustment control for the optical system by using the focus adjustment state detected in the focus detection area corresponding to a position of the target; and

a decision-making unit that makes a decision as to whether or not results of tracking operation executed by the tracking unit have met a predetermined condition,

wherein the control unit controls the focus adjustment control based upon results of the decision made by the decision-making unit.

23. A tracking device according to claim 22, wherein:

the decision-making unit makes a decision as to whether or not to control the focus adjustment control based upon comparison results obtained by comparing image information in the image plane with image information corresponding to the target and the focus adjustment state detected in the focus detection area corresponding to a position of the target.

24. A tracking device according to claim 22, wherein:

if the target is judged to have been tracked after controlling the focus adjustment control, the control unit rescinds controlling of the focus adjustment control.

25. A tracking device according to claim 22, wherein:

the decision-making unit includes a first decision-making unit that makes a decision as to whether or not the target within the image plane has been tracked based upon the image information by the tracking unit, and a second decision-making unit that makes a decision as to whether or not the target has been tracked based upon the focus adjustment state detected in the focus detection area corresponding to a position of results of tracking operation executed by the tracking unit after the decision by the first decision-making unit; and

the control unit executes the focus adjustment control if the second decision-making unit determines that the target has been tracked and controls the focus adjustment control if the second decision-making unit determines that the target has not been tracked.

26. A tracking device according to claim 22, wherein:

the decision-making unit includes a first decision-making unit that detects a difference between a previous focus adjustment state and a current focus adjustment state in the focus detection area corresponding to the position of the target based upon the focus adjustment state detected by the focus detection unit, and a second decision-making unit that makes a decision as to whether or not the target has been tracked based upon the results of tracking operation by the tracking unit; and

the control unit controls the focus adjustment control if the second decision-making unit determines that the target has not been tracked and the first decision-making unit determines that the difference between the previous focus adjustment state and the current focus adjustment state is bigger than a first predetermined value.

27. A tracking device according to claim 26, wherein:

the control unit executes the focus adjustment control if the second decision-making unit determines that the target has not been tracked and the first decision-making unit determines that the difference between the previous focus adjustment state and the current focus adjustment state is smaller than a second predetermined value which is smaller than the first predetermined value.

28. A tracking device according to claim 22, wherein:

the decision-making unit includes a first decision-making unit that makes a decision as to whether or not the target has been tracked by using the image information, and a second decision-making unit that makes a decision as to whether or not a difference between a previous focus adjustment state and a current focus adjustment state is bigger than a predetermined value by using an output from the focus detection unit.

29. A tracking device according to claim 28, wherein:

the control unit does not control the focus adjustment control if the first decision-making unit does not determine that the target has been tracked and the second decision-making unit determines that the difference is smaller than the predetermined value.

30. A tracking device according to claim 28, wherein:

the control unit does not control the focus adjustment control if the first decision-making unit determines that the target has been tracked and the second decision-making unit determines that the difference is smaller than the predetermined value.

31. A tracking device according to claim 28, wherein:

the control unit executes the focus adjustment control by using a focus detection area used in a previous focus adjustment control processing if the first decision-making unit does not determine that the target has been tracked.

32. A tracking device according to claim 28, wherein:

if the first decision-making unit does not determine that the target has been tracked, the control unit bans the focus adjustment control for a predetermined length of time and executes the focus adjustment control by using a focus detection area used in a previous focus adjustment control processing after the predetermined length of time.