Method and apparatus for selective disqualification of digital images

• US 7,995,795 B2
• Filed: 08/03/2010
• Issued: 08/09/2011
• Est. Priority Date: 02/24/2006
• Status: Active Grant

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: Tessera Technologies Ireland Limited (Adeia Inc.)
• Inventors: Steinberg, Eran, Bigioi, Petronel, Corcoran, Peter
• Primary Examiner(s): Tran; Phuoc
• Assistant Examiner(s): LIEW, ALEX KOK SOON
• Application Number:
  US12/849,597
• Publication Number:
  US 20110033112A1
• Time in Patent Office: 371 Days
• Field of Search: 382/103, 382115-118, 382124-127, 396155-206
• US Class Current: 382/103
• CPC Class Codes: G06V 10/98 Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure

Abstract

An unsatisfactory scene is disqualified as an image acquisition control for a camera. An image is acquired. One or more eye regions are determined. The eye regions are analyzed to determine whether they are blinking, and if so, then the scene is disqualified as a candidate for a processed, permanent image while the eye is completing the blinking.

Claims

1. A method of selectively disqualifying a scene as a candidate for permanent capture, storage or processing, or combinations thereof, the method comprising:

acquiring a present image of a scene including a key feature;

detecting the key feature;

determining that an occluding object is currently occluding a significant portion of the key feature;

rejecting the present image as a candidate for post-acquisition digital image processing due to the occluding;

performing temporal analysis of movement of the occluding object relative to the key feature; and

automatically acquiring a new image to replace the present image after delaying for a period of time, wherein the delaying of said acquiring the new image corresponds to an estimated time for said occluding of said key feature to end based on said temporal analysis of movement.

2. The method of claim 1, wherein the present image comprises a relatively low resolution reference/preview image.

3. The method of claim 1, wherein the temporal analysis comprises determining a speed at which the occluding object is moving into or out of the scene.

4. The method of claim 1, wherein the temporal analysis comprises determining a speed of the occluding object for determining when the occluding will end.

5. The method of claim 1, wherein the temporal analysis comprises a speed and a direction of the movement of the occluding object.

6. The method of claim 1, further comprising determining an extent to which the key feature is showing.

7. The method of claim 6, further comprising determining whether the key feature is currently being covered or uncovered.

8. The method of claim 1, wherein the key feature comprises a face, eye or mouth region, or combinations thereof.

9. The method of claim 1, wherein the determining temporal analysis of movement comprises determining a direction of movement of the occluding object.

10. The method of claim 1, wherein the performing temporal analysis comprises determining a degree of blurriness of the occluding object due to object movement during exposure.

11. A method of selectively disqualifying a scene as a candidate for permanent capture, storage or processing, or combinations thereof, the method comprising:

acquiring a present image of a scene including a key feature;

detecting the key feature;

determining that a shadowing object is currently shadowing a significant portion of the key feature;

rejecting the present image as a candidate for post-acquisition digital image processing due to the shadowing;

performing temporal analysis of movement of the shadowing object relative to the key feature; and

automatically acquiring a new image to replace the present image after delaying for a period of time, wherein the delaying of said acquiring the new image corresponds to an estimated time for said shadowing of said key feature to end based on said temporal analysis of movement of the shadowing object.

12. The method of claim 11, wherein the present image comprises a relatively low resolution reference/preview image.

13. The method of claim 11, wherein the temporal analysis comprises determining a speed at which the shadowing object is moving into or out of the scene.

14. The method of claim 11, wherein the temporal analysis comprises determining a speed of the shadowing object for determining when the shadowing will end.

15. The method of claim 11, wherein the temporal analysis comprises determining a speed and a direction of the shadowing object.

16. The method of claim 11, further comprising determining an extent to which the key feature is shadowed.

17. The method of claim 11, wherein the key feature comprises a face, eye or mouth region, or combinations thereof.

18. The method of claim 11, wherein the performing temporal analysis comprises determining a degree of blurriness of the shadowing object due to object movement during exposure.

19. A method of selectively disqualifying a scene as a candidate for permanent capture, storage or processing, or combinations thereof, the method comprising:

acquiring a present image of a scene including a key feature;

detecting the key feature;

determining that a significant portion of the key feature is currently being shadowed;

rejecting the present image as a candidate for post-acquisition digital image processing due to the key feature being shadowed;

performing temporal analysis of shadow movement relative to the key feature; and

automatically acquiring a new image to replace the present image after delaying for a period of time, wherein the delaying of said acquiring the new image corresponds to an estimated time for an end of the key feature being shadowed based on said temporal analysis of movement.

20. The method of claim 19, wherein the present image comprises a relatively low resolution reference/preview image.

21. The method of claim 19, wherein the temporal analysis comprises determining a speed at which the shadow is moving into or out of the scene.

22. The method of claim 19, wherein the temporal analysis comprises determining a direction which the shadow is moving into or out of the scene.

23. The method of claim 19, wherein the temporal analysis comprises determining a speed of the shadow for determining the end of the key feature being shadowed.

24. The method of claim 19, further comprising determining an extent to which the key feature is being shadowed.

25. The method of claim 19, wherein the key feature comprises a face, eye or mouth region, or combinations thereof.

26. One or more non-transitory computer readable media having code embedded therein for programming a processor to perform a method of selectively disqualifying a scene as a candidate for permanent capture, storage or processing, or combinations thereof, the method comprising:

acquiring a present image of a scene including a key feature;

detecting the key feature;

determining that an occluding object is currently occluding a significant portion of the key feature;

rejecting the present image as a candidate for post-acquisition digital image processing due to the occluding;

performing temporal analysis of movement of the occluding object relative to the key feature; and

automatically acquiring a new image to replace the present image after delaying for a period of time, wherein the delaying of said acquiring the new image corresponds to an estimated time for said occluding of said key feature to end based on said temporal analysis of movement.

27. The one or more non-transitory computer readable media of claim 26, wherein the present image comprises a relatively low resolution reference/preview image.

28. The one or more non-transitory computer readable media of claim 26, wherein the temporal analysis comprises determining a speed at which the occluding object is moving into or out of the scene.

29. The one or more non-transitory computer readable media of claim 26, wherein the temporal analysis comprises determining a speed of the occluding object for determining when the occluding will end.

30. The one or more non-transitory computer readable media of claim 26, wherein the temporal analysis comprises a speed and a direction of the movement of the occluding object.

31. The one or more non-transitory computer readable media of claim 26, wherein the method further comprises determining an extent to which the key feature is showing.

32. The one or more non-transitory computer readable media of claim 31, wherein the method further comprises determining whether the key feature is currently being covered or uncovered.

33. The one or more non-transitory computer readable media of claim 26, wherein the key feature comprises a face, eye or mouth region, or combinations thereof.

34. The one or more non-transitory computer readable media of claim 26, wherein the determining temporal analysis of movement comprises determining a direction of movement of the occluding object.

35. The one or more non-transitory computer readable media of claim 26, wherein the performing temporal analysis comprises determining a degree of blurriness of the occluding object due to object movement during exposure.

36. The one or more non-transitory computer readable media having code embedded therein for programming a processor to perform a method of selectively disqualifying a scene as a candidate for permanent capture, storage or processing, or combinations thereof, the method comprising:

acquiring a present image of a scene including a key feature;

detecting the key feature;

determining that a shadowing object is currently shadowing a significant portion of the key feature;

rejecting the present image as a candidate for post-acquisition digital image processing due to the shadowing;

performing temporal analysis of movement of the shadowing object relative to the key feature; and

automatically acquiring a new image to replace the present image after delaying for a period of time, wherein the delaying of said acquiring the new image corresponds to an estimated time for said shadowing of said key feature to end based on said temporal analysis of movement of the shadowing object.

37. The one or more non-transitory computer readable media of claim 36, wherein the present image comprises a relatively low resolution reference/preview image.

38. The one or more non-transitory computer readable media of claim 36, wherein the temporal analysis comprises determining a speed at which the shadowing object is moving into or out of the scene.

39. The one or more non-transitory computer readable media of claim 36, wherein the temporal analysis comprises determining a speed of the shadowing object for determining when the shadowing will end.

40. The one or more non-transitory computer readable media of claim 36, wherein the temporal analysis comprises determining a speed and a direction of the shadowing object.

41. The one or more non-transitory computer readable media of claim 36, wherein the method further comprises determining an extent to which the key feature is shadowed.

42. The one or more non-transitory computer readable media of claim 36, wherein the key feature comprises a face, eye or mouth region, or combinations thereof.

43. The one or more non-transitory computer readable media of claim 36, wherein the performing temporal analysis comprises determining a degree of blurriness of the shadowing object due to object movement during exposure.

44. The one or more non-transitory computer readable media having code embedded therein for programming a processor to perform a method of selectively disqualifying a scene as a candidate for permanent capture, storage or processing, or combinations thereof, the method comprising:

acquiring a present image of a scene including a key feature;

detecting the key feature;

determining that a significant portion of the key feature is currently being shadowed;

rejecting the present image as a candidate for post-acquisition digital image processing due to the key feature being shadowed;

performing temporal analysis of shadow movement relative to the key feature; and

automatically acquiring a new image to replace the present image after delaying for a period of time, wherein the delaying of said acquiring the new image corresponds to an estimated time for an end of the key feature being shadowed based on said temporal analysis of movement.

45. The one or more non-transitory computer readable media of claim 44, wherein the present image comprises a relatively low resolution reference/preview image.

46. The one or more non-transitory computer readable media of claim 44, wherein the temporal analysis comprises determining a speed at which the shadow is moving into or out of the scene.

47. The one or more non-transitory computer readable media of claim 44, wherein the temporal analysis comprises determining a direction which the shadow is moving into or out of the scene.

48. The one or more non-transitory computer readable media of claim 44, wherein the temporal analysis comprises determining a speed of the shadow for determining the end of the key feature being shadowed.

49. The one or more non-transitory computer readable media of claim 44, wherein the method further comprises determining an extent to which the key feature is being shadowed.

50. The one or more non-transitory computer readable media of claim 44, wherein the key feature comprises a face, eye or mouth region, or combinations thereof.

51. A digital image acquisition device, comprising:

a lens and image sensor for acquiring digital images;

a processor; and

one or more computer readable media having code embedded therein for programming a processor to perform a method of selectively disqualifying a scene as a candidate for permanent capture, storage or processing, or combinations thereof, wherein the method comprises;

acquiring a present image of a scene including a key feature;

detecting the key feature;

determining that an occluding object is currently occluding a significant portion of the key feature;

rejecting the present image as a candidate for post-acquisition digital image processing due to the occluding;

performing temporal analysis of movement of the occluding object relative to the key feature; and

automatically acquiring a new image to replace the present image after delaying for a period of time, wherein the delaying of said acquiring the new image corresponds to an estimated time for said occluding of said key feature to end based on said temporal analysis of movement.

52. The digital image acquisition device of claim 51, wherein the present image comprises a relatively low resolution reference/preview image.

53. The digital image acquisition device of claim 51, wherein the temporal analysis comprises determining a speed at which the occluding object is moving into or out of the scene.

54. The digital image acquisition device of claim 51, wherein the temporal analysis comprises determining a speed of the occluding object for determining when the occluding will end.

55. The digital image acquisition device of claim 51, wherein the temporal analysis comprises a speed and a direction of the movement of the occluding object.

56. The digital image acquisition device of claim 51, wherein the method further comprises determining an extent to which the key feature is showing.

57. The digital image acquisition device of claim 56, wherein the method further comprises determining whether the key feature is currently being covered or uncovered.

58. The digital image acquisition device of claim 51, wherein the key feature comprises a face, eye or mouth region, or combinations thereof.

59. The digital image acquisition device of claim 51, wherein the determining temporal analysis of movement comprises determining a direction of movement of the occluding object.

60. The digital image acquisition device of claim 51, wherein the performing temporal analysis comprises determining a degree of blurriness of the occluding object due to object movement during exposure.

61. A digital image acquisition device, comprising:

a lens and image sensor for acquiring digital images;

a processor; and

one or more computer readable media having code embedded therein for programming a processor to perform a method of selectively disqualifying a scene as a candidate for permanent capture, storage or processing, or combinations thereof, the method comprising;

acquiring a present image of a scene including a key feature;

detecting the key feature;

determining that a shadowing object is currently shadowing a significant portion of the key feature;

rejecting the present image as a candidate for post-acquisition digital image processing due to the shadowing;

performing temporal analysis of movement of the shadowing object relative to the key feature; and

automatically acquiring a new image to replace the present image after delaying for a period of time, wherein the delaying of said acquiring the new image corresponds to an estimated time for said shadowing of said key feature to end based on said temporal analysis of movement of the shadowing object.

62. The digital image acquisition device of claim 61, wherein the present image comprises a relatively low resolution reference/preview image.

63. The digital image acquisition device of claim 61, wherein the temporal analysis comprises determining a speed at which the shadowing object is moving into or out of the scene.

64. The digital image acquisition device of claim 61, wherein the temporal analysis comprises determining a speed of the shadowing object for determining when the shadowing will end.

65. The digital image acquisition device of claim 61, wherein the temporal analysis comprises determining a speed and a direction of the shadowing object.

66. The digital image acquisition device of claim 61, wherein the method further comprises determining an extent to which the key feature is shadowed.

67. The digital image acquisition device of claim 61, wherein the key feature comprises a face, eye or mouth region, or combinations thereof.

68. The digital image acquisition device of claim 61, wherein the performing temporal analysis comprises determining a degree of blurriness of the shadowing object due to object movement during exposure.

69. A digital image acquisition device, comprising:

a lens and image sensor for acquiring digital images;

a processor; and

one or more computer readable media having code embedded therein for programming a processor to perform a method of selectively disqualifying a scene as a candidate for permanent capture, storage or processing, or combinations thereof, the method comprising;

acquiring a present image of a scene including a key feature;

detecting the key feature;

determining that a significant portion of the key feature is currently being shadowed;

rejecting the present image as a candidate for post-acquisition digital image processing due to the key feature being shadowed;

performing temporal analysis of shadow movement relative to the key feature; and

automatically acquiring a new image to replace the present image after delaying for a period of time, wherein the delaying of said acquiring the new image corresponds to an estimated time for an end of the key feature being shadowed based on said temporal analysis of movement.

70. The digital image acquisition device of claim 69, wherein the present image comprises a relatively low resolution reference/preview image.

71. The digital image acquisition device of claim 69, wherein the temporal analysis comprises determining a speed at which the shadow is moving into or out of the scene.

72. The digital image acquisition device of claim 69, wherein the temporal analysis comprises determining a direction which the shadow is moving into or out of the scene.

73. The digital image acquisition device of claim 69, wherein the temporal analysis comprises determining a speed of the shadow for determining the end of the key feature being shadowed.

74. The digital image acquisition device of claim 69, wherein the method further comprises determining an extent to which the key feature is being shadowed.

75. The digital image acquisition device of claim 69, wherein the key feature comprises a face, eye or mouth region, or combinations thereof.