Handheld article with movement discrimination

• US 8,212,882 B2
• Filed: 05/27/2010
• Issued: 07/03/2012
• Est. Priority Date: 03/25/2007
• Status: Active Grant

• Current Assignee: FotoNation Limited (Adeia, Inc.)
• Original Assignee: DigitalOptics Corporation Europe Limited (Adeia, Inc.)
• Inventors: Florea, Corneliu, Albu, Felix, Zamfir, Adrian, Drimbarean, Alexandru
• Primary Examiner(s): Chan, Jason
• Assistant Examiner(s): Prabhakher, Pritham
• Application Number:
  US12/789,300
• Publication Number:
  US 20100238309A1
• Time in Patent Office: 768 Days
• Field of Search: 34820899-20816
• US Class Current: 348/208.99
• CPC Class Codes: G03B 17/00 Details of cameras or camera bodies; Accessories therefor lens hoods or caps G03B11/04
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations

Abstract

A digital camera 10 has a pair of angular rate-sensing gyroscopic sensors 130 with mutually perpendicular axes and an electronic circuit 120 responsive to the sensor output signals to discriminate between voluntary and involuntary movements of the article as a function of the number of zero crossings per unit time of the signal and the average of the absolute amplitude of the signal.

Claims

1. A digital camera-enabled portable device, comprising:

a lens and image sensor for acquiring digital images;

a processor;

at least one angular rate-sensing gyroscopic sensor;

an electronic circuit responsive to a sensor output signal to discriminate between voluntary and involuntary movements of the article as a function at least of the number of zero crossings per unit time of the signal; and

a face tracking module configured to detect and track a face within the images and to select an operating condition based on a determination as to whether the article is undergoing voluntary movement, and

wherein the operating condition comprises turning face tracking off upon determining that the article is undergoing voluntary movement.

2. The digital camera enabled portable device of claim 1, wherein the function is proportional to the number of zero crossings of the signal.

3. The digital camera enabled portable device of claim 1, including first and second angular rate-sensing gyroscopic sensors with transverse axes, the electronic circuit being responsive to both sensor output signals to discriminate between voluntary and involuntary movements of the article.

4. The digital camera-enabled portable device of claim 3, wherein the axes of the first and second angular rate-sensing gyroscopic sensors are substantially perpendicular to one another.

5. The digital camera-enabled portable device of claim 1, wherein the electronic circuit is responsive to the sensor output signal to discriminate between voluntary and involuntary movements of the article as a function also of the average of the absolute amplitude of the signal.

6. A digital camera-enabled portable device, comprising:

a lens and image sensor for acquiring digital images;

a processor;

at least one angular rate-sensing gyroscopic sensor;

an electronic circuit responsive to a sensor output signal to discriminate between voluntary and involuntary movements of the article as a function at least of the number of zero crossings per unit time of the signal; and

a face tracking module configured to detect and track a face within the images and to select an operating condition based on a determination as to whether the article is undergoing voluntary movement,

first and second angular rate-sensing gyroscopic sensors with transverse axes, the electronic circuit being responsive to both sensor output signals to discriminate between voluntary and involuntary movements of the article,

wherein the function is proportional to the number of zero crossings of the signal and inversely proportional to the average of the absolute amplitude of the signal.

7. The digital camera-enabled portable device of claim 6, wherein the electronic circuit discriminates between involuntary and voluntary movements by determining whether the function falls below a first threshold indicating voluntary movement or above the first threshold indicating no voluntary movement.

8. The digital camera-enabled portable device of claim 7, wherein the electronic circuit further discriminates between involuntary movements and sensor noise by determining whether the function falls below a second predetermined threshold greater than the first threshold indicating involuntary movement or above the second threshold indicating no movement.

9. A digital camera-enabled portable device, comprising:

a lens and image sensor for acquiring digital images;

a processor;

at least one angular rate-sensing gyroscopic sensor;

an electronic circuit responsive to a sensor output signal to discriminate between voluntary and involuntary movements of the article as a function at least of the number of zero crossings per unit time of the signal; and

a face tracking module configured to detect and track a face within the images and to select an operating condition based on a determination as to whether the article is undergoing voluntary movement,

wherein the electronic circuit is responsive to the sensor output signal to discriminate between voluntary and involuntary movements of the article as a function also of the average of the absolute amplitude of the signal, and

wherein the function is proportional to the number of zero crossings of the signal and inversely proportional to the average of the absolute amplitude of the signal.

10. The digital camera-enabled portable device of claim 9, wherein the electronic circuit discriminates between involuntary and voluntary movements by determining whether the function falls below a first threshold indicating voluntary movement, or above the first threshold indicating no voluntary movement.

11. The digital camera-enabled portable device of claim 10, wherein the electronic circuit further discriminates between involuntary movements and sensor noise when the function is above the first threshold by determining whether the function falls below a second predetermined threshold greater than the first threshold indicating involuntary movement, or above the second threshold indicating no movement.

12. The digital camera-enabled portable device of claim 11, wherein the face tracking module is further configured to select an operating condition based on a further determination as to whether the article is undergoing no movement.

13. The digital camera-enabled portable device of claim 12, wherein when the device is determined to have no movement, the operating condition comprises using an existing location for a face candidate region.

14. The digital camera-enabled portable device of claim 13, wherein the operating condition comprises not attempting to predict a location for the face based on any camera movement.

15. The digital camera-enabled portable device of claim 9, wherein the operating condition comprises turning face tracking off upon determining that the article is undergoing voluntary movement.

16. One or more non-transitory computer-readable storage device having code embedded therein for programming a processor to perform a method of tracking a face within multiple images of an image stream acquired with a digital camera-enabled portable device equipped with at least one angular rate-sensing gyroscope, wherein the method comprises:

receiving an angular rate-sensing gyroscopic sensor output signal;

calculating a value of a function at least of the number of zero crossings per unit time of the signal;

discriminating between voluntary and involuntary movements of the digital camera-enabled portable device based on the value; and

detecting and tracking said face within the multiple images only when the device is not undergoing voluntary movement,

wherein the detecting and tracking of said face comprises turning face tracking off upon determining that the device is undergoing voluntary movement.

17. The one or more computer-readable storage devices of claim 16, wherein the function is proportional to the number of zero crossings of the signal.

18. The one or more computer-readable storage devices of claim 16, wherein the device is equipped with first and second angular rate-sensing gyroscopic sensors with transverse axes, and the discriminating between voluntary and involuntary movements of the device comprises analyzing both sensor output signals.

19. The one or more computer-readable storage devices of claim 18, wherein the axes of the first and second angular rate-sensing gyroscopic sensors are substantially perpendicular to one another.

20. The one or more computer-readable storage devices of claim 16, wherein the function is also a function of the average of the absolute amplitude of the signal.

21. One or more non-transitory computer-readable storage device having code embedded therein for programming a processor to perform a method of tracking a face within multiple images of an image stream acquired with a digital camera-enabled portable device equipped with at least one angular rate-sensing gyroscope, wherein the method comprises:

receiving an angular rate-sensing gyroscopic sensor output signal;

calculating a value of a function at least of the number of zero crossings per unit time of the signal;

discriminating between voluntary and involuntary movements of the digital camera-enabled portable device based on the value;

detecting and tracking said face within the multiple images only when the device is not undergoing voluntary movement,

wherein the device is equipped with first and second angular rate-sensing gyroscopic sensors with transverse axes, and the discriminating between voluntary and involuntary movements of the device comprises analyzing both sensor output signals,

wherein the function is proportional to the number of zero crossings of the signal and inversely proportional to the average of the absolute amplitude of the signal.

22. The one or more computer-readable storage devices of claim 21, wherein the discriminating between involuntary and voluntary movements comprises determining whether the function falls below a first threshold indicating voluntary movement or above the first threshold indicating no voluntary movement.

23. The one or more computer-readable storage devices of claim 22, wherein the method further comprises discriminating between involuntary movements and sensor noise, including determining whether the function falls below a second predetermined threshold greater than the first threshold indicating involuntary movement or above the second threshold indicating no movement.

24. The one or more computer-readable storage devices of claim 21, wherein the detecting and tracking of said face comprises turning face tracking off upon determining that the device is undergoing voluntary movement.

25. One or more non-transitory computer-readable storage device having code embedded therein for programming a processor to perform a method of tracking a face within multiple images of an image stream acquired with a digital camera-enabled portable device equipped with at least one angular rate-sensing gyroscope, wherein the method comprises:

receiving an angular rate-sensing gyroscopic sensor output signal;

calculating a value of a function at least of the number of zero crossings per unit time of the signal;

discriminating between voluntary and involuntary movements of the digital camera-enabled portable device based on the value; and

detecting and tracking said face within the multiple images only when the device is not undergoing voluntary movement

wherein the function is also a function of the average of the absolute amplitude of the signal,

wherein the function is proportional to the number of zero crossings of the signal and inversely proportional to the average of the absolute amplitude of the signal.

26. The one or more computer-readable storage devices of claim 25, wherein the discriminating between involuntary and voluntary movements comprises determining whether the function falls below a first threshold indicating voluntary movement, or above the first threshold indicating no voluntary movement.

27. The one or more computer-readable storage devices of claim 26, wherein the method further comprises discriminating between involuntary movements and sensor noise when the function is above the first threshold by determining whether the function falls below a second predetermined threshold greater than the first threshold indicating involuntary movement, or above the second threshold indicating no movement.

28. The one or more computer-readable storage devices of claim 27, wherein the detecting and tracking of said face further comprises selecting an operating condition based on a further determination as to whether the device is undergoing no movement.

29. The one or more computer-readable storage devices of claim 28, wherein when the device is determined to have no movement, the detecting and tracking of said face comprises using an existing location for a face candidate region.

30. The one or more computer readable storage devices of claim 29, wherein the detecting and tracking of said face does not include predicting its location based on any camera movement.

31. A method of tracking a face within multiple images of an image stream acquired with a digital camera-enabled portable device equipped with at least one angular rate-sensing gyroscope, wherein the method comprises:

receiving an angular rate-sensing gyroscopic sensor output signal;

calculating a value of a function at least of the number of zero crossings per unit time of the signal;

discriminating between voluntary and involuntary movements of the digital camera-enabled portable device based on the value; and

detecting and tracking said face within the multiple images only when the device is not undergoing voluntary movement, and

wherein the detecting and tracking of said face comprises turning face tracking off upon determining that the device is undergoing voluntary movement.

32. The method of claim 31, wherein the function is proportional to the number of zero crossings of the signal.

33. The method of claim 31, wherein the device is equipped with first and second angular rate-sensing gyroscopic sensors with transverse axes, and the discriminating between voluntary and involuntary movements of the device comprises analyzing both sensor output signals.

34. The method of claim 33, wherein the axes of the first and second angular rate-sensing gyroscopic sensors are substantially perpendicular to one another.

35. The method of claim 31, wherein the function is also a function of the average of the absolute amplitude of the signal.

36. A method of tracking a face within multiple images of an image stream acquired with a digital camera-enabled portable device equipped with at least one angular rate-sensing gyroscope, wherein the method comprises:

receiving an angular rate-sensing gyroscopic sensor output signal;

calculating a value of a function at least of the number of zero crossings per unit time of the signal;

discriminating between voluntary and involuntary movements of the digital camera-enabled portable device based on the value; and

detecting and tracking said face within the multiple images only when the device is not undergoing voluntary movement

wherein the device is equipped with first and second angular rate-sensing gyroscopic sensors with transverse axes, and the discriminating between voluntary and involuntary movements of the device comprises analyzing both sensor output signals,

wherein the function is proportional to the number of zero crossings of the signal and inversely proportional to the average of the absolute amplitude of the signal.

37. The method of claim 36, wherein the discriminating between involuntary and voluntary movements comprises determining whether the function falls below a first threshold indicating voluntary movement or above the first threshold indicating no voluntary movement.

38. The method of claim 37, further comprising discriminating between involuntary movements and sensor noise, including determining whether the function falls below a second predetermined threshold greater than the first threshold indicating involuntary movement or above the second threshold indicating no movement.

39. A method of tracking a face within multiple images of an image stream acquired with a digital camera-enabled portable device equipped with at least one angular rate-sensing gyroscope, wherein the method comprises:

receiving an angular rate-sensing gyroscopic sensor output signal;

calculating a value of a function at least of the number of zero crossings per unit time of the signal;

discriminating between voluntary and involuntary movements of the digital camera-enabled portable device based on the value; and

detecting and tracking said face within the multiple images only when the device is not undergoing voluntary movement,

wherein the function is also a function of the average of the absolute amplitude of the signal,

wherein the function is proportional to the number of zero crossings of the signal and inversely proportional to the average of the absolute amplitude of the signal.

40. The method of claim 39, wherein the discriminating between involuntary and voluntary movements comprises determining whether the function falls below a first threshold indicating voluntary movement, or above the first threshold indicating no voluntary movement.

41. The method of claim 40, further comprising discriminating between involuntary movements and sensor noise when the function is above the first threshold by determining whether the function falls below a second predetermined threshold greater than the first threshold indicating involuntary movement, or above the second threshold indicating no movement.

42. The method of claim 41, wherein the detecting and tracking of said face further comprises selecting an operating condition based on a further determination as to whether the device is undergoing no movement.

43. The method of claim 42, wherein when the device is determined to have no movement, the detecting and tracking of said face comprises using an existing location for a face candidate region.

44. The method of claim 43, wherein the detecting and tracking of said face does not include predicting its location based on any camera movement.

45. The method of claim 39, wherein the detecting and tracking of said face comprises turning face tracking off upon determining that the device is undergoing voluntary movement.