Systems, devices and methods for tracking objects on a display

• US 9,454,827 B2
• Filed: 02/20/2014
• Issued: 09/27/2016
• Est. Priority Date: 08/27/2013
• Status: Expired due to Fees

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Deng, Fan, Yan, Ming, Ma, Lei, Gao, Dashan, Zhong, Xin, Liu, Shizhong
• Primary Examiner(s): Werner, Brian P
• Application Number:
  US14/185,695
• Publication Number:
  US 20150063632A1
• Time in Patent Office: 950 Days
• Field of Search: 382/103, 382/254, 382/274
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20024 Filtering details
• CPC Class Codes: G06T 2207/20076 Probabilistic image processing
• CPC Class Codes: G06T 2207/20224 Image subtraction
• CPC Class Codes: G06T 5/90 Dynamic range modification of images or parts thereof
• CPC Class Codes: G06T 5/92 based on global image properties
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80

Abstract

Systems, devices and methods for improved tracking with an electronic device are disclosed. The disclosures employ advanced exposure compensation and/or stabilization techniques. The tracking features may therefore be used in an electronic device to improve tracking performance under dramatically changing lighting conditions and/or when exposed to destabilizing influences, such as jitter. Historical data related to the lighting conditions and/or to the movement of a region of interest containing the tracked object are advantageously employed to improve the tracking system under such conditions.

Claims

1. A method of tracking an object with an electronic device, the method comprising:

defining a reference value based on a first average light intensity of pixels in a first region of a first image frame comprising the object;

determining a second average light intensity of pixels in a second region of a second image frame comprising the object, the second average light intensity of pixels being different than the first average light intensity of pixels, and the second image frame captured after the first image frame;

calculating a difference between the reference value of the first region in the first image frame and the determined second average light intensity of the second region in the second image frame;

redefining the reference value to produce a redefined reference value, based on the average light intensity of pixels in the second region of the second image frame, in response to the calculated difference being less than an intensity limit;

applying a gain filter to the region of the second image frame to produce a filtered image frame;

tracking the object using the pixels in the filtered image frame; and

using the redefined reference value for tracking the object in a third image frame, wherein the third image frame is captured after the second image frame.

2. The method of claim 1, wherein the applying the gain filter comprises calculating a variation indicator of the region based on current and historical parameters of the region.

3. The method of claim 2, wherein the applying the gain filter further comprises determining a confidence level based on the variation indicator.

4. The method of claim 3, wherein the applying the gain filter further comprises determining a gain based on the confidence level and determining the gain filter based on the gain.

22. The method of claim 1, wherein the redefining of the reference value is in response to the difference being less than an intensity limit or in response to an accrued time satisfying a time threshold.

23. The method of claim 22, wherein the accrued time is an amount of time since defining or previously redefining the reference value.

24. The method of claim 1, wherein the tracking the object comprises adjusting the region of the second image frame based on the gain filter.

5. A system for tracking an object with an electronic device, the system comprising:

a processor configured to;

define a reference value based on a first average light intensity of pixels in a first region of a first image frame comprising the object;

determine a second average light intensity of pixels in a second region of a second image frame comprising the object, the second average light intensity of pixels being different than the first average light intensity of pixels, and the second image frame captured after the first image frame;

calculate a difference between the reference value of the first region in the first image frame and the determined second average light intensity of the second region in the second image frame;

redefine the reference value to produce a redefined reference value, based on the average light intensity of pixels in the second region of the second image frame, in response to the calculated difference being less than an intensity limit;

apply a gain filter to the region of the second image frame to produce a filtered image frame;

track the object using the pixels in the filtered image frame; and

use the redefined reference value for tracking the object in a third image frame, wherein the third image frame is captured after the second image frame.

6. The system of claim 5, wherein the processor is configured to apply the gain filter by calculating a variation indicator of the region based on current and historical parameters of the region.

7. The system of claim 6, wherein the current and historical parameters comprise, respectively, current and historical sizes of the region.

8. The system of claim 6, wherein the current and historical parameters comprise, respectively, current and historical locations of the region.

9. The system of claim 6, wherein the processor is configured to apply the gain filter by determining a confidence level based on the variation indicator.

10. The system of claim 9, wherein the processor is configured to apply the gain filter by determining a gain based on the confidence level and determining the gain filter based on the gain.

11. The system of claim 10, wherein the processor is further configured to track the object by adjusting the region of the second image frame based on the gain filter.

12. The system of claim 11, wherein the adjusting the region comprises adjusting the location of the region.

13. The system of claim 11, wherein the adjusting the region comprises adjusting the size of the region.

14. A system for tracking an object with an electronic device, the system comprising:

means for defining a reference value based on a first average light intensity of pixels in a first region of a first image frame comprising the object;

means for determining a second average light intensity of pixels in a second region of a second image frame comprising the object, the second average light intensity of pixels being different than the first average light intensity of pixels, and the second image frame captured after the first image frame;

means for calculating a difference between the reference value of the first region in the first image frame and the determined second average light intensity of the second region in the second image frame;

means for redefining the reference value to produce a redefined reference value, based on the average light intensity of pixels in the second region of the second image frame, in response to the calculated difference being less than an intensity limit; and

means for applying a gain filter to the region of the second image frame to produce a filtered image frame;

means for tracking the object using the pixels in the filtered image frame; and

means for using the redefined reference value for tracking the object in a third image frame, wherein the third image frame is captured after the second image frame.

15. The system of claim 14, wherein the means for applying a gain filter comprises:

means for calculating a variation indicator of the region based on current and historical parameters of the region; and

means for determining a confidence level based on the variation indicator.

16. The system of claim 15, wherein the means for applying a gain filter further comprises:

means for determining a gain based on the confidence level; and

means for determining the gain filter based on the gain.

17. The system of claim 16, further comprising means for tracking the object by adjusting the region of the second image frame based on the gain filter.

18. A non-transitory computer readable medium configured to store instructions that when executed cause a processor to:

define a reference value based on a first average light intensity of pixels in a first region of a first image frame comprising the object;

determine a second average light intensity of pixels in a second region of a second image frame comprising the object, the second average light intensity of pixels being different than the first average light intensity of pixels, and the second image frame captured after the first image frame;

calculate a difference between the reference value of the first region in the first image frame and the determined second average light intensity of the second region in the second image frame;

redefine the reference value to produce a redefined reference value based on the average light intensity of pixels in the second region of the second image frame, in response to determining the calculated difference being less than an intensity limit; and

apply a gain filter to the region of the second image frame to produce a filtered image frame;

track the object using the pixels in the filtered image frame; and

use the redefined reference value for tracking the object in a third image frame, wherein the third image frame is captured after the second image frame.

19. The computer readable medium of claim 18, wherein the applying the gain filter comprises:

calculating a variation indicator of the region based on current and historical parameters of the region; and

determining a confidence level based on the variation indicator.

20. The computer readable medium of claim 19, wherein the applying the gain filter further comprises:

determining a gain based on the confidence level; and

determining the gain filter based on the gain.

21. The computer readable medium of claim 20, wherein the instructions further cause the processor to track the object by adjusting the region of the second image frame based on the gain filter.