Camera and light source synchronization for object tracking

• US 10,142,553 B2
• Filed: 09/16/2013
• Issued: 11/27/2018
• Est. Priority Date: 09/16/2013
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Horesh, Nizan
• Primary Examiner(s): Rahman, Mohammad J
• Application Number:
  US14/129,649
• Publication Number:
  US 20160219208A1
• Time in Patent Office: 1,898 Days
• Field of Search: None
• CPC Class Codes: G03B 15/05 Combinations of cameras with electronic flash apparatus; Electronic flash units
• CPC Class Codes: G03B 17/38 Releasing-devices separate from shutter integral with shutter G03B9/08
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/689 Motion occurring during a rolling shutter mode
• CPC Class Codes: H04N 23/73 by influencing the exposure time
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means

Abstract

Technologies for camera and light source synchronization include an imaging device to detect a current location of an object in a captured image generated by the imaging device. The imaging device predicts a next location of the object in a next captured image, generated by the imaging device, based on the current location of the object. The imaging device determines an illumination interval defining a period of time during which a camera of the imaging device is to expose a set of sensor lines during the capturing of the next captured image and activates a light source of the imaging device to illuminate the object during the determined illumination interval. The set of sensor lines corresponds with the predicted next location of the object.

Claims

1. An imaging device for camera and light source synchronization, the imaging device comprising:

an image processing module to detect a current location of an object in a captured image generated by the imaging device;

a location prediction module to predict a next location of the object in a next captured image, generated by the imaging device, based on (i) the current location of the object and (ii) historical data that identifies previously detected locations of the object in corresponding previously captured images generated by the imaging device; and

an illumination module to (i) determine an illumination interval defining a period of time during which a light source of the imaging device is to illuminate a set of sensor lines of the imaging device during the capture of the next captured image based on the predicted next location of the object, wherein the set of sensor lines corresponds with the predicted next location of the object and (ii) activate the light source of the imaging device to illuminate only the set of sensor lines of the imaging device that was determined to correspond to the predicted next location of the object throughout the determined illumination interval, wherein to active the light source comprises to sequentially expose each sensor line of the set of sensor lines of the imaging device to capture the next captured image.

2. The imaging device of claim 1, wherein to detect the current location of the object comprises to detect a current location of a subject'"'"'s eyes in the captured image.

3. The imaging device of claim 1, wherein to detect the current location of the object comprises to reduce a search area of the captured image based on a previously predicted location of the object.

4. The imaging device of claim 1, wherein the location prediction module is to receive sensor data indicative of motion of the computing device or the object,

wherein to predict the next location of the object comprises to predict a next location of the object in the next captured image based on the current location and the sensor data.

5. The imaging device of claim 1, wherein to predict the next location of the object comprises to predict a next location of the object in the next captured image based on the current location and a previously detected location of the object in a previously captured image.

6. The imaging device of claim 1, wherein the illumination module is to deactivate the light source during a period of time outside the determined illumination interval in which the camera is to expose the set of sensor lines of the next captured image.

7. The imaging device of claim 1, further comprising an image capturing module to capture the next captured image with the camera of the imaging device,

wherein the camera is to capture the next captured image based on an electronic rolling shutter mode.

8. The imaging device of claim 1, wherein the imaging device is one of a tablet computer, a laptop computer, or a cellular phone.

9. The imaging device of claim 1, further comprising an image capturing module to sequentially reset each sensor line in the next captured image,

wherein the illumination module is to activate the light source in response to a determination that (i) the next sensor line to be reset corresponds with the predicted next location of the object and (ii) the light source is not already activated.

10. The imaging device of claim 9, wherein the image capturing module is to sequentially read each sensor line in the next captured image a predetermined exposure time after each sensor line is sequentially reset;

and

wherein the illumination module is to deactivate the light source in response to a determination that neither the next sensor line to be read nor the last sensor line read corresponds with the predicted next location of the object.

11. The imaging device of claim 1, wherein the image processing module is to analyze the next captured image to identify illuminated sensor lines indicative of the sensor lines illuminated during the capture of the next captured image;

and

wherein the illumination module is to adjust the illumination interval based on the analysis of the image processing module.

12. One or more non-transitory, machine-readable storage media comprising a plurality of instructions stored thereon that, in response to execution by an imaging device, cause the imaging device to:

detect a current location of an object in a captured image generated by the imaging device;

predict a next location of the object in a next captured image, generated by the imaging device, based on (i) the current location of the object and (ii) historical data that identifies previously detected locations of the object in corresponding previously captured images generated by the imaging device;

determine an illumination interval defining a period of time during which a light source of the imaging device is to illuminate a set of sensor lines of the imaging device during the capturing of the next captured image based on the predicted next location of the object, the set of sensor lines corresponding with the predicted next location of the object; and

activate the light source of the imaging device to illuminate only the set of sensor lines of the imaging device that was determined to correspond to the predicted next location of the object during the determined illumination interval, wherein to active the light source comprises to sequentially expose each sensor line of the set of sensor lines of the imaging device to capture the next captured image.

13. The one or more non-transitory, machine-readable storage media of claim 12, wherein to detect the current location of the object comprises to detect a current location of the subject'"'"'s eyes in the captured image.

14. The one or more non-transitory, machine-readable storage media of claim 13, wherein to detect the current location of the subject'"'"'s eyes comprises to detect a current location of the subject'"'"'s face in the captured image.

15. The one or more non-transitory, machine-readable storage media of claim 12, wherein to detect the current location of the object comprises to reduce a search area of the captured image based on a previously predicted location of the object.

16. The one or more non-transitory, machine-readable storage media of claim 12, wherein the plurality of instructions further cause the imaging device to receive sensor data that indicates any motion of the imaging device or the object,

wherein to predict the next location of the object comprises to predict a next location of the object in the next captured image based on the current location and the sensor data.

17. The one or more non-transitory, machine-readable storage media of claim 12, wherein to predict the next location of the object comprises to predict a next location of the object in the next captured image based on the current location and a previously detected location of the object in a previously captured image.

18. The one or more non-transitory, machine-readable storage media of claim 12, wherein the plurality of instructions further cause the imaging device to deactivate the light source during a period of time outside the determined illumination interval in which the camera is to expose the set of sensor lines of the next captured image.

19. The one or more non-transitory, machine-readable storage media of claim 12, wherein the plurality of instructions further cause the imaging device to:

reset, sequentially, each sensor line in the next captured image; and

activate the light source in response to a determination that (i) the next sensor line to be reset corresponds with the predicted next location of the object and (ii) the light source is not already activated.

20. The one or more non-transitory, machine-readable storage media of claim 19, wherein the plurality of instructions further cause the imaging device to:

read, sequentially, each sensor line in the next captured image a predetermined exposure time after each sensor line is sequentially reset; and

deactivate the light source in response to a determination that neither the next sensor line to be read nor the last sensor line read corresponds with the predicted next location of the object.

21. The one or more non-transitory, machine-readable storage media of claim 12, wherein the plurality of instructions further cause the imaging device to:

analyze the next captured image to identify illuminated sensor lines indicative of the sensor lines illuminated during the capture of the next captured image; and

adjust the illumination interval based on the analysis of the next captured image.

22. A method for camera and light source synchronization on an imaging device, the method comprising:

detecting, by the imaging device, a current location of an object in a captured image generated by the imaging device;

predicting, by the imaging device, a next location of the object in a next captured image, generated by the imaging device, based on (i) the current location of the object and (ii) historical data that identifies previously detected locations of the object in corresponding previously captured images generated by the imaging device;

determining, by the imaging device, an illumination interval defining a period of time during which a light source of the imaging device is to illuminate a set of sensor lines of the imaging device during the capturing of the next captured image based on the predicted next location of the object, the set of sensor lines corresponding with the predicted next location of the object; and

activating, by the imaging device, a light source of the imaging device to illuminate only the set of sensor lines of the imaging device that was determined to correspond to the predicted next location of the object during the determined illumination interval, wherein activating the light source comprises sequentially exposing each sensor line of the set of sensor lines of the imaging device to capture the next captured image.

23. The method of claim 22, further comprising:

resetting, sequentially by the imaging device, each sensor line in the next captured image; and

activating, by the imaging device, the light source in response to determining that (i) the next sensor line to be reset corresponds with the predicted next location of the object and (ii) the light source is not already activated.

24. The method of claim 23, further comprising:

reading, sequentially by the imaging device, each sensor line in the next captured image a predetermined exposure time after each sensor line is sequentially reset; and

deactivating, by the imaging device, the light source in response to determining that neither the next sensor line to be read nor the last sensor line read corresponds with the predicted next location of the object.

25. The method of claim 22, further comprising:

analyzing, by the imaging device, the next captured image to identify illuminated sensor lines indicative of the sensor lines illuminated during the capture of the next captured image; and

adjusting, by the imaging device, the illumination interval based on the analysis of the next captured image.