Motion triggered gated imaging

• US 10,306,148 B2
• Filed: 08/30/2016
• Issued: 05/28/2019
• Est. Priority Date: 08/30/2016
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Makela, Christian, Pirinen, Ossi
• Primary Examiner(s): Tissire, Abdelaaziz
• Application Number:
  US15/252,194
• Publication Number:
  US 20180063442A1
• Time in Patent Office: 1,001 Days
• CPC Class Codes: H04N 23/684 performed by controlling the image sensor readout, e.g. by controlling the integration time
• CPC Class Codes: H04N 23/6845 by combination of a plurality of images sequentially taken
• CPC Class Codes: H04N 23/687 by shifting the lens or sensor position
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
• CPC Class Codes: H04N 23/743 Bracketing, i.e. taking a series of images with varying exposure conditions
• CPC Class Codes: H04N 25/587 acquired sequentially, e.g. using the combination of odd and even image fields

Abstract

In one example, a digital image capture unit comprises a gated image sensor configured to operate multiple sensor exposure events per a single image frame readout. The digital image capture unit further comprises a motion monitor configured to monitor motion related to the digital image capture unit. The digital image capture unit further comprises a controller configured to instruct the gated image sensor to discard a sensor exposure event of the multiple sensor exposure events in response to a temporally corresponding monitored motion related to the digital image capture unit failing to meet a motion requirement.

Claims

1. A digital image capture unit, comprising:

a gated image sensor configured to operate multiple sensor exposure events that occur during a single image frame readout, the single image frame readout starting with a shutter opening and ending with the shutter closing;

a motion monitor configured to monitor motion related to the digital image capture unit; and

a controller configured to instruct the gated image sensor to discard a sensor exposure event of the multiple sensor exposure events in response to a temporally corresponding monitored motion related to the digital image capture unit failing to meet a motion requirement, wherein the sensor exposure event and the temporally corresponding monitored motion occurred at a same time.

2. The digital image capture unit as claimed in claim 1, wherein the motion related to the digital image capture unit comprises motion of an object in a scene to be captured during the image frame readout.

3. The digital image capture unit as claimed in claim 1, wherein the motion related to the digital image capture unit comprises motion of the digital image capture unit.

4. The digital image capture unit as claimed in claim 3, wherein the motion monitor comprises an image stabilizer configured to stabilize image frames by compensating for the monitored motion of the digital image capture unit.

5. The digital image capture unit as claimed in claim 4, wherein the image stabilizer comprises at least one motion sensor configured to detect the motion of the digital image capture unit.

6. The digital image capture unit as claimed in claim 5, wherein at least one motion sensor comprises a gyroscope.

7. The digital image capture unit as claimed in claim 5, further comprising a lens system, wherein the image stabilizer further comprises:

at least one actuator configured to shift one of the gated image sensor and the lens system in order to compensate for the detected motion of the digital image capture unit; and

at least one position feedback sensor configured to measure the movement of the shifted one of the gated image sensor and the lens system.

8. The digital image capture unit as claimed in claim 7, wherein at least one position feedback sensor comprises a Hall effect sensor.

9. The digital image capture unit as claimed in claim 7, wherein the motion requirement comprises the difference between the detected motion of the digital image capture unit and the measured movement of the shifted one of the gated image sensor and the lens system staying below a threshold.

10. The digital image capture unit as claimed in claim 9, wherein the threshold is increased over time during the image frame readout.

11. The digital image capture unit as claimed in claim 10, wherein the controller comprises an image stabilizer driver.

12. The digital image capture unit as claimed in claim 1, wherein the gated image sensor is further configured to operate in a global shutter mode.

13. A method, comprising:

operating, by a gated image sensor of a digital image capture unit, multiple sensor exposure events that occur during a single image frame readout, the single image frame readout starting with a shutter opening and ending with the shutter closing;

monitoring, by a motion monitor of the digital image capture unit, motion related to the digital image capture unit; and

instructing, by a controller of the digital image capture unit, the gated image sensor to discard a sensor exposure event of the multiple sensor exposure events in response to a temporally corresponding monitored motion related to the digital image capture unit failing to meet a motion requirement, wherein the sensor exposure event and the temporally corresponding monitored motion occurred at a same time.

14. The method as claimed in claim 13, wherein the motion related to the digital image capture unit comprises motion of an object in a scene to be captured during the image frame readout.

15. The method as claimed in claim 13, wherein the motion related to the digital image capture unit comprises motion of the digital image capture unit, and the method further comprises stabilizing image frames by compensating for the monitored motion of the digital image capture unit.

16. The method as claimed in claim 15, wherein the stabilizing of the image frames comprises detecting, by at least one motion sensor of the digital image capture unit, motion of the digital image capture unit.

17. The method as claimed in claim 16, wherein the stabilizing of the image frames further comprises:

shifting, by at least one actuator of the digital image capture unit, one of the gated image sensor and a lens system of the digital image capture unit in order to compensate for the detected motion of the digital image capture unit; and

measuring, by at least one position feedback sensor of the digital image capture unit, the movement of the shifted one of the gated image sensor and the lens system.

18. The method as claimed in claim 17, wherein the motion requirement comprises the difference between the detected motion of the digital image capture unit and the measured movement of the shifted one of the gated image sensor and the lens system staying below a threshold.

19. The method as claimed in claim 18, further comprising increasing the threshold over time during the image frame readout.

20. An electronic apparatus, comprising:

a digital image capture unit, comprising;

a gated image sensor configured to operate multiple sensor exposure events that occur during a single image frame readout, the single image frame readout starting with a shutter opening and ending with the shutter closing;

a motion monitor configured to monitor motion related to the digital image capture unit; and

a controller configured to instruct the gated image sensor to discard a sensor exposure event of the multiple sensor exposure events in response to a temporally corresponding monitored motion related to the digital image capture unit failing to meet a motion requirement, wherein the sensor exposure event and the temporally corresponding monitored motion occurred at a same time.