Determining proximity of a mobile device to a subject based on shadow analysis

• US 9,336,599 B2
• Filed: 03/17/2015
• Issued: 05/10/2016
• Est. Priority Date: 06/23/2010
• Status: Expired due to Fees

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Conwell, William Y.
• Primary Examiner(s): MARIAM, DANIEL G
• Application Number:
  US14/660,360
• Publication Number:
  US 20150262364A1
• Time in Patent Office: 420 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06T 1/005 Robust watermarking, e.g. average attack or collusion attack resistant
• CPC Class Codes: G06T 2201/0065 Extraction of an embedded watermark; Reliable detection
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement
• CPC Class Codes: G06T 7/507 from shading G06T7/586 takes precedence

Abstract

Portions of the disclosure relate generally to shadow analysis, e.g., on mobile platforms. One claim recites a mobile phone comprising: a camera for capturing images and video; memory for buffering captured images and video; means for identifying a shadow cast by the mobile phone on a subject being imaged by said camera by analyzing buffered captured images and video; and means for determining proximity to the subject based on an analysis of the shadow. Of course, other claims and combinations are provided too.

Claims

1. A cell phone comprising:

a camera for capturing images and video;

memory for buffering captured images and video;

means for identifying a shadow cast by the cell phone on a subject being imaged by said camera by analyzing buffered captured images and video; and

means for determining proximity from the cell phone to the subject based on the identified shadow.

2. The cell phone of claim 1 in which said means for determining evaluates a color level of the shadow.

3. The cell phone of claim 1 in which said means for determining evaluates boundary sharpness associated with the shadow.

4. The cell phone of claim 1 in which said means for determining evaluates a temporal sequence of image frames to determine color levels of the shadow over the image frames.

5. The cell phone of claim 4 in which a determination is made that the cell phone is moving closer to the subject as the shadow becomes darker over the temporal sequence of image frames.

6. The cell phone of claim 1 in which said means for determining evaluates a temporal sequence of image frames to determine boundary sharpness of the shadow over the temporal sequence of image frames.

7. The cell phone of claim 6 in which a determination is made that the cell phone is moving closer to the subject as the boundary sharpness of the shadow increases over the temporal sequence of image frames.

8. The cell phone of claim 1 further comprising means for adjusting focus of said camera based on an analysis of the shadow.

9. The cell phone of claim 8 further comprising a microphone for capturing audio;

a touchscreen display, and means for communicating.

10. The cell phone of claim 1 in which the subject comprises a printed or displayed object or graphic.

11. A cell phone comprising:

a camera for capturing imagery;

memory for buffering captured imagery;

means for identifying a shadow cast by the cell phone on a subject being imaged by said camera; and

means for redressing the shadow in connection with;

i) reading a digital watermark from imagery captured of the subject, or ii) calculating a fingerprint from the imagery captured of the subject, in which said means for redressing the shadow disregards image content associated with the shadow when reading the digital watermark or calculating a fingerprint.

12. The cell phone of claim 11 in which the subject comprises a printed or displayed object or graphic.

13. A cell phone comprising:

a camera for capturing imagery;

memory for buffering captured imagery;

means for identifying a shadow cast by the cell phone on a subject being imaged by said camera, in which said means for identifying a shadow locates candidate edges, in which candidate edges once identified in image data are matched against a series of reference templates; and

means for redressing the shadow in connection with;

i) reading a digital watermark from imagery captured of the subject, or ii) calculating a fingerprint from the imagery captured of the subject.

14. The cell phone of claim 13 in which the reference templates correspond to shadows produced by different edges of the camera, or a smart phone including the camera.

15. A cell phone comprising:

a camera for capturing imagery;

means for buffering captured imagery;

means for identifying a shadow cast by the cell phone on a subject being imaged by said camera; and

means for redressing the shadow in connection with;

i) reading a digital watermark from imagery captured of the subject, or ii) calculating a fingerprint from the imagery captured of the subject, in which said means for redressing the shadow ranks candidate pixel or image regions for submission to a watermark detector or to a fingerprint analyzer, and in which shadowed regions are ranked relatively lower than un-shadowed regions.