Methods and apparatus for detecting and/or indicating a blocked sensor or camera module

• US 10,003,738 B2
• Filed: 10/18/2016
• Issued: 06/19/2018
• Est. Priority Date: 12/18/2015
• Status: Active Grant

• Current Assignee: Blue River Technology Inc. (Deere & Company)
• Original Assignee: Light Labs Inc.
• Inventors: Lautenbach, Bradley, Laroia, Rajiv
• Primary Examiner(s): LAM, HUNG H
• Application Number:
  US15/297,129
• Publication Number:
  US 20170180637A1
• Time in Patent Office: 609 Days
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image

Abstract

Methods and apparatus for detecting and/or indicating a blocked sensor and/or blocked camera module are described. The sensor maybe a distance sensor used to support focus operations. Depending on the embodiment, the camera system may include one or more sensors and one or more camera modules. As sensor output is received and/or images are captured by one or more camera modules, the sensor output, e.g., distance sensor output, and/or captured images, e.g., optical image sensor output, are checked to determine if one or more of the sensors and/or camera modules are obstructed. When an obstruction of a sensor or camera module is detected, to make a user aware of the obstruction condition a visual and/or physical indication of an obstructed sensor or camera module is provided to the user of the camera device. The indication may include haptic feedback in the form of vibrations and/or a visual obstruction indication.

Claims

1. A method of operating a camera, the method comprising:

detecting obstruction of a sensor or camera module;

indicating via visual feedback that a sensor or camera module is obstructed, said indicating including displaying on a display of the camera a first image showing a sensor or camera module with an indication that the sensor or camera module is obstructed; and

selecting, prior to displaying on the display of the camera the first imae, said first image from a plurality of stored images, different images in said plurality of stored images corresponding to obstruction of different sensors or camera modules.

2. The method of claim 1, wherein selecting said first image from the plurality of stored images includes selecting said first image based on which of a plurality of sensors or camera modules is determined to be obstructed.

3. The method of claim 2, wherein the selected first image shows an object obstructing at least the sensor or camera module which was determined to be obstructed.

4. The method of claim 1, wherein said sensor is a distance sensor.

5. The method of claim 1, further comprising:

waiting a predetermined period of time;

checking the camera module or sensor which was obstructed to determine if it is still obstructed; and

if the camera module or sensor is still obstructed, repeating said step of indicating via visual feedback that a sensor or camera module is obstructed.

6. The method of claim 1, wherein said first image is an image showing a finger blocking at least a portion of a sensor or camera module.

7. A method of operating a camera, the method comprising:

detecting obstruction of a sensor or camera module;

indicating via visual feedback that a sensor or camera module is obstructed, said indicating including displaying on a display of the camera a first image showing a sensor or camera module with an indication that the sensor or camera module is obstructed; and

wherein said first image is displayed as an inset (PIP) image on the display while a preview image is being displayed.

8. The method of claim 7, wherein the display is on the rear of the camera and the first image is displayed on a portion of the display corresponding to the front portion of the camera where the obstructed sensor or camera module is located.

9. The method of claim 7, wherein said sensor is a distance sensor.

10. The method of claim 7, further comprising:

waiting a predetermined period of time;

checking the camera module or sensor which was obstructed to determine if it is still obstructed; and

if the camera module or sensor is still obstructed, repeating said step of indicating via visual feedback that a sensor or camera module is obstructed.

11. The method of claim 7, wherein said first image is an image showing a finger blocking at least a portion of a sensor or camera module.

12. A camera comprising:

at least one sensor;

a plurality of camera modules;

a display; and

a processor configured to;

detect obstruction of a sensor or camera module;

indicate via visual feedback that a sensor or camera module is obstructed, wherein being configured to indicate includes being configured to display on the display of the camera a first image showing a sensor or camera module with an indication that the sensor or camera module is obstructed; and

select, prior to display on the display of the camera the first image, said first image from a plurality of stored images, different images in said plurality of stored images corresponding to obstruction of different sensors or camera modules.

13. The camera of claim 12, wherein said sensor is a distance sensor.

14. The camera of claim 12, wherein said processor is further configured to:

wait a predetermined period of time;

check the camera module or sensor which was obstructed to determine if it is still obstructed; and

if the camera module or sensor is still obstructed, repeat said indicating via visual feedback that a sensor or camera module is obstructed.

15. The camera of claim 12, wherein said first image is an image showing a finger blocking at least a portion of a sensor or camera module.

16. A non-transitory computer readable medium including computer executable instructions which when executed by a processor control a camera apparatus to perform the steps of:

detecting obstruction of a sensor or camera module;

indicating via visual feedback that a sensor or camera module is obstructed, said indicating including displaying on a display of the camera apparatus a first image showing a sensor or camera module with an indication that the sensor or camera module is obstructed; and

selecting, prior to displaying on the display of the camera apparatus the first image, said first image from a plurality of stored images, different images in said plurality of stored images corresponding to obstruction of different sensors or camera modules.

17. A camera comprising:

at least one sensor;

a plurality of camera modules;

a display; and

a processor configured to;

detect obstruction of a sensor or camera module; and

indicate via visual feedback that a sensor or camera module is obstructed, wherein being configured to indicate includes being configured to display on the display of the camera a first image showing a sensor or camera module with an indication that the sensor or camera module is obstructed; and

wherein said processor is configured to display said first image as an inset (PIP) image on the display while a preview image is being displayed.

18. The camera of claim 17, wherein said sensor is a distance sensor.