Method and system for configuring an imaging device for the reception of digital pulse recognition information

• US 10,237,489 B2
• Filed: 08/21/2017
• Issued: 03/19/2019
• Est. Priority Date: 07/26/2011
• Status: Active Grant

• Current Assignee: ABL IP Holding LLC (Acuity Brands, Inc.)
• Original Assignee: ABL IP Holding LLC (Acuity Brands, Inc.)
• Inventors: Ryan, Daniel, Staats, Peter, Sumner, Rob
• Primary Examiner(s): Wong, Allen C
• Application Number:
  US15/681,618
• Publication Number:
  US 20170347006A1
• Time in Patent Office: 575 Days
• Field of Search: 348 61
• CPC Class Codes: G01C 21/206 specially adapted for indoor navigation
• CPC Class Codes: G01S 17/46 Indirect determination of position data
• CPC Class Codes: G01S 7/484 Transmitters
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: H04B 10/1149 Arrangements for indoor wireless networking of information
• CPC Class Codes: H04B 10/116 Visible light communication
• CPC Class Codes: H04N 1/387 Composing, repositioning or otherwise geometrically modifying originals
• CPC Class Codes: H04N 21/426 Internal components of the client ; Characteristics thereof H04N5/44 takes precedence
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 23/73 by influencing the exposure time
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation
• CPC Class Codes: H04N 25/531 by controlling rolling shutters in CMOS SSIS
• CPC Class Codes: H04N 25/60 Noise processing, e.g. detecting, correcting, reducing or removing noise
• CPC Class Codes: H04N 5/144 Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20
• CPC Class Codes: H04N 5/455 Demodulation-circuits

Abstract

In one aspect, the present disclosure relates to a method for configuring one or more imaging sensors of an imaging device to capture digital images for digital pulse recognition demodulation. In some embodiments, the method includes initializing one or more imaging sensors of the imaging device, determining a subset of the one or more imaging sensors to configure, setting a configuration for each of the one or more imaging sensors of the subset by defining a region of interest as a metering area for each of the one or more imaging sensors of the subset and automatically adjusting a setting for each of the one or more imaging sensors of the subset, and adjusting input parameters of a demodulation function based on a device profile of the imaging device. In some embodiments, the adjusted setting is locked to prevent further adjustment of the adjusted setting.

Claims

1. A device, comprising:

a plurality of sensors including an image sensor and at least one non-image sensor, wherein the at least one non-image sensor comprises a receiver configured to detect one or more radio frequency signals;

a processor coupled to the plurality of sensors;

a memory; and

software in the memory to be run by the processor, wherein running of the software by the processor configures the device to implement functions, including functions to;

operate the image sensor to capture one or more images including a signal modulated within visible light transmitted from a visible light source located within a space, the signal corresponding to an identity of the visible light source;

process the one or more images to determine, based at least in part on the signal, the identity of the visible light source;

acquire, via the at least one non-image sensor, a plurality of measurements characteristic of conditions at a location within the space proximate the visible light source, the function to acquire including;

for each of the detected one or more radio frequency signals detected by the receiver;

measuring characteristics of the respective radio frequency signal; and

calculating a signal strength of the respective radio frequency signal; and

in response to determining the identity of the visible light source based on the processed one or more images captured by the image sensor, calibrate a predetermined location of the identified visible light source based on the plurality of measurements acquired via the at least one non-image sensor, the function to calibrate including;

transmitting to a server, via a network, for recording;

the respective measured characteristics and the respective calculated signal strength,

the determined identity of the visible light source, and

the plurality of measurements characteristic of conditions at the location within the space proximate the identified visible light source.

2. The device of claim 1, wherein the at least one non-image sensor further comprises a second non-image sensor, the second non-image sensor including at least one of:

an accelerometer;

a compass;

a gyroscope;

a microphone;

or

an infrared detector.

3. The device of claim 2, wherein the function to calibrate the predetermined location of the identified visible light source and the plurality of measurements further includes a function to:

transmit the plurality of measurements acquired via the second non-image sensor to the server via the network for recording.

4. The device of claim 1 configured as a mobile device, wherein the receiver includes one or more of:

a Bluetooth receiver;

a Wi-Fi receiver;

or

a cellular receiver.

5. A mobile device comprising the device of claim 1, wherein:

the mobile device includes a mobile application that includes a map of the space, with positions of a plurality of light sources within the space, including the identified visible light source, overlaid on the map; and

the mobile application is configured to iteratively perform the implemented functions for the plurality of light sources within the space.

6. The device of claim 1, wherein the plurality of measurements characteristic of conditions at a location within the space proximate the visible light source includes one or more of overall brightness, signal detections, and orientation of the device.

7. A mobile device comprising:

a wireless interface configured to communicate through a network over a wireless medium;

a plurality of sensors including an image sensor and at least one non-image sensor;

a processor coupled to the plurality of sensors;

a memory; and

software in the memory to be run by the processor, wherein running of the software by the processor configures the device to implement functions, including functions to;

operate the image sensor to capture one or more images including a signal modulated within visible light transmitted from a visible light source located within a space, the signal corresponding to an identity of the visible light source;

process the one or more images to determine, based at least in part on the signal, the identity of the visible light source;

acquire, via the at least one non-image sensor, a plurality of measurements characteristic of conditions at a location within the space proximate the visible light source; and

in response to determining the identity of the visible light source based on the processed one or more images captured by the image sensor, calibrate a predetermined location of the identified visible light source based on the plurality of measurements acquired via the at least one non-image sensor; and

a mobile application in the memory that includes a map of the space, with positions of a plurality of light sources within the space, including the identified visible light source, overlaid on the map and configured to iteratively perform additional functions for the plurality of light sources including;

in response to determining the identity of the visible light source based on the processed one or images captured by the image sensor, receive a user input selecting which of the plurality of light sources the mobile device is under; and

in response to receiving the user selection of the light source the mobile device is under, transmit the determined identity of the visible light source, the user selection of the light source the mobile device is under, and the plurality of measurements to a server via the network for recording.

8. A method, comprising steps to:

capture, via an image sensor of a device, one or more images including a signal modulated within visible light transmitted from a visible light source located within a space, the signal corresponding to an identity of the visible light source, wherein the at least one non-image sensor comprises a receiver;

process the one or more images to determine, based at least in part on the signal, the identity of the visible light source;

acquire, via at least one non-image sensor of the device, a plurality of measurements characteristic of conditions at a location within the space proximate the visible light source, the step of acquiring including;

detecting, via the receiver, one or more radio frequency signals within the space; and

for each of the detected one or more radio frequency signals detected by the receiver;

measuring characteristics of the respective radio frequency signal; and

calculating a signal strength of the respective radio frequency signal; and

calibrate a predetermined location of the identified visible light source based on the plurality of measurements acquired via the at least one non-image sensor, the step of calibrating including;

transmitting to a server, via a network, for recording;

the respective measured characteristics and the respective calculated signal strength,

the determined identity of the visible light source, and

the plurality of measurements characteristic of conditions at the location within the space proximate the identified visible light source.

9. The method of claim 8, wherein the plurality of measurements characteristic of conditions at a location within the space proximate the visible light source includes one or more of overall brightness, signal detections, and orientation of the device.

10. The method of claim 8, wherein the receiver includes one or more of:

a Bluetooth receiver;

a Wi-Fi receiver;

or

a cellular receiver.

11. The method of claim 8, further comprising a step to iteratively repeat the steps of capturing, processing, acquiring, and calibrating for each of a plurality of visible light sources within the space.

12. The method of claim 8, wherein the at least one non-image sensor further comprises a second non-image sensor, the second non-image sensor including at least one of:

an accelerometer;

a compass;

a gyroscope;

a microphone;

or

an infrared detector.

13. The method of claim 12, wherein the calibrating step further includes a step to transmit, via the network the plurality of measurements acquired via the second non-image sensor to the server via the network for recording.

14. A method, comprising steps to:

capture, via an image sensor of a device, one or more images including a signal modulated within visible light transmitted from a visible light source located within a space, the signal corresponding to an identity of the visible light source;

process the one or more images to determine, based at least in part on the signal, the identity of the visible light source;

acquire a plurality of measurements characteristic of conditions at a location within the space proximate the visible light source, the step of acquiring including;

detecting, via the receiver, one or more radio frequency signals within the space; and

for each of the detected one or more radio frequency signals detected by the receiver;

measuring characteristics of the respective radio frequency signal; and

calculating a signal strength of the respective radio frequency signal;

retrieve, based at least in part on the identity of the visible light source, the respective measured characteristics, and the respective calculated signal strength, a predetermined location of the visible light source; and

determine, based at least in part on the retrieved predetermined location of the visible light source, a location of the device within the space.

15. The method of claim 14, wherein the plurality of measurements characteristic of conditions at the location within the space proximate the visible light source includes one or more of overall brightness, signal detections, and orientation of the device.

16. The method of claim 14, wherein the retrieval step further includes steps to:

transmit, via a wireless interface configured to communicate through a network over a wireless medium and to a server, the identity of the visible light source, the identified visible light source, the respective measured characteristics, and the respective calculated signal strength; and

receive the predetermined location from the server via the wireless interface.

17. The method of claim 14, wherein:

the at least non-image sensor further comprises a second non-image sensor; and

the plurality of measurements characteristic of conditions at the location within the space proximate the visible light source are further acquired by the second non-image sensor.

18. The method of claim 17, wherein:

the second non-image sensor includes at least one of;

an accelerometer;

a compass;

a gyroscope;

a microphone;

or

an infrared detector.