Method and apparatus for switching between cameras in a mobile device to receive a light signal

• US 9,918,013 B2
• Filed: 02/17/2016
• Issued: 03/13/2018
• Est. Priority Date: 07/26/2011
• Status: Active Grant

• Current Assignee: ABL IP Holding LLC (Acuity Brands, Inc.)
• Original Assignee: ABL IP Holding LLC (Acuity Brands, Inc.)
• Inventors: Ryan, Daniel, Ganick, Aaron, Green, Kelby Edward
• Primary Examiner(s): WONG, ALLEN C
• Application Number:
  US15/045,519
• Publication Number:
  US 20160165145A1
• Time in Patent Office: 755 Days
• Field of Search: 348 61
• CPC Class Codes: G01C 21/206 specially adapted for indoor navigation
• CPC Class Codes: H04B 10/116 Visible light communication
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04N 25/531 by controlling rolling shutters in CMOS SSIS
• CPC Class Codes: H04W 4/33 for indoor environments, e.g. buildings
• CPC Class Codes: H04W 4/38 for collecting sensor information

Abstract

In one aspect, the present disclosure relates to a method for a method for hiding a camera preview feed of a mobile device application. The method may proceed by the mobile device application enabling an imaging sensor of the mobile device, where the software of the mobile device requires the mobile device application to display the camera preview feed when the imaging sensor is enabled. The method may continue by creating a camera preview surface for displaying the camera preview feed. The method may further continue by modifying the camera preview surface to be hidden from the mobile device user. The method may end by setting the camera preview feed to be displayed on the camera preview surface. In another aspect, the present disclosure further relates to modifying the camera preview surface by resizing the camera preview surface to be one pixel large.

Claims

1. A method comprising:

determining an orientation of a mobile device;

selecting one optical sensor from a plurality of optical sensors of the mobile device as being most likely to receive a modulated light signal, based on the determined orientation; and

demodulating an output signal of the one optical sensor to produce a demodulated signal;

analyzing the demodulated signal of the optical sensor to determine whether a modulating signal is present;

when the analysis determines that the modulating signal is not present;

selecting another optical sensor of the plurality of optical sensors; and

demodulating an output signal of the other optical sensor to produce a further demodulated signal.

2. The method of claim 1, wherein the one optical sensor includes an imaging sensor and the method further includes configuring of the one optical sensor by modifying sensor parameters including at least one of exposure, focus, saturation, white balance, zoom, contrast, brightness, gain, sharpness, ISO, resolution, image quality, scene selection, and metering mode of the one optical sensor to improve reception of the modulated light signal before demodulating the output signal of the one optical sensor.

3. The method of claim 1, wherein the one optical sensor includes a photodiode and the demodulating of the optical sensor includes digitizing the output signal of the photodiode and detecting an on-off key (OOK) modulating signal.

4. The method of claim 1, wherein the determining the orientation of the mobile device includes analyzing output signals of at least one of a gyroscope, compass, or accelerometer of the mobile device to determine the orientation of the mobile device.

5. A method comprising:

determining an orientation of a mobile device;

selecting one optical sensor from a plurality of optical sensors of the mobile device as being most likely to receive a modulated light signal, based on the determined orientation; and

demodulating an output signal of the one optical sensor to produce a demodulated signal;

wherein the one optical sensor includes an imaging sensor and the demodulating of the output signal of the optical sensor includes processing an image output of the imaging sensor to obtain information corresponding to variations of width of one or more stripes in the image output.

6. The method of claim 5, wherein processing includes performing digital pulse recognition (DPR) demodulation on pixel values provided by the imaging sensor.

7. The method of claim 6, wherein:

the DPR demodulation includes generating a confidence score indicating a likelihood that the demodulated signal includes DPR tones; and

the analyzing of the demodulated signal includes analyzing the confidence score to determine whether DPR tones are present.

8. The method of claim 5, wherein the one optical sensor includes an imaging sensor and the method further includes configuring of the one optical sensor by modifying sensor parameters including at least one of exposure, focus, saturation, white balance, zoom, contrast, brightness, gain, sharpness, ISO, resolution, image quality, scene selection, and metering mode of the one optical sensor to improve reception of the modulated light signal before demodulating the output signal of the one optical sensor.

9. The method of claim 5, wherein the one optical sensor includes a photodiode and the demodulating of the optical sensor includes digitizing the output signal of the photodiode and detecting an on-off key (OOK) modulating signal.

10. The method of claim 5, wherein the determining the orientation of the mobile device includes analyzing output signals of at least one of a gyroscope, compass, or accelerometer of the mobile device to determine the orientation of the mobile device.

11. A mobile device comprising:

a first optical sensor mounted in a first location on the mobile device;

a second optical sensor mounted in a second location on the mobile device wherein the second location is different from the first location;

a processor, coupled to the first and second optical sensors;

a memory, coupled to the processor, the memory including program instructions that cause the processor to;

determine an orientation of the mobile device;

based on the determined orientation, select one of the first and second optical sensors as the optical sensor most likely to receive a modulated light signal;

demodulate an output signal of the one optical sensor to produce a demodulated signal; and

analyze the demodulated signal of the one optical sensor to determine whether a modulating signal is present;

when the analysis determines that the modulating signal is not present;

select another optical sensor of the first and second optical sensors;

configure the other optical sensor to receive the modulated light signal; and

demodulate an output signal of the other optical sensor to produce a further demodulated signal.

12. The mobile device of claim 11, wherein each of the first and second optical sensors is selected from a group consisting of a complementary metal oxide semiconductor (CMOS) imager, a charge coupled device (CCD) imager and a photodiode.

13. The mobile device of claim 11, wherein the first optical sensor is a front camera mounted on a front side of the mobile device and the second optical sensor is a back camera mounted on a back side of the mobile device.

14. The mobile device of claim 11, further including program instructions that cause the processor to configure the one optical sensor by modifying at least one sensor parameter including exposure, focus, saturation, white balance, zoom, contrast, brightness, gain, sharpness, ISO, resolution, image quality, scene selection, and metering mode to improve reception of the modulated light signal before the output signal of the one optical sensor is demodulated.

15. The mobile device of claim 11, wherein each camera is a rolling shutter camera.

16. The mobile device of claim 11, wherein:

the one optical sensor includes a photodiode and the mobile device further includes an analog-to-digital converter configured to digitize the output signal of the photodiode; and

the program instructions that cause the processor to demodulate the output signal of the sensor include program instructions that cause the processor to perform on-off key (OOK) demodulation.

17. The mobile device of claim 11, further comprising:

at least one sensor selected from a group consisting of a gyroscope, compass, and accelerometer; and

the program instructions that cause the processor to determine the orientation of the mobile device cause the processor to determine the orientation based on the output signals of the at least one sensor.

18. A mobile device comprising:

a first optical sensor mounted in a first location on the mobile device;

a second optical sensor mounted in a second location on the mobile device wherein the second location is different from the first location;

a processor, coupled to the first and second optical sensors;

a memory, coupled to the processor, the memory including program instructions that cause the processor to;

determine an orientation of the mobile device;

based on the determined orientation, select one of the first and second optical sensors as the optical sensor most likely to receive a modulated light signal, wherein the one optical sensor includes an imaging sensor; and

demodulate an output signal of the one optical sensor to produce a demodulated signal by processing an image output of the imaging sensor to obtain information corresponding to variations of width of one or more stripes in the image output.

19. The mobile device of claim 18, wherein the program instructions that cause the processor to demodulate the output signal of the optical sensor include program instructions that cause the processor to perform digital pulse recognition (DPR) demodulation on pixel values provided by the imaging sensor.

20. The mobile device of claim 19, wherein:

the program instructions that cause the processor to perform the DPR demodulation include program instructions that cause the processor to generate a confidence score indicating a likelihood that the demodulated signal includes DPR tones; and

the program instructions that analyze the demodulated signal include program instructions that analyze the confidence score to determine whether DPR tones are present.

21. The mobile device of claim 18, wherein each of the first and second optical sensors is selected from a group consisting of a complementary metal oxide semiconductor (CMOS) imager, a charge coupled device (CCD) imager and a photodiode.

22. The mobile device of claim 18, wherein the first optical sensor is a front camera mounted on a front side of the mobile device and the second optical sensor is a back camera mounted on a back side of the mobile device.

23. The mobile device of claim 18, further including program instructions that cause the processor to configure the one optical sensor by modifying at least one sensor parameter including exposure, focus, saturation, white balance, zoom, contrast, brightness, gain, sharpness, ISO, resolution, image quality, scene selection, and metering mode to improve reception of the modulated light signal before the output signal of the one optical sensor is demodulated.

24. The mobile device of claim 18, wherein each camera is a rolling shutter camera.

25. The mobile device of claim 18, wherein:

the one optical sensor includes a photodiode and the mobile device further includes an analog-to-digital converter configured to digitize the output signal of the photodiode; and

the program instructions that cause the processor to demodulate the output signal of the sensor include program instructions that cause the processor to perform on-off key (OOK) demodulation.

26. The mobile device of claim 18, further comprising:

at least one sensor selected from a group consisting of a gyroscope, compass, and accelerometer; and

the program instructions that cause the processor to determine the orientation of the mobile device cause the processor to determine the orientation based on the output signals of the at least one sensor.

27. A mobile device comprising:

a first camera mounted on a first side of the mobile device;

a second camera mounted on a second side the mobile device, opposite to the first side;

a processor, coupled to the first and second optical sensors;

a memory, coupled to the processor, the memory including program instructions that cause the processor to;

compare output signals of the first and second cameras;

select one of the first and second cameras providing a greater output signal as the optical sensor most likely to receive a modulated light signal;

configure the one camera to receive the modulated light signal;

demodulate an output signal of the one camera to produce a demodulated signal; and

analyze the demodulated signal of the one camera to determine whether a modulating signal is present;

when the analysis determines that the modulating signal is not present;

select another camera of the first and second cameras;

configure the other camera to receive the modulated light signal; and

demodulate an output signal of the other camera to produce a further demodulated signal.