Method and apparatus for receiving visible light signal

• US 9,673,903 B2
• Filed: 01/31/2016
• Issued: 06/06/2017
• Est. Priority Date: 07/31/2013
• Status: Expired due to Fees

• Current Assignee: Kuang-Chi Intelligent Photonic Technology Ltd. (Kuang-Chi Technologies Co., Ltd.)
• Original Assignee: Kuang-Chi Intelligent Photonic Technology Ltd. (Kuang-Chi Technologies Co., Ltd.)
• Inventors: Fan, Linyong, Liu, Ruopeng, Li, Chunlai
• Primary Examiner(s): SINGH, DALZID E
• Application Number:
  US15/011,569
• Publication Number:
  US 20160164606A1
• Time in Patent Office: 492 Days
• Field of Search: 398118
• CPC Class Codes: H04B 10/116 Visible light communication
• CPC Class Codes: H04B 10/60 Receivers

Abstract

The disclosure relates to a method and an apparatus for receiving a visible light signal. The method includes the following steps: controlling use of a camera as a light signal receiver to capture a group of continuous images covering an emitter, where the emitter emits visible light signals; and obtaining, from the group of continuous images, a visible light signal that comes from the emitter. In the disclosure, because a camera is used to receive a visible light signal, a visible light communication function can be implemented in various devices or systems under a premise that no hardware is newly added or modified.

Claims

1. A method for receiving a visible light signal, comprising:

controlling use of a camera as a light signal receiver to capture a group of continuous images covering an emitter, the emitter emits visible light signals, the group of continuous images includes an image of a visible light signal of the emitter and background image;

obtaining a visible light signal emitted by the emitter from the group of continuous images, specifically comprises;

dividing the group of continuous images into a plurality of images;

comparing luminance variation with time of each region with a predetermined size of all images, selecting a region with continuous varying luminance, and determining that a visible light signal that comes from the emitter exists in the region; and

analyzing and processing luminance changes of the region of all the images to obtain a visible light signal that comes from the emitter, outputting the image of a visible light signal of the emitter when the images captured by the camera include the visible light signal of the emitter;

outputting the background images when the images captured by the camera do not include the visible light signal of the emitter;

processing the visible light signal to restore original information.

2. The method according to claim 1, wherein the comparing luminance variation with time of each region with a predetermined size of all images comprises analyzing variation with time of average grey value of each region with the predetermined size;

and the step of processing the visible light signal comprises decoding, decryption, and/or descrambling.

3. The method according to claim 1, wherein:

in the step of dividing the group of continuous images into a plurality of images, the images are frames of image; and

the step of selecting a region with continuous varying luminance, and determining that a visible light signal exists in the region comprises processing each frame of image according to the following steps to identify a light spot in the frame of image;

searching for a pixel having a maximum grey value in the frame of image, and using it as a central point of a first light spot;

determining a boundary of the first light spot;

determining a size of the first light spot according to a distance between the boundary of the first light spot and the central point of the first light spot;

determining, according to the determined boundary and size of the first light spot, whether the first light spot is a valid light spot; and

restoring the visible light signal according to the identified light spot.

4. The method according to claim 3, wherein the step of determining a boundary of the first light spot comprises:

sequentially calculating, in ascending order of distances along a first direction, grey values of pixels that are at distances from the central point of the first light spot, and using a previous pixel of a pixel with a grey value abruptly changing from that of the previous pixel in the first direction as a boundary of the first light spot in the first direction, comprises;

if a grey value of a first pixel is less than a threshold grey value, using a previous pixel of the first pixel as the boundary of the first light spot in the first direction, or otherwise, using a boundary of the frame of image in the first direction as the boundary of the first light spot in the first direction; and

sequentially calculating, in ascending order of distances along a second direction, grey values of pixels that are at distances from the central point of the first light spot, and using a previous pixel of a pixel with a grey value abruptly changing from that of the previous pixel in the second direction as a boundary of the first light spot in the second direction, comprises;

if a grey value of a second pixel is less than the threshold of grey value, using a previous pixel of the second pixel as the boundary of the first light spot in the second direction, or otherwise, using a boundary of the frame of image in the second direction as the boundary of the first light spot in the second direction, where the first direction is opposite to the second direction, and the threshold of grey value is an average grey value of the frame of image.

5. The method according to claim 4, wherein the step of determining, according to the determined size of the first light spot, whether the first light spot is a valid light spot, comprises:

determining whether the size of the first light spot is greater than a threshold, and if yes, determining that the first light spot is a valid light spot, the greater one of a distance between the boundary of the first light spot in the first direction and the central point of the first light spot and a distance between the boundary of the first light spot in the second direction and the central point of the first light spot is selected as the size of the first light spot.

6. The method according to claim 3, wherein the step of determining, according to the determined boundary of the first light spot, whether the first light spot is a valid light spot, comprises:

determining whether any boundary of the first light spot is located at a boundary of the image, and if no, determining that the first light spot is a valid light spot.

7. The method according to claim 3, further comprising identifying a second light spot in the frame of image according to the following steps:

searching for a pixel of a maximum grey value in regions outside the first light spot in the frame of image, and using it as a central point of the second light spot, comprises;

setting grey values of pixels in the first light spot in the frame of image to an average grey value of the image to obtain a modified image; and

searching for a pixel of a maximum grey value in the modified image;

determining a boundary of the second light spot;

determining a size of the second light spot according to a distance between the boundary of the second light spot and the central point of the second light spot; and

determining, according to the determined boundary and size of the second light spot, whether the second light spot is a valid light spot.

8. The method according to claim 3, wherein the step of determining a boundary of the second light spot comprises:

sequentially calculating, in ascending order of distances along a first direction, grey values of pixels that are at distances from the central point of the second light spot, and using a previous pixel of a pixel with a grey value abruptly changing from that of the previous pixel in the first direction as a boundary of the second light spot in the first direction, comprises;

if a grey value of a first pixel is less than a threshold of grey value, using a previous pixel of the first pixel as the boundary of the second light spot in the first direction, or otherwise, using a boundary of the frame of image in the first direction as the boundary of the second light spot in the first direction; and

sequentially calculating, in ascending order of distances along a second direction, grey values of pixels that are at distances from the central point of the second light spot, and using a previous pixel of a pixel with a grey value abruptly changing from that of the previous pixel in the second direction as a boundary of the second light spot in the second direction, if a grey value of a second pixel is less than the threshold of grey value, using a previous pixel of the second pixel as the boundary of the second light spot in the second direction, or otherwise, using a boundary of the frame of image in the second direction as the boundary of the second light spot in the second direction, and the threshold of grey value is an average grey value of the frame of image.

9. The method according to claim 3, wherein the step of processing each frame of image to identify a light spot in the frame of image further comprises:

zooming out the frame of image according to a predetermined ratio, where the predetermined ratio is a common divisor of the pixel number in a row and the pixel number in a column of the image.

10. The method according to claim 3, wherein when the camera is normally in a low frame rate mode, the method further comprises:

identifying a start code of a predetermined sequence in the visible light signal; and

switching the camera to a high frame rate mode;

or,

identifying an end code of a predetermined sequence in the visible light signal; and

switching the camera to a low frame rate mode;

the method for switching a frame rate mode of the camera comprising;

modifying a register of a photosensitive device of the camera.

11. An apparatus for receiving a visible light signal, which comprises a hardware processor and a memory, wherein the hardware processor is configured to execute programming modules stored in the memory, wherein the programming modules comprise:

a module configured to control use of a camera as a light signal receiver to capture a group of continuous images covering an emitter, the emitter emitting visible light signals, the group of continuous images includes an image of a visible light signal of the emitter and background image;

a module configured to obtain, from the group of continuous images, a visible light signal that comes from the emitter, comprising;

a module configured to divide the group of continuous images into a plurality of images;

a module configured to compare luminance variation with time of each region with a predetermined size of all images, select a region with continuous varying luminance, and determine that a visible light signal that comes from the emitter exists in the region;

a module, configured to analyze and process luminance changes of the region of all the images to obtain the visible light signal that comes from the emitter, output the image of a visible light signal of the emitter when the images captured by the camera include the visible light signal of the emitter;

output the background images when the images captured by the camera do not include the visible light signal of the emitter; and

a module configured to processing the visible light signal to restore original information.

12. The apparatus according to claim 11, wherein the process of comparing luminance of variation with time of each region with a predetermined size of all images comprises analyzing a variation with time of average grey value of each region with the predetermined size, the module configured to processing visible light signal to restore original information performs decoding, decryption, and/or descrambling.

13. The apparatus according to claim 11, wherein:

the module configured to control use of a camera as a light signal receiver to capture a group of continuous images covering an emitter comprises;

a module configured to obtain, from the camera, a plurality of frames of image comprising a visible light signal; and

the module configured to obtain, from the group of continuous images, a visible light signal that comes from the emitter, comprises;

a module configured to process each frame of image to identify a light spot in the frame of image, comprising;

a module configured to search for a pixel having a maximum grey value in the frame of image, and use it as a central point of a first light spot;

a module configured to determine a boundary of the first light spot;

a module configured to determine a size of the first light spot according to a distance between the boundary of the first light spot and the central point of the first light spot;

a module configured to determine, according to the determined boundary and size of the first light spot, whether the first light spot is a valid light spot; and

a module configured to restore the visible light signal according to the identified light spot.

14. The apparatus according to claim 13, wherein the module configured to determine a boundary of the first light spot comprises:

a module configured to sequentially calculate, in ascending order of distances along a first direction, grey values of pixels that are at distances from the central point of the first light spot, and use a previous pixel of a pixel with a grey value abruptly changing from that of the previous pixel in the first direction as a boundary of the first light spot in the first direction;

if a grey value of a first pixel is less than a threshold of grey value, a previous pixel of the first pixel is used as the boundary of the first light spot in the first direction, or otherwise, a boundary of the frame of image in the first direction is used as the boundary of the first light spot in the first direction; and

a module configured to sequentially calculate, in ascending order of distances along a second direction, grey values of pixels that are at distances from the central point of the first light spot, and use a previous pixel of a pixel with a grey value abruptly changing from that of the previous pixel in the second direction as a boundary of the first light spot in the second direction;

if a grey value of a second pixel is less than the threshold of grey value, a previous pixel of the second pixel is used as the boundary of the first light spot in the second direction, or otherwise, a boundary of the frame of image in the second direction is used as the boundary of the first light spot in the second direction, where the first direction is opposite to the second direction, and the threshold of grey value is an average grey value of the frame of image.

15. The apparatus according to claim 13, wherein the module configured to determine, according to the determined boundary and size of the first light spot, whether the first light spot is a valid light spot, determines whether any boundary of the first light spot is located at a boundary of the image, and if no, determines that the first light spot is a valid light spot;

or the module configured to determine, according to the determined boundary and size of the first light spot, whether the first light spot is a valid light spot, determines whether the size of the first light spot is greater than a threshold, and if yes, determines that the first light spot is a valid light spot.

16. The apparatus according to claim 13, wherein the module configured to process each frame of image to identify a light spot in the frame of image further comprises:

a module configured to search for a pixel having a maximum grey value in regions outside the first light spot in the frame of image, and use it as a central point of the second light spot, comprises;

a module configured to set grey values of pixels in the first light spot in the frame of image to an average grey value of the image to obtain a modified image, and a module configured to search for a pixel having a maximum grey value in the modified image;

a module configured to determine a boundary of the second light spot;

a module configured to select a distance between the boundary of the second light spot and the central point of the second light spot as a size of the second light spot; and

a module configured to determine, according to the determined boundary of the second light spot, whether the second light spot is a valid light spot.

17. The apparatus according to claim 16, wherein the module configured to determine a boundary of the second light spot comprises:

a module configured to sequentially calculate, in ascending order of distances along a first direction, grey values of pixels that are at distances from the central point of the second light spot, and use a previous pixel of a pixel with a grey value abruptly changing from that of the previous pixel in the first direction as a boundary of the second light spot in the first direction;

if a grey value of a first pixel is less than a threshold of grey value, a previous pixel of the first pixel is used as the boundary of the first light spot in the first direction, or otherwise, a boundary of the frame of image in the first direction is used as the boundary of the first light spot in the first direction; and

a module configured to sequentially calculate, in ascending order of distances along a second direction, grey values of pixels that are at distances from the central point of the second light spot, and use a previous pixel of a pixel with a grey value abruptly changing from that of the previous pixel in the second direction as a boundary of the second light spot in the second direction;

if a grey value of a second pixel is less than the threshold of grey value, a previous pixel of the second pixel is used as the boundary of the first light spot in the second direction, or otherwise, a boundary of the frame of image in the second direction is used as the boundary of the first light spot in the second direction, where the first direction is opposite to the second direction, and the threshold of grey value is an average grey value of the frame of image.

18. The apparatus according to claim 13, wherein the module configured to process each frame of image to identify a light spot in the frame of image further comprises a module configured to zoom out the image according to a predetermined ratio, where the predetermined ratio is a common divisor of the pixel number in a row and the pixel number in a column of the frame of image.

19. The apparatus according to claim 13, wherein when the camera is normally in a low frame rate mode, the programming modules further comprise:

a module configured to identify a start code of a predetermined sequence in the visible light signal;

a module configured to switch the camera to a high frame rate mode according to the identified start code;

a module configured to identify an end code of the predetermined sequence in the visible light signal; and

a module configured to switch the camera to a low frame rate mode according to the identified end code.