Light receiver position determination

• US 9,014,564 B2
• Filed: 09/24/2012
• Issued: 04/21/2015
• Est. Priority Date: 09/24/2012
• Status: Expired due to Fees

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Roberts, Richard D., Zhu, Jing, Walma, Mathys C.
• Primary Examiner(s): Vanderpuye, Ken
• Assistant Examiner(s): BRITO PEGUERO, MERLIN
• Application Number:
  US13/625,361
• Publication Number:
  US 20140086587A1
• Time in Patent Office: 939 Days
• Field of Search: None
• US Class Current: 398/115
• CPC Class Codes: H04B 10/116 Visible light communication

Abstract

A light array includes lights that transmit modulated light to indicate their unique light identifiers (IDs) and lights that transmit unmodulated light. A light receiver records images of the light array and recovers the light IDs from the modulated light. The light receiver uses the IDs to retrieve a light map representative of the light array. The receiver aligns the retrieved light map with the recorded images of the light array, and accesses real-world positions of all of the light in the light array, as deployed, based on the aligned light map. The light receiver determines a 3-dimensional position of the light receiver relative to the light array.

Claims

1. A non-transitory computer readable medium encoded with a computer program, including instructions to cause a processor to:

access a sequence of images of at least a portion of an array of spatially separated modulated and unmodulated lights recorded by an image capture device;

identify images of lights of the array recorded in the sequence of images;

demodulate a light identifiers (ID) for each modulated light recorded in the sequence of images from the images of the respective modulated light;

retrieve a map of lights of at least a portion of the array based on the demodulated light IDs, wherein the map includes representations of modulated lights of the array that correspond to the demodulated light IDs, representations of unmodulated lights of the array, and light IDs of the unmodulated lights;

positionally align the map with the images of lights recorded in the sequence of images to determine light IDs of unmodulated lights recorded in the sequence of images;

retrieve position information for lights of the array recorded in the sequence of images, including to retrieve position information for each modulated light recorded in the sequence of images based on the respective demodulated light ID, and to retrieve position information for unmodulated lights of the array based on the light IDs of the unmodulated lights recorded in the sequence of images; and

photogrammetrically determine a position of the image capture device relative to the array based on the retrieved position information of the modulated and unmodulated lights recorded in the sequence of images accessed light positions.

2. The computer readable medium of claim 1, wherein:

the map defines a reduced-scale spatial arrangement of modulated and unmodulated lights of the array, and includes a light ID and position information for each light represented in the map; and

the instructions to cause the processor to positionally align include instructions to cause the processor to positionally align the representations of modulated lights of the map with the images of modulated lights based on respective light IDs to align the representations of unmodulated lights of the map with the images of unmodulated lights recorded in the sequence of images.

3. The computer readable medium of claim 2, wherein the instructions to cause the processor to retrieve position information include instructions to cause the processor to retrieve the position information based on light IDs corresponding to aligned pairs of lights represented in the map and images of lights recorded in the sequence of images.

4. The computer readable medium of claim 2, wherein the instructions to cause the processor to positionally align include instructions to cause the processor to rotate and scale the map to positionally align the map with the images of lights recorded in the sequence of images.

5. The computer readable medium of claim 1, wherein the instructions to cause the processor to retrieve position information include instructions to cause the processor to:

transmit a request for a map of a light array containing lights having the demodulated light IDs; and

receive the requested map and associated data.

6. The computer readable medium of claim 1, wherein the instructions to cause the processor to demodulate include instructions to cause the processor to demodulate bits of a light identifier based on frequencies at which a light recorded in the sequence of images varies in intensity.

7. An apparatus, comprising:

an image capture device to record a sequence of images of at least a portion of an array of spatially separated modulated and unmodulated lights;

a processor and memory configured to;

identify images of lights of the array recorded in the sequence of images;

demodulate a light identifiers (ID) for each modulated light recorded in the sequence of images from the images of the respective modulated light;

retrieve a map of lights of at least a portion of the array based on the demodulated light IDs, wherein the map includes representations of modulated lights of the array that correspond to the demodulated light IDs, representations of unmodulated lights of the array, and light IDs of the unmodulated lights;

positionally align the map with the images of lights recorded in the sequence of images to determine light IDs of unmodulated lights recorded in the sequence of images;

retrieve position information for lights of the array recorded in the sequence of images, including to retrieve position information for each modulated light recorded in the sequence of images based on the respective demodulated light ID, and to retrieve position information for unmodulated lights of the array based on the light IDs of the unmodulated lights recorded in the sequence of images; and

photogrammetrically determine a position of the image capture device relative to the array based on the retrieved position information of the modulated and unmodulated lights recorded in the sequence of images.

8. The apparatus of claim 7, wherein:

the map defines a reduced-scale spatial arrangement of the modulated and unmodulated lights of the array, and includes a light ID and position information for each light represented in the map; and

the processor and memory are further configured to positionally align the representations of modulated lights of the map with the images of modulated lights based on respective light IDs to align the representations of unmodulated lights of the map with unmodulated lights recorded in the sequence of images.

9. The apparatus of claim 8, wherein the processor and memory are further configured to retrieve the position information based on light IDs corresponding to aligned pairs of lights represented in the map and images of lights recorded in the sequence of images.

10. The apparatus of claim 8, wherein the processor and memory are further configured to rotate and scale the map to positionally align the map with images of lights recorded in the sequence of images.

11. The apparatus of claim 7, wherein the processor and memory are further configured to:

transmit a request for a map of a light array containing lights having the demodulated light IDs; and

receive the requested map and associated data.

12. The apparatus of claim 7, wherein the processor and memory are further configured to demodulate bits of a light identifier based on frequencies at which a light recorded in the sequence of images varies in intensity.

13. The apparatus of claim 7, further including

a user interface system;

a communication system to communicate with one or more of a communication network, the processor, and the user interface system; and

a housing to hold the processor and memory, the image capture device, the communication system, and at least a portion of the user interface system.

14. The apparatus of claim 13, wherein:

the communication system includes a wireless communication system; and

the housing includes a mobile hand-held housing and is configured to further hold a battery.

15. A method, comprising:

recording a sequence of images of at least a portion of an array of spatially separated modulated and unmodulated lights;

identifying images of lights of the array recorded in the sequence of images;

demodulating a light identifiers (ID) for each modulated light recorded in the sequence of images from the images of the respective modulated light;

retrieving a map of lights of at least a portion of the array based on the demodulated light IDs, wherein the map includes representations of modulated lights of the array that correspond to the demodulated light IDs, representations of unmodulated lights of the array, and light IDs of the unmodulated lights;

positionally aligning the map with the images of lights recorded in the sequence of images to determine light IDs of unmodulated lights recorded in the sequence of images;

retrieve position information for lights of the array recorded in the sequence of images, including to retrieve position information for each modulated light recorded in the sequence of images based on the respective demodulated light ID, and to retrieve position information for unmodulated lights of the array based on the light IDs of the unmodulated lights recorded in the sequence of images; and

photogrammetrically determining a position of the image capture devices relative to the array based on the retrieved position information of the modulated and unmodulated lights recorded in the sequence of images.

16. The method of claim 15, wherein:

the map defines a reduced-scale spatial arrangement of the modulated and unmodulated lights of the array, and includes a light ID and position information for each light represented in the map; and

the positionally aligning includes positionally aligning the representations of modulated lights of the map with the images of modulated lights based on respective light IDs to align the representations of unmodulated lights of the map with the images of unmodulated lights recorded in the sequence of images.

17. The method of claim 16, wherein the retrieving position information includes retrieving the position information based on light IDs corresponding to aligned pairs of lights represented in the map and images of lights recorded in the sequence of images.

18. The method of claim 16, wherein the positionally aligning includes rotating and scaling the map to positionally align the map with the images of lights recorded in the sequence of images.

19. The method of claim 15, wherein the retrieving positional information includes:

transmitting a request for a map of a light array containing lights having the demodulated light IDs; and

receiving the requested map and associated data.

20. The method of claim 15, wherein the demodulating includes demodulating bits of a light identifier based on frequencies at which a light recorded in the sequence of images varies in intensity.