Synchronizing active illumination cameras

• US 10,523,923 B2
• Filed: 12/28/2015
• Issued: 12/31/2019
• Est. Priority Date: 12/28/2015
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Kashyap, Abhinav
• Primary Examiner(s): Hossain, Farzana
• Application Number:
  US14/979,602
• Publication Number:
  US 20170188019A1
• Time in Patent Office: 1,464 Days
• CPC Class Codes: H04N 13/282 for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet

Abstract

Apparatus for controlling a plurality of active illumination cameras to operate in a time division multiplexed operating mode to acquire images of scenes that the cameras image.

Claims

1. A system for controlling operation of a plurality of active illumination cameras, the system comprising:

a hub configured to communicate with mobile communication devices and comprising a database comprising a list of active illumination cameras subscribed to the system that are configured to communicate with the hub and a server configured to process communications between the hub and the active illumination cameras subscribed to the system;

a first active illumination camera from the active illumination cameras subscribed to the system, the first active illumination camera configured to image one or more objects in a scene;

a second active illumination camera from the active illumination cameras subscribed to the system, the second active illumination camera configured to image the one or more objects in the scene,

the hub further configured to determine that an operation of the first active illumination camera would interfere with an operation of the second active illumination camera, and

based on the determination that the operation of the first active illumination camera would interfere with an operation of the second active illumination camera the second active illumination camera communicates with the hub to establish a time division multiplexing (TDM) imaging mode of operation in which at any one time, only the first active illumination camera or the second active illumination camera operates to image the one or more objects in the scene.

2. The system according to claim 1 wherein the active illumination cameras subscribed to the system are configured to establish a wireless local area network (WLAN) over which cameras in an imaging neighbourhood communicate to implement the TDM imaging mode.

3. The system according to claim 2 wherein a first set of the active illumination cameras subscribed to the system is configured to perform a radio scan after being turned on in the imaging neighbourhood to detect a radio beacon broadcast by a second set of the active illumination cameras subscribed to the system in the imagining neighbourhood, the radio beacon comprising a service set identifier (SSID) for the WLAN.

4. The system according to claim 3 wherein if the first set of the active illumination cameras do not detect the radio beacon the camera is configured to communicate with the hub and request an SSID for establishing the WLAN, and an access code that another camera may present to be granted access to the WLAN.

5. The system according to claim 4 wherein the hub is configured to respond to the request and communicate an SSID and access code to the first set of the active illumination cameras.

6. The system according to claim 5 wherein upon receiving the SSID and access code the first set of the active illumination cameras is configured to:

broadcast a radio beacon comprising the SSID;

assume a role as master camera of the WLAN that accepts as members of the WLAN in the role of slaves, other of the first set of the active illumination cameras that detect the beacon and transmit a request comprising the access code to join the WLAN; and

administer the TDM imaging mode of operation by allocating imaging time slots to slave cameras during which the slave cameras are allowed to image a scene.

7. The system according to claim 6 wherein the master camera is configured to allocate an imaging time slot to a slave camera by transmitting an image-ON message to the slave camera over the WLAN.

8. The system according to claim 7 wherein the image-On message comprises an ID of the slave camera for which the image-ON message is intended, a start time of the imaging time slot, and a duration of the imaging time slot.

9. The system according to claim 8 wherein the master camera is operable to receive an operating profile of the slave camera that is transmitted to the master camera over the WLAN, and customize the imaging time slot for the slave camera based on the operating profile.

10. The system according to claim 9 wherein the operating profile comprises one or more of the following:

an intensity of light that the slave camera transmits to illuminate a scene it images;

a pulse width for light pulses that the slave camera transmits to illuminate a scene it images;

a repetition frequency for light pulses that the slave camera transmits to illuminate a scene it images; and

a wavelength of light that the slave camera transmits to illuminate a scene it images.

11. The system according to claim 8 wherein the master camera is operable to receive a status message comprising status parameters for the slave camera that is transmitted to the master camera over the WLAN, and customize the imaging time slot for the slave camera based on the status message.

12. The system according to claim 8 wherein the status message comprises one or more of the following:

slave camera temperature;

slave camera power reserves;

availability for using an allocated imaging time slot; and

a frequency at which the slave camera can use imaging time slots.

13. The system according to claim 3 wherein if the first set of the active illumination cameras detect the radio beacon, the first set of the active illumination cameras is configured to communicate with the hub to:

request and receive the access code for the WLAN from the hub;

upon receiving the access code submit a request to the other of the first set of the active illumination cameras acting as a master of the WLAN, to join the WLAN as a slave to the master; and

upon joining the WLAN receive imaging time slots that the master allocates during which the active illumination camera as a slave camera is allowed to image a scene.

14. The system according to claim 1 wherein each of the active illumination cameras subscribed to the system is configured to communicate with the hub when the active illumination camera is turned on, to transmit to the hub, data that may be used to determine a geolocation of the active illumination camera.

15. The system according to claim 14 wherein the hub is configured to process the geolocation data it receives from the active illumination cameras subscribed to the system to determine when two or more of the active illumination cameras subscribed to the system are in a same imaging neighborhood in which the active illumination cameras subscribed to the system may interfere with each other'"'"'s operation.

16. The system according to claim 15 wherein upon determining that two or more of the active illumination cameras subscribed to the system are located in a same imaging neighbourhood, the hub is configured to communicate with the active illumination cameras subscribed to the system to allocate imaging time slots to the active illumination cameras subscribed to the system in the neighbourhood so that the active illumination cameras subscribed to the system operate in the TDM imaging mode.

17. The system according to claim 16 wherein the hub is configured to allocate an imaging time slot to a camera from the active illumination cameras subscribed to the system by transmitting an image-ON message to the camera over the WLAN, the image-On message comprising an ID of the camera for which the image-ON message is intended, a start time of the imaging time slot, and a duration of the imaging time slot.

18. The system according to claim 1 wherein the first active illumination camera comprises one of the following:

a time of flight (TOF) range camera, a structure light range camera, a strobe camera, and a flash camera.

19. The system according to claim 1 wherein the first and second active illumination cameras are comprised in a mobile communication device selected from:

a laptop computer, a workbook, a tablet, a smartphone, a wrist watch, and glasses.

20. A method of imaging a scene using a plurality of active illumination cameras, the method comprising:

establishing a wireless local area network (WLAN) over which the plurality of active illumination cameras communicate;

causing, by one or more processors, a first active illumination camera from the plurality of active illumination cameras to image one or more objects in a scene;

causing, by the one or more processors, a second active illumination camera from the plurality of active illumination cameras to image the one or more objects in the scene,

determining that an operation of the first active illumination camera would interfere with an operation of the second active illumination camera, and

based on the determination that the operation of the first active illumination camera would interfere with the operation of the second active illumination camera, establishing, by the one or more processors, a time division multiplexing (TDM) imaging mode of operation in which at any one time, only the first active illumination camera or the second active illumination camera in the imaging neighbourhood operates to image the one or more objects in the scene.