Shared secret arrangements and optical data transfer

• US 9,847,976 B2
• Filed: 04/08/2015
• Issued: 12/19/2017
• Est. Priority Date: 01/20/2012
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Lord, John D., Stach, John
• Primary Examiner(s): Dada, Beemnet
• Application Number:
  US14/681,610
• Publication Number:
  US 20150215295A1
• Time in Patent Office: 986 Days
• CPC Class Codes: H04B 10/11 Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
• CPC Class Codes: H04B 10/1141 One-way transmission
• CPC Class Codes: H04B 10/116 Visible light communication
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 63/083 using passwords cryptographic mechanisms or cryptographic arrangements for entity authentication using a predetermined code H04L9/3226
• CPC Class Codes: H04L 63/18 using different networks or channels, e.g. using out of band channels cryptographic mechanisms or cryptographic arrangements for key distribution involving distinctive intermediate devices or communication paths H04L9/0827; cryptographic mechanisms or cryptographic arrangements for authentication using a plurality of channels H04L9/3215
• CPC Class Codes: H04M 1/003 Telephone sets using electrooptical means in the transmission path
• CPC Class Codes: H04M 1/0264 for a camera module assembly
• CPC Class Codes: H04W 12/04 Key management, e.g. using generic bootstrapping architecture [GBA]
• CPC Class Codes: H04W 12/06 Authentication
• CPC Class Codes: H04W 12/50 Secure pairing of devices
• CPC Class Codes: H04W 12/65 Environment-dependent, e.g. using captured environmental data
• CPC Class Codes: H04W 88/06 adapted for operation in multiple networks or having at least two operational modes, e.g. multi-mode terminals

Abstract

Digital data is optically broadcast through an environment by controllably switching the brightness or chrominance of LED solid state lamps, or of other illumination sources (e.g., television screens and backlit computer displays). This optical data channel is useful to convey cryptographic key data by which devices within the environment can authenticate themselves to a secure network. In some embodiments, the optical modulation is sensed by the camera of a smartphone. The row data output by the smartphone'"'"'s camera sensor is processed to extract the modulated data signal. In some monochrome embodiments, data communication speeds far in excess of the camera'"'"'s frame rate (e.g., 30/second), or even the camera'"'"'s row rate (e.g., 14,400/second) are achieved. Still greater rates can be achieved by conveying different data in different chrominance channels. A great number of other features and arrangements are also detailed.

Claims

1. A method employing a mobile video camera that includes plural rows of photodetectors, each row producing pixel data, the method comprising the acts:

using said video camera to capture N frames per second of imagery, each frame comprising plural of said rows of pixel data;

processing said rows of pixel data to yield a time-varying output signal; and

discerning from said output signal a data signal conveying more than N symbols per second;

wherein said data signal was conveyed to the video camera by modulated light emitted from an LED light source, and wherein pixel data output by each of said plural rows of photodetectors varies in accordance with the modulated light.

2. The method of claim 1 that includes using information conveyed by said data signal to establish a secure wireless connection between two devices on a network.

3. The method of claim 1 that includes:

processing rows of pixel data of a first color to yield a first time-varying output signal;

processing rows of pixel data of a second color to yield a second time-varying output signal; and

discerning from said output signals a data signal conveying more than 2N symbols per second.

4. The method of claim 3 that further includes processing rows of pixel data of a third color to yield a third time-varying output signal, and discerning from said output signals a data signal conveying more than 3N symbols per second.

5. The method of claim 1 wherein the camera captures rows of imagery at M rows per second, and the method includes discerning from said output signal a data signal conveying more than M symbols per second.

6. The method of claim 5 that includes:

processing rows of pixel data of a first color to yield a first time-varying output signal;

processing rows of pixel data of a second color to yield a second time-varying output signal;

processing rows of pixel data of a third color to yield a third time-varying output signal; and

discerning from said output signals a data signal conveying more than 3M symbols per second.

12. The method of claim 1 that further includes the act of emitting the modulated light from the LED light source.

7. A method of optical signaling, using a portable device camera comprising rows of pixels operated in a rolling shutter fashion, wherein one row of a captured image frame is exposed starting at a first time and ending at a second time, and a next row of said captured image frame is exposed starting at a third time after the first time and before the second time, and ending at a fourth time after the second time, and wherein the camera captures frames of imagery in a video mode at N frames per second, and the method includes processing row data of the captured frames to extract an optical data signal having a data rate greater than N symbols per second.

8. The method of claim 7 wherein the camera captures rows of imagery at M rows per second, and the method comprises processing said row data to extract an optical data signal having a data rate greater than M symbols per second.

9. The method of claim 8 that includes processing said row data to extract an optical data signal having a rate of more than 2M symbols per second.

10. A portable user device equipped with a camera, a processor and a memory, the memory containing instructions configuring the device to perform acts including:

using said camera to capture N frames per second of imagery, each frame comprising plural rows of pixel data;

processing said rows of pixel data to yield a time-varying output signal; and

discerning from said output signal a data signal conveying more than N symbols per second;

wherein said instructions further configure the camera to operate in a rolling shutter fashion, in which one row of a captured image frame is exposed starting at a first time and ending at a second time, and a next row of said captured image frame is exposed starting at a third time after the first time and before the second time, and ending at a fourth time after the second time.

13. A system including the portable user device of claim 10, and further including an LED light source, said light source including a modulator configured to vary illumination from an LED of the light source in accordance with said data signal.

11. A non-transitory computer memory containing software instructions enabling a camera-equipped device to perform acts including:

using said camera to capture N frames per second of imagery, each frame comprising plural rows of pixel data;

processing said rows of pixel data to yield a time-varying output signal; and

discerning from said output signal a data signal conveying more than N symbols per second;

wherein said instructions further configure the camera to operate in a rolling shutter fashion, in which one row of a captured image frame is exposed starting at a first time and ending at a second time, and a next row of said captured image frame is exposed starting at a third time after the first time and before the second time, and ending at a fourth time after the second time.

14. A method employing a camera-equipped portable device, comprising the acts:

using said camera to capture N frames-per-second of imagery, in an ambient environment illuminated by an LED lamp modulated to emit an optical data signal having a bit rate of M bits-per-second, where M>

N, wherein each frame captured by the camera comprises plural rows of pixel data, where one of said rows is exposed starting at a first time and ending at a second time, and a next row of said captured image frame is exposed starting at a third time after the first time and before the second time, and ending at a fourth time after the second time;

wherein the ambient light is sampled at a rate greater than N times per second, permitting the M bits-per-second data signal to be discerned therefrom, notwithstanding the N frames-per-second capture rate of the camera.

15. The method of claim 14 in which the LED lamp provides overhead lighting for a home or office.

16. The method of claim 14 in which the LED lamp provides backlighting for an electronic display screen.

17. The method of claim 14 in which the LED lamp forms part of a data projection system.

18. The method of claim 14 that further includes converting an output signal corresponding to said plural rows of pixel data into a frequency domain.

19. The method of claim 14 that further includes:

producing an output signal corresponding to each row, by sampling and combining pixel data from plural photodetectors in the row; and

discerning the M bit-per-second data signal from the produced output signals.

20. The method of claim 19 in which said sampling comprises random sampling.