Systems and methods for ad-hoc networking in an optical narrowcasting system

• US 9,742,492 B2
• Filed: 12/30/2016
• Issued: 08/22/2017
• Est. Priority Date: 12/30/2015
• Status: Active Grant

• Current Assignee: Aron Surefire, LLC
• Original Assignee: SureFire LLC (Surefire Holdings LLC)
• Inventors: Shatz, Narkis E., Bortz, John C.
• Primary Examiner(s): Jacob, Oommen
• Application Number:
  US15/395,840
• Publication Number:
  US 20170195049A1
• Time in Patent Office: 235 Days
• Field of Search: None
• CPC Class Codes: G02B 13/0015 characterised by the lens design
• CPC Class Codes: G02B 19/0009 having refractive surfaces only
• CPC Class Codes: G02B 19/0023 at least one surface having optical power
• CPC Class Codes: G02B 19/009 for use with infrared radiation
• CPC Class Codes: G02B 19/0095 for use with ultraviolet radiation
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06Q 30/0277 Online advertisement
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G08C 23/04 using light waves, e.g. infrared
• CPC Class Codes: H04B 10/11 Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
• CPC Class Codes: H04B 10/114 Indoor or close-range type systems
• CPC Class Codes: H04B 10/1141 One-way transmission
• CPC Class Codes: H04B 10/1143 : Bidirectional transmission
• CPC Class Codes: H04B 10/116 : Visible light communication
• CPC Class Codes: H04B 10/50 : Transmitters
• CPC Class Codes: H04B 10/516 : Details of coding or modulation
• CPC Class Codes: H04B 10/5162 : Return-to-zero modulation schemes
• CPC Class Codes: H04B 10/541 : Digital intensity or amplitude modulation
• CPC Class Codes: H04B 10/60 : Receivers
• CPC Class Codes: H04B 10/615 : Arrangements affecting the optical part of the receiver
• CPC Class Codes: H04B 10/616 : Details of the electronic signal processing in coherent optical receivers
• CPC Class Codes: H04B 10/66 : Non-coherent receivers, e.g. using direct detection
• CPC Class Codes: H04B 10/697 : Arrangements for reducing noise and distortion
• CPC Class Codes: H04B 17/23 : Indication means, e.g. displays, alarms, audible means
• CPC Class Codes: H04M 1/72403 : with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/737 : Characterised by transmission of electromagnetic waves other than radio waves, e.g. infrared waves
• CPC Class Codes: H04N 21/4126 : The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/42204 : User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 23/62 : Control of parameters via user interfaces
• CPC Class Codes: H04N 23/69 : Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/71 : Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 5/272 : Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 7/22 : Adaptations for optical transmission
• CPC Class Codes: H04W 4/21 : for social networking applications
• CPC Class Codes: H04W 8/005 : Discovery of network devices, e.g. terminals
• CPC Class Codes: H04W 84/18 : Self-organising networks, e.g. ad-hoc networks or sensor networks
• CPC Class Codes: H04W 88/16 : Gateway arrangements

Abstract

Systems and methods for optical narrowcasting are provided for transmitting various types of content. Optical narrowcasting content indicative of the presence of additional information along with identifying information may be transmitted. The additional information (which may include meaningful amounts of advertising information, media, or any other content) may also be transmitted as optical narrowcasting content. Elements of an optical narrowcasting system may include optical transmitters and optical receivers which can be configured to be operative at distances ranging from, e.g., 400 meters to 1200 meters. Moreover, the elements can be implemented on a miniaturized scale in conjunction with small, user devices such as smartphones, thereby also realizing optical ad-hoc networking, as well as interoperability with other types of data networks. Optically narrowcast content can be used to augment a real-world experience, enhance and/or spawn new forms of social-media and media content.

Claims

1. A method, comprising:

receiving, at an optical receiver assembly communicatively coupled to a mobile device, a first modulated optical beam transmitted by a source;

extracting information from the modulated optical beam;

displaying the extracted information on a graphical user interface of an application presented on the mobile device;

receiving data corresponding to user input at the graphical user interface selecting the displayed information;

in response to receiving the data corresponding to user input at the graphical user interface selecting the extracted descriptive data, generating digital data to be transmitted by an optical transmitter assembly communicatively coupled to the mobile device to the source, wherein each of the optical receiver assembly and the optical transmitter assembly is a component of the mobile device or a component of a case physically coupled to the mobile device;

transferring the digital data to the optical transmitter assembly;

displaying, on the graphical user interface, an augmented reality object corresponding to a transmitting emitting region covered by the optical transmitter assembly, wherein the augmented reality object provides a visual representation of a field of view in which the optical transmitter assembly transmits modulated optical beams;

displaying, on the graphical user interface, a visual representation of the source; and

transmitting a second modulated optical beam from the optical transmitter assembly to the source, wherein the second modulated optical beam is modulated with the digital data.

2. The method of claim 1, further comprising:

prior to transmitting the second modulated optical beam, determining at the mobile device if an optical receiver assembly of the source is within a signal path of an optical transmitter of the optical transmitter assembly.

3. The method of claim 2, further comprising:

displaying a prompt to position the mobile device such that the visual representation of the source is within the augmented reality object corresponding to the transmitting emitting region covered by the optical transmitter.

4. The method of claim 3, further comprising:

tilting the optical transmitter assembly such that the source'"'"'s optical receiver assembly is within a signal path of the optical transmitter.

5. The method of claim 1, wherein the first modulated optical beam is an optical beacon, wherein the information extracted from the first modulated optical beam indicates that the source is an optical narrowcasting hotspot, and wherein the generated digital data is a request from the mobile device to access the hotspot.

6. The method of claim 1, wherein the first modulated optical beam is an optical signal.

7. The method of claim 6, wherein the information extracted from the first modulated optical beam includes information associated with a product offered for sale by the source, and wherein the generated digital data is a request to conduct a transaction to purchase the product.

12. The method of claim 1, further comprising:

displaying on a graphical user interface of the mobile device controls for configuring permitted optical communications between the mobile device and the source over an ad-hoc optical network, the permitted communications over the ad-hoc optical network comprising one or more of voice or video calling, text messaging, file transfer, or using an application.

13. The method of claim 1, wherein the first modulated optical beam is received over a distance of at least 400 m at a bit rate of at least 1 MHz.

14. The method of claim 5, wherein the request from the mobile device to access the hotspot comprises a unique optical narrowcasting identification associated with the mobile device.

15. The method of claim 1, wherein the optical receiver assembly comprises a lenslet array and an optical detector array, the method further comprising:

receiving the modulated optical beam at a plurality of lenslets of the lenslet array;

each of the plurality of lenslets concentrating collected flux onto at least one optical detector of the optical detector array;

amplifying signals received from the optical detector array to create an amplified signal; and

converting an optical format of the amplified signal to a digital signal.

16. The method of claim 1, further comprising:

converting the digital data to an optical format for optical transmission;

transmitting the converted data as light from a light-emitting element of the optical transmitter assembly to a collimator of the optical transmitter assembly;

receiving the light from the light-emitting element through an entrance pupil of the collimator; and

emitting the light from an exit pupil of the collimator.

17. The method of claim 16, further comprising:

homogenizing the light emitted from the exit pupil of the collimator using two or more lenslet arrays positioned in front of the exit pupil of the collimator.

8. A system, comprising:

an optical receiver assembly communicatively coupled to a smartphone, the optical receiver assembly adapted to receive a modulated optical beam transmitted by a source and extract information from the modulated optical beam;

an optical transmitter assembly communicatively coupled to the smartphone, the optical transmitter assembly adapted to transmit optical beams modulated with digital data, wherein each of the optical receiver assembly and the optical transmitter assembly is a component of the smartphone or a component of a smartphone case physically coupled to the smartphone;

a non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor, causes the smartphone to;

display the extracted information on a graphical user interface;

receive data corresponding to user input at the graphical user interface selecting the displayed information;

in response to receiving the data corresponding to user input at the graphical user interface selecting the extracted descriptive data, generating digital data to be transmitted by the optical transmitter assembly to an optical receiver assembly of the source;

transfer the digital data to the optical transmitter assembly;

display, on the graphical user interface, an augmented reality object corresponding to a transmitting emitting region covered by the optical transmitter assembly, wherein the augmented reality object provides a visual representation of a field of view in which the optical transmitter assembly transmits modulated optical beams; and

display, on the graphical user interface, a visual representation of the source.

9. The system of claim 8, wherein the modulated optical beam is an optical beacon, wherein the information extracted from the modulated optical beam indicates that the source is an optical narrowcasting hotspot, and wherein the generated digital data is a request from the smartphone to access the hotspot.

10. The system of claim 8, wherein the modulated optical beam is an optical signal.

11. The system of claim 8, wherein the optical receiver assembly communicatively coupled to the smartphone is integrated into a smartphone case attached and communicatively coupled to the smartphone, wherein the optical receiver assembly communicatively coupled to the smartphone comprises a lenslet array visible on a surface of the smartphone case.

18. The system of claim 8, wherein the instructions, when executed by the processor, further cause the smartphone to display on a graphical user interface controls for configuring permitted optical communications between the smartphone and the source over an ad-hoc optical network, the permitted communications over the ad-hoc optical network comprising one or more of voice or video calling, text messaging, file transfer, or using an application.

19. The system of claim 8, wherein the first modulated optical beam is received over a distance of at least 400 m at a bit rate of at least 1 MHz.

20. The system of claim 8, wherein the optical receiver assembly communicatively coupled to the smartphone is integrated into the smartphone, wherein the optical receiver assembly communicatively coupled to the smartphone comprises a lenslet array visible on a surface of the smartphone, the lenslet array comprising a plurality of lenslets configured to receive the modulated optical beam.

21. The system of claim 20, wherein the optical receiver assembly communicatively coupled to the smartphone further comprises:

an optical detector array including a plurality of optical detectors, each of the lenslets positioned to concentrate collected flux onto at least one optical detector of the plurality of optical detectors; and

a signal amplifier coupled to the optical detector array and configured to amplify signals received from the optical detector array to create an amplified signal.

22. The system of claim 8, wherein the optical transmitter assembly communicatively coupled to the smartphone comprises:

a light emitting element configured to transmit light comprising the digital data converted to an optical format;

a collimator symmetric about an optical axis substantially centered on the light-emitting element, the collimator comprising a body between a circular entrance pupil and a circular exit pupil, wherein the collimator is positioned to receive light from the light source through the first entrance pupil and emit the light from the exit pupil; and

two or more lenslet arrays positioned in front of the exit pupil of the collimator, wherein the lenslet arrays together act as a homogenizer to improve uniformity of light output from the exit pupil of the collimator.