Graphical user interface systems and methods for optical narrowcasting

• US 9,967,469 B2
• Filed: 09/13/2017
• Issued: 05/08/2018
• Est. Priority Date: 12/30/2015
• Status: Active Grant

• Current Assignee: Aron Surefire, LLC
• Original Assignee: SureFire LLC (Surefire Holdings LLC)
• Inventors: Shatz, Narkis E., Bortz, John C.
• Primary Examiner(s): Pasiewicz, Daniel M
• Application Number:
  US15/703,876
• Publication Number:
  US 20180054571A1
• Time in Patent Office: 237 Days
• Field of Search: None
• CPC Class Codes: G02B 13/0015 characterised by the lens design
• CPC Class Codes: G02B 19/0009 having refractive surfaces only
• CPC Class Codes: G02B 19/0023 at least one surface having optical power
• CPC Class Codes: G02B 19/009 for use with infrared radiation
• CPC Class Codes: G02B 19/0095 for use with ultraviolet radiation
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06Q 30/0277 Online advertisement
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G08C 23/04 using light waves, e.g. infrared
• CPC Class Codes: H04B 10/11 Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
• CPC Class Codes: H04B 10/114 Indoor or close-range type systems
• CPC Class Codes: H04B 10/1141 One-way transmission
• CPC Class Codes: H04B 10/1143 : Bidirectional transmission
• CPC Class Codes: H04B 10/116 : Visible light communication
• CPC Class Codes: H04B 10/50 : Transmitters
• CPC Class Codes: H04B 10/516 : Details of coding or modulation
• CPC Class Codes: H04B 10/5162 : Return-to-zero modulation schemes
• CPC Class Codes: H04B 10/541 : Digital intensity or amplitude modulation
• CPC Class Codes: H04B 10/60 : Receivers
• CPC Class Codes: H04B 10/615 : Arrangements affecting the optical part of the receiver
• CPC Class Codes: H04B 10/616 : Details of the electronic signal processing in coherent optical receivers
• CPC Class Codes: H04B 10/66 : Non-coherent receivers, e.g. using direct detection
• CPC Class Codes: H04B 10/697 : Arrangements for reducing noise and distortion
• CPC Class Codes: H04B 17/23 : Indication means, e.g. displays, alarms, audible means
• CPC Class Codes: H04M 1/72403 : with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/737 : Characterised by transmission of electromagnetic waves other than radio waves, e.g. infrared waves
• CPC Class Codes: H04N 21/4126 : The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/42204 : User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 23/62 : Control of parameters via user interfaces
• CPC Class Codes: H04N 23/69 : Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/71 : Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 5/272 : Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 7/22 : Adaptations for optical transmission
• CPC Class Codes: H04W 4/21 : for social networking applications
• CPC Class Codes: H04W 8/005 : Discovery of network devices, e.g. terminals
• CPC Class Codes: H04W 84/18 : Self-organising networks, e.g. ad-hoc networks or sensor networks
• CPC Class Codes: H04W 88/16 : Gateway arrangements

Abstract

Systems and methods for optical narrowcasting are provided for transmitting various types of content. Optical narrowcasting content indicative of the presence of additional information along with identifying information may be transmitted. The additional information (which may include meaningful amounts of advertising information, media, or any other content) may also be transmitted as optical narrowcasting content. Elements of an optical narrowcasting system may include optical transmitters and optical receivers which can be configured to be operative at distances ranging from, e.g., 400 meters to 1200 meters. Moreover, the elements can be implemented on a miniaturized scale in conjunction with small, user devices such as smartphones, thereby also realizing optical ad-hoc networking, as well as interoperability with other types of data networks. Optically narrowcast content can be used to augment a real-world experience, enhance and/or spawn new forms of social-media and media content.

Claims

1. A method, comprising:

initializing, on a mobile device, an application for displaying information extracted from a modulated optical beam by an optical receiver communicatively coupled to the mobile device;

displaying, on a graphical user interface of the application, a live display of a field of view (FOV) of a video camera of the mobile device;

detecting an optical beacon within a FOV of an optical beacon receiver communicatively coupled to the mobile device;

extracting identification information from the optical beacon;

determining an angular position of a source of the optical beacon; and

based on the extracted identification information and determined angular position, rendering, on the graphical user interface, a visual representation of the beacon'"'"'s source overlaid over the live display of the FOV of the camera, wherein the visual representation of the beacon'"'"'s source visually represents a location of the source relative to the live display of the FOV of the camera.

2. The method of claim 1, wherein the angular position of the source of the optical beacon is determined using at least positioning information transmitted in the beacon.

3. The method of claim 2, wherein the positioning information comprises latitude and longitude information of the source of the optical beacon.

4. The method of claim 3, wherein the angular position of the source of the optical beacon is determined using at least a measured propagation direction of the optical beacon relative to the FOV of the optical beacon receiver.

5. The method of claim 1, wherein the angular position of the source of the optical beacon is determined using at least a measured propagation direction of the optical beacon relative to the FOV of the optical beacon receiver.

6. The method of claim 1, wherein the extracted identification information identifies a name and category of the source of the beacon, and wherein the method further comprises:

based on the extracted identification information, rendering, on the graphical user interface, an icon visually representing the beacon'"'"'s source overlaid over the live display of the FOV of the camera, wherein the icon is based on the extracted category of the source.

7. The method of claim 1, further comprising:

storing the extracted identification information from the optical beacon in a persistent storage such that the optical beacon receiver does not need to redetect the beacon in order for a visual representation of the beacon'"'"'s source to be rendered during a subsequent session of the application.

8. The method of claim 1, wherein the optical receiver is an optical signal receiver.

9. The method of claim 8, wherein the optical signal receiver is a component of an optical receiver assembly comprising the optical signal receiver and the optical beacon receiver, wherein a FOV of the optical signal receiver is less than a FOV of the optical beacon receiver.

10. The method of claim 8, further comprising:

receiving data corresponding to user input selecting the visual representation of the beacon'"'"'s source; and

in response to receiving the data, determining if descriptive information associated with the beacon'"'"'s source is available in a storage communicatively coupled to the mobile device.

11. The method of claim 10, further comprising:

determining that the descriptive information associated with the beacon'"'"'s source is available in the storage;

retrieving the descriptive information from the storage; and

displaying the retrieved descriptive information on the graphical user interface.

12. The method of claim 10, further comprising:

determining that the descriptive information associated with the beacon'"'"'s source is not available in the storage; and

in response to determining that the descriptive information associated with the beacon'"'"'s source is not available in the storage, determining if an optical signal transmitted by the beacon'"'"'s source is within a FOV of the optical signal receiver.

13. The method of claim 8, further comprising:

receiving, at the optical signal receiver, an optical signal transmitted by the beacon'"'"'s source;

extracting descriptive information from the received optical signal; and

displaying the extracted descriptive information on the graphical user interface, wherein the descriptive information extracted from the received optical signal comprises at least one of video data, audio data, or textual data.

14. The method of claim 13, wherein the descriptive information extracted from the received optical signal comprises a control for initiating a request to the source, wherein the method further comprises:

receiving data corresponding to user input selecting the control; and

in response to receiving the data, transmitting an optical signal to the source.

15. The method of claim 14, wherein the optical signal transmitted to the source is modulated with information making an order request for a product.

16. The method of claim 14, wherein the optical signal transmitted to the source is modulated with information making a request for additional information from the source.

17. A non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor, causes a system to:

initialize an application for displaying information extracted from a modulated optical beam by an optical receiver communicatively coupled to a mobile device;

display, on a graphical user interface of the application, a live display of a field of view (FOV) of a video camera of the mobile device;

detect an optical beacon within a FOV of an optical beacon receiver communicatively coupled to the mobile device;

extract identification information from the optical beacon;

determine an angular position of a source of the optical beacon; and

based on the extracted identification information and determined angular position, rendering, on the graphical user interface, a visual representation of the beacon'"'"'s source overlaid over the live display of the FOV of the camera, wherein the visual representation of the beacon'"'"'s source visually represents a location of the source relative to the live display of the FOV of the camera.

18. The non-transitory computer-readable medium of claim 17, wherein the angular position of the source of the optical beacon is determined using at least positioning information transmitted in the optical beacon, wherein the positioning information comprises latitude and longitude information of the source of the optical beacon.

19. The non-transitory computer-readable medium of claim 17, wherein the angular position of the source of the optical beacon is determined using at least a measured propagation direction of the optical beacon relative to the FOV of the optical beacon receiver.

20. The non-transitory computer-readable medium of claim 17, wherein the extracted identification information identifies a name and category of the source of the beacon, and wherein the instructions, when executed by the processor, further cause the system to:

based on the extracted identification information, render, on the graphical user interface, an icon visually representing the beacon'"'"'s source overlaid over the live display of the FOV of the camera, wherein the icon is based on the extracted category of the source.

21. The non-transitory computer-readable medium of claim 17, wherein the instructions, when executed by the processor, further cause the system to:

store the extracted identification information from the optical beacon in a persistent storage such that the optical beacon receiver does not need to redetect the beacon in order for a visual representation of the beacon'"'"'s source to be rendered during a subsequent session of the application.

22. The non-transitory computer-readable medium of claim 17, wherein the optical receiver is an optical signal receiver.

23. The non-transitory computer-readable medium of claim 22, wherein the instructions, when executed by the processor, further cause the system to:

receive data corresponding to user input selecting the visual representation of the beacon'"'"'s source; and

in response to receiving the data, determine if descriptive information associated with the beacon'"'"'s source is available in a storage communicatively coupled to the mobile device.

24. The non-transitory computer-readable medium of claim 23, wherein the instructions, when executed by the processor, further cause the system to:

determine that the descriptive information associated with the beacon'"'"'s source is available in the storage;

retrieve the descriptive information from the storage; and

display the retrieved descriptive information on the graphical user interface.

25. The non-transitory computer-readable medium of claim 23, wherein the instructions, when executed by the processor, further cause the system to:

determine that the descriptive information associated with the beacon'"'"'s source is not available in the storage; and

in response to determining that the descriptive information associated with the beacon'"'"'s source is not available in the storage, determine if an optical signal transmitted by the beacon'"'"'s source is within a FOV of the optical signal receiver.

26. The non-transitory computer-readable medium of claim 22, wherein the instructions, when executed by the processor, further cause the system to:

receive, at the optical signal receiver, an optical signal transmitted by the beacon'"'"'s source;

extract descriptive information from the received optical signal; and

display the extracted descriptive information on the graphical user interface, wherein the descriptive information extracted from the received optical signal comprises at least one of video data, audio data, or textual data.

27. The non-transitory computer-readable medium of claim 26, wherein the descriptive information extracted from the received optical signal comprises a control for initiating a request to the source, wherein the instructions, when executed by the processor, further cause the system to:

transmit an optical signal to the source in response to receiving data corresponding to user input selecting the control.

28. The non-transitory computer-readable medium of claim 27, wherein the optical signal transmitted to the source is modulated with information making an order request for a product.

29. The non-transitory computer-readable medium of claim 27, wherein the optical signal transmitted to the source is modulated with information making a request for additional information from the source.

30. A system, comprising:

an optical beacon receiver;

a mobile device communicatively coupled to the optical beacon receiver, the mobile device comprising;

a video camera;

a processor; and

a non-transitory computer-readable medium having instructions stored thereon that, when executed by the processor, causes the mobile device to;

initialize an application for displaying information extracted from a modulated optical beam;

display, on a graphical user interface of the application, a live display of a field of view (FOV) of the video camera;

detect an optical beacon within a FOV of the optical beacon receiver;

extract identification information from the optical beacon;

determine an angular position of a source of the optical beacon; and

based on the extracted identification information and determined angular position, rendering, on the graphical user interface, a visual representation of the beacon'"'"'s source overlaid over the live display of the FOV of the camera, wherein the visual representation of the beacon'"'"'s source visually represents a location of the source relative to the live display of the FOV of the camera.