Embedded barcodes for displaying context relevant information

• US 9,471,824 B2
• Filed: 07/12/2013
• Issued: 10/18/2016
• Est. Priority Date: 07/12/2013
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Finlow-Bates, Keir, Annapureddy, Koushik
• Primary Examiner(s): LE, THIEN MINH
• Application Number:
  US13/941,252
• Publication Number:
  US 20150014417A1
• Time in Patent Office: 1,194 Days
• Field of Search: 23546201-46245, 23547201-47203, 235/375
• US Class Current: 1/1
• CPC Class Codes: G06K 7/1447 extracting optical codes from image or text carrying said optical code
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/6581 Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02

Abstract

Described herein are systems and methods employing embedded barcodes to convey supplemental information about an image, for example a motion picture. In some systems the barcodes may be subliminal because they are spliced, physically or digitally, into a movie frame shown too briefly to be consciously detectable to the human eye, but still detectable by camera sensors. Other described systems may display the barcodes in infrared or ultraviolet light, which is outside of the visible spectrum of light perceived by the human eye, but still detectable by camera sensors.

Claims

1. A system for displaying information to a user, comprising:

an optical sensor configured to detect an optical imperceptible barcode embedded into a video file, the optical imperceptible barcode unnoticeable by a human eye viewing the video file and detectable by the optical sensor; and

a processor coupled to the optical sensor and configured to;

recognize the optical imperceptible barcode,

decode supplemental information associated with the optical imperceptible barcode,

access data representing a user information preference,

compare the supplemental information with the user information preference, and

in response to determining that the supplemental information matches the user information preference, display at least a portion of the supplemental information to the user.

2. The system of claim 1, wherein the optical imperceptible barcode comprises one of a subliminal barcode and a non-visible barcode.

3. The system of claim 1, wherein the optical imperceptible barcode comprises a non-visible barcode, and wherein the non-visible barcode comprises one of ultraviolet and infrared light.

4. The system of claim 3, wherein the ultraviolet or infrared light is superimposed over at least a portion of the video file.

5. The system of claim 1, wherein the optical imperceptible barcode comprises a subliminal barcode, wherein the video file comprises a plurality of frames, and wherein the subliminal barcode is spliced into a barcode frame between a first frame and a subsequent frame of the plurality of frames.

6. The system of claim 5, wherein the subliminal barcode is physically spliced between a first frame and the next frame.

7. The system of claim 5, wherein subliminal barcode is digitally spliced between the first frame and the subsequent frame.

8. The system of claim 5, wherein the barcode frame is displayed while the video is being displayed at 24 frames per second or more.

9. The system of claim 1, wherein the supplemental information comprises one or more of subtitles, closed captioning, and director'"'"'s commentary.

10. The system of claim 1, wherein the user information preference comprises a subtitles language preference.

11. The system of claim 1, wherein the system comprises heads-up display glasses or a head-mounted display.

12. The system of claim 1, wherein the system comprises a wireless phone.

13. A method of displaying embedded information from a video file, comprising:

displaying the video file with an embedded optical imperceptible barcode to a user, wherein the optical imperceptible barcode represents supplemental information about an image, the optical imperceptible barcode unnoticeable by a human eye viewing the video file and detectable by the optical sensor;

detecting the embedded optical imperceptible barcode;

decoding the supplemental information;

retrieving a user information preference;

comparing the supplemental information with the user information preference; and

in response to determining that the supplemental information matches the user information preference, displaying at least a portion of the supplemental information to the user.

14. The method of claim 13, wherein the optical imperceptible barcode comprises one of a subliminal barcode and a non-visible barcode.

15. The method of claim 13, the image comprising a video comprising a plurality of frames, wherein the optical imperceptible barcode comprises a subliminal barcode spliced into a barcode frame between a first frame and a subsequent frame of the plurality of frames.

16. The method of claim 15, wherein displaying the image with the embedded optical imperceptible barcode further comprises displaying the barcode frame at a rate of at least 24 frames per second.

17. The method of claim 13, wherein the optical imperceptible barcode comprises a non-visible barcode comprising infrared or ultraviolet light, wherein the non-visible barcode overlays at least a portion of the image with the infrared or ultraviolet light.

18. A non-transitory computer-readable medium storing instructions which, when executed, cause a processor to:

scan an image, wherein the image comprises an embedded imperceptible barcode representing supplemental information about the image, the embedded imperceptible barcode unnoticeable by a human eye viewing the video file and detectable by the optical sensor;

detect the embedded imperceptible barcode;

decode the supplemental information;

retrieve a user information preference;

compare the supplemental information with the user information preference; and

in response to determining that the supplemental information matches the user information preference, cause at least a portion of the supplemental information to be presented to the user.

19. The non-transitory computer-readable medium of claim 18, wherein the processor further configures a display to present the relevant information to the user.

20. The non-transitory computer-readable medium of claim 18, wherein the processor further configures an auditory element to present the relevant information to the user.

21. A user presentation device for displaying additional information to a user, the user presentation device comprising:

means for scanning a video file comprising embedded imperceptible barcodes representing supplemental information about the image;

means for detecting an embedded imperceptible barcode, the embedded imperceptible barcode unnoticeable by a human eye viewing the video file and detectable by the optical sensor;

means for decoding the supplemental information represented by the barcode;

means for retrieving an information preference of a user and comparing the supplemental information to the information preference;

means for comparing the supplemental information with the user information preference; and

means for presenting at least a portion of the supplemental information to the user in response to the supplemental information matching with the user information preference.

22. The user presentation device of claim 21, wherein the means for scanning an image comprises one or more of a camera or a light source.

23. The user presentation device of claim 21, wherein the means for detecting the embedded imperceptible barcode comprises one or more of a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS), and a photodiode.

24. The user presentation device of claim 21, wherein the means for presenting information to the user comprises an LCD, LED, or touch-sensitive screen.

25. The user presentation device of claim 21, wherein the means for presenting information to the user comprises a heads-up display (HUD) or head-mounted display (HMD).

26. The user presentation device of claim 25, wherein the heads-up display (HUD) or head-mounted display (HMD) comprises a means for projecting the relevant information across at least a portion of a field of view of the user.

27. The user presentation device of claim 21, wherein the means for presenting information to the user comprises at least one of an audio speaker and a headphone jack.