Method for more efficient collecting of information

• US 8,826,340 B2
• Filed: 10/12/2012
• Issued: 09/02/2014
• Est. Priority Date: 10/14/2011
• Status: Active Grant

• Current Assignee: Symbol Shifters LLC
• Original Assignee: Symbol Shifters LLC
• Inventors: Ciciora, Walter Stanley, Hartson, Ted Elliott, Brown, Elijah Ethan
• Primary Examiner(s): Pendleton, Brian T
• Assistant Examiner(s): Lewis, Jonathan V
• Application Number:
  US13/650,425
• Publication Number:
  US 20130139195A1
• Time in Patent Office: 690 Days
• Field of Search: None
• US Class Current: 725/51
• CPC Class Codes: H04H 60/31 Arrangements for monitoring the use made of the broadcast services
• CPC Class Codes: H04H 60/33 Arrangements for monitoring the users' behaviour or opinions
• CPC Class Codes: H04H 60/46 for recognising users' preferences
• CPC Class Codes: H04H 60/56 Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
• CPC Class Codes: H04H 60/59 of video recognising characters or patterns in general G06F18/00, G06V20/00
• CPC Class Codes: H04N 1/32149 Methods relating to embedding, encoding, decoding, detection or retrieval operations
• CPC Class Codes: H04N 21/258 Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data arrangements for services using the result on the distributing side of broadcast systems H04H60/66; profiles in network data switching protocols H04L67/30
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/632 using a connection between clients on a wide area network, e.g. setting up a peer-to-peer communication via Internet for retrieving video segments from the hard-disk of other client devices broadcast-related systems characterised by transmission among terminal devices H04H60/80; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

Apparatus and processes for locating and processing QR codes or other Scannable Icons (SI'"'"'s) in video or television signals. A number of client elements (which may correspond to users) may be in communication of one or more control elements; the client elements may be found in user set top boxes, digital video recorders or other equipment employed to receive video or television signals. The control elements may be found in software in server platforms or such user equipment. The client elements may locate and decode SI'"'"'s according to various areas of interest of users. The control elements may control which client elements monitor various video or television signals; receive information related to decoded SI'"'"'s; and report information to client elements so that (among other things) users can be aware of SI'"'"'s in far more video or television signals than their own client elements are able to monitor.

Claims

1. A network for processing and managing information related to graphical bar code data that generates graphical bar codes in video images, wherein the graphical bar codes are QR codes or one dimensional bar codes, and wherein the graphical bar codes can be acquired and decoded optically by a mobile device from a monitor that displays the graphical bar codes in the video images, the graphical bar code data located and decoded by receivers under control of at least one control element, the network including:

a receiver coupled to a monitor that displays video images to a subscriber, the receiver receiving input from the subscriber as to at least one area of interest as to which the subscriber desires to obtain information, and the receiver including;

one or more graphical bar code data locators, wherein each graphical bar code data locater is coupled to a video source and parses video signals from the video source to locate the graphical bar code data in the video signals;

one or more graphical bar code data decoders, each graphical bar code data decoder coupled to a graphical bar code data locater to decode the graphical bar code data;

wherein the locating and decoding of the graphical bar code data is accomplished without optically acquiring or decoding the graphical bar codes in video images generated by the graphical bar code data;

one or more graphical bar code data processors, each graphical bar code data processor coupled to a graphical bar code data locater; and

at least one client element coupled to at least one of the graphical bar code data processors, wherein the at least one client element;

connects via an external network to at least one control element to receive instructions from the at least one control element as to particular video signals and areas of interest that should be monitored by the receiver that includes the client element;

instructs one or more of the graphical bar code data processors to automatically monitor the particular video signals and areas of interest as to which the client element has received instructions from the control element, in order to locate and decode the graphical bar code data in the video signals; and

reports via an external network at least some information relating to the located and decoded graphical bar code data to the at least one control element.

2. A network according to claim 1 wherein the receiver is a set top box and the video signals are television signals.

3. A network according to claim 1 wherein the receiver is a set top box and the graphical bar code data are data that generate QR codes or bar codes that include a plurality of rectangles or squares.

4. A network according to claim 1 wherein the receiver is a set top box and at least some of the client elements are implemented in software.

5. A network according to claim 1 wherein the receiver is a set top box and monitors at least some video signals regardless of whether a monitor connected to the receiver is in an on or off state.

6. A network according to claim 1 wherein the receiver is connected to one or more devices for parsing multiple signals.

7. A network according to claim 1 wherein third parties have access to the at least one control element in order to input information.

8. A network according to claim 7 wherein the at least one control element reports to third parties information corresponding to the subscriber'"'"'s selection of graphical bar codes supplied by the third parties.

9. A network according to claim 1 wherein techniques for identifying advertisements in video signals are employed to assist in location of graphical bar code data in the video signals.

10. A network according to claim 1 further comprising subscriber presentation functionality in communication with the at least one control element, and wherein the at least one control element reports to the subscriber presentation functionality, for the subscriber, information relating to graphical bar codes in the subscriber'"'"'s area of interest for which graphical bar code data have been located and decoded in the subscriber'"'"'s receiver.

11. A network according to claim 10 wherein the subscriber presentation functionality is implemented in a server to which the subscriber has internet access.

12. A network according to claim 10 wherein the subscriber presentation functionality is implemented in at least one client element.

13. A network according to claim 10 further comprising reporting functionality connected to the at least one control element or the subscriber presentation functionality, wherein the reporting functionality reports to a third party information about the subscriber'"'"'s selection of graphical bar codes.

14. A network according to claim 10 further comprising reporting functionality connected to the at least one control element, wherein the reporting functionality reports to a third party that graphical bar code data have appeared in a video signal.

15. A network according to claim 1 wherein at least some information related to the graphical bar code data includes information not included in the graphical bar code data, but is relevant to the context of the graphical bar code data.

16. A network according to claim 1 wherein information related to the graphical bar code data includes at least some of the address of a client element, address of a control element, identifying information about a graphical bar code, at least a portion of a video signal containing graphical bar code data, area of interest relating to a graphical bar code, time graphical bar code data were contained in a video signal, what channel included graphical bar code data, what television program included a graphical bar code, a graphical representation of a graphical bar code, and metadata relating to a graphical bar code.

17. A network according to claim 1 wherein the at least one control element instructs, via broadcast messages, at least some of the client elements as to which video signals and areas of interest should be monitored by the receiver.

18. A network according to claim 1 wherein the at least one control element directs, via addressed messages to client elements, at least some of the client elements as to which video signals and areas of interest should be monitored by the receiver.

19. A network according to claim 1 wherein at least some AOI'"'"'s are generated based at least in part on actions by the subscriber.

20. A network according to claim 1 wherein at least some AOI'"'"'s are supplied to the at least one control element via at least one third party supplier and based on inferences drawn by the at least one supplier about the subscriber'"'"'s preferences.

21. A network according to claim 1 wherein the network makes available to the subscriber information about graphical bar codes, graphical bar code data for which are included in video signals not being monitored by the subscriber'"'"'s receiver.

22. A receiver for inclusion in a network, the network for processing and managing information related to graphical bar code data that generates graphical bar codes in video images, wherein the graphical bar codes are QR codes or one dimensional bar codes, and wherein the graphical bar codes can be acquired and decoded optically by a mobile device from a monitor that displays the graphical bar codes in the video images,

the receiver coupled to a subscriber monitor that displays video images to a subscriber, the receiver receiving input from the subscriber as to at least one area of interest as to which the subscriber desires to obtain information, the receiver including:

one or more graphical bar code data locators, wherein each graphical bar code data locater is coupled to a video source and parses video signals from the video source to locate the graphical bar code data in the video signals;

one or more graphical bar code data decoders, each graphical bar code data decoder coupled to a graphical bar code data locater to decode the graphical bar code data;

wherein the locating and decoding of the graphical bar code data is accomplished without optically acquiring or decoding the graphical bar codes in video images generated by the graphical bar code data;

one or more graphical bar code data processors, each graphical bar code data processor coupled to a graphical bar code data locater; and

at least one client element coupled to at least one of the graphical bar code data processors, wherein the at least one client element;

connects via an external network to at least one control element to receive instructions from the at least one control element as to particular video signals and areas of interest that should be monitored by the receiver that includes the client element;

instructs one or more of the graphical bar code data processors to automatically monitor the particular video signals and areas of interest as to which the client element has received instructions from the control element, in order to locate and decode the graphical bar code data in the video signals; and

reports via an external network at least some information relating to the located and decoded graphical bar code data to the at least one control element.

23. A receiver according to claim 22 wherein the receiver is a set top box and the video signals are television signals.

24. A receiver according to claim 22 wherein the receiver is a set top box and the graphical bar code data are data that generate QR codes or bar codes that include a plurality of rectangles or squares.

25. A receiver according to claim 22 wherein the receiver is a set top box and at least one client element is implemented in software.

26. A receiver according to claim 22 that is a set top box that monitors at least some video signals regardless of whether a monitor connected to the receiver is in an on or off state.

27. A receiver according to claim 22 that connects to one or more devices for parsing multiple signals.

28. A receiver according to claim 22 wherein third parties have access to the at least one control element in order to input information.

29. A receiver according to claim 22 wherein at least some information related to graphical bar code data includes information not included in graphical bar code data, but relevant to the context of the graphical bar code data.

30. A receiver according to claim 22 wherein information related to detected graphical bar code data includes at least some of the address of the client element, address of a control element, identifying information about a graphical bar code, at least a portion of a video signal containing graphical bar code data, area of interest relating to a graphical bar code, time graphical bar code data were contained in a video signal, what channel included graphical bar code data, what television program included a graphical bar code, a graphical representation of a graphical bar code, and metadata relating to a graphical bar code.

31. A receiver according to claim 22 wherein the at least one client element learns information about how to locate graphical bar code data based on at least one previous location of graphical bar code data.

32. A receiver according to claim 22 wherein the at least one client element learns and reports to the at least one control element information about the subscriber'"'"'s area of interest based on the subscriber'"'"'s viewing of information relating to graphical bar codes.

33. A method for processing and managing information related to graphical bar codes in video images, wherein the graphical bar codes are QR codes or one dimensional bar codes, and wherein the graphical bar codes can be acquired and decoded optically by a mobile device from a monitor that displays the graphical bar codes in the video images, the method including the steps of:

providing a receiver connected to at least one control element, the receiver coupled to a subscriber monitor that displays video images to a subscriber, the receiver receiving input from the subscriber as to at least one area of interest as to which the subscriber desires to obtain information, the receiver including;

one or more graphical bar code data locators, wherein each graphical bar code data locater is coupled to a video source and parses video signals from the video source to locate the graphical bar code data in the video signals;

one or more graphical bar code data decoders, each graphical bar code data decoder coupled to a graphical bar code data locater to decode the graphical bar code data;

wherein the locating and decoding of the graphical bar code data is accomplished without optically acquiring or decoding the graphical bar codes in video images generated by the graphical bar code data;

one or more graphical bar code data processors, each graphical bar code data processor coupled to a graphical bar code data locater; and

at least one client element coupled to at least one of the graphical bar code data processors, wherein the at least one client element;

connects via an external network to at least one control element to receive instructions from the at least one control element as to particular video signals and areas of interest that should be monitored by the receiver that includes the client element;

instructs one or more of the graphical bar code data processors to automatically monitor the particular video signals and areas of interest as to which the client element has received instructions from the control element, in order to locate and decode the graphical bar code data in the video signals; and

reports via an external network at least some information relating to the located and decoded graphical bar code data to the at least one control element;

receiving, by the at least one client element and via an external network, instructions from the at least one control element as to particular video signals and areas of interest that should be monitored by the receiver;

instructing, by the at least one client element, one or more of the graphical bar code data processors to automatically monitor the particular video signals and areas of interest as to which the at least one client element has received instructions from the at least one control element, in order to detect and decode graphical bar code data in the video signals; and

reporting, by the at least one client element and via an external network, least some information relating to detected graphical bar code data to the at least one control element.

34. A method according to claim 33 wherein the receiver is a set top box and the video signals are television signals.

35. A method according to claim 33 wherein the receiver is a set top box and the graphical bar code data are data that generate QR codes or bar codes that include a plurality of rectangles or squares.

36. A method according to claim 33 wherein the receiver is a set top box and one or more client elements are implemented in software.

37. A method according to claim 33 further comprising monitoring at least some video signals regardless of whether a monitor connected to the receiver is in an on or off state.

38. A method according to claim 33 wherein the receiver is connected to one or more devices for parsing multiple signals.

39. A method according to claim 33 wherein at least one control element gives third parties access to the control element in order to input information.

40. A method according to claim 33 wherein at least some information relating to graphical bar code data includes information not included in graphical bar code data, but relevant to the context of the graphical bar code data.

41. A method according to claim 33 wherein information related to detected graphical bar code data includes at least some of the address of the client element, address of a control element, identifying information about a graphical bar code, at least a portion of a video signal containing graphical bar code data, area of interest relating to a graphical bar code, time graphical bar code data were contained in a video signal, what channel included graphical barcode data, what television program included a graphical bar code, a graphical representation of a graphical bar code, and metadata relating to a graphical bar code.