Methods and apparatus for nonintrusive monitoring of web browser usage

• US 9,602,371 B2
• Filed: 07/14/2014
• Issued: 03/21/2017
• Est. Priority Date: 04/11/2008
• Status: Active Grant

• Current Assignee: The Nielsen Company LLC (MOOD Media Corporation)
• Original Assignee: The Nielsen Company LLC (MOOD Media Corporation)
• Inventors: Lee, Morris
• Primary Examiner(s): NGUYEN, MINH CHAU
• Application Number:
  US14/330,655
• Publication Number:
  US 20140330963A1
• Time in Patent Office: 981 Days
• Field of Search: 709/218, 709223-224
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3495 for systems
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/1452 based on positionally close symbols, e.g. amount sign or URL-specific characters
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44224 Monitoring of user activity on external systems, e.g. Internet browsing
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

Example methods disclosed herein for monitoring web browsing include processing a video image obtained from a video signal of a device implementing a web browser to identify a first image region less than the entire video image, the first image region having a first shape corresponding to an address bar of the web browser. Disclosed example methods also include tagging first textual information identified in the first image region as corresponding to an address of a web page displayed by the web browser in response to determining that the first textual information includes a first string of text matching a reference string of text. Disclosed example methods further include reporting the tagged first textual information to determine usage of the web browser.

Claims

1. A method for monitoring web browsing, the method comprising:

processing, by executing an instruction with a processor, a video image obtained from a video signal of a device implementing a web browser to identify a first image region less than the entire video image, the first image region having a first shape corresponding to an address bar of the web browser;

tagging, by executing an instruction with the processor, first textual information identified in the first image region as corresponding to an address of a web page displayed by the web browser in response to determining that the first textual information includes a first string of text matching a reference string of text; and

reporting the tagged first textual information to determine usage of the web browser.

2. The method as defined in claim 1, further including:

identifying a second image region of the video image having a second shape corresponding to a title bar of the web browser;

tagging second textual information identified in the second image region as corresponding to a title of the web page displayed by the web browser in response to determining that the second image region has a first position relative to the first image region; and

reporting the tagged first textual information and the tagged second textual information to determine usage of the web browser.

3. The method as defined in claim 2, wherein tagging the second textual information includes tagging the second textual information identified in the second image region as corresponding to the title of the web page displayed by the web browser in response to determining that the second image region is positioned above the first image region.

4. The method as defined in claim 2, further including:

tagging the first image region as corresponding to the address bar of the web browser; and

tagging the second image region as corresponding to the title bar of the web browser.

5. The method as defined in claim 1, wherein the reference string of text corresponds to at least one of:

(1) a uniform resource locator (URL) scheme, (2) a start of a URL, (3) a domain suffix, (4) a sequence of at least two strings of text separated by one or more periods, or (5) a numeric internet protocol (IP) address format.

6. A tangible computer readable storage device or storage disk comprising computer readable instructions which, when executed, cause a computing device to at least:

process a video image obtained from a video signal of a device implementing a web browser to identify a first image region less than the entire video image, the first image region having a first shape corresponding to an address bar of the web browser;

tag first textual information identified in the first image region as corresponding to an address of a web page displayed by the web browser in response to determining that the first textual information includes a first string of text matching a reference string of text; and

report the tagged first textual information to determine usage of the web browser.

7. The storage device or storage disk as defined in claim 6, wherein the instructions, when executed, further cause the computing device to:

identify a second image region of the video image having a second shape corresponding to a title bar of the web browser;

tag second textual information identified in the second image region as corresponding to a title of the web page displayed by the web browser in response to determining that the second image region has a first position relative to the first image region; and

report the tagged first textual information and the tagged second textual information to determine usage of the web browser.

8. The storage device or storage disk as defined in claim 7, wherein the instructions, when executed, further cause the computing device to tag the second textual information identified in the second image region as corresponding to the title of the web page displayed by the web browser in response to determining that the second image region is positioned above the first image region.

9. The storage device or storage disk as defined in claim 7, wherein the instructions, when executed, further cause the computing device to:

tag the first image region as corresponding to the address bar of the web browser; and

tag the second image region as corresponding to the title bar of the web browser.

10. The storage device or storage disk as defined in claim 6, wherein the reference string of text corresponds to at least one of:

(1) a uniform resource locator (URL) scheme, (2) a start of a URL, (3) a domain suffix, (4) a sequence of at least two strings of text separated by one or more periods, or (5) a numeric internet protocol (IP) address format.

11. An apparatus for monitoring web browsing, the apparatus comprising:

a computer processor;

a graphical recognition processor to process a video image obtained from a video signal of a device implementing a web browser to identify a first image region less than the entire video image, the first image region having a first shape corresponding to an address bar of the web browser;

a textual recognition processor to tag first textual information identified in the first image region as corresponding to an address of a web page displayed by the web browser in response to determining that the first textual information includes a first string of text matching a reference string of text; and

a network interface report the tagged first textual information to determine usage of the web browser, at least one of the graphical recognition processor, the textual recognition processor or the network interface being implemented by the computer processor.

12. The apparatus as defined in claim 11, wherein:

the graphical recognition processor is further to identify a second image region of the video image having a second shape corresponding to a title bar of the web browser;

the textual recognition processor is further to tag second textual information identified in the second image region as corresponding to a title of the web page displayed by the web browser in response to determining that the second image region has a first position relative to the first image region; and

the network interface is further to report the tagged first textual information and the tagged second textual information to determine usage of the web browser.

13. The apparatus as defined in claim 12, wherein the textual recognition processor is further to tag the second textual information identified in the second image region as corresponding to the title of the web page displayed by the web browser in response to determining that the second image region is positioned above the first image region.

14. The apparatus as defined in claim 12, wherein the textual recognition processor is further to:

tag the first image region as corresponding to the address bar of the web browser; and

tag the second image region as corresponding to the title bar of the web browser.

15. The apparatus as defined in claim 11, wherein the reference string of text corresponds to at least one of:

(1) a uniform resource locator (URL) scheme, (2) a start of a URL, (3) a domain suffix, (4) a sequence of at least two strings of text separated by one or more periods, or (5) a numeric internet protocol (IP) address format.

16. A method to monitor web browsing, the method comprising:

determining, by executing an instruction with a processor, color scheme information for a region of a captured image including at least a portion of a web page displayed by a web browser implemented by a monitored device, the color scheme information including a histogram representative of respective numbers of pixels in the region having respective colors from a set of colors of interest; and

comparing, by executing an instruction with the processor, the color scheme information to reference color schemes associated with respective reference web pages to identify, based on the color scheme information, a web site accessed using the web browser.

17. A tangible computer readable storage device or storage disk comprising computer readable instructions which, when executed, cause a computing device to at least:

determine color scheme information for a region of a captured image including at least a portion of a web page displayed by a web browser implemented by a monitored device, the color scheme information including a histogram representative of respective numbers of pixels in the region having respective colors from a set of colors of interest; and

compare the color scheme information to reference color schemes associated with respective reference web pages to identify, based on the color scheme information, a web site accessed using the web browser.

18. An apparatus to monitor web browsing, the apparatus comprising:

means for determining color scheme information for a region of a captured image including at least a portion of a web page displayed by a web browser implemented by a monitored device, the color scheme information including a histogram representative of respective numbers of pixels in the region having respective colors from a set of colors of interest; and

means for comparing the color scheme information to reference color schemes associated with respective reference web pages to identify, based on the color scheme information, a web site accessed using the web browser.