Systems and methods for image processing

• US 10,037,318 B2
• Filed: 01/06/2014
• Issued: 07/31/2018
• Est. Priority Date: 01/03/2014
• Status: Active Grant

• Current Assignee: Yahoo Assets LLC
• Original Assignee: Oath Inc. (Verizon Communications Inc.)
• Inventors: Liu, Agnes
• Primary Examiner(s): SHIN, SEONG-AH A
• Application Number:
  US14/148,569
• Publication Number:
  US 20150193426A1
• Time in Patent Office: 1,667 Days
• Field of Search: 704 9, 704270, 725110, 709204
• CPC Class Codes: G06F 21/1063 Personalisation
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 40/205 Parsing
• CPC Class Codes: G06Q 30/0207 Discounts or incentives, e.g. coupons or rebates
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34

Abstract

Various embodiments of the present disclosure relate to systems and methods for dynamically modifying images based on the content of articles associated with the images, particularly the emotional content of an article. Among other things, embodiments of the present disclosure allow users to quickly and easily identify the emotional nature of an article based on such an image. Characteristics of an image associated with an article may also be modified in response to comments from viewers regarding the article.

Claims

1. A computer-implemented method comprising:

prior to displaying an article on a user device, the article to be displayed on an Internet web page delivered to the user device over a network, analyzing, by a computer system comprising a processor and memory, content in the article to identify emotional content of the article and a digital first image associated with the article, the first image comprising a visual characteristic, the content comprising textual content, the analyzing of the content to identify the emotional content comprises locating a keyword within the textual content that is associated with the emotional content, wherein;

the article contains a second image, and analyzing the article includes performing an image recognition process on the second image to identify content in the second image,

analyzing the article further includes searching for a plurality of keywords within the article, each respective keyword being associated with a respective emotion, and

identifying the emotional content associated with the article includes locating a first keyword associated with a first emotion within the article, locating a second keyword associated with a second emotion within the article, and selecting an emotion for the article based on respective weights assigned to the first keyword and the second keyword;

storing, by the computer system, the article in the memory;

subsequent to analyzing the content in the article, modifying, by the computer system and based on the identified emotional content, the visual characteristic of the first image, wherein the modified visual characteristic of the first image includes one or more of;

a size of the image, a shape of the image, a color of the image, a hue of the image, a tint of the image, a shading of the image, a tone of the image, a saturation of the image, or a lightness of the image;

receiving, from a website hosting the article, a comment regarding the article, the comment made by a viewer of the article;

analyzing the comment regarding the article; and

modifying a characteristic of the first image based on analyzing the comment, wherein the characteristic modified is a different characteristic than the characteristic modified based on the identified emotional content; and

transmitting, by the computer system over the network, the modified first image to the user device for display via a display of the user device.

2. The method of claim 1, wherein the second image contained in the article is part of a video.

3. The method of claim 1, wherein the first image and the second image are the same image, and the article contains the first image.

4. The method of claim 1, wherein the article contains audio, and wherein analyzing the article further includes performing a recognition process on the audio to identify content in the audio.

5. The method of claim 1, further comprising:

analyzing content of a plurality of articles to identify a respective emotion associated with each of the plurality of articles;

modifying a characteristic of a plurality of images, each image associated with a respective article from the plurality of articles, wherein the characteristic for each image is modified based on the identified emotional content for each respective article; and

presenting the plurality of images to a user.

6. The method of claim 5, wherein each of the plurality of images are presented together in a single display provided to the user via the user device.

7. The method of claim 5, wherein modifying the characteristics in the plurality of images includes modifying a first characteristic in a third image in the plurality of images, and modifying a second characteristic in a fourth image in the plurality of images, wherein the first characteristic is different from the second characteristic.

8. The method of claim 1, wherein the first image is further modified based on a volume of comments regarding the article from a plurality of viewers.

9. The method of claim 8, wherein the first image is further modified based on one or more keywords located in comments regarding the article from the plurality of viewers.

10. The method of claim 9, wherein the one or more keywords are associated with one or more of:

a viewer'"'"'s approval of the article, a viewer'"'"'s disapproval of the article, or an emotion conveyed by the viewer regarding the article.

11. A tangible, non-transitory computer-readable medium storing instructions that, when executed by a processor of a computer system, cause the computer system to:

prior to displaying an article on a user device, the article to be displayed on an Internet web page delivered to the user device over a network, analyze content in the article to identify emotional content of the article and a digital first image associated with the article, the first image comprising a visual characteristic, the content comprising textual content, the analyzing of the content to identify the emotional content comprises locating a keyword within the textual content that is associated with the emotional content, wherein;

the article contains a second image, and analyzing the article includes performing an image recognition process on the second image to identify content in the second image,

analyzing the article further includes searching for a plurality of keywords within the article, each respective keyword being associated with a respective emotion, and

identifying the emotional content associated with the article includes locating a first keyword associated with a first emotion within the article, locating a second keyword associated with a second emotion within the article, and selecting an emotion for the article based on respective weights assigned to the first keyword and the second keyword;

store the article in a memory of the computer system;

subsequent to analyzing the content in the article, modify, based on the identified emotional content, the visual characteristic of the first image, wherein the modified visual characteristic of the first image includes one or more of;

a size of the image, a shape of the image, a color of the image, a hue of the image, a tint of the image, a shading of the image, a tone of the image, a saturation of the image, or a lightness of the image;

receive, from a website hosting the article, a comment regarding the article, the comment made by a viewer of the article;

analyze the comment regarding the article; and

modify a characteristic of the first image based on analyzing the comment, wherein the characteristic modified is a different characteristic than the characteristic modified based on the identified emotional content; and

transmit, over the network by the computer system, the modified first image to the user device for display via a display of the user device.

12. A system comprising:

a processor; and

a storage medium in communication with the processor for tangibly storing thereon computer instructions that, when executed by the processor, cause the system to;

prior to displaying an article on a user device, the article to be displayed on an Internet web page delivered to the user device over a network, analyze content in the article to identify emotional content of the article and a digital first image associated with the article, the first image comprising a visual characteristic, the content comprising textual content, the analyzing of the content to identify the emotional content comprises locating a keyword within the textual content that is associated with the emotional content, wherein;

the article contains a second image, and analyzing the article includes performing an image recognition process on the second image to identify content in the second image,

analyzing the article further includes searching for a plurality of keywords within the article, each respective keyword being associated with a respective emotion, and

identifying the emotional content associated with the article includes locating a first keyword associated with a first emotion within the article, locating a second keyword associated with a second emotion within the article, and selecting an emotion for the article based on respective weights assigned to the first keyword and the second keyword;

store the article in the storage medium;

subsequent to analyzing the content in the article, modify, based on the identified emotional content, a visual characteristic of the first image, wherein the modified visual characteristic of the first image includes one or more of;

a size of the image, a shape of the image, a color of the image, a hue of the image, a tint of the image, a shading of the image, a tone of the image, a saturation of the image, or a lightness of the image;

receive, from a website hosting the article, a comment regarding the article, the comment made by a viewer of the article;

analyze the comment regarding the article; and

modify a characteristic of the first image based on analyzing the comment, wherein the characteristic modified is a different characteristic than the characteristic modified based on the identified emotional content; and

transmit, over the network by the processor, the modified first image to the user device for display via a display of the user device.