Method and apparatus for providing search capability and targeted advertising for audio, image, and video content over the internet

• US 9,947,025 B2
• Filed: 01/06/2016
• Issued: 04/17/2018
• Est. Priority Date: 07/20/2006
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Ho, Edwin
• Primary Examiner(s): ALBERTALLI, BRIAN LOUIS
• Application Number:
  US14/989,174
• Publication Number:
  US 20160117729A1
• Time in Patent Office: 832 Days
• CPC Class Codes: G06F 16/24573 using data annotations, e.g. user-defined metadata
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/685 using automatically derived transcript of audio data, e.g. lyrics speech recognition G10L15/00
• CPC Class Codes: G06F 16/7335 Graphical querying, e.g. query-by-region, query-by-sketch, query-by-trajectory, GUIs for designating a person/face/object as a query predicate end-user interface involving hot spots associated with the video H04N21/4725; end-user interface for selecting a Region of Interest H04N21/4728
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/784 the detected or recognised objects being people
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0256 User search
• CPC Class Codes: G06Q 30/0267 Wireless devices
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

The present invention provides an apparatus and method for extracting the content of a video, image, and/or audio file or podcast, analyzing the content, and then providing a targeted advertisement, search capability and/or other functionality based on the content of the file or podcast.

Claims

1. An apparatus comprising:

a communication module; and

a processor configured to;

transmit, via the communication module, a search request including at least one keyword to an external electronic device;

in response to the search request, acquire together advertisement content and non-advertisement content from the external electronic device; and

present, via a display operatively coupled with the processor, the advertisement content in relation with the non-advertisement content,

wherein the non-advertisement content includes video content or image content;

wherein the non-advertisement content and the advertisement content are selected by the external electronic device using a search term including the at least one keyword, and

wherein the advertisement content is integrated into a portion of the non-advertisement content in which the at least one keyword is found.

2. The apparatus of claim 1, wherein the processor is configured to acquire the at least one keyword from a text received as a user input.

3. The apparatus of claim 2, wherein the advertisement content further comprises audio content, video content, or link information corresponding to the keyword.

4. The apparatus of claim 1, wherein the non-advertisement content comprises a plurality of image frames including a first image frame and a second image frame, and wherein the processor is configured to:

perform the presenting in relation with the first image frame; and

refrain from performing the presenting in relation with the second image frame.

5. The apparatus of claim 1, wherein the processor is configured to:

present, via the display, a graphical indicator indicative of a presence of the advertisement content.

6. The apparatus of claim 1, wherein the processor is configured to:

perform, as at least part of the presenting, a video function or an audio function using a corresponding one of the advertisement content and the non-advertisement content.

7. The apparatus of claim 1, wherein the processor in configured to:

concurrently perform, as at least part of the presenting, a first function using the advertisement content, and a second function using the non-advertisement content, and

wherein each of the first function and the second function is one of a video function and an audio function.

8. The apparatus of claim 1, wherein the non-advertisement content is the video content, and wherein, in response to the portion of the non-advertisement content displaying or outputting the keyword, the selected advertisement content is output.

9. An apparatus comprising:

memory to store one or more advertisement contents and one or more non-advertisement contents;

a communication module; and

a processor configured to;

receive, via the communication module, a search request including at least one keyword from an external electronic device;

select, via the memory, at least one advertisement content from the one or more advertisement contents, and at least one non-advertisement content from the one or more non-advertisement content, based at least in part on the at least one keyword in the search request; and

transmit together the at least one advertisement content and the at least one non-advertisement content to the external electronic device as a response to the search request,

wherein the one or more non-advertisement content includes video content, or image content, and

wherein the advertisement content is integrated into a portion of the non-advertisement content in which the at least one keyword is found.

10. The apparatus of claim 9, wherein the processor is configured to:

select the at least one non-advertisement content based at least in part on meta data corresponding to at least part of the search request.

11. The apparatus of claim 10, wherein the processor is configured to:

generate the meta data based at least in part on the at least one non-advertisement content; and

select the at least one non-advertisement content from the one or more non-advertisement contents by comparing the generated meta data to the at least one keyword included in the search request.

12. The apparatus of claim 10, wherein the processor is configured to:

generate recognition data corresponding to an image object included in the non-advertisement content

generate the meta data based at least in part on the recognition data; and

select the at least one non-advertisement content from the one or more non-advertisement contents by comparing the generated meta data to the at least one keyword included in the search request.

13. A method comprising:

receiving, at an electronic device including a processor and memory storing one or more advertisement contents and one or more non-advertisement contents, a search request including at least one keyword from an external electronic device;

selecting, using the processor, at least one advertisement content from the one or more advertisement contents, and at least one non-advertisement content from the one or more non-advertisement contents in response to the search request; and

transmitting together the at least one advertisement content and the at least one non-advertisement content to the external electronic device as a response to the search request,

wherein the one or more non-advertisement contents comprise video content or image content;

wherein the selecting of the at least one advertisement content and the at least one non-advertisement content is performed by the external electronic device using a search term including the at least one keyword, and

wherein the advertisement content is integrated into a portion of the non-advertisement content in which the at least one keyword is found.

14. The method of claim 13, wherein the selecting comprises:

search the at least one non-advertisement content from the one or more non-advertisement contents based at least in part on meta data corresponding to the at least one keyword included in the search request.

15. The method of claim 13, wherein the selecting comprises:

generating recognition data corresponding to an image object included in the non-advertisement content;

generating meta data based at least in part on the recognition data; and

selecting the at least one non-advertisement content from the one or more non-advertisement contents by comparing the generated meta data to the at least one keyword included in the search request.

16. The method of claim 13, wherein the selecting comprises:

generating metadata based at least in part on the at least one non-advertisement content; and

selecting the at least one non-advertisement content from the one or more non-advertisement contents by comparing the generated meta data to the at least one keyword included in the search request.

17. The method of claim 13, wherein the selecting comprises:

identifying a relevant advertisement content based on descriptive data.

18. The method of claim 13, wherein the transmitting comprises:

transmitting link information corresponding to a website providing additional information associated with the at least one advertisement content.

19. The method of claim 13, wherein the transmitting comprises formatting the at least one advertisement content as suitable to be displayed at the external electronic device, and

wherein the non-advertisement content is a video and the integrating of the advertisement content comprises timing the at least one advertisement content to be synchronized with the portion of the at least one non-advertisement content based on relevance between the at least one advertisement content and the at least one non-advertisement content determined at least partially by the keyword.

20. A non-transitory machine-readable storage device storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

transmitting, via a communication module operatively coupled with the processor, a search request including at least one keyword to an external electronic device;

in response to the search request, receiving together advertisement content and non-advertisement content from the external electronic device; and

presenting, via a display operatively coupled with the processor, the advertisement content in relation with the non-advertisement content,

wherein the non-advertisement content including video content, or image content,

wherein the non-advertisement content and the advertisement content are acquired based on the at least one keyword, and

wherein the presenting further comprises integrating the advertisement content into a portion of the non-advertisement content in which the at least one keyword is found.