Electronic apparatus and method of operating the same

• US 10,616,631 B2
• Filed: 08/01/2017
• Issued: 04/07/2020
• Est. Priority Date: 08/01/2016
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Choi, Yoon-hee, Jung, Tae-ung, Yeo, Hae-dong, Wen, Wei
• Primary Examiner(s): Chin, Ricky
• Application Number:
  US15/665,797
• Publication Number:
  US 20180035149A1
• Time in Patent Office: 980 Days
• Field of Search: None
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/414 Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
• CPC Class Codes: H04N 21/432 Content retrieval operation from a local storage medium, e.g. hard-disk details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44222 Analytics of user selections, e.g. selection of programs or purchase activity monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/458 Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10
• CPC Class Codes: H04N 21/643 Communication protocols network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP], H04L65/65
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8455 involving pointers to the content, e.g. pointers to the I-frames of the video stream

Abstract

An electronic apparatus including a communication interface, a display, a memory configured to store one or more instructions, and a processor configured to execute the one or more instructions stored in the memory, wherein, when executed, the one or more instructions cause the processor to receive, based on a fingerprint extracted from content displayed on the display, information of a first broadcast channel corresponding to the content from a server and recognize the first broadcast channel corresponding to the content, in response to determining that a broadcast schedule of a replacement target existing advertisement is included in a broadcast schedule of the first broadcast channel, download a replacement advertisement from the server based on a start point of the replacement target existing advertisement, and reproduce the replacement advertisement at an advertisement time of the replacement target existing advertisement of the first broadcast channel.

Claims

1. An electronic apparatus comprising:

a communication interface;

a display;

a memory configured to store one or more instructions; and

a processor configured to execute the one or more instructions stored in the memory,

wherein, when executed, the one or more instructions cause the processor to;

extract a plurality of fingerprints of content displayed on the display;

recognize, based on the plurality of fingerprints, a first broadcast channel corresponding to the content displayed on the display;

determine, based on the plurality of fingerprints, a period of time during which the first broadcast channel is output on the display;

based on the period of time being greater than a predetermined period of time, request a broadcast fingerprint of the first broadcast channel from a server;

in response to determining, based on the broadcast fingerprint, that a broadcast schedule of a replacement target existing advertisement is included in a broadcast schedule of the first broadcast channel, download a replacement advertisement from the server based on a start point of the replacement target existing advertisement; and

reproduce the replacement advertisement at an advertisement time of the replacement target existing advertisement of the first broadcast channel,

wherein the plurality of fingerprints are extracted at regular intervals, and

wherein the period of time is determined by counting a number of sequential fingerprints from among the plurality of fingerprints which correspond to the first broadcast channel.

2. The electronic apparatus of claim 1, wherein the one or more instructions further cause the processor to extract the plurality of fingerprints of the content;

and transmit information of the plurality of fingerprints of the content to the server and receive information of the first broadcast channel corresponding to the content from the server,

wherein the first broadcast channel is determined based on a comparison result between the fingerprint of the content and a fingerprint of an image of each of broadcast channels.

3. The electronic apparatus of claim 1, wherein the one or more instructions further cause the processor to receive a notification indicating the broadcast schedule of the replacement target existing advertisement in the first broadcast channel from the server,

wherein the broadcast schedule of the replacement target existing advertisement is determined according to a comparison between an advertisement fingerprint of the first broadcast channel and an advertisement fingerprint of the replacement target existing advertisement.

4. The electronic apparatus of claim 1, wherein the one or more instructions further cause the processor to receive a broadcast fingerprint of the first broadcast channel, in which an advertisement replacement event including information of the start point of the replacement target existing advertisement is set, from the server.

5. The electronic apparatus of claim 3, wherein the one or more instructions further cause the processor to determine a current reproduction position of the first broadcast channel by comparing a broadcast fingerprint of the first broadcast channel and a fingerprint of content displayed in real time on the display;

and download at least a portion of the replacement advertisement before the start point of the replacement target existing advertisement based on the determined current reproduction position.

6. The electronic apparatus of claim 1, wherein the one or more instructions further cause the processor to set a second layer on a first layer where a broadcast of the first broadcast channel is output and reproduce the replacement advertisement on the second layer.

7. The electronic apparatus of claim 1, wherein the one or more instructions further cause the processor to, based on an execution screen for control of the electronic apparatus being called, display the execution screen overlappingly on an image of the replacement advertisement based on a difference image between an image of the replacement target existing advertisement and an image of the replacement target existing advertisement including the execution screen.

8. The electronic apparatus of claim 1, wherein the one or more instructions cause the processor to, in response to the first broadcast channel changing into a second broadcast channel, interrupt the reproduction of the replacement advertisement and display a screen broadcasted on the second broadcast channel on the display.

9. The electronic apparatus of claim 1, wherein the one or more instructions further cause the processor to set a plurality of regions in an image of the content and extract the fingerprint of the content based on a pixel value of the plurality of regions.

10. The electronic apparatus of claim 1, wherein the one or more instructions further cause the processor to:

set a second layer on a first layer where a broadcast of the first broadcast channel is output and reproduce the replacement advertisement on the second layer; and

set a third layer on the second layer where the replacement advertisement is output and display an execution screen on the third layer, wherein the third layer covers at least a portion of the second layer, and the second layer covers at least a portion of the first layer.

11. A method of operating an electronic apparatus, the method comprising:

extracting a plurality of fingerprints of content displayed on a display of the electronic apparatus;

recognizing, based on the plurality of fingerprints, a first broadcast channel corresponding to the content displayed on the display;

determining, based on the plurality of fingerprints, a period of time during which the first broadcast channel is output on the display;

based on the period of time being greater than a predetermined period of time, requesting a broadcast fingerprint of the first broadcast channel from a server;

in response to determining, based on the broadcast fingerprint, that a broadcast schedule of a replacement target existing advertisement is included in a broadcast schedule of the first broadcast channel, downloading a replacement advertisement from the server based on a start point of the replacement target existing advertisement; and

reproducing the replacement advertisement at an advertisement time of the replacement target existing advertisement of the first broadcast channel,

wherein the plurality of fingerprints are extracted at regular intervals, and

wherein the period of time is determined by counting a number of sequential fingerprints from among the plurality of fingerprints which correspond to the first broadcast channel.

12. The method of claim 11, further comprising receiving a notification indicating the broadcast schedule of the replacement target existing advertisement in the first broadcast channel from the server,

wherein the broadcast schedule of the replacement target existing advertisement is determined according to a comparison between an advertisement fingerprint of the first broadcast channel and an advertisement fingerprint of the replacement target existing advertisement.

13. The method of claim 11, further comprising receiving a broadcast fingerprint of the first broadcast channel, in which an advertisement replacement event including information of the start point of the replacement target existing advertisement is set, from the server,

wherein the downloading of the replacement advertisement from the server comprises:

determining a current reproduction position of the first broadcast channel by comparing the broadcast fingerprint of the first broadcast channel and a fingerprint of content displayed in real time on the display; and

downloading at least a portion of the replacement advertisement before the start point of the replacement target existing advertisement based on the determined current reproduction position.

14. The method of claim 11, wherein the reproducing of the replacement advertisement comprises setting a second layer on a first layer where a broadcast of the first broadcast channel is output, and reproducing the replacement advertisement on the second layer.

15. The method of claim 11, wherein based on an execution screen for control of the electronic apparatus being called, display the execution screen overlappingly on an image of the replacement advertisement based on a difference image between an image of the replacement target existing advertisement and an image of the replacement target existing advertisement including the execution screen.

16. The method of claim 11, further comprising, in response to the first broadcast channel changing into a second broadcast channel, interrupting the reproducing of the replacement advertisement and displaying a screen broadcasted on the second broadcast channel on the display.

17. A server comprising:

a communication interface;

a storage storing one or more instructions; and

a processor configured to execute the one or more instructions stored in the storage,

wherein when executed, the one or more instructions cause the processor to;

receive broadcast information about each of broadcast channels from a broadcast station and extract a broadcast fingerprint of an image of each of the broadcast channels;

receive a fingerprint of content displayed on an electronic apparatus from the electronic apparatus, wherein the fingerprint of the content is sent by the electronic apparatus based on the content being displayed on the electronic apparatus for a period of time that is greater than a predetermined period of time;

determine a first broadcast channel corresponding to the content by comparing the fingerprint of the content and the broadcast fingerprint of the image of each of the broadcast channels;

determine, based on a broadcast schedule of the first broadcast channel, whether a replacement target existing advertisement is scheduled to be broadcasted in the electronic apparatus; and

transmit a replacement advertisement to the electronic apparatus based on a start point of the replacement target existing advertisement when the replacement target existing advertisement is scheduled to be broadcasted in the electronic apparatus,

wherein the fingerprint of the content is included in a plurality of fingerprints of the content,

wherein the plurality of fingerprints of the content are extracted at regular intervals, and

wherein the period of time is determined by counting a number of sequential fingerprints of the content from among the plurality of fingerprints of the content which correspond to the first broadcast channel.

18. The server of claim 17, wherein the one or more instructions further cause the processor to:

determine whether an advertisement fingerprint of the replacement target existing advertisement in the electronic apparatus is included in an advertisement fingerprint of the first broadcast channel;

add and store start point information of the replacement target existing advertisement in a broadcast fingerprint of the first broadcast channel in response to determining that the advertisement fingerprint of the replacement target existing advertisement is included in the advertisement fingerprint of the first broadcast channel; and

transmit the broadcast fingerprint of the first broadcast channel to the electronic apparatus.

19. A method of operating a server, the method comprising:

receiving broadcast information about each of broadcast channels from a broadcast station and extracting a broadcast fingerprint of an image of each of the broadcast channels;

receiving a fingerprint of content displayed on an electronic apparatus of a user from the electronic apparatus, wherein the fingerprint of the content is sent by the electronic apparatus based on the content being displayed on the electronic apparatus for a period of time that is greater than a predetermined period of time;

determining a first broadcast channel corresponding to the content by comparing the fingerprint of the content and the broadcast fingerprint of the image of each of the broadcast channels;

determining, based on a broadcast schedule of the first broadcast channel, whether a replacement target existing advertisement is scheduled to be broadcasted in the electronic apparatus; and

transmitting a replacement advertisement to the electronic apparatus based on a start point of the replacement target existing advertisement when the replacement target existing advertisement is scheduled to be broadcasted in the electronic apparatus,

wherein the fingerprint of the content is included in a plurality of fingerprints of the content,

wherein the plurality of fingerprints of the content are extracted at regular intervals, and

wherein the period of time is determined by counting a number of sequential fingerprints of the content from among the plurality of fingerprints of the content which correspond to the first broadcast channel.

20. An electronic apparatus comprising:

a communication interface;

a display;

a memory configured to store one or more instructions; and

a processor configured to execute the one or more instructions stored in the memory,

wherein, when executed, the one or more instructions cause the processor to;

extract a plurality of fingerprints of content displayed on the display;

recognize, based on the plurality of fingerprints, a first broadcast channel corresponding to the content displayed on the display;

determine, based on the plurality of fingerprints, a period of time during which the first broadcast channel is output on the display;

based on the period of time being greater than a predetermined period of time, request a broadcast fingerprint of the first broadcast channel from a server;

in response to determining, based on the broadcast fingerprint, that a broadcast schedule of a replacement target existing advertisement is included in a broadcast schedule of the first broadcast channel, download a replacement advertisement from the server based on a start point of the replacement target existing advertisement; and

reproduce the replacement advertisement at an advertisement time of the replacement target existing advertisement of the first broadcast channel, wherein the one or more instructions further cause the processor to;

in response to an execution screen for control of the electronic apparatus being called, display the execution screen as overlapping an image of the replacement advertisement,

wherein the execution screen comprises a first execution screen portion and a second execution screen portion, and

wherein the displaying of the execution screen comprises displaying the second execution screen portion as overlapping the first execution screen portion, and displaying the first execution screen portion and the second execution screen portion as overlapping the image of the replacement advertisement.