ELECTRONIC APPARATUS AND METHOD OF OPERATING THE SAME

• US 20180035149A1
• Filed: 08/01/2017
• Published: 02/01/2018
• Est. Priority Date: 08/01/2016
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: CHOI, Yoon-hee, JUNG, Tae-ung, YEO, Hae-dong, WEN, Wei
• Granted Patent: US 10,616,631 B2
• Time in Patent Office: Days
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/414 Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
• CPC Class Codes: H04N 21/432 Content retrieval operation from a local storage medium, e.g. hard-disk details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44222 Analytics of user selections, e.g. selection of programs or purchase activity monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/458 Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10
• CPC Class Codes: H04N 21/643 Communication protocols network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP], H04L65/65
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8455 involving pointers to the content, e.g. pointers to the I-frames of the video stream

Abstract

An electronic apparatus including a communication interface, a display, a memory configured to store one or more instructions, and a processor configured to execute the one or more instructions stored in the memory, wherein, when executed, the one or more instructions cause the processor to receive, based on a fingerprint extracted from content displayed on the display, information of a first broadcast channel corresponding to the content from a server and recognize the first broadcast channel corresponding to the content, in response to determining that a broadcast schedule of a replacement target existing advertisement is included in a broadcast schedule of the first broadcast channel, download a replacement advertisement from the server based on a start point of the replacement target existing advertisement, and reproduce the replacement advertisement at an advertisement time of the replacement target existing advertisement of the first broadcast channel.

Claims

1. An electronic apparatus comprising:

a communication interface;

a display;

a memory configured to store one or more instructions; and

a processor configured to execute the one or more instructions stored in the memory,

wherein, when executed, the one or more instructions cause the processor to;

receive, based on a fingerprint extracted from content displayed on the display, information of a first broadcast channel corresponding to the content from a server and recognize the first broadcast channel corresponding to the content;

in response to determining that a broadcast schedule of a replacement target existing advertisement is included in a broadcast schedule of the first broadcast channel, download a replacement advertisement from the server based on a start point of the replacement target existing advertisement; and

reproduce the replacement advertisement at an advertisement time of the replacement target existing advertisement of the first broadcast channel.

2. The electronic apparatus of claim 1, wherein the one or more instructions further cause the processor to extract the fingerprint of the content;

and transmit information of the fingerprint of the content to the server and receive information of the first broadcast channel corresponding to the content from the server,

wherein the first broadcast channel is determined based on a comparison result between the fingerprint of the content and a fingerprint of an image of each of broadcast channels.

3. The electronic apparatus of claim 1, wherein the one or more instructions further cause the processor to extract the fingerprint of the content at predetermined time intervals and determine, based on the fingerprint extracted at the predetermined time intervals, whether the first broadcast channel is continuously output on the display;

and request information of a broadcast fingerprint of the first broadcast channel from the server in response to determining that the first broadcast channel is continuously output on the display.

4. The electronic apparatus of claim 1, wherein the one or more instructions further cause the processor to receive a notification indicating the broadcast schedule of the replacement target existing advertisement in the first broadcast channel from the server,

wherein the broadcast schedule of the replacement target existing advertisement is determined according to a comparison between an advertisement fingerprint of the first broadcast channel and an advertisement fingerprint of the replacement target existing advertisement.

5. The electronic apparatus of claim 1, wherein the one or more instructions further cause the processor to receive a broadcast fingerprint of the first broadcast channel, in which an advertisement replacement event including information of the start point of the replacement target existing advertisement is set, from the server.

6. The electronic apparatus of claim 4, wherein the one or more instructions further cause the processor to determine a current reproduction position of the first broadcast channel by comparing the broadcast fingerprint of the first broadcast channel and a fingerprint of content displayed in real time on the display;

and download at least a portion of the replacement advertisement before the start point of the replacement target existing advertisement based on the determined current reproduction position.

7. The electronic apparatus of claim 1, wherein the one or more instructions further cause the processor to set a second layer on a first layer where a broadcast of the first broadcast channel is output and reproduce the replacement advertisement on the second layer.

8. The electronic apparatus of claim 1, wherein the one or more instructions further cause the processor to, in response to an execution screen for control of the electronic apparatus being called, based on a difference image between an image of the replacement target existing advertisement and an image of the replacement target existing advertisement including the execution screen, display the execution screen overlappingly on an image of the replacement advertisement.

9. The electronic apparatus of claim 1, wherein the one or more instructions cause the processor to, in response to the first broadcast channel changing into a second broadcast channel, interrupt the reproduction of the replacement advertisement and display a screen broadcasted on the second broadcast channel on the display.

10. The electronic apparatus of claim 1, wherein the one or more instructions further cause the processor to set a plurality of regions in an image of the content and extract the fingerprint of the content based on a pixel value of the plurality of regions.

11. A method of operating an electronic apparatus, the method comprising:

extracting a fingerprint of content displayed on a display of the electronic apparatus;

receiving, based on the extracted fingerprint of the content, information of a first broadcast channel corresponding to the content from a server and recognizing the first broadcast channel corresponding to the content;

in response to determining that a broadcast schedule of a replacement target existing advertisement is included in a broadcast schedule of the first broadcast channel, downloading a replacement advertisement from the server based on a start point of the replacement target existing advertisement; and

reproducing the replacement advertisement at an advertisement time of the replacement target existing advertisement of the first broadcast channel.

12. The method of claim 11, further comprising:

extracting the fingerprint of the content at predetermined time intervals and determining, based on the fingerprint extracted at the predetermined time intervals, whether the first broadcast channel is continuously output on the display; and

requesting information of a broadcast fingerprint of the first broadcast channel from the server in response to determining that the first broadcast channel is continuously output on the display.

13. The method of claim 11, further comprising receiving a notification indicating the broadcast schedule of the replacement target existing advertisement in the first broadcast channel from the server,

wherein the broadcast schedule of the replacement target existing advertisement is determined according to a comparison between an advertisement fingerprint of the first broadcast channel and an advertisement fingerprint of the replacement target existing advertisement.

14. The method of claim 11, further comprising receiving a broadcast fingerprint of the first broadcast channel, in which an advertisement replacement event including information of the start point of the replacement target existing advertisement is set, from the server,

wherein the downloading of the replacement advertisement from the server comprises:

determining a current reproduction position of the first broadcast channel by comparing the broadcast fingerprint of the first broadcast channel and a fingerprint of content displayed in real time on the display; and

downloading at least a portion of the replacement advertisement before the start point of the replacement target existing advertisement based on the determined current reproduction position.

15. The method of claim 11, wherein the reproducing of the replacement advertisement comprises setting a second layer on a first layer where a broadcast of the first broadcast channel is output, and reproducing the replacement advertisement on the second layer.

16. The method of claim 11, further comprising, in response to an execution screen for control of the electronic apparatus being called, based on a difference image between an image of the replacement target existing advertisement and an image of the replacement target existing advertisement including the execution screen, displaying the execution screen overlappingly on an image of the replacement advertisement.

17. The method of claim 11, further comprising, in response to the first broadcast channel changing into a second broadcast channel, interrupting the reproducing of the replacement advertisement and displaying a screen broadcasted on the second broadcast channel on the display.

18. A server comprising:

a communication interface;

a storage storing one or more instructions; and

a processor configured to execute the one or more instructions stored in the storage,

wherein when executed, the one or more instructions cause the processor to;

receive broadcast information about each of broadcast channels from a broadcast station and extract a broadcast fingerprint of an image of each of the broadcast channels;

receive a fingerprint of content displayed on an electronic apparatus from the electronic apparatus;

determine a first broadcast channel corresponding to the content by comparing the fingerprint of the content and the broadcast fingerprint of the image of each of the broadcast channels;

determine, based on a broadcast schedule of the first broadcast channel, whether a replacement target existing advertisement is scheduled to be broadcasted in the electronic apparatus; and

transmit a replacement advertisement to the electronic apparatus based on a start point of the replacement target existing advertisement when the replacement target existing advertisement is scheduled to be broadcasted in the electronic apparatus.

19. The server of claim 18, wherein the one or more instructions further cause the processor to:

determine whether an advertisement fingerprint of the replacement target existing advertisement in the electronic apparatus is included in an advertisement fingerprint of the first broadcast channel;

add and store start point information of the replacement target existing advertisement in a broadcast fingerprint of the first broadcast channel in response to determining that the advertisement fingerprint of the replacement target existing advertisement is included in the advertisement fingerprint of the first broadcast channel; and

transmit the broadcast fingerprint of the first broadcast channel to the electronic apparatus.

20. A method of operating a server, the method comprising:

receiving broadcast information about each of broadcast channels from a broadcast station and extracting a broadcast fingerprint of an image of each of the broadcast channels;

receiving a fingerprint of content displayed on an electronic apparatus of a user from the electronic apparatus;

determining a first broadcast channel corresponding to the content by comparing the fingerprint of the content and the broadcast fingerprint of the image of each of the broadcast channels;

determining, based on a broadcast schedule of the first broadcast channel, whether a replacement target existing advertisement is scheduled to be broadcasted in the electronic apparatus; and

transmitting a replacement advertisement to the electronic apparatus based on a start point of the replacement target existing advertisement when the replacement target existing advertisement is scheduled to be broadcasted in the electronic apparatus.