Method and system for display control, breakaway judging apparatus and video/audio processing apparatus

• US 9,900,664 B2
• Filed: 12/28/2015
• Issued: 02/20/2018
• Est. Priority Date: 01/15/2015
• Status: Active Grant

• Current Assignee: Industrial Technology Research Institute
• Original Assignee: Industrial Technology Research Institute
• Inventors: Chang, Chen-Guei, Chen, Ming-Yen, Wei, Ming-Shyan, Tai, Yuan-Chu
• Primary Examiner(s): Hong, Michael
• Application Number:
  US14/979,520
• Publication Number:
  US 20160212495A1
• Time in Patent Office: 785 Days
• Field of Search: 725 22
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4383 Accessing a communication channel
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4882 for displaying messages, e.g. warnings, reminders arrangements for providing short real-time information to substation in data switching networks H04L12/1895
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

A method and system for display control, a breakaway judging apparatus and a video/audio processing apparatus are provided. The method includes following steps. A display signal source is received and a play content is obtained according to the display signal source. It is judged whether a play time corresponding to the play content is in a breakaway time according to at least one advertising fingerprint, wherein the at least one advertising fingerprint is a characteristic message corresponding to the play content, and the breakaway time is at least one time interval for playing at least one advertisement in the play content. If the play time corresponding to the play content is in the breakaway time, a prompt message is superimposed to the play content.

Claims

1. A display control method, adapted to a display control system, comprising:

receiving a display signal source;

obtaining a play content according to the display signal source, wherein the play content comprises a main display region and a minor display region, the main display region does not comprise a specific object superimposed to the play content and the minor display region includes the specific object superimposed to the play content;

capturing a plurality of frames which are images of the play content and generating a characteristic message corresponding to the frames of the play content, wherein each of the frames is an image of the main display region;

judging whether a play time corresponding to the play content is in a breakaway time according to at least one advertising fingerprint, wherein the at least one advertising fingerprint is the characteristic message corresponding to the frames of the play content, and the breakaway time is at least one time interval for playing at least one advertisement in the play content;

superimposing a prompt message to the play content if the play time corresponding to the play content is in the breakaway time; and

displaying another prompt message on a display apparatus if the play time corresponding to the play content is after an end of the breakaway time, wherein the another prompt message is used for prompting that the breakaway time of the play content is ended.

2. The display control method as claimed in claim 1, wherein the step of judging whether the play time corresponding to the play content is in the breakaway time according to the at least one advertising fingerprint comprises:

judging whether the play time corresponding to the play content is in the breakaway time according to a breakaway rule, wherein the breakaway rule is determined by a breakaway length and/or an advertising playing frequency or a combination thereof of a program type and/or a program time.

3. The display control method as claimed in claim 1, wherein the at least one advertising fingerprint is obtained by periodically capturing a plurality of frames of the play content, and respectively inputting the frames into a hash function to respectively generate a plurality of characteristic messages corresponding to the frames.

4. The display control method as claimed in claim 1, wherein the step of judging whether the play time corresponding to the play content is in the breakaway time according to the at least one advertising fingerprint comprises:

comparing the at least one advertising fingerprint with one or a plurality of advertising fingerprints in an advertising fingerprint database; and

judging that the play time corresponding to the play content is in the breakaway time if the advertising fingerprint database has a first advertising fingerprint, wherein similarity between the first advertising fingerprint and the at least one advertising fingerprint is higher than a first threshold.

5. The display control method as claimed in claim 1, further comprising:

comparing the at least one advertising fingerprint with one or a plurality of advertising fingerprints in an advertising fingerprint database;

judging that the play content is a known advertisement if the advertising fingerprint database has a first advertising fingerprint, wherein similarity between the first advertising fingerprint and the at least one advertising fingerprint is higher than a first threshold; and

judging that the play content is an unknown advertisement if the advertising fingerprint database does not have the first advertising fingerprint.

6. The display control method as claimed in claim 1, further comprising:

determining whether the play content is in a channel sequential switching state; and

superimposing the prompt message to the play content if the play content is in the channel sequential switching state.

7. The display control method as claimed in claim 1, further comprising:

receiving a selection operation performed corresponding to the prompt message, and superimposing a message corresponding to the prompt message to the play content.

8. The display control method as claimed in claim 1, further comprising:

receiving a selection operation performed corresponding to the prompt message, and displaying a message corresponding to the prompt message in a display region of a handheld device.

9. The display control method as claimed in claim 3, wherein each of the frames is an image of the main display region which is in a customized region in the play content, and the image does not comprise a channel logo superimposed to the play content.

10. The display control method as claimed in claim 5, further comprising:

determining whether an unknown advertising database of the advertising fingerprint database has a second advertising fingerprint, wherein similarity between the second advertising fingerprint and the at least one advertising fingerprint is higher than a second threshold; and

adding the at least one advertising fingerprint to the unknown advertising database if the unknown advertising database does not has the second advertising fingerprint.

11. The display control method as claimed in claim 10, further comprising:

recognizing the at least one advertising fingerprint; and

adding the recognized at least one advertising fingerprint to a known advertising database.

12. A display control system, comprising:

a display apparatus;

a video/audio processing apparatus, coupled to the display apparatus; and

a breakaway judging apparatus, coupled to the video/audio processing apparatus, and configured to receive a play content message comprising a play content from the video/audio processing apparatus, wherein the play content comprises a main display region and a minor display region, the main display region does not comprise a specific object superimposed to the play content and the minor display region includes the specific object superimposed to the play content,

wherein the breakaway judging apparatus captures a plurality of frames which are images of the play content and generates a characteristic message corresponding to the frames of the play content, wherein each of the frames is an image of the main display region,

wherein the breakaway judging apparatus judges whether a play time of the play content corresponding to the play content message is in a breakaway time according to at least one advertising fingerprint, wherein the at least one advertising fingerprint is the characteristic message corresponding to the frames of the play content, and the breakaway time is at least one time interval for playing at least one advertisement in the play content,

if the play time corresponding to the play content is in the breakaway time, the breakaway judging apparatus transmits a notification message to the video/audio processing apparatus, the video/audio processing apparatus superimposes a prompt message to the play content, and the display apparatus displays the prompt message and the play content,

if the play time corresponding to the play content is after an end of the breakaway time, the video/audio processing apparatus displays another prompt message on the display apparatus, wherein the another prompt message is used for prompting that the breakaway time of the play content is ended.

13. The display control system as claimed in claim 12, wherein the breakaway judging apparatus judges whether the play time corresponding to the play content is in the breakaway time according to the at least one advertising fingerprint comprises:

the breakaway judging apparatus judges whether the play time corresponding to the play content is in the breakaway time according to a breakaway rule, wherein the breakaway rule is determined by a breakaway length and/or an advertising playing frequency or a combination thereof of a program type and/or a program time.

14. The display control system as claimed in claim 12, wherein the at least one advertising fingerprint is obtained by the breakaway judging apparatus by periodically capturing a plurality of frames of the play content, and respectively inputting the frames into a hash function to respectively generate a plurality of characteristic messages corresponding to the frames.

15. The display control system as claimed in claim 12, wherein the operation that the breakaway judging apparatus judges whether the play time corresponding to the play content is in the breakaway time according to the at least one advertising fingerprint comprises:

the breakaway judging apparatus compares the at least one advertising fingerprint with one or a plurality of advertising fingerprints in an advertising fingerprint database of the breakaway judging apparatus,

if the advertising fingerprint database has a first advertising fingerprint, wherein similarity between the first advertising fingerprint and the at least one advertising fingerprint is higher than a first threshold, the breakaway judging apparatus judges that the play time corresponding to the play content is in the breakaway time.

16. The display control system as claimed in claim 12, wherein

the breakaway judging apparatus compares the at least one advertising fingerprint with one or a plurality of advertising fingerprints in an advertising fingerprint database of the breakaway judging apparatus, and if the advertising fingerprint database has a first advertising fingerprint, wherein similarity between the first advertising fingerprint and the at least one advertising fingerprint is higher than a first threshold, the breakaway judging apparatus judges that the play content is a known advertisement, and if the advertising fingerprint database does not have the first advertising fingerprint, the breakaway judging apparatus judges that the play content is an unknown advertisement.

17. The display control system as claimed in claim 12, wherein

the video/audio processing apparatus determines whether the play content is in a channel sequential switching state, and if the play content is in the channel sequential switching state, the video/audio processing apparatus superimposes the prompt message to the play content.

18. The display control system as claimed in claim 12, wherein

the video/audio processing apparatus receives a selection operation performed corresponding to the prompt message, and superimposes a message corresponding to the prompt message to the play content.

19. The display control system as claimed in claim 12, further comprising:

a handheld device, wherein when the video/audio processing apparatus receives a selection operation performed corresponding to the prompt message, the video/audio processing apparatus displays a message corresponding to the prompt message in a display region of the handheld device.

20. The display control system as claimed in claim 14 wherein each of the frames is an image of the main display region in the play content, wherein the main display region is a partial region of each of the frames, and the image does not comprise a channel logo superimposed to the play content.

21. The display control system as claimed in claim 16, wherein

the breakaway judging apparatus determines whether an unknown advertising database of the advertising fingerprint database has a second advertising fingerprint, wherein similarity between the second advertising fingerprint and the at least one advertising fingerprint is higher than a second threshold, and

if the unknown advertising database does not has the second advertising fingerprint, the breakaway judging apparatus adds the at least one advertising fingerprint to the unknown advertising database.

22. The display control system as claimed in claim 21, wherein

the breakaway judging apparatus recognizes the at least one advertising fingerprint, and

the breakaway judging apparatus adds the recognized at least one advertising fingerprint to a known advertising database.

23. A breakaway judging apparatus, comprising:

an input/output interface, configured to receive a display signal source; and

a processing unit, coupled to the input/output interface, and configured to obtain a play content according to the display signal source, wherein the play content comprises a main display region and a minor display region, the main display region does not comprise a specific object superimposed to the play content and the minor display region includes the specific object superimposed to the play content,

wherein the processing unit captures a plurality of frames which are images of the play content and generates a characteristic message corresponding to the frames of the play content, wherein each of the frames is an image of the main display region,

wherein the processing unit judges whether a play time corresponding to the play content is in a breakaway time according to at least one advertising fingerprint, wherein the at least one advertising fingerprint is the characteristic message corresponding to the frames of the play content, and the breakaway time is at least one time interval for playing at least one advertisement in the play content,

if the play time corresponding to the play content is in the breakaway time, the processing unit sends a breakaway judging notification through the input/output interface.

24. The breakaway judging apparatus as claimed in claim 23, wherein the operation that the processing unit judges whether the play time corresponding to the play content is in the breakaway time according to the at least one advertising fingerprint comprises:

the processing unit judges whether the play time corresponding to the play content is in the breakaway time according to a breakaway rule, wherein the breakaway rule is determined by a breakaway length and/or an advertising playing frequency or a combination thereof of a program type and/or a program time.

25. The breakaway judging apparatus as claimed in claim 23, wherein the at least one advertising fingerprint is obtained by the processing unit by periodically capturing a plurality of frames of the play content, and respectively inputting the frames into a hash function to respectively generate a plurality of characteristic messages corresponding to the frames.

26. The breakaway judging apparatus as claimed in claim 23, further comprising:

a storage unit, wherein

the processing unit compares the at least one advertising fingerprint with one or a plurality of advertising fingerprints in the storage unit,

if the advertising fingerprints in the storage unit comprise a first advertising fingerprint, the processing unit judges that the play time corresponding to the play content is in the breakaway time, wherein similarity between the first advertising fingerprint and the at least one advertising fingerprint is higher than a first threshold.

27. The breakaway judging apparatus as claimed in claim 23, further comprising:

a storage unit, wherein

the processing unit compares the at least one advertising fingerprint with one or a plurality of advertising fingerprints in the storage unit,

if the advertising fingerprints in the storage unit comprise a first advertising fingerprint, the processing unit judges that the play content is a known advertisement, wherein similarity between the first advertising fingerprint and the at least one advertising fingerprint is higher than a first threshold,

if the storage unit does not have the first advertising fingerprint, the processing unit judges that the play content is an unknown advertisement.

28. The breakaway judging apparatus as claimed in claim 25, wherein each of the frames is an image of the main display region in the play content, wherein the main display region is a partial region of each of the frames, and the image does not comprise a channel logo superimposed to the play content.

29. The breakaway judging apparatus as claimed in claim 27, wherein

the processing unit determines whether a plurality of advertising fingerprints in an unknown advertising storage region of the storage unit comprise a second advertising fingerprint, wherein whether the advertising fingerprints in the unknown advertising storage region comprise the second advertising fingerprint is determined according to whether similarity between the second advertising fingerprint and the at least one advertising fingerprint is higher than a second threshold, and

if the unknown advertising storage region does not has the second advertising fingerprint, the processing unit adds the at least one advertising fingerprint to the unknown advertising storage region.

30. The breakaway judging apparatus as claimed in claim 29, wherein

the processing unit recognizes the at least one advertising fingerprint, and

the processing unit adds the recognized at least one advertising fingerprint to a known advertising storage region of the storage unit.

31. A video/audio processing apparatus, comprising:

an input/output interface; and

a processing unit, coupled to the input/output interface, and configured to output a play content message comprising a play content through the input/output interface, and receiving a notification message generated by a breakaway judging apparatus through the input/output interface, wherein the play content comprises a main display region and a minor display region, the main display region does not comprise a specific object superimposed to the play content and the minor display region includes the specific object superimposed to the play content, wherein the breakaway judging apparatus generates the notification message by capturing a plurality of frames which are images of the play content and generating a characteristic message corresponding to the frames of the play content, wherein each of the frames is an image of the main display region,

wherein the notification message is configured to indicate whether a play time of the play content corresponding to the play content message is in a breakaway time, wherein the breakaway time is at least one time interval for playing at least one advertisement in the play content,

if the play time corresponding to the play content is in the breakaway time, the processing unit superimposes a notification message to the play content,

if the play time corresponding to the play content is after an end of the breakaway time, the processing unit sends another prompt message through the input/output interface and displays the another prompt message on a display apparatus, wherein the another prompt message is used for prompting that the breakaway time of the play content is ended.

32. The video/audio processing apparatus as claimed in claim 31, wherein

the processing unit determines whether the play content is in a channel sequential switching state,

if the play content is in the channel sequential switching state, the processing unit superimposes the prompt message to the play content.

33. The video/audio processing apparatus as claimed in claim 31, wherein

the input/output interface receives a selection operation performed corresponding to the prompt message, and the processing unit superimposes a message corresponding to the prompt message to the play content.