Optimizing media fingerprint retention to improve system resource utilization

• US 10,080,062 B2
• Filed: 07/14/2016
• Issued: 09/18/2018
• Est. Priority Date: 07/16/2015
• Status: Active Grant

• Current Assignee: Inscape Data, Inc. (VIZIO, Inc.)
• Original Assignee: Inscape Data, Inc. (VIZIO, Inc.)
• Inventors: Neumeier, Zeev, Collette, Michael
• Primary Examiner(s): Lin, Jason K
• Application Number:
  US15/210,730
• Publication Number:
  US 20170019716A1
• Time in Patent Office: 796 Days
• Field of Search: None
• CPC Class Codes: G06F 16/7847 using low-level visual features of the video content
• CPC Class Codes: G06V 10/40 Extraction of image or video features
• CPC Class Codes: G06V 10/751 Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/845 Structuring of content, e.g. decomposing content into time segments

Abstract

Provided are devices, computer-program products, and methods for removing redundant data associated with frames. For example, a method can include receiving an initial frame, determining initial cue data for the initial frame, and sending the initial cue data to a server. The method can further include receiving a new frame and determining new cue data for the new frame. The method can further include identifying a pixel value range. The method can further include determining a pixel value difference between an initial pixel data sample and a new pixel data sample. The method can further include determining the pixel value difference is within the pixel value range and updating the new cue data by removing the new pixel data sample from the new cue data when the pixel value difference is within the pixel value range. The method can further include sending the updated new cue data to the server.

Claims

1. A computer-implemented method comprising:

receiving an initial frame, wherein the initial frame includes pixel data;

determining initial cue data for the initial frame, wherein the initial cue data includes a plurality of initial pixel data samples associated with the initial frame;

sending the initial cue data, wherein the initial cue data is addressed to a server;

receiving a new frame, wherein the new frame includes pixel data, and wherein the new frame is received after the initial frame;

determining new cue data for the new frame, wherein the new cue data includes a plurality of new pixel data samples associated with the new frame;

identifying a pixel value range, wherein pixel data samples are determined to be similar when a pixel value difference between the pixel data samples is within the pixel value range;

determining a pixel value difference between an initial pixel data sample and a new pixel data sample, wherein the initial pixel data sample corresponds to the new pixel data sample;

determining the pixel value difference is within the pixel value range;

updating the new cue data by removing the new pixel data sample from the new cue data when the pixel value difference is within the pixel value range; and

sending the updated new cue data, wherein the updated new cue data is addressed to the server.

2. The computer-implemented method of claim 1, further comprising:

sending a flag indicating that the new pixel data sample is removed from the new cue data, wherein the flag is addressed to the server.

3. The computer-implemented method of claim 1, further comprising:

sending a flag indicating that a row of pixel data samples are removed from the new cue data, wherein the new pixel data sample is included in the row, and wherein the flag is addressed to the server.

4. The computer-implemented method of claim 1, wherein a pixel data sample is computed from a pixel patch, and wherein the pixel patch includes an array of pixels of a frame.

5. The computer-implemented method of claim 4, wherein the pixel data sample is computed by taking an average of pixel values of pixels in the pixel patch.

6. The computer-implemented method of claim 1, wherein the server is configured to identify that the new pixel data sample is removed from the updated new cue data.

7. The computer-implemented method of claim 1, wherein the initial frame is included in a broadcast signal.

8. A system comprising:

one or more processors; and

a non-transitory computer-readable medium containing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations including;

receive an initial frame, wherein the initial frame includes pixel data;

determine initial cue data for the initial frame, wherein the initial cue data includes a plurality of initial pixel data samples associated with the initial frame;

send the initial cue data, wherein the initial cue data is addressed to a server;

receive a new frame, wherein the new frame includes pixel data, and wherein the new frame is received after the initial frame;

determine new cue data for the new frame, wherein the new cue data includes a plurality of new pixel data samples associated with the new frame;

identify a pixel value range, wherein pixel data samples are determined to be similar when a pixel value difference between the pixel data samples is within the pixel value range;

determine a pixel value difference between an initial pixel data sample and a new pixel data sample, wherein the initial pixel data sample corresponds to the new pixel data sample;

determine the pixel value difference is within the pixel value range;

update the new cue data by removing the new pixel data sample from the new cue data when the pixel value difference is within the pixel value range; and

send the updated new cue data, wherein the updated new cue data is addressed to the server.

9. The system of claim 8, further comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform operations including:

send a flag indicating that the new pixel data sample is removed from the new cue data, wherein the flag is addressed to the server.

10. The system of claim 8, further comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform operations including:

send a flag indicating that a row of pixel data samples are removed from the new cue data, wherein the new pixel data sample is included in the row, and wherein the flag is addressed to the server.

11. The system of claim 8, wherein a pixel data sample is computed from a pixel patch, and wherein the pixel patch includes an array of pixels of a frame.

12. The system of claim 11, wherein the pixel data sample is computed by taking an average of pixel values of pixels in the pixel patch.

13. The system of claim 8, wherein the server is configured to identify that the new pixel data sample is removed from the updated new cue data.

14. The system of claim 8, wherein the initial frame is included in a broadcast signal.

15. A computer-program product tangibly embodied in a non-transitory machine-readable storage medium, including instructions that, when executed by the one or more processors, cause the one or more processors to:

receive an initial frame, wherein the initial frame includes pixel data;

determine initial cue data for the initial frame, wherein the initial cue data includes a plurality of initial pixel data samples associated with the initial frame;

send the initial cue data, wherein the initial cue data is addressed to a server;

receive a new frame, wherein the new frame includes pixel data, and wherein the new frame is received after the initial frame;

determine new cue data for the new frame, wherein the new cue data includes a plurality of new pixel data samples associated with the new frame;

identify a pixel value range, wherein pixel data samples are determined to be similar when a pixel value difference between the pixel data samples is within the pixel value range;

determine a pixel value difference between an initial pixel data sample and a new pixel data sample, wherein the initial pixel data sample corresponds to the new pixel data sample;

determine the pixel value difference is within the pixel value range;

update the new cue data by removing the new pixel data sample from the new cue data when the pixel value difference is within the pixel value range; and

send the updated new cue data, wherein the updated new cue data is addressed to the server.

16. The computer-program product of claim 15, further including instructions that, when executed by the one or more processors, cause the one or more processors to:

send a flag indicating that the new pixel data sample is removed from the new cue data, wherein the flag is addressed to the server.

17. The computer-program product of claim 15, further including instructions that, when executed by the one or more processors, cause the one or more processors to:

send a flag indicating that a row of pixel data samples are removed from the new cue data, wherein the new pixel data sample is included in the row, and wherein the flag is addressed to the server.

18. The computer-program product of claim 15, wherein a pixel data sample is computed from a pixel patch, and wherein the pixel patch includes an array of pixels of a frame.

19. The computer-program product of claim 18, wherein the pixel data sample is computed by taking an average of pixel values of pixels in the pixel patch.

20. The computer-program product of claim 15, wherein the server is configured to identify that the new pixel data sample is removed from the updated new cue data.