Quality control service using input quality metrics

• US 10,560,215 B1
• Filed: 03/27/2017
• Issued: 02/11/2020
• Est. Priority Date: 03/27/2017
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Hegar, Ryan Paul, Shams, Khawaja Salman
• Primary Examiner(s): Zhang, Shirley X
• Application Number:
  US15/469,849
• Time in Patent Office: 1,051 Days
• CPC Class Codes: G06F 11/076 by exceeding a count or rate limit, e.g. word- or bit count limit
• CPC Class Codes: H04L 1/00 Arrangements for detecting or preventing errors in the information received correcting synchronisation H04L7/00
• CPC Class Codes: H04L 1/0014 by adapting the source coding
• CPC Class Codes: H04N 1/00002 Diagnosis, testing or measuring; Detecting, analysing or monitoring not otherwise provided for error detection, error correction or monitoring in digital computers or digital computer components G06F11/00
• CPC Class Codes: H04N 1/00005 relating to image data
• CPC Class Codes: H04N 1/00007 relating to particular apparatus or devices

Abstract

Transcoders may be used to transcode multimedia inputs to generate output multimedia segments encoding segment quality scores that relate to the quality of transcoded segments and may be based at least in part on whether transcoding errors were detected. A system may be used to monitor quality control information relating to the generation of transcoded segments and invoke a quality control routine to determine a root cause for issues in the transcoding environment.

Claims

1. A system, comprising:

one or more processors; and

memory that stores computer-executable instructions that, as a result of execution, cause the system to;

store quality information associated with a plurality of transcoded multimedia segments generated by a plurality of transcoders, wherein the quality information comprises an indication that a transcoding error occurred as part of generating a transcoded multimedia segment of the plurality of transcoded multimedia segments;

detect satisfaction of a condition based at least in part on the quality information;

obtain quality information for at least a subset of the plurality of transcoded multimedia segments, wherein the subset includes quality information in common; and

identify, based at least on the common quality information, a transcoder from the plurality of transcoders as being the source of the transcoding error associated with the common quality information.

2. The system of claim 1, wherein:

the quality information further comprises an identifier associated with the transcoder; and

the common quality information comprises the identifier associated with the transcoder.

3. The system of claim 1, wherein:

obtaining quality information for the at least subset of plurality of transcoded multimedia segments comprises obtaining a segment quality metric associated with the transcoded multimedia segment, wherein the segment quality metric is based on one or more transcoding errors detected as part of generating the transcoded multimedia segment.

4. The system of claim 1, wherein the memory that stores computer-executable instructions that, as a result of execution, further causes the system to further identify, based at least on the common quality information, a multimedia segment generated by the transcoder as being the source of the transcoding error associated with the common quality information.

5. A computer-implemented method, comprising:

detecting satisfaction of a condition based at least in part on quality information associated with a plurality of transcoded multimedia segments generated by a plurality of transcoders, wherein the quality information comprises an indication that a transcoding error occurred as part of generating the plurality of transcoded multimedia segments;

obtaining quality information for at least a subset of the plurality of transcoded multimedia segments, wherein the subset includes quality information in common; and

identifying, based at least on the common quality information, a source of the transcoding error associated with the common quality information.

6. The computer-implemented method of claim 5, wherein:

the common quality information comprises an identifier associated with a computing device used to generate at least part of the plurality of transcoded multimedia segments; and

the identification of the source of the transcoding error associated with the common quality information comprises identifying the computing device.

7. The computer-implemented method of claim 6, wherein:

a first portion of the common quality information comprises;

a first segment quality metric, wherein the first segment quality metric is based on one or more transcoding errors detected as part of generating a first multimedia segment; and

a first time associated with generation of the first multimedia segment;

a second portion of the common quality information comprises;

a second segment quality metric, wherein the second segment quality metric is based on one or more transcoding errors detected as part of generating a second multimedia segment; and

a second time associated with generation of the second multimedia segment; and

identifying the computing device as being the source of the transcoding error associated with the common quality information comprises;

obtaining the first portion of the common quality information and the second portion of the common quality information;

determining the first time occurred temporally before the second time; and

determining a decrease in quality from the first time to the second time based at least in part on the first segment quality metric and the second segment quality metric.

8. The computer-implemented method of claim 7, wherein the first multimedia segment and the second multimedia segment share a common encoding format.

9. The computer-implemented method of claim 5, further comprising:

detecting a transcoder of the plurality of transcoders generated a multimedia segment;

obtaining, based on detecting the generation of the multimedia segment, quality information associated with the generated multimedia segment; and

wherein the subset that includes quality information in common comprises the generated multimedia segment.

10. The computer-implemented method of claim 5, wherein detecting satisfaction of the condition is further based at least in part on a segment quality metric included in the quality information.

11. The computer-implemented method of claim 5, further comprising making the identified source of the transcoding error and at least some of the common quality information available.

12. The computer-implemented method of claim 5, further comprising:

detecting a transcoder of the plurality of transcoders generated a multimedia segment;

storing quality information associated with the generated multimedia segment; and

wherein detecting satisfaction of the condition comprises retrieving the stored quality information associated with the generated multimedia segment as part of obtaining the quality information for the at least the subset of the plurality of transcoded multimedia segments.

13. A non-transitory computer-readable storage medium comprising executable instructions that, as a result of being executed by one or more processors of a computer system, cause the computer system to at least:

detect satisfaction of a condition based at least in part on quality information associated with a plurality of transcoded multimedia segments, the quality information comprising an indication that a transcoding error occurred as part of generating a transcoded multimedia segment of the plurality of transcoded multimedia segments;

obtain quality information for at least a subset of the plurality of transcoded multimedia segments, wherein the subset includes quality information in common; and

identify, based at least on the common quality information, a source of the transcoding error associated with the common quality information.

14. The non-transitory computer-readable storage medium of claim 13, wherein:

the common quality information comprises an encoding format associated with at least part of the plurality of transcoded multimedia segments; and

wherein the instructions further cause the computer system to identify the encoding format as being the source of the transcoding error associated with the common quality information.

15. The non-transitory computer-readable storage medium of claim 14, wherein:

the quality information comprises a first portion of quality information and a second portion of quality information;

the first portion of quality information indicates a transcoding error and is associated with a first multimedia segment of the plurality of transcoded multimedia segments; and

the second portion of quality information indicates the transcoding error and is associated with a second multimedia segment of the plurality of transcoded multimedia segments, wherein the second multimedia segment and the first multimedia segment include different multimedia content.

16. The non-transitory computer-readable storage medium of claim 13, wherein the instructions further cause the computer system to make the identified source of the transcoding error and at least some of the common quality information entries available.

17. The non-transitory computer-readable storage medium of claim 13, wherein the transcoding error is associated with the at least the subset of the plurality of transcoded multimedia segments.

18. The non-transitory computer-readable storage medium of claim 13, wherein:

the quality information comprises information usable to obtain a segment quality metric associated with the transcoded multimedia segment, wherein the segment quality metric is based at least in part on the transcoding error that occurred as part of the generation of the transcoded multimedia segment; and

detecting satisfaction of the condition comprises;

obtaining, using at least the quality information, the segment quality metric; and

comparing the segment quality metric against a threshold.

19. The non-transitory computer-readable storage medium of claim 13, wherein the instructions further cause the computer system to:

store the quality information associated with a plurality of transcoded multimedia segments; and

wherein detecting satisfaction of the condition comprises retrieving the stored quality information.

20. The non-transitory computer-readable storage medium of claim 13, wherein satisfaction of the condition occurs at a first time and satisfaction of a second condition occurs at a fixed time after the condition is satisfied, and further wherein satisfaction of the second condition is also based at least in part on the quality information associated with the plurality of transcoded multimedia segments.