Backfill of video stream

• US 9,553,910 B2
• Filed: 11/22/2015
• Issued: 01/24/2017
• Est. Priority Date: 01/06/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Kirkby, Ronald Loren, Nelson, Gregory Rourk, Duffy, Gregory R.
• Primary Examiner(s): Lai, Michael C
• Application Number:
  US14/948,355
• Publication Number:
  US 20160080450A1
• Time in Patent Office: 429 Days
• US Class Current: 1/1
• CPC Class Codes: H04L 1/1877 for semi-reliable protocols, e.g. for less sensitive applications like streaming video buffer level management for video bitstream control arrangements H04N21/44004
• CPC Class Codes: H04L 47/193 at the transport layer, e.g. TCP related
• CPC Class Codes: H04L 47/2433 Allocation of priorities to traffic types
• CPC Class Codes: H04L 47/30 in combination with information about buffer occupancy at either end or at transit nodes
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Abstract

A data streaming method is performed at a computing device having one or more processors and memory. The memory stores one or more programs configured for execution by the one or more processors. The process records video from a camera in real-time. The recorded video is stored in the memory in a circular buffer in chronological order. The process sends data in chronological order from the circular buffer to a destination in real-time. In response to detecting that a portion of content from the circular buffer needs to be resent, the process concurrently resends to the destination in reverse chronological order data from the portion of content from the circular buffer.

Claims

1. A data streaming method performed at a computing device having one or more processors and memory storing one or more programs configured for execution by the one or more processors, comprising:

recording video from a camera in real-time, wherein the recorded video is stored in the memory in a circular buffer in chronological order;

sending data in chronological order from the circular buffer to a destination in real-time; and

in response to detecting that a portion of content from the circular buffer needs to be resent, concurrently resending to the destination in reverse chronological order data from the portion of content from the circular buffer.

2. The method of claim 1, further comprising receiving acknowledgements sent by the destination.

3. The method of claim 2, wherein detecting that the portion of content from the circular buffer needs to be resent includes detecting that no acknowledgement for the portion of content from the circular buffer has been received from the destination.

4. The method of claim 1, wherein sending data in chronological order is given higher priority than resending data in reverse chronological order.

5. The method of claim 1, wherein sending data in chronological order uses a forward cursor that advances in a forward direction in the circular buffer as video frames from the circular buffer are sent to the destination.

6. The method of claim 5, wherein resending data in reverse chronological order uses a backfill cursor that advances in a direction opposite the forward direction in the circular buffer as video frames from the portion are resent to the destination.

7. A data streaming system, comprising:

one or more processors;

memory; and

one or more programs stored in the memory, wherein the one or more programs are configured for execution by the one or more processors for;

recording video from a camera in real-time, wherein the recorded video is stored in the memory in a circular buffer in chronological order;

sending data in chronological order from the circular buffer to a destination in real-time; and

in response to detecting that a portion of content from the circular buffer needs to be resent, concurrently resending to the destination in reverse chronological order data from the portion of content from the circular buffer.

8. The data streaming system of claim 7, further comprising receiving acknowledgements sent by the destination.

9. The data streaming system of claim 8, wherein detecting that the portion of content from the circular buffer needs to be resent includes detecting that no acknowledgement for the portion of content from the circular buffer has been received from the destination.

10. The data streaming system of claim 7, wherein sending data in chronological order is given higher priority than resending data in reverse chronological order.

11. The data streaming system of claim 7, wherein sending data in chronological order uses a forward cursor that advances in a forward direction in the circular buffer as video frames from the circular buffer are sent to the destination.

12. The data streaming system of claim 11, wherein resending data in reverse chronological order uses a backfill cursor that advances in a direction opposite the forward direction in the circular buffer as video frames from the portion are resent to the destination.

13. A non-transitory computer readable storage medium storing one or more programs configured for execution by a computing device having one or more processors and memory, the one or more programs comprising instructions for:

recording video from a camera in real-time, wherein the recorded video is stored in the memory in a circular buffer in chronological order;

sending data in chronological order from the circular buffer to a destination in real-time; and

in response to detecting that a portion of content from the circular buffer needs to be resent, concurrently resending to the destination in reverse chronological order data from the portion of content from the circular buffer.

14. The computer readable storage medium of claim 13, further comprising receiving acknowledgements sent by the destination.

15. The computer readable storage medium of claim 14, wherein detecting that the portion of content from the circular buffer needs to be resent includes detecting that no acknowledgement for the portion of content from the circular buffer has been received from the destination.

16. The computer readable storage medium of claim 13, wherein sending data in chronological order is given higher priority than resending data in reverse chronological order.

17. The computer readable storage medium of claim 13, wherein sending data in chronological order uses a forward cursor that advances in a forward direction in the circular buffer as video frames from the circular buffer are sent to the destination.

18. The computer readable storage medium of claim 17, wherein resending data in reverse chronological order uses a backfill cursor that advances in a direction opposite the forward direction in the circular buffer as video frames from the portion are resent to the destination.