Device, system and method for real-time personalization of streaming video

• US 10,742,337 B2
• Filed: 03/23/2018
• Issued: 08/11/2020
• Est. Priority Date: 03/23/2018
• Status: Active Grant

• Current Assignee: BuildScale, Inc.
• Original Assignee: BuildScale, Inc.
• Inventors: Vermeyden, Pieter Willem, Wright, Stephen Claude, Galloway, Devon Bruce, Campaigne, Tyler James
• Primary Examiner(s): Shang, Annan Q
• Application Number:
  US15/933,915
• Publication Number:
  US 20190296840A1
• Time in Patent Office: 872 Days
• Field of Search: 725 34, 725 88, 725 80, 725 37, 725 18, 725 97, 725 14, 725 38, 725116, 725 47
• CPC Class Codes: G06F 16/735 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: H04H 20/106 Receiver-side switching
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/4586 Content update operation triggered locally, e.g. by comparing the version of software modules in a DVB carousel to the version stored locally deployment, distribution, installation, update of software G06F8/65; error detection or correction of the data by redundancy during software upgrading G06F11/1433; arrangements for updating broadcast information or broadcast-related information H04H60/25
• CPC Class Codes: H04N 21/4825 using a list of items to be played back in a given order, e.g. playlists
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments

Abstract

A device, system and method for real-time personalization of streaming video is provided. The device has access to a memory storing: nonpersonalized video segments; and data for rendering personalized video segments, the nonpersonalized video segments and the personalized video segments associated with a given order. When a request for a personalized video is received, the device causes rendering of at least a subset of the personalized video segments to be rendered using the data, incorporating personal data associated with the request into the personalized video segments. As the personalized video segments are rendered, the device updates and transmits a manifest, to the communication device, identifying available video segments according to the given order. The video segments identified in the manifest are provided to the communication device in response to receiving requests for the video segments.

Claims

1. A device comprising:

a communication interface; and

a controller having access to a memory storing;

nonpersonalized video segments; and

data for rendering personalized video segments, the nonpersonalized video segments and the personalized video segments associated with a given order, the data for rendering the personalized video segments including respective video fields to be populated by respective personal data,

the controller configured to;

receive, from a communication device, using the communication interface, a request for a personalized video;

cause rendering of at least a subset of the personalized video segments using the data for rendering the personalized video segments by;

populating personal data associated with the request into the video fields of the data for rendering the personalized video segments during the rendering, the personal data comprising data indicative of one or more of text and graphics to be incorporated into the personalized video segments, such that a rendered personalized video segment comprises at least one video frame that includes the personal data at a location of a respective video field;

the rendering of the personalized video segments occurring according to the given order;

generate, and transmit to the communication device, using the communication interface, a manifest identifying at least a first video segment selected according to the given order;

update, and transmit to the communication device, using the communication interface, the manifest to identify, according to the given order, further available video segments, as rendering of each of the personalized video segments is completed; and

provide to the communication device, using the communication interface, as the personalized video, video segments identified in the manifest, in response to receiving requests for the video segments from the communication device.

2. The device of claim 1, wherein the controller is further configured to render each of the personalized video segments by:

retrieving, from the data for rendering personalized video segments, one or more of a respective prerendered static layer and a respective prerendered non-static layer;

rendering a respective personalized layer using the personal data; and

combining the respective personalized layer with one or more of the respective prerendered static layer and the respective prerendered non-static layer.

3. The device of claim 2, wherein the controller is further configured to render each of the personalized video segments by:

retrieving, from the data for rendering personalized video segments, transformation data; and

rendering the respective personalized layer using the personal data, and according to the transformation data, such that the respective personalized layer is transformed according to one or more of a previous respective personalized layer and a next respective personalized layer.

4. The device of claim 1, wherein a first available video segment, according to the given order, is a first nonpersonalized video segment, and controller is further configured to:

in response to receiving the request, transmit the manifest identifying the first nonpersonalized video segment.

5. The device of claim 1, wherein the controller is further configured to:

cause rendering of the at least a subset of the personalized video segments to occur in parallel.

6. The device of claim 5, wherein the controller is further configured to:

cause parallel processing resources to complete rendering of the personalized video segments according to the given order.

7. The device of claim 1, wherein the controller is further configured to:

continue to render the personalized video segments that occur later in the personalized video, according to the given order, while providing, to the communication device, the personalized video segments that occur earlier in the personalized video, as they are completed.

8. The device of claim 1, wherein the controller is further configured to:

as rendering of a next personalized video segment is completed, update the manifest to identify the next personalized video segment and any nonpersonalized video segments that occur between the next personalized video segment and another personalized video segment that is still being rendered.

9. The device of claim 1, wherein the personal data associated with the request is received with the request.

10. The device of claim 1, wherein the personal data associated with the request is retrieved from a database using information received with the request.

11. A method comprising:

receiving, at a device, from a communication device, using a communication interface, a request for a personalized video, the device having access to a memory storing;

nonpersonalized video segments; and

data for rendering personalized video segments, the nonpersonalized video segments and the personalized video segments associated with a given order, the data for rendering the personalized video segments including respective video fields to be populated by respective personal data;

causing rendering of at least a subset of the personalized video segments using the data for rendering the personalized video segments by;

populating personal data associated with the request into the video fields of the data for rendering the personalized video segments during the rendering, the personal data comprising data indicative of one or more of text and graphics to be incorporated into the personalized video segments, such that a rendered personalized video segment comprises at least one video frame that includes the personal data at a location of a respective video field;

the rendering of the personalized video segments occurring according to the given order;

generating, and transmitting to the communication device, using the communication interface, a manifest identifying at least a first video segment selected according to the given order;

updating, and transmitting to the communication device, using the communication interface, the manifest to identify, according to the given order, further available video segments, as rendering of each of the personalized video segments is completed; and

providing to the communication device, using the communication interface, as the personalized video, video segments identified in the manifest, in response to receiving requests for the video segments from the communication device.

12. The method of claim 11, further comprising rendering each of the personalized video segments by:

retrieving, from the data for rendering personalized video segments, one or more of a respective prerendered static layer and a respective prerendered non-static layer;

rendering a respective personalized layer using the personal data; and

combining the respective personalized layer with one or more of the respective prerendered static layer and the respective prerendered non-static layer.

13. The method of claim 12, further comprising rendering each of the personalized video segments by:

retrieving, from the data for rendering personalized video segments, transformation data; and

rendering the respective personalized layer using the personal data, and according to the transformation data, such that the respective personalized layer is transformed according to one or more of a previous respective personalized layer and a next respective personalized layer.

14. The method of claim 11, wherein a first available video segment, according to the given order, is a first nonpersonalized video segment, and the method further comprises:

in response to receiving the request, transmitting the manifest identifying the first nonpersonalized video segment.

15. The method of claim 11, further comprising:

causing rendering of the at least a subset of the personalized video segments to occur in parallel.

16. The method of claim 15, further comprising:

causing parallel processing resources to complete rendering of the personalized video segments according to the given order.

17. The method of claim 11, further comprising:

continuing to render the personalized video segments that occur later in the personalized video, according to the given order, while providing, to the communication device, the personalized video segments that occur earlier in the personalized video, as they are completed.

18. The method of claim 11, further comprising:

as rendering of a next personalized video segment is completed, updating the manifest to identify the next personalized video segment and any nonpersonalized video segments that occur between the next personalized video segment and another personalized video segment that is still being rendered.

19. The method of claim 11, wherein the personal data associated with the request is received with the request.

20. The method of claim 11, wherein the personal data associated with the request is retrieved from a database using information received with the request.