INTELLIGENT BUFFERING OF LARGE-SCALE VIDEO

• US 20170178601A1
• Filed: 12/22/2015
• Published: 06/22/2017
• Est. Priority Date: 12/22/2015
• Status: Active Grant

• Current Assignee: JBF Interlude 2009 Ltd.
• Original Assignee: JBF Interlude 2009 Ltd.
• Inventors: Bloch, Jonathan, Feldman, Barak, Zubalsky, Tal, Benari, Alon, Hofshy, Yuval
• Granted Patent: US 11,164,548 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2360/127 Updating a frame memory using a transfer of data from a source area to a destination area
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: G09G 5/395 Arrangements specially adapted for transferring the contents of the bit-mapped memory to the screen G09G5/399 takes precedence

Abstract

In a method and supporting system for intelligent buffering of large scale videos, a video presentation includes a plurality of sub-videos, each associated with a field of view. During presentation of the large scale video, sub-videos within a user'"'"'s field of view are loaded and presented to the user, and sub-videos in proximate fields of view are loaded for potential presentation. On identifying a change in the user'"'"'s field of view to one of the proximate fields of view, sub-videos are loaded for presentation within the new field of view. In a method and supporting system for seamless transitions in large scale videos, a video having a plurality of sub-videos is provided for presentation to a user, and distraction levels based on video content and user interactions are tracked. A transition point for the video is identified based on one or both transaction levels, and a sub-video is changed to a different sub-video at the transition point.

Claims

1. A computer-implemented method comprising:

storing at least a portion of a video presentation comprising a plurality of sub-videos, each sub-video associated with one of a plurality of fields of view;

identifying a first field of view of a user viewing the video presentation;

loading one or more first sub-videos for presentation within the first field of view;

loading one or more second sub-videos associated with one or more fields of view proximate to the first field of view;

identifying a change in the field of view of the user to a second field of view; and

loading at least one of the second sub-videos for presentation within the second field of view.

2. The method of claim 1, wherein a particular sub-video comprises a plurality of video frames, each frame comprising a portion of a frame of a larger video.

3. The method of claim 1, wherein a particular sub-video comprises a plurality of video frames, each frame comprising a first portion at a first resolution and a second portion at a second resolution lower than the first resolution.

4. The method of claim 1, wherein the change in the field of view is based on an interaction of the user with the video presentation.

5. The method of claim 4, wherein the interaction comprises at least one of a head movement and an eye movement.

6. The method of claim 1, wherein the at least one of the second sub-videos is associated with the second field of view.

7. The method of claim 1, further comprising loading one or more third sub-videos associated with one or more fields of view proximate to the second field of view.

8. The method of claim 7, wherein the loading of the third sub-videos is performed at an increased speed relative to further loading of the second sub-videos.

9. The method of claim 7, further comprising stopping loading of the first sub-videos.

10. The method of claim 1, wherein the first sub-videos comprise a sub-video for immediate presentation within the first field of view and one or more different sub-videos for potential presentation within the first field of view.

11. The method of claim 10, further comprising identifying a transition in presentation within the first field of view, the transition being from the sub-video for immediate presentation to one of the different sub-videos, the transition being based on an interaction of the user.

12. The method of claim 11, wherein the interaction comprises at least one of a head movement, an eye movement, speech, a hand movement, an arm movement, and an input from a control device.

13. The method of claim 10, wherein the loading of the different sub-videos is based on at least one of a current field of view of the user and a probability that the user will have a particular field of view.

14. The method of claim 1, wherein the second sub-videos comprise a sub-video for immediate presentation within the second field of view and one or more other sub-videos for potential presentation within the second field of view.

15. The method of claim 1, further comprising associating a weight with each sub-video being loaded based on a probability of that sub-video being viewed by the user, wherein a loading speed of a particular sub-video is based at least in part on the weight associated therewith.

16. A system comprising:

at least one memory storing computer-executable instructions; and

at least one processor for executing the instructions stored on the memory, wherein execution of the instructions programs the at least one processor to perform operations comprising;

storing at least a portion of a video presentation comprising a plurality of sub-videos, each sub-video associated with one of a plurality of fields of view;

identifying a first field of view of a user viewing the video presentation;

loading one or more first sub-videos for presentation within the first field of view;

loading one or more second sub-videos associated with one or more fields of view proximate to the first field of view;

identifying a change in the field of view of the user to a second field of view; and

loading at least one of the second sub-videos for presentation within the second field of view.

17. The system of claim 16, wherein a particular sub-video comprises a plurality of video frames, each frame comprising a portion of a frame of a larger video.

18. The system of claim 16, wherein a particular sub-video comprises a plurality of video frames, each frame comprising a first portion at a first resolution and a second portion at a second resolution lower than the first resolution.

19. The system of claim 16, wherein the change in the field of view is based on an interaction of the user with the video presentation.

20. The system of claim 19, wherein the interaction comprises at least one of a head movement and an eye movement.

21. The system of claim 16, wherein the at least one of the second sub-videos is associated with the second field of view.

22. The system of claim 16, wherein the operations further comprise loading one or more third sub-videos associated with one or more fields of view proximate to the second field of view.

23. The system of claim 22, wherein the loading of the third sub-videos is performed at an increased speed relative to further loading of the second sub-videos.

24. The system of claim 22, wherein the operations further comprise stopping loading of the first sub-videos.

25. The system of claim 16, wherein the first sub-videos comprise a sub-video for immediate presentation within the first field of view and one or more different sub-videos for potential presentation within the first field of view.

26. The system of claim 25, wherein the operations further comprise identifying a transition in presentation within the first field of view, the transition being from the sub-video for immediate presentation to one of the different sub-videos, the transition being based on an interaction of the user.

27. The system of claim 26, wherein the interaction comprises at least one of a head movement, an eye movement, speech, a hand movement, an arm movement, and an input from a control device.

28. The system of claim 25, wherein the loading of the different sub-videos is based on at least one of a current field of view of the user and a probability that the user will have a particular field of view.

29. The system of claim 16, wherein the second sub-videos comprise a sub-video for immediate presentation within the second field of view and one or more other sub-videos for potential presentation within the second field of view.

30. The system of claim 16, wherein the operations further comprise associating a weight with each sub-video being loaded based on a probability of that sub-video being viewed by the user, wherein a loading speed of a particular sub-video is based at least in part on the weight associated therewith.