Video streaming in a web browser

• US 10,565,288 B2
• Filed: 01/20/2017
• Issued: 02/18/2020
• Est. Priority Date: 12/01/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Ramachandran, Vivek V.
• Primary Examiner(s): Shiau, Shen
• Application Number:
  US15/411,378
• Publication Number:
  US 20170132178A1
• Time in Patent Office: 1,124 Days
• CPC Class Codes: G06F 16/748 Hypervideo linking data to content, e.g. by linking an URL to a video object in the context of video distribution systems H04N21/858
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing
• CPC Class Codes: G08B 13/19684 Portable terminal, e.g. mobile phone, used for viewing video remotely
• CPC Class Codes: H04N 21/2355 involving reformatting operations of additional data, e.g. HTML pages optimising the visualization of content for information retrieval from the Internet G06F16/9577; tracking of instant messages H04L51/234; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/472 End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04W 88/06 adapted for operation in multiple networks or having at least two operational modes, e.g. multi-mode terminals

Abstract

A video element of a browser can be moved, resized, etc. independently of the remainder of a browser page. In one embodiment, as the video element is moved, the remainder of the browser page is reformatted so as to change the page'"'"'s layout. The renderer of the content can have a different video provider sourcing the video element than the remainder of the browser page. As a result, two different content streams can be provided to the renderer in parallel. In another embodiment, the video element can be docked, such as through a flick operation or a drag-and-drop operation. Once docked, the browser page can be scrolled while the docked video element remains at a fixed location relative to an edge of the browser page.

Claims

1. A mobile device, comprising:

a processor;

a display screen;

a memory storing code that, when executed by the processor, causes the mobile device to;

receive a first content from a first media provider and a second content from a second media provider, wherein the first content comprises video content and the second content comprises written content;

display the video content in a video element in a browser page on the mobile device;

simultaneous with the display of the video content in the video element, display the written content in a display outside of the video element in the browser page;

locate the video element in a user-controllable docked position;

perceive a user indication to modify the display of the written content;

dynamically modify the display of the written content in response to the user indication, while maintaining the video element in a fixed position relative to an edge of a user interface; and

in response to a user selection of the video element, pass coordinates of the video element from a browser engine to a media engine.

2. The mobile device of claim 1, wherein the user indication to modify the display of the written content comprises an indication to scroll the content and the dynamic modification of the display of the written content comprises scrolling the written content.

3. The mobile device of claim 1, wherein the code, when executed by the processor, further causes the mobile device to reformat the written content to account for a change in position of the video element relative to the written content as the display of the written content is modified.

4. The mobile device of claim 1, wherein the code, when executed by the processor, further causes the mobile device to receive an encoded video stream and the written content from a network using the media engine, and decode the encoded video stream and written content using the media engine.

5. The mobile device of claim 4, wherein the code, when executed by the processor, further causes the mobile device to receive user input selecting the video element while the decoded video stream is playing and switch to a full-screen mode wherein only the decoded video stream from the media engine is rendered.

6. The mobile device of claim 1, wherein passing control includes passing a video element identifier from the browser engine to the media engine and passing the video element identifier from the browser engine to a renderer.

7. The mobile device of claim 1, wherein the user indication includes a drag-and-drop operation or a flick operation.

8. A method, comprising:

sourcing video content from a media engine;

sourcing written content from a browser engine;

receiving in parallel streams, at a renderer, the video content and the written content;

displaying the video content in a video element in a browser page on a mobile device;

displaying the written content in a written content display outside of the video element in the browser page on the mobile device;

receiving user input to move the video element;

in response to the user input, moving the video element to a docked position;

adjusting the written content display, while maintaining the video element in a fixed position relative to an edge of a user interface, wherein the fixed position relative to the edge of the user interface is determined based on the docked position; and

in response to a user selection of the video element, passing coordinates of the video element from the browser engine to the renderer.

9. The method of claim 8, wherein the adjusting the written content display comprises scrolling the written content.

10. The method of claim 8, further comprising receiving an encoded video stream and the written content from a network using the media engine, and further including decoding the encoded video stream and written content using the media engine.

11. The method of claim 10, further comprising receiving user input selecting the video element while the video content is playing and switching to a full-screen mode wherein only the decoded video stream from the media engine is rendered.

12. The method of claim 8, wherein the user input includes a drag-and-drop operation or a flick operation.

13. The method of claim 8, further comprising passing control of the video element from the browser engine to the media engine upon selection of the video element.

14. A mobile phone device, comprising:

a processor;

a display screen;

a memory storing code that, when executed by the processor, causes the mobile phone device to;

source a video content from a media engine;

source a written content from a browser engine;

receive in parallel streams, at a renderer, the video content and the written content;

display the video content in a video element in a browser page on the mobile phone device;

display the written content in a position outside of the video element in the browser page;

receive user input to move the video element;

in response to the user input, move the video element to a docked position;

adjust the position of the written content, while maintaining the video element in a fixed position relative to an edge of a user interface, wherein the fixed position relative to the edge of the user interface is based on the docked position; and

in response to a user selection of the video element, pass coordinates of the video element from the browser engine to the media engine.

15. The mobile phone device of claim 14, wherein the code, when executed by the processor, further causes the mobile phone device to reformat the written content to account for a change in position of the video element relative to the written content as the written content is scrolled.

16. The mobile phone device of claim 14, wherein the code, when executed by the processor, further causes the mobile phone device to receive an encoded video stream and the written content from a network using the media engine, and decode the encoded video stream and written content using the media engine.

17. The mobile phone device of claim 14, further including passing control of the video element from the browser engine to the media engine in response to the user selection of the video element, wherein passing control includes passing a video element identifier from the browser engine to the media engine and passing the video element identifier from the browser engine to the renderer.