Display system and virtual web device in the cloud

• US 10,534,852 B2
• Filed: 07/20/2016
• Issued: 01/14/2020
• Est. Priority Date: 09/30/2015
• Status: Active Grant

• Current Assignee: Samsung Display Company Limited (Samsung Electronics Co. Ltd.)
• Original Assignee: Samsung Display Company Limited (Samsung Electronics Co. Ltd.)
• Inventors: Lee, Janghwan, Lu, Ning
• Primary Examiner(s): Nguyen, Maikhanh
• Application Number:
  US15/215,512
• Publication Number:
  US 20170091160A1
• Time in Patent Office: 1,273 Days
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing
• CPC Class Codes: G06F 40/137 Hierarchical processing, e.g. outlines
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G06F 40/205 Parsing
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications
• CPC Class Codes: H04L 67/04 specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network

Abstract

A virtual device for processing Web-based content to be displayed on a remote rendering device includes: a processor implemented by one or more cloud resources; and a memory, and the memory stores instructions that, when executed, cause the processor to: receive the content; detect an attribute of the remote rendering device and process the content according to the detected attribute; analyze the content to construct a render tree corresponding to the content; prepare render tree data for rendering by the remote rendering device, the render tree data corresponding to the constructed render tree; and transmit the render tree data over a communication network to the remote rendering device.

Claims

1. A virtual device for processing Web-based content to be displayed on a remote rendering device, the virtual device comprising:

a processor implemented by one or more cloud resources; and

a memory, wherein the memory stores instructions that, when executed, cause the processor to;

receive the Web-based content;

detect an attribute of the remote rendering device and process the Web-based content according to the detected attribute, the attribute comprising a form factor data of the remote rendering device and an encoding format of the remote rendering device;

analyze the Web-based content to construct a render tree corresponding to the Web-based content;

prepare render tree data for rendering by the remote rendering device, the render tree data corresponding to the constructed render tree; and

transmit the render tree data over a communication network to the remote rendering device,

wherein the Web-based content is generated by one or more other virtual devices and is received by the virtual device over the communication network, and

wherein the Web-based content comprises data written in HyperText Markup Language (HTML), and the instructions, when executed, further cause the processor to generate at least one of audio data or video data for displaying the Web-based content on the remote rendering device in an audio format, visual format, or an audiovisual format.

2. The virtual device of claim 1, wherein the instructions that cause the processor to prepare the render tree data comprise instructions for packetizing the render tree into data packets prior to transmission of the render tree data.

3. The virtual device of claim 1, wherein the instructions that cause the processor to transmit the render tree data comprise instructions for transmitting the render tree data to a plurality of remote rendering devices having differing form factors from one another.

4. The virtual device of claim 3, wherein the render tree is constructed based on the form factor data.

5. The virtual device of claim 3, wherein the instructions that cause the processor to process the Web-based content comprise instructions for transcoding the Web-based content based on the encoding format.

6. The virtual device of claim 1, wherein the instructions, when executed, further cause the processor to receive input event data from the remote rendering device and to update a user interface of the virtual device based on the input event data.

7. The virtual device of claim 1, wherein the instructions, when executed, further cause the processor to reserve rendering of the Web-based content for the remote rendering device.

8. The virtual device of claim 1, wherein the Web-based content comprises Web of Things (WoT) data generated by a remote WoT device.

9. A rendering device for displaying Web-based content, the rendering device comprising:

a processor; and

a memory, wherein the memory stores instructions that, when executed, cause the processor to;

transmit, over a communication network, information about the rendering device to a cloud resource, wherein the information about the rendering device comprises information corresponding to a form factor data of the rendering device and an encoding format of the rendering device;

receive, over the communication network, data packets corresponding to a render tree constructed by the cloud resource, the render tree representing the Web-based content;

reconstruct the render tree from the data packets;

compute layout data of nodes of the render tree, the nodes representing a structure of the Web-based content; and

traverse the render tree to paint the nodes on a display screen of the rendering device,

wherein the Web-based content is generated by one or more other cloud resources and is received by the cloud resource over the communication network, and

wherein the Web-based content comprises data written in HyperText Markup Language (HTML), and the instructions, when executed, further cause the cloud resource to generate at least one of audio data or video data for displaying the Web-based content on the rendering device in an audio format, visual format, or an audiovisual format.

10. The rendering device of claim 9, wherein the information about the rendering device further comprises information corresponding to at least one of:

a supported video codec, a supported audio codec, Web Graphics Library (WebGL) support, or Web Computing Language (WebCL) support.

11. The rendering device of claim 9, wherein the instructions that cause the processor to receive the data packets from the cloud resource comprise instructions for de-packetizing the data packets.

12. The rendering device of claim 9, wherein the instructions, when executed, further cause the processor to receive input event data from an input device, and to transmit the input event data to the cloud resource.

13. The rendering device of claim 9, wherein the rendering device is a display-only device.

14. The rendering device of claim 9, wherein the rendering device is devoid of a DOM tree constructor.

15. The rendering device of claim 9, wherein the Web-based content comprises WoT data.

16. A Web of Things (WoT) device for processing WoT data to be displayed on a remote rendering device, the WoT device comprising:

a processor; and

a memory, wherein the memory stores instructions that, when executed, cause the processor to;

receive the WoT data;

detect an attribute of the remote rendering device and process the WoT data according to the detected attribute, the attribute comprising a form factor data of the remote rendering device and an encoding format of the remote rendering device;

analyze the WoT data to construct a render tree corresponding to the WoT data;

prepare render tree data for rendering by the remote rendering device, the render tree data corresponding to the constructed render tree; and

transmit the render tree data over a communication network to the remote rendering device,

wherein the WoT data is generated by one or more other WoT devices and is received by the WoT device over the communication network, and

wherein the WoT data comprises data written in HyperText Markup Language (HTML), and the instructions, when executed, further cause the processor to generate at least one of audio data or video data for displaying the WoT data on the remote rendering device in an audio format, visual format, or an audiovisual format.

17. A system for processing Web-based content to be displayed, the system comprising:

a first processor implemented on one or more cloud resources;

a second processor on a remote rendering device; and

a memory, wherein the memory stores instructions that, when executed, cause the first processor to;

receive the Web-based content;

detect an attribute of the remote rendering device and process the Web-based content according to the detected attribute, the attribute comprising a form factor data of the remote rendering device and an encoding format of the remote rendering device;

analyze the Web-based content to construct a render tree corresponding to the Web-based content; and

transmit render tree data corresponding to the constructed render tree over a communication network, to the remote rendering device,

wherein the memory further stores instructions that, when executed, cause the second processor to;

receive the render tree data as data packets;

reconstruct the render tree from the data packets;

compute layout data of nodes of the render tree, the nodes representing a structure of the Web-based content; and

traverse the render tree to paint the nodes on a display screen of the remote rendering device,

wherein the Web-based content is generated by one or more other cloud resources and is received by the one or more cloud resources over the communication network, and

wherein the Web-based content comprises data written in HyperText Markup Language (HTML), and the instructions, when executed, further cause the first processor to generate at least one of audio data or video data for displaying the Web-based content on the remote rendering device in an audio format, visual format, or an audiovisual format.