Output generation based on semantic expressions

• US 10,380,228 B2
• Filed: 02/10/2017
• Issued: 08/13/2019
• Est. Priority Date: 02/10/2017
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Lee, David
• Primary Examiner(s): Tran, Quoc A
• Application Number:
  US15/430,232
• Publication Number:
  US 20180232340A1
• Time in Patent Office: 914 Days
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G06F 40/186 Templates
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising

Abstract

Disclosed embodiments generally relate to logically describing and modeling the layout of an output (e.g., a document or a presentation) by capturing author intent. Author intent can be captured based on the author'"'"'s selection of visual exemplars (e.g., lists, grids, collages, etc.) with which to express content. Each visual exemplar identifies one or more semantic expressions (e.g., specific, often implied, relationships that are represented in visual exemplars of content) that are represented by those visual exemplars. The identified semantic expressions form a contract that can be observed in any generated output. The output can be formatted and laid out in a variety of different ways (e.g., for a variety of different presentation devices) to provide aesthetic and semantic efficiency in the generated output while maintaining the intent of the author.

Claims

1. A computer-implemented method comprising:

obtaining author input data, wherein obtaining the author input data includes receiving, over a user interface, a selection of a first visual exemplar with which to express content data, the selection conveying an editorial intent of an author of the author input data;

identifying the first visual exemplar expressed by the editorial intent;

identifying a set of semantic expressions expressed by the first visual exemplar, wherein the set of semantic expressions comprises two or more semantic expressions;

identifying a contract subset of the set of semantic expressions; and

generating an output that communicates the content data based on the contract subset, wherein generating the output includes generating an output that expresses the contract subset and varies a non-contract semantic expression,

wherein the first visual exemplar comprises a visual exemplar selected from the group consisting of;

a heading, a sidebar, a list, an outline, a stack, flowing content, a filmstrip, a grid, a comparison, a triptych, a collage, drill-down content, clustered content, gallery, text expressing title, text expressing heading, text expressing caption, text expressing block text, text expressing quotation, text expressing body text, and a visual exemplar demonstrating a relationship between text and media;

wherein the set of semantic expressions comprises a semantic expression selected from the group consisting of;

hierarchy, drill-in, summarization, hyperlink, sidebar, continuity, grouping, uniformity, ordering, emphasis, showcase, text size, text with media, equality, media as background, caption, attribution, block text, quotation, body text, optional, and reveal; and

wherein the set of semantic expressions comprises strict uniformity and strict ordering.

2. The method of claim 1, wherein generating the output that expresses the contract subset and varies the non-contract semantic expression comprises:

selecting a second visual exemplar for the content data, the second visual exemplar expressing the contract subset and varying the non-contract semantic expression,

wherein the output communicates the content data using the second visual exemplar.

3. The method of claim 1, further comprising:

causing a plurality of visual exemplars to be presented to a user at the user interface, wherein the plurality of visual exemplars comprises the first visual exemplar; and

receiving one or more content elements to express based on the first visual exemplar,

wherein the obtained author input data comprises the one or more content elements and the selection of the first visual exemplar.

4. The method of claim 3, wherein the one or more content elements comprise a content element selected from the group consisting of a text content element, an audio content element, a video content element, and an image content element.

5. The method of claim 1,

wherein the first visual exemplar comprises a list;

wherein uniformity expresses an extent of homogeneity of one or more of;

content size, content rotation, and content alignment, to be maintained in content when generating output; and

wherein ordering expresses an extent to which an order of content is to be maintained when generating output.

6. The method of claim 1,

wherein the first visual exemplar comprises a grid;

wherein the set of semantic expressions comprises tight continuity and tight uniformity;

wherein uniformity expresses an extent of homogeneity of one or more of;

content size, content rotation, and content alignment, to be maintained in content when generating output; and

wherein continuity expresses an extent to which content is to be separated when generating output.

7. The method of claim 1, wherein the first visual exemplar represents the editorial intent of the author of the author input data.

8. A computer-implemented method comprising:

obtaining author input data having an author input data visual exemplar, the author input data visual exemplar associated with two or more author input data visual exemplar semantic expressions, wherein obtaining the author input data includes receiving, over a user interface, a selection of the author input data visual exemplar with which to express content data, the selection conveying an editorial intent of an author of the author input data;

obtaining consumer data; and

generating an output based on the editorial intent of the author of the author input data and the consumer data, wherein generating the output comprises;

preserving a contract subset of the author input data visual exemplar semantic expressions in the output; and

varying one or more semantic expressions not in the contract subset,

wherein the author input data visual exemplar comprises a visual exemplar selected from the group consisting of;

a heading, a sidebar, a list, an outline, a stack, flowing content, a filmstrip, a grid, a comparison, a triptych, a collage, drill-down content, clustered content, gallery, text expressing title, text expressing heading, text expressing caption, text expressing block text, text expressing quotation, text expressing body text, and a visual exemplar demonstrating a relationship between text and media; and

wherein the author input data visual exemplar semantic expressions include at least one semantic expression selected from the group consisting of;

hierarchy, drill-in, summarization, hyperlink, sidebar, continuity, grouping, uniformity, ordering, emphasis, showcase, text size, text with media, equality, media as background, caption, attribution, block text, quotation, body text, optional, and reveal; and

wherein the author input data visual exemplar semantic expressions comprises strict uniformity and strict ordering.

9. The method of claim 8, further comprising providing the output to a presentation device, wherein the consumer data comprises one or more presentation device characteristics selected from the group consisting of a resolution, a screen size, a dots-per-inch value, a touch screen characteristic, a paper quality characteristic, and an accessibility characteristic.

10. The method of claim 8, wherein the consumer data comprises data selected from the group consisting of:

distance-to-screen data, presentation mode data, kiosk data, and autoplay data.

11. The method of claim 8, further comprising:

obtaining style data,

wherein generating the output is further based on the style data.

12. The method of claim 11, wherein the style data comprises data selected from the group consisting of:

typography data, color data, decorator data, layout data, and animation data.

13. The method of claim 8, wherein obtaining the author input data comprises:

causing a plurality of visual exemplars to be presented to a user at the user interface, the plurality of visual exemplars including the author input data visual exemplar.

14. The method of claim 13, wherein causing the plurality of visual exemplars to be presented to the user comprises:

causing a first visual exemplar of the plurality of visual exemplars to be presented to the user at the user interface, the first visual exemplar associated with one or more first semantic expressions; and

causing a second visual exemplar of the plurality of visual exemplars to be presented to the user at the user interface, the second visual exemplar associated with second semantic expressions,

wherein the second semantic expressions vary from the one or more first semantic expressions by a single semantic expression.

15. The method of claim 14,

wherein the second semantic expressions comprise uniformity and loose continuity;

wherein the one or more first semantic expressions comprise uniformity and tight continuity;

wherein uniformity expresses an extent of homogeneity of one or more of;

content size, content rotation, and content alignment, to be maintained in content when generating output; and

wherein continuity expresses an extent to which content is to be separated when generating output.

16. A non-transitory computer-readable medium comprising computer-executable instructions stored thereon that, when executed by a processor, cause the processor to:

cause a plurality of visual exemplars to be presented to a user at a user interface;

receive a selection of a first visual exemplar from the plurality of visual exemplars over the user interface with which to express one or more content elements;

identify a set of semantic expressions associated with the first visual exemplar, wherein the set of semantic expressions comprises two or more semantic expressions;

identify a contract subset of the set of semantic expressions;

identify a non-contract subset of the set of semantic expressions, wherein the non-contract subset is disjoint with the contract subset; and

generate an output that communicates content data based on the contract subset and varies at least one semantic expression in the non-contract subset,

wherein the first visual exemplar comprises a visual exemplar selected from the group consisting of;

a heading, a sidebar, a list, an outline, a stack, flowing content, a filmstrip, a grid, a comparison, a triptych, a collage, drill-down content, clustered content, gallery, text expressing title, text expressing heading, text expressing caption, text expressing block text, text expressing quotation, text expressing body text, and a visual exemplar demonstrating a relationship between text and media;

wherein the set of semantic expressions includes at least one semantic expression selected from the group consisting of;

hierarchy, drill-in, summarization, hyperlink, sidebar, continuity, grouping, uniformity, ordering, emphasis, showcase, text size, text with media, equality, media as background, caption, attribution, block text, quotation, body text, optional, and reveal; and

wherein the set of semantic expressions comprises strict uniformity and strict ordering.

17. The non-transitory computer-readable medium of claim 16, wherein of generating the output comprises:

selecting a second visual exemplar for the content data, the second visual exemplar associated with the contract subset and varying at least one semantic expression not in the contract subset,

wherein the output communicates the content data using the second visual exemplar.

18. The non-transitory computer-readable medium of claim 16,

wherein the set of semantic expressions comprises continuity and uniformity;

wherein uniformity expresses an extent of homogeneity of one or more of;

content size, content rotation, and content alignment, to be maintained in content when generating output; and

wherein continuity expresses an extent to which content is to be separated when generating output.

19. The non-transitory, computer-readable medium of claim 16, wherein the first visual exemplar represents an editorial intent of an author of the author input data.

20. The non-transitory, computer-readable medium of claim 16, wherein the instructions further cause the processor to obtain consumer data, wherein generating the output is based, in part, on the obtained consumer data.