Semi-automatic organic layout for media streams

• US 9,582,160 B2
• Filed: 11/14/2013
• Issued: 02/28/2017
• Est. Priority Date: 11/14/2013
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Circlaeys, Eric, Bronder, Kjell, Weber, Ralf
• Primary Examiner(s): Bashore, William
• Assistant Examiner(s): PARCHER, DANIEL W
• Application Number:
  US14/080,522
• Publication Number:
  US 20150135069A1
• Time in Patent Office: 1,202 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images

Abstract

In order to display a set of media items in a visually pleasing manner, the relationship between the set of media items and a plurality of predefined media arrangements may be determined. A score corresponding to the set of media items may be compared to a score corresponding to each of the predefined media arrangements. The media item score and the media arrangement scores may be based on properties of the media items and properties of the media arrangements, respectively. The media arrangement that is most closely related to the set of media items may be identified based on the score comparison and the media items may be displayed in the identified media arrangement.

Claims

1. A non-transitory program storage device, readable by a processor and comprising instructions stored thereon to cause one or more processors to:

identify a set of media arrangements, wherein each media arrangement is assigned an array of media arrangement score values that represent one or more properties of each of the media arrangements, and wherein each media arrangement comprises a layout for arranging media items;

generate an array of media score values for a set of media items that represents one or more properties of the media items in the set of media items;

compare the array of media score values with each of the arrays of media arrangement score values to generate arrays of comparison score values, wherein each array of comparison score values represents mismatches between the array of media score values and one of the arrays of media arrangement score values, and wherein the comparison includes penalizing for mismatches between the number of media items in the set of media items and a number of media frames in each of the media arrangements;

identify a media arrangement to display the set of media items based, at least in part, on the arrays of comparison score values; and

provide one or more instructions to display the set of media items using the identified media arrangement.

2. The non-transitory program storage device of claim 1, wherein the instructions to cause the one or more processors to identify the set of media arrangements comprise instructions to cause the one or more processors to:

identify the plurality of media arrangements that correspond to one or more page layouts;

identify one or more groups corresponding to each of the one or more page layouts; and

identify one or more derivatives corresponding to each of the one or more groups.

3. The non-transitory program storage device of claim 1, wherein the instructions to cause the one or more processors to generate an array of media score values comprise instructions to cause the one or more processors to evaluate an aspect ratio of each of the one or more media items in the set of media items.

4. The non-transitory program storage device of claim 1, wherein the array of media arrangement score values for each of the media arrangements is dependent on at least one score function for at least one media frame that forms each of the media arrangements.

5. The non-transitory program storage device of claim 1, wherein the instructions to cause the one or more processors to generate an array of media score values comprise instructions to cause the one or more processors to generate an ordered set of values, and wherein the ordered set of values corresponds to the media items in the set of media items.

6. The non-transitory program storage device of claim 1, wherein the instructions to cause the one or more processors to compare the array of media score values with each of the arrays of media arrangement score values comprise instructions to cause the one or more processors to perform a logical operation on the array of media score values and each of the arrays of media arrangement score values.

7. The non-transitory program storage device of claim 1, wherein the instructions further cause the one or more processors to identify the number of media items supported by each of the media arrangements by determining a maximum number of media items supported by the set of media arrangements and a minimum number of media items supported by the set of media arrangements.

8. The non-transitory program storage device of claim 7, wherein the instructions further cause the one or more processors to obtain the set of media items and a plurality of other sets of media items based on the maximum number of media items and the minimum number of media items supported by the set of media arrangements.

9. A method, comprising:

identifying, using one or more processors, a set of media arrangements, wherein each media arrangement is associated with an array of media arrangement score values determined from one or more properties of each of the media arrangements, and wherein each media arrangement is a layout for arranging media items;

generating for a set of media items, using the one or more processors, an array of media score values based, at least in part, on one or more properties of the media items in the set of media items;

comparing, using the one or more processors, the array of media score values with each of the arrays of media arrangement score values to generate arrays of comparison score values, wherein each array of comparison score values represents mismatches between the array of media score values and one of the arrays of media arrangement score values, and wherein the comparing includes penalizing for mismatches between the number of media items in the set of media items and a number of media frames in each of the media arrangements;

identifying, using the one or more processors, a media arrangement to display the set of media items based, at least in part, on the arrays of comparison scores; and

providing, using the one or more processors, one or more instructions to display the media items in the identified media arrangement.

10. The method of claim 9, wherein each of the arrays of media arrangement score values is based on at least one score function for at least one media frame used to form each of the media arrangements.

11. The method of claim 9, wherein the array of media score values comprises an ordered set of binary values, the binary values corresponding to orientations of media items in the set of media items.

12. The method of claim 9, wherein comparing the array of media score values with each of the arrays of media arrangement score values comprises performing a binary logic operation on corresponding values in the array of media score values and each of the arrays of media arrangement score values to generate the arrays of comparisons score values, each array of comparison score values comprising an ordered set of binary values.

13. The method of claim 9, further comprising identifying, using the one or more processors, the number of media items supported by each of the media arrangements by determining a maximum number of media items supported by the set of media arrangements and a minimum number of media items supported by the set of media arrangements.

14. The method of claim 13, further comprising obtaining the set of media items and a plurality of other sets of media items based on the maximum number of media items and the minimum number of media items supported by the set of media arrangements.

15. A system, comprising:

a memory;

a display device; and

one or more processors operatively coupled to the memory and the display device and configured to execute program code stored in the memory to cause the one or more processors to;

determine an array of media arrangement score values for each of a set of media arrangements that is based on one or more properties of the media arrangements, wherein each media arrangement is a layout for arranging media items;

divide a set of media items into one or more media item subsets;

generate an array of media score values for each of the one or more media item subsets based, at least in part, on one or more properties of the media items;

compare the array of media score values for each of the media item subsets with each of the arrays of media arrangement score values to generate arrays of comparison score values, wherein each array of comparison score values distinguishes mismatches between the array of media score values and one of the arrays of media arrangement score values, and wherein the comparison includes penalizing for mismatches between the number of media items in the set of media items and a number of media frames in each of the media arrangements;

identify a media item subset-media arrangement pair that is most closely related based, at least in part, on the arrays of comparison scores; and

assign each media item in the media item subset of the identified pair to a corresponding media frame of the media arrangement of the identified pair for display on the display device.

16. The system of claim 15, wherein the program code to cause the one or more processors to divide a set of media items into one or more media item subsets comprises program code to determine a maximum number of media items and a minimum number of media items supported by the set of media arrangements, wherein the number of media item subsets is based on the difference of the maximum number of media items and the minimum number of media items.

17. The system of claim 15, wherein each of the arrays of media arrangement score values is based on at least one score function for at least one media frame that forms each of the media arrangements.

18. The system of claim 17, wherein the program code to cause the one or more processors to generate an array of media score values for each of the one or more media item subsets comprises program code to cause the one or more processors to generate an ordered set of binary values, the binary values corresponding to orientations of media items in the media item subset, wherein the binary values are ordered according to an order of the media items in the media item subset.

19. The system of claim 18, wherein the program code to cause the one or more processors to compare the array of media score values for each of the media item subsets with each of the arrays of media arrangement values to generate arrays of comparison scores comprises program code to cause the one or more processors to perform a logical operation on the array of media score values and the arrays of media arrangement score values.