Image collage authoring

• US 9,152,292 B2
• Filed: 02/05/2009
• Issued: 10/06/2015
• Est. Priority Date: 02/05/2009
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Xiao, Jun, Atkins, C. Brian, Zhang, Xuemei, Cheatle, Phil, Gao, Yuli
• Primary Examiner(s): Tran, Tuyetlien
• Assistant Examiner(s): DUCKWORTH, JIANMEI F
• Application Number:
  US12/366,616
• Publication Number:
  US 20100199227A1
• Time in Patent Office: 2,434 Days
• Field of Search: 715/863, 715/800
• US Class Current: 1/1
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/1296 Printer job scheduling or printer resource handling
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: H04N 2201/0082 Image hardcopy reproducer H04N2201/0091 - H04N2201/0094 take precedence

Abstract

A user interface that includes a catalog area, a collage mock-up area, and a mode select interface control operable to select an operational state of the user interface is displayed. Thumbnails of respective images are shown in the catalog area. A layout of a subset of the images is presented in the collage mock-up area. In response to the receipt of a user input gesture and a determination that the user interface is in a first operational state, a first action type is performed based on the type of the received user input gesture and the object type of the target object. In response to the receipt of the user input gesture and a determination that the user interface is in a second operational state, a second action type is performed based on the type of the received user input gesture and the object type of the target object.

Claims

1. A method, comprising:

on a display, displaying a user interface comprising a catalog area, a collage mock-up area, and a mode select interface control operable to select an operational state of the user interface;

displaying thumbnails of images in the catalog area;

presenting a subset of the images in a layout over respective portions of the collage mock-up area, the collage mock-up area including a mock-up background object selectable to change the layout of the subset of the images;

receiving a user input gesture on a target object displayed on the user interface, the user input gesture being one of multiple types of user input gestures, the target object being one of multiple object types;

determining whether the user interface is in a first or a second operational state;

in response to determining that the user interface is in the first operational state, performing a first action, selected from a first set of actions corresponding to the first operational state, based on (i) the type of the received user input gesture, and (ii) the object type of the target object;

in response to determining that the user interface is in the second operational state, performing a second action, selected from a second set actions corresponding to the second operational state, based on (i) the type of the received user input gesture, and (ii) the object type of the target object; and

in response to a point-and-click gesture on the mock-up background object, changing the layout from a current layout to a new layout for the subset of the images.

2. The method of claim 1, wherein the multiple types of user input gestures comprise point-and-click gestures, drag-and-drop gestures, and scroll gestures.

3. The method of claim 1, wherein the multiple object types comprise the collage mock-up area, the model select interface control, the thumbnails of the images, an album icon displayed in the catalog area, and each of the subset of the images in the layout.

4. The method of claim 1, wherein:

when the user interface is in the first operational state, changing the layout comprises maintaining relative sizes and positions of each of the subset of the images in the layout while changing the layout between (i) a straight layout in which respective edges of adjacent images in the subset are parallel across respective dimensions of the layout, and (ii) a tilted layout in which the respective edges of the adjacent images in the subset are non-parallel across the respective dimensions of the layout; and

when the user interface is in the second operational state, changing the layout comprises changing at least one of a relative size and a relative position of one or more of the images in the subset.

5. The method of claim 1, wherein:

when the user interface is in the first operational state and the received user input gesture is a point-and-click gesture on a target one of the subset of the images presented in the collage mock-up area, the first action comprises selecting the target image; and

when the user interface is in the second operational state and the received user input gesture is a point-and-click gesture on one of the subset of the images presented in the collage mock-up area, the second action comprises creating a modified image of the target image and replacing the target image with the modified image in the layout.

6. The method of claim 5, wherein creating the modified image comprises at least one of:

(i) automatically cropping the target image, and (ii) automatically enhancing the target image.

7. The method of claim 1, wherein the catalog area comprises an album area and an image area, the album area comprising an album icon associated with a collection of images corresponding to the displayed thumbnails, the thumbnails being displayed in the image area.

8. The method of claim 7, wherein:

when the user interface is in the second operational state and the received user input gesture is a point-and-click gesture on the album icon, the second action comprises (i) automatically selecting an image from the collection, (ii) adding the selected image to the subset of the images to produce a new subset of the images, (iii) selecting a different layout for the new subset of the images, and (iv) presenting the different layout in the collage mock-up area.

9. The method of claim 7, wherein:

when the user interface is in the second operational state and the received user input gesture is a point-and-click gesture on a target one of the thumbnails shown in the image area, the second action comprises automatically rearranging the thumbnails shown in the image area according to a similarity between the target thumbnail and other thumbnails corresponding to the collection of images.

10. The method of claim 1, wherein presenting the subset of the images in the layout comprises presenting each respective one of the subset of the images in a respective frame that defines a boundary around the respective image in the layout.

11. The method of claim 10, wherein:

when the user interface is in the first operational state and the received user input gesture is a drag-and-drop gesture defining a movement of the respective image within the respective frame from a first position to a second position within the respective frame, the first action comprises repositioning the respective image within the respective frame to define a different view of the respective image through the respective frame.

12. The method of claim 10, wherein:

when the user interface is in the first operational state and the received user input gesture is a drag-and-drop gesture defining a movement of the respective image within the respective frame from a first position to a second position over a second respective image in the subset within a second respective frame of the layout, the first action comprises swapping positions of the respective image and the second respective image in the layout.

13. The method of claim 10, wherein:

when the user interface is in the first operational state and the received user input gesture is a scroll gesture with respect to the respective image, the first action comprises re-sizing a region of the respective image presented through the respective frame.

14. The method of claim 1, wherein:

when the user interface is in the second operational state and the received user input gesture is a drag-and-drop gesture defining a movement of a first image in the subset from a first position to a second position over a second image in the subset, the second action comprises swapping relative positions of the first and second images in the layout; and

swapping the relative positions comprises (i) determining a different layout of the images that exchanges the relative positions of the first and second images and maintains relative positions of the other images in the subset, and (ii) presenting the different layout in the collage mock-up area.

15. The method of claim 1, wherein:

when the user interface is in the second operational state and the received user input gesture is a drag-and-drop gesture defining a movement of a selected one of the thumbnails from a first position to a second position over a target one of the images in the subset, the second action comprises replacing the target image in the subset with the image corresponding to the selected thumbnail; and

replacing the target image in the subset with the image corresponding to the selected thumbnail produces a new subset of images for presentation in a different layout in the collage mock-up area.

16. The method of claim 15, wherein the different layout comprises the image corresponding to the selected thumbnail being positioned in an equivalent relative position in the layout as the target image.

17. The method of claim 1, wherein:

when the user interface is in the second operational state and the received user input gesture is a scroll gesture with respect to a target one of the images in the subset, the second action comprises (i) re-sizing the target image, (ii) determining a different layout for the subset of the images that accommodates the re-sized target image and maintains relative positions of the images in the layout, and (iii) presenting the different layout in the collage mock-up area.

18. A non-transitory computer-readable medium storing instructions that, when executed by a computer, cause the computer to:

on a display, display a user interface comprising a catalog area, a collage mock-up area, and a mode select interface control operable to select an operational state of the user interface;

display thumbnails of images in the catalog area;

present a subset of the images in a layout over respective portions of the collage mock-up area, the collage mock-up area including a mock-up background object selectable to change the layout of the subset of the images;

receive a user input gesture on a target object displayed on the user interface, the user input gesture being one of multiple types of user input gestures, the target object being one of multiple object types;

determine whether the user interface is in a first or second operational state;

in response to determining that the user interface is in the first operational state, perform a first action, selected from a first set of actions corresponding to the first operational state, based on (i) the type of the received user input gesture, and (ii) the object type of the target object;

in response to determining that the user interface is in the second operational state, perform a second action, selected from a second set actions corresponding to the second operational state, based on (i) the type of the received user input gesture, and (ii) the object type of the target object;

in response to a point-and-click gesture on the mock-up background object, change the layout from a current layout to a new layout for the subset of the images.

19. An apparatus comprising:

a hardware memory storing instructions; and

a hardware processor coupled to the memory to execute the instructions, causing the hardware processor to;

on a display, display a user interface comprising a catalog area, a collage mock-up area, and a mode select interface control operable to select an operational state of the user interface;

display thumbnails of images in the catalog area;

present a subset of the images in a layout over respective portions of the collage mock-up area, the collage mock-up area including a mock-up background object selectable to change the layout of the subset of the images;

receive a user input gesture on a target object displayed on the user interface, the user input gesture being one of multiple types of user input gestures, the target object being one of multiple object types;

determine whether the user interface is in a first or a second operational state;

in response to determining that the user interface is in the first operational state, perform a first action, selected from a first set of actions corresponding to the first operational state, based on (i) the type of the received user input gesture, and (ii) the object type of the target object;

in response to determining that the user interface is in a second operational state, perform a second action, selected from a second set of actions corresponding to the second operational state, based on (i) the type of the received user input gesture, and (ii) the object type of the target object; and

in response to a point-and-click gesture on the mock-up background object, change the layout from a current layout to a new layout for the subset of images.