Context sensitive adaptable user interface

• US 9,823,824 B2
• Filed: 08/13/2014
• Issued: 11/21/2017
• Est. Priority Date: 08/19/2013
• Status: Active Grant

• Current Assignee: Kodak Alaris Inc (KPP (no. 2) Trustees Ltd.)
• Original Assignee: Kodak Alaris Inc (KPP (no. 2) Trustees Ltd.)
• Inventors: Pasquarette, Stephen James, Manico, Joseph Anthony
• Primary Examiner(s): Nabi, Reza
• Assistant Examiner(s): Rodriguez, Daniel
• Application Number:
  US14/458,953
• Publication Number:
  US 20150052439A1
• Time in Patent Office: 1,196 Days
• Field of Search: 715731
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

A user interface control for an image product creation application is used for adding user supplied text or graphic elements to an image product, wherein the user interface control is responsive to the position relative to a user supplied image, a recognized object within the user supplied image, or an image product related feature, wherein the user interface control provides an indication when the text or graphic elements are positioned proximal to the user supplied image, the recognized object, or the image product related feature, and wherein the user interface control modifies an attribute of the text or graphic elements when placed proximal to the user supplied image, the recognized object, or the image product related feature.

Claims

1. A context and content sensitive user interface system for a computer device, comprising:

a processor equipped device having a display; and

a user interface control for an image product creation application under the control of the processor for adding user selected or supplied text or graphic elements to at least one digital image product;

wherein the user interface control is configured to;

analyze the context and content of the digital image product and recognize a plurality of objects within the digital image product;

allow a user to link the text and/or graphic elements with at least one of the recognized objects within the digital image product;

in response to dragging the text and/or graphic elements within a predetermined distance to any of the plurality of recognized objects, dynamically suggest to the user modifications to at least one attribute of a color, font, size, shape, surround, or background of the text and/or graphic elements in the digital image product based on the analysis of the context and content of the digital image product by the user interface; and

as the user drags the text and/or graphic elements, dynamically indicate by the user interface to the user via visual, haptic, or audio feedback text placement options that are available on any given area of the digital image product, wherein the image product areas includes recognized objects and open spaces including template surround areas for composite images, collages, or album pages, or folds, gutters, or borders for post printing converting, folding, trimming, and binding operations.

2. A method of placing text and/or graphic elements in a digital image product comprising:

providing a context and content sensitive adaptable user interface for the text and/or graphic element placement in a digital image product;

analyzing the context and content of the digital image product and recognizing a plurality of objects within the digital image product;

allowing a user to link the text and/or graphic elements with at least one of the recognized objects within the digital image product;

in response to dragging the text and/or graphic elements within a predetermined distance to any of the plurality of recognized objects, dynamically suggesting to the user modifications to at least one attribute of a color, font, size, shape, surround, or background of the text and/or graphic elements in the digital image product based on the analysis of the context and content of the digital image product by the user interface; and

as the user drags the text and/or graphic elements, dynamically indicating by the user interface to the user via visual, haptic, or audio feedback text placement options that are available on any given area of the digital image product, wherein the image product areas includes recognized objects and open spaces including template surround areas for composite images, collages, or album pages, or folds, gutters, or borders for post printing converting, folding, trimming, and binding operations.

3. The method of claim 2 wherein, as the user drags the text around the layout a plurality of methods are used to convey text and image product associations.

4. The method of claim 3 wherein text conforms and adapts to the spaces and colors of objects recognized in the image.

5. The method of claim 3 further comprising formatting that can be generated around any part of the image allowing the user to make visual choices instead of selecting tools and initiating text formatting modifications.

6. The method of claim 2 wherein the text is added as a top layer of an imaging product enabling the user to touch the text to drag it to a new location on the layout.

7. The method of claim 6 wherein the text is stretched or shrunk to change the size of the text.

8. The method of claim 7 wherein the text is stretched or shrunk using standard multi-finger gestures.

9. The method of claim 7 wherein the text is stretched or shrunk automatically to adapt to the content of the image.

10. The method of claim 2 wherein a visual or audio linking of the text with image content comprises linking with detected faces, animals, objects, clipart, or graphic design elements.

11. The method of claim 2 wherein the digital image product comprises a greeting card.

12. The method of claim 2 wherein, when the user drags the text adjacent to a picture a visual method is used to convey a linkage, including a visual outline around the two elements which flashes or alternate colors to convey that is a linkage indicator.

13. The method of claim 2 wherein the text and the image are linked with a graphic user interface insertion bar or icon to indicate that the image and text are tied together.

14. The method of claim 2 wherein touching a linked text in a defined manner allows the user to modify the text and element linkage.

15. The method of claim 2 wherein the text font automatically adjusts to the image content.

16. The method of claim 2 further comprising using a designated text input area to lock the text to an object in the image.

17. The method of claim 2 further comprising using a drop shadow technique to write the text into sand, snow, foam, bubbles, or foliage in the image.

18. The method of claim 2 further comprising suggesting text based on content analysis of the image.

19. The method of claim 2 further comprising cascading the level of importance of the content in a scene so as not to obscure important content with text.

20. The method of claim 19 wherein foreground faces facing forward are assigned a first priority, foreground faces facing sideways are assigned a second priority, and foreground objects are assigned a third priority.