Methods and arrangements relating to signal rich art

• US 9,563,970 B2
• Filed: 01/14/2011
• Issued: 02/07/2017
• Est. Priority Date: 01/15/2010
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Davis, Bruce L., Haaga, Donald, Reed, Alastair M., Rodriguez, Tony F.
• Primary Examiner(s): Hong, Stephen
• Assistant Examiner(s): LUDWIG, MATTHEW J
• Application Number:
  US13/007,372
• Publication Number:
  US 20110214044A1
• Time in Patent Office: 2,216 Days
• Field of Search: 715/201, 715/202, 715/208, 715/273, 715/203, 715/731, 713/176, 382/175
• US Class Current: 1/1
• CPC Class Codes: G06F 21/64 Protecting data integrity, e.g. using checksums, certificates or signatures
• CPC Class Codes: G06F 2221/2119 Authenticating web pages, e.g. with suspicious links
• CPC Class Codes: G06F 2221/2151 Time stamp
• CPC Class Codes: G06F 30/00 Computer-aided design [CAD]
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/40 Filling a planar surface by adding surface attributes, e.g. colour or texture
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 11/80 Creating or modifying a manually drawn or painted image using a manual input device, e.g. mouse, light pen, direction keys on keyboard
• CPC Class Codes: H04N 1/32149 Methods relating to embedding, encoding, decoding, detection or retrieval operations

Abstract

Art is infused with network identifiers at the time of its creation, rather than as a post-process. The identifiers may be encoded as overt elements of the art, and enable the artist to reprogram—over time—an augmentation of the artwork experience via network-delivered components. These network components can include stimuli present when the artist created the work (e.g., music), commentary by the artist, video and augmented reality features, audience-crowdsourced content (e.g., imagery of, or feedback provided by, other viewers encountering the artwork), etc. The artwork augmentation can vary with the user'"'"'s context (e.g., location, demographics, interests, history). Physical brushes can be equipped to insert such identifiers in graphic arts; other authoring tools are disclosed as well. The network experience can be delivered via smartphones, projectors, and other devices. A great number of other features and arrangements are also detailed.

Claims

1. Program instructions stored on a non-transitory computer readable medium, and operative to configure a programmable processing system for authoring content to perform the following acts:

present a graphical user interface that provides plural authoring tools enabling a user to define elements of an artwork, including enabling the user to select a first visual element from among plural available visual elements, and insert the first visual element into the artwork as part of creation of the artwork, the first visual element being drawn from a list;

a brush stroke, a line, a pattern, a texture, or text, said first visual element of the artwork including a signal that encodes an identifier, said identifier enabling identification in a data structure of network-based response information associated with said first element of the artwork, wherein as the user creates the visual appearance of the artwork, the artwork is also adapted to enable network linking, and wherein another of said available visual elements does not include a signal that encodes an identifier;

present a graphical user interface that enables the user to define a user-selected network-based response that should be made available for presentation to a person who captures imagery depicting said first element of the artwork using a camera-equipped portable device; and

store information about said user-selected network-based response in said data structure, in association with said identifier encoded in the signal included with the selected first visual element;

wherein the configured system is adapted for use both to create an artwork, and also to define a network-based experience for presentation to persons who capture imagery depicting the artwork using camera-equipped portable devices.

2. The program instructions stored on a computer readable medium of claim 1 wherein the user-selected network-based response comprises an audio response.

3. The program instructions stored on a computer readable medium of claim 1, wherein the artwork includes two different elements that are assigned different identifiers, each of the identifiers is associated with a different network-based response.

4. The program instructions stored on a computer readable medium of claim 1, in which one of said plural authoring tools comprises a paintbrush tool that lays down pixels, or defines a vector graphic, having a patterned arrangement, the patterned arrangement conveying both said identifier and also a steganographically-encoded calibration pattern that aids in decoding of the identifier from the artwork.

5. The program instructions stored on a computer readable medium of claim 1, wherein the user-selected network-based response varies in response to differing persons who capture imagery depicting the artwork, so that a first person capturing imagery of the artwork is presented with a first response, and a second person capturing imagery of the artwork is presented with a second, different, response, because the person capturing imagery of the artwork has changed from the first person to the second person.

6. A method for authoring an artwork, the method comprising:

providing, in a graphical user interface, a first tool configured to be manipulated by a user to select a first visual element, from among plural available visual elements, for insertion into an artwork as part of creation of the artwork, the first visual element being drawn from a list;

a brush stroke, a line, a pattern, a texture, or text, said first visual element of the artwork including a signal that encodes an identifier, said identifier enabling identification in a data structure of network-based response information associated with said first element of the artwork, wherein as the user creates the visual appearance of the artwork, the artwork is also adapted to enable network linking, and wherein another of said available visual elements does not include a signal that encodes an identifier;

providing, in a graphical interface, a second tool for manipulation by the user to define a user-selected network-based response that should be made available for presentation to a person who captures imagery depicting said first artwork element using a camera-equipped portable device; and

storing information about said user-selected network-based response in said data structure, in association with said identifier encoded in the signal included with the selected first visual element;

wherein the method is useful in both creating an artwork, and also in defining a network-based experience for presentation to persons who capture imagery depicting the artwork using camera-equipped portable devices.

7. The method of claim 6, wherein the user-selected network-based response comprises an audio response.

8. The method of claim 6, wherein the artwork includes two different elements having different identifiers assigned thereto, said identifiers being associated with two different network-based responses.

9. The method of claim 6, in which said first tool comprises a paintbrush tool that lays down pixels, or defines a vector graphic, having a patterned arrangement, the patterned arrangement conveying both said identifier and also a steganographically-encoded calibration pattern that aids in decoding of the identifier from the artwork.

10. The method of claim 6, wherein the user-selected network-based response varies in response to differing persons capturing imagery of the artwork, so that a first person is presented with a first response, and a second person is presented with a second, different, response, because the person capturing imagery of the artwork has changed from the first person to the second person.

11. The method of claim 6, in which the user-selected network-based response is defined by an association between the first artwork element and stored information about said response, wherein the stored information defines temporal information about an order by which different network based responses are to be rendered to persons who capture imagery of the artwork, wherein a person who captures imagery of the artwork at a first time is presented with a first network-based response, based on an association between the first artwork element and first stored information, and a person who captures imagery of the artwork at a second time, later than the first time, is presented with a second, different, network-based response, based on an association between the first artwork element and second stored information.

12. A work of visual art presented on a tangible display or medium, produced by the method of claim 11.

13. The method of claim 6 in which said first and second tools are both provided in the same graphical user interface.

14. A method employing a computer system for authoring product packaging label artwork, the method comprising the acts:

providing, in a graphical user interface of said computer system, a first tool configured to be manipulated by a user to select a first visual element, from among plural available visual elements, for insertion into product packaging label artwork as part of creation of the artwork, the first visual element being drawn from a list;

a brush stroke, a line, a pattern, a texture, or text, said first visual element of the product packaging label artwork having an identifier assigned thereto and steganographically encoded therein, wherein as the user creates the visual appearance of the label artwork, the artwork is also being steganographically encoded with the identifier, and wherein another of said available visual elements does not have an identifier steganographically encoded therein;

determining whether the product packaging label artwork is deficient in terms of recognizability of its steganographically-encoded identifier;

in response to a determination that the artwork is deficient in terms of said recognizability, adjusting the artwork to enhance recognizability of its steganographically-encoded identifier;

providing, in a graphical interface, a second tool for manipulation to define a network-based response that should be made available for presentation to persons who capture imagery of the label using camera-equipped portable devices, where said devices extract said steganographically-encoded identifier; and

storing information about said defined network-based response in association with said identifier;

wherein the method is useful in both creating product packaging label artwork that is suitable for reliable identification, and also in defining a network-based experience for presentation to persons who capture imagery of the product packaging label artwork using said camera-equipped portable devices.

15. The method of claim 14 wherein the product packaging label artwork includes two different elements having different identifiers assigned thereto, said identifiers being associated with two different network-based responses.

16. The method of claim 14 in which said first tool comprises a paintbrush tool that lays down pixels, or defines a vector graphic, having a patterned arrangement, the patterned arrangement conveying both said identifier and also a steganographically-encoded calibration pattern that aids in decoding of the identifier from the product packaging label artwork.

17. The method of claim 14 wherein the network-based response varies in response to differing persons capturing imagery of the product packaging label artwork, so that a first person capturing imagery of the product packaging label artwork is presented with a first response, and a second person capturing imagery of the product packaging label artwork is presented with a second, different, response.

18. The method of claim 14 in which the network-based response is defined by an association between the first artwork element of the product packaging label artwork and stored information about said response, wherein the stored information defines temporal information about an order by which different network based responses are to be rendered to persons who capture imagery of the artwork, wherein a person capturing imagery of the product packaging label artwork at a first time is presented with a first network-based response, based on an association between the first artwork element of the product packaging label artwork and first stored information, and a person capturing imagery of the product packaging label artwork at a second time, later than the first time, is presented with a second, different, network-based response, based on an association between the first artwork element of the product packaging label artwork and second stored information.

19. The method of claim 14 in which said first and second tools are both provided in the same graphical user interface of said computer system.

20. The method of claim 14 that includes, when such determination finds the artwork to be deficient, automatically adjusting the artwork to enhance recognizability of its steganographically-embedded identifier.

21. The method of claim 14 that further includes rendering said artwork by printing on a label.

22. The method of claim 14 that further includes presenting, to the user, a graphical map that indicates relative strength of the steganographic encoding across the artwork.