Associating audio and image data

• US 20040037540A1
• Filed: 04/30/2003
• Published: 02/26/2004
• Est. Priority Date: 04/30/2002
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Adams, Guy De. Warren Bruce, Frohlich, David Mark
• Granted Patent: US 8,059,921 B2
• Time in Patent Office: Days
• US Class Current: 386/96
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 31/006 with video camera or receiver
• CPC Class Codes: G11B 33/0488 in boxes or containers comprising additional sound reproducing or activating means
• CPC Class Codes: G11C 2207/16 Solid state audio
• CPC Class Codes: G11C 7/16 Storage of analogue signals in digital stores using an arrangement comprising analogue/digital [A/D] converters, digital memories and digital/analogue [D/A] converters
• CPC Class Codes: H04N 1/32122 in a separate device, e.g. in a memory or on a display separate from image data
• CPC Class Codes: H04N 2201/3264 of sound signals

Abstract

An audio photograph data storage system stores a printed image and a plurality of audio segments associated with the printed image. The audio segments are arranged in a plurality of audio layers.

Claims

1. A method of storing image data and audio data, said method comprising:

storing data representing an image; and

storing a plurality of individual audio data segments in a plurality of audio layers, each of said audio layers comprising at least one audio data segment;

wherein said plurality of audio data segments are related to said image data.

2. The method as claimed in claim 1, wherein:

said plurality of audio layers are arranged in a hierarchical lattice arrangement.

3. The method as claimed in claim 2, wherein:

within said lattice structure, said image data and audio data are arranged into sets of audio photographs, audio photographs within one of said sets sharing a common theme.

4. The method as claimed in claim 1, wherein:

within a said audio layer, a plurality of said data segments are stored in chronological order.

5. The method as claimed in claim 1, further including capturing at least one of said audio data segment 3 after said image data have been captured.

6. The method as claimed in claim 1, further comprising the step of:

editing at least one said audio layer by modifying a data segment content of said audio layer.

7. The method as claimed in claim 1, wherein said plurality of audio layers are stored such that each said layer stores data of a particular semantic type.

8. The method as claimed in claim 1, wherein said plurality of audio layers are stored such that individual audio layers store an audio data segment having a semantic content selected from the set;

ambient sound;

music;

voice commentary;

conversation.

9. The method as claimed in claim 1, wherein at least one said audio layer include a plurality of audio data segments which are semantically related to each other and which are semantically related to said image data.

10. A method of editing an audio photograph including data representing an image and a plurality of audio layers, each of said audio layers capable of including at least one audio data segment, said editing method comprising:

selecting said image data;

selecting an audio data segment;

comparing semantic content of said audio data segment with a semantic description of each of a plurality of said audio layers;

selecting said audio layer having a data type definition closest to a data content type of said audio data segment; and

storing said audio data segment in said selected audio layer.

11. A method of editing a plurality of audio photographs, each said audio photograph including:

image data; and

a plurality of audio layers including audio associated with said image data;

said method comprising;

displaying a plurality of said images on a display screen;

selecting individual ones of said images;

grouping individual ones of said images together to form one or a plurality of groups of said images; and

displaying a plurality of audio layers associated with said first level display, each of said audio layers including at least one audio data segment.

12. The method as claimed in claim 11, wherein individual ones of said plurality of audio layers include audio data types different from those of each other of said audio layers.

13. The method as claimed in claim 11, further comprising:

displaying one of said groups of images on a display screen, in a second level of display;

displaying a second level of audio including a plurality of audio layers, wherein each of said plurality of audio layers stores audio data of a type that is different from a data type stored in each of said other audio layers.

14. The method as claimed in claim 11, further comprising:

displaying a further level including a single audio data;

displaying a further level of audio, said further level of audio comprising a plurality of audio layers, each of said audio layers including audio data of a type different from an audio data stored in each of other audio layers.

15. A data format for an audio photograph including:

at least one image data; and

a plurality of audio data segments;

said format comprising;

a first file location for storage of said image data file; and

a plurality of audio segment data file locations including a plurality of audio layers, each of said layers comprising a set of said audio data segments.

16. The format as claimed in claim 15 wherein:

each said audio layers includes a set of said audio data segments at positions having a sequential numbering system.

17. The format as claimed in claim 16, wherein each said audio layers includes a set of said audio data segments at positions based on the chronological order in which the audio segment data files were captured.

18. The format as claimed in claim 15, wherein each of said audio layers includes one said sets of audio data segments at playback positions in an order in which said audio segment data files are arranged within said layer.

19. A method of playback of an audio photograph, said audio photograph including:

image data; and

a plurality of audio data segments arranged in a plurality of audio layers, wherein each said audio layer includes audio data segments of a same data type, said method comprising;

playing a first plurality of data segments corresponding to a first of said audio data layers, said first plurality of audio data segments including data content of a first data type; and

playing at least another one of said audio data layers, said another data layer including another plurality of audio data segments including data content of another data type.

20. The method as claimed in claim 19, wherein said first data type and said another data type are selected from the set:

ambient data;

music data;

commentary audio data;

conversation audio data.

21. A method of editing an audio photograph, said audio photograph including:

image data;

a plurality of audio layers, each of said audio layers including at least one audio data segment;

said method comprising the steps of;

selecting said audio photo by selection of said image data;

playing audio data contained in one of said audio layers at a controlled volume level;

during playback of said audio data, recording the volume level at which the audio data are played.

22. The method as claimed in claim 21, further comprising:

selecting one of said audio layers by activating a switch associated with said audio layer, and then controlling the sound volume of the selected layer.

23. A photograph album for storing a plurality of audio photographs, one of said audio photographs including:

an image; and

at least one segment including audio data associated with said image;

said photograph album comprising;

a display region for displaying a plurality of images; and

an audio system for storing a plurality of audio segments that are arranged in a plurality of audio layers, wherein each said audio layer include audio segments of an audio data type different from audio segments of each of the other layers.

24. The photograph album as claimed in claim 23, comprising:

a plurality of said audio layers, wherein the different audio layers store audio segments of the following audio types;

ambient sound;

music;

voice commentary;

voice conversation.

25. A photograph album for storing a plurality of audio prints, one of said audio prints including:

a printed image; and

at least one audio segment including audio data associated with one of said printed images;

said photograph album comprising;

a display region for displaying a plurality of said printed images; and

an audio system for storing a plurality of audio segments arranged in a plurality of audio layers, each of said audio layers including audio segments of an audio data type different from audio segments of each of said other layers.

26. A method of processing physical printed images and associated audio data, said method comprising:

storing at least one of said physical printed images; and

storing a plurality of individual ones of said audio segments in a plurality of audio layers, each of said audio layers comprising at least one audio segment, said audio segment comprising a self-contained item of audio;

said plurality of audio segments being related to said physical printed image.

27. A service of supplying a plurality of audio prints for use in a photograph album, wherein one of said audio prints includes:

at least one physical printed image; and

a plurality of audio segments arranged as a plurality of audio layers, said service comprising;

receiving a plurality of images;

p2 generating a plurality of audio layers, each of said audio layers being capable of storing at least one of said audio segments;

printing said image; and

supplying said plurality of audio layers as electronic data.

28. A service of supplying a plurality of audio photographs including:

at least one image; and

a plurality of audio segments arranged as a plurality of audio layers,

said service comprising;

receiving a plurality of said images;

generating a plurality of audio layers, each of said audio layers storing at least one of said audio segments;

supplying said image data as electronic data; and

supplying said plurality of audio layers as electronic data.

29. An audio photograph data storage system comprising:

means for storing a printed image; and

means for storing a plurality of audio segments associated with said printed image, said plurality of audio segments being arranged in a plurality of audio layers.

30. An audio photograph data storage system comprising a data storage device configured for:

storing a printed image; and

storing a plurality of audio segments associated with said printed image, said plurality of audio segments being arranged in a plurality of audio layers.

31. An audio photograph data storage system comprising a data storage device storing (a) a printed image and (b) a plurality of audio segments associated with said printed image, said plurality of audio segments being arranged in a plurality of audio layers.

32. A memory storing a computer program having program instructions for causing a computer entity to perform the operations of:

storing a printed image;

storing a plurality of audio segments associated with said printed image, said plurality of audio segments being arranged in a plurality of audio layers.

33. Apparatus for storing image data and audio data, comprising:

a memory configured for;

storing image data representing a plurality of images; and

storing a plurality of audio layers such that a plurality of individual audio data segments relating to the data of one of said images can be stored in said audio layers,

wherein said image data and said audio data are arranged into sets of audio photographs each including the data of one of said images and a plurality of said audio layers, wherein audio photographs within said set are semantically related to each other.

34. Apparatus for storing image data and audio data, comprising:

a memory;

storing image data representing a plurality of images; and

storing a plurality of audio layers such that a plurality of individual audio data segments relating to the data of one of said images are stored in said audio layers,

wherein said image data and said audio data are arranged into sets of audio photographs each including the data of one of said images and a plurality of said audio layers, wherein audio photographs within said set are semantically related to each other.

35. A memory storing a computer program having program instructions for causing a computer to

store data representing an image;

store a plurality of audio layers such that a plurality of individual audio data segments relating to said image data can be stored in said audio layers,

arrange said image data and said audio data segments into sets of audio photographs each including said image data and a plurality of said audio layers, and

enable a user to semantically relate the audio photographs within said set to each other.