Lossless manipulation of media objects

• US 7,142,225 B1
• Filed: 01/31/2002
• Issued: 11/28/2006
• Est. Priority Date: 01/31/2002
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Boler, Sabrina D., Young, Robert D., Getzinger, Thomas W., Gruhl, Robert E., Baker, Karen L.
• Primary Examiner(s): Sajous, Wesner
• Application Number:
  US10/066,167
• Time in Patent Office: 1,762 Days
• Field of Search: 345619-624, 345/473, 345/475, 345/706, 345/723, 345724-725, 345/838, 345/861, 345/327, 345/328, 345/650, 345/654, 345/566, 345/649, 345/652, 345/547, 345/555, 382/52, 382/63, 382/243, 382/232, 382/282, 382295-299, 382/254, 382/291, 382/293, 382305-306, 715/500, 715/530, 715/700, 715/723, 715/732, 707/1, 707/103, 707/104, 707/527
• US Class Current: 345/619
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: H04N 19/48 using compressed domain processing techniques other than decoding, e.g. modification of transform coefficients, variable length coding [VLC] data or run-length data motion estimation in a transform domain H04N19/547; processing of decoded motion vectors H04N19/513
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

An original media object, such as an image, is edited without loss of the data comprising the media object. Changes applied to the media object are defined by metadata associated with the media object. For example, metadata define the cropping of an original JPEG image without loss of the original image. The metadata from a previous editing session can be used to further revising a change to the media object. Preferably, the metadata are stored as a stream in a substorage of an object linking and embedding (OLE) file. For display purposes, and for ease of modification, an edited version of the media object is stored as another stream of data in the substorage of the OLE file. The edited version of the media object is preferably compressed and serves as an intermediate object for faster display during editing and as a surrogate if the original media object is unavailable.

Claims

1. A method for lossless editing of a media object that comprises an image, comprising the steps of:

(a) accessing data defining the media object to produce a representation of the media object;

(b) enabling a user to selectively edit the representation of the media object by applying a modification to the representation, wherein the step of applying the modification comprises the step of cropping the representation of the media object, and then producing metadata that define the modification, said metadata including a size and a position of a crop outline on the representation of the image to indicate limits of a cropped image;

(c) rendering a modified media object in accord with the modification to the representation; and

(d) storing the metadata that define the modification applied to the representation in association with the media object, without modifying the data that define the media object.

2. The method of claim 1, further comprising the steps of:

(a) enabling the user to again selectively edit the representation of the media object, by applying a further modification that changes the limits of the cropped image on the representation of the media object;

(b) updating the metadata to define the modification by indicating new limits of the cropped image; and

(c) rendering the modified media object in accord with the further modification.

3. The method of claim 1, wherein the image is stored in a Joint Photographic Experts Group (JPEG) format.

4. The method of claim 1, wherein the step of storing the metadata comprises the step of storing a stream of the metadata in a substorage of an object linking and embedding (OLE) file.

5. The method of claim 1, wherein the step of rendering comprises the step of rendering the cropped image without portions of the representation that lie outside the limits of the cropped image.

6. The method of claim 5, further comprising the step of compressing data for a portion of the media object within the limits of the cropped image.

7. The method of claim 1, further comprising the step of storing the cropped image as a JPEG stream of data in a substorage of an OLE file.

8. The method of claim 7, wherein the OLE file defines a collection of one or more images.

9. The method of claim 1, further comprising the step of providing input to the metadata for storage that defines at least one of an image title, an image number, an image rotation, an image width, an image height, and an image source file location for the media object.

10. The method of claim 1, further comprising the step of perceptibly differentiating a first portion of the representation of the image from a second portion of the representation of the image, wherein the first portion and second portion are demarcated by the crop outline.

11. A machine-readable medium having machine instructions for performing the steps of claim 1.

12. A system for lossless editing of a media object that comprises an image, comprising:

(a) a processor;

(b) a display in communication with the processor;

(c) an input device in communication with the processor; and

(d) a memory in communication with the processor, said memory storing the media object and machine instructions that cause the processor to;

(i) access data defining the media object, to produce a representation of the media object;

(ii) enable a user to employ the input device to selectively edit the representation of the media object by applying a modification to the representation, the modification including cropping the representation of the media object, and in response to the modification, producing metadata that define the modification, said metadata including a size and a position of a crop outline on the representation of the image to indicate limits of a cropped image;

(iii) render a modified media object in accord with the modification applied to the representation; and

(iv) store the metadata that define the modification applied to the representation in association with the media object, without modifying the data that define the media object.

13. The system of claim 12, wherein the machine instruction further cause the processor to:

(a) enable a user to employ the input device to again selectively edit the representation of the media object, by applying a further modification that changes the limits of the cropped image on the representation of the media object appearing on the display;

(b) update the metadata to define the modification by indicating new limits of the cropped image; and

(c) render the modified media object on the display in accord with the further modification.

14. The system of claim 12, wherein the image is stored in the memory in a Joint Photographic Experts Group (JPEG) format.

15. The system of claim 12, wherein the metadata are stored in the memory as a stream of data in a substorage of an object linking and embedding (OLE) file.

16. The system of claim 12, wherein the machine instructions further cause the processor to render the cropped image without portions of the representation that lie outside the limits of the cropped image.

17. The system of claim 16, wherein the machine instructions further cause the processor to compress data for a portion of the media object within the limits of the cropped image.

18. The system of claim 12, wherein the machine instructions further cause the processor to store the cropped image as a JPEG stream of data in a substorage of an OLE file.

19. The system of claim 12, wherein the OLE file defines a collection of one or more images.

20. The system of claim 12, wherein the machine instructions further cause the processor to provide input to the metadata for storage in the memory, wherein said input defines at least one of an image title, an image number, an image rotation, an image width, an image height, and an image source file location for the media object in the memory.

21. The system of claim 12, wherein the machine instructions further cause the processor to perceptibly differentiate a first portion of the representation of the image from a second portion of the representation of the image, wherein the first portion and second portion are demarcated by the crop outline.

22. A method for lossless modification of a media object, comprising the steps of:

(a) accessing data defining the media object to produce a representation of the media object;

(b) enabling a user to perform a first modification of the representation of the media object, producing metadata the define the first modification;

(c) rendering the first modification of the representation;

(d) storing the metadata that define the first modification applied to the representation of the media object in association with the data that define the media object, without modifying the data that define the media object;

(e) subsequently accessing the media object and metadata;

(f) rendering the representation of the media object as defined by the metadata;

(g) enabling the user to further modify the first modification of the representation of the media object, to produce a second modification and producing metadata that define the second modification; and

(h) storing the metadata that now define the second modification of the media object, without modifying the data that define the media object.

23. The method of claim 22, wherein the representation of the media object comprises one of a static image, and a video image, and an audible sound.

24. The method of claim 22, wherein the metadata comprises dimensions of a crop outline.

25. The method of claim 22, further comprising the step of perceptibly differentiating a first portion of the representation of the media object from a second portion of the representation of the media object to aid the user to one of perform the first modification and further modify the first modification.

26. A machine-readable medium having machine instructions for performing the steps of claim 22.

27. The method of claim 22, wherein the modification comprises at least one of the steps of cropping, rotating, and trimming an image that comprises the representation of the media object.

28. A system for lossless modification of a media object, comprising:

(a) a processor;

(b) an input device in communication with the processor; and

(c) a memory in communication with the processor, said memory storing data defining the media object and machine instructions that cause the processor to;

(i) access the data defining the media object to produce a representation of the media object;

(ii) enable a user to employ the input device to perform a first modification of the representation of the media object, producing metadata that define the first modification;

(iii) render the first modification of the representation;

(iv) store the metadata that define the first modification applied to the representation of the media object in the memory in association with the data that define the media object, without modifying the data that define the media object;

(v) subsequently access the media object and metadata in the memory;

(vi) rendering the representation of the media object as defined by the metadata;

(vii) enabling the user to further modify the first modification of the representation of the media object, to produce a second modification and producing metadata that define the second modification; and

(viii) storing the metadata that now define the second modification of the media object in the memory.

29. The system of claim 28, wherein the representation of the media object comprises one of a static image, and a video image, and an audible sound.

30. The system of claim 28, wherein the metadata comprises dimensions of a crop outline.

31. The system of claim 28, wherein the machine instructions further cause the processor to perceptibly differentiate a first portion of the representation of the media object from a second portion of the representation of the media object to aid the user to one of perform the first modification and further modify the first modification.

32. The system of claim 28, wherein the modification comprises one of cropping, rotating, and trimming an image that comprises the representation of the media object.