Producing enhanced photographic products from images captured at known picture sites

• US 20040183918A1
• Filed: 03/20/2003
• Published: 09/23/2004
• Est. Priority Date: 03/20/2003
• Status: Abandoned Application

• Current Assignee: Eastman Kodak Company
• Original Assignee: Eastman Kodak Company
• Inventors: Fredlund, John R., Manico, Joseph A., Squilla, John R.
• Application Number:
  US10/392,994
• Publication Number:
  US 20040183918A1
• Time in Patent Office: Days
• US Class Current: 348/211.2
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 5/00 Image enhancement or restoration
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: H04N 1/00132 in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
• CPC Class Codes: H04N 1/0014 via e-mail
• CPC Class Codes: H04N 1/00143 Ordering
• CPC Class Codes: H04N 1/00164 at a remote location
• CPC Class Codes: H04N 1/00167 Processing or editing H04N1/00196 - H04N1/00201 take precedence
• CPC Class Codes: H04N 1/00172 directly from a still digital camera or from a storage medium mounted in a still digital camera H04N1/0018 takes precedence
• CPC Class Codes: H04N 1/00193 to a portable storage medium, e.g. a read-writable compact disk
• CPC Class Codes: H04N 1/00196 Creation of a photo-montage, e.g. photoalbum H04N1/0019 takes precedence
• CPC Class Codes: H04N 1/32128 attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image for information embedded in the image H04N1/32144
• CPC Class Codes: H04N 2201/3253 Position information, e.g. geographical position at time of capture, GPS data
• CPC Class Codes: H04N 2201/3261 of multimedia information, e.g. a sound signal
• CPC Class Codes: H04N 23/681 Motion detection

Abstract

A photographic system is described for producing enhanced products from pictures of one or more known picture sites situated at predetermined locations and representing content of interest to a photographer. The system includes (a) a database containing content pertaining to the picture sites; (b) a camera for capturing images of the picture sites; (c) a processor for relating the captured images to the locations of picture sites, thereby identifying locations of the images, where the processor uses the locations of the images to access selected content in the database pertaining to the picture sites; and (d) a product generator for generating enhanced image products. In one embodiment, the data base contains stock images pertaining to the picture sites and the product generator combines the stock images pertaining to the content of the picture sites with the captured images of the picture sites to generate a new image product.

Claims

1. A photographic system for producing enhanced products from pictures of one or more known picture sites situated at predetermined locations and representing content of interest to a photographer, said system comprising:

a database containing content pertaining to the picture sites, said content including image content pertaining to the picture sites;

a camera for capturing images of the picture sites;

a processor for relating the captured images to the locations of picture sites, thereby identifying locations of the images, said processor using the locations of the images to access selected content in the database pertaining to the picture sites; and

a product generator for generating enhanced image products by combining the image content pertaining to the picture sites with the captured images of the picture sites to generate a new image product.

2. The photographic system as claimed in claim 1 wherein the camera records location data useful for identifying the picture sites, and the processor relates the location data recorded together with the captured images to the picture sites to identify the location of the images.

3. The photographic system as claimed in claim 2 wherein the location data is obtained from a positioning system external to the camera.

4. The photographic system as claimed in claim 2 wherein the location data is obtained from a communication source associated with a picture site.

5. The photographic system as claimed in claim 1 wherein the database contains reference images of picture sites and the processor relates the captured images to the reference images to identify the locations of the images.

6. The photographic system as claimed in claim 1 wherein the database contains reference images of the picture sites and a trained operator further relates the captured images to the reference images to identify the location of the images.

7. The photographic system as claimed in claim 1 wherein the content pertaining to the picture sites comprises image, text, graphics or video content.

8. The photographic system as claimed in claim 1 wherein the camera is a digital camera, or a video capture device, or an image capture device incorporated into a cell phone or a personal digital assistant (PDA).

9. The photographic system as claimed in claim 1 wherein the product composer generates an enhanced image product from a captured image by combining a historical image representative of the picture site with the captured image of the picture site to generate a new image product.

10. The photographic system as claimed in claim 1 wherein the processor is in the camera.

11. A photographic system for producing enhanced products from pictures of one or more known picture sites situated at predetermined locations and representing content of interest to a photographer, said system comprising:

a database containing content pertaining to the picture sites;

a camera for capturing images of the picture sites, wherein the camera includes a processor for relating the captured images to locations of the picture sites, thereby identifying locations of the images, said processor using the locations of the images to access selected information in the database pertaining to the content of the picture sites; and

a product generator for generating enhanced image products from the images by utilizing the selected content pertaining to the picture sites.

12. The photographic system as claimed in claim 11 wherein the database is downloaded to the camera.

13. The photographic system as claimed in claim 11 wherein the database is resident in the camera.

14. The photographic system as claimed in claim 11 wherein the product generator is in the camera.

15. The photographic system as claimed in claim 11 wherein the camera records location data useful for identifying the picture sites, and the processor relates the location data recorded together with the captured images to the picture sites to identify the location of the images.

16. The photographic system as claimed in claim 15 wherein the location data is obtained from a positioning system external to the camera.

17. The photographic system as claimed in claim 15 wherein the location data is obtained from a communication source associated with the picture sites.

18. The photographic system as claimed in claim 11 wherein the database contains reference images of picture sites and the processor relates the captured images to the reference images to identify the locations of the images.

19. A photographic system for producing enhanced products from pictures of one or more known picture sites situated at predetermined locations and representing content of interest to a photographer, said system comprising:

a database containing content pertaining to the picture sites;

a camera for capturing images of the picture sites;

a processor for relating the captured images to locations of the picture sites, thereby identifying locations of the images, said processor using the locations of the images to access selected content in the database pertaining to the picture sites; and

a product generator for generating enhanced image products from the images by utilizing the selected content pertaining to the picture sites to automatically adjust the images, thereby modifying pictorial content or representation of the images.

20. The photographic system as claimed in claim 19 wherein pictorial content or representation of the images is modified by automatically resizing the images.

21. The photographic system as claimed in claim 19 wherein pictorial content or representation of the images is modified by automatically cropping the images.

22. The photographic system as claimed in claim 19 wherein pictorial content or representation of the images is modified by automatically zooming the images.

23. The photographic system as claimed in claim 19 wherein pictorial content or representation of the images is modified by automatically enhancing the images.

24. A photographic system for producing enhanced products from pictures of one or more known picture sites situated at predetermined locations and representing content of interest to a photographer, said system comprising:

a database containing content pertaining to the picture sites, said content including reference images pertaining to the pictorial content of the picture sites;

a camera for capturing images of the picture sites;

a processor including an image analysis algorithm for relating the captured images to the pictorial content of one or more of the reference images, thereby identifying locations of the captured images;

said processor using the locations of the captured images to access selected content in the database pertaining to the picture sites; and

a product generator for generating enhanced image products from the captured images by utilizing the selected content pertaining to the picture sites.

25. A photographic method for producing enhanced products from pictures of one or more known picture sites situated at predetermined locations and representing content of interest to a photographer, said method comprising the steps of:

storing content pertaining to the picture sites, said content including stock images pertaining to the picture sites;

capturing images of the picture sites;

relating the images to locations of the picture sites, thereby identifying locations of the images;

using the locations of the images to access selected content in the database pertaining to the picture sites; and

generating enhanced image products by combining the stock images pertaining to the content of the picture sites with the captured images of the picture sites to generate a new image product.

26. The method as claimed in claim 25 furthers comprising the step of recording location data useful for identifying the picture sites, and wherein the step of relating the images to locations of the picture sites further comprises using the location data to relate the images to the locations of the picture sites, thereby identifying the locations of the images.

27. A photographic method for producing enhanced products from pictures captured by a camera capable of identifying one or more known picture sites situated at predetermined locations and representing content of interest to a photographer, said method comprising the steps of:

storing content pertaining to the picture sites;

capturing images of the picture sites;

relating the images to locations of the picture sites, thereby identifying locations of the images;

using the locations of the images to access selected content in the database pertaining to the picture sites; and

generating enhanced image products from the images by utilizing the selected content pertaining to the picture sites to adjust the images, thereby modifying pictorial content of the images.

28. A photographic system for producing enhanced products from pictures captured by a camera capable of identifying one or more known picture sites situated at predetermined locations and representing content of interest to a photographer, said system comprising:

a database containing content pertaining to the picture sites, said content including reference images pertaining to pictorial content of the picture sites;

a camera for capturing images of the picture sites;

a processor including an image analysis algorithm for relating the images to the pictorial content of one or more of the reference images, thereby identifying locations of the images;

using the locations of the images to access selected content in the database pertaining to the picture sites; and

generating enhanced image products from the images by utilizing the selected content pertaining to the picture sites.

29. A recording device for use in gathering meta data associated with images captured by a camera, said meta data provided by one or more known picture sites situated at predetermined locations and representing content of interest to a photographer, said device comprising:

means for attaching the recording device to the camera;

a communication device for communicating with the picture site and receiving the meta data from the picture site;

a memory for storing the meta data; and

means for synchronizing the storage of the meta data with an image captured by the camera.

30. The recording device as claimed in claim 29 for use with a film camera, wherein the synchronizing means comprises a device for sensing motion indicative of a film advance.

31. The recording device as claimed in claim 29 for use with a digital camera, wherein the synchronizing means comprises a user interface for synchronizing the frame sequence of digital image capture with reception of meta data.

32. The recording device as claimed in claim 29 wherein the meta data comprises location data specifying information indicative of location of the picture site.

33. The recording device as claimed in claim 29 further including an output interface for downloading the meta data from the receiving device to an external processor.

34. The recording device as claimed in claim 29 wherein the camera includes a short range RF transmitter on a recording medium and the recording device further includes a receiver for receiving meta data from the transmitter identifying the recording medium.

35. The recording device as claimed in claim 29 for use with a single use film camera having a lens and viewfinder, wherein the recording device further includes a flexible sleeve into which the single use camera is inserted, said sleeve including openings for the lens and viewfinder.

36. A photographic system for producing enhanced products from pictures of one or more known picture sites situated at predetermined locations and representing content of interest to a photographer, said system comprising:

a database containing content pertaining to the picture sites;

a camera for capturing images of the picture sites;

a processor for relating the captured images to the locations of picture sites, thereby identifying locations of the images, said processor using the locations of the images to access selected content in the database pertaining to the picture sites;

a photofinishing system for generating an image bearing product from the captured images; and

a product generator utilizing the selected content pertaining to the picture sites to generate a sticker having the selected content printed thereon, said sticker being attached to the back of the image bearing product of a corresponding image.

37. The system as claimed in claim 36 wherein the image bearing product is a CD, a DVD or a print.

38. A photographic system for producing enhanced products from pictures of one or more known picture sites situated at predetermined locations and representing content of interest to a photographer, said system comprising:

a database containing a library of stored content, including images, pertaining to the picture sites;

a camera for capturing images at a particular picture site location and for recording date/time information with the images;

a recording device carried by the photographer for recording date/time and location information;

a processor for correlating the date/time information recorded by the camera and the recording device in order to relate the location information to the captured images and to a subset of stored content, including images, in the library that pertain to the particular picture site location, said processor processing the subset of stored content, including images, and the captured images to identify the stored content of the picture site that is shown in the captured images; and

a product generator for generating an enhanced image product by associating the identified stored content of the picture site with the captured images to generate a new image product.

39. The system as claimed in claim 38 wherein the recording device includes a clock for recording date/time and a data entry device for entry of location data by the photographer.

40. The system as claimed in claim 39 wherein the data entry device is a keypad through which the photographer enters location data.

41. The system as claimed in claim 38 wherein the recording device includes a clock for recording date/time and a global position system (GPS) device for recording of location coordinates.

42. The system as claimed in claim 38 wherein the processor includes an image processing algorithm for correlating objects found in the subset of stored images with objects in the captured images, thereby identifying the content of the picture site shown in the captured images.

43. The system as claimed in claim 38 wherein the camera is a film camera having a recording area on a film for recording the date/time information.

44. The system as claimed in claim 43 wherein the film camera is a single use camera with a clock attachment for recording the date/time information on the film.

45. The system as claimed in claim 38 wherein the camera is a digital camera that records the date/time information together with the images.

46. A photographic method for producing enhanced products from pictures of one or more known picture sites situated at predetermined locations and representing content of interest to a photographer, said method comprising the steps of:

storing a library of images pertaining to content of the picture sites;

capturing images at a particular picture site location with a camera and recording date/time information with the images;

recording date/time and location information with a recording device separate from the camera;

correlating the date/time information recorded by the camera and the recording device in order to relate the captured images to a subset of images in the library that pertain to the particular picture site location;

processing the subset of stored images and the captured images to identify the content of the picture site that is shown in the captured images; and

generating an enhanced image product by associating the identified stored content of the picture site with the captured images to generate a new image product.

47. The method as claimed in claim 46 wherein the step of recording date/time and location information with a recording device separate from the camera comprises recording global positioning system (GPS) coordinates and date/time information contemporaneous with the recording of the GPS coordinates.

48. The method as claimed in claim 46 wherein the step of processing the subset of stored images and the captured images correlates objects found in the subset of stored images with objects in the captured images, thereby identifying the content of the picture site shown in the captured images.

49. A photographic method for producing enhanced products from pictures captured at one or more known picture sites situated at predetermined locations and representing content of interest to a photographer, said method comprising the steps of:

(a) providing a library of stock images representing different photographic views captured from the known picture sites, the stock images containing recognizable objects associated with the picture sites, said library further including information pertaining to the content of the picture sites and to location coordinates for the picture sites;

(b) capturing images at one or more of the known picture sites, and storing the captured images along with a date/time of capture;

(c) determining location coordinates while capturing the images, and storing the location coordinates along with a date/time of their reception;

(d) using the date/times from steps (b) and (c) to relate the stored location coordinates with the captured images, thereby associating a location coordinate with each captured image;

(e) using the location coordinates for a captured image and for the picture sites to identify one or more stock images from a particular picture site that relates to a captured image;

(f) processing the captured image and the stock images to identify recognizable objects in the captured images that match up with recognizable objects in one or more stock images, thereby identifying the picture site that matches up with the captured image; and

(g) providing enhanced image products by combining the content information from the database with the captured images of the picture sites to generate a new image product.

50. The method as claimed in claim 49 wherein step (c) comprises determining location coordinates from a GPS receiver associated with a camera that captures images in the step (b).

51. The method as claimed in claim 49 wherein step (c) comprises determining location coordinates from the captured images.

52. A photographic method for producing enhanced products from pictures captured at one or more known picture sites situated at predetermined locations and representing content of interest to a photographer, said method comprising the steps of:

(a) providing a database of information pertaining to the content of the picture sites and to global positioning system (GPS) coordinates for the picture sites;

(b) capturing images at one or more of the known picture sites, and storing the captured images along with date/time of capture;

(c) receiving a stream of GPS coordinates while capturing the images, and storing the stream of GPS coordinates along with date/time of their reception;

(d) using the date/time from steps (b) and (c) to relate the stored stream of GPS coordinates with the captured images, thereby associating a GPS coordinate with each captured image;

(e) using the GPS coordinates for the captured images and for the picture sites to identify the particular picture site that relates to a captured image; and

(f) providing enhanced image products by using the content information from the database with the captured images of the picture sites to generate a new image product.

53. A photographic system for producing enhanced products from pictures of known picture sites situated at predetermined locations and representing content of interest to a photographer, said system comprising:

a database containing a library of stored content referenced to the locations of the picture sites;

a camera for capturing images at a plurality of picture sites and for recording date/time information with the images;

a recording device for recording date/time and location information;

a processor for correlating the date/time information recorded by the camera and the recording device in order to relate the location information to the captured images and to a plurality of picture sites in the database corresponding to the captured images, said processor using the locations of the plurality of picture sites to interpolate an estimated location relative to the plurality of picture sites, and thereby identify stored content in the database associated with the estimated location; and

a product generator for generating an enhanced image product by associating the identified stored content of the estimated location with the captured images to generate a new image product.

54. The system as claimed in claim 53 wherein the estimated location represents a location between picture sites which the photographer would likely have passed by.

55. A method for producing enhanced products from pictures of known picture sites situated at predetermined locations and representing content of interest to a photographer, said method comprising the steps of:

(a) storing content referenced to the locations of the picture sites;

(b) capturing images at a plurality of picture sites and recording date/time information with the images;

(c) recording date/time and location information;

(d) correlating the date/time information recorded in steps (b) and (c) in order to relate the location information to the captured images and to the plurality of stored picture sites corresponding to the captured images,

(e) using the locations of the plurality of stored picture sites to interpolate an estimated location relative to the plurality of picture sites, and thereby identify stored content in the database associated with the estimated location; and

(f) generating an enhanced image product by associating the identified stored content of the estimated location with the captured images to generate a new image product.

56. The method as claimed in claim 55 wherein the estimated location represents a location between picture sites which the photographer would likely have passed by.

57. A photographic system for producing enhanced products from pictures of one or more known picture sites situated at predetermined locations and representing content of interest to a photographer, said system comprising:

a database containing content pertaining to the picture sites;

a camera for capturing images of the picture sites;

a processor for relating the captured images to the locations of picture sites, thereby identifying locations of the images, said processor using the locations of the images to access selected content in the database pertaining to the picture sites;

a product generator for generating enhanced image products by combining the content pertaining to the picture sites with the captured images of the picture sites to generate a new image product; and

a display for displaying the image product to the photographer with one or more choices for modification to the new image product appropriate for the identified location of the image.

58. A photographic system for producing enhanced products from pictures of one or more known picture sites situated at predetermined locations and representing content of interest to a photographer, said system comprising:

a database containing content pertaining to the picture sites;

a camera for capturing images of the picture sites, wherein the camera includes a display and a processor for relating the captured images to locations of the picture sites, thereby identifying locations of the images, said processor (a) using the locations of the images to access selected information in the database pertaining to the content of the picture sites and (b) offering to the photographer a choice on the display of location specific enhanced image products, thereby enabling one or more chosen enhanced image products; and

a product generator for generating the one or more chosen enhanced image products from the images by utilizing the selected content pertaining to the picture sites.

59. The photographic system as claimed in claim 58 wherein the database is downloaded to the camera.

60. The photographic system as claimed in claim 58 wherein the database is resident in the camera.

61. The photographic system as claimed in claim 58 wherein the product generator is in the camera.

62. A photographic system for producing enhanced products from pictures of one or more known picture sites situated at predetermined locations and representing content of interest to a photographer, said system comprising:

a database containing content pertaining to the picture sites;

a camera for capturing images of the picture sites, said camera incorporated into a cellular telephone;

a processor for relating the captured images to the locations of picture sites by triangulating between cell phone towers positioned at known locations, thereby identifying locations of the images, said processor using the locations of the images to access selected content in the database pertaining to the picture sites; and

a product generator for generating enhanced image products by combining the content pertaining to the picture sites with the captured images of the picture sites to generate a new image product.

63. A single use camera including a short range transmitter for transmitting data identifying the camera.

64. A recording device for use with the camera claimed in claim 63 in gathering meta data associated with images captured by the camera, said meta data provided by one or more known picture sites situated at predetermined locations and representing content of interest to a photographer, wherein said device comprises:

means for attaching the recording device to the single use camera;

a communication device for communicating with the picture site and receiving the meta data from the picture site;

a memory for storing the meta data; and

means for synchronizing the storage of the meta data with an image captured by the camera.

65. The recording device as claimed in claim 64 wherein the data identifying the camera is transmitted to the synchronizing means.

66. The recording device as claimed in claim 64, wherein the means for attaching the device to the camera further includes a flexible sleeve into which the single use camera is inserted, said sleeve including openings for a lens and viewfinder on the camera.

67. The recording device as claimed in claim 64 wherein the synchronizing means comprises a device for sensing motion indicative of a film advance.

68. The recording device as claimed in claim 64 wherein the meta data comprises location data specifying information indicative of location of the picture site.

69. The recording device as claimed in claim 64 further including an output interface for downloading the meta data from the receiving device to an external processor.