Image exchange with image annotation

• US 7,508,419 B2
• Filed: 10/14/2005
• Issued: 03/24/2009
• Est. Priority Date: 10/09/2001
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Vronay, David, Toyama, Kentaro, Anandan, Padmanabhan
• Primary Examiner(s): Villecco; John M
• Application Number:
  US11/251,041
• Publication Number:
  US 20060107297A1
• Time in Patent Office: 1,257 Days
• Field of Search: 709/212, 709/213, 709/216, 709/217, 709/219, 709/231, 709/238, 709/239, 707/3, 707/6, 348/231.5, 348/207.1, 348/211.3, 348/231.2, 348/231.3, 348/231.6, 348/552, 725/105
• US Class Current: 348/211.3
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04N 1/00132 in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
• CPC Class Codes: H04N 1/00137 Transmission
• CPC Class Codes: H04N 1/00148 Storage information retrieval G06F16/00
• CPC Class Codes: H04N 1/00172 directly from a still digital camera or from a storage medium mounted in a still digital camera H04N1/0018 takes precedence
• CPC Class Codes: H04N 1/00244 with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/781 on disks or drums
• CPC Class Codes: H04N 5/85 on discs or drums
• CPC Class Codes: H04N 5/907 using static stores, e.g. storage tubes or semiconductor memories H04N5/91 takes precedence
• CPC Class Codes: H04N 5/9201 involving the multiplexing of an additional signal and the video signal
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching

Abstract

A system and method for providing a peer-to-peer photo-sharing environment. The system includes: manual and automatic photo annotation at the client; periodic client-server synchronization; an index of client photos on a central server or a photo database that is resident on the central server, which is updated by the client-server synchronization function; end-user search functionality to search the centralized index or photo database; and transmission of the relevant photos to the client via an on-line image cache. In one embodiment, one client'"'"'s new photos are automatically displayed on another client'"'"'s computer (e.g., via screen saver or another mechanism).

Claims

1. A computer-implemented process for sharing images among a plurality of clients, comprising the process actions of:

inputting images at a hosting client;

annotating said images with metadata at said hosting client;

creating a local index of said images and local database of said images at said hosting client;

synchronizing said hosting client'"'"'s local index with a master index of a central server which automatically retrieves and combines the meta data of an image among said images with meta data associated with the same image from other locations on a network connecting the central server and hosting clients, said master index comprising all images available for sharing at all hosting clients and at said central server; and

providing images from said hosting client.

2. The computer-implemented process of claim 1 wherein said process action of annotating one of said-images further comprises, annotating said image with a user rating.

3. The computer-implemented process of claim 1 wherein the process action of annotating said images further comprises annotating an image with the time it was created, wherein annotating said image with the time it was created comprises annotating said image with a time by using a time stamp provided by a Global Positioning System integrated with the camera that created the image.

4. The computer-implemented process of claim 1 wherein the process action of annotating said images further comprises annotating said image with the location the image depicts, comprising:

annotating said image with a location by using a location stamp provided by a Global Positioning System integrated with the camera that created the image.

5. The computer-implemented process of claim 1, wherein the annotating process action is automatic and wherein automatically annotating an image further comprises using automated vision techniques to determine whether the image depicts a natural or man-made object and annotating the image as either natural or man-made.

6. The computer-implemented process of claim 1 wherein the process action of annotating said images further comprises annotating an image with a camera orientation when the image was captured, wherein the camera orientation is provided in the format of yaw, pitch and roll.

7. The computer-implemented process of claim 1 wherein the process action of annotating said images further comprises annotating the privacy level of an image, wherein annotating the privacy level of the image comprises the process action of annotating said image with a privacy level that is manually input by the user.

8. The computer-implemented process of claim 7 wherein the privacy level that is manually input by a user further comprises the process action of selecting from a default setting of having the image accessible to only the user.

9. The computer-implemented process of claim 1, wherein the annotating process action is automatic and wherein automatically annotating an image further comprises using pixel comparison techniques with images of known content and comparing the image to determine its content and annotating the image as to what the image is.

10. The computer-implemented process of claim 1 wherein the process action of annotating said images further comprises annotating the image with an image modification history that comprises:

annotating said image with annotation data as to how it was modified;

annotating said image with annotation data as to when it was modified;

annotating said image with annotation data as to by whom it was modified; and

annotating said image with any other modifications made to annotation data made at the time of modification.

11. The computer-implemented process of claim 1 wherein the process action of annotating said images further comprises annotating the image with a server-provided user rating comprising an indication as to how closely the image matched a search criteria.

12. The computer-implemented process of claim 1, wherein the annotating process action is automatic and wherein automatically annotating an image further comprises using face recognition techniques to identify a specific person in the image and annotating the image with an identifier for the person.

13. The computer-implemented process of claim 1 wherein the process action of annotating said images further comprises annotating said image with usage statistics comprising:

annotating the image with how often the image was posted to a website;

annotating the image with the times the image was posted to a website;

annotating the image with the number of times the image was emailed;

annotating the image with how relevant the image was found to be in a search; and

annotating the image as to how many times the image was requested.

14. The computer-implemented process of claim 1, wherein the process action of annotating at least one of said input images further comprises annotating the image with an imputed location based on time and location the image was taken further comprising the process actions of:

identifying the time and location said image was created;

identifying other images taken close to the same time and with the same camera when said image was created;

imputing to said image the location of said other images taken at close to the same time; and

annotating said image with said imputed location.

15. The computer-implemented process of claim 1 wherein the process action of synchronizing further comprises the process actions of:

storing changes to local index and local database of said images at said hosting client in a modification log;

periodically connecting said hosting client to said central server; and

synchronizing said local index and said local database of said hosting client with said master index of said central server using said modification log.

16. A computer-implemented process for sharing images comprising the process actions of:

inputting images at a hosting client;

automatically retrieving from other locations on the network and annotating said images with metadata associated with the same image located in a different location at said hosting client;

at said hosting client creating a master index of all images available for sharing at all hosting clients and at said central server;

creating a local index of images input at the hosting client and a local database wherein the images include the meta data associated with the same image located at a different location of said images at said hosting client;

providing images from said hosting client.

17. The computer-implemented process of claim 16 wherein said process action of annotating said input image further comprises, annotating said image with usage statistics.

18. The computer-implemented process of claim 16 further comprising annotating an image with a location which the image depicts, wherein annotating said image with the location which the image depicts comprises annotating said image with a location by using a location stamp provided by deriving a location from cell site location provided by a camera integrated with the camera that created the image.

19. The computer-implemented process of claim 16, further comprising annotating an image with an imputed location, wherein the process action of annotating the image with an imputed location further comprises the process actions of:

identifying the time and location said image was created;

identifying other images taken close to the same time and with the same camera when said image was created;

imputing to said image the location of said other images taken at close to the same time with a same camera; and

annotating said image with said imputed location.