Image processing system and method

• US 8,874,596 B2
• Filed: 07/10/2009
• Issued: 10/28/2014
• Est. Priority Date: 02/26/2004
• Status: Active Grant

• Current Assignee: ATI Technologies ULC (Advanced Micro Devices, Inc.)
• Original Assignee: ATI Technologies ULC (Advanced Micro Devices, Inc.)
• Inventors: Bandas, Peter
• Primary Examiner(s): Vy, Hung T
• Application Number:
  US12/500,801
• Publication Number:
  US 20090276464A1
• Time in Patent Office: 1,936 Days
• Field of Search: 707/736, 707/758, 707/790, 707/802, 707/803, 707/805, 382/305, 382/190, 382/205, 382/180, 382/115
• US Class Current: 707/758
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

An image processing system and method receives one or more digital images in the form of image data, including selected object data of a digital image, and determines, by an electronic recognition process, if a recognition match is available between the selected object data of the digital image and image object library data associated with image descriptor library data. An automated library user interface presents selectable matched object descriptor data associated with the image descriptor library data when a recognition match occurs between the selected object data of the digital image and the image descriptor library data. In response, the automated library user interface provides user feedback data to confirm that the image descriptor library data corresponds with the selected object data of the digital image, or entered descriptor data if no match or an incorrect match occurs, to create library descriptor associated image data.

Claims

1. An image processing method carried out by an image processing system, comprising:

determining, by an electronic recognition process, if a recognition match occurs between selected object data of a digital image and image object library data, wherein the image object library data are associated with image descriptor library data;

presenting a plurality of selectable matched object descriptor data associated with the image descriptor library data when a recognition match is determined between the selected object data of the digital image and the image object library data;

receiving feedback data in response to presenting the plurality of selectable matched object descriptor data to confirm that the image descriptor library data corresponds with the selected object data of the digital image wherein the feedback data comprises a selected one of the plurality of selectable matched object description data; and

in response to the feedback data, associating the image descriptor library data with the digital image to create descriptor associated image library data and adding the created descriptor associated image library data as stored new object library data.

2. The method of claim 1 including:

receiving entered descriptor data to associate with the digital image; and

creating the descriptor associated image library data in response to receiving the entered descriptor data when at least one of;

(a) no recognition match is determined between the selected object data of the digital image and the image object library data, and (b) the feedback data indicates that the image descriptor library data do not correspond with the selected object data of the digital image.

3. The method of claim 1 wherein the selected object data of the digital image represent a plurality of objects in the digital image, the method further including:

determining, by the electronic recognition process, if a recognition match occurs between each of the plurality of objects in the digital image and the image object library data;

presenting the plurality of selectable matched object descriptor data associated with the image descriptor library data when a recognition match is determined between the corresponding plurality of objects in the digital image and the image object library data;

receiving feedback data in response to presenting the plurality of selectable matched object descriptor data to confirm that the image descriptor library data associated with the plurality of selectable matched object descriptor data match the corresponding plurality of objects in the digital image; and

in response to the feedback data, associating the image descriptor library data with the digital image for each of the corresponding plurality of objects to create corresponding descriptor associated image library data and adding the created descriptor associated image library data as stored new object library data.

4. The method of claim 1 wherein the descriptor associated image library data include subdescriptor data associated with the selected object data of the digital image.

5. The method of claim 1 wherein the descriptor associated image library data are selected from at least one of:

person attribute data, place attribute data, thing attribute data and event attribute data.

6. The method of claim 5 wherein the person attribute data are associated with at least one of:

name attribute data, facial expression attribute data and activity attribute data;

wherein the place attribute data are selected from at least one of;

landscape attribute data, weather attribute data, season attribute data and lighting attribute data;

wherein the thing attribute data are selected from at least one of;

animal attribute data and building attribute data; and

wherein the event attribute data are selected from party attribute data, family event attribute data and vacation attribute data.

7. The method of claim 1 including generating the selected object data of the digital image in response to selecting at least one of:

the digital image, and a portion of the digital image, by at least one of;

a user and an electronic object recognizer.

8. The image processing method of claim 1 comprising presenting subdescriptor data comprising at least one of:

facial expression attribute data;

activity attribute data; and

place attribute data.

12. The method of claim 8 wherein the selected object data of the digital image represent a plurality of objects in the digital image, the method further including:

determining, by the electronic recognition process, if a recognition match occurs between each of the plurality of objects in the digital image and the image object library data;

presenting the plurality of selectable matched object descriptor data associated with the image descriptor library data when a recognition match is determined between the corresponding plurality of objects in the digital image and the image object library data;

receiving feedback data in response to presenting the plurality of selectable matched object descriptor data to confirm that the image descriptor library data associated with the plurality of selectable matched object descriptor data match the corresponding plurality of objects in the digital image; and

in response to the feedback data, associating the image descriptor library data with the digital image for each of the corresponding plurality of objects to create corresponding descriptor associated image library data and adding the created descriptor associated image library data as stored new object library data.

9. An image processing method carried out by an image processing system, comprising:

receiving image data representing a digital image;

generating selected object data of the digital image in response to receiving the image data;

determining, by an electronic recognition process, if a recognition match occurs between the selected object data of the digital image and image object library data, wherein the image object library data are associated with image descriptor library data;

presenting a plurality of selectable matched object descriptor data associated with the image descriptor library data when a recognition match is determined between the selected object data of the digital image and the image object library data;

receiving feedback data in response to presenting the plurality of selectable matched object descriptor data to confirm that the image descriptor library data corresponds with the selected object data of the digital image wherein the feedback data comprises a selected one of the plurality of selectable matched object description data; and

in response to the feedback data, associating the image descriptor library data with the digital image to create descriptor associated image library data and adding the created descriptor associated image library data as stored new object library data.

10. The method of claim 9 wherein the image data represent a plurality of digital images such that each of the plurality of digital images is associated with corresponding descriptor associated image library data, including:

storing the descriptor associated image library data associated with each of the corresponding plurality of digital images; and

creating at least one of;

a table of contents, an index and a photo album including the descriptor associated image library data associated with each of the corresponding plurality of digital images.

11. The method of claim 9 including:

receiving entered descriptor data to associate with the digital image; and

creating the descriptor associated image library data in response to receiving the entered descriptor data when at least one of;

(a) no recognition match is determined between the selected object data of the digital image and the image object library data, and (b) the feedback data indicates that the image descriptor library data do not correspond with the selected object data of the digital image.

13. The method of claim 9 including generating the selected object data of the digital image based on selecting at least one of:

the digital image, and a portion of the digital image, by at least one of;

a user and an electronic object recognizer.

14. An image processing system comprising:

memory containing image object library data and image descriptor library data associated with the image object library data; and

an object recognizer, operatively coupled to the memory, and operative to receive selected object data of a digital image, the image object library data and the image descriptor library data and, in response, to determine, by an electronic recognition process, if a recognition match occurs between the selected object data of the digital image and the image object library data, and to present a plurality of selectable matched object descriptor data associated with the image descriptor library data when a recognition match is determined between the selected object data of the digital image and the image object library data, such that the object recognizer is operative to receive feedback data in response to the presented selectable matched object descriptor data to confirm that the image descriptor library data corresponds with the selected object data of the digital image, wherein the feedback data comprises a selected one of the plurality of selectable matched object description data and wherein the image descriptor library data is, in response to the feedback data, associated with the digital image to create descriptor associated image library data and adding the created descriptor associated image library data as stored new object library data.

15. The image processing system of claim 14 wherein the memory is operative to receive entered descriptor data to associate with the digital image and to create the descriptor associated image library data when at least one of:

(a) no recognition match is determined between the selected object data of the digital image and the image object library data, and (b) the feedback data indicates that the image descriptor library data do not correspond with the selected object data of the digital image.

16. The image processing system of claim 14, including a user interface, operatively coupled to the object recognizer, and operative to receive the plurality of selectable matched object descriptor data and, in response, to display the plurality of selectable matched object descriptor data.

17. The image processing system of claim 14, including an object detector, operatively coupled to the memory and to the object recognizer, and operative to receive image data representing the digital image and, in response, to provide the selected object data of the digital image to the object recognizer.

18. The image processing system of claim 14 wherein the selected object data of the digital image are generated in response to selecting at least one of:

the digital image, and a portion of the digital image, by at least one of;

a user and the object recognizer.

19. An image processing system comprising:

memory containing image object library data and image descriptor library data associated with the image object library data;

a processor coupled to the memory, the processor operative to;

receive selected object data of a digital image, the image object library data and the image descriptor library data and, in response, to determine, by an electronic recognition process, if a recognition match occurs between the selected object data of the digital image and the image object library data, and to produce a plurality of selectable matched object descriptor data associated with the image object library data when a recognition match is determined between the selected object data of the digital image and the image object library data; and

provide a user interface operative to present the plurality of selectable matched object descriptor data and, in response, to provide feedback data to the object recognizer to confirm that the image descriptor library data corresponds with the selected object data of the digital image;

wherein the image descriptor library data are, in response to the feedback data, associated with the selected object data of the digital image to create descriptor associated image library data and wherein the processor is operative to add the created descriptor associated image library data as stored new object library data and wherein the feedback data selects one of the plurality of selectable matched object description data.

20. The image processing system of claim 19 wherein the processor is operative to receive image data representing the digital image and, in response, to provide the selected object data of the digital image to the object recognizer.

21. Memory containing instructions executable by one or more processing devices that cause the one or more processing devices to:

determine, by an electronic recognition process, if a recognition match occurs between selected object data of a digital image and image object library data, wherein the image object library data are associated with image descriptor library data;

present a plurality of selectable matched object descriptor data associated with the image descriptor library data when a recognition match is determined between the selected object data of the digital image and the image object library data;

receive feedback data in response to presenting the plurality of selectable matched object descriptor data to confirm that the image descriptor library data corresponds with the selected object data of the digital image wherein the feedback data comprises a selected one of the plurality of selectable matched object description data; and

in response to the feedback data, associate the image descriptor library data with the digital image to create descriptor associated image library data and adding the created descriptor associated image library data as stored new object library data.

22. The memory of claim 21 containing executable instructions that cause the one or more processing devices to:

receive entered descriptor data to associate with the digital image and in response create the descriptor associated image library data when at least one of;

(a) no recognition match is determined between the selected object data of the digital image and the image object library data, and (b) the feedback data indicate that the image descriptor library data do not correspond with the selected object data of the digital image.

23. An image processing method carried out by an image processing system, comprising:

determining, by an electronic recognition process, if a recognition match occurs between selected object data of a digital image and image object library data, wherein the image object library data are associated with image descriptor library data;

presenting a plurality of selectable matched object descriptor data associated with the image descriptor library data when a recognition match is determined between the selected object data of the digital image and the image object library data; and

in response to selected object descriptor data from the plurality of selectable matched object descriptor data, associating the image descriptor library data with the digital image to create descriptor associated image library data and adding the created descriptor associated image library data as stored new object library data.