Tags and automated vision

• US 20050011959A1
• Filed: 06/15/2004
• Published: 01/20/2005
• Est. Priority Date: 06/25/2003
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Grosvenor, David Arthur
• Application Number:
  US10/868,241
• Publication Number:
  US 20050011959A1
• Time in Patent Office: Days
• US Class Current: 235/470
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06T 7/10 Segmentation; Edge detection motion-based segmentation G06T7/215
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A system and method for processing images is provided. One embodiment is a method of processing an image comprising obtaining an electronic image from an input device, obtaining data concerning the properties of at least one object within the image by virtue of information encoded by tags associated with those objects and selecting at least one image processing procedure in accordance with the data indicated by the tags.

Claims

1. An image processing system comprising:

a camera; and

a data processor responsive to an output of the camera, wherein the image processing system is further responsive to a tag carried on an associated object within a field of view of the camera, the tag providing information about the associated object which is used by the image processing system to modify its processing of the camera output, and wherein the data processor implements a plurality of image processing procedures, and wherein data associated with the tag information is utilised to determine which of the image processing procedures are appropriate.

2. The image processing system of claim 1, wherein the data associated with the tag information indicates an image processing procedure to be implemented by the data processor.

3. The image processing system of claim 1, in which the tag information indicates data concerning a physical nature of the object.

4. The image processing system of claim 3, in which the tag information indicates at least one of a genus, a class, a type and an identity of the object.

5. The image processing system of claim 3, in which object identification activities are invoked according to object information supplied by the tag information.

6. The image processing system of claim 3, wherein one of a plurality of object identification algorithms is selected on the basis of the tag information.

7. The image processing system of claim 3, wherein one of a plurality of object models is selected on the basis of the tag information.

8. The image processing system of claim 3, wherein the tag information indicates data concerning a visual appearance of the object.

9. The image processing system of claim 3, in which the image processing system uses data concerning a visual appearance of the object during processing.

10. The image processing system of claim 9, in which the object comprises a person and the data concerning the visual appearance of the person includes at least one of a person'"'"'s race, a person'"'"'s gender, a person'"'"'s size, a person'"'"'s clothing worn, a person'"'"'s hair colour, a person'"'"'s hair style, a person'"'"'s jewellery and a person'"'"'s spectacles.

11. The image processing system of claim 1, in which the tag conveys the data which is used by the image processing procedures.

12. The image processing system of claim 1, in which the tag points to the data which is used by the image processing procedures.

13. The image processing system of claim 1, in which the data used by the image processing procedures constrain a selection of models used.

14. The image processing system of claim 1, in which the data used by the image processing procedures constrain a selection of image analysis algorithms used.

15. The image processing system of claim 1, in which the data is used to rank a plurality of image processing models used to identify features within an image.

16. The image processing system as claimed in any one of claim 1, in which the data is used to rank a plurality of image processing algorithms that may be used to identify features within an image.

17. The image processing system of claim 1, wherein the tag indicates data enabling the data processor to perform an image segmentation process.

18. The image processing system of claim 1, wherein the tag indicates region grouping data enabling the data processor to associate regions that compose an object.

19. The image processing system as claimed in claim 1, in which the tag indicates data for a selection of an object template for use in an identification model.

20. The image processing system of claim 1, in which the tag indicates information about the environment and the image processing system uses this environment information during its processing of the camera output.

21. The image processing system of claim 1, wherein the image processing procedures include probabilistic shape models.

22. The image processing system of claim 21, wherein the probabilistic shape models are trained during image processing.

23. The image processing system of claim 1, wherein the tag indicates data facilitating the ability of the data processor to perform tracking of the associated object.

24. The image processing system of claim 1, in which the tag identifies a data store for holding data about the associated object.

25. The image processing system of claim 24, in which each time an object is captured and analysed by the image processing system, the data relating to the object is updated.

26. The image processing system of claim 1, wherein the image processing system further comprises a plurality of cameras.

27. The image processing system of claim 1, wherein the tag indicates the information concerning the tag'"'"'s position on an object, and the image processing system uses this position information to invoke a particular image processing process for part of the object in a predetermined relationship with respect to the tag.

28. The image processing system of claim 1, further comprising a radio receiver responsive to a radio transmitter in the tag, wherein the information is communicated from the tag transmitter to the radio receiver.

29. A method of processing an image, comprising:

obtaining an electronic image from an input device;

obtaining data concerning the properties of at least one object within the image by virtue of information encoded by tags associated with those objects; and

selecting at least one image processing procedure in accordance with the data indicated by the tags.

30. The method of claim 29, further comprising capturing the electronic image wherein the tags are visible on the image.

31. The method of claim 29, further comprising analysing the electronic image to identify the tags thereon.

32. The method of claim 29, further comprising receiving transmitted information from the tag, the information having at least identity data, such that the information pertinent to image analysis of the tagged object can be obtained from a data store.

33. The method of claim 32, further comprising transmitting by the tag information appertaining to the image processing procedure to be used to identify the object.

34. The method of claim 33, wherein obtaining the data further comprises obtaining a probabilistic shape model relating to the object.

35. The method of claim 32, wherein the receiving further comprises receiving information concerning at least one of a motion, an orientation or a pose of the object.

36. The method of claim 32, wherein the receiving further comprises receiving information to facilitate tracking of the object.

37. The method of claim 29, wherein the selecting further comprises constraining the image processing procedure.

38. The method of claim 29, further comprising adjusting colour of a portion of the object based upon the tag information.

39. The method of claim 29, further comprising adjusting orientation of the object based upon the tag information.

40. The method of claim 29, further comprising adjusting position of the object based upon the tag information.

41. The method of claim 29, further comprising determining associated information pertaining to the object based upon the tag information.

42. A tag for use in an image processing system, wherein the tag is encoded with or is responsive to physical features of an object to which the tag is attached, wherein the tag is responsive to the environment around the object, and wherein the tag indicates information to the image processing system such that the image processing system can select an appropriate image analysis procedure from a plurality of image analysis procedures.

43. The tag of claim 42, the tag further comprising visual information concerning the object encoded as part of the tag.

44. The tag of claim 42, the tag further comprising address information pointing to an address where information concerning the object is available.

45. The tag of claims 42, wherein the information comprises information relating to at least one physical property of the object.

46. The tag of claim 45, wherein the information comprises information relating to an appearance of the object.

47. The tag of claim 42, wherein the information comprises information relating to other objects that have a significant probability of being in the vicinity of the tagged object.

48. The tag of claim 42, wherein the information comprises information relating to a position of the tag on the object.

49. The tag of claim 42, wherein the information of the tag is detectable in an infrared or an ultraviolet region of an electromagnetic spectrum.

50. The tag of claim 42, wherein the tag further comprises a transmitter.

51. The tag of claim 50, in which the tag is responsive to one or more of:

a. an ambient lighting parameter;

b. an ambient temperature parameter;

c. an ambient humidity parameter; and

d. a wind speed parameter,

wherein the tag transmits data concerning one or more of the parameters.

52. The tag of claim 50, in which the tag is responsive to a motion of the object, and wherein the tag transmits information relating to the motion.

53. The tag of claim 50, in which the tag is responsive to an orientation of the object, and wherein the tag transmits information relating to the orientation.

54. The tag of claim 50, where the tag is responsive to the proximity of other tags, and is arranged to transmit data pertaining to other tags in its vicinity.

55. A system for processing an image, comprising:

means for obtaining an electronic image from an input device;

means for obtaining data concerning the properties of at least one object within the image by virtue of information encoded by tags associated with those objects; and

means for selecting at least one image processing procedure in accordance with the data indicated by the tags.

56. The system of claim 55, wherein the means for obtaining data further comprises means for obtaining proximity information from the tag when the tag is responsive to the proximity of other tags and when the tag is arranged to transmit the proximity information pertaining to other tags in its vicinity.

57. The system of claim 55, wherein the means for obtaining data further comprises means for obtaining address information form the tag pointing to an address where information concerning the object is available.

58. The system of claim 55, wherein the means for obtaining data further comprises means for obtaining information from the tag relating to at least one physical property of the object.

59. The system of claim 55, wherein the means for obtaining data further comprises means for obtaining appearance information from the tag relating to an appearance of the object.

60. The system of claim 55, wherein the means for obtaining data further comprises means for obtaining information from the tag relating to other objects that have a significant probability of being in the vicinity of the tagged object.

61. The system of claim 55, wherein the means for obtaining data further comprises means for obtaining position information from the tag relating to a position of the tag on the object.

62. The system of claim 55, wherein the means for obtaining data further comprises means for obtaining motion information from the tag when the tag is responsive to a motion of the object.

63. The system of claim 55, wherein the means for obtaining data further comprises means for obtaining orientation information from the tag when the tag is responsive to an orientation of the object.

64. A program for processing an image stored on computer-readable medium, the program comprising logic configured to perform:

obtaining an electronic image from an input device;

determining data concerning the properties of at least one object within the image by virtue of information encoded by tags associated with those objects;

selecting at least one image processing procedure in accordance with the data indicated by the tags; and

processing the electronic image in accordance with the selected image processing procedure.

65. The program of claim 64, wherein the program further comprises logic configured to adjust colour of a portion of the object based upon information from the tag.

66. The program of claim 64, wherein the program further comprises logic configured to adjust orientation of the object based upon information from the tag.

67. The program of claim 64, wherein the program further comprises logic configured to adjust position of the object based upon information from the tag.

68. The program of claim 64, wherein the program further comprises logic configured to determine associated information pertaining to the object based upon information from the tag.