Methods, functional Data, and Systems for image feature translation

• US 7,242,806 B2
• Filed: 01/23/2002
• Issued: 07/10/2007
• Est. Priority Date: 01/23/2002
• Status: Active Grant

• Current Assignee: Honeywell Incorporated (Honeywell International Inc.)
• Original Assignee: Honeywell International Inc.
• Inventors: Johnson, Michael, Henderson, Thomas A., Hamza, Rida M., Kwong, Au W.
• Primary Examiner(s): Mehta; Bhavesh M
• Assistant Examiner(s): STREGE, JOHN B
• Application Number:
  US10/055,876
• Publication Number:
  US 20030138146A1
• Time in Patent Office: 1,994 Days
• Field of Search: 382/209, 382/217, 382/218, 348/160
• US Class Current: 382/209
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 2207/30268 Vehicle interior
• CPC Class Codes: G06T 7/001 using an image reference approach
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/59 inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 2201/02 Recognising information on displays, dials, clocks

Abstract

Methods, functional data, and systems are provided for image feature translation. An image is decomposed into sub images, each sub image having its features identified by feature attributes. The feature attributes are used to identify a particular feature within each sub image. The orientation of the particular feature within the sub image is then mapped or calculated to a value. One or more of the mapped or calculated values are translated into a reading associated with an instrument. The reading is then optionally recorded or transmitted.

Claims

1. A method of processing an image, comprising:

receiving one or more sub images within an image;

separating each sub image from the image;

associating a template with each sub image;

using one or more feature vectors associated with each template to locate one or more features within each of the sub images each feature represented by three pixel coordinates from the sub image being examined, wherein each of the feature vectors is represented as a collection of three pixel coordinates for each sub image, wherein a first pixel coordinate represents a center or origin of the sub image being examined, a second pixel coordinate represents an edge coordinate along a x-axis extending eastward or westward from the origin, and a third pixel coordinate represents a different edge coordinate along a y-axis extending northward or southward from the origin, and wherein each sub image graphically representing an instrument that has a visual reading captured and depicted within the sub image, and a geometric shape for each instrument also reflected in each of the feature vectors to which it relates along with its coverage attributes within the image, wherein the geometric shape and the coverage attributes are derivable from the three pixel coordinates associated with the sub image being examined and defined in the sub image'"'"'s feature vector; and

processing one or more rules associated with one or more of the located features acquired from each of the feature vectors to derive a particular visual reading for a particular sub image representing a particular instrument depicted in the image, wherein each located feature is acquired by comparing the three pixel coordinates identified in the particular sub image to each of the feature vectors and each feature vector'"'"'s three pixel coordinates.

2. The method of claim 1 further comprising calculating an instrument reading from one or more of the located features using one or more of the associated rules.

3. The method of claim 2 further comprising electronically transmitting the instrument reading.

4. The method of claim 3 wherein the instrument reading is associated with one of the sub images, which represents a picture of an instrument panel.

5. The method of claim 1 further comprising, periodically repeating all the steps.

6. The method of claim 5 wherein a period to repeat the steps is customizable.

7. A method of converting an instrument reading to digital information storage on a computer readable medium, comprising:

receiving an electronic image of an instrument having one or more image features necessary for resolving an instrument reading;

isolating each image feature within the image by comparing three pixel coordinates of each isolated image to its own feature vector, wherein each feature vector is a collection of at least three pixel coordinates for each isolated image, wherein a first pixel coordinate represents an origin coordinate for the isolated image being examined, a second pixel coordinate represents an eastward or westward coordinate extending from the origin coordinate, and a third pixel coordinate representing a northward or southward coordinate extending from the origin coordinate, and each isolated image representing a graphical symbol, and a shape for each graphical symbol also reflected in the feature vector to which it relates along with its coverage attributes within the electronic image, wherein the graphical symbol and the coverage attributes for any given isolated image is derivable from the corresponding at least three pixel coordinates defined in the given isolated image'"'"'s feature vector;

mapping or calculating each isolated image feature to its own value using each feature'"'"'s at least three sampled coordinates, the value associated with each isolated image feature'"'"'s orientation within the image; and

determining the instrument reading by performing a calculation on the values in response to each isolated image'"'"'s feature vector.

8. The method of claim 7 further comprising calibrating the isolating step one time before capturing the image.

9. The method of claim 8 further comprising determining an degree of angular orientation associated with calibrating and using the angular orientation in isolating each image feature.

10. The method of claim 7, wherein the instrument is a control panel. one of an aircraft, a marine vehicle, and a land vehicle.

11. The method of claim 10 wherein the control is associated with at least one of an aircraft, a marine vehicle, and a land vehicle.