Virtual map system and method for tracking objects

• US 6,377,296 B1
• Filed: 01/28/1999
• Issued: 04/23/2002
• Est. Priority Date: 01/28/1999
• Status: Expired due to Term

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: International Business Machines Corporation
• Inventors: Kanevsky, Dimitri, Zlatsin, Alexander
• Primary Examiner(s): Le, Vu
• Assistant Examiner(s): Philippe, Gims
• Application Number:
  US09/238,845
• Time in Patent Office: 1,181 Days
• Field of Search: H04/N.718, 348/94, 348/116, 348/139, 348/143, 348/150, 348/151, 348/152, 348/153, 348/155, 348/159, 348/161, 348/169, 348/170, 382/103, 707/27, 707/8, 386/38, 386/39, 386/106, 386/96, 345/328, 345/520, 704/260, 704/270, 704/275
• US Class Current: 348/143
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

A system, for automatically tracking objects, including a computer processor and memory, cameras and other sensors and a user interface. A user registers an object with the system by presenting the object to a camera, which produces an image of the object, and describing the object through a user interface. Based on an analysis of the image and the description provided by the user, an object identifier/tracker determines the attributes of the object, classifies the object according to the attributes, and indexes and stores the image in a database. The system will thereafter track the location of the object. Subsequently, the user can query the system to search the database to obtain information regarding the object.

Claims

1. A system for tracking an item, comprising:

a camera for monitoring a space within which said item is located, and for producing an image of said item;

object identifier/tracker means, for (a) receiving said image, (b) registering said item and logging a location of said item in said space, and (c) updating said logged location if said location in said space changes;

database means, coupled to said object identifier/tracker means, for storing data representative of said item and said logged location;

user interface means for (a) accepting a descriptor of said item, wherein said descriptor is used by said object identifier/tracker means when registering said item, and (b) accepting a request regarding said item;

a search means for formulating and passing a query to said database means based on said request, and for retrieving a result from said database means, said result indicating said logged location of said item; and

output means for reporting said result.

2. The system of claim 1, further comprising a gesture recognition means, coupled to said camera, for monitoring and interpreting a gesture of a user, and, based on said gesture, providing a directive to said object identifier/tracker means initiating said registration of said item.

3. The system of claim 1, further comprising one or more sensors, coupled to said object identifier/tracker means, for indicating motion of an object in a subset of said space.

4. The system of claim 1, wherein said object identifier/tracker means classifies one or more attributes of said item selected from the group consisting of name, priority, color, form, size, time stamp, and ownership.

5. The system of claim 4, wherein said data representative of said attributes is stored in one or more formats selected from the group consisting of text, picture, and audio.

6. The system of claim 1, wherein said user interface means includes at least one of a keyboard, a handwriting recognition module, an optical character recognition module and a speech recognition module.

7. The system of claim 6, further comprising a semantic module coupled to said speech recognition means, for analyzing a spoken phrase to assist said search means when formulating said query.

8. The system of claim 7,

wherein said semantic module recognizes a voice as that of a particular individual, and

wherein said object identifier/tracker means associates said item with said particular individual.

9. The system of claim 1, further comprising a speaker means for communicating audible sounds to a user, and a dialog module for engaging in a spoken dialog with said user.

10. The system of claim 1, wherein said database means further comprises a virtual map of said space, and said output means comprises a display means for displaying an image of said item represented at said logged location on said virtual map.

11. The system of claim 10, wherein said user interface means further comprises a navigation means for modifying said displayed image, including the ability to cause said displayed image to move left, move right, move up, move down, zoom in and zoom out.

12. The system of claim 1, wherein said database means further comprises a virtual map of said space, and said user interface means comprises a controller means, said controller means comprising:

a speech recognition module for accepting a spoken phrase from a user;

speaker means for communicating audible sounds to said user;

display means for displaying an image of said item represented at said logged location on said virtual map;

navigation means for modifying said displayed image, including the ability to cause said displayed image to move left, move right, move up, move down, zoom in and zoom out.

13. The system of claim 1, further comprising:

means for connecting to a computer network,

wherein said camera further comprises means for connecting to said computer network for remote communication with said system, and

wherein said user interface means further comprises means for connecting to said computer network for remote communication with said system.

14. A computer-implemented method for tracking an item, said method comprising the steps of:

monitoring a space within which said item is located and producing a first image of said item;

acquiring a descriptor of said item;

registering said item and logging a location of said item in said space based on said first image and said descriptor;

storing data representative of said item and said logged location to a storage media;

monitoring said item and producing a second image of said item;

identifying said location of said item based on said second image;

updating said stored data representative of said logged location in a case where said location changes;

accepting a request regarding said item;

searching said storage media based on said request and retrieving said data representative of said logged location; and

reporting a result of said search.