ROBUST OBJECT RECOGNITION BY DYNAMIC MODELING IN AUGMENTED REALITY
First Claim
Patent Images
1. A method for performing object recognition in Augmented Reality (AR) systems, the method comprising:
- converting a two dimensional image of an object to an image domain representation;
defining an attributed graph in the image domain based on links between nodes of the image domain representation;
defining another attributed graph in a model domain; and
matching the attributed graphs in the image and model domains by identifying and activating links between corresponding nodes of the attributed graphs.
3 Assignments
0 Petitions
Accused Products
Abstract
Technologies are generally described for providing a robust object recognition scheme based on dynamic modeling. Correlations in fine scale temporal structure of cellular regions may be employed to group the regions together into higher-order entities. The entities represent a rich structure and may be used to code high level objects. Object recognition may be formatted as elastic graph matching.
36 Citations
30 Claims
-
1. A method for performing object recognition in Augmented Reality (AR) systems, the method comprising:
-
converting a two dimensional image of an object to an image domain representation; defining an attributed graph in the image domain based on links between nodes of the image domain representation; defining another attributed graph in a model domain; and matching the attributed graphs in the image and model domains by identifying and activating links between corresponding nodes of the attributed graphs. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. An apparatus for performing object recognition in Augmented Reality (AR) systems, the apparatus comprising:
-
a memory adapted to store image data and graph data; a first processing unit adapted to execute a dynamic modeling module, wherein the dynamic modeling module is adapted to; transform a two dimensional (2D) image from the stored image data to an image domain representation comprising a 2D array of linked nodes with each node encoding at least one distinct feature in image domain; determine vertex labels representing activity vectors of the at least one feature for each node in the image domain; determine edge labels representing connectivity between the nodes of the image domain; and define an attributed graph in model domain based on one or more of the vertex labels and/or the edge labels, the attributed graph being stored in the memory as part of the graph data; and a second processing unit adapted to execute a graph matching module, wherein the graph matching module is adapted to; identify and activate links between the nodes in the image domain and corresponding nodes in the model domain; and reduce a number of connections between nodes with similar features. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17)
-
-
18. A computer-readable storage medium having instructions stored thereon for performing object recognition in Augmented Reality (AR) systems, the instructions comprising:
-
converting a two dimensional image of an object to an image domain representation comprising a plurality of linked nodes, each node including a set of feature detectors; determining vertex labels that represent activity vectors of the feature detectors by applying the feature detectors to each pixel of the two dimensional image; determining edge labels that represent connectivity between the nodes by detecting links between each node; generating an attributed graph in the image domain based on the vertex and edge labels; defining an attributed graph in model domain, wherein the attributed graph in the model domain is an idealized copy of the attributed graph in the image domain; determining connections between the attributed graphs in the image domain and the model domain based on matching vertex labels and edge labels of the attributed graphs; and reducing the connections to a topology-preserving mapping between the image domain and the model domain. - View Dependent Claims (19, 20, 21, 22, 23, 24, 25)
-
-
26. A system for performing object recognition in Augmented Reality (AR) systems, comprising:
-
at least one sensor adapted to capture a two dimensional (2D) image of a real scene; an image processing server adapted to convert the 2D image to an image domain representation comprising a 2D array of nodes in the image domain, each node including a set of feature detectors; a reality server adapted to; determine vertex labels representing activity vectors of the at least one feature for each node in the image domain; determine edge labels representing connectivity between the nodes of the image domain; define an attributed graph in the image domain and another attributed graph in model domain based on the vertex and edge labels; identify and activate links between the nodes in the image domain and corresponding nodes in the model domain; reduce a number of connections between nodes with similar features; and an image generation server adapted to generate an augmented scene by overlaying the 2D image and a virtual image rendered based on the reduced connections between the attributed graph in the image domain and the other attributed graph in the image domain. - View Dependent Claims (27, 28, 29, 30)
-
Specification